2024-04-03T03:25:00.086 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-03T03:25:00.087 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_cbodley@teuthology --name cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi --verbose --archive /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874 --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/orig.config.yaml 2024-04-03T03:25:00.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T03:25:00.219 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874 branch: wip-cbodley-testing description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7637874' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cbodley-testing ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 888a4a757aa90aa5ed4fb3291576474bc07507ce ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 888a4a757aa90aa5ed4fb3291576474bc07507ce openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley-testing sha1: 888a4a757aa90aa5ed4fb3291576474bc07507ce owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4379 sha1: 888a4a757aa90aa5ed4fb3291576474bc07507ce sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_888a4a757aa90aa5ed4fb3291576474bc07507ce/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 888a4a757aa90aa5ed4fb3291576474bc07507ce targets: smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFLgZ6zNouvHIjgv2P77XxyefnUSV3rLK0sfVfL+8JEn65Gu0Y7QNLktBsCBHDPibdl+QzzrV7J/PAImqYFj4aA= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDe9QW5qhbgo38kVyahGLMl0uKnW4+nvI8vXE9zS2067sunmND40vD69pCYCHUDkdh1cmlt+SE0nSU7gK3qg6D4= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-04-03_02:50:19 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-03T03:25:00.219 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_888a4a757aa90aa5ed4fb3291576474bc07507ce/qa; will attempt to use it 2024-04-03T03:25:00.220 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_888a4a757aa90aa5ed4fb3291576474bc07507ce/qa/tasks 2024-04-03T03:25:00.220 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-03T03:25:00.222 INFO:teuthology.task.internal:Checking packages... 2024-04-03T03:25:00.245 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '888a4a757aa90aa5ed4fb3291576474bc07507ce' 2024-04-03T03:25:00.246 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-03T03:25:00.246 INFO:teuthology.packaging:ref: None 2024-04-03T03:25:00.246 INFO:teuthology.packaging:tag: None 2024-04-03T03:25:00.246 INFO:teuthology.packaging:branch: wip-cbodley-testing 2024-04-03T03:25:00.246 INFO:teuthology.packaging:sha1: 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:25:00.246 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cbodley-testing 2024-04-03T03:25:00.509 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2594-g888a4a75-1jammy 2024-04-03T03:25:00.510 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-03T03:25:00.518 INFO:teuthology.task.internal:no buildpackages task found 2024-04-03T03:25:00.518 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-03T03:25:00.524 INFO:teuthology.task.internal:Saving configuration 2024-04-03T03:25:00.543 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-03T03:25:00.548 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-03T03:25:00.575 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-03 03:19:22.102134', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJ9SSHcCR/Cj7PsBr7jsOAhkfNnF29fsDS0PtWYTcp/J'} 2024-04-03T03:25:00.597 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-03 03:19:22.103603', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINZTvI4yTQ729xl2x3We7lCXBNITxy4drNok7Miw49Te'} 2024-04-03T03:25:00.598 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-03T03:25:00.604 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-03T03:25:00.604 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-03T03:25:00.604 INFO:teuthology.run_tasks:Running task console_log... 2024-04-03T03:25:00.676 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca4a6ab280>, signals=[15]) 2024-04-03T03:25:00.676 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-03T03:25:00.682 INFO:teuthology.task.internal:Opening connections... 2024-04-03T03:25:00.682 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T03:25:00.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:25:00.766 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T03:25:00.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:25:00.845 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-03T03:25:00.851 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-04-03T03:25:00.857 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-04-03T03:25:00.857 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-03T03:25:00.904 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04" 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-03T03:25:00.905 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy 2024-04-03T03:25:00.906 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-03T03:25:00.926 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-04-03T03:25:00.931 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-04-03T03:25:00.932 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Ubuntu" 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="22.04" 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_CODENAME=jammy 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:ID=ubuntu 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE=debian 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-03T03:25:00.979 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-03T03:25:00.980 INFO:teuthology.orchestra.run.smithi130.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-03T03:25:00.980 INFO:teuthology.orchestra.run.smithi130.stdout:UBUNTU_CODENAME=jammy 2024-04-03T03:25:00.980 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-04-03T03:25:01.000 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-03T03:25:01.016 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-03T03:25:01.022 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-03T03:25:01.022 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-04-03T03:25:01.024 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-04-03T03:25:01.028 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-03T03:25:01.035 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-03T03:25:01.035 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-04-03T03:25:01.070 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-04-03T03:25:01.088 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-03T03:25:01.144 INFO:teuthology.run_tasks:Running task kernel... 2024-04-03T03:25:01.158 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-03T03:25:01.158 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-03T03:25:01.159 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-03T03:25:01.159 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-03T03:25:01.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:25:01.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:25:01.167 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-04-03T03:25:01.167 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-04-03T03:25:01.213 INFO:teuthology.orchestra.run.smithi104.stdout:5.15.0-56-generic 2024-04-03T03:25:01.214 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.15.0-56-generic 2024-04-03T03:25:01.214 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get clean 2024-04-03T03:25:01.215 INFO:teuthology.orchestra.run.smithi130.stdout:5.15.0-56-generic 2024-04-03T03:25:01.215 INFO:teuthology.task.kernel:Running kernel on smithi130: 5.15.0-56-generic 2024-04-03T03:25:01.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get clean 2024-04-03T03:25:01.349 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get update 2024-04-03T03:25:01.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-04-03T03:25:01.519 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-03T03:25:01.540 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-03T03:25:01.543 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-03T03:25:01.545 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-03T03:25:01.623 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-03T03:25:01.693 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-03T03:25:01.693 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-03T03:25:01.789 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,303 kB] 2024-04-03T03:25:01.811 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [436 kB] 2024-04-03T03:25:01.853 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [602 kB] 2024-04-03T03:25:01.930 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,303 kB] 2024-04-03T03:25:01.946 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,519 kB] 2024-04-03T03:25:01.952 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [436 kB] 2024-04-03T03:25:01.961 INFO:teuthology.orchestra.run.smithi104.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [233 kB] 2024-04-03T03:25:01.967 INFO:teuthology.orchestra.run.smithi104.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-03T03:25:01.967 INFO:teuthology.orchestra.run.smithi104.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-04-03T03:25:01.968 INFO:teuthology.orchestra.run.smithi104.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,616 kB] 2024-04-03T03:25:01.997 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [233 kB] 2024-04-03T03:25:02.008 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-03T03:25:02.008 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,616 kB] 2024-04-03T03:25:02.014 INFO:teuthology.orchestra.run.smithi104.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [271 kB] 2024-04-03T03:25:02.021 INFO:teuthology.orchestra.run.smithi104.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [293 kB] 2024-04-03T03:25:02.022 INFO:teuthology.orchestra.run.smithi104.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-03T03:25:02.022 INFO:teuthology.orchestra.run.smithi104.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-03T03:25:02.028 INFO:teuthology.orchestra.run.smithi104.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-03T03:25:02.042 INFO:teuthology.orchestra.run.smithi104.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-04-03T03:25:02.044 INFO:teuthology.orchestra.run.smithi104.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,644 kB] 2024-04-03T03:25:02.047 INFO:teuthology.orchestra.run.smithi104.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-04-03T03:25:02.054 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-03T03:25:02.060 INFO:teuthology.orchestra.run.smithi104.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-03T03:25:02.063 INFO:teuthology.orchestra.run.smithi104.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-03T03:25:02.064 INFO:teuthology.orchestra.run.smithi104.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-03T03:25:02.065 INFO:teuthology.orchestra.run.smithi104.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-04-03T03:25:02.066 INFO:teuthology.orchestra.run.smithi104.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-04-03T03:25:02.074 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-04-03T03:25:02.074 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [271 kB] 2024-04-03T03:25:02.080 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-03T03:25:02.081 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-03T03:25:02.093 INFO:teuthology.orchestra.run.smithi104.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [274 kB] 2024-04-03T03:25:02.098 INFO:teuthology.orchestra.run.smithi104.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-03T03:25:02.098 INFO:teuthology.orchestra.run.smithi104.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-04-03T03:25:02.102 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-04-03T03:25:02.110 INFO:teuthology.orchestra.run.smithi104.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-04-03T03:25:02.110 INFO:teuthology.orchestra.run.smithi104.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-03T03:25:02.126 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-03T03:25:02.127 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-03T03:25:02.127 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-04-03T03:25:02.127 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-03T03:25:02.135 INFO:teuthology.orchestra.run.smithi104.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-04-03T03:25:02.137 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-04-03T03:25:02.137 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-03T03:25:02.138 INFO:teuthology.orchestra.run.smithi104.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-03T03:25:02.138 INFO:teuthology.orchestra.run.smithi104.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-03T03:25:02.139 INFO:teuthology.orchestra.run.smithi104.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.6 kB] 2024-04-03T03:25:02.140 INFO:teuthology.orchestra.run.smithi104.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.0 kB] 2024-04-03T03:25:02.144 INFO:teuthology.orchestra.run.smithi104.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-03T03:25:02.144 INFO:teuthology.orchestra.run.smithi104.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-03T03:25:02.145 INFO:teuthology.orchestra.run.smithi104.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-03T03:25:02.146 INFO:teuthology.orchestra.run.smithi104.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-03T03:25:02.165 INFO:teuthology.orchestra.run.smithi104.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-03T03:25:02.165 INFO:teuthology.orchestra.run.smithi104.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-03T03:25:02.165 INFO:teuthology.orchestra.run.smithi104.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-03T03:25:02.166 INFO:teuthology.orchestra.run.smithi104.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-03T03:25:02.166 INFO:teuthology.orchestra.run.smithi104.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-03T03:25:02.191 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,519 kB] 2024-04-03T03:25:02.494 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [602 kB] 2024-04-03T03:25:02.534 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [293 kB] 2024-04-03T03:25:02.549 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-03T03:25:02.550 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-04-03T03:25:02.551 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,644 kB] 2024-04-03T03:25:02.610 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [274 kB] 2024-04-03T03:25:02.617 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-03T03:25:02.901 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-04-03T03:25:03.486 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,060 kB] 2024-04-03T03:25:03.596 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-04-03T03:25:03.616 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-03T03:25:03.618 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.6 kB] 2024-04-03T03:25:03.621 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-03T03:25:03.622 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.0 kB] 2024-04-03T03:25:03.623 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-03T03:25:03.623 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-03T03:25:03.627 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-03T03:25:03.632 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-03T03:25:03.806 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-03T03:25:03.888 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-03T03:25:03.970 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-03T03:25:04.052 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-03T03:25:04.079 INFO:teuthology.orchestra.run.smithi130.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-03T03:25:07.610 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 12.6 MB in 2s (6,835 kB/s) 2024-04-03T03:25:08.385 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 12.6 MB in 3s (4,753 kB/s) 2024-04-03T03:25:08.932 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-04-03T03:25:08.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-03T03:25:09.011 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-04-03T03:25:09.207 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-04-03T03:25:09.208 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-04-03T03:25:09.380 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages were automatically installed and are no longer required: 2024-04-03T03:25:09.380 INFO:teuthology.orchestra.run.smithi104.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-03T03:25:09.380 INFO:teuthology.orchestra.run.smithi104.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-03T03:25:09.381 INFO:teuthology.orchestra.run.smithi104.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-03T03:25:09.381 INFO:teuthology.orchestra.run.smithi104.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-03T03:25:09.381 INFO:teuthology.orchestra.run.smithi104.stdout: python2.7-minimal 2024-04-03T03:25:09.381 INFO:teuthology.orchestra.run.smithi104.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-03T03:25:09.382 INFO:teuthology.orchestra.run.smithi104.stdout:The following additional packages will be installed: 2024-04-03T03:25:09.382 INFO:teuthology.orchestra.run.smithi104.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-04-03T03:25:09.382 INFO:teuthology.orchestra.run.smithi104.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-04-03T03:25:09.382 INFO:teuthology.orchestra.run.smithi104.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-04-03T03:25:09.384 INFO:teuthology.orchestra.run.smithi104.stdout:Suggested packages: 2024-04-03T03:25:09.384 INFO:teuthology.orchestra.run.smithi104.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-03T03:25:09.384 INFO:teuthology.orchestra.run.smithi104.stdout:Recommended packages: 2024-04-03T03:25:09.384 INFO:teuthology.orchestra.run.smithi104.stdout: thermald 2024-04-03T03:25:09.445 INFO:teuthology.orchestra.run.smithi104.stdout:The following NEW packages will be installed: 2024-04-03T03:25:09.446 INFO:teuthology.orchestra.run.smithi104.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-04-03T03:25:09.446 INFO:teuthology.orchestra.run.smithi104.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-04-03T03:25:09.446 INFO:teuthology.orchestra.run.smithi104.stdout: linux-modules-extra-5.15.0-101-generic 2024-04-03T03:25:09.447 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages will be upgraded: 2024-04-03T03:25:09.448 INFO:teuthology.orchestra.run.smithi104.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-03T03:25:09.512 INFO:teuthology.orchestra.run.smithi104.stdout:3 upgraded, 5 newly installed, 0 to remove and 312 not upgraded. 2024-04-03T03:25:09.512 INFO:teuthology.orchestra.run.smithi104.stdout:Need to get 113 MB of archives. 2024-04-03T03:25:09.513 INFO:teuthology.orchestra.run.smithi104.stdout:After this operation, 582 MB of additional disk space will be used. 2024-04-03T03:25:09.513 INFO:teuthology.orchestra.run.smithi104.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-04-03T03:25:09.786 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-03T03:25:09.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-03T03:25:09.858 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-03T03:25:10.033 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-04-03T03:25:10.034 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-04-03T03:25:10.186 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-04-03T03:25:10.186 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-03T03:25:10.186 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-03T03:25:10.187 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-03T03:25:10.187 INFO:teuthology.orchestra.run.smithi130.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-03T03:25:10.187 INFO:teuthology.orchestra.run.smithi130.stdout: python2.7-minimal 2024-04-03T03:25:10.187 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-03T03:25:10.188 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-04-03T03:25:10.188 INFO:teuthology.orchestra.run.smithi130.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-04-03T03:25:10.188 INFO:teuthology.orchestra.run.smithi130.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-04-03T03:25:10.188 INFO:teuthology.orchestra.run.smithi130.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-04-03T03:25:10.189 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-04-03T03:25:10.189 INFO:teuthology.orchestra.run.smithi130.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-03T03:25:10.189 INFO:teuthology.orchestra.run.smithi130.stdout:Recommended packages: 2024-04-03T03:25:10.189 INFO:teuthology.orchestra.run.smithi130.stdout: thermald 2024-04-03T03:25:10.242 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-04-03T03:25:10.242 INFO:teuthology.orchestra.run.smithi130.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-04-03T03:25:10.242 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-04-03T03:25:10.242 INFO:teuthology.orchestra.run.smithi130.stdout: linux-modules-extra-5.15.0-101-generic 2024-04-03T03:25:10.243 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages will be upgraded: 2024-04-03T03:25:10.244 INFO:teuthology.orchestra.run.smithi130.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-03T03:25:10.422 INFO:teuthology.orchestra.run.smithi130.stdout:3 upgraded, 5 newly installed, 0 to remove and 312 not upgraded. 2024-04-03T03:25:10.422 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 113 MB of archives. 2024-04-03T03:25:10.422 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 582 MB of additional disk space will be used. 2024-04-03T03:25:10.422 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-04-03T03:25:10.508 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-04-03T03:25:10.869 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-04-03T03:25:11.841 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-04-03T03:25:12.197 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-04-03T03:25:12.660 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-04-03T03:25:12.760 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-04-03T03:25:12.760 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-04-03T03:25:12.995 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-04-03T03:25:13.099 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-04-03T03:25:13.496 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 113 MB in 4s (31.0 MB/s) 2024-04-03T03:25:13.649 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-04-03T03:25:14.434 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-04-03T03:25:14.434 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-04-03T03:25:14.435 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-04-03T03:25:15.179 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-04-03T03:25:15.297 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-04-03T03:25:15.634 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-03T03:25:15.638 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-03T03:25:15.713 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 113 MB in 5s (22.4 MB/s) 2024-04-03T03:25:15.754 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:15.915 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-04-03T03:25:17.952 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-03T03:25:17.958 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-03T03:25:18.063 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:18.147 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-04-03T03:25:18.167 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-03T03:25:18.246 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:18.691 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-04-03T03:25:18.712 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-03T03:25:18.749 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:20.615 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-04-03T03:25:20.636 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-03T03:25:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:21.185 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-04-03T03:25:21.206 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-03T03:25:21.243 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:25.126 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-04-03T03:25:25.251 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-03T03:25:25.609 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-04-03T03:25:25.738 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-03T03:25:26.040 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-04-03T03:25:26.051 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-04-03T03:25:26.090 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-04-03T03:25:27.764 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-04-03T03:25:27.922 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-03T03:25:28.289 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-04-03T03:25:28.403 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-03T03:25:28.681 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-04-03T03:25:28.703 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-04-03T03:25:28.747 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-04-03T03:25:31.879 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-04-03T03:25:31.916 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-03T03:25:31.953 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:34.537 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-04-03T03:25:34.662 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-03T03:25:34.914 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-04-03T03:25:34.950 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-04-03T03:25:34.980 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:35.004 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-04-03T03:25:35.117 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:35.235 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-04-03T03:25:35.372 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:36.694 INFO:teuthology.orchestra.run.smithi104.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-03T03:25:36.694 INFO:teuthology.orchestra.run.smithi104.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-03T03:25:36.694 INFO:teuthology.orchestra.run.smithi104.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-04-03T03:25:36.694 INFO:teuthology.orchestra.run.smithi104.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-04-03T03:25:36.867 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:38.334 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:38.528 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-04-03T03:25:38.626 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-04-03T03:25:39.008 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-04-03T03:25:39.130 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:39.272 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-04-03T03:25:39.401 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:39.786 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-04-03T03:25:39.911 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-04-03T03:25:40.037 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:40.106 INFO:teuthology.orchestra.run.smithi104.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-03T03:25:40.106 INFO:teuthology.orchestra.run.smithi104.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-04-03T03:25:40.753 INFO:teuthology.orchestra.run.smithi130.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-03T03:25:40.753 INFO:teuthology.orchestra.run.smithi130.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-03T03:25:40.753 INFO:teuthology.orchestra.run.smithi130.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-04-03T03:25:40.754 INFO:teuthology.orchestra.run.smithi130.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-04-03T03:25:40.912 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:42.338 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:44.189 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-04-03T03:25:44.332 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-04-03T03:25:44.458 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-04-03T03:25:44.526 INFO:teuthology.orchestra.run.smithi130.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-03T03:25:44.527 INFO:teuthology.orchestra.run.smithi130.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-04-03T03:25:53.983 INFO:teuthology.orchestra.run.smithi104.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-03T03:25:53.984 INFO:teuthology.orchestra.run.smithi104.stdout:Sourcing file `/etc/default/grub' 2024-04-03T03:25:53.994 INFO:teuthology.orchestra.run.smithi104.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-03T03:25:54.013 INFO:teuthology.orchestra.run.smithi104.stdout:Generating grub configuration file ... 2024-04-03T03:25:54.269 INFO:teuthology.orchestra.run.smithi104.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-04-03T03:25:54.287 INFO:teuthology.orchestra.run.smithi104.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-04-03T03:25:54.588 INFO:teuthology.orchestra.run.smithi104.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-03T03:25:54.594 INFO:teuthology.orchestra.run.smithi104.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-03T03:25:54.667 INFO:teuthology.orchestra.run.smithi104.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-03T03:25:54.673 INFO:teuthology.orchestra.run.smithi104.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-03T03:25:54.849 INFO:teuthology.orchestra.run.smithi104.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-03T03:25:54.849 INFO:teuthology.orchestra.run.smithi104.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-03T03:25:54.849 INFO:teuthology.orchestra.run.smithi104.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-03T03:25:54.880 INFO:teuthology.orchestra.run.smithi104.stdout:done 2024-04-03T03:25:55.365 DEBUG:teuthology.orchestra.run.smithi104:> dpkg -s linux-image-generic 2024-04-03T03:25:55.387 INFO:teuthology.orchestra.run.smithi104.stdout:Package: linux-image-generic 2024-04-03T03:25:55.387 INFO:teuthology.orchestra.run.smithi104.stdout:Status: install ok installed 2024-04-03T03:25:55.387 INFO:teuthology.orchestra.run.smithi104.stdout:Priority: optional 2024-04-03T03:25:55.387 INFO:teuthology.orchestra.run.smithi104.stdout:Section: kernel 2024-04-03T03:25:55.387 INFO:teuthology.orchestra.run.smithi104.stdout:Installed-Size: 21 2024-04-03T03:25:55.387 INFO:teuthology.orchestra.run.smithi104.stdout:Maintainer: Ubuntu Kernel Team 2024-04-03T03:25:55.387 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: amd64 2024-04-03T03:25:55.388 INFO:teuthology.orchestra.run.smithi104.stdout:Source: linux-meta 2024-04-03T03:25:55.388 INFO:teuthology.orchestra.run.smithi104.stdout:Version: 5.15.0.101.98 2024-04-03T03:25:55.388 INFO:teuthology.orchestra.run.smithi104.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-03T03:25:55.388 INFO:teuthology.orchestra.run.smithi104.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-03T03:25:55.388 INFO:teuthology.orchestra.run.smithi104.stdout:Recommends: thermald 2024-04-03T03:25:55.388 INFO:teuthology.orchestra.run.smithi104.stdout:Description: Generic Linux kernel image 2024-04-03T03:25:55.388 INFO:teuthology.orchestra.run.smithi104.stdout: This package will always depend on the latest generic kernel image 2024-04-03T03:25:55.388 INFO:teuthology.orchestra.run.smithi104.stdout: available. 2024-04-03T03:25:55.388 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-04-03T03:25:55.388 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-03T03:25:55.388 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-03T03:25:55.389 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-03T03:25:55.389 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2024-04-03T03:25:55.389 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get clean 2024-04-03T03:25:55.593 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get update 2024-04-03T03:25:55.718 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-03T03:25:55.835 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-03T03:25:55.912 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-03T03:25:55.994 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-03T03:25:57.121 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-04-03T03:25:57.139 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-03T03:25:57.189 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-04-03T03:25:57.363 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-04-03T03:25:57.364 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-04-03T03:25:57.516 INFO:teuthology.orchestra.run.smithi104.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-04-03T03:25:57.516 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages were automatically installed and are no longer required: 2024-04-03T03:25:57.516 INFO:teuthology.orchestra.run.smithi104.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-03T03:25:57.516 INFO:teuthology.orchestra.run.smithi104.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-03T03:25:57.516 INFO:teuthology.orchestra.run.smithi104.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-03T03:25:57.516 INFO:teuthology.orchestra.run.smithi104.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-03T03:25:57.517 INFO:teuthology.orchestra.run.smithi104.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-03T03:25:57.517 INFO:teuthology.orchestra.run.smithi104.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-03T03:25:57.557 INFO:teuthology.orchestra.run.smithi104.stdout:0 upgraded, 0 newly installed, 0 to remove and 312 not upgraded. 2024-04-03T03:25:57.559 DEBUG:teuthology.orchestra.run.smithi104:> dpkg -s linux-image-generic 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Package: linux-image-generic 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Status: install ok installed 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Priority: optional 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Section: kernel 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Installed-Size: 21 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Maintainer: Ubuntu Kernel Team 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: amd64 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Source: linux-meta 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Version: 5.15.0.101.98 2024-04-03T03:25:57.620 INFO:teuthology.orchestra.run.smithi104.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-03T03:25:57.621 INFO:teuthology.orchestra.run.smithi104.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-03T03:25:57.621 INFO:teuthology.orchestra.run.smithi104.stdout:Recommends: thermald 2024-04-03T03:25:57.621 INFO:teuthology.orchestra.run.smithi104.stdout:Description: Generic Linux kernel image 2024-04-03T03:25:57.621 INFO:teuthology.orchestra.run.smithi104.stdout: This package will always depend on the latest generic kernel image 2024-04-03T03:25:57.621 INFO:teuthology.orchestra.run.smithi104.stdout: available. 2024-04-03T03:25:57.621 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-04-03T03:25:57.665 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.5FaqnxQZxj 2024-04-03T03:25:57.665 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5FaqnxQZxj 2024-04-03T03:25:57.722 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.5FaqnxQZxj 2024-04-03T03:25:57.832 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.5FaqnxQZxj is 10KB 2024-04-03T03:25:57.844 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.5FaqnxQZxj 2024-04-03T03:25:57.849 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-03T03:25:57.900 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:25:57.901 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-03T03:25:57.901 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-03T03:25:57.968 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-04-03T03:25:57.968 DEBUG:teuthology.orchestra.run.smithi104:> sudo update-grub 2024-04-03T03:25:58.423 INFO:teuthology.orchestra.run.smithi130.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-03T03:25:58.424 INFO:teuthology.orchestra.run.smithi130.stdout:Sourcing file `/etc/default/grub' 2024-04-03T03:25:58.445 INFO:teuthology.orchestra.run.smithi130.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-03T03:25:58.469 INFO:teuthology.orchestra.run.smithi130.stdout:Generating grub configuration file ... 2024-04-03T03:25:58.776 INFO:teuthology.orchestra.run.smithi130.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-04-03T03:25:58.790 INFO:teuthology.orchestra.run.smithi130.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-04-03T03:25:59.100 INFO:teuthology.orchestra.run.smithi104.stderr:Sourcing file `/etc/default/grub' 2024-04-03T03:25:59.101 INFO:teuthology.orchestra.run.smithi104.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-03T03:25:59.104 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2024-04-03T03:25:59.122 INFO:teuthology.orchestra.run.smithi130.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-03T03:25:59.127 INFO:teuthology.orchestra.run.smithi130.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-03T03:25:59.202 INFO:teuthology.orchestra.run.smithi130.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-03T03:25:59.209 INFO:teuthology.orchestra.run.smithi130.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-03T03:25:59.279 INFO:teuthology.orchestra.run.smithi104.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-04-03T03:25:59.284 INFO:teuthology.orchestra.run.smithi104.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-04-03T03:25:59.379 INFO:teuthology.orchestra.run.smithi130.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-03T03:25:59.379 INFO:teuthology.orchestra.run.smithi130.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-03T03:25:59.379 INFO:teuthology.orchestra.run.smithi130.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-03T03:25:59.419 INFO:teuthology.orchestra.run.smithi130.stdout:done 2024-04-03T03:25:59.524 INFO:teuthology.orchestra.run.smithi104.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-03T03:25:59.530 INFO:teuthology.orchestra.run.smithi104.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-03T03:25:59.572 INFO:teuthology.orchestra.run.smithi104.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-03T03:25:59.577 INFO:teuthology.orchestra.run.smithi104.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-03T03:25:59.721 INFO:teuthology.orchestra.run.smithi104.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-03T03:25:59.722 INFO:teuthology.orchestra.run.smithi104.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-03T03:25:59.722 INFO:teuthology.orchestra.run.smithi104.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-03T03:25:59.732 INFO:teuthology.orchestra.run.smithi104.stderr:done 2024-04-03T03:25:59.749 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2024-04-03T03:25:59.901 DEBUG:teuthology.orchestra.run.smithi130:> dpkg -s linux-image-generic 2024-04-03T03:25:59.928 INFO:teuthology.orchestra.run.smithi130.stdout:Package: linux-image-generic 2024-04-03T03:25:59.928 INFO:teuthology.orchestra.run.smithi130.stdout:Status: install ok installed 2024-04-03T03:25:59.928 INFO:teuthology.orchestra.run.smithi130.stdout:Priority: optional 2024-04-03T03:25:59.928 INFO:teuthology.orchestra.run.smithi130.stdout:Section: kernel 2024-04-03T03:25:59.928 INFO:teuthology.orchestra.run.smithi130.stdout:Installed-Size: 21 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout:Maintainer: Ubuntu Kernel Team 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: amd64 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout:Source: linux-meta 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout:Version: 5.15.0.101.98 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout:Recommends: thermald 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout:Description: Generic Linux kernel image 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout: This package will always depend on the latest generic kernel image 2024-04-03T03:25:59.929 INFO:teuthology.orchestra.run.smithi130.stdout: available. 2024-04-03T03:25:59.929 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-04-03T03:25:59.929 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-03T03:25:59.930 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-03T03:25:59.930 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-03T03:25:59.930 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2024-04-03T03:25:59.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get clean 2024-04-03T03:26:00.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-04-03T03:26:00.405 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-03T03:26:00.405 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-03T03:26:00.478 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-03T03:26:00.560 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-03T03:26:01.761 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-03T03:26:01.778 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-03T03:26:01.827 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-03T03:26:02.003 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-04-03T03:26:02.004 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-04-03T03:26:02.156 INFO:teuthology.orchestra.run.smithi130.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-04-03T03:26:02.156 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-04-03T03:26:02.157 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-03T03:26:02.157 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-03T03:26:02.157 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-03T03:26:02.157 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-03T03:26:02.157 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-03T03:26:02.157 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-03T03:26:02.195 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 0 newly installed, 0 to remove and 312 not upgraded. 2024-04-03T03:26:02.197 DEBUG:teuthology.orchestra.run.smithi130:> dpkg -s linux-image-generic 2024-04-03T03:26:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:Package: linux-image-generic 2024-04-03T03:26:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:Status: install ok installed 2024-04-03T03:26:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:Priority: optional 2024-04-03T03:26:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:Section: kernel 2024-04-03T03:26:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:Installed-Size: 21 2024-04-03T03:26:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:Maintainer: Ubuntu Kernel Team 2024-04-03T03:26:02.258 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: amd64 2024-04-03T03:26:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:Source: linux-meta 2024-04-03T03:26:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:Version: 5.15.0.101.98 2024-04-03T03:26:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-03T03:26:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-03T03:26:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:Recommends: thermald 2024-04-03T03:26:02.259 INFO:teuthology.orchestra.run.smithi130.stdout:Description: Generic Linux kernel image 2024-04-03T03:26:02.259 INFO:teuthology.orchestra.run.smithi130.stdout: This package will always depend on the latest generic kernel image 2024-04-03T03:26:02.260 INFO:teuthology.orchestra.run.smithi130.stdout: available. 2024-04-03T03:26:02.260 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-04-03T03:26:02.302 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.71WNRzTwcp 2024-04-03T03:26:02.303 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub/grub.cfg /tmp/tmp.71WNRzTwcp 2024-04-03T03:26:02.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.71WNRzTwcp 2024-04-03T03:26:02.485 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.71WNRzTwcp is 10KB 2024-04-03T03:26:02.498 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.71WNRzTwcp 2024-04-03T03:26:02.504 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-03T03:26:02.558 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:26:02.559 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-03T03:26:02.559 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-03T03:26:02.651 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-04-03T03:26:02.651 DEBUG:teuthology.orchestra.run.smithi130:> sudo update-grub 2024-04-03T03:26:03.882 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub' 2024-04-03T03:26:03.884 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-03T03:26:03.887 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-04-03T03:26:04.086 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-04-03T03:26:04.093 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-04-03T03:26:04.360 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-03T03:26:04.365 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-03T03:26:04.404 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-03T03:26:04.409 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-03T03:26:04.521 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-03T03:26:04.521 INFO:teuthology.orchestra.run.smithi130.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-03T03:26:04.521 INFO:teuthology.orchestra.run.smithi130.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-03T03:26:04.535 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-04-03T03:26:04.537 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2024-04-03T03:26:29.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-03T03:26:29.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-03T03:26:29.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:26:34.543 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-03T03:26:34.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-03T03:26:34.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:26:48.094 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-03T03:26:52.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-03T03:26:57.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-03T03:26:57.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:27:00.158 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-03T03:27:01.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-03T03:27:01.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:27:05.022 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-03T03:27:12.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-03T03:27:12.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:27:17.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-03T03:27:17.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:27:30.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-03T03:27:35.458 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-03T03:27:45.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-03T03:27:45.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:27:46.444 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-03T03:27:47.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-03T03:27:47.078 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-101-generic"... 2024-04-03T03:27:47.078 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-04-03T03:27:47.125 INFO:teuthology.orchestra.run.smithi104.stdout:5.15.0-101-generic 2024-04-03T03:27:47.126 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-04-03T03:27:47.126 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-03T03:27:47.126 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-03T03:27:48.127 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-03T03:27:48.127 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-03T03:27:48.218 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2024-04-03T03:27:48.251 DEBUG:teuthology.parallel:result is None 2024-04-03T03:27:50.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-03T03:27:50.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:27:50.731 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-04-03T03:27:51.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-03T03:27:51.282 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-101-generic"... 2024-04-03T03:27:51.282 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-04-03T03:27:51.327 INFO:teuthology.orchestra.run.smithi130.stdout:5.15.0-101-generic 2024-04-03T03:27:51.328 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-04-03T03:27:51.328 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-03T03:27:51.328 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-03T03:27:52.329 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-03T03:27:52.329 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-03T03:27:52.674 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2024-04-03T03:27:52.697 DEBUG:teuthology.parallel:result is None 2024-04-03T03:27:52.698 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-03T03:27:52.706 INFO:teuthology.task.internal:Creating test directory... 2024-04-03T03:27:52.706 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-03T03:27:52.708 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-03T03:27:52.714 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-03T03:27:52.720 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-03T03:27:52.730 INFO:teuthology.task.internal:Creating archive directory... 2024-04-03T03:27:52.730 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-03T03:27:52.755 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-03T03:27:52.785 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-03T03:27:52.792 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-03T03:27:52.792 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-03T03:27:52.815 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-03T03:27:52.835 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-03T03:27:52.843 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-03T03:27:52.843 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-03T03:27:52.852 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-03T03:27:52.854 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-03T03:27:52.861 INFO:teuthology.task.internal:Configuring sudo... 2024-04-03T03:27:52.861 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-03T03:27:52.891 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-03T03:27:52.908 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-03T03:27:52.917 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-03T03:27:52.917 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-03T03:27:52.947 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-03T03:27:52.956 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-03T03:27:52.998 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-03T03:27:53.046 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:27:53.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-03T03:27:53.105 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-03T03:27:53.110 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-03T03:27:53.156 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:27:53.156 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-03T03:27:53.226 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-04-03T03:27:53.228 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-04-03T03:27:53.302 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-03T03:27:53.310 INFO:teuthology.task.internal:Starting timer... 2024-04-03T03:27:53.310 INFO:teuthology.run_tasks:Running task pcp... 2024-04-03T03:27:53.325 INFO:teuthology.run_tasks:Running task selinux... 2024-04-03T03:27:53.332 DEBUG:teuthology.task.selinux:Excluding smithi104: OS 'ubuntu' does not support SELinux 2024-04-03T03:27:53.332 DEBUG:teuthology.task.selinux:Excluding smithi130: OS 'ubuntu' does not support SELinux 2024-04-03T03:27:53.333 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-03T03:27:53.333 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-03T03:27:53.333 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-03T03:27:53.333 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-03T03:27:53.341 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-03T03:27:53.347 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-03T03:27:53.469 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-03T03:27:53.485 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-03T03:27:53.487 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi104.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-03T03:34:53.628 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi104.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2024-04-03T03:34:53.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-03T03:34:53.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:34:53.711 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-03T03:34:53.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-03T03:34:53.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-03T03:34:53.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-03T03:34:53.869 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-04-03T03:34:53.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-03T03:34:53.942 INFO:teuthology.run_tasks:Running task clock... 2024-04-03T03:34:53.952 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-03T03:34:53.953 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-03T03:34:53.953 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-03T03:34:53.955 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-03T03:34:53.956 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-03T03:34:53.986 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-03T03:34:53.986 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: Command line: ntpd -gq 2024-04-03T03:34:53.986 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: ---------------------------------------------------- 2024-04-03T03:34:53.986 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: ntp-4 is maintained by Network Time Foundation, 2024-04-03T03:34:53.986 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-03T03:34:53.986 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: corporation. Support and training for ntp-4 are 2024-04-03T03:34:53.986 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: available at https://www.nwtime.org/support 2024-04-03T03:34:53.986 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: ---------------------------------------------------- 2024-04-03T03:34:53.987 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: proto: precision = 0.045 usec (-24) 2024-04-03T03:34:53.987 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: basedate set to 2022-02-04 2024-04-03T03:34:53.987 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: gps base set to 2022-02-06 (week 2196) 2024-04-03T03:34:53.987 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-03T03:34:53.987 INFO:teuthology.orchestra.run.smithi104.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-03T03:34:53.987 INFO:teuthology.orchestra.run.smithi104.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-03T03:34:53.988 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: restrict ::: KOD does nothing without LIMITED. 2024-04-03T03:34:53.988 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: Listen and drop on 0 v6wildcard [::]:123 2024-04-03T03:34:53.988 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-03T03:34:53.989 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: Listen normally on 2 lo 127.0.0.1:123 2024-04-03T03:34:53.989 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: Listen normally on 3 enp3s0f1 172.21.15.104:123 2024-04-03T03:34:53.989 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: Listen normally on 4 lo [::1]:123 2024-04-03T03:34:53.989 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce89%5]:123 2024-04-03T03:34:53.989 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:34:53 ntpd[17161]: Listening on routing socket on fd #22 for interface updates 2024-04-03T03:34:54.011 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: Command line: ntpd -gq 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: ---------------------------------------------------- 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: ntp-4 is maintained by Network Time Foundation, 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: corporation. Support and training for ntp-4 are 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: available at https://www.nwtime.org/support 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: ---------------------------------------------------- 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: proto: precision = 0.045 usec (-24) 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: basedate set to 2022-02-04 2024-04-03T03:34:54.012 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: gps base set to 2022-02-06 (week 2196) 2024-04-03T03:34:54.013 INFO:teuthology.orchestra.run.smithi130.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-03T03:34:54.013 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-03T03:34:54.013 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: restrict ::: KOD does nothing without LIMITED. 2024-04-03T03:34:54.013 INFO:teuthology.orchestra.run.smithi130.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-03T03:34:54.014 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: Listen and drop on 0 v6wildcard [::]:123 2024-04-03T03:34:54.014 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-03T03:34:54.014 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: Listen normally on 2 lo 127.0.0.1:123 2024-04-03T03:34:54.014 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: Listen normally on 3 enp3s0f1 172.21.15.130:123 2024-04-03T03:34:54.014 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: Listen normally on 4 lo [::1]:123 2024-04-03T03:34:54.014 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f37%5]:123 2024-04-03T03:34:54.015 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:34:54 ntpd[17175]: Listening on routing socket on fd #22 for interface updates 2024-04-03T03:34:54.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:54 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:54.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:54 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:54.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:54 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:54.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:54 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:54.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:54 ntpd[17161]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:54.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:54 ntpd[17161]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:55.011 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:55.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:55.014 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:55.014 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:55.014 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:55.014 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:55.014 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:55.014 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:55.014 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:55.014 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:55.015 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:55.015 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:55 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:55.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:55 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:55.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:55 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:55.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:55 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:55.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:55 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:55.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:55 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:55.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:55 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:55.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:55 ntpd[17161]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:55.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:55 ntpd[17161]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:56.011 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:56 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:56.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:56 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:56.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:56 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:56.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:56 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:56.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:56 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:56.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:56 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:56.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:56 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:56.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:56 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:56 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:56 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:56 ntpd[17161]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:56 ntpd[17161]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:57.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:57.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:57 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:57.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:57 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:57.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:57 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:57.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:57 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:57.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:57 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:57.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:57 ntpd[17161]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:57.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:57 ntpd[17161]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:58.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:58 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:58.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:58 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:58.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:58 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:58.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:58 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:58.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:58 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:58.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:58 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:58.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:58.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:58.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:58.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:58.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:58.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:58.988 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:58.988 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:58.988 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:58.988 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:58.988 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:58.988 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:58 ntpd[17161]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:59.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:59.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:34:59 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:34:59.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:59 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:59.986 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:59 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:59.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:59 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:34:59.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:59 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:34:59.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:59 ntpd[17161]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:34:59.987 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:34:59 ntpd[17161]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:35:00.011 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:00 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:35:00.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:00 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:35:00.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:00 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:35:00.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:00 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:35:00.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:00 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:35:00.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:00 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:35:00.990 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:35:00.991 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:35:00.991 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:35:00.991 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:35:00.991 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:35:00.991 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:35:00.991 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:35:00.991 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:35:00.991 INFO:teuthology.orchestra.run.smithi104.stdout: 3 Apr 03:35:00 ntpd[17161]: ntpd: time slew -0.001038 s 2024-04-03T03:35:00.992 INFO:teuthology.orchestra.run.smithi104.stdout:ntpd: time slew -0.001038s 2024-04-03T03:35:00.994 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-03T03:35:00.994 INFO:teuthology.orchestra.run.smithi104.stderr: 3 Apr 03:35:00 ntpd[17161]: can't open /var/log/ntpstats/loopstats.20240403: Permission denied 2024-04-03T03:35:01.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:35:01.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:35:01.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:35:01.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:35:01.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-03T03:35:01.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240403: Permission denied 2024-04-03T03:35:01.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-03T03:35:01.012 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240403: Permission denied 2024-04-03T03:35:01.013 INFO:teuthology.orchestra.run.smithi130.stdout: 3 Apr 03:35:01 ntpd[17175]: ntpd: time slew -0.002236 s 2024-04-03T03:35:01.013 INFO:teuthology.orchestra.run.smithi130.stdout:ntpd: time slew -0.002236s 2024-04-03T03:35:01.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-03T03:35:01.013 INFO:teuthology.orchestra.run.smithi130.stderr: 3 Apr 03:35:01 ntpd[17175]: can't open /var/log/ntpstats/loopstats.20240403: Permission denied 2024-04-03T03:35:01.041 INFO:teuthology.orchestra.run.smithi104.stdout: remote refid st t when poll reach delay offset jitter 2024-04-03T03:35:01.042 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================== 2024-04-03T03:35:01.042 INFO:teuthology.orchestra.run.smithi104.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-03T03:35:01.042 INFO:teuthology.orchestra.run.smithi104.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-03T03:35:01.042 INFO:teuthology.orchestra.run.smithi104.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-03T03:35:01.042 INFO:teuthology.orchestra.run.smithi104.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-03T03:35:01.068 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2024-04-03T03:35:01.068 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2024-04-03T03:35:01.069 INFO:teuthology.orchestra.run.smithi130.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-03T03:35:01.069 INFO:teuthology.orchestra.run.smithi130.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-03T03:35:01.069 INFO:teuthology.orchestra.run.smithi130.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-03T03:35:01.069 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-03T03:35:01.070 INFO:teuthology.run_tasks:Running task install... 2024-04-03T03:35:01.079 DEBUG:teuthology.task.install:project ceph 2024-04-03T03:35:01.080 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '888a4a757aa90aa5ed4fb3291576474bc07507ce'}} 2024-04-03T03:35:01.080 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '888a4a757aa90aa5ed4fb3291576474bc07507ce'} 2024-04-03T03:35:01.080 INFO:teuthology.task.install:Using flavor: default 2024-04-03T03:35:01.093 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-03T03:35:01.093 INFO:teuthology.task.install:extra packages: [] 2024-04-03T03:35:01.094 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-key list | grep Ceph 2024-04-03T03:35:01.095 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-key list | grep Ceph 2024-04-03T03:35:01.151 INFO:teuthology.orchestra.run.smithi104.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-03T03:35:01.170 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-03T03:35:01.180 INFO:teuthology.orchestra.run.smithi104.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-03T03:35:01.180 INFO:teuthology.orchestra.run.smithi104.stdout:uid [ unknown] Ceph.com (release key) 2024-04-03T03:35:01.181 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-03T03:35:01.181 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-04-03T03:35:01.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:35:01.197 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-03T03:35:01.197 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph.com (release key) 2024-04-03T03:35:01.198 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-03T03:35:01.198 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-04-03T03:35:01.198 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:35:01.331 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default/ 2024-04-03T03:35:01.332 INFO:teuthology.task.install.deb:Package version is 19.0.0-2594-g888a4a75-1jammy 2024-04-03T03:35:01.339 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default/ 2024-04-03T03:35:01.339 INFO:teuthology.task.install.deb:Package version is 19.0.0-2594-g888a4a75-1jammy 2024-04-03T03:35:01.453 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:35:01.453 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-03T03:35:01.467 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-04-03T03:35:01.513 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:35:01.513 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-03T03:35:01.527 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get update 2024-04-03T03:35:01.643 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-03T03:35:01.657 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-03T03:35:01.678 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-03T03:35:01.689 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy InRelease 2024-04-03T03:35:01.696 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-03T03:35:01.711 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-03T03:35:01.732 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-03T03:35:01.757 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-03T03:35:01.763 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-03T03:35:01.784 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-04-03T03:35:01.803 INFO:teuthology.orchestra.run.smithi104.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy InRelease 2024-04-03T03:35:01.811 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-03T03:35:01.840 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-03T03:35:01.877 INFO:teuthology.orchestra.run.smithi104.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-03T03:35:01.893 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-03T03:35:01.913 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-03T03:35:01.956 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-04-03T03:35:01.975 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-03T03:35:01.986 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 29.2 kB in 0s (86.0 kB/s) 2024-04-03T03:35:02.110 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 29.2 kB in 0s (71.4 kB/s) 2024-04-03T03:35:02.903 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-03T03:35:02.919 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2594-g888a4a75-1jammy cephadm=19.0.0-2594-g888a4a75-1jammy ceph-mds=19.0.0-2594-g888a4a75-1jammy ceph-mgr=19.0.0-2594-g888a4a75-1jammy ceph-common=19.0.0-2594-g888a4a75-1jammy ceph-fuse=19.0.0-2594-g888a4a75-1jammy ceph-test=19.0.0-2594-g888a4a75-1jammy ceph-volume=19.0.0-2594-g888a4a75-1jammy radosgw=19.0.0-2594-g888a4a75-1jammy python3-rados=19.0.0-2594-g888a4a75-1jammy python3-rgw=19.0.0-2594-g888a4a75-1jammy python3-cephfs=19.0.0-2594-g888a4a75-1jammy python3-rbd=19.0.0-2594-g888a4a75-1jammy libcephfs2=19.0.0-2594-g888a4a75-1jammy libcephfs-dev=19.0.0-2594-g888a4a75-1jammy librados2=19.0.0-2594-g888a4a75-1jammy librbd1=19.0.0-2594-g888a4a75-1jammy rbd-fuse=19.0.0-2594-g888a4a75-1jammy 2024-04-03T03:35:02.978 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-03T03:35:03.016 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-04-03T03:35:03.032 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2594-g888a4a75-1jammy cephadm=19.0.0-2594-g888a4a75-1jammy ceph-mds=19.0.0-2594-g888a4a75-1jammy ceph-mgr=19.0.0-2594-g888a4a75-1jammy ceph-common=19.0.0-2594-g888a4a75-1jammy ceph-fuse=19.0.0-2594-g888a4a75-1jammy ceph-test=19.0.0-2594-g888a4a75-1jammy ceph-volume=19.0.0-2594-g888a4a75-1jammy radosgw=19.0.0-2594-g888a4a75-1jammy python3-rados=19.0.0-2594-g888a4a75-1jammy python3-rgw=19.0.0-2594-g888a4a75-1jammy python3-cephfs=19.0.0-2594-g888a4a75-1jammy python3-rbd=19.0.0-2594-g888a4a75-1jammy libcephfs2=19.0.0-2594-g888a4a75-1jammy libcephfs-dev=19.0.0-2594-g888a4a75-1jammy librados2=19.0.0-2594-g888a4a75-1jammy librbd1=19.0.0-2594-g888a4a75-1jammy rbd-fuse=19.0.0-2594-g888a4a75-1jammy 2024-04-03T03:35:03.095 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-04-03T03:35:03.174 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-04-03T03:35:03.174 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-04-03T03:35:03.293 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-04-03T03:35:03.294 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-04-03T03:35:03.367 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-04-03T03:35:03.367 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-03T03:35:03.367 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-03T03:35:03.367 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-03T03:35:03.368 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-03T03:35:03.368 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-03T03:35:03.368 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-03T03:35:03.368 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-04-03T03:35:03.369 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-03T03:35:03.369 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-03T03:35:03.369 INFO:teuthology.orchestra.run.smithi130.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-03T03:35:03.369 INFO:teuthology.orchestra.run.smithi130.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-03T03:35:03.370 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-03T03:35:03.370 INFO:teuthology.orchestra.run.smithi130.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-03T03:35:03.370 INFO:teuthology.orchestra.run.smithi130.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-03T03:35:03.370 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-03T03:35:03.370 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-03T03:35:03.370 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-03T03:35:03.370 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-03T03:35:03.370 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-03T03:35:03.371 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet zip 2024-04-03T03:35:03.372 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-04-03T03:35:03.372 INFO:teuthology.orchestra.run.smithi130.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-03T03:35:03.372 INFO:teuthology.orchestra.run.smithi130.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-03T03:35:03.372 INFO:teuthology.orchestra.run.smithi130.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-03T03:35:03.372 INFO:teuthology.orchestra.run.smithi130.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-03T03:35:03.372 INFO:teuthology.orchestra.run.smithi130.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-03T03:35:03.372 INFO:teuthology.orchestra.run.smithi130.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-03T03:35:03.372 INFO:teuthology.orchestra.run.smithi130.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-03T03:35:03.372 INFO:teuthology.orchestra.run.smithi130.stdout:Recommended packages: 2024-04-03T03:35:03.373 INFO:teuthology.orchestra.run.smithi130.stdout: btrfs-tools 2024-04-03T03:35:03.472 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-04-03T03:35:03.472 INFO:teuthology.orchestra.run.smithi130.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-03T03:35:03.472 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-03T03:35:03.472 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-03T03:35:03.472 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-03T03:35:03.473 INFO:teuthology.orchestra.run.smithi130.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-03T03:35:03.473 INFO:teuthology.orchestra.run.smithi130.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-03T03:35:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-03T03:35:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-03T03:35:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-03T03:35:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-03T03:35:03.474 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-03T03:35:03.475 INFO:teuthology.orchestra.run.smithi130.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-03T03:35:03.476 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-03T03:35:03.476 INFO:teuthology.orchestra.run.smithi130.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-03T03:35:03.476 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-03T03:35:03.476 INFO:teuthology.orchestra.run.smithi130.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-03T03:35:03.485 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages were automatically installed and are no longer required: 2024-04-03T03:35:03.485 INFO:teuthology.orchestra.run.smithi104.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-03T03:35:03.485 INFO:teuthology.orchestra.run.smithi104.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-03T03:35:03.486 INFO:teuthology.orchestra.run.smithi104.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-03T03:35:03.486 INFO:teuthology.orchestra.run.smithi104.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-03T03:35:03.486 INFO:teuthology.orchestra.run.smithi104.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-03T03:35:03.486 INFO:teuthology.orchestra.run.smithi104.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-03T03:35:03.487 INFO:teuthology.orchestra.run.smithi104.stdout:The following additional packages will be installed: 2024-04-03T03:35:03.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-03T03:35:03.488 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-03T03:35:03.488 INFO:teuthology.orchestra.run.smithi104.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-03T03:35:03.488 INFO:teuthology.orchestra.run.smithi104.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-03T03:35:03.488 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-03T03:35:03.488 INFO:teuthology.orchestra.run.smithi104.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-03T03:35:03.488 INFO:teuthology.orchestra.run.smithi104.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-03T03:35:03.488 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-03T03:35:03.488 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-03T03:35:03.488 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-03T03:35:03.489 INFO:teuthology.orchestra.run.smithi104.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-03T03:35:03.490 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-03T03:35:03.490 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-03T03:35:03.490 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet zip 2024-04-03T03:35:03.490 INFO:teuthology.orchestra.run.smithi104.stdout:Suggested packages: 2024-04-03T03:35:03.491 INFO:teuthology.orchestra.run.smithi104.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-03T03:35:03.491 INFO:teuthology.orchestra.run.smithi104.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-03T03:35:03.491 INFO:teuthology.orchestra.run.smithi104.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-03T03:35:03.491 INFO:teuthology.orchestra.run.smithi104.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-03T03:35:03.491 INFO:teuthology.orchestra.run.smithi104.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-03T03:35:03.491 INFO:teuthology.orchestra.run.smithi104.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-03T03:35:03.491 INFO:teuthology.orchestra.run.smithi104.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-03T03:35:03.491 INFO:teuthology.orchestra.run.smithi104.stdout:Recommended packages: 2024-04-03T03:35:03.491 INFO:teuthology.orchestra.run.smithi104.stdout: btrfs-tools 2024-04-03T03:35:03.539 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 118 newly installed, 0 to remove and 299 not upgraded. 2024-04-03T03:35:03.540 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 179 MB of archives. 2024-04-03T03:35:03.540 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 819 MB of additional disk space will be used. 2024-04-03T03:35:03.540 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-03T03:35:03.592 INFO:teuthology.orchestra.run.smithi104.stdout:The following NEW packages will be installed: 2024-04-03T03:35:03.592 INFO:teuthology.orchestra.run.smithi104.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-03T03:35:03.592 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-03T03:35:03.592 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-03T03:35:03.593 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-03T03:35:03.593 INFO:teuthology.orchestra.run.smithi104.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-03T03:35:03.593 INFO:teuthology.orchestra.run.smithi104.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-03T03:35:03.593 INFO:teuthology.orchestra.run.smithi104.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-03T03:35:03.594 INFO:teuthology.orchestra.run.smithi104.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-03T03:35:03.594 INFO:teuthology.orchestra.run.smithi104.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-03T03:35:03.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-03T03:35:03.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-03T03:35:03.594 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-03T03:35:03.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-03T03:35:03.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-03T03:35:03.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-03T03:35:03.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-03T03:35:03.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-03T03:35:03.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-03T03:35:03.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-03T03:35:03.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-03T03:35:03.595 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-03T03:35:03.596 INFO:teuthology.orchestra.run.smithi104.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-03T03:35:03.596 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-03T03:35:03.596 INFO:teuthology.orchestra.run.smithi104.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-03T03:35:03.596 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-03T03:35:03.596 INFO:teuthology.orchestra.run.smithi104.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-03T03:35:03.647 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-03T03:35:03.649 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-03T03:35:03.670 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-03T03:35:03.691 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2594-g888a4a75-1jammy [3,554 kB] 2024-04-03T03:35:03.737 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-03T03:35:03.742 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-03T03:35:03.755 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-03T03:35:03.758 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-03T03:35:03.759 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-03T03:35:03.760 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-03T03:35:03.768 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-03T03:35:03.771 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-03T03:35:03.773 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-03T03:35:03.774 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-03T03:35:03.778 INFO:teuthology.orchestra.run.smithi104.stdout:0 upgraded, 118 newly installed, 0 to remove and 299 not upgraded. 2024-04-03T03:35:03.778 INFO:teuthology.orchestra.run.smithi104.stdout:Need to get 179 MB of archives. 2024-04-03T03:35:03.778 INFO:teuthology.orchestra.run.smithi104.stdout:After this operation, 819 MB of additional disk space will be used. 2024-04-03T03:35:03.778 INFO:teuthology.orchestra.run.smithi104.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-03T03:35:03.784 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-03T03:35:03.785 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-03T03:35:03.788 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-03T03:35:03.789 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-03T03:35:03.804 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-03T03:35:03.804 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-03T03:35:03.805 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-03T03:35:03.806 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-03T03:35:03.806 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-03T03:35:03.807 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-03T03:35:03.809 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2594-g888a4a75-1jammy [3,554 kB] 2024-04-03T03:35:03.825 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-03T03:35:03.825 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-03T03:35:03.825 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-03T03:35:03.828 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-03T03:35:03.846 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-03T03:35:03.846 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-03T03:35:03.846 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-03T03:35:03.847 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-03T03:35:03.848 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-03T03:35:03.848 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-03T03:35:03.867 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-03T03:35:03.868 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-03T03:35:03.868 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-03T03:35:03.874 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-03T03:35:03.897 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-03T03:35:03.898 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-03T03:35:03.898 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-03T03:35:03.899 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-03T03:35:03.901 INFO:teuthology.orchestra.run.smithi130.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-03T03:35:03.902 INFO:teuthology.orchestra.run.smithi130.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-03T03:35:03.925 INFO:teuthology.orchestra.run.smithi130.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-03T03:35:03.926 INFO:teuthology.orchestra.run.smithi130.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-03T03:35:03.928 INFO:teuthology.orchestra.run.smithi130.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-03T03:35:03.929 INFO:teuthology.orchestra.run.smithi130.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-03T03:35:03.960 INFO:teuthology.orchestra.run.smithi130.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-03T03:35:03.964 INFO:teuthology.orchestra.run.smithi130.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-03T03:35:04.060 INFO:teuthology.orchestra.run.smithi130.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-03T03:35:04.118 INFO:teuthology.orchestra.run.smithi130.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-03T03:35:04.120 INFO:teuthology.orchestra.run.smithi130.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-03T03:35:04.121 INFO:teuthology.orchestra.run.smithi130.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-03T03:35:04.122 INFO:teuthology.orchestra.run.smithi130.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-03T03:35:04.155 INFO:teuthology.orchestra.run.smithi130.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-03T03:35:04.158 INFO:teuthology.orchestra.run.smithi130.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-03T03:35:04.159 INFO:teuthology.orchestra.run.smithi130.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-03T03:35:04.182 INFO:teuthology.orchestra.run.smithi130.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-03T03:35:04.182 INFO:teuthology.orchestra.run.smithi130.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-03T03:35:04.182 INFO:teuthology.orchestra.run.smithi130.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-03T03:35:04.183 INFO:teuthology.orchestra.run.smithi130.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-03T03:35:04.184 INFO:teuthology.orchestra.run.smithi130.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-03T03:35:04.184 INFO:teuthology.orchestra.run.smithi130.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-03T03:35:04.190 INFO:teuthology.orchestra.run.smithi130.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-03T03:35:04.190 INFO:teuthology.orchestra.run.smithi130.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-03T03:35:04.195 INFO:teuthology.orchestra.run.smithi130.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-03T03:35:04.205 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-03T03:35:04.210 INFO:teuthology.orchestra.run.smithi130.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-03T03:35:04.212 INFO:teuthology.orchestra.run.smithi130.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-03T03:35:04.213 INFO:teuthology.orchestra.run.smithi130.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-03T03:35:04.216 INFO:teuthology.orchestra.run.smithi130.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-03T03:35:04.217 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-03T03:35:04.219 INFO:teuthology.orchestra.run.smithi130.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-03T03:35:04.220 INFO:teuthology.orchestra.run.smithi130.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-03T03:35:04.221 INFO:teuthology.orchestra.run.smithi130.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-03T03:35:04.231 INFO:teuthology.orchestra.run.smithi130.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-03T03:35:04.232 INFO:teuthology.orchestra.run.smithi130.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-03T03:35:04.235 INFO:teuthology.orchestra.run.smithi130.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-03T03:35:04.253 INFO:teuthology.orchestra.run.smithi130.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-03T03:35:04.254 INFO:teuthology.orchestra.run.smithi130.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-03T03:35:04.254 INFO:teuthology.orchestra.run.smithi130.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-03T03:35:04.257 INFO:teuthology.orchestra.run.smithi130.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-03T03:35:04.258 INFO:teuthology.orchestra.run.smithi130.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-03T03:35:04.269 INFO:teuthology.orchestra.run.smithi130.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-03T03:35:04.269 INFO:teuthology.orchestra.run.smithi130.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-03T03:35:04.274 INFO:teuthology.orchestra.run.smithi130.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-03T03:35:04.278 INFO:teuthology.orchestra.run.smithi130.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-03T03:35:04.279 INFO:teuthology.orchestra.run.smithi130.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-03T03:35:04.299 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-03T03:35:04.363 INFO:teuthology.orchestra.run.smithi130.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2594-g888a4a75-1jammy [3,224 kB] 2024-04-03T03:35:04.528 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-03T03:35:04.540 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-03T03:35:04.551 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2594-g888a4a75-1jammy [3,224 kB] 2024-04-03T03:35:04.570 INFO:teuthology.orchestra.run.smithi104.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-03T03:35:04.571 INFO:teuthology.orchestra.run.smithi130.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2594-g888a4a75-1jammy [712 kB] 2024-04-03T03:35:04.579 INFO:teuthology.orchestra.run.smithi104.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-03T03:35:04.580 INFO:teuthology.orchestra.run.smithi104.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-03T03:35:04.581 INFO:teuthology.orchestra.run.smithi104.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-03T03:35:04.600 INFO:teuthology.orchestra.run.smithi104.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-03T03:35:04.607 INFO:teuthology.orchestra.run.smithi130.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2594-g888a4a75-1jammy [356 kB] 2024-04-03T03:35:04.632 INFO:teuthology.orchestra.run.smithi130.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2594-g888a4a75-1jammy [32.8 kB] 2024-04-03T03:35:04.634 INFO:teuthology.orchestra.run.smithi130.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2594-g888a4a75-1jammy [180 kB] 2024-04-03T03:35:04.639 INFO:teuthology.orchestra.run.smithi130.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2594-g888a4a75-1jammy [66.7 kB] 2024-04-03T03:35:04.642 INFO:teuthology.orchestra.run.smithi130.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2594-g888a4a75-1jammy [330 kB] 2024-04-03T03:35:04.667 INFO:teuthology.orchestra.run.smithi130.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2594-g888a4a75-1jammy [6,655 kB] 2024-04-03T03:35:04.768 INFO:teuthology.orchestra.run.smithi104.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-03T03:35:04.814 INFO:teuthology.orchestra.run.smithi104.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2594-g888a4a75-1jammy [712 kB] 2024-04-03T03:35:04.861 INFO:teuthology.orchestra.run.smithi104.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2594-g888a4a75-1jammy [356 kB] 2024-04-03T03:35:04.897 INFO:teuthology.orchestra.run.smithi104.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2594-g888a4a75-1jammy [32.8 kB] 2024-04-03T03:35:04.897 INFO:teuthology.orchestra.run.smithi104.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2594-g888a4a75-1jammy [180 kB] 2024-04-03T03:35:04.903 INFO:teuthology.orchestra.run.smithi104.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2594-g888a4a75-1jammy [66.7 kB] 2024-04-03T03:35:04.905 INFO:teuthology.orchestra.run.smithi104.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2594-g888a4a75-1jammy [330 kB] 2024-04-03T03:35:04.941 INFO:teuthology.orchestra.run.smithi104.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2594-g888a4a75-1jammy [6,655 kB] 2024-04-03T03:35:05.076 INFO:teuthology.orchestra.run.smithi130.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2594-g888a4a75-1jammy [112 kB] 2024-04-03T03:35:05.078 INFO:teuthology.orchestra.run.smithi130.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2594-g888a4a75-1jammy [466 kB] 2024-04-03T03:35:05.088 INFO:teuthology.orchestra.run.smithi130.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2594-g888a4a75-1jammy [25.3 MB] 2024-04-03T03:35:05.175 INFO:teuthology.orchestra.run.smithi104.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-03T03:35:05.207 INFO:teuthology.orchestra.run.smithi104.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-03T03:35:05.209 INFO:teuthology.orchestra.run.smithi104.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-03T03:35:05.289 INFO:teuthology.orchestra.run.smithi104.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-03T03:35:05.340 INFO:teuthology.orchestra.run.smithi104.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-03T03:35:05.360 INFO:teuthology.orchestra.run.smithi104.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2594-g888a4a75-1jammy [112 kB] 2024-04-03T03:35:05.362 INFO:teuthology.orchestra.run.smithi104.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-03T03:35:05.369 INFO:teuthology.orchestra.run.smithi104.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-03T03:35:05.370 INFO:teuthology.orchestra.run.smithi104.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-03T03:35:05.381 INFO:teuthology.orchestra.run.smithi104.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-03T03:35:05.382 INFO:teuthology.orchestra.run.smithi104.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-03T03:35:05.387 INFO:teuthology.orchestra.run.smithi104.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2594-g888a4a75-1jammy [466 kB] 2024-04-03T03:35:05.403 INFO:teuthology.orchestra.run.smithi104.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2594-g888a4a75-1jammy [25.3 MB] 2024-04-03T03:35:05.547 INFO:teuthology.orchestra.run.smithi104.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-03T03:35:05.630 INFO:teuthology.orchestra.run.smithi104.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-03T03:35:05.659 INFO:teuthology.orchestra.run.smithi104.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-03T03:35:05.676 INFO:teuthology.orchestra.run.smithi104.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-03T03:35:05.720 INFO:teuthology.orchestra.run.smithi104.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-03T03:35:05.930 INFO:teuthology.orchestra.run.smithi104.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-03T03:35:05.945 INFO:teuthology.orchestra.run.smithi104.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-03T03:35:05.953 INFO:teuthology.orchestra.run.smithi104.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-03T03:35:05.958 INFO:teuthology.orchestra.run.smithi104.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-03T03:35:05.979 INFO:teuthology.orchestra.run.smithi104.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-03T03:35:05.983 INFO:teuthology.orchestra.run.smithi104.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-03T03:35:06.150 INFO:teuthology.orchestra.run.smithi104.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-03T03:35:06.484 INFO:teuthology.orchestra.run.smithi104.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-03T03:35:06.515 INFO:teuthology.orchestra.run.smithi104.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-03T03:35:06.525 INFO:teuthology.orchestra.run.smithi104.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-03T03:35:06.765 INFO:teuthology.orchestra.run.smithi104.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-03T03:35:06.766 INFO:teuthology.orchestra.run.smithi104.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-03T03:35:06.766 INFO:teuthology.orchestra.run.smithi104.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-03T03:35:06.815 INFO:teuthology.orchestra.run.smithi104.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-03T03:35:06.816 INFO:teuthology.orchestra.run.smithi104.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2594-g888a4a75-1jammy [5,087 kB] 2024-04-03T03:35:06.817 INFO:teuthology.orchestra.run.smithi104.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-03T03:35:06.821 INFO:teuthology.orchestra.run.smithi104.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-03T03:35:06.823 INFO:teuthology.orchestra.run.smithi104.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-03T03:35:06.944 INFO:teuthology.orchestra.run.smithi104.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2594-g888a4a75-1jammy [244 kB] 2024-04-03T03:35:06.950 INFO:teuthology.orchestra.run.smithi104.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2594-g888a4a75-1jammy [124 kB] 2024-04-03T03:35:06.954 INFO:teuthology.orchestra.run.smithi104.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2594-g888a4a75-1jammy [1,528 kB] 2024-04-03T03:35:06.989 INFO:teuthology.orchestra.run.smithi104.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-03T03:35:07.024 INFO:teuthology.orchestra.run.smithi104.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2594-g888a4a75-1jammy [6,256 kB] 2024-04-03T03:35:07.254 INFO:teuthology.orchestra.run.smithi104.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-03T03:35:07.337 INFO:teuthology.orchestra.run.smithi104.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2594-g888a4a75-1jammy [22.8 MB] 2024-04-03T03:35:07.432 INFO:teuthology.orchestra.run.smithi104.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-03T03:35:07.446 INFO:teuthology.orchestra.run.smithi104.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-03T03:35:07.465 INFO:teuthology.orchestra.run.smithi104.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-03T03:35:07.530 INFO:teuthology.orchestra.run.smithi104.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-03T03:35:07.573 INFO:teuthology.orchestra.run.smithi130.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2594-g888a4a75-1jammy [5,087 kB] 2024-04-03T03:35:07.822 INFO:teuthology.orchestra.run.smithi104.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-03T03:35:07.824 INFO:teuthology.orchestra.run.smithi104.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-03T03:35:07.827 INFO:teuthology.orchestra.run.smithi104.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-03T03:35:07.827 INFO:teuthology.orchestra.run.smithi104.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-03T03:35:07.829 INFO:teuthology.orchestra.run.smithi104.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-03T03:35:08.045 INFO:teuthology.orchestra.run.smithi104.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-03T03:35:08.097 INFO:teuthology.orchestra.run.smithi130.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2594-g888a4a75-1jammy [244 kB] 2024-04-03T03:35:08.129 INFO:teuthology.orchestra.run.smithi130.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2594-g888a4a75-1jammy [124 kB] 2024-04-03T03:35:08.147 INFO:teuthology.orchestra.run.smithi130.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2594-g888a4a75-1jammy [1,528 kB] 2024-04-03T03:35:08.336 INFO:teuthology.orchestra.run.smithi130.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2594-g888a4a75-1jammy [6,256 kB] 2024-04-03T03:35:08.429 INFO:teuthology.orchestra.run.smithi104.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2594-g888a4a75-1jammy [14.0 kB] 2024-04-03T03:35:08.430 INFO:teuthology.orchestra.run.smithi104.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2594-g888a4a75-1jammy [870 kB] 2024-04-03T03:35:08.446 INFO:teuthology.orchestra.run.smithi104.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2594-g888a4a75-1jammy [2,434 kB] 2024-04-03T03:35:08.490 INFO:teuthology.orchestra.run.smithi104.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2594-g888a4a75-1jammy [791 kB] 2024-04-03T03:35:08.511 INFO:teuthology.orchestra.run.smithi104.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-03T03:35:08.516 INFO:teuthology.orchestra.run.smithi104.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2594-g888a4a75-1jammy [147 kB] 2024-04-03T03:35:08.517 INFO:teuthology.orchestra.run.smithi104.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-03T03:35:08.528 INFO:teuthology.orchestra.run.smithi104.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2594-g888a4a75-1jammy [2,330 kB] 2024-04-03T03:35:08.628 INFO:teuthology.orchestra.run.smithi104.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2594-g888a4a75-1jammy [8,625 kB] 2024-04-03T03:35:08.807 INFO:teuthology.orchestra.run.smithi104.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-03T03:35:08.807 INFO:teuthology.orchestra.run.smithi104.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-03T03:35:08.810 INFO:teuthology.orchestra.run.smithi104.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-03T03:35:08.811 INFO:teuthology.orchestra.run.smithi104.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-03T03:35:08.813 INFO:teuthology.orchestra.run.smithi104.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-03T03:35:08.815 INFO:teuthology.orchestra.run.smithi104.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-03T03:35:08.816 INFO:teuthology.orchestra.run.smithi104.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-03T03:35:08.817 INFO:teuthology.orchestra.run.smithi104.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-03T03:35:08.999 INFO:teuthology.orchestra.run.smithi104.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-03T03:35:09.043 INFO:teuthology.orchestra.run.smithi104.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2594-g888a4a75-1jammy [14.2 kB] 2024-04-03T03:35:09.044 INFO:teuthology.orchestra.run.smithi104.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2594-g888a4a75-1jammy [50.3 MB] 2024-04-03T03:35:09.096 INFO:teuthology.orchestra.run.smithi130.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2594-g888a4a75-1jammy [22.8 MB] 2024-04-03T03:35:09.417 INFO:teuthology.orchestra.run.smithi104.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-03T03:35:09.464 INFO:teuthology.orchestra.run.smithi104.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-03T03:35:09.498 INFO:teuthology.orchestra.run.smithi104.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-03T03:35:09.596 INFO:teuthology.orchestra.run.smithi104.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-03T03:35:09.635 INFO:teuthology.orchestra.run.smithi104.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-03T03:35:09.647 INFO:teuthology.orchestra.run.smithi104.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-03T03:35:09.652 INFO:teuthology.orchestra.run.smithi104.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-03T03:35:09.700 INFO:teuthology.orchestra.run.smithi104.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-03T03:35:09.703 INFO:teuthology.orchestra.run.smithi104.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-03T03:35:09.724 INFO:teuthology.orchestra.run.smithi104.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-03T03:35:09.889 INFO:teuthology.orchestra.run.smithi104.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-03T03:35:10.163 INFO:teuthology.orchestra.run.smithi104.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-03T03:35:10.180 INFO:teuthology.orchestra.run.smithi104.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-03T03:35:10.334 INFO:teuthology.orchestra.run.smithi104.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-03T03:35:10.363 INFO:teuthology.orchestra.run.smithi104.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-03T03:35:10.521 INFO:teuthology.orchestra.run.smithi104.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-03T03:35:10.524 INFO:teuthology.orchestra.run.smithi104.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-03T03:35:10.526 INFO:teuthology.orchestra.run.smithi104.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-03T03:35:10.548 INFO:teuthology.orchestra.run.smithi104.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-03T03:35:10.553 INFO:teuthology.orchestra.run.smithi104.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-03T03:35:11.521 INFO:teuthology.orchestra.run.smithi104.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2594-g888a4a75-1jammy [121 kB] 2024-04-03T03:35:11.524 INFO:teuthology.orchestra.run.smithi104.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2594-g888a4a75-1jammy [38.9 kB] 2024-04-03T03:35:11.525 INFO:teuthology.orchestra.run.smithi104.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2594-g888a4a75-1jammy [13.2 MB] 2024-04-03T03:35:11.780 INFO:teuthology.orchestra.run.smithi130.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2594-g888a4a75-1jammy [14.0 kB] 2024-04-03T03:35:11.780 INFO:teuthology.orchestra.run.smithi130.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2594-g888a4a75-1jammy [870 kB] 2024-04-03T03:35:11.837 INFO:teuthology.orchestra.run.smithi130.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2594-g888a4a75-1jammy [2,434 kB] 2024-04-03T03:35:11.973 INFO:teuthology.orchestra.run.smithi104.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2594-g888a4a75-1jammy [91.2 kB] 2024-04-03T03:35:12.023 INFO:teuthology.orchestra.run.smithi130.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2594-g888a4a75-1jammy [791 kB] 2024-04-03T03:35:12.084 INFO:teuthology.orchestra.run.smithi130.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2594-g888a4a75-1jammy [147 kB] 2024-04-03T03:35:12.087 INFO:teuthology.orchestra.run.smithi130.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2594-g888a4a75-1jammy [2,330 kB] 2024-04-03T03:35:12.249 INFO:teuthology.orchestra.run.smithi130.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2594-g888a4a75-1jammy [8,625 kB] 2024-04-03T03:35:12.524 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 179 MB in 8s (21.3 MB/s) 2024-04-03T03:35:12.688 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-03T03:35:12.789 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-04-03T03:35:12.794 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-03T03:35:12.808 INFO:teuthology.orchestra.run.smithi130.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2594-g888a4a75-1jammy [14.2 kB] 2024-04-03T03:35:12.809 INFO:teuthology.orchestra.run.smithi130.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2594-g888a4a75-1jammy [50.3 MB] 2024-04-03T03:35:12.879 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-03T03:35:13.307 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-03T03:35:13.333 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-03T03:35:13.374 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-03T03:35:13.710 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-03T03:35:13.736 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-03T03:35:13.776 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-03T03:35:14.180 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-03T03:35:14.206 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-03T03:35:14.255 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:35:14.675 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-03T03:35:14.701 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-03T03:35:14.741 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:35:15.069 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-03T03:35:15.095 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-03T03:35:15.136 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:35:15.472 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-03T03:35:15.498 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-03T03:35:15.538 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-03T03:35:15.875 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package librados2. 2024-04-03T03:35:15.901 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../007-librados2_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:15.941 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking librados2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:15.994 INFO:teuthology.orchestra.run.smithi130.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2594-g888a4a75-1jammy [121 kB] 2024-04-03T03:35:15.997 INFO:teuthology.orchestra.run.smithi130.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2594-g888a4a75-1jammy [38.9 kB] 2024-04-03T03:35:15.998 INFO:teuthology.orchestra.run.smithi130.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2594-g888a4a75-1jammy [13.2 MB] 2024-04-03T03:35:16.377 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package librbd1. 2024-04-03T03:35:16.392 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../008-librbd1_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:16.427 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking librbd1 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:16.524 INFO:teuthology.orchestra.run.smithi130.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cbodley-testing/888a4a757aa90aa5ed4fb3291576474bc07507ce/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2594-g888a4a75-1jammy [91.2 kB] 2024-04-03T03:35:16.838 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libcephfs2. 2024-04-03T03:35:16.864 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:16.905 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libcephfs2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:17.085 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 179 MB in 13s (13.7 MB/s) 2024-04-03T03:35:17.174 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-rados. 2024-04-03T03:35:17.200 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:17.218 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-03T03:35:17.240 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-rados (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:17.315 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-04-03T03:35:17.320 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-03T03:35:17.406 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-03T03:35:17.593 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-03T03:35:17.620 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:17.668 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-ceph-argparse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:17.711 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-03T03:35:17.738 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-03T03:35:17.784 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-03T03:35:17.954 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-cephfs. 2024-04-03T03:35:17.969 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:18.012 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-cephfs (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:18.103 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-03T03:35:18.130 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-03T03:35:18.170 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-03T03:35:18.331 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-03T03:35:18.358 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:18.407 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-ceph-common (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:18.607 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-03T03:35:18.633 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-03T03:35:18.681 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:35:18.760 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-03T03:35:18.786 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-03T03:35:18.826 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-03T03:35:19.084 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-03T03:35:19.111 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-03T03:35:19.151 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:35:19.179 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-prettytable. 2024-04-03T03:35:19.205 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-03T03:35:19.254 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-03T03:35:19.504 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-03T03:35:19.523 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-rbd. 2024-04-03T03:35:19.530 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-03T03:35:19.538 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:19.570 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:35:19.573 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-rbd (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:19.890 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-03T03:35:19.916 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-03T03:35:19.918 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-03T03:35:19.944 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-03T03:35:19.957 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-03T03:35:19.984 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-03T03:35:20.226 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librados2. 2024-04-03T03:35:20.252 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../007-librados2_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:20.261 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-03T03:35:20.277 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-03T03:35:20.293 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librados2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:20.320 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-03T03:35:20.614 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-03T03:35:20.630 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-03T03:35:20.672 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-03T03:35:20.745 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librbd1. 2024-04-03T03:35:20.772 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../008-librbd1_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:20.812 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librbd1 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:20.959 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package lua5.1. 2024-04-03T03:35:20.981 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-03T03:35:21.026 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-03T03:35:21.264 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs2. 2024-04-03T03:35:21.290 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:21.328 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package lua-any. 2024-04-03T03:35:21.331 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:21.355 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-03T03:35:21.395 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-03T03:35:21.591 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rados. 2024-04-03T03:35:21.607 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:21.631 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package zip. 2024-04-03T03:35:21.641 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rados (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:21.646 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-03T03:35:21.681 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking zip (3.0-12build2) ... 2024-04-03T03:35:21.967 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package unzip. 2024-04-03T03:35:21.969 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-03T03:35:21.994 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-03T03:35:21.995 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:22.034 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-03T03:35:22.038 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-argparse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:22.271 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cephfs. 2024-04-03T03:35:22.297 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:22.554 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cephfs (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:22.721 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package luarocks. 2024-04-03T03:35:22.748 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-03T03:35:22.788 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-03T03:35:23.154 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package librgw2. 2024-04-03T03:35:23.181 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../025-librgw2_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:23.199 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-03T03:35:23.212 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking librgw2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:23.225 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:23.265 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-common (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:23.593 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-03T03:35:23.620 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-03T03:35:23.660 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-03T03:35:23.731 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-rgw. 2024-04-03T03:35:23.758 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:23.797 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-rgw (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:23.954 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-prettytable. 2024-04-03T03:35:23.971 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-03T03:35:24.004 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-03T03:35:24.134 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-03T03:35:24.161 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-03T03:35:24.200 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-03T03:35:24.215 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rbd. 2024-04-03T03:35:24.242 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:24.273 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rbd (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:24.520 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libradosstriper1. 2024-04-03T03:35:24.547 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:24.586 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libradosstriper1 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:24.617 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-03T03:35:24.644 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-03T03:35:24.684 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-03T03:35:24.956 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-common. 2024-04-03T03:35:24.978 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-03T03:35:24.983 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:24.994 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-03T03:35:25.022 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-common (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:25.036 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-03T03:35:25.331 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-03T03:35:25.357 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-03T03:35:25.397 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-03T03:35:25.692 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua5.1. 2024-04-03T03:35:25.708 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-03T03:35:25.742 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-03T03:35:26.061 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-any. 2024-04-03T03:35:26.077 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-03T03:35:26.122 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-03T03:35:26.344 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-base. 2024-04-03T03:35:26.355 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package zip. 2024-04-03T03:35:26.372 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:26.382 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-03T03:35:26.420 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-base (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:26.422 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking zip (3.0-12build2) ... 2024-04-03T03:35:26.733 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package unzip. 2024-04-03T03:35:26.760 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-03T03:35:26.800 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-03T03:35:27.057 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-03T03:35:27.084 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-03T03:35:27.124 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-03T03:35:27.195 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package luarocks. 2024-04-03T03:35:27.221 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-03T03:35:27.261 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-03T03:35:27.376 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-cheroot. 2024-04-03T03:35:27.403 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-03T03:35:27.435 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-03T03:35:27.627 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librgw2. 2024-04-03T03:35:27.654 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../025-librgw2_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:27.702 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librgw2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:27.721 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-03T03:35:27.736 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-03T03:35:27.779 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-03T03:35:28.090 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-03T03:35:28.117 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-03T03:35:28.157 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-03T03:35:28.196 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rgw. 2024-04-03T03:35:28.212 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:28.254 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rgw (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:28.459 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-03T03:35:28.486 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-03T03:35:28.526 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-03T03:35:28.590 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-03T03:35:28.617 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-03T03:35:28.657 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-03T03:35:28.779 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-tempora. 2024-04-03T03:35:28.794 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-03T03:35:28.829 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-03T03:35:28.968 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libradosstriper1. 2024-04-03T03:35:28.995 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:29.043 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libradosstriper1 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:29.098 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-portend. 2024-04-03T03:35:29.113 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-03T03:35:29.156 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-03T03:35:29.405 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-common. 2024-04-03T03:35:29.405 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-03T03:35:29.420 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-03T03:35:29.432 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:29.455 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-03T03:35:29.462 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-common (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:29.741 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-03T03:35:29.767 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-03T03:35:29.808 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-03T03:35:30.153 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-natsort. 2024-04-03T03:35:30.179 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-03T03:35:30.228 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-03T03:35:30.540 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-logutils. 2024-04-03T03:35:30.566 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-03T03:35:30.605 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-03T03:35:30.734 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-base. 2024-04-03T03:35:30.761 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:30.810 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-base (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:30.933 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-03T03:35:30.960 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-03T03:35:31.000 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-03T03:35:31.269 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-mako. 2024-04-03T03:35:31.284 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-03T03:35:31.319 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-03T03:35:31.388 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-03T03:35:31.415 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-03T03:35:31.455 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-03T03:35:31.614 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-03T03:35:31.641 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-03T03:35:31.681 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-03T03:35:31.681 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cheroot. 2024-04-03T03:35:31.697 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-03T03:35:31.740 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-03T03:35:31.992 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-03T03:35:32.018 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-03T03:35:32.058 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-03T03:35:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-03T03:35:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-03T03:35:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-03T03:35:32.361 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-webob. 2024-04-03T03:35:32.387 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-03T03:35:32.436 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-03T03:35:32.454 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-03T03:35:32.481 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-03T03:35:32.521 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-03T03:35:32.755 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-waitress. 2024-04-03T03:35:32.782 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-03T03:35:32.825 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-03T03:35:32.936 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-03T03:35:32.963 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-03T03:35:33.056 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-03T03:35:33.100 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-tempita. 2024-04-03T03:35:33.126 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-03T03:35:33.158 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-03T03:35:33.359 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempora. 2024-04-03T03:35:33.386 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-03T03:35:33.425 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-03T03:35:33.461 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-paste. 2024-04-03T03:35:33.487 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-03T03:35:33.537 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-03T03:35:33.678 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-portend. 2024-04-03T03:35:33.705 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-03T03:35:33.736 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-03T03:35:33.839 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-03T03:35:33.854 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-03T03:35:33.889 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-03T03:35:34.006 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-03T03:35:34.033 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-03T03:35:34.088 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-03T03:35:34.192 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-03T03:35:34.218 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-03T03:35:34.258 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-03T03:35:34.392 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-03T03:35:34.419 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-03T03:35:34.458 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-03T03:35:34.578 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-webtest. 2024-04-03T03:35:34.604 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-03T03:35:34.653 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-03T03:35:34.812 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-natsort. 2024-04-03T03:35:34.839 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-03T03:35:34.878 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-03T03:35:34.981 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pecan. 2024-04-03T03:35:35.007 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-03T03:35:35.047 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-03T03:35:35.198 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-logutils. 2024-04-03T03:35:35.224 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-03T03:35:35.264 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-03T03:35:35.410 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-certifi. 2024-04-03T03:35:35.437 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-03T03:35:35.477 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-03T03:35:35.517 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-03T03:35:35.543 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-03T03:35:35.575 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-03T03:35:35.788 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-idna. 2024-04-03T03:35:35.815 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-03T03:35:35.853 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-mako. 2024-04-03T03:35:35.854 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-03T03:35:35.880 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-03T03:35:35.919 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-03T03:35:36.140 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-urllib3. 2024-04-03T03:35:36.167 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-03T03:35:36.207 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-03T03:35:36.247 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-03T03:35:36.274 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-03T03:35:36.314 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-03T03:35:36.502 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-requests. 2024-04-03T03:35:36.517 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-03T03:35:36.560 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-03T03:35:36.616 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-03T03:35:36.643 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-03T03:35:36.683 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-03T03:35:36.879 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-03T03:35:36.906 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-03T03:35:36.946 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-03T03:35:37.655 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webob. 2024-04-03T03:35:37.682 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-03T03:35:37.721 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-03T03:35:38.074 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-waitress. 2024-04-03T03:35:38.101 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-03T03:35:38.143 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-03T03:35:38.282 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-03T03:35:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:38.349 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:38.469 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempita. 2024-04-03T03:35:38.496 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-03T03:35:38.536 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-03T03:35:38.754 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-03T03:35:38.781 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:38.820 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:38.872 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-paste. 2024-04-03T03:35:38.898 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-03T03:35:38.946 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-03T03:35:39.156 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-03T03:35:39.183 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-03T03:35:39.223 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-03T03:35:39.241 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-03T03:35:39.268 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-03T03:35:39.308 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-03T03:35:39.526 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-openssl. 2024-04-03T03:35:39.552 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-03T03:35:39.595 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-03T03:35:39.611 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-03T03:35:39.637 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-03T03:35:39.685 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-03T03:35:39.895 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr. 2024-04-03T03:35:39.922 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:39.953 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:39.997 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webtest. 2024-04-03T03:35:40.024 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-03T03:35:40.063 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-03T03:35:40.323 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mon. 2024-04-03T03:35:40.350 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:40.375 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pecan. 2024-04-03T03:35:40.389 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mon (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:40.401 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-03T03:35:40.443 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-03T03:35:40.796 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-certifi. 2024-04-03T03:35:40.812 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-03T03:35:40.854 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-03T03:35:40.976 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-osd. 2024-04-03T03:35:41.003 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:41.042 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-osd (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:41.149 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-idna. 2024-04-03T03:35:41.176 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-03T03:35:41.215 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-03T03:35:41.468 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-urllib3. 2024-04-03T03:35:41.495 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-03T03:35:41.535 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-03T03:35:41.822 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests. 2024-04-03T03:35:41.848 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-03T03:35:41.888 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-03T03:35:42.079 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph. 2024-04-03T03:35:42.095 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../066-ceph_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:42.137 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:42.199 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-03T03:35:42.226 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-03T03:35:42.283 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-03T03:35:42.465 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-fuse. 2024-04-03T03:35:42.492 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:42.531 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-fuse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:42.568 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-03T03:35:42.584 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:42.627 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:42.935 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mds. 2024-04-03T03:35:42.962 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:42.973 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-03T03:35:43.000 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:43.001 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mds (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:43.040 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:43.438 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package cephadm. 2024-04-03T03:35:43.448 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-03T03:35:43.465 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../069-cephadm_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:43.474 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-03T03:35:43.504 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking cephadm (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:43.518 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-03T03:35:43.820 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-openssl. 2024-04-03T03:35:43.847 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-03T03:35:43.895 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-03T03:35:43.899 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-03T03:35:43.925 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-03T03:35:43.973 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-03T03:35:44.249 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr. 2024-04-03T03:35:44.275 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:44.310 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-03T03:35:44.317 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:44.336 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-03T03:35:44.384 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-03T03:35:44.676 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mon. 2024-04-03T03:35:44.692 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:44.726 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mon (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:45.347 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-osd. 2024-04-03T03:35:45.373 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:45.381 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-babel. 2024-04-03T03:35:45.409 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-03T03:35:45.413 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-osd (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:45.447 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-03T03:35:45.759 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-jinja2. 2024-04-03T03:35:45.786 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-03T03:35:45.825 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-03T03:35:46.178 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-03T03:35:46.205 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:46.245 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:46.508 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph. 2024-04-03T03:35:46.535 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../066-ceph_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:46.573 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-03T03:35:46.574 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:46.600 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-03T03:35:46.631 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-03T03:35:46.860 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-fuse. 2024-04-03T03:35:46.887 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:46.900 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-routes. 2024-04-03T03:35:46.919 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-fuse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:46.927 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-03T03:35:46.967 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-03T03:35:47.280 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mds. 2024-04-03T03:35:47.304 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-03T03:35:47.307 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:47.331 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:47.347 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mds (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:47.370 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:47.742 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephadm. 2024-04-03T03:35:47.768 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../069-cephadm_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:47.808 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephadm (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:48.136 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-03T03:35:48.163 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-03T03:35:48.202 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-03T03:35:48.530 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-03T03:35:48.557 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-03T03:35:48.597 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-03T03:35:48.700 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-03T03:35:48.716 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-03T03:35:48.750 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-03T03:35:49.270 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-joblib. 2024-04-03T03:35:49.298 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-03T03:35:49.336 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-03T03:35:49.635 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-babel. 2024-04-03T03:35:49.663 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-03T03:35:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-03T03:35:49.701 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-03T03:35:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-03T03:35:49.764 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-03T03:35:50.030 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jinja2. 2024-04-03T03:35:50.034 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-sklearn. 2024-04-03T03:35:50.057 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-03T03:35:50.063 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-03T03:35:50.092 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-03T03:35:50.096 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-03T03:35:50.449 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-03T03:35:50.476 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:50.524 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:50.717 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-03T03:35:50.745 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:50.861 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:50.869 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-03T03:35:50.896 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-03T03:35:50.935 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-03T03:35:51.205 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-routes. 2024-04-03T03:35:51.224 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-03T03:35:51.263 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-03T03:35:51.600 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-03T03:35:51.627 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:51.674 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:51.806 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-cachetools. 2024-04-03T03:35:51.833 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-03T03:35:51.872 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-03T03:35:52.175 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-03T03:35:52.202 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-03T03:35:52.241 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-03T03:35:52.553 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-03T03:35:52.581 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-03T03:35:52.611 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-03T03:35:52.889 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-rsa. 2024-04-03T03:35:52.905 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-03T03:35:52.939 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-03T03:35:52.954 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-03T03:35:52.970 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-03T03:35:53.013 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-03T03:35:53.243 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-google-auth. 2024-04-03T03:35:53.271 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-03T03:35:53.309 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-03T03:35:53.525 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-joblib. 2024-04-03T03:35:53.552 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-03T03:35:53.591 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-03T03:35:53.929 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-03T03:35:53.957 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-03T03:35:53.996 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-03T03:35:54.112 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-03T03:35:54.139 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-03T03:35:54.169 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-03T03:35:54.307 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-websocket. 2024-04-03T03:35:54.334 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-03T03:35:54.373 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-03T03:35:54.464 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn. 2024-04-03T03:35:54.491 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-03T03:35:54.531 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-03T03:35:54.652 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-03T03:35:54.679 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-03T03:35:54.710 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-03T03:35:55.256 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-03T03:35:55.283 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:55.373 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-03T03:35:55.390 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:35:55.408 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:55.465 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:55.784 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-03T03:35:55.812 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-03T03:35:55.851 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-03T03:35:56.179 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-03T03:35:56.206 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-03T03:35:56.245 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-03T03:35:56.445 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cachetools. 2024-04-03T03:35:56.472 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-03T03:35:56.520 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-03T03:35:56.520 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package jq. 2024-04-03T03:35:56.520 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-03T03:35:56.548 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-03T03:35:56.776 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package socat. 2024-04-03T03:35:56.789 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-03T03:35:56.803 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-03T03:35:56.818 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-03T03:35:56.842 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-03T03:35:56.855 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-03T03:35:57.153 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package xmlstarlet. 2024-04-03T03:35:57.170 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-03T03:35:57.192 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-03T03:35:57.212 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-03T03:35:57.219 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-03T03:35:57.259 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-03T03:35:57.553 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rsa. 2024-04-03T03:35:57.558 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-test. 2024-04-03T03:35:57.580 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-03T03:35:57.585 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:35:57.620 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-03T03:35:57.624 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-test (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:35:57.941 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-google-auth. 2024-04-03T03:35:57.967 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-03T03:35:58.006 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-03T03:35:58.301 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-03T03:35:58.317 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-03T03:35:58.351 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-03T03:35:58.871 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-websocket. 2024-04-03T03:35:58.898 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-03T03:35:58.938 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-03T03:35:59.249 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-03T03:35:59.277 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-03T03:35:59.316 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-03T03:35:59.988 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-03T03:36:00.004 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:36:00.012 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-volume. 2024-04-03T03:36:00.040 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:36:00.046 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:00.078 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-volume (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:00.341 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-03T03:36:00.369 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-03T03:36:00.373 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-03T03:36:00.401 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:36:00.407 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-03T03:36:00.440 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libcephfs-dev (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:00.734 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-03T03:36:00.735 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-03T03:36:00.762 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-03T03:36:00.762 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-03T03:36:00.801 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-03T03:36:00.801 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-03T03:36:01.071 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package jq. 2024-04-03T03:36:01.099 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-03T03:36:01.122 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-03T03:36:01.129 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-03T03:36:01.150 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-03T03:36:01.188 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-03T03:36:01.374 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package socat. 2024-04-03T03:36:01.401 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-03T03:36:01.440 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-03T03:36:01.525 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package nvme-cli. 2024-04-03T03:36:01.554 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-03T03:36:01.592 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-03T03:36:01.760 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package xmlstarlet. 2024-04-03T03:36:01.787 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-03T03:36:01.826 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-03T03:36:02.022 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package pkg-config. 2024-04-03T03:36:02.050 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-03T03:36:02.088 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-03T03:36:02.198 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-test. 2024-04-03T03:36:02.226 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:36:02.256 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-test (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:02.350 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-03T03:36:02.378 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-03T03:36:02.416 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-03T03:36:02.861 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-03T03:36:02.889 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-03T03:36:02.927 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-03T03:36:03.213 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pastescript. 2024-04-03T03:36:03.241 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-03T03:36:03.280 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-03T03:36:03.583 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pluggy. 2024-04-03T03:36:03.611 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-03T03:36:03.649 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-03T03:36:03.944 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-psutil. 2024-04-03T03:36:03.974 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-03T03:36:04.010 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-03T03:36:04.364 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-py. 2024-04-03T03:36:04.392 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-03T03:36:04.430 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-03T03:36:04.708 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pygments. 2024-04-03T03:36:04.736 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-03T03:36:04.774 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-03T03:36:04.794 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-volume. 2024-04-03T03:36:04.821 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2594-g888a4a75-1jammy_all.deb ... 2024-04-03T03:36:04.859 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-volume (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:05.132 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-03T03:36:05.146 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:36:05.188 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs-dev (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:05.245 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-03T03:36:05.274 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-03T03:36:05.312 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-03T03:36:05.500 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-03T03:36:05.527 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-03T03:36:05.566 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-03T03:36:05.623 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-toml. 2024-04-03T03:36:05.651 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-03T03:36:05.689 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-03T03:36:05.904 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-03T03:36:05.932 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-03T03:36:05.959 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pytest. 2024-04-03T03:36:05.970 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-03T03:36:05.987 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-03T03:36:06.018 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-03T03:36:06.308 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package nvme-cli. 2024-04-03T03:36:06.336 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-03T03:36:06.370 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-simplejson. 2024-04-03T03:36:06.374 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-03T03:36:06.399 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-03T03:36:06.437 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-03T03:36:06.714 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-03T03:36:06.743 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-03T03:36:06.762 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package pkg-config. 2024-04-03T03:36:06.779 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-03T03:36:06.780 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-03T03:36:06.812 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-03T03:36:07.090 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-03T03:36:07.107 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-03T03:36:07.149 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-03T03:36:07.476 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package radosgw. 2024-04-03T03:36:07.505 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../116-radosgw_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:36:07.542 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking radosgw (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:07.551 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-03T03:36:07.580 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-03T03:36:07.618 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-03T03:36:07.921 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastescript. 2024-04-03T03:36:07.949 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-03T03:36:07.987 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-03T03:36:08.299 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pluggy. 2024-04-03T03:36:08.327 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-03T03:36:08.329 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package rbd-fuse. 2024-04-03T03:36:08.345 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:36:08.365 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-03T03:36:08.387 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking rbd-fuse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:08.677 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-psutil. 2024-04-03T03:36:08.700 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-03T03:36:08.704 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-03T03:36:08.743 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-03T03:36:08.942 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-03T03:36:09.071 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-py. 2024-04-03T03:36:09.099 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-03T03:36:09.137 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-03T03:36:09.302 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-03T03:36:09.441 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pygments. 2024-04-03T03:36:09.469 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-03T03:36:09.507 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-03T03:36:09.567 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-03T03:36:09.886 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-03T03:36:09.995 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-03T03:36:10.023 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-03T03:36:10.061 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-03T03:36:10.305 INFO:teuthology.orchestra.run.smithi104.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-03T03:36:10.373 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-toml. 2024-04-03T03:36:10.380 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up cephadm (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:10.400 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-03T03:36:10.439 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-03T03:36:10.725 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pytest. 2024-04-03T03:36:10.753 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-03T03:36:10.791 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-03T03:36:10.888 INFO:teuthology.orchestra.run.smithi104.stdout:Adding system user cephadm....done 2024-04-03T03:36:11.077 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-03T03:36:11.170 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplejson. 2024-04-03T03:36:11.198 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-03T03:36:11.236 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-03T03:36:11.345 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-03T03:36:11.472 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-03T03:36:11.488 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-03T03:36:11.522 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-03T03:36:11.605 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-03T03:36:11.730 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-03T03:36:11.998 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-03T03:36:12.235 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package radosgw. 2024-04-03T03:36:12.257 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-03T03:36:12.263 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../116-radosgw_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:36:12.301 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking radosgw (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:12.362 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-03T03:36:12.651 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-03T03:36:13.020 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-03T03:36:13.054 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package rbd-fuse. 2024-04-03T03:36:13.070 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2594-g888a4a75-1jammy_amd64.deb ... 2024-04-03T03:36:13.104 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking rbd-fuse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:13.280 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-03T03:36:13.408 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-03T03:36:13.555 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-03T03:36:13.667 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-03T03:36:13.793 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-03T03:36:13.798 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-03T03:36:14.025 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-03T03:36:14.052 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-03T03:36:14.259 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-03T03:36:14.387 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-03T03:36:14.510 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-ceph-argparse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:14.769 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-03T03:36:14.817 INFO:teuthology.orchestra.run.smithi130.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-03T03:36:14.904 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-03T03:36:15.030 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-03T03:36:15.137 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephadm (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:15.139 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-03T03:36:15.390 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-03T03:36:15.671 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user cephadm....done 2024-04-03T03:36:15.794 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-03T03:36:15.820 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-03T03:36:15.900 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-03T03:36:15.902 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-03T03:36:16.027 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-03T03:36:16.248 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-03T03:36:16.403 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-03T03:36:16.529 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-03T03:36:16.601 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-03T03:36:16.797 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-03T03:36:16.827 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-03T03:36:17.048 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-03T03:36:17.173 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-03T03:36:17.332 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up zip (3.0-12build2) ... 2024-04-03T03:36:17.416 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-03T03:36:17.433 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-03T03:36:17.525 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-03T03:36:17.844 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-03T03:36:18.135 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-03T03:36:18.204 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-03T03:36:18.394 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-03T03:36:18.466 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-03T03:36:18.529 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-03T03:36:18.655 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-03T03:36:18.725 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-03T03:36:18.939 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-03T03:36:18.977 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-03T03:36:19.315 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-03T03:36:19.320 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-03T03:36:19.541 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-03T03:36:19.579 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-03T03:36:19.830 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-argparse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:19.926 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-03T03:36:20.081 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-03T03:36:20.191 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-03T03:36:20.235 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-03T03:36:20.292 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-03T03:36:20.410 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-03T03:36:20.578 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-03T03:36:20.660 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-03T03:36:20.838 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-03T03:36:20.964 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-ceph-common (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:21.033 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-03T03:36:21.057 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-03T03:36:21.147 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-03T03:36:21.248 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-03T03:36:21.273 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-idna (3.3-1) ... 2024-04-03T03:36:21.574 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-03T03:36:21.600 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-03T03:36:21.709 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-03T03:36:21.985 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-03T03:36:22.245 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-03T03:36:22.562 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up zip (3.0-12build2) ... 2024-04-03T03:36:22.689 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-03T03:36:22.762 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-03T03:36:23.014 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:36:23.123 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-03T03:36:23.391 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-03T03:36:23.391 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-03T03:36:23.517 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-03T03:36:23.617 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-03T03:36:23.643 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-03T03:36:23.735 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-03T03:36:23.861 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-03T03:36:23.953 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-03T03:36:24.162 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-03T03:36:24.212 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-03T03:36:24.463 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:36:24.563 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-03T03:36:24.564 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-03T03:36:24.806 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-03T03:36:24.857 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-03T03:36:25.133 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-03T03:36:25.174 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-03T03:36:25.392 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-03T03:36:25.451 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-03T03:36:25.651 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-03T03:36:25.793 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-03T03:36:25.911 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-03T03:36:26.053 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-03T03:36:26.179 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-common (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:26.179 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-03T03:36:26.305 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-03T03:36:26.464 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-idna (3.3-1) ... 2024-04-03T03:36:26.589 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-03T03:36:26.690 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-03T03:36:26.757 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-03T03:36:26.966 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-03T03:36:27.284 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-03T03:36:27.535 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-03T03:36:27.669 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-03T03:36:27.795 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-03T03:36:27.868 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-03T03:36:27.921 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-03T03:36:28.105 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-03T03:36:28.164 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:36:28.223 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-03T03:36:28.282 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-03T03:36:28.525 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-03T03:36:28.607 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-03T03:36:28.643 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-03T03:36:28.769 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-03T03:36:28.875 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-03T03:36:29.001 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-03T03:36:29.062 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-03T03:36:29.260 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:36:29.314 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-03T03:36:29.395 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-03T03:36:29.556 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:36:29.673 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-03T03:36:29.712 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-03T03:36:29.958 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-03T03:36:30.013 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-03T03:36:30.210 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-03T03:36:30.289 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-03T03:36:30.415 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-03T03:36:30.469 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-03T03:36:30.691 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-03T03:36:30.729 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-03T03:36:30.967 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-03T03:36:30.988 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-03T03:36:31.247 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-03T03:36:31.329 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-03T03:36:31.365 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-03T03:36:31.650 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-03T03:36:31.713 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-03T03:36:31.761 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-03T03:36:31.998 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-03T03:36:32.052 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-03T03:36:32.334 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-03T03:36:32.353 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-03T03:36:32.460 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up librados2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:32.587 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:32.604 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-03T03:36:32.712 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-03T03:36:32.713 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-03T03:36:32.815 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-03T03:36:32.888 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-03T03:36:33.048 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libcephfs2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:33.158 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-03T03:36:33.165 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libradosstriper1 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:33.266 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-03T03:36:33.284 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-03T03:36:33.543 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up librbd1 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:33.669 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-modules-core (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:33.694 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-03T03:36:33.795 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-fuse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:33.962 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-03T03:36:34.006 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-03T03:36:34.006 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-03T03:36:34.089 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-03T03:36:34.339 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-03T03:36:34.449 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-03T03:36:34.538 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libcephfs-dev (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:34.681 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-rados (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:34.750 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-03T03:36:35.060 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-03T03:36:35.352 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-03T03:36:35.479 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-03T03:36:35.551 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up librgw2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:35.658 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-03T03:36:35.780 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-03T03:36:36.048 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-03T03:36:36.385 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-03T03:36:36.761 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-03T03:36:36.887 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-rbd (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:37.021 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up rbd-fuse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-03T03:36:37.146 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-rgw (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:37.272 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-cephfs (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:37.383 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-03T03:36:37.390 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-common (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:37.492 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librados2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:37.609 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:37.735 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-03T03:36:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:Adding group ceph....done 2024-04-03T03:36:38.072 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:38.198 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libradosstriper1 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:38.242 INFO:teuthology.orchestra.run.smithi104.stdout:Adding system user ceph....done 2024-04-03T03:36:38.307 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-03T03:36:38.377 INFO:teuthology.orchestra.run.smithi104.stdout:Setting system user ceph properties....done 2024-04-03T03:36:38.394 INFO:teuthology.orchestra.run.smithi104.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-03T03:36:38.530 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-03T03:36:38.576 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librbd1 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:38.702 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-modules-core (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:38.828 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-fuse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:38.873 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-03T03:36:39.052 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-03T03:36:39.053 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-03T03:36:39.324 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-test (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:39.450 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up radosgw (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:39.529 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs-dev (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:39.680 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rados (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:39.806 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librgw2 (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:39.922 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-03T03:36:39.922 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-03T03:36:39.932 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-03T03:36:40.409 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-base (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:40.813 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-03T03:36:41.077 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rbd (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:41.204 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up rbd-fuse (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:41.299 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mds (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:41.314 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rgw (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:41.414 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cephfs (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:41.514 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-03T03:36:41.514 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-03T03:36:41.515 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-common (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:41.992 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:42.059 INFO:teuthology.orchestra.run.smithi130.stdout:Adding group ceph....done 2024-04-03T03:36:42.210 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-03T03:36:42.210 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-03T03:36:42.444 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user ceph....done 2024-04-03T03:36:42.604 INFO:teuthology.orchestra.run.smithi130.stdout:Setting system user ceph properties....done 2024-04-03T03:36:42.621 INFO:teuthology.orchestra.run.smithi130.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-03T03:36:42.693 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-osd (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:42.755 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-03T03:36:42.966 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-03T03:36:42.966 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-03T03:36:43.061 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-03T03:36:43.436 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:43.534 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-test (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:43.562 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:43.660 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up radosgw (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:43.705 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mon (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:43.917 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-03T03:36:43.917 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-03T03:36:44.132 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-03T03:36:44.132 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-03T03:36:44.414 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-cephadm (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:44.537 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-base (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:44.540 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:44.674 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-dashboard (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:44.833 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-volume (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:44.854 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-03T03:36:45.178 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-03T03:36:45.295 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-03T03:36:45.305 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mds (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:45.448 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-03T03:36:45.526 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-03T03:36:45.526 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-03T03:36:45.991 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:46.207 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-03T03:36:46.207 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-03T03:36:46.590 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-03T03:36:46.675 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-osd (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:46.936 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-03T03:36:46.937 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-03T03:36:47.200 INFO:teuthology.orchestra.run.smithi104.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-03T03:36:47.203 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-04-03T03:36:47.259 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-04-03T03:36:47.394 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:47.456 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-04-03T03:36:47.457 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-04-03T03:36:47.503 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:47.635 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages were automatically installed and are no longer required: 2024-04-03T03:36:47.635 INFO:teuthology.orchestra.run.smithi104.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-03T03:36:47.635 INFO:teuthology.orchestra.run.smithi104.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-03T03:36:47.635 INFO:teuthology.orchestra.run.smithi104.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-03T03:36:47.635 INFO:teuthology.orchestra.run.smithi104.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-03T03:36:47.636 INFO:teuthology.orchestra.run.smithi104.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-03T03:36:47.636 INFO:teuthology.orchestra.run.smithi104.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout:The following additional packages will be installed: 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-04-03T03:36:47.637 INFO:teuthology.orchestra.run.smithi104.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-04-03T03:36:47.638 INFO:teuthology.orchestra.run.smithi104.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-04-03T03:36:47.638 INFO:teuthology.orchestra.run.smithi104.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-04-03T03:36:47.638 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mon (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:47.638 INFO:teuthology.orchestra.run.smithi104.stdout:Suggested packages: 2024-04-03T03:36:47.638 INFO:teuthology.orchestra.run.smithi104.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-04-03T03:36:47.638 INFO:teuthology.orchestra.run.smithi104.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-04-03T03:36:47.639 INFO:teuthology.orchestra.run.smithi104.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-04-03T03:36:47.639 INFO:teuthology.orchestra.run.smithi104.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-04-03T03:36:47.639 INFO:teuthology.orchestra.run.smithi104.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-04-03T03:36:47.674 INFO:teuthology.orchestra.run.smithi104.stdout:The following NEW packages will be installed: 2024-04-03T03:36:47.674 INFO:teuthology.orchestra.run.smithi104.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-04-03T03:36:47.674 INFO:teuthology.orchestra.run.smithi104.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-04-03T03:36:47.674 INFO:teuthology.orchestra.run.smithi104.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-04-03T03:36:47.675 INFO:teuthology.orchestra.run.smithi104.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-04-03T03:36:47.675 INFO:teuthology.orchestra.run.smithi104.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-04-03T03:36:47.675 INFO:teuthology.orchestra.run.smithi104.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-04-03T03:36:47.675 INFO:teuthology.orchestra.run.smithi104.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-04-03T03:36:47.675 INFO:teuthology.orchestra.run.smithi104.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-04-03T03:36:47.675 INFO:teuthology.orchestra.run.smithi104.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-04-03T03:36:47.675 INFO:teuthology.orchestra.run.smithi104.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-04-03T03:36:47.675 INFO:teuthology.orchestra.run.smithi104.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-04-03T03:36:47.675 INFO:teuthology.orchestra.run.smithi104.stdout: s3cmd 2024-04-03T03:36:47.842 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-03T03:36:47.842 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-03T03:36:47.855 INFO:teuthology.orchestra.run.smithi104.stdout:0 upgraded, 35 newly installed, 0 to remove and 299 not upgraded. 2024-04-03T03:36:47.855 INFO:teuthology.orchestra.run.smithi104.stdout:Need to get 10.4 MB of archives. 2024-04-03T03:36:47.855 INFO:teuthology.orchestra.run.smithi104.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-04-03T03:36:47.855 INFO:teuthology.orchestra.run.smithi104.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-04-03T03:36:47.938 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-04-03T03:36:47.938 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-04-03T03:36:47.964 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-04-03T03:36:48.134 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-04-03T03:36:48.210 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-04-03T03:36:48.218 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-04-03T03:36:48.289 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-cephadm (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:48.358 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-04-03T03:36:48.423 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:48.450 INFO:teuthology.orchestra.run.smithi104.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-04-03T03:36:48.452 INFO:teuthology.orchestra.run.smithi104.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-04-03T03:36:48.455 INFO:teuthology.orchestra.run.smithi104.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-04-03T03:36:48.549 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-dashboard (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:48.700 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-volume (19.0.0-2594-g888a4a75-1jammy) ... 2024-04-03T03:36:48.763 INFO:teuthology.orchestra.run.smithi104.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-04-03T03:36:48.846 INFO:teuthology.orchestra.run.smithi104.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-04-03T03:36:49.053 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-03T03:36:49.154 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-03T03:36:49.306 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-03T03:36:49.367 INFO:teuthology.orchestra.run.smithi104.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-04-03T03:36:49.369 INFO:teuthology.orchestra.run.smithi104.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-04-03T03:36:49.371 INFO:teuthology.orchestra.run.smithi104.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-04-03T03:36:49.375 INFO:teuthology.orchestra.run.smithi104.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-04-03T03:36:49.376 INFO:teuthology.orchestra.run.smithi104.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-04-03T03:36:49.393 INFO:teuthology.orchestra.run.smithi104.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-04-03T03:36:49.396 INFO:teuthology.orchestra.run.smithi104.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-04-03T03:36:49.428 INFO:teuthology.orchestra.run.smithi104.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-shared-utils-java all 3.3.0-1 [149 kB] 2024-04-03T03:36:49.434 INFO:teuthology.orchestra.run.smithi104.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-04-03T03:36:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-04-03T03:36:49.855 INFO:teuthology.orchestra.run.smithi104.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-04-03T03:36:49.862 INFO:teuthology.orchestra.run.smithi104.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-04-03T03:36:49.955 INFO:teuthology.orchestra.run.smithi104.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-04-03T03:36:49.985 INFO:teuthology.orchestra.run.smithi104.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-04-03T03:36:50.065 INFO:teuthology.orchestra.run.smithi104.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-04-03T03:36:50.166 INFO:teuthology.orchestra.run.smithi104.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-04-03T03:36:50.194 INFO:teuthology.orchestra.run.smithi104.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-04-03T03:36:50.320 INFO:teuthology.orchestra.run.smithi104.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-04-03T03:36:50.320 INFO:teuthology.orchestra.run.smithi104.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-04-03T03:36:50.324 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-03T03:36:50.388 INFO:teuthology.orchestra.run.smithi104.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-04-03T03:36:50.552 INFO:teuthology.orchestra.run.smithi104.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-04-03T03:36:50.635 INFO:teuthology.orchestra.run.smithi104.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-04-03T03:36:50.981 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-03T03:36:50.984 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-04-03T03:36:51.037 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-03T03:36:51.218 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-04-03T03:36:51.219 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-04-03T03:36:51.290 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 10.4 MB in 3s (3,269 kB/s) 2024-04-03T03:36:51.377 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libapache-pom-java. 2024-04-03T03:36:51.385 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-04-03T03:36:51.385 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-03T03:36:51.385 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-03T03:36:51.385 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-03T03:36:51.386 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-03T03:36:51.386 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-03T03:36:51.386 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-03T03:36:51.387 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-04-03T03:36:51.388 INFO:teuthology.orchestra.run.smithi130.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-04-03T03:36:51.389 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-04-03T03:36:51.389 INFO:teuthology.orchestra.run.smithi130.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-04-03T03:36:51.389 INFO:teuthology.orchestra.run.smithi130.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-04-03T03:36:51.389 INFO:teuthology.orchestra.run.smithi130.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-04-03T03:36:51.389 INFO:teuthology.orchestra.run.smithi130.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-04-03T03:36:51.389 INFO:teuthology.orchestra.run.smithi130.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-04-03T03:36:51.425 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-04-03T03:36:51.426 INFO:teuthology.orchestra.run.smithi130.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-04-03T03:36:51.427 INFO:teuthology.orchestra.run.smithi130.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-04-03T03:36:51.427 INFO:teuthology.orchestra.run.smithi130.stdout: s3cmd 2024-04-03T03:36:51.450 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173895 files and directories currently installed.) 2024-04-03T03:36:51.455 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-04-03T03:36:51.485 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 35 newly installed, 0 to remove and 299 not upgraded. 2024-04-03T03:36:51.485 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 10.4 MB of archives. 2024-04-03T03:36:51.485 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-04-03T03:36:51.485 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-04-03T03:36:51.501 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libapache-pom-java (18-1) ... 2024-04-03T03:36:51.507 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-04-03T03:36:51.507 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-04-03T03:36:51.510 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-04-03T03:36:51.553 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-04-03T03:36:51.571 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-04-03T03:36:51.573 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-04-03T03:36:51.609 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-04-03T03:36:51.636 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-04-03T03:36:51.636 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-04-03T03:36:51.638 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-04-03T03:36:51.690 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-04-03T03:36:51.690 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-04-03T03:36:51.709 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-04-03T03:36:51.709 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-04-03T03:36:51.709 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-04-03T03:36:51.710 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-04-03T03:36:51.710 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-04-03T03:36:51.713 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-04-03T03:36:51.714 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-04-03T03:36:51.719 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-shared-utils-java all 3.3.0-1 [149 kB] 2024-04-03T03:36:51.737 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-04-03T03:36:51.739 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-04-03T03:36:51.739 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-04-03T03:36:51.740 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-04-03T03:36:51.740 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-04-03T03:36:51.741 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-04-03T03:36:51.742 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-04-03T03:36:51.744 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-04-03T03:36:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-04-03T03:36:51.759 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-04-03T03:36:51.761 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-04-03T03:36:51.777 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-04-03T03:36:51.783 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-04-03T03:36:51.795 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-04-03T03:36:51.804 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-04-03T03:36:51.804 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-04-03T03:36:51.805 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-04-03T03:36:52.051 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-04-03T03:36:52.066 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-04-03T03:36:52.106 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-04-03T03:36:52.240 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 10.4 MB in 0s (28.0 MB/s) 2024-04-03T03:36:52.313 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libapache-pom-java. 2024-04-03T03:36:52.358 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libcdi-api-java. 2024-04-03T03:36:52.372 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173895 files and directories currently installed.) 2024-04-03T03:36:52.374 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-04-03T03:36:52.376 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-04-03T03:36:52.416 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-04-03T03:36:52.420 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libapache-pom-java (18-1) ... 2024-04-03T03:36:52.665 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-04-03T03:36:52.669 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libcommons-cli-java. 2024-04-03T03:36:52.685 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-04-03T03:36:52.692 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-04-03T03:36:52.719 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-04-03T03:36:52.731 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-04-03T03:36:52.949 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-04-03T03:36:52.959 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-04-03T03:36:52.980 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libcommons-parent-java. 2024-04-03T03:36:52.997 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-04-03T03:36:53.001 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-04-03T03:36:53.039 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-04-03T03:36:53.253 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcdi-api-java. 2024-04-03T03:36:53.270 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-04-03T03:36:53.294 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libcommons-io-java. 2024-04-03T03:36:53.312 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-04-03T03:36:53.318 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-04-03T03:36:53.356 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-04-03T03:36:53.573 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcommons-cli-java. 2024-04-03T03:36:53.589 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-04-03T03:36:53.617 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-04-03T03:36:53.634 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-04-03T03:36:53.634 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-04-03T03:36:53.675 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-04-03T03:36:53.867 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcommons-parent-java. 2024-04-03T03:36:53.883 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-04-03T03:36:53.917 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-04-03T03:36:53.964 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-04-03T03:36:53.990 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-04-03T03:36:54.027 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-04-03T03:36:54.153 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcommons-io-java. 2024-04-03T03:36:54.180 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-04-03T03:36:54.219 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-04-03T03:36:54.247 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libjsr305-java. 2024-04-03T03:36:54.263 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-04-03T03:36:54.305 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-04-03T03:36:54.481 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-04-03T03:36:54.496 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-04-03T03:36:54.538 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-04-03T03:36:54.558 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libguava-java. 2024-04-03T03:36:54.586 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-04-03T03:36:54.624 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libguava-java (29.0-6) ... 2024-04-03T03:36:54.833 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-04-03T03:36:54.849 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-04-03T03:36:54.886 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-04-03T03:36:55.060 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libaopalliance-java. 2024-04-03T03:36:55.085 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjsr305-java. 2024-04-03T03:36:55.088 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-04-03T03:36:55.099 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-04-03T03:36:55.126 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-04-03T03:36:55.135 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-04-03T03:36:55.371 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libguice-java. 2024-04-03T03:36:55.397 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libguava-java. 2024-04-03T03:36:55.398 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-04-03T03:36:55.413 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-04-03T03:36:55.437 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-04-03T03:36:55.458 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libguava-java (29.0-6) ... 2024-04-03T03:36:55.824 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-04-03T03:36:55.840 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-04-03T03:36:55.882 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-04-03T03:36:55.883 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libaopalliance-java. 2024-04-03T03:36:55.911 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-04-03T03:36:55.949 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-04-03T03:36:56.143 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libjansi-native-java. 2024-04-03T03:36:56.171 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-04-03T03:36:56.202 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libguice-java. 2024-04-03T03:36:56.209 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-04-03T03:36:56.230 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-04-03T03:36:56.260 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-04-03T03:36:56.480 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libjansi-java. 2024-04-03T03:36:56.495 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-04-03T03:36:56.537 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libjansi-java (1.18-1) ... 2024-04-03T03:36:56.615 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-04-03T03:36:56.630 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-04-03T03:36:56.672 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-04-03T03:36:56.789 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libmaven-parent-java. 2024-04-03T03:36:56.817 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-04-03T03:36:56.881 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-04-03T03:36:57.010 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjansi-native-java. 2024-04-03T03:36:57.037 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-04-03T03:36:57.076 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-04-03T03:36:57.133 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-04-03T03:36:57.149 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-04-03T03:36:57.191 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-04-03T03:36:57.347 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjansi-java. 2024-04-03T03:36:57.362 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-04-03T03:36:57.404 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjansi-java (1.18-1) ... 2024-04-03T03:36:57.511 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-04-03T03:36:57.538 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-04-03T03:36:57.585 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-04-03T03:36:57.640 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmaven-parent-java. 2024-04-03T03:36:57.667 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-04-03T03:36:57.698 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-04-03T03:36:57.863 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-04-03T03:36:57.891 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-04-03T03:36:57.930 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-04-03T03:36:57.942 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-04-03T03:36:57.958 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-04-03T03:36:58.000 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-04-03T03:36:58.234 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-04-03T03:36:58.250 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1_all.deb ... 2024-04-03T03:36:58.286 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-04-03T03:36:58.292 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1) ... 2024-04-03T03:36:58.303 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-04-03T03:36:58.345 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-04-03T03:36:58.578 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-04-03T03:36:58.605 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-04-03T03:36:58.606 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-04-03T03:36:58.634 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-04-03T03:36:58.644 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-04-03T03:36:58.672 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-04-03T03:36:58.896 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-04-03T03:36:58.926 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-04-03T03:36:58.952 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-04-03T03:36:58.963 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-04-03T03:36:58.965 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1_all.deb ... 2024-04-03T03:36:59.010 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1) ... 2024-04-03T03:36:59.199 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-04-03T03:36:59.215 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-04-03T03:36:59.249 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-04-03T03:36:59.305 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-04-03T03:36:59.320 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-04-03T03:36:59.362 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-04-03T03:36:59.467 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-04-03T03:36:59.493 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-04-03T03:36:59.534 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-04-03T03:36:59.598 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-04-03T03:36:59.626 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-04-03T03:36:59.665 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-04-03T03:36:59.795 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-04-03T03:36:59.824 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-04-03T03:36:59.861 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-04-03T03:36:59.909 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-04-03T03:36:59.925 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-04-03T03:36:59.959 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-04-03T03:37:00.114 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libslf4j-java. 2024-04-03T03:37:00.142 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-04-03T03:37:00.181 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-04-03T03:37:00.220 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-04-03T03:37:00.248 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-04-03T03:37:00.286 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-04-03T03:37:00.459 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libsisu-inject-java. 2024-04-03T03:37:00.475 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-04-03T03:37:00.519 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-04-03T03:37:00.547 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-04-03T03:37:00.564 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-04-03T03:37:00.606 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-04-03T03:37:00.805 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-04-03T03:37:00.833 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-04-03T03:37:00.867 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libslf4j-java. 2024-04-03T03:37:00.871 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-04-03T03:37:00.894 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-04-03T03:37:00.933 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-04-03T03:37:01.141 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libmaven3-core-java. 2024-04-03T03:37:01.157 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-04-03T03:37:01.179 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libsisu-inject-java. 2024-04-03T03:37:01.195 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-04-03T03:37:01.198 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-04-03T03:37:01.229 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-04-03T03:37:01.515 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-04-03T03:37:01.531 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-04-03T03:37:01.573 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-04-03T03:37:01.630 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libwagon-file-java. 2024-04-03T03:37:01.662 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-04-03T03:37:01.703 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-04-03T03:37:01.845 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmaven3-core-java. 2024-04-03T03:37:01.861 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-04-03T03:37:01.894 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-04-03T03:37:01.963 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-04-03T03:37:01.991 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-04-03T03:37:02.030 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-04-03T03:37:02.257 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libwagon-file-java. 2024-04-03T03:37:02.271 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-04-03T03:37:02.315 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-04-03T03:37:02.483 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package maven. 2024-04-03T03:37:02.510 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-04-03T03:37:02.549 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking maven (3.6.3-5) ... 2024-04-03T03:37:02.661 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-04-03T03:37:02.678 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-04-03T03:37:02.719 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-04-03T03:37:02.902 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-magic. 2024-04-03T03:37:02.930 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-04-03T03:37:02.985 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-04-03T03:37:03.156 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package maven. 2024-04-03T03:37:03.184 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-04-03T03:37:03.214 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking maven (3.6.3-5) ... 2024-04-03T03:37:03.330 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package s3cmd. 2024-04-03T03:37:03.358 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-04-03T03:37:03.396 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-04-03T03:37:03.517 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-magic. 2024-04-03T03:37:03.545 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-04-03T03:37:03.584 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-04-03T03:37:03.767 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-04-03T03:37:03.878 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-04-03T03:37:03.878 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package s3cmd. 2024-04-03T03:37:03.906 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-04-03T03:37:03.945 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-04-03T03:37:03.986 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-04-03T03:37:04.128 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-04-03T03:37:04.254 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-04-03T03:37:04.323 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-04-03T03:37:04.380 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-04-03T03:37:04.425 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-04-03T03:37:04.506 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-04-03T03:37:04.543 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-04-03T03:37:04.632 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-04-03T03:37:04.669 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-04-03T03:37:04.757 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-04-03T03:37:04.795 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-04-03T03:37:04.892 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-04-03T03:37:04.921 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-04-03T03:37:05.001 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libapache-pom-java (18-1) ... 2024-04-03T03:37:05.047 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-04-03T03:37:05.145 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-04-03T03:37:05.176 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-04-03T03:37:05.261 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-04-03T03:37:05.283 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-04-03T03:37:05.387 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-04-03T03:37:05.392 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-04-03T03:37:05.493 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libapache-pom-java (18-1) ... 2024-04-03T03:37:05.516 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-04-03T03:37:05.619 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-04-03T03:37:05.639 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-04-03T03:37:05.745 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-04-03T03:37:05.871 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-04-03T03:37:05.907 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-04-03T03:37:05.997 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-04-03T03:37:06.033 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-04-03T03:37:06.123 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-04-03T03:37:06.159 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-04-03T03:37:06.301 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libmaven-parent-java (31-2) ... 2024-04-03T03:37:06.382 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-04-03T03:37:06.478 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libcommons-parent-java (43-1) ... 2024-04-03T03:37:06.484 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-04-03T03:37:06.585 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-04-03T03:37:06.603 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-04-03T03:37:06.719 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmaven-parent-java (31-2) ... 2024-04-03T03:37:06.729 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up s3cmd (2.2.0-1) ... 2024-04-03T03:37:06.845 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcommons-parent-java (43-1) ... 2024-04-03T03:37:06.988 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-04-03T03:37:07.039 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-04-03T03:37:07.114 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up s3cmd (2.2.0-1) ... 2024-04-03T03:37:07.165 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-04-03T03:37:07.291 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libguava-java (29.0-6) ... 2024-04-03T03:37:07.416 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-04-03T03:37:07.423 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-04-03T03:37:07.542 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-04-03T03:37:07.592 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-04-03T03:37:07.652 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-04-03T03:37:07.719 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libguava-java (29.0-6) ... 2024-04-03T03:37:07.761 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-04-03T03:37:07.845 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-04-03T03:37:07.878 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libguice-java (4.2.3-2) ... 2024-04-03T03:37:07.971 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-04-03T03:37:08.005 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libjansi-java (1.18-1) ... 2024-04-03T03:37:08.098 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-04-03T03:37:08.130 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libmaven-shared-utils-java (3.3.0-1) ... 2024-04-03T03:37:08.207 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-04-03T03:37:08.256 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-04-03T03:37:08.332 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libguice-java (4.2.3-2) ... 2024-04-03T03:37:08.382 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up maven (3.6.3-5) ... 2024-04-03T03:37:08.433 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjansi-java (1.18-1) ... 2024-04-03T03:37:08.559 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmaven-shared-utils-java (3.3.0-1) ... 2024-04-03T03:37:08.639 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-04-03T03:37:08.685 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-04-03T03:37:08.711 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-03T03:37:08.812 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up maven (3.6.3-5) ... 2024-04-03T03:37:09.069 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-04-03T03:37:09.133 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-03T03:37:10.258 INFO:teuthology.orchestra.run.smithi104.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-03T03:37:10.265 DEBUG:teuthology.parallel:result is None 2024-04-03T03:37:10.506 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-03T03:37:10.511 DEBUG:teuthology.parallel:result is None 2024-04-03T03:37:10.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:37:10.656 DEBUG:teuthology.orchestra.run.smithi104:> dpkg-query -W -f '${Version}' ceph 2024-04-03T03:37:10.676 INFO:teuthology.orchestra.run.smithi104.stdout:19.0.0-2594-g888a4a75-1jammy 2024-04-03T03:37:10.677 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2594-g888a4a75-1jammy 2024-04-03T03:37:10.677 INFO:teuthology.task.install:The correct ceph version 19.0.0-2594-g888a4a75-1jammy is installed. 2024-04-03T03:37:10.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:37:10.832 DEBUG:teuthology.orchestra.run.smithi130:> dpkg-query -W -f '${Version}' ceph 2024-04-03T03:37:10.852 INFO:teuthology.orchestra.run.smithi130.stdout:19.0.0-2594-g888a4a75-1jammy 2024-04-03T03:37:10.852 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2594-g888a4a75-1jammy 2024-04-03T03:37:10.852 INFO:teuthology.task.install:The correct ceph version 19.0.0-2594-g888a4a75-1jammy is installed. 2024-04-03T03:37:10.854 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-03T03:37:10.854 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:10.854 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-03T03:37:10.868 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:10.868 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-03T03:37:10.908 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-03T03:37:10.908 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:10.908 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-04-03T03:37:10.921 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-03T03:37:10.974 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:10.975 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-04-03T03:37:10.988 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-03T03:37:11.048 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-03T03:37:11.048 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:11.048 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-03T03:37:11.099 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-03T03:37:11.153 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:11.154 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-03T03:37:11.167 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-03T03:37:11.222 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-03T03:37:11.223 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:11.223 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-04-03T03:37:11.236 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-03T03:37:11.290 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:11.290 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-04-03T03:37:11.303 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-03T03:37:11.362 INFO:teuthology.run_tasks:Running task ceph... 2024-04-03T03:37:11.462 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-03T03:37:11.462 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-04-03T03:37:11.465 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2024-04-03T03:37:11.478 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-03T03:37:11.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-03T03:37:11.520 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-03T03:37:11.533 INFO:tasks.ceph:Creating extra log directories... 2024-04-03T03:37:11.534 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-03T03:37:11.572 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-03T03:37:11.599 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-03T03:37:11.599 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-03T03:37:11.600 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874', 'branch': 'wip-cbodley-testing', 'description': 'rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7637874', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cbodley-testing'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '888a4a757aa90aa5ed4fb3291576474bc07507ce'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '888a4a757aa90aa5ed4fb3291576474bc07507ce'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley-testing', 'sha1': '888a4a757aa90aa5ed4fb3291576474bc07507ce'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4379, 'sha1': '888a4a757aa90aa5ed4fb3291576474bc07507ce', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_888a4a757aa90aa5ed4fb3291576474bc07507ce/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '888a4a757aa90aa5ed4fb3291576474bc07507ce', 'targets': {'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFLgZ6zNouvHIjgv2P77XxyefnUSV3rLK0sfVfL+8JEn65Gu0Y7QNLktBsCBHDPibdl+QzzrV7J/PAImqYFj4aA=', 'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDe9QW5qhbgo38kVyahGLMl0uKnW4+nvI8vXE9zS2067sunmND40vD69pCYCHUDkdh1cmlt+SE0nSU7gK3qg6D4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '888a4a757aa90aa5ed4fb3291576474bc07507ce'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-04-03_02:50:19', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-03T03:37:11.600 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-03T03:37:11.628 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-03T03:37:11.637 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-04-03T03:37:11.676 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2024-04-03T03:37:11.691 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:11.691 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-04-03T03:37:11.735 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-03T03:37:11.735 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-04-03T03:37:11.783 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-03T03:37:11.783 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T03:37:11.783 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-04-03T03:37:11.783 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T03:37:11.783 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-03 03:31:35.123483351 +0000 2024-04-03T03:37:11.783 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-03 03:31:34.875485563 +0000 2024-04-03T03:37:11.783 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-03 03:31:34.875485563 +0000 2024-04-03T03:37:11.783 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-04-03T03:37:11.784 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-03T03:37:11.837 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-03T03:37:11.838 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-03T03:37:11.838 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000451021 s, 1.1 MB/s 2024-04-03T03:37:11.839 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-03T03:37:11.889 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-04-03T03:37:11.938 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-03T03:37:11.939 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T03:37:11.939 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-04-03T03:37:11.939 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T03:37:11.939 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-03 03:31:35.631478818 +0000 2024-04-03T03:37:11.939 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-03 03:31:35.359481245 +0000 2024-04-03T03:37:11.939 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-03 03:31:35.359481245 +0000 2024-04-03T03:37:11.939 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-04-03T03:37:11.939 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-03T03:37:11.992 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-03T03:37:11.992 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-03T03:37:11.992 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000332042 s, 1.5 MB/s 2024-04-03T03:37:11.993 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-03T03:37:12.046 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-04-03T03:37:12.099 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-03T03:37:12.099 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T03:37:12.099 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-04-03T03:37:12.099 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T03:37:12.099 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-03 03:31:36.151474180 +0000 2024-04-03T03:37:12.099 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-03 03:31:35.903476392 +0000 2024-04-03T03:37:12.099 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-03 03:31:35.903476392 +0000 2024-04-03T03:37:12.099 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-04-03T03:37:12.099 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-03T03:37:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-03T03:37:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-03T03:37:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000362781 s, 1.4 MB/s 2024-04-03T03:37:12.154 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-03T03:37:12.204 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-04-03T03:37:12.250 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-03T03:37:12.250 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T03:37:12.250 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-04-03T03:37:12.250 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T03:37:12.251 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-04-03 03:31:36.675469505 +0000 2024-04-03T03:37:12.251 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-04-03 03:31:36.407471896 +0000 2024-04-03T03:37:12.251 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-04-03 03:31:36.407471896 +0000 2024-04-03T03:37:12.251 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-04-03T03:37:12.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-03T03:37:12.304 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-04-03T03:37:12.305 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-04-03T03:37:12.305 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.00038973 s, 1.3 MB/s 2024-04-03T03:37:12.306 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-03T03:37:12.356 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:12.356 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:12.356 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-04-03T03:37:12.362 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-03T03:37:12.362 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-04-03T03:37:12.411 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-03T03:37:12.412 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T03:37:12.412 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-04-03T03:37:12.412 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T03:37:12.412 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-03 03:31:36.511473255 +0000 2024-04-03T03:37:12.412 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-03 03:31:36.247475614 +0000 2024-04-03T03:37:12.412 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-03 03:31:36.247475614 +0000 2024-04-03T03:37:12.412 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-04-03T03:37:12.412 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-03T03:37:12.466 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-03T03:37:12.466 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-03T03:37:12.466 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.00042039 s, 1.2 MB/s 2024-04-03T03:37:12.467 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-03T03:37:12.516 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-04-03T03:37:12.563 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-03T03:37:12.563 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T03:37:12.563 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-04-03T03:37:12.563 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T03:37:12.563 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-03 03:31:36.991468968 +0000 2024-04-03T03:37:12.563 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-03 03:31:36.719471397 +0000 2024-04-03T03:37:12.563 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-03 03:31:36.719471397 +0000 2024-04-03T03:37:12.563 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-04-03T03:37:12.564 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-03T03:37:12.617 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-03T03:37:12.617 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-03T03:37:12.617 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000416164 s, 1.2 MB/s 2024-04-03T03:37:12.618 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-03T03:37:12.669 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-04-03T03:37:12.715 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-03T03:37:12.715 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T03:37:12.715 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-04-03T03:37:12.716 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T03:37:12.716 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-03 03:31:37.475464645 +0000 2024-04-03T03:37:12.716 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-03 03:31:37.227466860 +0000 2024-04-03T03:37:12.716 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-03 03:31:37.227466860 +0000 2024-04-03T03:37:12.716 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-04-03T03:37:12.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-03T03:37:12.770 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-03T03:37:12.770 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-03T03:37:12.770 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000445843 s, 1.1 MB/s 2024-04-03T03:37:12.771 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-03T03:37:12.820 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-04-03T03:37:12.868 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-03T03:37:12.868 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-03T03:37:12.868 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-04-03T03:37:12.868 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-03T03:37:12.868 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-03 03:31:37.987460072 +0000 2024-04-03T03:37:12.869 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-03 03:31:37.719462466 +0000 2024-04-03T03:37:12.869 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-03 03:31:37.719462466 +0000 2024-04-03T03:37:12.869 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2024-04-03T03:37:12.869 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-03T03:37:12.921 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-03T03:37:12.922 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-03T03:37:12.922 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000388477 s, 1.3 MB/s 2024-04-03T03:37:12.923 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-03T03:37:12.972 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:12.972 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-03T03:37:12.972 INFO:tasks.ceph:Generating config... 2024-04-03T03:37:12.974 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-03T03:37:12.974 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-04-03T03:37:12.974 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-04-03T03:37:12.974 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-04-03T03:37:12.974 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-04-03T03:37:12.974 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-04-03T03:37:12.974 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-04-03T03:37:12.974 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-03T03:37:12.974 INFO:tasks.ceph:[client] setuser = ceph 2024-04-03T03:37:12.974 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-04-03T03:37:12.974 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-04-03T03:37:12.975 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-04-03T03:37:12.975 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-04-03T03:37:12.975 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-04-03T03:37:12.975 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-03T03:37:12.975 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-03T03:37:12.975 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-03T03:37:12.975 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-03T03:37:12.975 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-03T03:37:12.975 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-03T03:37:12.975 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-03T03:37:12.975 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-03T03:37:12.975 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-03T03:37:12.975 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-03T03:37:12.975 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-03T03:37:12.976 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-03T03:37:12.976 INFO:tasks.ceph:Setting up mon.a... 2024-04-03T03:37:12.977 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-03T03:37:13.010 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.keyring 2024-04-03T03:37:13.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-03T03:37:13.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-03T03:37:13.154 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.104'), ('mon.c', '[v2:172.21.15.104:3301,v1:172.21.15.104:6790]'), ('mon.b', '172.21.15.130')] 2024-04-03T03:37:13.155 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.104,[v2:172.21.15.104:3301,v1:172.21.15.104:6790],172.21.15.130', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-03T03:37:13.156 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:13.156 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-03T03:37:13.202 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.104 --addv c '[v2:172.21.15.104:3301,v1:172.21.15.104:6790]' --add b 172.21.15.130 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:13.288 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:37:13.288 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:37:13.289 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:13.289 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: generated fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:37:13.289 INFO:teuthology.orchestra.run.smithi104.stdout:setting min_mon_release = quincy 2024-04-03T03:37:13.289 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 0 2024-04-03T03:37:13.289 INFO:teuthology.orchestra.run.smithi104.stdout:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:37:13.289 INFO:teuthology.orchestra.run.smithi104.stdout:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:37:13.289 INFO:teuthology.orchestra.run.smithi104.stdout:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:37:13.289 INFO:teuthology.orchestra.run.smithi104.stdout:min_mon_release 17 (quincy) 2024-04-03T03:37:13.290 INFO:teuthology.orchestra.run.smithi104.stdout:election_strategy: 1 2024-04-03T03:37:13.290 INFO:teuthology.orchestra.run.smithi104.stdout:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:37:13.290 INFO:teuthology.orchestra.run.smithi104.stdout:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:37:13.290 INFO:teuthology.orchestra.run.smithi104.stdout:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:37:13.290 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-03T03:37:13.291 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-03T03:37:13.339 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a081b84a-44ad-4905-81c6-ab13dbb94769... 2024-04-03T03:37:13.340 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-03T03:37:13.383 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.413 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.414 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-04-03T03:37:13.415 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.104,[v2:172.21.15.104:3301,v1:172.21.15.104:6790],172.21.15.130" 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: mon client directed command retry = 5 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: ms inject socket failures = 5000 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: osd heartbeat grace = 40 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: osd_max_pg_log_entries = 10 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: osd_min_pg_log_entries = 10 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.416 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug trim objects = true 2024-04-03T03:37:13.417 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.418 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-04-03T03:37:13.418 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-04-03T03:37:13.418 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.418 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-04-03T03:37:13.418 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.418 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-04-03T03:37:13.418 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.418 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: bdev async discard = True 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: bdev enable discard = True 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore allocator = bitmap 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 1/20 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 1/20 2024-04-03T03:37:13.419 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 4/10 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: osd fast shutdown = False 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: osd shutdown pgref assert = True 2024-04-03T03:37:13.420 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-04-03T03:37:13.421 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-04-03T03:37:13.422 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd crush smoke test = False 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-04-03T03:37:13.423 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: debug rgw = 20 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: rgw bucket counters cache = True 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: rgw crypt require ssl = False 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: rgw crypt s3 kms backend = testing 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-04-03T03:37:13.424 INFO:teuthology.orchestra.run.smithi104.stdout: rgw torrent flag = True 2024-04-03T03:37:13.425 INFO:teuthology.orchestra.run.smithi104.stdout: rgw user counters cache = True 2024-04-03T03:37:13.425 INFO:teuthology.orchestra.run.smithi104.stdout: setgroup = ceph 2024-04-03T03:37:13.425 INFO:teuthology.orchestra.run.smithi104.stdout: setuser = ceph 2024-04-03T03:37:13.425 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-04-03T03:37:13.425 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2024-04-03T03:37:13.425 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2024-04-03T03:37:13.426 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2024-04-03T03:37:13.427 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.428 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-03T03:37:13.428 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2024-04-03T03:37:13.428 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.428 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2024-04-03T03:37:13.428 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-03T03:37:13.428 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.428 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2024-04-03T03:37:13.428 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-03T03:37:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.104,[v2:172.21.15.104:3301,v1:172.21.15.104:6790],172.21.15.130" 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: mon client directed command retry = 5 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: ms inject socket failures = 5000 2024-04-03T03:37:13.430 INFO:teuthology.orchestra.run.smithi130.stdout: osd heartbeat grace = 40 2024-04-03T03:37:13.431 INFO:teuthology.orchestra.run.smithi130.stdout: osd_max_pg_log_entries = 10 2024-04-03T03:37:13.431 INFO:teuthology.orchestra.run.smithi130.stdout: osd_min_pg_log_entries = 10 2024-04-03T03:37:13.431 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:37:13.431 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.431 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2024-04-03T03:37:13.431 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2024-04-03T03:37:13.431 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.431 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug trim objects = true 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.432 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: bdev async discard = True 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: bdev enable discard = True 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = bitmap 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2024-04-03T03:37:13.433 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 1/20 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 1/20 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 4/10 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: osd fast shutdown = False 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2024-04-03T03:37:13.434 INFO:teuthology.orchestra.run.smithi130.stdout: osd shutdown pgref assert = True 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2024-04-03T03:37:13.435 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-03T03:37:13.436 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd crush smoke test = False 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: debug rgw = 20 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: rgw bucket counters cache = True 2024-04-03T03:37:13.437 INFO:teuthology.orchestra.run.smithi130.stdout: rgw crypt require ssl = False 2024-04-03T03:37:13.438 INFO:teuthology.orchestra.run.smithi130.stdout: rgw crypt s3 kms backend = testing 2024-04-03T03:37:13.438 INFO:teuthology.orchestra.run.smithi130.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-04-03T03:37:13.438 INFO:teuthology.orchestra.run.smithi130.stdout: rgw torrent flag = True 2024-04-03T03:37:13.438 INFO:teuthology.orchestra.run.smithi130.stdout: rgw user counters cache = True 2024-04-03T03:37:13.438 INFO:teuthology.orchestra.run.smithi130.stdout: setgroup = ceph 2024-04-03T03:37:13.438 INFO:teuthology.orchestra.run.smithi130.stdout: setuser = ceph 2024-04-03T03:37:13.438 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2024-04-03T03:37:13.438 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2024-04-03T03:37:13.438 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2024-04-03T03:37:13.439 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-03T03:37:13.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-03T03:37:13.517 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-03T03:37:13.517 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:13.517 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-03T03:37:13.523 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:13.523 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-03T03:37:13.570 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T03:37:13.571 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:13.571 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-03T03:37:13.571 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-03T03:37:13.636 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:13.636 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:13.683 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T03:37:13.683 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:13.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-03T03:37:13.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-03T03:37:13.709 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:13.709 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:13.755 INFO:tasks.ceph:Setting up mon nodes... 2024-04-03T03:37:13.755 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-03T03:37:13.755 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-03T03:37:13.798 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-03T03:37:13.801 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-03T03:37:13.844 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-03T03:37:13.855 INFO:tasks.ceph:Setting up mds nodes... 2024-04-03T03:37:13.855 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-03T03:37:13.855 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-03T03:37:13.889 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-03T03:37:13.899 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-03T03:37:13.933 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-03T03:37:13.944 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-03T03:37:13.944 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-03T03:37:13.944 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-03T03:37:13.957 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:13.957 INFO:tasks.ceph:role: osd.0 2024-04-03T03:37:13.958 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T03:37:13.958 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-03T03:37:14.022 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-03T03:37:14.022 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-03T03:37:14.023 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-03T03:37:14.023 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-03T03:37:14.023 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-03T03:37:14.023 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-03T03:37:14.023 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-03T03:37:14.023 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-03T03:37:14.023 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-03T03:37:14.023 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-03T03:37:14.471 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-03T03:37:14.473 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-03T03:37:14.473 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-03T03:37:14.568 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-03T03:37:14.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:37:14.578 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: /sbin/restorecon: command not found 2024-04-03T03:37:14.578 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-03T03:37:14.633 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:14.633 INFO:tasks.ceph:role: osd.1 2024-04-03T03:37:14.633 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T03:37:14.633 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-03T03:37:14.694 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-03T03:37:14.695 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-03T03:37:14.695 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-03T03:37:14.695 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-03T03:37:14.695 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-03T03:37:14.695 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-03T03:37:14.695 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-03T03:37:14.695 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-03T03:37:14.695 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-03T03:37:14.695 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-03T03:37:15.163 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-03T03:37:15.166 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-03T03:37:15.167 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-03T03:37:15.317 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-03T03:37:15.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:37:15.329 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: /sbin/restorecon: command not found 2024-04-03T03:37:15.329 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-03T03:37:15.382 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:15.382 INFO:tasks.ceph:role: osd.2 2024-04-03T03:37:15.382 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T03:37:15.383 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-03T03:37:15.445 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-03T03:37:15.445 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-03T03:37:15.445 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-03T03:37:15.446 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-03T03:37:15.446 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-03T03:37:15.446 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-03T03:37:15.446 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-03T03:37:15.446 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-03T03:37:15.446 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-03T03:37:15.446 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-03T03:37:15.924 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-03T03:37:15.926 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-03T03:37:15.926 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-03T03:37:16.073 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-03T03:37:16.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:37:16.085 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: /sbin/restorecon: command not found 2024-04-03T03:37:16.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-03T03:37:16.138 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:16.138 INFO:tasks.ceph:role: osd.3 2024-04-03T03:37:16.138 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T03:37:16.139 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-03T03:37:16.203 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-03T03:37:16.203 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-03T03:37:16.203 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-03T03:37:16.203 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-03T03:37:16.203 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-03T03:37:16.203 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-04-03T03:37:16.203 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-03T03:37:16.203 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-03T03:37:16.204 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-03T03:37:16.204 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-03T03:37:16.632 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-04-03T03:37:16.635 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-04-03T03:37:16.635 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-03T03:37:16.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-03T03:37:16.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:37:16.737 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: /sbin/restorecon: command not found 2024-04-03T03:37:16.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:16.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:16.846+0000 7f274dc947c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-03T03:37:16.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:16.850+0000 7f274dc947c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-03T03:37:16.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:16.850+0000 7f274dc947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-03T03:37:16.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:16.850+0000 7f274dc947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-03T03:37:16.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:16.850+0000 7f274dc947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-03T03:37:16.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:16.854+0000 7f274dc947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-03T03:37:19.839 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-03T03:37:19.853 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:19.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:19.934+0000 7ff5a56327c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-03T03:37:19.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:19.934+0000 7ff5a56327c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-03T03:37:19.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:19.934+0000 7ff5a56327c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-03T03:37:19.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:19.934+0000 7ff5a56327c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-03T03:37:19.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:19.934+0000 7ff5a56327c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-03T03:37:19.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:19.934+0000 7ff5a56327c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-03T03:37:22.901 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-03T03:37:22.955 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:23.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:23.034+0000 7f2623f577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-03T03:37:23.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:23.034+0000 7f2623f577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-03T03:37:23.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:23.034+0000 7f2623f577c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-03T03:37:23.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:23.034+0000 7f2623f577c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-03T03:37:23.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:23.034+0000 7f2623f577c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-03T03:37:23.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:23.034+0000 7f2623f577c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-03T03:37:26.025 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-03T03:37:26.079 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:26.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:26.162+0000 7f8cb37697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-03T03:37:26.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:26.162+0000 7f8cb37697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-03T03:37:26.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:26.162+0000 7f8cb37697c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-03T03:37:26.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:26.162+0000 7f8cb37697c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-03T03:37:26.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:26.162+0000 7f8cb37697c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-03T03:37:26.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:37:26.166+0000 7f8cb37697c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-03T03:37:29.135 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-03T03:37:29.192 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-03T03:37:29.207 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:29.207 INFO:tasks.ceph:role: osd.4 2024-04-03T03:37:29.207 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T03:37:29.207 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-03T03:37:29.270 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-03T03:37:29.741 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-03T03:37:29.743 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-03T03:37:29.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-03T03:37:29.854 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-03T03:37:29.865 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-04-03T03:37:29.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:37:29.866 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-03T03:37:29.926 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:29.926 INFO:tasks.ceph:role: osd.5 2024-04-03T03:37:29.926 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T03:37:29.926 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-03T03:37:29.990 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-03T03:37:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-03T03:37:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-03T03:37:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-03T03:37:29.990 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-03T03:37:29.990 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-03T03:37:29.990 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-03T03:37:29.990 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-03T03:37:29.991 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-03T03:37:29.991 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-03T03:37:30.412 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-03T03:37:30.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-03T03:37:30.414 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-03T03:37:30.480 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-03T03:37:30.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:37:30.533 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-04-03T03:37:30.533 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-03T03:37:30.586 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:30.586 INFO:tasks.ceph:role: osd.6 2024-04-03T03:37:30.587 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T03:37:30.587 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-03T03:37:30.650 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-03T03:37:30.650 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-03T03:37:30.651 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-03T03:37:30.651 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-03T03:37:30.651 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-03T03:37:30.651 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-03T03:37:30.651 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-03T03:37:30.651 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-03T03:37:30.651 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-03T03:37:30.651 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-03T03:37:31.120 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-03T03:37:31.122 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-03T03:37:31.122 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-03T03:37:31.221 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-03T03:37:31.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:37:31.231 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-04-03T03:37:31.232 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-03T03:37:31.288 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-03T03:37:31.288 INFO:tasks.ceph:role: osd.7 2024-04-03T03:37:31.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T03:37:31.289 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-03T03:37:31.352 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-03T03:37:31.353 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-03T03:37:31.353 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-03T03:37:31.353 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-03T03:37:31.353 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-03T03:37:31.353 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-03T03:37:31.353 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-03T03:37:31.353 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-03T03:37:31.353 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-03T03:37:31.353 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-03T03:37:31.805 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-03T03:37:31.807 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-03T03:37:31.807 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-03T03:37:31.950 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-03T03:37:31.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:37:31.962 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-04-03T03:37:31.963 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:32.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:32.084+0000 7fe5be0877c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-03T03:37:32.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:32.088+0000 7fe5be0877c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-03T03:37:32.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:32.088+0000 7fe5be0877c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-03T03:37:32.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:32.088+0000 7fe5be0877c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-03T03:37:32.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:32.088+0000 7fe5be0877c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-03T03:37:32.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:32.092+0000 7fe5be0877c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-03T03:37:35.088 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-03T03:37:35.103 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:35.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:35.180+0000 7fa602a517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-03T03:37:35.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:35.180+0000 7fa602a517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-03T03:37:35.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:35.180+0000 7fa602a517c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-03T03:37:35.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:35.180+0000 7fa602a517c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-03T03:37:35.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:35.180+0000 7fa602a517c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-03T03:37:35.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:35.180+0000 7fa602a517c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-03T03:37:38.166 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-03T03:37:38.223 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:38.303 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:38.300+0000 7ffbaca227c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-03T03:37:38.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:38.300+0000 7ffbaca227c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-03T03:37:38.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:38.300+0000 7ffbaca227c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-03T03:37:38.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:38.300+0000 7ffbaca227c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-03T03:37:38.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:38.300+0000 7ffbaca227c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-03T03:37:38.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:38.300+0000 7ffbaca227c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-03T03:37:41.291 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-03T03:37:41.347 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:41.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:41.424+0000 7f0abb3e77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-03T03:37:41.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:41.424+0000 7f0abb3e77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-03T03:37:41.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:41.424+0000 7f0abb3e77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-03T03:37:41.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:41.424+0000 7f0abb3e77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-03T03:37:41.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:41.424+0000 7f0abb3e77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-03T03:37:41.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-03T03:37:41.424+0000 7f0abb3e77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-03T03:37:44.406 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-03T03:37:44.462 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-03T03:37:44.463 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:44.463 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-03T03:37:44.478 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:44.478 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-03T03:37:44.534 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:44.534 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-03T03:37:44.590 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:44.590 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-03T03:37:44.645 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:44.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-03T03:37:44.701 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:44.702 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-03T03:37:44.716 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:44.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-03T03:37:44.771 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:44.771 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-03T03:37:44.826 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:44.826 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-03T03:37:44.886 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:44.886 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-03T03:37:44.942 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:44.942 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-03T03:37:44.949 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:44.949 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-03T03:37:44.990 INFO:tasks.ceph:Adding keys to all mons... 2024-04-03T03:37:44.991 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-03T03:37:44.993 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-03T03:37:45.036 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.y] 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDpzgxmup+ZLxAAbOoijlsRBAPke+8kgZAF0A== 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDszgxm3ByUMhAAC3yP68AY62TyPEP7xyYQKA== 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDvzgxm0RDLNxAAzEWeOuTpgnUSHIAp1gSydA== 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDzzgxmCPgvAhAAk56N+TAUywl6+mIwsvjRUw== 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQD2zgxmMEfdCRAAdBhxnagZ8HXPIV3Jt1N7lg== 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDpzgxmX11iMhAADRUb4bpm5A+l1Ju+7dPUzg== 2024-04-03T03:37:45.037 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.4] 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQD8zgxmKQRNBRAABk1GkVD0vYPwtnZ6i8PGCA== 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.5] 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQD/zgxmtOITCxAAazjGKk7SGnJpyzxp87yH1A== 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.6] 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQACzwxmkiUwEhAAdD7pk+aM2Y96DAC0lCJDoA== 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.7] 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAFzwxmYL6YGRAAEEKrR0kmp8wcywc/AW623w== 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDpzgxmhZz9NBAAn7UCl+aVIRmi1NXeT8lW0g== 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout:[client.1] 2024-04-03T03:37:45.038 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDpzgxmPKuzNxAAn+YbjWGLWQg41ASLTBmSEA== 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDpzgxmup+ZLxAAbOoijlsRBAPke+8kgZAF0A== 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDszgxm3ByUMhAAC3yP68AY62TyPEP7xyYQKA== 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDvzgxm0RDLNxAAzEWeOuTpgnUSHIAp1gSydA== 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDzzgxmCPgvAhAAk56N+TAUywl6+mIwsvjRUw== 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQD2zgxmMEfdCRAAdBhxnagZ8HXPIV3Jt1N7lg== 2024-04-03T03:37:45.045 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDpzgxmX11iMhAADRUb4bpm5A+l1Ju+7dPUzg== 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQD8zgxmKQRNBRAABk1GkVD0vYPwtnZ6i8PGCA== 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQD/zgxmtOITCxAAazjGKk7SGnJpyzxp87yH1A== 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQACzwxmkiUwEhAAdD7pk+aM2Y96DAC0lCJDoA== 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAFzwxmYL6YGRAAEEKrR0kmp8wcywc/AW623w== 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDpzgxmhZz9NBAAn7UCl+aVIRmi1NXeT8lW0g== 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2024-04-03T03:37:45.046 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQDpzgxmPKuzNxAAn+YbjWGLWQg41ASLTBmSEA== 2024-04-03T03:37:45.047 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-03T03:37:45.083 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-03T03:37:45.134 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.171 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.222 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.225 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.265 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.308 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.352 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.388 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.437 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-03T03:37:45.476 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-03T03:37:45.517 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.556 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.605 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.636 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.688 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.715 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.768 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.804 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-03T03:37:45.847 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-03T03:37:45.884 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-03T03:37:45.934 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-03T03:37:45.967 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-03T03:37:46.022 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-03T03:37:46.022 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-03T03:37:46.062 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-03T03:37:46.155 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-03T03:37:46.165 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-03T03:37:46.215 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-03T03:37:46.307 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-03T03:37:46.317 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-03T03:37:46.331 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-03T03:37:46.423 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-03T03:37:46.433 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:46.435 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-03T03:37:46.478 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-03T03:37:46.478 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-03T03:37:46.478 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-03T03:37:46.483 INFO:tasks.ceph.mon.a:Started 2024-04-03T03:37:46.483 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-03T03:37:46.483 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-03T03:37:46.486 INFO:tasks.ceph.mon.c:Started 2024-04-03T03:37:46.486 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-03T03:37:46.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-03T03:37:46.523 INFO:tasks.ceph.mon.b:Started 2024-04-03T03:37:46.524 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-03T03:37:46.524 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-03T03:37:46.524 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-03T03:37:46.528 INFO:tasks.ceph.mgr.y:Started 2024-04-03T03:37:46.528 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-03T03:37:46.529 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-03T03:37:46.530 INFO:tasks.ceph.mgr.x:Started 2024-04-03T03:37:46.531 INFO:tasks.ceph:Setting crush tunables to default 2024-04-03T03:37:46.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd crush tunables default 2024-04-03T03:37:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:adjusted tunables profile to default 2024-04-03T03:37:52.066 INFO:tasks.ceph:check_enable_crimson: False 2024-04-03T03:37:52.066 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-03T03:37:52.066 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:52.066 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-03T03:37:52.076 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:52.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-03T03:37:52.127 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:52.128 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-03T03:37:52.154 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:52.152+0000 7f35d66ae180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-03T03:37:52.176 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:52.173+0000 7f59a7675180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-03T03:37:52.181 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:37:52.181 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-03T03:37:52.233 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:52.233 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-03T03:37:52.247 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:52.247 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-03T03:37:52.301 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:52.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-03T03:37:52.358 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-03T03:37:52.358 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-03T03:37:52.414 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new cdcccedf-738f-4af4-b6fe-239363e19af7 0 2024-04-03T03:37:52.636 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:52.633+0000 7f59a7675180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-03T03:37:52.664 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:52.660+0000 7f35d66ae180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-03T03:37:52.666 INFO:teuthology.orchestra.run.smithi130.stdout:0 2024-04-03T03:37:52.682 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new cb64780c-0034-4021-a7d7-0b725dd52bd1 1 2024-04-03T03:37:52.824 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:52.821+0000 7f59a7675180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-03T03:37:52.851 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:52.848+0000 7f35d66ae180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-03T03:37:52.880 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-04-03T03:37:52.897 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 493c05f7-c1db-4b96-8b6f-02aeb44d8c11 2 2024-04-03T03:37:53.096 INFO:teuthology.orchestra.run.smithi130.stdout:2 2024-04-03T03:37:53.113 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new cadbc92e-6c80-46a1-ba6a-048465239e9a 3 2024-04-03T03:37:53.313 INFO:teuthology.orchestra.run.smithi130.stdout:3 2024-04-03T03:37:53.329 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 5e978b18-a3f9-423b-ac65-efd7261c2127 4 2024-04-03T03:37:53.368 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:53.365+0000 7f59a7675180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-03T03:37:53.421 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:53.417+0000 7f59a7675180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-03T03:37:53.422 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:53.416+0000 7f35d66ae180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-03T03:37:53.474 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:53.469+0000 7f59a7675180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-03T03:37:53.477 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:53.472+0000 7f35d66ae180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-03T03:37:53.528 INFO:teuthology.orchestra.run.smithi130.stdout:4 2024-04-03T03:37:53.530 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:53.528+0000 7f35d66ae180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-03T03:37:53.546 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new b5e1a1fd-c60f-4f92-8176-f41d8ef5d86b 5 2024-04-03T03:37:53.551 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:53.549+0000 7f59a7675180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-03T03:37:53.602 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:53.601+0000 7f59a7675180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-03T03:37:53.610 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:53.608+0000 7f35d66ae180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-03T03:37:53.664 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:53.660+0000 7f35d66ae180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-03T03:37:53.678 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:53.677+0000 7f59a7675180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-03T03:37:53.730 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:53.729+0000 7f59a7675180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-03T03:37:53.743 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:53.740+0000 7f35d66ae180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-03T03:37:53.744 INFO:teuthology.orchestra.run.smithi130.stdout:5 2024-04-03T03:37:53.761 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 734ba606-b896-45d4-8268-9ab8ba12baa5 6 2024-04-03T03:37:53.798 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:53.796+0000 7f35d66ae180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-03T03:37:53.881 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:53.877+0000 7f59a7675180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-03T03:37:53.942 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:53.941+0000 7f59a7675180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-03T03:37:53.953 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:53.948+0000 7f35d66ae180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-03T03:37:53.955 INFO:teuthology.orchestra.run.smithi130.stdout:6 2024-04-03T03:37:53.974 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new ee2a9629-90cb-4b2d-8793-bb070513fada 7 2024-04-03T03:37:54.016 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:54.012+0000 7f35d66ae180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-03T03:37:54.207 INFO:teuthology.orchestra.run.smithi130.stdout:7 2024-04-03T03:37:54.223 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-03T03:37:54.223 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-03T03:37:54.226 INFO:tasks.ceph.osd.0:Started 2024-04-03T03:37:54.226 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-03T03:37:54.226 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-03T03:37:54.229 INFO:tasks.ceph.osd.1:Started 2024-04-03T03:37:54.229 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-03T03:37:54.229 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-03T03:37:54.231 INFO:tasks.ceph.osd.2:Started 2024-04-03T03:37:54.231 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-03T03:37:54.231 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-03T03:37:54.234 INFO:tasks.ceph.osd.3:Started 2024-04-03T03:37:54.234 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-03T03:37:54.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-03T03:37:54.237 INFO:tasks.ceph.osd.4:Started 2024-04-03T03:37:54.237 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-03T03:37:54.237 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-03T03:37:54.238 INFO:tasks.ceph.osd.5:Started 2024-04-03T03:37:54.239 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-03T03:37:54.239 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-03T03:37:54.241 INFO:tasks.ceph.osd.6:Started 2024-04-03T03:37:54.241 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-03T03:37:54.241 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-03T03:37:54.243 INFO:tasks.ceph.osd.7:Started 2024-04-03T03:37:54.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-03T03:37:54.467 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:37:54.467 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":10,"fsid":"a081b84a-44ad-4905-81c6-ab13dbb94769","created":"2024-04-03T03:37:51.907603+0000","modified":"2024-04-03T03:37:54.203613+0000","last_up_change":"0.000000","last_in_change":"2024-04-03T03:37:54.203613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cdcccedf-738f-4af4-b6fe-239363e19af7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb64780c-0034-4021-a7d7-0b725dd52bd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"493c05f7-c1db-4b96-8b6f-02aeb44d8c11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cadbc92e-6c80-46a1-ba6a-048465239e9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5e978b18-a3f9-423b-ac65-efd7261c2127","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b5e1a1fd-c60f-4f92-8176-f41d8ef5d86b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"734ba606-b896-45d4-8268-9ab8ba12baa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ee2a9629-90cb-4b2d-8793-bb070513fada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T03:37:54.483 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-03T03:37:54.483 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-03T03:37:54.612 INFO:tasks.ceph.mgr.y.smithi104.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-03T03:37:54.612 INFO:tasks.ceph.mgr.y.smithi104.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-03T03:37:54.612 INFO:tasks.ceph.mgr.y.smithi104.stderr: from numpy import show_config as show_numpy_config 2024-04-03T03:37:54.615 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-03T03:37:54.613+0000 7f6cf21a07c0 -1 Falling back to public interface 2024-04-03T03:37:54.627 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-04-03T03:37:54.625+0000 7f223e66b7c0 -1 Falling back to public interface 2024-04-03T03:37:54.627 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-04-03T03:37:54.625+0000 7fd936beb7c0 -1 Falling back to public interface 2024-04-03T03:37:54.651 INFO:tasks.ceph.mgr.x.smithi130.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-03T03:37:54.651 INFO:tasks.ceph.mgr.x.smithi130.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-03T03:37:54.651 INFO:tasks.ceph.mgr.x.smithi130.stderr: from numpy import show_config as show_numpy_config 2024-04-03T03:37:54.683 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:54.681+0000 7f59a7675180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-03T03:37:54.712 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:54.708+0000 7f35d66ae180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-03T03:37:54.840 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:54.837+0000 7f59a7675180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-03T03:37:54.859 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-03T03:37:54.856+0000 7f70221b87c0 -1 Falling back to public interface 2024-04-03T03:37:54.859 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-03T03:37:54.856+0000 7fc98796b7c0 -1 Falling back to public interface 2024-04-03T03:37:54.860 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-03T03:37:54.856+0000 7f9eac1c47c0 -1 Falling back to public interface 2024-04-03T03:37:54.861 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-03T03:37:54.856+0000 7f9eab184640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6817/0: (98) Address already in use 2024-04-03T03:37:54.863 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-03T03:37:54.860+0000 7fb499e947c0 -1 Falling back to public interface 2024-04-03T03:37:54.863 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-04-03T03:37:54.861+0000 7f892a0d87c0 -1 Falling back to public interface 2024-04-03T03:37:54.889 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:54.884+0000 7f35d66ae180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-03T03:37:54.996 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:54.993+0000 7f59a7675180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-03T03:37:55.045 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:55.040+0000 7f35d66ae180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-03T03:37:55.065 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:55.061+0000 7f59a7675180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-03T03:37:55.107 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:55.104+0000 7f35d66ae180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-03T03:37:55.200 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:55.197+0000 7f59a7675180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-03T03:37:55.241 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:55.236+0000 7f35d66ae180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-03T03:37:55.289 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-03T03:37:55.460 INFO:teuthology.misc.health.smithi104.stdout: 2024-04-03T03:37:55.461 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":10,"fsid":"a081b84a-44ad-4905-81c6-ab13dbb94769","created":"2024-04-03T03:37:51.907603+0000","modified":"2024-04-03T03:37:54.203613+0000","last_up_change":"0.000000","last_in_change":"2024-04-03T03:37:54.203613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cdcccedf-738f-4af4-b6fe-239363e19af7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb64780c-0034-4021-a7d7-0b725dd52bd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"493c05f7-c1db-4b96-8b6f-02aeb44d8c11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cadbc92e-6c80-46a1-ba6a-048465239e9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5e978b18-a3f9-423b-ac65-efd7261c2127","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b5e1a1fd-c60f-4f92-8176-f41d8ef5d86b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"734ba606-b896-45d4-8268-9ab8ba12baa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ee2a9629-90cb-4b2d-8793-bb070513fada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T03:37:55.480 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-03T03:37:55.835 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:55.833+0000 7f59a7675180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-03T03:37:55.860 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:55.856+0000 7f35d66ae180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-03T03:37:55.909 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:55.905+0000 7f59a7675180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-03T03:37:55.934 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:55.932+0000 7f35d66ae180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-03T03:37:56.090 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:56.085+0000 7f59a7675180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-03T03:37:56.114 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:56.112+0000 7f35d66ae180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-03T03:37:56.163 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:56.161+0000 7f59a7675180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-03T03:37:56.187 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:56.184+0000 7f35d66ae180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-03T03:37:56.448 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:56.445+0000 7f59a7675180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-03T03:37:56.473 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:56.468+0000 7f35d66ae180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-03T03:37:56.509 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:56.505+0000 7f59a7675180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-03T03:37:56.533 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-03T03:37:56.528+0000 7f35d66ae180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-03T03:37:57.553 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:57.549+0000 7f594eac1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-03T03:37:57.553 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-04-03T03:37:57.549+0000 7f594eac1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-03T03:37:58.445 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-04-03T03:37:58.441+0000 7fd936beb7c0 -1 osd.0 0 log_to_monitors true 2024-04-03T03:37:58.469 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-04-03T03:37:58.465+0000 7f223e66b7c0 -1 osd.3 0 log_to_monitors true 2024-04-03T03:37:58.590 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-03T03:37:58.585+0000 7f6cf21a07c0 -1 osd.2 0 log_to_monitors true 2024-04-03T03:37:58.604 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-03T03:37:58.600+0000 7fc98796b7c0 -1 osd.5 0 log_to_monitors true 2024-04-03T03:37:58.714 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-03T03:37:58.708+0000 7fb499e947c0 -1 osd.4 0 log_to_monitors true 2024-04-03T03:37:58.719 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-03T03:37:58.716+0000 7f70221b87c0 -1 osd.7 0 log_to_monitors true 2024-04-03T03:37:58.721 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-03T03:37:58.716+0000 7f9eac1c47c0 -1 osd.6 0 log_to_monitors true 2024-04-03T03:37:58.814 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-04-03T03:37:58.813+0000 7f892a0d87c0 -1 osd.1 0 log_to_monitors true 2024-04-03T03:38:00.987 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-04-03T03:38:00.985+0000 7fd932b94640 -1 osd.0 0 waiting for initial osdmap 2024-04-03T03:38:01.033 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-04-03T03:38:01.029+0000 7fd92a9c8640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T03:38:01.059 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-04-03T03:38:01.057+0000 7f223a614640 -1 osd.3 0 waiting for initial osdmap 2024-04-03T03:38:01.100 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-04-03T03:38:01.097+0000 7f2232448640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T03:38:01.949 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-03T03:38:01.945+0000 7f6cee95b640 -1 osd.2 0 waiting for initial osdmap 2024-04-03T03:38:01.971 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-04-03T03:38:01.969+0000 7f6ce5f7d640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T03:38:01.989 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-04-03T03:38:01.985+0000 7f8926081640 -1 osd.1 0 waiting for initial osdmap 2024-04-03T03:38:02.019 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-04-03T03:38:02.017+0000 7f891deb5640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T03:38:02.288 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-03T03:38:02.592 INFO:teuthology.misc.health.smithi104.stdout: 2024-04-03T03:38:02.592 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":14,"fsid":"a081b84a-44ad-4905-81c6-ab13dbb94769","created":"2024-04-03T03:37:51.907603+0000","modified":"2024-04-03T03:38:02.032827+0000","last_up_change":"2024-04-03T03:38:02.032827+0000","last_in_change":"2024-04-03T03:37:54.203613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cdcccedf-738f-4af4-b6fe-239363e19af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6810","nonce":1629744318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6814","nonce":1629744318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6819","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6821","nonce":1629744318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6817","nonce":1629744318}]},"public_addr":"172.21.15.104:6810/1629744318","cluster_addr":"172.21.15.104:6814/1629744318","heartbeat_back_addr":"172.21.15.104:6821/1629744318","heartbeat_front_addr":"172.21.15.104:6817/1629744318","state":["exists","up"]},{"osd":1,"uuid":"cb64780c-0034-4021-a7d7-0b725dd52bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6825","nonce":1648728207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6827","nonce":1648728207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6831","nonce":1648728207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6829","nonce":1648728207}]},"public_addr":"172.21.15.104:6825/1648728207","cluster_addr":"172.21.15.104:6827/1648728207","heartbeat_back_addr":"172.21.15.104:6831/1648728207","heartbeat_front_addr":"172.21.15.104:6829/1648728207","state":["exists","up"]},{"osd":2,"uuid":"493c05f7-c1db-4b96-8b6f-02aeb44d8c11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6801","nonce":3577269254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6803","nonce":3577269254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6807","nonce":3577269254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6805","nonce":3577269254}]},"public_addr":"172.21.15.104:6801/3577269254","cluster_addr":"172.21.15.104:6803/3577269254","heartbeat_back_addr":"172.21.15.104:6807/3577269254","heartbeat_front_addr":"172.21.15.104:6805/3577269254","state":["exists","up"]},{"osd":3,"uuid":"cadbc92e-6c80-46a1-ba6a-048465239e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6811","nonce":2848281456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6815","nonce":2848281456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6823","nonce":2848281456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6820","nonce":2848281456}]},"public_addr":"172.21.15.104:6811/2848281456","cluster_addr":"172.21.15.104:6815/2848281456","heartbeat_back_addr":"172.21.15.104:6823/2848281456","heartbeat_front_addr":"172.21.15.104:6820/2848281456","state":["exists","up"]},{"osd":4,"uuid":"5e978b18-a3f9-423b-ac65-efd7261c2127","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b5e1a1fd-c60f-4f92-8176-f41d8ef5d86b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"734ba606-b896-45d4-8268-9ab8ba12baa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ee2a9629-90cb-4b2d-8793-bb070513fada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T03:38:02.611 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-04-03T03:38:02.735 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-03T03:38:02.732+0000 7fc983914640 -1 osd.5 0 waiting for initial osdmap 2024-04-03T03:38:02.740 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-03T03:38:02.736+0000 7fb495e3d640 -1 osd.4 0 waiting for initial osdmap 2024-04-03T03:38:02.759 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-03T03:38:02.756+0000 7fc97b748640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T03:38:02.760 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-03T03:38:02.756+0000 7f9ea816d640 -1 osd.6 0 waiting for initial osdmap 2024-04-03T03:38:02.775 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-03T03:38:02.772+0000 7fb48dc71640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T03:38:02.777 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-03T03:38:02.772+0000 7f701e161640 -1 osd.7 0 waiting for initial osdmap 2024-04-03T03:38:02.799 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-03T03:38:02.796+0000 7f9e9ffa1640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T03:38:02.802 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-03T03:38:02.800+0000 7f7015f95640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-03T03:38:09.418 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-03T03:38:09.717 INFO:teuthology.misc.health.smithi104.stdout: 2024-04-03T03:38:09.718 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":17,"fsid":"a081b84a-44ad-4905-81c6-ab13dbb94769","created":"2024-04-03T03:37:51.907603+0000","modified":"2024-04-03T03:38:05.066295+0000","last_up_change":"2024-04-03T03:38:03.047546+0000","last_in_change":"2024-04-03T03:37:54.203613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-03T03:38:02.577485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdcccedf-738f-4af4-b6fe-239363e19af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6810","nonce":1629744318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6814","nonce":1629744318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6819","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6821","nonce":1629744318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6817","nonce":1629744318}]},"public_addr":"172.21.15.104:6810/1629744318","cluster_addr":"172.21.15.104:6814/1629744318","heartbeat_back_addr":"172.21.15.104:6821/1629744318","heartbeat_front_addr":"172.21.15.104:6817/1629744318","state":["exists","up"]},{"osd":1,"uuid":"cb64780c-0034-4021-a7d7-0b725dd52bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6825","nonce":1648728207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6827","nonce":1648728207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6831","nonce":1648728207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6829","nonce":1648728207}]},"public_addr":"172.21.15.104:6825/1648728207","cluster_addr":"172.21.15.104:6827/1648728207","heartbeat_back_addr":"172.21.15.104:6831/1648728207","heartbeat_front_addr":"172.21.15.104:6829/1648728207","state":["exists","up"]},{"osd":2,"uuid":"493c05f7-c1db-4b96-8b6f-02aeb44d8c11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6801","nonce":3577269254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6803","nonce":3577269254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6807","nonce":3577269254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6805","nonce":3577269254}]},"public_addr":"172.21.15.104:6801/3577269254","cluster_addr":"172.21.15.104:6803/3577269254","heartbeat_back_addr":"172.21.15.104:6807/3577269254","heartbeat_front_addr":"172.21.15.104:6805/3577269254","state":["exists","up"]},{"osd":3,"uuid":"cadbc92e-6c80-46a1-ba6a-048465239e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6811","nonce":2848281456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6815","nonce":2848281456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6823","nonce":2848281456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6820","nonce":2848281456}]},"public_addr":"172.21.15.104:6811/2848281456","cluster_addr":"172.21.15.104:6815/2848281456","heartbeat_back_addr":"172.21.15.104:6823/2848281456","heartbeat_front_addr":"172.21.15.104:6820/2848281456","state":["exists","up"]},{"osd":4,"uuid":"5e978b18-a3f9-423b-ac65-efd7261c2127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6825","nonce":3307467241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6827","nonce":3307467241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6831","nonce":3307467241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6829","nonce":3307467241}]},"public_addr":"172.21.15.130:6825/3307467241","cluster_addr":"172.21.15.130:6827/3307467241","heartbeat_back_addr":"172.21.15.130:6831/3307467241","heartbeat_front_addr":"172.21.15.130:6829/3307467241","state":["exists","up"]},{"osd":5,"uuid":"b5e1a1fd-c60f-4f92-8176-f41d8ef5d86b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6808","nonce":2542797043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6814","nonce":2542797043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6823","nonce":2542797043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6817","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6820","nonce":2542797043}]},"public_addr":"172.21.15.130:6808/2542797043","cluster_addr":"172.21.15.130:6814/2542797043","heartbeat_back_addr":"172.21.15.130:6823/2542797043","heartbeat_front_addr":"172.21.15.130:6820/2542797043","state":["exists","up"]},{"osd":6,"uuid":"734ba606-b896-45d4-8268-9ab8ba12baa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6807","nonce":3494208016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6811","nonce":3494208016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6821","nonce":3494208016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6816","nonce":3494208016}]},"public_addr":"172.21.15.130:6807/3494208016","cluster_addr":"172.21.15.130:6811/3494208016","heartbeat_back_addr":"172.21.15.130:6821/3494208016","heartbeat_front_addr":"172.21.15.130:6816/3494208016","state":["exists","up"]},{"osd":7,"uuid":"ee2a9629-90cb-4b2d-8793-bb070513fada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6801","nonce":1404666531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6803","nonce":1404666531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6819","nonce":1404666531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6810","nonce":1404666531}]},"public_addr":"172.21.15.130:6801/1404666531","cluster_addr":"172.21.15.130:6803/1404666531","heartbeat_back_addr":"172.21.15.130:6819/1404666531","heartbeat_front_addr":"172.21.15.130:6810/1404666531","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.476315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.833487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.541824+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.514798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.672766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.567478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.759099+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.729435+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T03:38:09.734 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-03T03:38:09.734 INFO:tasks.ceph:Creating RBD pool 2024-04-03T03:38:09.734 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-03T03:38:10.604 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'rbd' created 2024-04-03T03:38:10.627 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-03T03:38:11.606 INFO:teuthology.orchestra.run.smithi104.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-03T03:38:11.633 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-03T03:38:11.633 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-03T03:38:11.634 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-03T03:38:11.634 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-03T03:38:11.634 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-03T03:38:11.975 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:38:11.992 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":666075964},{"type":"v1","addr":"172.21.15.104:6833","nonce":666075964}]},"active_addr":"172.21.15.104:6833/666075964","active_change":"2024-04-03T03:37:56.527230+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":1667415687}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":2597481487}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":2927200365}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":3984229173}]}]} 2024-04-03T03:38:11.996 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-03T03:38:11.996 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-03T03:38:11.996 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-03T03:38:12.292 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:38:12.292 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"a081b84a-44ad-4905-81c6-ab13dbb94769","created":"2024-04-03T03:37:51.907603+0000","modified":"2024-04-03T03:38:11.597033+0000","last_up_change":"2024-04-03T03:38:03.047546+0000","last_in_change":"2024-04-03T03:37:54.203613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-03T03:38:02.577485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-03T03:38:10.032509+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdcccedf-738f-4af4-b6fe-239363e19af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6810","nonce":1629744318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6814","nonce":1629744318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6819","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6821","nonce":1629744318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6817","nonce":1629744318}]},"public_addr":"172.21.15.104:6810/1629744318","cluster_addr":"172.21.15.104:6814/1629744318","heartbeat_back_addr":"172.21.15.104:6821/1629744318","heartbeat_front_addr":"172.21.15.104:6817/1629744318","state":["exists","up"]},{"osd":1,"uuid":"cb64780c-0034-4021-a7d7-0b725dd52bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6825","nonce":1648728207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6827","nonce":1648728207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6831","nonce":1648728207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6829","nonce":1648728207}]},"public_addr":"172.21.15.104:6825/1648728207","cluster_addr":"172.21.15.104:6827/1648728207","heartbeat_back_addr":"172.21.15.104:6831/1648728207","heartbeat_front_addr":"172.21.15.104:6829/1648728207","state":["exists","up"]},{"osd":2,"uuid":"493c05f7-c1db-4b96-8b6f-02aeb44d8c11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6801","nonce":3577269254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6803","nonce":3577269254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6807","nonce":3577269254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6805","nonce":3577269254}]},"public_addr":"172.21.15.104:6801/3577269254","cluster_addr":"172.21.15.104:6803/3577269254","heartbeat_back_addr":"172.21.15.104:6807/3577269254","heartbeat_front_addr":"172.21.15.104:6805/3577269254","state":["exists","up"]},{"osd":3,"uuid":"cadbc92e-6c80-46a1-ba6a-048465239e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6811","nonce":2848281456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6815","nonce":2848281456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6823","nonce":2848281456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6820","nonce":2848281456}]},"public_addr":"172.21.15.104:6811/2848281456","cluster_addr":"172.21.15.104:6815/2848281456","heartbeat_back_addr":"172.21.15.104:6823/2848281456","heartbeat_front_addr":"172.21.15.104:6820/2848281456","state":["exists","up"]},{"osd":4,"uuid":"5e978b18-a3f9-423b-ac65-efd7261c2127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6825","nonce":3307467241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6827","nonce":3307467241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6831","nonce":3307467241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6829","nonce":3307467241}]},"public_addr":"172.21.15.130:6825/3307467241","cluster_addr":"172.21.15.130:6827/3307467241","heartbeat_back_addr":"172.21.15.130:6831/3307467241","heartbeat_front_addr":"172.21.15.130:6829/3307467241","state":["exists","up"]},{"osd":5,"uuid":"b5e1a1fd-c60f-4f92-8176-f41d8ef5d86b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6808","nonce":2542797043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6814","nonce":2542797043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6823","nonce":2542797043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6817","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6820","nonce":2542797043}]},"public_addr":"172.21.15.130:6808/2542797043","cluster_addr":"172.21.15.130:6814/2542797043","heartbeat_back_addr":"172.21.15.130:6823/2542797043","heartbeat_front_addr":"172.21.15.130:6820/2542797043","state":["exists","up"]},{"osd":6,"uuid":"734ba606-b896-45d4-8268-9ab8ba12baa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6807","nonce":3494208016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6811","nonce":3494208016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6821","nonce":3494208016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6816","nonce":3494208016}]},"public_addr":"172.21.15.130:6807/3494208016","cluster_addr":"172.21.15.130:6811/3494208016","heartbeat_back_addr":"172.21.15.130:6821/3494208016","heartbeat_front_addr":"172.21.15.130:6816/3494208016","state":["exists","up"]},{"osd":7,"uuid":"ee2a9629-90cb-4b2d-8793-bb070513fada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6801","nonce":1404666531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6803","nonce":1404666531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6819","nonce":1404666531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6810","nonce":1404666531}]},"public_addr":"172.21.15.130:6801/1404666531","cluster_addr":"172.21.15.130:6803/1404666531","heartbeat_back_addr":"172.21.15.130:6819/1404666531","heartbeat_front_addr":"172.21.15.130:6810/1404666531","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.476315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.833487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.541824+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.514798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.672766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.567478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.759099+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.729435+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T03:38:12.311 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-03T03:38:12.311 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-03T03:38:12.594 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:38:12.595 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"a081b84a-44ad-4905-81c6-ab13dbb94769","created":"2024-04-03T03:37:51.907603+0000","modified":"2024-04-03T03:38:11.597033+0000","last_up_change":"2024-04-03T03:38:03.047546+0000","last_in_change":"2024-04-03T03:37:54.203613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-03T03:38:02.577485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-03T03:38:10.032509+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdcccedf-738f-4af4-b6fe-239363e19af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6810","nonce":1629744318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6814","nonce":1629744318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6819","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6821","nonce":1629744318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6817","nonce":1629744318}]},"public_addr":"172.21.15.104:6810/1629744318","cluster_addr":"172.21.15.104:6814/1629744318","heartbeat_back_addr":"172.21.15.104:6821/1629744318","heartbeat_front_addr":"172.21.15.104:6817/1629744318","state":["exists","up"]},{"osd":1,"uuid":"cb64780c-0034-4021-a7d7-0b725dd52bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6825","nonce":1648728207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6827","nonce":1648728207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6831","nonce":1648728207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6829","nonce":1648728207}]},"public_addr":"172.21.15.104:6825/1648728207","cluster_addr":"172.21.15.104:6827/1648728207","heartbeat_back_addr":"172.21.15.104:6831/1648728207","heartbeat_front_addr":"172.21.15.104:6829/1648728207","state":["exists","up"]},{"osd":2,"uuid":"493c05f7-c1db-4b96-8b6f-02aeb44d8c11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6801","nonce":3577269254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6803","nonce":3577269254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6807","nonce":3577269254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6805","nonce":3577269254}]},"public_addr":"172.21.15.104:6801/3577269254","cluster_addr":"172.21.15.104:6803/3577269254","heartbeat_back_addr":"172.21.15.104:6807/3577269254","heartbeat_front_addr":"172.21.15.104:6805/3577269254","state":["exists","up"]},{"osd":3,"uuid":"cadbc92e-6c80-46a1-ba6a-048465239e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6811","nonce":2848281456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6815","nonce":2848281456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6823","nonce":2848281456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6820","nonce":2848281456}]},"public_addr":"172.21.15.104:6811/2848281456","cluster_addr":"172.21.15.104:6815/2848281456","heartbeat_back_addr":"172.21.15.104:6823/2848281456","heartbeat_front_addr":"172.21.15.104:6820/2848281456","state":["exists","up"]},{"osd":4,"uuid":"5e978b18-a3f9-423b-ac65-efd7261c2127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6825","nonce":3307467241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6827","nonce":3307467241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6831","nonce":3307467241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6829","nonce":3307467241}]},"public_addr":"172.21.15.130:6825/3307467241","cluster_addr":"172.21.15.130:6827/3307467241","heartbeat_back_addr":"172.21.15.130:6831/3307467241","heartbeat_front_addr":"172.21.15.130:6829/3307467241","state":["exists","up"]},{"osd":5,"uuid":"b5e1a1fd-c60f-4f92-8176-f41d8ef5d86b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6808","nonce":2542797043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6814","nonce":2542797043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6823","nonce":2542797043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6817","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6820","nonce":2542797043}]},"public_addr":"172.21.15.130:6808/2542797043","cluster_addr":"172.21.15.130:6814/2542797043","heartbeat_back_addr":"172.21.15.130:6823/2542797043","heartbeat_front_addr":"172.21.15.130:6820/2542797043","state":["exists","up"]},{"osd":6,"uuid":"734ba606-b896-45d4-8268-9ab8ba12baa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6807","nonce":3494208016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6811","nonce":3494208016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6821","nonce":3494208016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6816","nonce":3494208016}]},"public_addr":"172.21.15.130:6807/3494208016","cluster_addr":"172.21.15.130:6811/3494208016","heartbeat_back_addr":"172.21.15.130:6821/3494208016","heartbeat_front_addr":"172.21.15.130:6816/3494208016","state":["exists","up"]},{"osd":7,"uuid":"ee2a9629-90cb-4b2d-8793-bb070513fada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6801","nonce":1404666531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6803","nonce":1404666531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6819","nonce":1404666531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6810","nonce":1404666531}]},"public_addr":"172.21.15.130:6801/1404666531","cluster_addr":"172.21.15.130:6803/1404666531","heartbeat_back_addr":"172.21.15.130:6819/1404666531","heartbeat_front_addr":"172.21.15.130:6810/1404666531","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.476315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.833487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.541824+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.514798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.672766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.567478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.759099+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.729435+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T03:38:12.612 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-03T03:38:12.613 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-03T03:38:12.613 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-03T03:38:12.613 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-03T03:38:12.614 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-03T03:38:12.614 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-03T03:38:12.615 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-03T03:38:12.615 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-03T03:38:12.862 INFO:teuthology.orchestra.run.smithi104.stdout:60129542150 2024-04-03T03:38:12.863 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-03T03:38:12.869 INFO:teuthology.orchestra.run.smithi104.stdout:60129542149 2024-04-03T03:38:12.870 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-03T03:38:12.875 INFO:teuthology.orchestra.run.smithi104.stdout:64424509444 2024-04-03T03:38:12.876 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-03T03:38:12.885 INFO:teuthology.orchestra.run.smithi104.stdout:60129542148 2024-04-03T03:38:12.885 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-03T03:38:12.887 INFO:teuthology.orchestra.run.smithi104.stdout:64424509444 2024-04-03T03:38:12.888 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-03T03:38:12.889 INFO:teuthology.orchestra.run.smithi104.stdout:60129542149 2024-04-03T03:38:12.889 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-03T03:38:12.891 INFO:teuthology.orchestra.run.smithi104.stdout:64424509445 2024-04-03T03:38:12.891 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-03T03:38:12.895 INFO:teuthology.orchestra.run.smithi104.stdout:64424509446 2024-04-03T03:38:12.895 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-03T03:38:13.348 INFO:teuthology.orchestra.run.smithi104.stdout:60129542148 2024-04-03T03:38:13.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.2 2024-04-03T03:38:13.392 INFO:teuthology.orchestra.run.smithi104.stdout:64424509443 2024-04-03T03:38:13.398 INFO:teuthology.orchestra.run.smithi104.stdout:60129542147 2024-04-03T03:38:13.403 INFO:teuthology.orchestra.run.smithi104.stdout:64424509443 2024-04-03T03:38:13.410 INFO:teuthology.orchestra.run.smithi104.stdout:60129542146 2024-04-03T03:38:13.415 INFO:teuthology.orchestra.run.smithi104.stdout:60129542147 2024-04-03T03:38:13.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.4 2024-04-03T03:38:13.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.3 2024-04-03T03:38:13.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.1 2024-04-03T03:38:13.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.5 2024-04-03T03:38:13.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.0 2024-04-03T03:38:13.456 INFO:teuthology.orchestra.run.smithi104.stdout:64424509445 2024-04-03T03:38:13.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-04-03T03:38:13.484 INFO:teuthology.orchestra.run.smithi104.stdout:64424509444 2024-04-03T03:38:13.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2024-04-03T03:38:14.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-03T03:38:14.425 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-03T03:38:14.430 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-03T03:38:14.436 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-03T03:38:14.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-03T03:38:14.441 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-03T03:38:14.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-03T03:38:14.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-03T03:38:14.898 INFO:teuthology.orchestra.run.smithi104.stdout:60129542150 2024-04-03T03:38:14.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-04-03T03:38:14.924 DEBUG:teuthology.parallel:result is None 2024-04-03T03:38:14.946 INFO:teuthology.orchestra.run.smithi104.stdout:64424509445 2024-04-03T03:38:14.960 INFO:teuthology.orchestra.run.smithi104.stdout:64424509445 2024-04-03T03:38:14.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.4 2024-04-03T03:38:14.973 DEBUG:teuthology.parallel:result is None 2024-04-03T03:38:14.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.5 2024-04-03T03:38:14.979 DEBUG:teuthology.parallel:result is None 2024-04-03T03:38:14.982 INFO:teuthology.orchestra.run.smithi104.stdout:60129542149 2024-04-03T03:38:14.984 INFO:teuthology.orchestra.run.smithi104.stdout:60129542149 2024-04-03T03:38:14.985 INFO:teuthology.orchestra.run.smithi104.stdout:60129542148 2024-04-03T03:38:15.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-04-03T03:38:15.008 DEBUG:teuthology.parallel:result is None 2024-04-03T03:38:15.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-04-03T03:38:15.014 DEBUG:teuthology.parallel:result is None 2024-04-03T03:38:15.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-04-03T03:38:15.014 DEBUG:teuthology.parallel:result is None 2024-04-03T03:38:15.022 INFO:teuthology.orchestra.run.smithi104.stdout:64424509446 2024-04-03T03:38:15.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.6 2024-04-03T03:38:15.041 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-04-03T03:38:15.041 DEBUG:teuthology.parallel:result is None 2024-04-03T03:38:15.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.7 2024-04-03T03:38:15.054 DEBUG:teuthology.parallel:result is None 2024-04-03T03:38:15.054 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-03T03:38:15.055 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-03T03:38:15.362 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:38:15.363 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-03T03:38:15.379 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-03T03:38:14.540865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218808,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755912,"statfs":{"total":773094113280,"available":772870053888,"internally_reserved":0,"allocated":2686976,"data_stored":1663504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001001"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:12.618660+0000","last_change":"2024-04-03T03:38:11.618291+0000","last_active":"2024-04-03T03:38:12.618660+0000","last_peered":"2024-04-03T03:38:12.618660+0000","last_clean":"2024-04-03T03:38:12.618660+0000","last_became_active":"2024-04-03T03:38:11.617573+0000","last_became_peered":"2024-04-03T03:38:11.617573+0000","last_unstale":"2024-04-03T03:38:12.618660+0000","last_undegraded":"2024-04-03T03:38:12.618660+0000","last_fullsized":"2024-04-03T03:38:12.618660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:12:17.137777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:12.615542+0000","last_change":"2024-04-03T03:38:11.613510+0000","last_active":"2024-04-03T03:38:12.615542+0000","last_peered":"2024-04-03T03:38:12.615542+0000","last_clean":"2024-04-03T03:38:12.615542+0000","last_became_active":"2024-04-03T03:38:11.613252+0000","last_became_peered":"2024-04-03T03:38:11.613252+0000","last_unstale":"2024-04-03T03:38:12.615542+0000","last_undegraded":"2024-04-03T03:38:12.615542+0000","last_fullsized":"2024-04-03T03:38:12.615542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:56:15.329216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.033148+0000","last_change":"2024-04-03T03:38:11.618107+0000","last_active":"2024-04-03T03:38:13.033148+0000","last_peered":"2024-04-03T03:38:13.033148+0000","last_clean":"2024-04-03T03:38:13.033148+0000","last_became_active":"2024-04-03T03:38:11.617057+0000","last_became_peered":"2024-04-03T03:38:11.617057+0000","last_unstale":"2024-04-03T03:38:13.033148+0000","last_undegraded":"2024-04-03T03:38:13.033148+0000","last_fullsized":"2024-04-03T03:38:13.033148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:22:38.744380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:12.615540+0000","last_change":"2024-04-03T03:38:11.611219+0000","last_active":"2024-04-03T03:38:12.615540+0000","last_peered":"2024-04-03T03:38:12.615540+0000","last_clean":"2024-04-03T03:38:12.615540+0000","last_became_active":"2024-04-03T03:38:11.609995+0000","last_became_peered":"2024-04-03T03:38:11.609995+0000","last_unstale":"2024-04-03T03:38:12.615540+0000","last_undegraded":"2024-04-03T03:38:12.615540+0000","last_fullsized":"2024-04-03T03:38:12.615540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:52:03.961331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.032608+0000","last_change":"2024-04-03T03:38:11.614869+0000","last_active":"2024-04-03T03:38:13.032608+0000","last_peered":"2024-04-03T03:38:13.032608+0000","last_clean":"2024-04-03T03:38:13.032608+0000","last_became_active":"2024-04-03T03:38:11.613973+0000","last_became_peered":"2024-04-03T03:38:11.613973+0000","last_unstale":"2024-04-03T03:38:13.032608+0000","last_undegraded":"2024-04-03T03:38:13.032608+0000","last_fullsized":"2024-04-03T03:38:13.032608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:38:53.162490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-03T03:38:11.756492+0000","last_change":"2024-04-03T03:38:11.755773+0000","last_active":"2024-04-03T03:38:11.756492+0000","last_peered":"2024-04-03T03:38:11.756492+0000","last_clean":"2024-04-03T03:38:11.756492+0000","last_became_active":"2024-04-03T03:38:11.755301+0000","last_became_peered":"2024-04-03T03:38:11.755301+0000","last_unstale":"2024-04-03T03:38:11.756492+0000","last_undegraded":"2024-04-03T03:38:11.756492+0000","last_fullsized":"2024-04-03T03:38:11.756492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:16:27.269270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.033047+0000","last_change":"2024-04-03T03:38:11.620060+0000","last_active":"2024-04-03T03:38:13.033047+0000","last_peered":"2024-04-03T03:38:13.033047+0000","last_clean":"2024-04-03T03:38:13.033047+0000","last_became_active":"2024-04-03T03:38:11.619474+0000","last_became_peered":"2024-04-03T03:38:11.619474+0000","last_unstale":"2024-04-03T03:38:13.033047+0000","last_undegraded":"2024-04-03T03:38:13.033047+0000","last_fullsized":"2024-04-03T03:38:13.033047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:13:54.362230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.032623+0000","last_change":"2024-04-03T03:38:11.616774+0000","last_active":"2024-04-03T03:38:13.032623+0000","last_peered":"2024-04-03T03:38:13.032623+0000","last_clean":"2024-04-03T03:38:13.032623+0000","last_became_active":"2024-04-03T03:38:11.615990+0000","last_became_peered":"2024-04-03T03:38:11.615990+0000","last_unstale":"2024-04-03T03:38:13.032623+0000","last_undegraded":"2024-04-03T03:38:13.032623+0000","last_fullsized":"2024-04-03T03:38:13.032623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:31.225680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.032889+0000","last_change":"2024-04-03T03:38:04.257665+0000","last_active":"2024-04-03T03:38:13.032889+0000","last_peered":"2024-04-03T03:38:13.032889+0000","last_clean":"2024-04-03T03:38:13.032889+0000","last_became_active":"2024-04-03T03:38:04.255147+0000","last_became_peered":"2024-04-03T03:38:04.255147+0000","last_unstale":"2024-04-03T03:38:13.032889+0000","last_undegraded":"2024-04-03T03:38:13.032889+0000","last_fullsized":"2024-04-03T03:38:13.032889+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_clean_scrub_stamp":"2024-04-03T03:38:03.047546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:39:28.268533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":649277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":778240,"data_stored":649277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T03:38:15.380 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-03T03:38:15.659 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:38:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-03T03:38:15.675 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-03T03:38:14.540865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218808,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755912,"statfs":{"total":773094113280,"available":772870053888,"internally_reserved":0,"allocated":2686976,"data_stored":1663504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001001"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:12.618660+0000","last_change":"2024-04-03T03:38:11.618291+0000","last_active":"2024-04-03T03:38:12.618660+0000","last_peered":"2024-04-03T03:38:12.618660+0000","last_clean":"2024-04-03T03:38:12.618660+0000","last_became_active":"2024-04-03T03:38:11.617573+0000","last_became_peered":"2024-04-03T03:38:11.617573+0000","last_unstale":"2024-04-03T03:38:12.618660+0000","last_undegraded":"2024-04-03T03:38:12.618660+0000","last_fullsized":"2024-04-03T03:38:12.618660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:12:17.137777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:12.615542+0000","last_change":"2024-04-03T03:38:11.613510+0000","last_active":"2024-04-03T03:38:12.615542+0000","last_peered":"2024-04-03T03:38:12.615542+0000","last_clean":"2024-04-03T03:38:12.615542+0000","last_became_active":"2024-04-03T03:38:11.613252+0000","last_became_peered":"2024-04-03T03:38:11.613252+0000","last_unstale":"2024-04-03T03:38:12.615542+0000","last_undegraded":"2024-04-03T03:38:12.615542+0000","last_fullsized":"2024-04-03T03:38:12.615542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:56:15.329216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.033148+0000","last_change":"2024-04-03T03:38:11.618107+0000","last_active":"2024-04-03T03:38:13.033148+0000","last_peered":"2024-04-03T03:38:13.033148+0000","last_clean":"2024-04-03T03:38:13.033148+0000","last_became_active":"2024-04-03T03:38:11.617057+0000","last_became_peered":"2024-04-03T03:38:11.617057+0000","last_unstale":"2024-04-03T03:38:13.033148+0000","last_undegraded":"2024-04-03T03:38:13.033148+0000","last_fullsized":"2024-04-03T03:38:13.033148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:22:38.744380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:12.615540+0000","last_change":"2024-04-03T03:38:11.611219+0000","last_active":"2024-04-03T03:38:12.615540+0000","last_peered":"2024-04-03T03:38:12.615540+0000","last_clean":"2024-04-03T03:38:12.615540+0000","last_became_active":"2024-04-03T03:38:11.609995+0000","last_became_peered":"2024-04-03T03:38:11.609995+0000","last_unstale":"2024-04-03T03:38:12.615540+0000","last_undegraded":"2024-04-03T03:38:12.615540+0000","last_fullsized":"2024-04-03T03:38:12.615540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:52:03.961331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.032608+0000","last_change":"2024-04-03T03:38:11.614869+0000","last_active":"2024-04-03T03:38:13.032608+0000","last_peered":"2024-04-03T03:38:13.032608+0000","last_clean":"2024-04-03T03:38:13.032608+0000","last_became_active":"2024-04-03T03:38:11.613973+0000","last_became_peered":"2024-04-03T03:38:11.613973+0000","last_unstale":"2024-04-03T03:38:13.032608+0000","last_undegraded":"2024-04-03T03:38:13.032608+0000","last_fullsized":"2024-04-03T03:38:13.032608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:38:53.162490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-03T03:38:11.756492+0000","last_change":"2024-04-03T03:38:11.755773+0000","last_active":"2024-04-03T03:38:11.756492+0000","last_peered":"2024-04-03T03:38:11.756492+0000","last_clean":"2024-04-03T03:38:11.756492+0000","last_became_active":"2024-04-03T03:38:11.755301+0000","last_became_peered":"2024-04-03T03:38:11.755301+0000","last_unstale":"2024-04-03T03:38:11.756492+0000","last_undegraded":"2024-04-03T03:38:11.756492+0000","last_fullsized":"2024-04-03T03:38:11.756492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:16:27.269270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.033047+0000","last_change":"2024-04-03T03:38:11.620060+0000","last_active":"2024-04-03T03:38:13.033047+0000","last_peered":"2024-04-03T03:38:13.033047+0000","last_clean":"2024-04-03T03:38:13.033047+0000","last_became_active":"2024-04-03T03:38:11.619474+0000","last_became_peered":"2024-04-03T03:38:11.619474+0000","last_unstale":"2024-04-03T03:38:13.033047+0000","last_undegraded":"2024-04-03T03:38:13.033047+0000","last_fullsized":"2024-04-03T03:38:13.033047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:13:54.362230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.032623+0000","last_change":"2024-04-03T03:38:11.616774+0000","last_active":"2024-04-03T03:38:13.032623+0000","last_peered":"2024-04-03T03:38:13.032623+0000","last_clean":"2024-04-03T03:38:13.032623+0000","last_became_active":"2024-04-03T03:38:11.615990+0000","last_became_peered":"2024-04-03T03:38:11.615990+0000","last_unstale":"2024-04-03T03:38:13.032623+0000","last_undegraded":"2024-04-03T03:38:13.032623+0000","last_fullsized":"2024-04-03T03:38:13.032623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:31.225680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-03T03:38:13.032889+0000","last_change":"2024-04-03T03:38:04.257665+0000","last_active":"2024-04-03T03:38:13.032889+0000","last_peered":"2024-04-03T03:38:13.032889+0000","last_clean":"2024-04-03T03:38:13.032889+0000","last_became_active":"2024-04-03T03:38:04.255147+0000","last_became_peered":"2024-04-03T03:38:04.255147+0000","last_unstale":"2024-04-03T03:38:13.032889+0000","last_undegraded":"2024-04-03T03:38:13.032889+0000","last_fullsized":"2024-04-03T03:38:13.032889+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_clean_scrub_stamp":"2024-04-03T03:38:03.047546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:39:28.268533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":649277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":778240,"data_stored":649277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T03:38:15.676 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-03T03:38:15.676 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-03T03:38:15.676 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-03T03:38:15.676 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-03T03:38:15.981 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:38:15.981 INFO:teuthology.orchestra.run.smithi104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-03T03:38:15.999 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-03T03:38:15.999 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-04-03T03:38:16.010 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-04-03T03:38:16.011 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p /home/ubuntu/cephtest/ca 2024-04-03T03:38:16.016 DEBUG:teuthology.orchestra.run.smithi104:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-04-03T03:38:16.816 INFO:teuthology.orchestra.run.smithi104.stderr:.+......+.......+..+....+..+............+.+.........+.....+.......+...+...+..+...+....+...+...+...+.....+.........+.+..+...+.......+.........+...+......+.........+..+.+..+.+.........+..+......+...+.+........+..........+...+...+......+........+............+...+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+...+..+.......+............+.....+...+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+..........+..+......+.+...+..+....+.....................+...+..+.+..................+.....+......+.+..+...+....+...+..+..................+.+..+....+.....+...+.............+.....+....+...+...........+.......+............+..+...............+..........+........+..........+..+...+.......+...........+...+.+...+........+....+.........+................................+....+...+.....+...+.......+...+.................+...............+................+..+...................+.....+....+...........................+..+.......+...........+...+.......+..............+.+............+..+.+..+.+..............+.+....................................+.....+...+.+.........+..+...+...+...+...................+...+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-04-03T03:38:17.284 INFO:teuthology.orchestra.run.smithi104.stderr:.+.........+.......................+.+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.........+....+...+..+...+...+.+...+..+....+.....+.+.....+....+..+...+....+........+.......+..+................+..+.+...........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.................+.....+......+....+..+.......+.....+.............+.........+...+..+.........+......+.+...+.....+.......+..............+.+..................+......+.....+....+..+..................+..........+......+...........+...+.+......+..+............................+...+..+.........+....+.....+.+...+........+.............+.....+.+........+.+...........+.............+..+......+.........+......+.......+.....+..........+............+........+......+......+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-04-03T03:38:17.299 INFO:teuthology.orchestra.run.smithi104.stderr:----- 2024-04-03T03:38:17.307 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-04-03T03:38:17.379 DEBUG:teuthology.orchestra.run.smithi104:> sudo update-ca-certificates 2024-04-03T03:38:17.444 INFO:teuthology.orchestra.run.smithi104.stdout:Updating certificates in /etc/ssl/certs... 2024-04-03T03:38:18.101 INFO:teuthology.orchestra.run.smithi104.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-04-03T03:38:18.122 INFO:teuthology.orchestra.run.smithi104.stdout:1 added, 0 removed; done. 2024-04-03T03:38:18.135 INFO:teuthology.orchestra.run.smithi104.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-04-03T03:38:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:38:19.708 INFO:teuthology.orchestra.run.smithi104.stdout:Adding debian:root.pem 2024-04-03T03:38:19.724 INFO:teuthology.orchestra.run.smithi104.stdout:done. 2024-04-03T03:38:19.724 INFO:teuthology.orchestra.run.smithi104.stdout:done. 2024-04-03T03:38:19.728 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p /home/ubuntu/cephtest/ca 2024-04-03T03:38:19.774 DEBUG:teuthology.orchestra.run.smithi104:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi104.front.sepia.ceph.com 2024-04-03T03:38:20.039 INFO:teuthology.orchestra.run.smithi104.stderr:..+........+...+.......+..+.+.....+......+.+.....+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...+........................+.+...........+.+..+...+...+............+.......+..+.+...+.........+...........+.+......+..+.+.....+......+.+..+......+.......+........+.+...............+.....+...................+..+.............+..+....+......+..+......+....+.....+.+............+..+......+.+...+..+......+.........+.+.....+.............+......+...+..+.........+.......+..+............+.........+..........+.....+.+..................+..+.+........+....+.....+...+.........+...+...+...+.+...+......+.........+...+...+.....+.........+......+......+.+.....+...+.+..................+..+....+..............+...+...+.......+...+..+....+...+.....+...............+...+....+........+.......+......+...+...........+...+................+..............+.+..+....+....................+.+...+..+.........+...+...+...+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-04-03T03:38:20.178 INFO:teuthology.orchestra.run.smithi104.stderr:.....+.................+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+...+...+..+.+............+.....+.........+...+......+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+......+..+...+......+...+..........+..+.........+....+......+..+....+.......................+...+............+............+.+...+.....+.......+.........+.........+..............+...+....+.....+..........+.........+.....+......+.........+.+...+......+.....+......+......+....+...+.....+...+....+........+......+......+....+.....+.+......+.....+.......+........+...+.+...+..+......+...+....+.................+...+.............+..+......+.+.....+.+..+......+.......+..............+.+..+......+.+...+........+.........+..........+...+.....+......+............+...+................+.....+.+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-04-03T03:38:20.182 INFO:teuthology.orchestra.run.smithi104.stderr:----- 2024-04-03T03:38:20.185 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:38:20.185 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-04-03T03:38:20.230 DEBUG:teuthology.orchestra.run.smithi104:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-04-03T03:38:20.282 INFO:teuthology.orchestra.run.smithi104.stderr:Certificate request self-signature ok 2024-04-03T03:38:20.282 INFO:teuthology.orchestra.run.smithi104.stderr:subject=CN = smithi104.front.sepia.ceph.com 2024-04-03T03:38:20.294 DEBUG:teuthology.orchestra.run.smithi104:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-04-03T03:38:20.342 DEBUG:teuthology.orchestra.run.smithi104:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-04-03T03:38:20.396 INFO:teuthology.orchestra.run.smithi104.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-04-03T03:38:20.396 DEBUG:teuthology.orchestra.run.smithi104:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-04-03T03:38:20.443 INFO:teuthology.run_tasks:Running task rgw... 2024-04-03T03:38:20.459 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-04-03T03:38:20.459 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-03T03:38:20.460 INFO:tasks.rgw:Creating data pools 2024-04-03T03:38:20.460 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-03T03:38:20.460 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-04-03T03:38:21.677 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-04-03T03:38:23.698 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'default.rgw.buckets.data' created 2024-04-03T03:38:23.722 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-03T03:38:24.682 INFO:teuthology.orchestra.run.smithi104.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-03T03:38:24.729 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-03T03:38:25.704 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'default.rgw.buckets.index' created 2024-04-03T03:38:25.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-03T03:38:26.702 INFO:teuthology.orchestra.run.smithi104.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-03T03:38:26.755 DEBUG:tasks.rgw:Pools created 2024-04-03T03:38:26.755 INFO:tasks.rgw:Configuring compression type = random 2024-04-03T03:38:26.755 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-04-03T03:38:26.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-04-03T03:38:26.756 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-04-03T03:38:26.812 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:38:26.812 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:38:28.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.785+0000 7f95b318b640 0 -- 172.21.15.104:0/4094034419 >> [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] conn(0x7f9488066c70 msgr2=0x7f9488069130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:38:28.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:28.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b398c640 0 -- 172.21.15.104:0/2808048269 >> [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] conn(0x7f9478066d60 msgr2=0x7f9478069220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:38:28.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b5670980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:28.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b5670980 20 realm 2024-04-03T03:38:28.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:28.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b5670980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:28.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b5670980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:38:28.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:28.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b5670980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:28.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.793+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:28.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.797+0000 7f95b5670980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:38:28.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.797+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:28.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.797+0000 7f95b5670980 20 rados_obj.operate() r=0 bl.length=911 2024-04-03T03:38:28.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.797+0000 7f95b5670980 20 searching for the correct realm 2024-04-03T03:38:28.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.817+0000 7f95b5670980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:38:28.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.817+0000 7f95b5670980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:38:28.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.817+0000 7f95b5670980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:38:28.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.817+0000 7f95b5670980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:38:28.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.817+0000 7f95b5670980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:38:28.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.817+0000 7f95b5670980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:38:28.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.817+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:28.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:28.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:28.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:38:28.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:28.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 rados_obj.operate() r=0 bl.length=436 2024-04-03T03:38:28.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 zone default found 2024-04-03T03:38:28.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 4 Realm: () 2024-04-03T03:38:28.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:38:28.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:38:28.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:38:28.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 zonegroup default 2024-04-03T03:38:28.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:28.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:28.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:28.821+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:30.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:30.717+0000 7f95b5670980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:30.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:30.717+0000 7f95b5670980 20 rados->read ofs=0 len=0 2024-04-03T03:38:30.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:30.721+0000 7f95b5670980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:30.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:30.721+0000 7f95b5670980 20 started sync module instance, tier type = 2024-04-03T03:38:30.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:30.721+0000 7f95b5670980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:38:32.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 20 add_watcher() i=0 2024-04-03T03:38:32.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 20 add_watcher() i=1 2024-04-03T03:38:32.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 20 add_watcher() i=2 2024-04-03T03:38:32.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 20 add_watcher() i=3 2024-04-03T03:38:32.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 20 add_watcher() i=4 2024-04-03T03:38:32.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 20 add_watcher() i=5 2024-04-03T03:38:32.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 20 add_watcher() i=6 2024-04-03T03:38:32.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 20 add_watcher() i=7 2024-04-03T03:38:32.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 2 all 8 watchers are set, enabling cache 2024-04-03T03:38:32.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-04-03T03:38:32.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.777+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-04-03T03:38:32.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-04-03T03:38:32.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-04-03T03:38:32.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-04-03T03:38:32.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-04-03T03:38:32.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-04-03T03:38:32.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-04-03T03:38:32.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-04-03T03:38:32.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-04-03T03:38:32.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-04-03T03:38:32.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-04-03T03:38:32.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-04-03T03:38:32.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-04-03T03:38:32.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.781+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-04-03T03:38:32.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-04-03T03:38:32.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-04-03T03:38:32.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-04-03T03:38:32.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-04-03T03:38:32.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-04-03T03:38:32.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-04-03T03:38:32.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-04-03T03:38:32.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-04-03T03:38:32.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-04-03T03:38:32.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-04-03T03:38:32.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-04-03T03:38:32.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.785+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-04-03T03:38:32.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-04-03T03:38:32.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-04-03T03:38:32.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-04-03T03:38:32.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-04-03T03:38:32.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-04-03T03:38:32.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-04-03T03:38:32.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-04-03T03:38:32.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-04-03T03:38:32.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-04-03T03:38:32.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-04-03T03:38:32.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-04-03T03:38:32.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.789+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-04-03T03:38:32.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-04-03T03:38:32.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-04-03T03:38:32.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-04-03T03:38:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-04-03T03:38:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-04-03T03:38:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-04-03T03:38:32.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-04-03T03:38:32.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-04-03T03:38:32.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-04-03T03:38:32.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-04-03T03:38:32.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-04-03T03:38:32.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.793+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-04-03T03:38:32.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-04-03T03:38:32.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-04-03T03:38:32.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-04-03T03:38:32.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-04-03T03:38:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-04-03T03:38:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-04-03T03:38:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-04-03T03:38:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-04-03T03:38:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-04-03T03:38:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-04-03T03:38:32.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-04-03T03:38:32.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.797+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-04-03T03:38:32.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-04-03T03:38:32.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-04-03T03:38:32.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-04-03T03:38:32.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-04-03T03:38:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-04-03T03:38:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-04-03T03:38:32.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-04-03T03:38:32.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-04-03T03:38:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-04-03T03:38:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-04-03T03:38:32.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-04-03T03:38:32.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.801+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-04-03T03:38:32.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-04-03T03:38:32.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-04-03T03:38:32.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-04-03T03:38:32.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-04-03T03:38:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-04-03T03:38:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-04-03T03:38:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-04-03T03:38:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-04-03T03:38:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-04-03T03:38:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.805+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-04-03T03:38:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-04-03T03:38:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-04-03T03:38:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-04-03T03:38:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-04-03T03:38:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-04-03T03:38:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-04-03T03:38:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-04-03T03:38:32.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-04-03T03:38:32.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-04-03T03:38:32.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-04-03T03:38:32.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-04-03T03:38:32.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.809+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-04-03T03:38:32.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-04-03T03:38:32.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-04-03T03:38:32.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-04-03T03:38:32.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-04-03T03:38:32.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-04-03T03:38:32.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-04-03T03:38:32.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-04-03T03:38:32.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-04-03T03:38:32.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-04-03T03:38:32.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-04-03T03:38:32.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-04-03T03:38:32.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.813+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-04-03T03:38:32.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-04-03T03:38:32.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-04-03T03:38:32.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-04-03T03:38:32.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-04-03T03:38:32.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-04-03T03:38:32.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-04-03T03:38:32.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-04-03T03:38:32.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-04-03T03:38:32.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-04-03T03:38:32.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-04-03T03:38:32.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-04-03T03:38:32.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-04-03T03:38:32.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-04-03T03:38:32.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.817+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-04-03T03:38:32.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-04-03T03:38:32.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-04-03T03:38:32.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-04-03T03:38:32.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-04-03T03:38:32.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-04-03T03:38:32.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-04-03T03:38:32.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-04-03T03:38:32.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-04-03T03:38:32.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-04-03T03:38:32.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-04-03T03:38:32.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-04-03T03:38:32.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-04-03T03:38:32.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-04-03T03:38:32.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.821+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-04-03T03:38:32.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-04-03T03:38:32.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-04-03T03:38:32.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-04-03T03:38:32.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-04-03T03:38:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-04-03T03:38:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-04-03T03:38:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-04-03T03:38:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-04-03T03:38:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-04-03T03:38:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-04-03T03:38:32.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-04-03T03:38:32.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-04-03T03:38:32.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-04-03T03:38:32.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.825+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-04-03T03:38:32.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-04-03T03:38:32.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-04-03T03:38:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-04-03T03:38:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-04-03T03:38:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-04-03T03:38:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-04-03T03:38:32.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-04-03T03:38:32.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-04-03T03:38:32.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-04-03T03:38:32.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-04-03T03:38:32.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-04-03T03:38:32.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.829+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-04-03T03:38:32.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-04-03T03:38:32.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-04-03T03:38:32.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-04-03T03:38:32.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-04-03T03:38:32.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-04-03T03:38:32.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-04-03T03:38:32.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-04-03T03:38:32.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-04-03T03:38:32.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-04-03T03:38:32.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-04-03T03:38:32.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-04-03T03:38:32.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.833+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-04-03T03:38:32.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-04-03T03:38:32.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-04-03T03:38:32.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-04-03T03:38:32.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-04-03T03:38:32.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-04-03T03:38:32.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-04-03T03:38:32.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-04-03T03:38:32.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-04-03T03:38:32.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-04-03T03:38:32.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-04-03T03:38:32.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-04-03T03:38:32.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.837+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-04-03T03:38:32.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-04-03T03:38:32.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-04-03T03:38:32.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-04-03T03:38:32.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-04-03T03:38:32.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-04-03T03:38:32.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-04-03T03:38:32.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-04-03T03:38:32.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-04-03T03:38:32.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-04-03T03:38:32.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-04-03T03:38:32.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-04-03T03:38:32.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-04-03T03:38:32.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-04-03T03:38:32.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.841+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-04-03T03:38:32.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-04-03T03:38:32.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-04-03T03:38:32.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-04-03T03:38:32.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-04-03T03:38:32.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-04-03T03:38:32.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.845+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-04-03T03:38:32.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-04-03T03:38:32.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-04-03T03:38:32.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-04-03T03:38:32.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-04-03T03:38:32.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-04-03T03:38:32.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-04-03T03:38:32.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-04-03T03:38:32.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-04-03T03:38:32.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-04-03T03:38:32.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-04-03T03:38:32.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-04-03T03:38:32.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-04-03T03:38:32.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-04-03T03:38:32.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.849+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-04-03T03:38:32.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-04-03T03:38:32.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-04-03T03:38:32.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-04-03T03:38:32.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-04-03T03:38:32.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-04-03T03:38:32.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-04-03T03:38:32.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-04-03T03:38:32.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-04-03T03:38:32.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-04-03T03:38:32.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-04-03T03:38:32.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-04-03T03:38:32.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-04-03T03:38:32.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-04-03T03:38:32.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.853+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-04-03T03:38:32.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-04-03T03:38:32.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-04-03T03:38:32.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-04-03T03:38:32.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-04-03T03:38:32.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-04-03T03:38:32.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-04-03T03:38:32.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-04-03T03:38:32.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-04-03T03:38:32.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-04-03T03:38:32.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-04-03T03:38:32.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-04-03T03:38:32.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.857+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.861+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-04-03T03:38:32.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.861+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-04-03T03:38:32.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.861+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.861+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-04-03T03:38:32.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.861+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-04-03T03:38:32.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.861+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.861+0000 7f95b5670980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-04-03T03:38:32.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.861+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-04-03T03:38:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.865+0000 7f95b5670980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-03T03:38:32.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.873+0000 7f94667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:38:32.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.873+0000 7f95b5670980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:38:32.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:32.873+0000 7f95b5670980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:38:35.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.721+0000 7f95b5670980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-04-03T03:38:35.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.721+0000 7f95b5670980 5 note: GC not initialized 2024-04-03T03:38:35.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.737+0000 7f94657e2640 20 reqs_thread_entry: start 2024-04-03T03:38:35.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.737+0000 7f95b5670980 20 init_complete bucket index max shards: 11 2024-04-03T03:38:35.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.737+0000 7f95b5670980 20 Filter name: none 2024-04-03T03:38:35.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.737+0000 7f945e7fc640 20 reqs_thread_entry: start 2024-04-03T03:38:35.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.797+0000 7f94667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:38:35.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.801+0000 7f95b5670980 20 remove_watcher() i=0 2024-04-03T03:38:35.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.801+0000 7f95b5670980 2 removed watcher, disabling cache 2024-04-03T03:38:35.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.805+0000 7f95b5670980 20 remove_watcher() i=1 2024-04-03T03:38:35.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.809+0000 7f95b5670980 20 remove_watcher() i=2 2024-04-03T03:38:35.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.809+0000 7f95b5670980 20 remove_watcher() i=3 2024-04-03T03:38:35.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.813+0000 7f95b5670980 20 remove_watcher() i=4 2024-04-03T03:38:35.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.817+0000 7f95b5670980 20 remove_watcher() i=5 2024-04-03T03:38:35.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.817+0000 7f95b5670980 20 remove_watcher() i=6 2024-04-03T03:38:35.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.821+0000 7f95b5670980 20 remove_watcher() i=7 2024-04-03T03:38:35.841 INFO:teuthology.orchestra.run.smithi104.stdout:[] 2024-04-03T03:38:35.841 DEBUG:tasks.util.rgw: json result: [] 2024-04-03T03:38:35.841 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-03T03:38:35.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-03T03:38:35.842 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-04-03T03:38:35.883 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:38:35.883 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:38:35.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.909+0000 7fbd6edc7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:38:35.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.909+0000 7fbd6edc7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:38:35.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:35.913+0000 7fbbbaffd640 20 reqs_thread_entry: start 2024-04-03T03:38:35.936 INFO:teuthology.orchestra.run.smithi104.stdout:{"id":"87e710bc-6ab8-4bc9-b5e4-c80563afdb7d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-03T03:38:35.936 DEBUG:tasks.util.rgw: json result: {'id': '87e710bc-6ab8-4bc9-b5e4-c80563afdb7d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-03T03:38:35.936 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-04-03T03:38:35.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-04-03T03:38:35.937 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-04-03T03:38:36.011 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:38:36.011 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:38:36.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.049+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.049+0000 7fcf08bcb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.049+0000 7fcf08bcb980 20 realm 2024-04-03T03:38:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.049+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.049+0000 7fcf08bcb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.049+0000 7fcf08bcb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:38:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.049+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.049+0000 7fcf08bcb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.049+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.053+0000 7fcf08bcb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:38:36.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.053+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.053+0000 7fcf08bcb980 20 rados_obj.operate() r=0 bl.length=927 2024-04-03T03:38:36.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.053+0000 7fcf08bcb980 20 searching for the correct realm 2024-04-03T03:38:36.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.057+0000 7fcf06ee7640 0 -- 172.21.15.104:0/358723723 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fcf0010d040 msgr2=0x7fcf0010f0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:38:36.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.273+0000 7fcf05ee5640 0 -- 172.21.15.104:0/358723723 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fcf0010bbd0 msgr2=0x7fcf000fc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:38:36.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:38:36.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:38:36.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:38:36.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:38:36.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:38:36.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:38:36.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:38:36.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.489+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 rados_obj.operate() r=0 bl.length=436 2024-04-03T03:38:36.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 zone default found 2024-04-03T03:38:36.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 4 Realm: () 2024-04-03T03:38:36.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:38:36.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:38:36.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:38:36.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 zonegroup default 2024-04-03T03:38:36.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 started sync module instance, tier type = 2024-04-03T03:38:36.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.493+0000 7fcf08bcb980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:38:36.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.517+0000 7fcf08bcb980 20 add_watcher() i=0 2024-04-03T03:38:36.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.517+0000 7fcf08bcb980 20 add_watcher() i=1 2024-04-03T03:38:36.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.517+0000 7fcf08bcb980 20 add_watcher() i=2 2024-04-03T03:38:36.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.517+0000 7fcf08bcb980 20 add_watcher() i=3 2024-04-03T03:38:36.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.517+0000 7fcf08bcb980 20 add_watcher() i=4 2024-04-03T03:38:36.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.517+0000 7fcf08bcb980 20 add_watcher() i=5 2024-04-03T03:38:36.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.521+0000 7fcf08bcb980 20 add_watcher() i=6 2024-04-03T03:38:36.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.521+0000 7fcf08bcb980 20 add_watcher() i=7 2024-04-03T03:38:36.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.521+0000 7fcf08bcb980 2 all 8 watchers are set, enabling cache 2024-04-03T03:38:36.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.525+0000 7fcdbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:38:36.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.525+0000 7fcf08bcb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:38:36.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.525+0000 7fcf08bcb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:38:36.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.525+0000 7fcf08bcb980 5 note: GC not initialized 2024-04-03T03:38:36.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.525+0000 7fcd377fe640 20 reqs_thread_entry: start 2024-04-03T03:38:36.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.525+0000 7fcf08bcb980 20 init_complete bucket index max shards: 11 2024-04-03T03:38:36.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.525+0000 7fcf08bcb980 20 Filter name: none 2024-04-03T03:38:36.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.525+0000 7fcd357fa640 20 reqs_thread_entry: start 2024-04-03T03:38:36.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.545+0000 7fcdbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:38:36.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.549+0000 7fcf08bcb980 20 remove_watcher() i=0 2024-04-03T03:38:36.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.549+0000 7fcf08bcb980 2 removed watcher, disabling cache 2024-04-03T03:38:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.549+0000 7fcf08bcb980 20 remove_watcher() i=1 2024-04-03T03:38:36.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.553+0000 7fcf08bcb980 20 remove_watcher() i=2 2024-04-03T03:38:36.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.557+0000 7fcf08bcb980 20 remove_watcher() i=3 2024-04-03T03:38:36.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.557+0000 7fcf08bcb980 20 remove_watcher() i=4 2024-04-03T03:38:36.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.561+0000 7fcf08bcb980 20 remove_watcher() i=5 2024-04-03T03:38:36.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.561+0000 7fcf08bcb980 20 remove_watcher() i=6 2024-04-03T03:38:36.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.565+0000 7fcf08bcb980 20 remove_watcher() i=7 2024-04-03T03:38:36.580 INFO:teuthology.orchestra.run.smithi104.stdout:[] 2024-04-03T03:38:36.580 DEBUG:tasks.util.rgw: json result: [] 2024-04-03T03:38:36.580 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-04-03T03:38:36.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-04-03T03:38:36.581 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-04-03T03:38:36.658 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:38:36.659 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:38:36.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.685+0000 7fa2fcdff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:38:36.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.685+0000 7fa2fcdff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:38:36.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.689+0000 7fa1bd7e2640 20 reqs_thread_entry: start 2024-04-03T03:38:36.711 INFO:teuthology.orchestra.run.smithi104.stdout:{"id":"87e710bc-6ab8-4bc9-b5e4-c80563afdb7d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-03T03:38:36.711 DEBUG:tasks.util.rgw: json result: {'id': '87e710bc-6ab8-4bc9-b5e4-c80563afdb7d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-03T03:38:36.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-04-03T03:38:36.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-04-03T03:38:36.712 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-04-03T03:38:36.788 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:38:36.788 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:38:36.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.825+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 20 realm 2024-04-03T03:38:36.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:38:36.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:36.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:38:36.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.829+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:36.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.833+0000 7f4ebe2f1980 20 rados_obj.operate() r=0 bl.length=927 2024-04-03T03:38:36.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.833+0000 7f4ebe2f1980 20 searching for the correct realm 2024-04-03T03:38:36.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.837+0000 7f4ebc60d640 0 -- 172.21.15.104:0/3126966306 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f4eb4094040 msgr2=0x7f4eb4001270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:38:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:36.841+0000 7f4ebb60b640 0 -- 172.21.15.104:0/3126966306 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f4eb401a040 msgr2=0x7f4eb40920d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:38:37.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.057+0000 7f4ebe2f1980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:38:37.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.057+0000 7f4ebe2f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:38:37.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.057+0000 7f4ebe2f1980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:38:37.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.057+0000 7f4ebe2f1980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:38:37.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.057+0000 7f4ebe2f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:38:37.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.057+0000 7f4ebe2f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:38:37.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.057+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:37.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.057+0000 7f4ebe2f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:37.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.057+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:37.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:38:37.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 rados_obj.operate() r=0 bl.length=436 2024-04-03T03:38:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 zone default found 2024-04-03T03:38:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 4 Realm: () 2024-04-03T03:38:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:38:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:38:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:38:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 zonegroup default 2024-04-03T03:38:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:37.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:37.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:37.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:37.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.061+0000 7f4ebe2f1980 20 rados->read ofs=0 len=0 2024-04-03T03:38:37.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.065+0000 7f4ebe2f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:38:37.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.065+0000 7f4ebe2f1980 20 started sync module instance, tier type = 2024-04-03T03:38:37.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.065+0000 7f4ebe2f1980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:38:37.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.089+0000 7f4ebe2f1980 20 add_watcher() i=0 2024-04-03T03:38:37.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.089+0000 7f4ebe2f1980 20 add_watcher() i=1 2024-04-03T03:38:37.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.089+0000 7f4ebe2f1980 20 add_watcher() i=2 2024-04-03T03:38:37.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.089+0000 7f4ebe2f1980 20 add_watcher() i=3 2024-04-03T03:38:37.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.089+0000 7f4ebe2f1980 20 add_watcher() i=4 2024-04-03T03:38:37.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.089+0000 7f4ebe2f1980 20 add_watcher() i=5 2024-04-03T03:38:37.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.089+0000 7f4ebe2f1980 20 add_watcher() i=6 2024-04-03T03:38:37.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.093+0000 7f4ebe2f1980 20 add_watcher() i=7 2024-04-03T03:38:37.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.093+0000 7f4ebe2f1980 2 all 8 watchers are set, enabling cache 2024-04-03T03:38:37.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.097+0000 7f4d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:38:37.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.097+0000 7f4ebe2f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:38:37.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.097+0000 7f4ebe2f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:38:37.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.097+0000 7f4ebe2f1980 5 note: GC not initialized 2024-04-03T03:38:37.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.097+0000 7f4d70fe1640 20 reqs_thread_entry: start 2024-04-03T03:38:37.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.097+0000 7f4ebe2f1980 20 init_complete bucket index max shards: 11 2024-04-03T03:38:37.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.097+0000 7f4ebe2f1980 20 Filter name: none 2024-04-03T03:38:37.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.097+0000 7f4cea7fc640 20 reqs_thread_entry: start 2024-04-03T03:38:37.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.117+0000 7f4d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:38:37.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.121+0000 7f4ebe2f1980 20 remove_watcher() i=0 2024-04-03T03:38:37.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.125+0000 7f4ebe2f1980 2 removed watcher, disabling cache 2024-04-03T03:38:37.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.125+0000 7f4ebe2f1980 20 remove_watcher() i=1 2024-04-03T03:38:37.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.129+0000 7f4ebe2f1980 20 remove_watcher() i=2 2024-04-03T03:38:37.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.129+0000 7f4ebe2f1980 20 remove_watcher() i=3 2024-04-03T03:38:37.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.133+0000 7f4ebe2f1980 20 remove_watcher() i=4 2024-04-03T03:38:37.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.133+0000 7f4ebe2f1980 20 remove_watcher() i=5 2024-04-03T03:38:37.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.137+0000 7f4ebe2f1980 20 remove_watcher() i=6 2024-04-03T03:38:37.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.137+0000 7f4ebe2f1980 20 remove_watcher() i=7 2024-04-03T03:38:37.155 INFO:teuthology.orchestra.run.smithi104.stdout:[] 2024-04-03T03:38:37.155 DEBUG:tasks.util.rgw: json result: [] 2024-04-03T03:38:37.156 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-04-03T03:38:37.156 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-04-03T03:38:37.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-04-03T03:38:37.156 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-04-03T03:38:37.239 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:38:37.239 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:38:37.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.269+0000 7fdf6367c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:38:37.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.269+0000 7fdf6367c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:38:37.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.273+0000 7fdd9f7fe640 20 reqs_thread_entry: start 2024-04-03T03:38:37.293 INFO:teuthology.orchestra.run.smithi104.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-04-03T03:38:37.293 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-04-03T03:38:37.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-04-03T03:38:37.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-04-03T03:38:37.293 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-04-03T03:38:37.370 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:38:37.370 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:38:37.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.397+0000 7fdf9f9cb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:38:37.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.397+0000 7fdf9f9cb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:38:37.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.401+0000 7fde607e0640 20 reqs_thread_entry: start 2024-04-03T03:38:37.425 INFO:teuthology.orchestra.run.smithi104.stdout:{"id":"87e710bc-6ab8-4bc9-b5e4-c80563afdb7d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-03T03:38:37.425 DEBUG:tasks.util.rgw: json result: {'id': '87e710bc-6ab8-4bc9-b5e4-c80563afdb7d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-03T03:38:37.425 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-04-03T03:38:37.425 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-04-03T03:38:37.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-04-03T03:38:37.425 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-04-03T03:38:37.500 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:38:37.500 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:38:37.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.525+0000 7f714062b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:38:37.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.525+0000 7f714062b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:38:37.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.529+0000 7f70017e2640 20 reqs_thread_entry: start 2024-04-03T03:38:37.551 INFO:teuthology.orchestra.run.smithi104.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-04-03T03:38:37.551 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-04-03T03:38:37.551 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-04-03T03:38:37.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-04-03T03:38:37.552 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-04-03T03:38:37.637 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:38:37.637 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:38:37.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.661+0000 7f951ac36980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:38:37.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.661+0000 7f951ac36980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:38:37.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:38:37.665+0000 7f935e7fc640 20 reqs_thread_entry: start 2024-04-03T03:38:37.689 INFO:teuthology.orchestra.run.smithi104.stdout:{"id":"87e710bc-6ab8-4bc9-b5e4-c80563afdb7d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-03T03:38:37.689 DEBUG:tasks.util.rgw: json result: {'id': '87e710bc-6ab8-4bc9-b5e4-c80563afdb7d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-03T03:38:37.689 INFO:tasks.rgw:Starting rgw... 2024-04-03T03:38:37.689 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-04-03T03:38:37.690 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-03T03:38:37.690 DEBUG:teuthology.orchestra.run.smithi104:> sudo echo -n https://smithi104.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-03T03:38:37.748 INFO:teuthology.orchestra.run.smithi104.stdout:https://smithi104.front.sepia.ceph.com:443 2024-04-03T03:38:37.749 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-03T03:38:37.801 DEBUG:teuthology.orchestra.run.smithi104:> sudo keytool -import -alias smithi104.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-04-03T03:38:38.144 INFO:teuthology.orchestra.run.smithi104.stderr:Warning: use -cacerts option to access cacerts keystore 2024-04-03T03:38:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:Certificate was added to keystore 2024-04-03T03:38:38.514 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-04-03T03:38:38.514 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-03T03:38:38.515 DEBUG:teuthology.orchestra.run.smithi104:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-03T03:38:38.517 INFO:tasks.rgw.client.0:Started 2024-04-03T03:38:38.517 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi104.front.sepia.ceph.com:443/ 2024-04-03T03:38:38.517 DEBUG:teuthology.orchestra.run.smithi104:> curl https://smithi104.front.sepia.ceph.com:443/ 2024-04-03T03:38:38.539 INFO:teuthology.orchestra.run.smithi104.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-03T03:38:38.540 INFO:teuthology.orchestra.run.smithi104.stderr: Dload Upload Total Spent Left Speed 2024-04-03T03:38:38.542 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-03T03:38:38.543 INFO:teuthology.orchestra.run.smithi104.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-03T03:38:38.543 INFO:teuthology.orchestra.run.smithi104.stderr:curl: (7) Failed to connect to smithi104.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-04-03T03:38:39.544 DEBUG:teuthology.orchestra.run.smithi104:> curl https://smithi104.front.sepia.ceph.com:443/ 2024-04-03T03:38:39.555 INFO:teuthology.orchestra.run.smithi104.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-03T03:38:39.555 INFO:teuthology.orchestra.run.smithi104.stderr: Dload Upload Total Spent Left Speed 2024-04-03T03:38:39.555 INFO:teuthology.orchestra.run.smithi104.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-03T03:38:39.555 INFO:teuthology.orchestra.run.smithi104.stderr:curl: (7) Failed to connect to smithi104.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-04-03T03:38:39.556 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-03T03:38:41.557 DEBUG:teuthology.orchestra.run.smithi104:> curl https://smithi104.front.sepia.ceph.com:443/ 2024-04-03T03:38:41.568 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-03T03:38:41.569 INFO:teuthology.orchestra.run.smithi104.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-03T03:38:41.569 INFO:teuthology.orchestra.run.smithi104.stderr: Dload Upload Total Spent Left Speed 2024-04-03T03:38:41.569 INFO:teuthology.orchestra.run.smithi104.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-03T03:38:41.569 INFO:teuthology.orchestra.run.smithi104.stderr:curl: (7) Failed to connect to smithi104.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-04-03T03:38:45.570 DEBUG:teuthology.orchestra.run.smithi104:> curl https://smithi104.front.sepia.ceph.com:443/ 2024-04-03T03:38:45.582 INFO:teuthology.orchestra.run.smithi104.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-03T03:38:45.582 INFO:teuthology.orchestra.run.smithi104.stderr: Dload Upload Total Spent Left Speed 2024-04-03T03:38:45.582 INFO:teuthology.orchestra.run.smithi104.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-03T03:38:45.582 INFO:teuthology.orchestra.run.smithi104.stderr:curl: (7) Failed to connect to smithi104.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-04-03T03:38:45.582 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-03T03:38:53.584 DEBUG:teuthology.orchestra.run.smithi104:> curl https://smithi104.front.sepia.ceph.com:443/ 2024-04-03T03:38:53.594 INFO:teuthology.orchestra.run.smithi104.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-03T03:38:53.595 INFO:teuthology.orchestra.run.smithi104.stderr: Dload Upload Total Spent Left Speed 2024-04-03T03:38:53.596 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-03T03:38:53.597 INFO:teuthology.orchestra.run.smithi104.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-03T03:38:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:curl: (7) Failed to connect to smithi104.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-04-03T03:39:02.998 INFO:tasks.rgw.client.0.smithi104.stdout:2024-04-03T03:39:02.989+0000 8e9be80 -1 ssl_private_key was not found: rgw/cert//default.key 2024-04-03T03:39:09.598 DEBUG:teuthology.orchestra.run.smithi104:> curl https://smithi104.front.sepia.ceph.com:443/ 2024-04-03T03:39:09.611 INFO:teuthology.orchestra.run.smithi104.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-03T03:39:09.611 INFO:teuthology.orchestra.run.smithi104.stderr: Dload Upload Total Spent Left Speed 2024-04-03T03:39:10.775 INFO:teuthology.orchestra.run.smithi104.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 183 0 --:--:-- 0:00:01 --:--:-- 184 2024-04-03T03:39:10.778 INFO:teuthology.orchestra.run.smithi104.stdout:anonymous 2024-04-03T03:39:10.779 INFO:teuthology.run_tasks:Running task tox... 2024-04-03T03:39:10.790 INFO:tasks.tox:Deploying tox from pip... 2024-04-03T03:39:10.791 DEBUG:teuthology.orchestra.run.smithi104:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-04-03T03:39:13.723 DEBUG:teuthology.orchestra.run.smithi104:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-04-03T03:39:14.463 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting tox==3.15.0 2024-04-03T03:39:14.570 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-04-03T03:39:14.633 INFO:teuthology.orchestra.run.smithi104.stdout: ---------------------------------------- 82.1/82.1 KB 1.3 MB/s eta 0:00:00 2024-04-03T03:39:14.782 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting py<2,>=1.4.17 2024-04-03T03:39:14.803 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-04-03T03:39:14.841 INFO:teuthology.orchestra.run.smithi104.stdout: ---------------------------------------- 98.7/98.7 KB 2.6 MB/s eta 0:00:00 2024-04-03T03:39:14.937 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting six<2,>=1.14.0 2024-04-03T03:39:14.957 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-04-03T03:39:15.092 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting pluggy<1,>=0.12.0 2024-04-03T03:39:15.112 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-04-03T03:39:15.256 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting packaging>=14 2024-04-03T03:39:15.275 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading packaging-24.0-py3-none-any.whl (53 kB) 2024-04-03T03:39:15.319 INFO:teuthology.orchestra.run.smithi104.stdout: ---------------------------------------- 53.5/53.5 KB 1.1 MB/s eta 0:00:00 2024-04-03T03:39:15.716 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-04-03T03:39:15.735 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) 2024-04-03T03:39:15.913 INFO:teuthology.orchestra.run.smithi104.stdout: ---------------------------------------- 3.8/3.8 MB 21.7 MB/s eta 0:00:00 2024-04-03T03:39:16.067 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting filelock<4,>=3.0.0 2024-04-03T03:39:16.097 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading filelock-3.13.3-py3-none-any.whl (11 kB) 2024-04-03T03:39:16.225 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting toml>=0.9.4 2024-04-03T03:39:16.245 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-04-03T03:39:16.411 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting distlib<1,>=0.3.7 2024-04-03T03:39:16.430 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-04-03T03:39:16.473 INFO:teuthology.orchestra.run.smithi104.stdout: -------------------------------------- 468.9/468.9 KB 12.1 MB/s eta 0:00:00 2024-04-03T03:39:16.592 INFO:teuthology.orchestra.run.smithi104.stdout:Collecting platformdirs<5,>=3.9.1 2024-04-03T03:39:16.612 INFO:teuthology.orchestra.run.smithi104.stdout: Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) 2024-04-03T03:39:16.792 INFO:teuthology.orchestra.run.smithi104.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-04-03T03:39:17.823 INFO:teuthology.orchestra.run.smithi104.stdout:Successfully installed distlib-0.3.8 filelock-3.13.3 packaging-24.0 platformdirs-4.2.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.1 2024-04-03T03:39:17.913 INFO:teuthology.run_tasks:Running task workunit... 2024-04-03T03:39:17.926 INFO:tasks.workunit:Pulling workunits from ref 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:39:17.927 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-03T03:39:17.927 DEBUG:teuthology.orchestra.run.smithi104:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:39:17.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:39:17.932 INFO:teuthology.orchestra.run.smithi104.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-03T03:39:17.933 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:39:17.978 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-03T03:39:17.978 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-03T03:39:18.030 INFO:tasks.workunit:timeout=3h 2024-04-03T03:39:18.030 INFO:tasks.workunit:cleanup=True 2024-04-03T03:39:18.031 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:39:18.080 INFO:tasks.workunit.client.0.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-03T03:40:36.186 INFO:tasks.workunit.client.0.smithi104.stderr:Note: switching to '888a4a757aa90aa5ed4fb3291576474bc07507ce'. 2024-04-03T03:40:36.186 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:36.186 INFO:tasks.workunit.client.0.smithi104.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-03T03:40:36.186 INFO:tasks.workunit.client.0.smithi104.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-03T03:40:36.186 INFO:tasks.workunit.client.0.smithi104.stderr:state without impacting any branches by switching back to a branch. 2024-04-03T03:40:36.186 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr: git switch -c 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr:Or undo this operation with: 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr: git switch - 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:36.187 INFO:tasks.workunit.client.0.smithi104.stderr:HEAD is now at 888a4a757aa Merge branch 'pr-56562' into wip-cbodley-testing 2024-04-03T03:40:36.191 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-03T03:40:36.238 INFO:tasks.workunit.client.0.smithi104.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-03T03:40:36.242 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T03:40:36.242 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-03T03:40:37.245 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-03T03:40:37.336 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-03T03:40:37.386 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T03:40:37.389 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T03:40:37.390 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-03T03:40:37.439 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T03:40:37.442 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:40:37.442 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-03T03:40:37.495 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-04-03T03:40:37.496 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-04-03T03:40:37.496 DEBUG:teuthology.orchestra.run.smithi104:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-04-03T03:40:37.547 INFO:tasks.workunit.client.0.smithi104.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-04-03T03:40:37.548 INFO:tasks.workunit.client.0.smithi104.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-04-03T03:40:37.548 INFO:tasks.workunit.client.0.smithi104.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-04-03T03:40:40.866 INFO:tasks.workunit.client.0.smithi104.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-04-03T03:40:40.866 INFO:tasks.workunit.client.0.smithi104.stderr:++ deactivate nondestructive 2024-04-03T03:40:40.866 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T03:40:40.866 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T03:40:40.869 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-04-03T03:40:40.869 INFO:tasks.workunit.client.0.smithi104.stderr:++ hash -r 2024-04-03T03:40:40.870 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T03:40:40.870 INFO:tasks.workunit.client.0.smithi104.stderr:++ unset VIRTUAL_ENV 2024-04-03T03:40:40.870 INFO:tasks.workunit.client.0.smithi104.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-04-03T03:40:40.870 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-04-03T03:40:40.870 INFO:tasks.workunit.client.0.smithi104.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-04-03T03:40:40.870 INFO:tasks.workunit.client.0.smithi104.stderr:++ export VIRTUAL_ENV 2024-04-03T03:40:40.870 INFO:tasks.workunit.client.0.smithi104.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-04-03T03:40:40.871 INFO:tasks.workunit.client.0.smithi104.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-04-03T03:40:40.871 INFO:tasks.workunit.client.0.smithi104.stderr:++ export PATH 2024-04-03T03:40:40.871 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T03:40:40.871 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -z '' ']' 2024-04-03T03:40:40.871 INFO:tasks.workunit.client.0.smithi104.stderr:++ _OLD_VIRTUAL_PS1= 2024-04-03T03:40:40.871 INFO:tasks.workunit.client.0.smithi104.stderr:++ PS1='(rgw) ' 2024-04-03T03:40:40.871 INFO:tasks.workunit.client.0.smithi104.stderr:++ export PS1 2024-04-03T03:40:40.872 INFO:tasks.workunit.client.0.smithi104.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-04-03T03:40:40.872 INFO:tasks.workunit.client.0.smithi104.stderr:++ export VIRTUAL_ENV_PROMPT 2024-04-03T03:40:40.872 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-04-03T03:40:40.872 INFO:tasks.workunit.client.0.smithi104.stderr:++ hash -r 2024-04-03T03:40:40.872 INFO:tasks.workunit.client.0.smithi104.stderr:+ pip install pip --upgrade 2024-04-03T03:40:41.230 INFO:tasks.workunit.client.0.smithi104.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-04-03T03:40:41.503 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting pip 2024-04-03T03:40:41.640 INFO:tasks.workunit.client.0.smithi104.stdout: Downloading pip-24.0-py3-none-any.whl (2.1 MB) 2024-04-03T03:40:41.798 INFO:tasks.workunit.client.0.smithi104.stdout: ---------------------------------------- 2.1/2.1 MB 13.7 MB/s eta 0:00:00 2024-04-03T03:40:41.872 INFO:tasks.workunit.client.0.smithi104.stdout:Installing collected packages: pip 2024-04-03T03:40:41.872 INFO:tasks.workunit.client.0.smithi104.stdout: Attempting uninstall: pip 2024-04-03T03:40:41.873 INFO:tasks.workunit.client.0.smithi104.stdout: Found existing installation: pip 22.0.2 2024-04-03T03:40:42.161 INFO:tasks.workunit.client.0.smithi104.stdout: Uninstalling pip-22.0.2: 2024-04-03T03:40:42.168 INFO:tasks.workunit.client.0.smithi104.stdout: Successfully uninstalled pip-22.0.2 2024-04-03T03:40:43.141 INFO:tasks.workunit.client.0.smithi104.stdout:Successfully installed pip-24.0 2024-04-03T03:40:43.205 INFO:tasks.workunit.client.0.smithi104.stderr:+ pip install boto3 2024-04-03T03:40:44.273 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting boto3 2024-04-03T03:40:44.394 INFO:tasks.workunit.client.0.smithi104.stdout: Downloading boto3-1.34.76-py3-none-any.whl.metadata (6.6 kB) 2024-04-03T03:40:45.022 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting botocore<1.35.0,>=1.34.76 (from boto3) 2024-04-03T03:40:45.041 INFO:tasks.workunit.client.0.smithi104.stdout: Downloading botocore-1.34.76-py3-none-any.whl.metadata (5.7 kB) 2024-04-03T03:40:45.173 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-04-03T03:40:45.193 INFO:tasks.workunit.client.0.smithi104.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-04-03T03:40:45.360 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-04-03T03:40:45.390 INFO:tasks.workunit.client.0.smithi104.stdout: Downloading s3transfer-0.10.1-py3-none-any.whl.metadata (1.7 kB) 2024-04-03T03:40:45.581 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T03:40:45.624 INFO:tasks.workunit.client.0.smithi104.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-04-03T03:40:45.872 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T03:40:45.896 INFO:tasks.workunit.client.0.smithi104.stdout: Downloading urllib3-2.2.1-py3-none-any.whl.metadata (6.4 kB) 2024-04-03T03:40:46.161 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T03:40:46.184 INFO:tasks.workunit.client.0.smithi104.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-04-03T03:40:46.283 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading boto3-1.34.76-py3-none-any.whl (139 kB) 2024-04-03T03:40:46.396 INFO:tasks.workunit.client.0.smithi104.stdout: ---------------------------------------- 139.3/139.3 kB 1.3 MB/s eta 0:00:00 2024-04-03T03:40:46.421 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading botocore-1.34.76-py3-none-any.whl (12.1 MB) 2024-04-03T03:40:47.443 INFO:tasks.workunit.client.0.smithi104.stdout: ---------------------------------------- 12.1/12.1 MB 15.6 MB/s eta 0:00:00 2024-04-03T03:40:47.464 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-04-03T03:40:47.539 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading s3transfer-0.10.1-py3-none-any.whl (82 kB) 2024-04-03T03:40:47.598 INFO:tasks.workunit.client.0.smithi104.stdout: ---------------------------------------- 82.2/82.2 kB 1.4 MB/s eta 0:00:00 2024-04-03T03:40:47.619 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-04-03T03:40:47.672 INFO:tasks.workunit.client.0.smithi104.stdout: ---------------------------------------- 229.9/229.9 kB 4.5 MB/s eta 0:00:00 2024-04-03T03:40:47.691 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading urllib3-2.2.1-py3-none-any.whl (121 kB) 2024-04-03T03:40:47.755 INFO:tasks.workunit.client.0.smithi104.stdout: ---------------------------------------- 121.1/121.1 kB 1.8 MB/s eta 0:00:00 2024-04-03T03:40:47.774 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-04-03T03:40:47.983 INFO:tasks.workunit.client.0.smithi104.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-04-03T03:40:49.057 INFO:tasks.workunit.client.0.smithi104.stdout:Successfully installed boto3-1.34.76 botocore-1.34.76 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.1 six-1.16.0 urllib3-2.2.1 2024-04-03T03:40:49.561 INFO:tasks.workunit.client.0.smithi104.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-04-03T03:40:49.712 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-04-03T03:40:49.748 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:40:49.748 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:40:49.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.784+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:49.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 20 realm 2024-04-03T03:40:49.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:49.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:40:49.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:49.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:49.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.788+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.792+0000 7fe2ae9cd980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:40:49.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.792+0000 7fe2ae9cd980 20 searching for the correct realm 2024-04-03T03:40:49.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.796+0000 7fe2acce9640 0 -- 172.21.15.104:0/3810945651 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x55a1ef8b0d60 msgr2=0x55a1ef8b3220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:49.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.804+0000 7fe2abce7640 0 -- 172.21.15.104:0/3810945651 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fe29c065020 msgr2=0x7fe29c07b760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:49.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:40:49.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:40:49.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:40:49.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:40:49.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:40:49.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:40:49.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:49.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 zone default found 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 4 Realm: () 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 zonegroup default 2024-04-03T03:40:49.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:49.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:49.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:49.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 started sync module instance, tier type = 2024-04-03T03:40:49.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.812+0000 7fe2ae9cd980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:40:49.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.836+0000 7fe2ae9cd980 20 add_watcher() i=0 2024-04-03T03:40:49.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.836+0000 7fe2ae9cd980 20 add_watcher() i=1 2024-04-03T03:40:49.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.836+0000 7fe2ae9cd980 20 add_watcher() i=2 2024-04-03T03:40:49.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.836+0000 7fe2ae9cd980 20 add_watcher() i=3 2024-04-03T03:40:49.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.836+0000 7fe2ae9cd980 20 add_watcher() i=4 2024-04-03T03:40:49.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.836+0000 7fe2ae9cd980 20 add_watcher() i=5 2024-04-03T03:40:49.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.836+0000 7fe2ae9cd980 20 add_watcher() i=6 2024-04-03T03:40:49.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.836+0000 7fe2ae9cd980 20 add_watcher() i=7 2024-04-03T03:40:49.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.836+0000 7fe2ae9cd980 2 all 8 watchers are set, enabling cache 2024-04-03T03:40:49.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe162fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:49.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:40:49.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:40:49.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 5 note: GC not initialized 2024-04-03T03:40:49.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe161fdb640 20 reqs_thread_entry: start 2024-04-03T03:40:49.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 20 init_complete bucket index max shards: 11 2024-04-03T03:40:49.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 20 Filter name: none 2024-04-03T03:40:49.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe0d37fe640 20 reqs_thread_entry: start 2024-04-03T03:40:49.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-04-03T03:40:49.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 20 rados->read ofs=0 len=0 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-04-03T03:40:49.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.840+0000 7fe2ae9cd980 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-04-03T03:40:49.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.844+0000 7fe2ae9cd980 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-04-03T03:40:49.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.844+0000 7fe2ae9cd980 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-04-03T03:40:49.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.844+0000 7fe2ae9cd980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-04-03T03:40:49.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.844+0000 7fe1837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94153997033120 notifier 4529 bl.length()=560 2024-04-03T03:40:49.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.844+0000 7fe1837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-04-03T03:40:49.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.844+0000 7fe1837fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-04-03T03:40:49.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.872+0000 7fe2ae9cd980 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-04-03T03:40:49.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.872+0000 7fe2ae9cd980 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-04-03T03:40:49.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.872+0000 7fe2ae9cd980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-04-03T03:40:49.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.876+0000 7fe1837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94153996969104 notifier 4529 bl.length()=186 2024-04-03T03:40:49.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.876+0000 7fe1837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-04-03T03:40:49.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.876+0000 7fe1837fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-04-03T03:40:49.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.876+0000 7fe162fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:49.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.884+0000 7fe2ae9cd980 20 remove_watcher() i=0 2024-04-03T03:40:49.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.884+0000 7fe2ae9cd980 2 removed watcher, disabling cache 2024-04-03T03:40:49.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.884+0000 7fe2ae9cd980 20 remove_watcher() i=1 2024-04-03T03:40:49.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.888+0000 7fe2ae9cd980 20 remove_watcher() i=2 2024-04-03T03:40:49.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.888+0000 7fe2ae9cd980 20 remove_watcher() i=3 2024-04-03T03:40:49.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.892+0000 7fe2ae9cd980 20 remove_watcher() i=4 2024-04-03T03:40:49.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.892+0000 7fe2ae9cd980 20 remove_watcher() i=5 2024-04-03T03:40:49.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.896+0000 7fe2ae9cd980 20 remove_watcher() i=6 2024-04-03T03:40:49.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:49.896+0000 7fe2ae9cd980 20 remove_watcher() i=7 2024-04-03T03:40:50.174 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:50.175 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:50.359 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:50.359 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:50.511 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:50.511 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:51.121 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:51.121 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:52.059 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:52.059 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:52.282 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:52.282 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:52.470 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:52.470 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:52.532 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:52.533 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:52.720 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:52.720 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:53.038 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:53.038 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:53.126 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:53.127 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:53.262 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:53.262 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:53.320 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:53.320 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:53.560 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:53.560 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:53.624 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:53.624 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:53.774 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:53.775 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:53.833 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: recalculated bucket check stats are correct 2024-04-03T03:40:53.833 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:53.834 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-04-03T03:40:53.867 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:40:53.867 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:40:54.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.120+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.120+0000 7fe052319980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.120+0000 7fe052319980 20 realm 2024-04-03T03:40:54.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.120+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.124+0000 7fe052319980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.124+0000 7fe052319980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:40:54.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.124+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.124+0000 7fe052319980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.124+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.124+0000 7fe052319980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:54.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.124+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.124+0000 7fe052319980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:40:54.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.124+0000 7fe052319980 20 searching for the correct realm 2024-04-03T03:40:54.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.128+0000 7fe050635640 0 -- 172.21.15.104:0/1269742485 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x7fdf18074a50 msgr2=0x7fdf18076e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:54.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.344+0000 7fe04f633640 0 -- 172.21.15.104:0/1269742485 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fe040028040 msgr2=0x7fe04008fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:54.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:40:54.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:40:54.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:40:54.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:40:54.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:40:54.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:40:54.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:54.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:40:54.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 zone default found 2024-04-03T03:40:54.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 4 Realm: () 2024-04-03T03:40:54.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:40:54.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:40:54.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:40:54.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 zonegroup default 2024-04-03T03:40:54.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.360+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.364+0000 7fe052319980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.364+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.364+0000 7fe052319980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.364+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.364+0000 7fe052319980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.364+0000 7fe052319980 20 started sync module instance, tier type = 2024-04-03T03:40:54.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.364+0000 7fe052319980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:40:54.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.392+0000 7fe052319980 20 add_watcher() i=0 2024-04-03T03:40:54.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.392+0000 7fe052319980 20 add_watcher() i=1 2024-04-03T03:40:54.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.392+0000 7fe052319980 20 add_watcher() i=2 2024-04-03T03:40:54.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.392+0000 7fe052319980 20 add_watcher() i=3 2024-04-03T03:40:54.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.392+0000 7fe052319980 20 add_watcher() i=4 2024-04-03T03:40:54.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.392+0000 7fe052319980 20 add_watcher() i=5 2024-04-03T03:40:54.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.392+0000 7fe052319980 20 add_watcher() i=6 2024-04-03T03:40:54.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.392+0000 7fe052319980 20 add_watcher() i=7 2024-04-03T03:40:54.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.392+0000 7fe052319980 2 all 8 watchers are set, enabling cache 2024-04-03T03:40:54.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.396+0000 7fdf05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:54.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.396+0000 7fe052319980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:40:54.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.396+0000 7fe052319980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:40:54.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.396+0000 7fe052319980 5 note: GC not initialized 2024-04-03T03:40:54.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fdf04fe1640 20 reqs_thread_entry: start 2024-04-03T03:40:54.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 20 init_complete bucket index max shards: 11 2024-04-03T03:40:54.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 20 Filter name: none 2024-04-03T03:40:54.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fde7e7fc640 20 reqs_thread_entry: start 2024-04-03T03:40:54.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:40:54.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:40:54.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:40:54.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:40:54.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:40:54.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:40:54.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:40:54.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:40:54.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:40:54.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:40:54.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:40:54.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:40:54.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.400+0000 7fe052319980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:40:54.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.404+0000 7fe052319980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:40:54.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.404+0000 7fe052319980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:40:54.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.404+0000 7fe052319980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:40:54.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.404+0000 7fe052319980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:40:54.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.412+0000 7fdf05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:54.422 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.420+0000 7fe052319980 20 remove_watcher() i=0 2024-04-03T03:40:54.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.420+0000 7fe052319980 2 removed watcher, disabling cache 2024-04-03T03:40:54.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.424+0000 7fe052319980 20 remove_watcher() i=1 2024-04-03T03:40:54.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.424+0000 7fe052319980 20 remove_watcher() i=2 2024-04-03T03:40:54.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.428+0000 7fe052319980 20 remove_watcher() i=3 2024-04-03T03:40:54.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.428+0000 7fe052319980 20 remove_watcher() i=4 2024-04-03T03:40:54.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.432+0000 7fe052319980 20 remove_watcher() i=5 2024-04-03T03:40:54.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.436+0000 7fe052319980 20 remove_watcher() i=6 2024-04-03T03:40:54.438 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.436+0000 7fe052319980 20 remove_watcher() i=7 2024-04-03T03:40:54.457 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-04-03T03:40:54.488 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:40:54.489 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:40:54.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.528+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 realm 2024-04-03T03:40:54.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:40:54.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:54.536 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.536 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:40:54.536 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.532+0000 7f94f9327980 20 searching for the correct realm 2024-04-03T03:40:54.541 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.540+0000 7f94f6641640 0 -- 172.21.15.104:0/3757932812 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f94e803d040 msgr2=0x7f94e803e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:54.548 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.544+0000 7f94f6641640 0 -- 172.21.15.104:0/3757932812 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f94f006bbc0 msgr2=0x7f94f004a230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:40:54.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:40:54.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:40:54.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:40:54.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:40:54.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:40:54.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:40:54.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:54.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:40:54.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 zone default found 2024-04-03T03:40:54.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 4 Realm: () 2024-04-03T03:40:54.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:40:54.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:40:54.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:40:54.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 zonegroup default 2024-04-03T03:40:54.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.760+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.764+0000 7f94f9327980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.764+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.764+0000 7f94f9327980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.764+0000 7f94f9327980 20 started sync module instance, tier type = 2024-04-03T03:40:54.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.764+0000 7f94f9327980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:40:54.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.792+0000 7f94f9327980 20 add_watcher() i=0 2024-04-03T03:40:54.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.792+0000 7f94f9327980 20 add_watcher() i=1 2024-04-03T03:40:54.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.792+0000 7f94f9327980 20 add_watcher() i=2 2024-04-03T03:40:54.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.792+0000 7f94f9327980 20 add_watcher() i=3 2024-04-03T03:40:54.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.792+0000 7f94f9327980 20 add_watcher() i=4 2024-04-03T03:40:54.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.792+0000 7f94f9327980 20 add_watcher() i=5 2024-04-03T03:40:54.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.792+0000 7f94f9327980 20 add_watcher() i=6 2024-04-03T03:40:54.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.792+0000 7f94f9327980 20 add_watcher() i=7 2024-04-03T03:40:54.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.792+0000 7f94f9327980 2 all 8 watchers are set, enabling cache 2024-04-03T03:40:54.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.796+0000 7f93ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:54.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:40:54.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:40:54.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 5 note: GC not initialized 2024-04-03T03:40:54.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f9327fff640 20 reqs_thread_entry: start 2024-04-03T03:40:54.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 init_complete bucket index max shards: 11 2024-04-03T03:40:54.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 Filter name: none 2024-04-03T03:40:54.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f9325ffb640 20 reqs_thread_entry: start 2024-04-03T03:40:54.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:40:54.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:40:54.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:40:54.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:40:54.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.800+0000 7f94f9327980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.804+0000 7f94f9327980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:40:54.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.804+0000 7f94f9327980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:40:54.809 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.808+0000 7f93ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:54.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.812+0000 7f94f9327980 20 remove_watcher() i=0 2024-04-03T03:40:54.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.812+0000 7f94f9327980 2 removed watcher, disabling cache 2024-04-03T03:40:54.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.812+0000 7f94f9327980 20 remove_watcher() i=1 2024-04-03T03:40:54.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.816+0000 7f94f9327980 20 remove_watcher() i=2 2024-04-03T03:40:54.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.816+0000 7f94f9327980 20 remove_watcher() i=3 2024-04-03T03:40:54.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.820+0000 7f94f9327980 20 remove_watcher() i=4 2024-04-03T03:40:54.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.820+0000 7f94f9327980 20 remove_watcher() i=5 2024-04-03T03:40:54.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.824+0000 7f94f9327980 20 remove_watcher() i=6 2024-04-03T03:40:54.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.824+0000 7f94f9327980 20 remove_watcher() i=7 2024-04-03T03:40:54.842 INFO:tasks.workunit.client.0.smithi104.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 110, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-04-03T03:40:54.842 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: bucket check unlinked does not report normal entries 2024-04-03T03:40:54.842 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:54.842 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-04-03T03:40:54.878 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:40:54.878 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:40:54.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.916+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 20 realm 2024-04-03T03:40:54.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:40:54.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:54.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:54.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.920+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:54.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.924+0000 7f7d46107980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:40:54.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.924+0000 7f7d46107980 20 searching for the correct realm 2024-04-03T03:40:54.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:54.932+0000 7f7d43c22640 0 -- 172.21.15.104:0/1994525331 >> [v2:172.21.15.130:6804/3494208016,v1:172.21.15.130:6807/3494208016] conn(0x7f7d3c040510 msgr2=0x7f7d3c05cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:55.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.148+0000 7f7d43421640 0 -- 172.21.15.104:0/1994525331 >> [v2:172.21.15.130:6805/2542797043,v1:172.21.15.130:6808/2542797043] conn(0x55e91a13c070 msgr2=0x55e91a13e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:55.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:40:55.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:40:55.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:40:55.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:40:55.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:40:55.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:40:55.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:55.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:55.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:55.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:55.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.156+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:55.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:40:55.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 zone default found 2024-04-03T03:40:55.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 4 Realm: () 2024-04-03T03:40:55.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:40:55.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:40:55.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:40:55.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 zonegroup default 2024-04-03T03:40:55.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:55.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:55.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:55.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:55.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:55.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:55.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 started sync module instance, tier type = 2024-04-03T03:40:55.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.160+0000 7f7d46107980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:40:55.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.184+0000 7f7d46107980 20 add_watcher() i=0 2024-04-03T03:40:55.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.184+0000 7f7d46107980 20 add_watcher() i=1 2024-04-03T03:40:55.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.184+0000 7f7d46107980 20 add_watcher() i=2 2024-04-03T03:40:55.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.184+0000 7f7d46107980 20 add_watcher() i=3 2024-04-03T03:40:55.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.184+0000 7f7d46107980 20 add_watcher() i=4 2024-04-03T03:40:55.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.184+0000 7f7d46107980 20 add_watcher() i=5 2024-04-03T03:40:55.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.184+0000 7f7d46107980 20 add_watcher() i=6 2024-04-03T03:40:55.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.188+0000 7f7d46107980 20 add_watcher() i=7 2024-04-03T03:40:55.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.188+0000 7f7d46107980 2 all 8 watchers are set, enabling cache 2024-04-03T03:40:55.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.192+0000 7f7bf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:55.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.192+0000 7f7d46107980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:40:55.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.192+0000 7f7d46107980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:40:55.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.192+0000 7f7d46107980 5 note: GC not initialized 2024-04-03T03:40:55.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.192+0000 7f7bf8fe1640 20 reqs_thread_entry: start 2024-04-03T03:40:55.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.192+0000 7f7d46107980 20 init_complete bucket index max shards: 11 2024-04-03T03:40:55.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.192+0000 7f7d46107980 20 Filter name: none 2024-04-03T03:40:55.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.192+0000 7f7b727fc640 20 reqs_thread_entry: start 2024-04-03T03:40:55.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:40:55.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:55.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:40:55.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:40:55.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:40:55.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:40:55.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 20 rados->read ofs=0 len=0 2024-04-03T03:40:55.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:40:55.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:40:55.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:40:55.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:40:55.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:40:55.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:40:55.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:40:55.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 1 NOTICE: finished shard 0 (0 entries found) 2024-04-03T03:40:55.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.196+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:40:55.201 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 1 NOTICE: finished shard 1 (0 entries found) 2024-04-03T03:40:55.201 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:40:55.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 1 NOTICE: finished shard 2 (0 entries found) 2024-04-03T03:40:55.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:40:55.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 1 NOTICE: finished shard 3 (0 entries found) 2024-04-03T03:40:55.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:40:55.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 1 NOTICE: finished shard 4 (0 entries found) 2024-04-03T03:40:55.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:40:55.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 1 NOTICE: finished shard 5 (0 entries found) 2024-04-03T03:40:55.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.200+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:40:55.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.204+0000 7f7d46107980 1 NOTICE: finished shard 6 (0 entries found) 2024-04-03T03:40:55.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.204+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:40:55.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.204+0000 7f7d46107980 1 NOTICE: finished shard 7 (0 entries found) 2024-04-03T03:40:55.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.204+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:40:55.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.204+0000 7f7d46107980 1 NOTICE: finished shard 8 (0 entries found) 2024-04-03T03:40:55.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.204+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:40:55.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.204+0000 7f7d46107980 1 NOTICE: finished shard 9 (0 entries found) 2024-04-03T03:40:55.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.204+0000 7f7d46107980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:40:55.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.208+0000 7f7d46107980 1 NOTICE: finished shard 10 (0 entries found) 2024-04-03T03:40:55.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.208+0000 7f7d46107980 1 NOTICE: finished all shards (0 entries found) 2024-04-03T03:40:55.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.208+0000 7f7bf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:55.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.212+0000 7f7d46107980 20 remove_watcher() i=0 2024-04-03T03:40:55.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.212+0000 7f7d46107980 2 removed watcher, disabling cache 2024-04-03T03:40:55.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.216+0000 7f7d46107980 20 remove_watcher() i=1 2024-04-03T03:40:55.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.216+0000 7f7d46107980 20 remove_watcher() i=2 2024-04-03T03:40:55.223 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.220+0000 7f7d46107980 20 remove_watcher() i=3 2024-04-03T03:40:55.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.224+0000 7f7d46107980 20 remove_watcher() i=4 2024-04-03T03:40:55.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.224+0000 7f7d46107980 20 remove_watcher() i=5 2024-04-03T03:40:55.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.224+0000 7f7d46107980 20 remove_watcher() i=6 2024-04-03T03:40:55.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:55.228+0000 7f7d46107980 20 remove_watcher() i=7 2024-04-03T03:40:55.246 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-04-03T03:40:55.669 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-04-03T03:40:57.089 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:57.089 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:57.274 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T03:40:57.275 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-04-03T03:40:57.311 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:40:57.311 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:40:57.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.352+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.352+0000 7f7bccdb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.352+0000 7f7bccdb3980 20 realm 2024-04-03T03:40:57.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.352+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.356+0000 7f7bccdb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.356+0000 7f7bccdb3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:40:57.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.356+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.356+0000 7f7bccdb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.356+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.359 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.356+0000 7f7bccdb3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:57.359 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.356+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.356+0000 7f7bccdb3980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:40:57.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.356+0000 7f7bccdb3980 20 searching for the correct realm 2024-04-03T03:40:57.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.360+0000 7f7bcb0cf640 0 -- 172.21.15.104:0/233010835 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f7bc4023030 msgr2=0x7f7bc4056230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:57.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.368+0000 7f7bca0cd640 0 -- 172.21.15.104:0/233010835 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f7bc405fac0 msgr2=0x7f7bc40239a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:57.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:40:57.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:40:57.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:40:57.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:40:57.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:40:57.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:40:57.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:57.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.584+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:40:57.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 zone default found 2024-04-03T03:40:57.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 4 Realm: () 2024-04-03T03:40:57.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:40:57.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:40:57.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:40:57.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 zonegroup default 2024-04-03T03:40:57.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 started sync module instance, tier type = 2024-04-03T03:40:57.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.588+0000 7f7bccdb3980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:40:57.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.612+0000 7f7bccdb3980 20 add_watcher() i=0 2024-04-03T03:40:57.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.612+0000 7f7bccdb3980 20 add_watcher() i=1 2024-04-03T03:40:57.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.612+0000 7f7bccdb3980 20 add_watcher() i=2 2024-04-03T03:40:57.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.612+0000 7f7bccdb3980 20 add_watcher() i=3 2024-04-03T03:40:57.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.612+0000 7f7bccdb3980 20 add_watcher() i=4 2024-04-03T03:40:57.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.612+0000 7f7bccdb3980 20 add_watcher() i=5 2024-04-03T03:40:57.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.616+0000 7f7bccdb3980 20 add_watcher() i=6 2024-04-03T03:40:57.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.616+0000 7f7bccdb3980 20 add_watcher() i=7 2024-04-03T03:40:57.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.616+0000 7f7bccdb3980 2 all 8 watchers are set, enabling cache 2024-04-03T03:40:57.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f7a817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:57.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f7bccdb3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:40:57.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f7bccdb3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:40:57.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f7bccdb3980 5 note: GC not initialized 2024-04-03T03:40:57.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f79fbfff640 20 reqs_thread_entry: start 2024-04-03T03:40:57.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f7bccdb3980 20 init_complete bucket index max shards: 11 2024-04-03T03:40:57.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f7bccdb3980 20 Filter name: none 2024-04-03T03:40:57.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f79f9ffb640 20 reqs_thread_entry: start 2024-04-03T03:40:57.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f7bccdb3980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:40:57.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.624+0000 7f7bccdb3980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:40:57.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:40:57.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:40:57.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: starting shard=0 2024-04-03T03:40:57.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:40:57.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: starting shard=1 2024-04-03T03:40:57.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:40:57.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: starting shard=2 2024-04-03T03:40:57.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:40:57.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: starting shard=3 2024-04-03T03:40:57.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:40:57.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 INFO: main: starting shard=4 2024-04-03T03:40:57.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.628+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:40:57.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 INFO: main: starting shard=5 2024-04-03T03:40:57.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:40:57.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 INFO: main: starting shard=6 2024-04-03T03:40:57.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:40:57.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 INFO: main: starting shard=7 2024-04-03T03:40:57.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:40:57.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 INFO: main: starting shard=8 2024-04-03T03:40:57.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.632+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:40:57.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.636+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-04-03T03:40:57.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.636+0000 7f7bccdb3980 20 INFO: main: starting shard=9 2024-04-03T03:40:57.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.636+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:40:57.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.636+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.636+0000 7f7bccdb3980 20 INFO: main: starting shard=10 2024-04-03T03:40:57.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.636+0000 7f7bccdb3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:40:57.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.636+0000 7f7bccdb3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.636+0000 7f7bccdb3980 20 INFO: main: done 2024-04-03T03:40:57.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.636+0000 7f7a817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:57.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.644+0000 7f7bccdb3980 20 remove_watcher() i=0 2024-04-03T03:40:57.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.644+0000 7f7bccdb3980 2 removed watcher, disabling cache 2024-04-03T03:40:57.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.648+0000 7f7bccdb3980 20 remove_watcher() i=1 2024-04-03T03:40:57.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.648+0000 7f7bccdb3980 20 remove_watcher() i=2 2024-04-03T03:40:57.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.652+0000 7f7bccdb3980 20 remove_watcher() i=3 2024-04-03T03:40:57.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.652+0000 7f7bccdb3980 20 remove_watcher() i=4 2024-04-03T03:40:57.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.656+0000 7f7bccdb3980 20 remove_watcher() i=5 2024-04-03T03:40:57.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.656+0000 7f7bccdb3980 20 remove_watcher() i=6 2024-04-03T03:40:57.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.656+0000 7f7bccdb3980 20 remove_watcher() i=7 2024-04-03T03:40:57.676 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:57.676 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:57.704 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:57.704 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:57.839 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T03:40:57.839 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-04-03T03:40:57.874 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:40:57.875 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:40:57.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.916+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.916+0000 7f9985c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.916+0000 7f9985c69980 20 realm 2024-04-03T03:40:57.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.916+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.916+0000 7f9985c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.916+0000 7f9985c69980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:40:57.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.916+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.916+0000 7f9985c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.916+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.920+0000 7f9985c69980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:57.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.920+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.920+0000 7f9985c69980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:40:57.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.920+0000 7f9985c69980 20 searching for the correct realm 2024-04-03T03:40:57.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.924+0000 7f9983784640 0 -- 172.21.15.104:0/2052184789 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x55b0967e9cc0 msgr2=0x55b0967ec0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:57.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.932+0000 7f9982f83640 0 -- 172.21.15.104:0/2052184789 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f997c0b7aa0 msgr2=0x7f997c0b3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:57.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:40:57.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:40:57.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:40:57.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:40:57.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:40:57.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:40:57.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:57.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:40:57.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 zone default found 2024-04-03T03:40:57.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 4 Realm: () 2024-04-03T03:40:57.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:40:57.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:40:57.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:40:57.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 zonegroup default 2024-04-03T03:40:57.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:57.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 started sync module instance, tier type = 2024-04-03T03:40:57.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.940+0000 7f9985c69980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:40:57.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.960+0000 7f9985c69980 20 add_watcher() i=0 2024-04-03T03:40:57.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.960+0000 7f9985c69980 20 add_watcher() i=1 2024-04-03T03:40:57.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.960+0000 7f9985c69980 20 add_watcher() i=2 2024-04-03T03:40:57.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.960+0000 7f9985c69980 20 add_watcher() i=3 2024-04-03T03:40:57.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.960+0000 7f9985c69980 20 add_watcher() i=4 2024-04-03T03:40:57.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.960+0000 7f9985c69980 20 add_watcher() i=5 2024-04-03T03:40:57.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.960+0000 7f9985c69980 20 add_watcher() i=6 2024-04-03T03:40:57.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.960+0000 7f9985c69980 20 add_watcher() i=7 2024-04-03T03:40:57.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.960+0000 7f9985c69980 2 all 8 watchers are set, enabling cache 2024-04-03T03:40:57.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9839fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:57.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:40:57.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:40:57.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 5 note: GC not initialized 2024-04-03T03:40:57.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9838fe1640 20 reqs_thread_entry: start 2024-04-03T03:40:57.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 init_complete bucket index max shards: 11 2024-04-03T03:40:57.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 Filter name: none 2024-04-03T03:40:57.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f97b27fc640 20 reqs_thread_entry: start 2024-04-03T03:40:57.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:40:57.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 rados->read ofs=0 len=0 2024-04-03T03:40:57.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:40:57.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:40:57.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:40:57.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 INFO: main: starting shard=0 2024-04-03T03:40:57.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:40:57.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 INFO: main: starting shard=1 2024-04-03T03:40:57.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:40:57.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 INFO: main: starting shard=2 2024-04-03T03:40:57.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.964+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:40:57.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: starting shard=3 2024-04-03T03:40:57.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:40:57.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: starting shard=4 2024-04-03T03:40:57.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:40:57.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: starting shard=5 2024-04-03T03:40:57.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:40:57.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-04-03T03:40:57.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: starting shard=6 2024-04-03T03:40:57.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:40:57.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: starting shard=7 2024-04-03T03:40:57.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:40:57.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 INFO: main: starting shard=8 2024-04-03T03:40:57.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.968+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:40:57.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.972+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.972+0000 7f9985c69980 20 INFO: main: starting shard=9 2024-04-03T03:40:57.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.972+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:40:57.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.972+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.972+0000 7f9985c69980 20 INFO: main: starting shard=10 2024-04-03T03:40:57.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.972+0000 7f9985c69980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:40:57.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.972+0000 7f9985c69980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:57.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.972+0000 7f9985c69980 20 INFO: main: done 2024-04-03T03:40:57.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.972+0000 7f9839fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:57.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.980+0000 7f9985c69980 20 remove_watcher() i=0 2024-04-03T03:40:57.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.980+0000 7f9985c69980 2 removed watcher, disabling cache 2024-04-03T03:40:57.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.984+0000 7f9985c69980 20 remove_watcher() i=1 2024-04-03T03:40:57.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.984+0000 7f9985c69980 20 remove_watcher() i=2 2024-04-03T03:40:57.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.988+0000 7f9985c69980 20 remove_watcher() i=3 2024-04-03T03:40:57.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.988+0000 7f9985c69980 20 remove_watcher() i=4 2024-04-03T03:40:57.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.992+0000 7f9985c69980 20 remove_watcher() i=5 2024-04-03T03:40:57.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.992+0000 7f9985c69980 20 remove_watcher() i=6 2024-04-03T03:40:57.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:57.992+0000 7f9985c69980 20 remove_watcher() i=7 2024-04-03T03:40:58.010 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:58.010 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:58.032 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:58.032 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:58.150 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T03:40:58.150 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-04-03T03:40:58.184 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:40:58.184 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:40:58.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.224+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 20 realm 2024-04-03T03:40:58.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:40:58.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:58.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.228+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.232+0000 7f6cf73fb980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:40:58.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.232+0000 7f6cf73fb980 20 searching for the correct realm 2024-04-03T03:40:58.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.236+0000 7f6cf4f16640 0 -- 172.21.15.104:0/2917928981 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x5636ac543030 msgr2=0x5636ac5454f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:58.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.240+0000 7f6cf4715640 0 -- 172.21.15.104:0/2917928981 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f6cec085720 msgr2=0x7f6cec0544a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:58.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.248+0000 7f6cf73fb980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:40:58.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.248+0000 7f6cf73fb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:40:58.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.248+0000 7f6cf73fb980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:40:58.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.248+0000 7f6cf73fb980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:40:58.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.248+0000 7f6cf73fb980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:40:58.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.248+0000 7f6cf73fb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:40:58.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.248+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:58.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 zone default found 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 4 Realm: () 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 zonegroup default 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 started sync module instance, tier type = 2024-04-03T03:40:58.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.252+0000 7f6cf73fb980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:40:58.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.272+0000 7f6cf73fb980 20 add_watcher() i=0 2024-04-03T03:40:58.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.272+0000 7f6cf73fb980 20 add_watcher() i=1 2024-04-03T03:40:58.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.272+0000 7f6cf73fb980 20 add_watcher() i=2 2024-04-03T03:40:58.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.272+0000 7f6cf73fb980 20 add_watcher() i=3 2024-04-03T03:40:58.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.272+0000 7f6cf73fb980 20 add_watcher() i=4 2024-04-03T03:40:58.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.272+0000 7f6cf73fb980 20 add_watcher() i=5 2024-04-03T03:40:58.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.272+0000 7f6cf73fb980 20 add_watcher() i=6 2024-04-03T03:40:58.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.276+0000 7f6cf73fb980 20 add_watcher() i=7 2024-04-03T03:40:58.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.276+0000 7f6cf73fb980 2 all 8 watchers are set, enabling cache 2024-04-03T03:40:58.280 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.276+0000 7f6bab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:58.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.276+0000 7f6cf73fb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:40:58.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.276+0000 7f6cf73fb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:40:58.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.276+0000 7f6cf73fb980 5 note: GC not initialized 2024-04-03T03:40:58.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6baa7e4640 20 reqs_thread_entry: start 2024-04-03T03:40:58.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 init_complete bucket index max shards: 11 2024-04-03T03:40:58.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 Filter name: none 2024-04-03T03:40:58.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6ba37fe640 20 reqs_thread_entry: start 2024-04-03T03:40:58.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:40:58.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:40:58.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:40:58.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:40:58.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 INFO: main: starting shard=0 2024-04-03T03:40:58.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:40:58.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 INFO: main: starting shard=1 2024-04-03T03:40:58.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:40:58.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-04-03T03:40:58.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 INFO: main: starting shard=2 2024-04-03T03:40:58.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:40:58.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 INFO: main: starting shard=3 2024-04-03T03:40:58.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.280+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:40:58.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: starting shard=4 2024-04-03T03:40:58.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:40:58.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: starting shard=5 2024-04-03T03:40:58.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:40:58.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: starting shard=6 2024-04-03T03:40:58.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:40:58.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: starting shard=7 2024-04-03T03:40:58.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:40:58.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: starting shard=8 2024-04-03T03:40:58.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:40:58.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 INFO: main: starting shard=9 2024-04-03T03:40:58.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.284+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:40:58.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.288+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.288+0000 7f6cf73fb980 20 INFO: main: starting shard=10 2024-04-03T03:40:58.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.288+0000 7f6cf73fb980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:40:58.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.288+0000 7f6cf73fb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.288+0000 7f6cf73fb980 20 INFO: main: done 2024-04-03T03:40:58.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.288+0000 7f6bab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:58.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.292+0000 7f6cf73fb980 20 remove_watcher() i=0 2024-04-03T03:40:58.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.292+0000 7f6cf73fb980 2 removed watcher, disabling cache 2024-04-03T03:40:58.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.296+0000 7f6cf73fb980 20 remove_watcher() i=1 2024-04-03T03:40:58.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.296+0000 7f6cf73fb980 20 remove_watcher() i=2 2024-04-03T03:40:58.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.300+0000 7f6cf73fb980 20 remove_watcher() i=3 2024-04-03T03:40:58.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.300+0000 7f6cf73fb980 20 remove_watcher() i=4 2024-04-03T03:40:58.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.304+0000 7f6cf73fb980 20 remove_watcher() i=5 2024-04-03T03:40:58.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.304+0000 7f6cf73fb980 20 remove_watcher() i=6 2024-04-03T03:40:58.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.304+0000 7f6cf73fb980 20 remove_watcher() i=7 2024-04-03T03:40:58.325 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:58.325 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:58.347 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:58.348 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:58.502 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T03:40:58.503 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-04-03T03:40:58.538 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:40:58.538 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:40:58.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.580+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.580+0000 7f363163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.580+0000 7f363163f980 20 realm 2024-04-03T03:40:58.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.580+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.580+0000 7f363163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.580+0000 7f363163f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:40:58.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.580+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.580+0000 7f363163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.580+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.584+0000 7f363163f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:58.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.584+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.584+0000 7f363163f980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:40:58.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.584+0000 7f363163f980 20 searching for the correct realm 2024-04-03T03:40:58.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.588+0000 7f362f95b640 0 -- 172.21.15.104:0/3017369152 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f362801b040 msgr2=0x7f362805c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:58.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.596+0000 7f362e959640 0 -- 172.21.15.104:0/3017369152 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f362805d530 msgr2=0x7f3628075130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:58.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.812+0000 7f363163f980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:40:58.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.812+0000 7f363163f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:40:58.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.812+0000 7f363163f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:40:58.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.812+0000 7f363163f980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:40:58.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.812+0000 7f363163f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:40:58.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.812+0000 7f363163f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:40:58.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.812+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.812+0000 7f363163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.812+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:58.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:40:58.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 zone default found 2024-04-03T03:40:58.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 4 Realm: () 2024-04-03T03:40:58.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:40:58.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:40:58.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:40:58.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 zonegroup default 2024-04-03T03:40:58.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.816+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.820+0000 7f363163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:58.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.820+0000 7f363163f980 20 started sync module instance, tier type = 2024-04-03T03:40:58.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.820+0000 7f363163f980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:40:58.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.840+0000 7f363163f980 20 add_watcher() i=0 2024-04-03T03:40:58.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.840+0000 7f363163f980 20 add_watcher() i=1 2024-04-03T03:40:58.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.840+0000 7f363163f980 20 add_watcher() i=2 2024-04-03T03:40:58.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.840+0000 7f363163f980 20 add_watcher() i=3 2024-04-03T03:40:58.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.840+0000 7f363163f980 20 add_watcher() i=4 2024-04-03T03:40:58.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.840+0000 7f363163f980 20 add_watcher() i=5 2024-04-03T03:40:58.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.840+0000 7f363163f980 20 add_watcher() i=6 2024-04-03T03:40:58.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.844+0000 7f363163f980 20 add_watcher() i=7 2024-04-03T03:40:58.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.844+0000 7f363163f980 2 all 8 watchers are set, enabling cache 2024-04-03T03:40:58.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.848+0000 7f34e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:58.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.848+0000 7f363163f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:40:58.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.848+0000 7f363163f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:40:58.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.848+0000 7f363163f980 5 note: GC not initialized 2024-04-03T03:40:58.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f34e4fe1640 20 reqs_thread_entry: start 2024-04-03T03:40:58.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 init_complete bucket index max shards: 11 2024-04-03T03:40:58.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 Filter name: none 2024-04-03T03:40:58.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f345e7fc640 20 reqs_thread_entry: start 2024-04-03T03:40:58.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:40:58.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 rados->read ofs=0 len=0 2024-04-03T03:40:58.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:40:58.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:40:58.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:40:58.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 INFO: main: starting shard=0 2024-04-03T03:40:58.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:40:58.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.852+0000 7f363163f980 20 INFO: main: starting shard=1 2024-04-03T03:40:58.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:40:58.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: starting shard=2 2024-04-03T03:40:58.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:40:58.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: starting shard=3 2024-04-03T03:40:58.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:40:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: starting shard=4 2024-04-03T03:40:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:40:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: starting shard=5 2024-04-03T03:40:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:40:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 INFO: main: starting shard=6 2024-04-03T03:40:58.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.856+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:40:58.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: starting shard=7 2024-04-03T03:40:58.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:40:58.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: starting shard=8 2024-04-03T03:40:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:40:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: starting shard=9 2024-04-03T03:40:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:40:58.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:40:58.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: starting shard=10 2024-04-03T03:40:58.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:40:58.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-04-03T03:40:58.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.860+0000 7f363163f980 20 INFO: main: done 2024-04-03T03:40:58.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.864+0000 7f34e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:40:58.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.868+0000 7f363163f980 20 remove_watcher() i=0 2024-04-03T03:40:58.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.868+0000 7f363163f980 2 removed watcher, disabling cache 2024-04-03T03:40:58.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.872+0000 7f363163f980 20 remove_watcher() i=1 2024-04-03T03:40:58.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.872+0000 7f363163f980 20 remove_watcher() i=2 2024-04-03T03:40:58.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.876+0000 7f363163f980 20 remove_watcher() i=3 2024-04-03T03:40:58.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.876+0000 7f363163f980 20 remove_watcher() i=4 2024-04-03T03:40:58.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.880+0000 7f363163f980 20 remove_watcher() i=5 2024-04-03T03:40:58.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.880+0000 7f363163f980 20 remove_watcher() i=6 2024-04-03T03:40:58.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:58.884+0000 7f363163f980 20 remove_watcher() i=7 2024-04-03T03:40:58.902 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:40:58.902 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:40:58.925 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-04-03T03:40:59.354 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-04-03T03:40:59.780 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: bucket check unlinked finds unlistable entries 2024-04-03T03:40:59.780 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:40:59.780 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-04-03T03:40:59.813 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:40:59.813 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:40:59.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.852+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:40:59.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.852+0000 7fc062b08980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:59.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.852+0000 7fc062b08980 20 realm 2024-04-03T03:40:59.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.852+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:40:59.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.856+0000 7fc062b08980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:59.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.856+0000 7fc062b08980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:40:59.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.856+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:40:59.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.856+0000 7fc062b08980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:40:59.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.856+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:40:59.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.856+0000 7fc062b08980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:40:59.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.856+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:40:59.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.856+0000 7fc062b08980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:40:59.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.856+0000 7fc062b08980 20 searching for the correct realm 2024-04-03T03:40:59.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.860+0000 7fc060e24640 0 -- 172.21.15.104:0/3938619449 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fc058030070 msgr2=0x7fc05805cca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:40:59.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:40:59.868+0000 7fc05fe22640 0 -- 172.21.15.104:0/3938619449 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fc0580287e0 msgr2=0x7fc05808e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:00.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.084+0000 7fc062b08980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:00.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.084+0000 7fc062b08980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:00.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.084+0000 7fc062b08980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:00.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.084+0000 7fc062b08980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:00.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.084+0000 7fc062b08980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:00.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.084+0000 7fc062b08980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:00.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.084+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.084+0000 7fc062b08980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.084+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:00.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:00.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 zone default found 2024-04-03T03:41:00.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 4 Realm: () 2024-04-03T03:41:00.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:00.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:00.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:00.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 zonegroup default 2024-04-03T03:41:00.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 started sync module instance, tier type = 2024-04-03T03:41:00.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.088+0000 7fc062b08980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:00.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.112+0000 7fc062b08980 20 add_watcher() i=0 2024-04-03T03:41:00.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.112+0000 7fc062b08980 20 add_watcher() i=1 2024-04-03T03:41:00.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.112+0000 7fc062b08980 20 add_watcher() i=2 2024-04-03T03:41:00.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.112+0000 7fc062b08980 20 add_watcher() i=3 2024-04-03T03:41:00.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.112+0000 7fc062b08980 20 add_watcher() i=4 2024-04-03T03:41:00.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.112+0000 7fc062b08980 20 add_watcher() i=5 2024-04-03T03:41:00.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.112+0000 7fc062b08980 20 add_watcher() i=6 2024-04-03T03:41:00.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.116+0000 7fc062b08980 20 add_watcher() i=7 2024-04-03T03:41:00.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.116+0000 7fc062b08980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:00.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.120+0000 7fbf16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:00.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.120+0000 7fc062b08980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:00.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.120+0000 7fc062b08980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:00.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.120+0000 7fc062b08980 5 note: GC not initialized 2024-04-03T03:41:00.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.120+0000 7fbf15fdb640 20 reqs_thread_entry: start 2024-04-03T03:41:00.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.120+0000 7fc062b08980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:00.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.120+0000 7fc062b08980 20 Filter name: none 2024-04-03T03:41:00.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fbe877fe640 20 reqs_thread_entry: start 2024-04-03T03:41:00.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:41:00.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:00.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:41:00.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:41:00.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:41:00.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:00.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:41:00.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:41:00.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:41:00.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:41:00.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:41:00.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:00.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 1 NOTICE: finished shard 0 (0 entries found) 2024-04-03T03:41:00.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:00.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.124+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:00.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.128+0000 7fc062b08980 1 NOTICE: finished shard 2 (0 entries found) 2024-04-03T03:41:00.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.128+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:00.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.128+0000 7fc062b08980 1 NOTICE: finished shard 3 (0 entries found) 2024-04-03T03:41:00.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.128+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:00.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.128+0000 7fc062b08980 1 NOTICE: finished shard 4 (0 entries found) 2024-04-03T03:41:00.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.128+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:00.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.128+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:00.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 1 NOTICE: finished shard 6 (0 entries found) 2024-04-03T03:41:00.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:00.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 1 NOTICE: finished shard 7 (0 entries found) 2024-04-03T03:41:00.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:00.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:00.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 1 NOTICE: finished shard 9 (0 entries found) 2024-04-03T03:41:00.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:00.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 1 NOTICE: finished shard 1 (1 entries found) 2024-04-03T03:41:00.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 1 NOTICE: finished shard 5 (1 entries found) 2024-04-03T03:41:00.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 1 NOTICE: finished shard 8 (1 entries found) 2024-04-03T03:41:00.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 1 NOTICE: finished shard 10 (1 entries found) 2024-04-03T03:41:00.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.132+0000 7fc062b08980 1 NOTICE: finished all shards (4 entries found) 2024-04-03T03:41:00.138 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.136+0000 7fbf16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:00.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.140+0000 7fc062b08980 20 remove_watcher() i=0 2024-04-03T03:41:00.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.140+0000 7fc062b08980 2 removed watcher, disabling cache 2024-04-03T03:41:00.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.144+0000 7fc062b08980 20 remove_watcher() i=1 2024-04-03T03:41:00.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.144+0000 7fc062b08980 20 remove_watcher() i=2 2024-04-03T03:41:00.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.148+0000 7fc062b08980 20 remove_watcher() i=3 2024-04-03T03:41:00.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.148+0000 7fc062b08980 20 remove_watcher() i=4 2024-04-03T03:41:00.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.152+0000 7fc062b08980 20 remove_watcher() i=5 2024-04-03T03:41:00.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.152+0000 7fc062b08980 20 remove_watcher() i=6 2024-04-03T03:41:00.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.152+0000 7fc062b08980 20 remove_watcher() i=7 2024-04-03T03:41:00.178 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: unlinked entries are not listable 2024-04-03T03:41:00.178 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:00.180 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:00.180 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:00.329 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-04-03T03:41:00.329 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:00.335 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:00.335 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:00.450 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:00.450 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:00.538 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-04-03T03:41:00.538 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:00.539 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-04-03T03:41:00.577 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:00.578 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:00.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.620+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.620+0000 7f9997a93980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.620+0000 7f9997a93980 20 realm 2024-04-03T03:41:00.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.620+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.620+0000 7f9997a93980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.620+0000 7f9997a93980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:00.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.620+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.620+0000 7f9997a93980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.620+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.624+0000 7f9997a93980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:00.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.624+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.624+0000 7f9997a93980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:00.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.624+0000 7f9997a93980 20 searching for the correct realm 2024-04-03T03:41:00.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.628+0000 7f9995daf640 0 -- 172.21.15.104:0/1150900327 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f9990008050 msgr2=0x7f999003d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:00.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.636+0000 7f9994dad640 0 -- 172.21.15.104:0/1150900327 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f999005b420 msgr2=0x7f999005b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:00.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.852+0000 7f9997a93980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:00.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.852+0000 7f9997a93980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:00.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.852+0000 7f9997a93980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:00.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.852+0000 7f9997a93980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:00.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.852+0000 7f9997a93980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:00.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.852+0000 7f9997a93980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:00.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.852+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.852+0000 7f9997a93980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.852+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:00.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:00.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 zone default found 2024-04-03T03:41:00.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 4 Realm: () 2024-04-03T03:41:00.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:00.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:00.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:00.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 zonegroup default 2024-04-03T03:41:00.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:00.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 started sync module instance, tier type = 2024-04-03T03:41:00.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.856+0000 7f9997a93980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:00.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.884+0000 7f9997a93980 20 add_watcher() i=0 2024-04-03T03:41:00.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.884+0000 7f9997a93980 20 add_watcher() i=1 2024-04-03T03:41:00.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.884+0000 7f9997a93980 20 add_watcher() i=2 2024-04-03T03:41:00.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.884+0000 7f9997a93980 20 add_watcher() i=3 2024-04-03T03:41:00.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.884+0000 7f9997a93980 20 add_watcher() i=4 2024-04-03T03:41:00.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.884+0000 7f9997a93980 20 add_watcher() i=5 2024-04-03T03:41:00.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.884+0000 7f9997a93980 20 add_watcher() i=6 2024-04-03T03:41:00.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.888+0000 7f9997a93980 20 add_watcher() i=7 2024-04-03T03:41:00.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.888+0000 7f9997a93980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:00.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f984b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:00.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f9997a93980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:00.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f9997a93980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:00.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f9997a93980 5 note: GC not initialized 2024-04-03T03:41:00.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f984a7e4640 20 reqs_thread_entry: start 2024-04-03T03:41:00.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f9997a93980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:00.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f9997a93980 20 Filter name: none 2024-04-03T03:41:00.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f97bbfff640 20 reqs_thread_entry: start 2024-04-03T03:41:00.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f9997a93980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:41:00.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.892+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 20 rados->read ofs=0 len=0 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:00.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 1 NOTICE: finished shard 0 (0 entries removed) 2024-04-03T03:41:00.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:00.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:00.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 1 NOTICE: finished shard 2 (0 entries removed) 2024-04-03T03:41:00.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:00.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 1 NOTICE: finished shard 3 (0 entries removed) 2024-04-03T03:41:00.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.896+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:00.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.900+0000 7f9997a93980 1 NOTICE: finished shard 4 (0 entries removed) 2024-04-03T03:41:00.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.900+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:00.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.900+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:00.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.900+0000 7f9997a93980 1 NOTICE: finished shard 6 (0 entries removed) 2024-04-03T03:41:00.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.900+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:00.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.900+0000 7f9997a93980 1 NOTICE: finished shard 7 (0 entries removed) 2024-04-03T03:41:00.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.900+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:00.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.900+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:00.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 1 NOTICE: finished shard 9 (0 entries removed) 2024-04-03T03:41:00.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:00.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:00.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state: octx=0x56329254f550 obj=check-bucket:e state=0x5632927fb568 s->prefetch_data=0 2024-04-03T03:41:00.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:00.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state: octx=0x563292560800 obj=check-bucket:d state=0x5632927fa078 s->prefetch_data=0 2024-04-03T03:41:00.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:00.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state: octx=0x5632927ff5a0 obj=check-bucket:c state=0x5632927fc0c8 s->prefetch_data=0 2024-04-03T03:41:00.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:00.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state: octx=0x5632927fffa0 obj=check-bucket:f state=0x5632927fcc28 s->prefetch_data=0 2024-04-03T03:41:00.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state: setting s->obj_tag to gculx73mplsoy2kqtbtmycl8wuv32kl8 2024-04-03T03:41:00.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state_impl: setting s->olh_tag to hmbgbllr91yhnuai56i9qq3vv9333n0b 2024-04-03T03:41:00.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hmbgbllr91yhnuai56i9qq3vv9333n0b 2024-04-03T03:41:00.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state: setting s->obj_tag to i50cokrq9aohry4fm4ctzdiojkem5wrg 2024-04-03T03:41:00.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state_impl: setting s->olh_tag to jpb6sesd6fcy0ysz0f8qioomasj64d1a 2024-04-03T03:41:00.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jpb6sesd6fcy0ysz0f8qioomasj64d1a 2024-04-03T03:41:00.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state: setting s->obj_tag to n54pqihlactmbe33ce4to9lksmdkfk9h 2024-04-03T03:41:00.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state_impl: setting s->olh_tag to 5itc4fyg43r70ysztiysr73jiodbxtgp 2024-04-03T03:41:00.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5itc4fyg43r70ysztiysr73jiodbxtgp 2024-04-03T03:41:00.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state: setting s->obj_tag to alf3gqf001dtm497ffui80sfa0n229tp 2024-04-03T03:41:00.910 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.904+0000 7f9997a93980 20 get_obj_state_impl: setting s->olh_tag to v2fuf5f4d3lizxo91klih220t90m8w9z 2024-04-03T03:41:00.910 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.908+0000 7f9997a93980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v2fuf5f4d3lizxo91klih220t90m8w9z 2024-04-03T03:41:00.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.908+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:00.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.908+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:00.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.908+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:00.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:00.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-04-03T03:41:00.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 20 olh_log_entry: epoch=2 op=3 key=e[R60PT2u8HgGPt1aRXTG.3b8gyjhXnqY] 2024-04-03T03:41:00.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 20 get_obj_state: octx=0x56329254f550 obj=check-bucket:_:R60PT2u8HgGPt1aRXTG.3b8gyjhXnqY_e state=0x5632928a5778 s->prefetch_data=0 2024-04-03T03:41:00.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 10 manifest: total_size = 22 2024-04-03T03:41:00.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12174333533480071314 2024-04-03T03:41:00.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 20 get_obj_state: octx=0x56329254f550 obj=check-bucket:_:R60PT2u8HgGPt1aRXTG.3b8gyjhXnqY_e state=0x5632928a5778 s->prefetch_data=0 2024-04-03T03:41:00.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 20 prepare_atomic_modification: state is not atomic. state=0x5632928a5778 2024-04-03T03:41:00.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:00.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.912+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:00.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:00.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:00.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 olh_log_entry: epoch=3 op=3 key=c[-GpWWfkcsGql24lEhyRZoZJ.AuRbRaW] 2024-04-03T03:41:00.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 get_obj_state: octx=0x5632927ff5a0 obj=check-bucket:_:-GpWWfkcsGql24lEhyRZoZJ.AuRbRaW_c state=0x5632928927c8 s->prefetch_data=0 2024-04-03T03:41:00.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 olh_log_entry: epoch=3 op=3 key=d[i0vDnAFZ9j4RBLnGclfXLPJKdhr6Amp] 2024-04-03T03:41:00.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 get_obj_state: octx=0x563292560800 obj=check-bucket:_:i0vDnAFZ9j4RBLnGclfXLPJKdhr6Amp_d state=0x5632928b0138 s->prefetch_data=0 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 10 manifest: total_size = 22 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6845877598786185244 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 get_obj_state: octx=0x563292560800 obj=check-bucket:_:i0vDnAFZ9j4RBLnGclfXLPJKdhr6Amp_d state=0x5632928b0138 s->prefetch_data=0 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 prepare_atomic_modification: state is not atomic. state=0x5632928b0138 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 10 manifest: total_size = 22 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12149117980446982967 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 get_obj_state: octx=0x5632927ff5a0 obj=check-bucket:_:-GpWWfkcsGql24lEhyRZoZJ.AuRbRaW_c state=0x5632928927c8 s->prefetch_data=0 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 prepare_atomic_modification: state is not atomic. state=0x5632928927c8 2024-04-03T03:41:00.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.916+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:00.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.920+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:00.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.920+0000 7f9997a93980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:41:00.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.920+0000 7f9997a93980 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-04-03T03:41:00.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.920+0000 7f9997a93980 0 deleting objects inline since gc isn't initialized 2024-04-03T03:41:00.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.920+0000 7f9997a93980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1__shadow:R60PT2u8HgGPt1aRXTG.3b8gyjhXnqY_.e-YIa3Bb4gaCRbWLY6ih3kaAL8a_819_0 2024-04-03T03:41:00.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9878ff9640 20 handle_completion(): completion ok for obj=e[R60PT2u8HgGPt1aRXTG.3b8gyjhXnqY] 2024-04-03T03:41:00.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T03:41:00.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-04-03T03:41:00.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 20 olh_log_entry: epoch=2 op=3 key=f[Qm16ougPN18GFsqQdHG-hYurluqwe0g] 2024-04-03T03:41:00.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 20 get_obj_state: octx=0x5632927fffa0 obj=check-bucket:_:Qm16ougPN18GFsqQdHG-hYurluqwe0g_f state=0x56329289ebe8 s->prefetch_data=0 2024-04-03T03:41:00.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 10 manifest: total_size = 12 2024-04-03T03:41:00.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.976089561796470693 2024-04-03T03:41:00.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 20 get_obj_state: octx=0x5632927fffa0 obj=check-bucket:_:Qm16ougPN18GFsqQdHG-hYurluqwe0g_f state=0x56329289ebe8 s->prefetch_data=0 2024-04-03T03:41:00.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 20 prepare_atomic_modification: state is not atomic. state=0x56329289ebe8 2024-04-03T03:41:00.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:00.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 20 get_obj_state: octx=0x56329254f550 obj=check-bucket:e state=0x5632927fb568 s->prefetch_data=0 2024-04-03T03:41:00.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.924+0000 7f9997a93980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hmbgbllr91yhnuai56i9qq3vv9333n0b 2024-04-03T03:41:00.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.928+0000 7f9997a93980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:41:00.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.928+0000 7f9997a93980 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-04-03T03:41:00.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.928+0000 7f9997a93980 0 deleting objects inline since gc isn't initialized 2024-04-03T03:41:00.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.928+0000 7f9997a93980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1__shadow:i0vDnAFZ9j4RBLnGclfXLPJKdhr6Amp_.0yXllVH5O6tGf_6ZGAusAOBiHGKuJmn_0 2024-04-03T03:41:00.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.928+0000 7f9878ff9640 20 handle_completion(): completion ok for obj=d[i0vDnAFZ9j4RBLnGclfXLPJKdhr6Amp] 2024-04-03T03:41:00.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.932+0000 7f9997a93980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T03:41:00.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.932+0000 7f9997a93980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:41:00.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.932+0000 7f9997a93980 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-04-03T03:41:00.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.932+0000 7f9997a93980 0 deleting objects inline since gc isn't initialized 2024-04-03T03:41:00.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.932+0000 7f9997a93980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1__shadow:-GpWWfkcsGql24lEhyRZoZJ.AuRbRaW_.PtUrDhYY5AauOj1dViZEvmYNjn914dN_0 2024-04-03T03:41:00.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.932+0000 7f986bfff640 20 handle_completion(): completion ok for obj=c[-GpWWfkcsGql24lEhyRZoZJ.AuRbRaW] 2024-04-03T03:41:00.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.936+0000 7f9997a93980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T03:41:00.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.936+0000 7f9997a93980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:41:00.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.936+0000 7f9997a93980 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-04-03T03:41:00.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.936+0000 7f9997a93980 0 deleting objects inline since gc isn't initialized 2024-04-03T03:41:00.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.936+0000 7f9997a93980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1__shadow:Qm16ougPN18GFsqQdHG-hYurluqwe0g_.5Yn8ZQEQzVPNmgs3T8EG2ykR2smBW_F_0 2024-04-03T03:41:00.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.940+0000 7f9878ff9640 20 handle_completion(): completion ok for obj=f[Qm16ougPN18GFsqQdHG-hYurluqwe0g] 2024-04-03T03:41:00.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.940+0000 7f9997a93980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T03:41:00.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.940+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:00.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.940+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:00.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.940+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:00.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.940+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:00.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.940+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:00.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.944+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:00.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.944+0000 7f9997a93980 1 NOTICE: finished shard 5 (1 entries removed) 2024-04-03T03:41:00.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.944+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:00.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.944+0000 7f9997a93980 1 NOTICE: finished shard 8 (1 entries removed) 2024-04-03T03:41:00.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.944+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:00.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.944+0000 7f9997a93980 1 NOTICE: finished shard 1 (1 entries removed) 2024-04-03T03:41:00.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.944+0000 7f9997a93980 20 get_obj_state: octx=0x5632927fffa0 obj=check-bucket:f state=0x5632927fcc28 s->prefetch_data=0 2024-04-03T03:41:00.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.944+0000 7f9997a93980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v2fuf5f4d3lizxo91klih220t90m8w9z 2024-04-03T03:41:00.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.952+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:00.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.952+0000 7f9997a93980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:00.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.952+0000 7f9997a93980 1 NOTICE: finished shard 10 (1 entries removed) 2024-04-03T03:41:00.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.952+0000 7f9997a93980 1 NOTICE: finished all shards (4 entries removed) 2024-04-03T03:41:00.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.956+0000 7f984b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:00.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.960+0000 7f9997a93980 20 remove_watcher() i=0 2024-04-03T03:41:00.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.960+0000 7f9997a93980 2 removed watcher, disabling cache 2024-04-03T03:41:00.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.960+0000 7f9997a93980 20 remove_watcher() i=1 2024-04-03T03:41:00.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.964+0000 7f9997a93980 20 remove_watcher() i=2 2024-04-03T03:41:00.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.968+0000 7f9997a93980 20 remove_watcher() i=3 2024-04-03T03:41:00.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.968+0000 7f9997a93980 20 remove_watcher() i=4 2024-04-03T03:41:00.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.968+0000 7f9997a93980 20 remove_watcher() i=5 2024-04-03T03:41:00.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.972+0000 7f9997a93980 20 remove_watcher() i=6 2024-04-03T03:41:00.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:00.972+0000 7f9997a93980 20 remove_watcher() i=7 2024-04-03T03:41:00.995 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:00.995 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:01.018 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:01.018 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:01.044 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:01.044 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:01.086 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:01.086 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:01.131 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: bucket check unlinked does not affect normal entries 2024-04-03T03:41:01.131 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:01.133 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:01.133 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:01.265 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:01.265 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:01.319 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:01.319 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:01.366 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:01.366 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:01.428 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:01.428 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:01.478 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-04-03T03:41:01.478 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:01.479 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-04-03T03:41:01.517 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:01.517 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:01.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.560+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.560+0000 7f342905d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:01.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.560+0000 7f342905d980 20 realm 2024-04-03T03:41:01.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.560+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.560+0000 7f342905d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:01.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.560+0000 7f342905d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:01.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.560+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.560+0000 7f342905d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:01.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.560+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.564+0000 7f342905d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:01.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.564+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.564+0000 7f342905d980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:01.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.564+0000 7f342905d980 20 searching for the correct realm 2024-04-03T03:41:01.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.568+0000 7f3427379640 0 -- 172.21.15.104:0/1519615112 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f342002e070 msgr2=0x7f342002f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:01.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.576+0000 7f3426377640 0 -- 172.21.15.104:0/1519615112 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f342002f910 msgr2=0x7f34200473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:01.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:01.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:01.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:01.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:01.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:01.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:01.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:01.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:01.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.792+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:01.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 zone default found 2024-04-03T03:41:01.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 4 Realm: () 2024-04-03T03:41:01.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:01.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:01.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:01.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 zonegroup default 2024-04-03T03:41:01.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:01.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:01.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:01.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 started sync module instance, tier type = 2024-04-03T03:41:01.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.796+0000 7f342905d980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:01.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.820+0000 7f342905d980 20 add_watcher() i=0 2024-04-03T03:41:01.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.820+0000 7f342905d980 20 add_watcher() i=1 2024-04-03T03:41:01.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.820+0000 7f342905d980 20 add_watcher() i=2 2024-04-03T03:41:01.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.820+0000 7f342905d980 20 add_watcher() i=3 2024-04-03T03:41:01.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.820+0000 7f342905d980 20 add_watcher() i=4 2024-04-03T03:41:01.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.820+0000 7f342905d980 20 add_watcher() i=5 2024-04-03T03:41:01.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.820+0000 7f342905d980 20 add_watcher() i=6 2024-04-03T03:41:01.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.824+0000 7f342905d980 20 add_watcher() i=7 2024-04-03T03:41:01.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.824+0000 7f342905d980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:01.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.828+0000 7f32dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:01.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.828+0000 7f342905d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:01.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.828+0000 7f342905d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:01.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.828+0000 7f342905d980 5 note: GC not initialized 2024-04-03T03:41:01.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.828+0000 7f3257fff640 20 reqs_thread_entry: start 2024-04-03T03:41:01.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.828+0000 7f342905d980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:01.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.828+0000 7f342905d980 20 Filter name: none 2024-04-03T03:41:01.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f3255ffb640 20 reqs_thread_entry: start 2024-04-03T03:41:01.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:41:01.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:01.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:41:01.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:41:01.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:41:01.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 20 rados->read ofs=0 len=0 2024-04-03T03:41:01.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:01.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:41:01.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:41:01.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:41:01.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:41:01.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:41:01.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:01.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 1 NOTICE: finished shard 0 (0 entries found) 2024-04-03T03:41:01.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:01.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 1 NOTICE: finished shard 1 (0 entries found) 2024-04-03T03:41:01.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:01.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 1 NOTICE: finished shard 2 (0 entries found) 2024-04-03T03:41:01.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.832+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:01.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 1 NOTICE: finished shard 3 (0 entries found) 2024-04-03T03:41:01.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:01.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 1 NOTICE: finished shard 4 (0 entries found) 2024-04-03T03:41:01.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:01.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 1 NOTICE: finished shard 5 (0 entries found) 2024-04-03T03:41:01.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:01.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 1 NOTICE: finished shard 6 (0 entries found) 2024-04-03T03:41:01.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:01.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 1 NOTICE: finished shard 7 (0 entries found) 2024-04-03T03:41:01.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.836+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:01.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.840+0000 7f342905d980 1 NOTICE: finished shard 8 (0 entries found) 2024-04-03T03:41:01.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.840+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:01.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.840+0000 7f342905d980 1 NOTICE: finished shard 9 (0 entries found) 2024-04-03T03:41:01.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.840+0000 7f342905d980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:01.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.840+0000 7f342905d980 1 NOTICE: finished shard 10 (0 entries found) 2024-04-03T03:41:01.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.840+0000 7f342905d980 1 NOTICE: finished all shards (0 entries found) 2024-04-03T03:41:01.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.840+0000 7f32dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:01.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.848+0000 7f342905d980 20 remove_watcher() i=0 2024-04-03T03:41:01.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.848+0000 7f342905d980 2 removed watcher, disabling cache 2024-04-03T03:41:01.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.848+0000 7f342905d980 20 remove_watcher() i=1 2024-04-03T03:41:01.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.852+0000 7f342905d980 20 remove_watcher() i=2 2024-04-03T03:41:01.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.852+0000 7f342905d980 20 remove_watcher() i=3 2024-04-03T03:41:01.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.856+0000 7f342905d980 20 remove_watcher() i=4 2024-04-03T03:41:01.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.856+0000 7f342905d980 20 remove_watcher() i=5 2024-04-03T03:41:01.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.856+0000 7f342905d980 20 remove_watcher() i=6 2024-04-03T03:41:01.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:01.860+0000 7f342905d980 20 remove_watcher() i=7 2024-04-03T03:41:01.880 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:01.880 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:02.106 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:02.106 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:02.232 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-04-03T03:41:02.268 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:02.269 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:02.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.520+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.520+0000 7f9127777980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:02.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.520+0000 7f9127777980 20 realm 2024-04-03T03:41:02.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.520+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.520+0000 7f9127777980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:02.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.520+0000 7f9127777980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:02.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.520+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.524+0000 7f9127777980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:02.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.524+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.527 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.524+0000 7f9127777980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:02.527 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.524+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.527 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.524+0000 7f9127777980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:02.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.524+0000 7f9127777980 20 searching for the correct realm 2024-04-03T03:41:02.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.528+0000 7f9125a93640 0 -- 172.21.15.104:0/4102608617 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f9120033060 msgr2=0x7f912005b260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:02.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.744+0000 7f9124a91640 0 -- 172.21.15.104:0/4102608617 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f9120061830 msgr2=0x7f91200297a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:02.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:02.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:02.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:02.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:02.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:02.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:02.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:02.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:02.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.960+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:02.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 zone default found 2024-04-03T03:41:02.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 4 Realm: () 2024-04-03T03:41:02.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:02.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:02.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:02.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 zonegroup default 2024-04-03T03:41:02.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:02.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:02.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:02.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:02.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 started sync module instance, tier type = 2024-04-03T03:41:02.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.964+0000 7f9127777980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:02.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.992+0000 7f9127777980 20 add_watcher() i=0 2024-04-03T03:41:02.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.992+0000 7f9127777980 20 add_watcher() i=1 2024-04-03T03:41:02.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.992+0000 7f9127777980 20 add_watcher() i=2 2024-04-03T03:41:02.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.992+0000 7f9127777980 20 add_watcher() i=3 2024-04-03T03:41:02.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.992+0000 7f9127777980 20 add_watcher() i=4 2024-04-03T03:41:02.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.992+0000 7f9127777980 20 add_watcher() i=5 2024-04-03T03:41:02.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.992+0000 7f9127777980 20 add_watcher() i=6 2024-04-03T03:41:02.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.996+0000 7f9127777980 20 add_watcher() i=7 2024-04-03T03:41:02.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:02.996+0000 7f9127777980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:03.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.000+0000 7f8fdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:03.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.000+0000 7f9127777980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:03.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.000+0000 7f9127777980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:03.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.000+0000 7f9127777980 5 note: GC not initialized 2024-04-03T03:41:03.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.000+0000 7f8fda7e4640 20 reqs_thread_entry: start 2024-04-03T03:41:03.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.000+0000 7f9127777980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:03.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.000+0000 7f9127777980 20 Filter name: none 2024-04-03T03:41:03.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.000+0000 7f8f4bfff640 20 reqs_thread_entry: start 2024-04-03T03:41:03.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.000+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:03.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:03.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:03.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:41:03.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 INFO: main: starting shard=0 2024-04-03T03:41:03.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:03.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 INFO: main: starting shard=1 2024-04-03T03:41:03.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:03.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 INFO: main: starting shard=2 2024-04-03T03:41:03.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:03.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 INFO: main: starting shard=3 2024-04-03T03:41:03.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.004+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:03.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: starting shard=4 2024-04-03T03:41:03.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:03.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: starting shard=5 2024-04-03T03:41:03.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:03.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: starting shard=6 2024-04-03T03:41:03.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:03.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: starting shard=7 2024-04-03T03:41:03.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:03.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 INFO: main: starting shard=8 2024-04-03T03:41:03.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.008+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:03.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.012+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-04-03T03:41:03.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.012+0000 7f9127777980 20 INFO: main: starting shard=9 2024-04-03T03:41:03.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.012+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:03.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.012+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.012+0000 7f9127777980 20 INFO: main: starting shard=10 2024-04-03T03:41:03.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.012+0000 7f9127777980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:03.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.012+0000 7f9127777980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.012+0000 7f9127777980 20 INFO: main: done 2024-04-03T03:41:03.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.012+0000 7f8fdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:03.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.020+0000 7f9127777980 20 remove_watcher() i=0 2024-04-03T03:41:03.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.020+0000 7f9127777980 2 removed watcher, disabling cache 2024-04-03T03:41:03.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.020+0000 7f9127777980 20 remove_watcher() i=1 2024-04-03T03:41:03.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.024+0000 7f9127777980 20 remove_watcher() i=2 2024-04-03T03:41:03.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.028+0000 7f9127777980 20 remove_watcher() i=3 2024-04-03T03:41:03.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.028+0000 7f9127777980 20 remove_watcher() i=4 2024-04-03T03:41:03.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.032+0000 7f9127777980 20 remove_watcher() i=5 2024-04-03T03:41:03.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.032+0000 7f9127777980 20 remove_watcher() i=6 2024-04-03T03:41:03.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.036+0000 7f9127777980 20 remove_watcher() i=7 2024-04-03T03:41:03.055 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-04-03T03:41:03.087 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:03.087 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:03.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.128+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.128+0000 7fa815285980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.128+0000 7fa815285980 20 realm 2024-04-03T03:41:03.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.128+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.128+0000 7fa815285980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.128+0000 7fa815285980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:03.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.128+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.128+0000 7fa815285980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.128+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.132+0000 7fa815285980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:03.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.132+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.132+0000 7fa815285980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:03.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.132+0000 7fa815285980 20 searching for the correct realm 2024-04-03T03:41:03.140 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.136+0000 7fa812da0640 0 -- 172.21.15.104:0/179481116 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x564a21e26e50 msgr2=0x564a21e29240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:03.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.144+0000 7fa81259f640 0 -- 172.21.15.104:0/179481116 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fa8040655e0 msgr2=0x7fa80405b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:03.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:03.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:03.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:03.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:03.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:03.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 zone default found 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 4 Realm: () 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 zonegroup default 2024-04-03T03:41:03.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.152+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.156+0000 7fa815285980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.156+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.156+0000 7fa815285980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.156+0000 7fa815285980 20 started sync module instance, tier type = 2024-04-03T03:41:03.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.156+0000 7fa815285980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:03.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.172+0000 7fa815285980 20 add_watcher() i=0 2024-04-03T03:41:03.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.172+0000 7fa815285980 20 add_watcher() i=1 2024-04-03T03:41:03.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.172+0000 7fa815285980 20 add_watcher() i=2 2024-04-03T03:41:03.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.172+0000 7fa815285980 20 add_watcher() i=3 2024-04-03T03:41:03.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.172+0000 7fa815285980 20 add_watcher() i=4 2024-04-03T03:41:03.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.172+0000 7fa815285980 20 add_watcher() i=5 2024-04-03T03:41:03.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.172+0000 7fa815285980 20 add_watcher() i=6 2024-04-03T03:41:03.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.172+0000 7fa815285980 20 add_watcher() i=7 2024-04-03T03:41:03.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.172+0000 7fa815285980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:03.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa6c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:03.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa815285980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:03.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa815285980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:03.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa815285980 5 note: GC not initialized 2024-04-03T03:41:03.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa643fff640 20 reqs_thread_entry: start 2024-04-03T03:41:03.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa815285980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:03.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa815285980 20 Filter name: none 2024-04-03T03:41:03.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa641ffb640 20 reqs_thread_entry: start 2024-04-03T03:41:03.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa815285980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:03.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.176+0000 7fa815285980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:03.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:03.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:41:03.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: starting shard=0 2024-04-03T03:41:03.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:03.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: starting shard=1 2024-04-03T03:41:03.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:03.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: starting shard=2 2024-04-03T03:41:03.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:03.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: starting shard=3 2024-04-03T03:41:03.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:03.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: starting shard=4 2024-04-03T03:41:03.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:03.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 INFO: main: starting shard=5 2024-04-03T03:41:03.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.180+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:03.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-04-03T03:41:03.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: starting shard=6 2024-04-03T03:41:03.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:03.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: starting shard=7 2024-04-03T03:41:03.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:03.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.187 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: starting shard=8 2024-04-03T03:41:03.187 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:03.187 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.187 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: starting shard=9 2024-04-03T03:41:03.187 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:03.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: starting shard=10 2024-04-03T03:41:03.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:03.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:03.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.184+0000 7fa815285980 20 INFO: main: done 2024-04-03T03:41:03.189 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.188+0000 7fa6c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:03.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.192+0000 7fa815285980 20 remove_watcher() i=0 2024-04-03T03:41:03.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.192+0000 7fa815285980 2 removed watcher, disabling cache 2024-04-03T03:41:03.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.192+0000 7fa815285980 20 remove_watcher() i=1 2024-04-03T03:41:03.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.196+0000 7fa815285980 20 remove_watcher() i=2 2024-04-03T03:41:03.201 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.196+0000 7fa815285980 20 remove_watcher() i=3 2024-04-03T03:41:03.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.200+0000 7fa815285980 20 remove_watcher() i=4 2024-04-03T03:41:03.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.200+0000 7fa815285980 20 remove_watcher() i=5 2024-04-03T03:41:03.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.204+0000 7fa815285980 20 remove_watcher() i=6 2024-04-03T03:41:03.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.204+0000 7fa815285980 20 remove_watcher() i=7 2024-04-03T03:41:03.219 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: bucket check olh finds leftover OLH entries 2024-04-03T03:41:03.219 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:03.220 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-04-03T03:41:03.247 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:03.248 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:03.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.468+0000 7f5330e79640 0 --2- 172.21.15.104:0/2225344193 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x55772b18c1b0 0x55772b303030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-04-03T03:41:03.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.496+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.496+0000 7f5333b5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.496+0000 7f5333b5f980 20 realm 2024-04-03T03:41:03.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.496+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.496+0000 7f5333b5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.496+0000 7f5333b5f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:03.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.496+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.496+0000 7f5333b5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.496+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.500+0000 7f5333b5f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:03.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.500+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.500+0000 7f5333b5f980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:03.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.500+0000 7f5333b5f980 20 searching for the correct realm 2024-04-03T03:41:03.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.500+0000 7f5330e79640 0 -- 172.21.15.104:0/4222410787 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f5324079020 msgr2=0x7f532407e0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:03.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.712+0000 7f5331e7b640 0 -- 172.21.15.104:0/4222410787 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x55772b3c52f0 msgr2=0x55772b3c76e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:03.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:03.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:03.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:03.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:03.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:03.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:03.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:03.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:03.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 zone default found 2024-04-03T03:41:03.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 4 Realm: () 2024-04-03T03:41:03.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:03.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:03.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:03.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 zonegroup default 2024-04-03T03:41:03.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.732+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.736+0000 7f5333b5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.736+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.736+0000 7f5333b5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.736+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.736+0000 7f5333b5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.736+0000 7f5333b5f980 20 started sync module instance, tier type = 2024-04-03T03:41:03.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.736+0000 7f5333b5f980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:03.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.760+0000 7f5333b5f980 20 add_watcher() i=0 2024-04-03T03:41:03.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.760+0000 7f5333b5f980 20 add_watcher() i=1 2024-04-03T03:41:03.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.760+0000 7f5333b5f980 20 add_watcher() i=2 2024-04-03T03:41:03.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.760+0000 7f5333b5f980 20 add_watcher() i=3 2024-04-03T03:41:03.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.760+0000 7f5333b5f980 20 add_watcher() i=4 2024-04-03T03:41:03.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.760+0000 7f5333b5f980 20 add_watcher() i=5 2024-04-03T03:41:03.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.760+0000 7f5333b5f980 20 add_watcher() i=6 2024-04-03T03:41:03.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.764+0000 7f5333b5f980 20 add_watcher() i=7 2024-04-03T03:41:03.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.764+0000 7f5333b5f980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:03.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.768+0000 7f51e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:03.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.768+0000 7f5333b5f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:03.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.768+0000 7f5333b5f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:03.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.768+0000 7f5333b5f980 5 note: GC not initialized 2024-04-03T03:41:03.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.768+0000 7f51e67e4640 20 reqs_thread_entry: start 2024-04-03T03:41:03.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.768+0000 7f5333b5f980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:03.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.768+0000 7f5333b5f980 20 Filter name: none 2024-04-03T03:41:03.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.768+0000 7f5157fff640 20 reqs_thread_entry: start 2024-04-03T03:41:03.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:41:03.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:03.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:41:03.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:41:03.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:41:03.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:03.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:41:03.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:41:03.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:41:03.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:41:03.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:41:03.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:03.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 1 NOTICE: finished shard 0 (0 entries found) 2024-04-03T03:41:03.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:03.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 1 NOTICE: finished shard 1 (0 entries found) 2024-04-03T03:41:03.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.772+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:03.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 1 NOTICE: finished shard 2 (0 entries found) 2024-04-03T03:41:03.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:03.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 1 NOTICE: finished shard 3 (0 entries found) 2024-04-03T03:41:03.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:03.778 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 1 NOTICE: finished shard 4 (0 entries found) 2024-04-03T03:41:03.778 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:03.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 1 NOTICE: finished shard 5 (1 entries found) 2024-04-03T03:41:03.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:03.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 1 NOTICE: finished shard 6 (0 entries found) 2024-04-03T03:41:03.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:03.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 1 NOTICE: finished shard 7 (0 entries found) 2024-04-03T03:41:03.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:03.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 1 NOTICE: finished shard 8 (1 entries found) 2024-04-03T03:41:03.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.776+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:03.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.780+0000 7f5333b5f980 1 NOTICE: finished shard 9 (0 entries found) 2024-04-03T03:41:03.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.780+0000 7f5333b5f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:03.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.780+0000 7f5333b5f980 1 NOTICE: finished shard 10 (0 entries found) 2024-04-03T03:41:03.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.780+0000 7f5333b5f980 1 NOTICE: finished all shards (2 entries found) 2024-04-03T03:41:03.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.780+0000 7f51e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:03.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.784+0000 7f5333b5f980 20 remove_watcher() i=0 2024-04-03T03:41:03.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.784+0000 7f5333b5f980 2 removed watcher, disabling cache 2024-04-03T03:41:03.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.788+0000 7f5333b5f980 20 remove_watcher() i=1 2024-04-03T03:41:03.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.788+0000 7f5333b5f980 20 remove_watcher() i=2 2024-04-03T03:41:03.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.792+0000 7f5333b5f980 20 remove_watcher() i=3 2024-04-03T03:41:03.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.796+0000 7f5333b5f980 20 remove_watcher() i=4 2024-04-03T03:41:03.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.796+0000 7f5333b5f980 20 remove_watcher() i=5 2024-04-03T03:41:03.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.796+0000 7f5333b5f980 20 remove_watcher() i=6 2024-04-03T03:41:03.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.800+0000 7f5333b5f980 20 remove_watcher() i=7 2024-04-03T03:41:03.815 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-04-03T03:41:03.815 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:03.816 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-04-03T03:41:03.846 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:03.847 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:03.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.888+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.888+0000 7fc7ecccd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.888+0000 7fc7ecccd980 20 realm 2024-04-03T03:41:03.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.888+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.888+0000 7fc7ecccd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.888+0000 7fc7ecccd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:03.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.888+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.888+0000 7fc7ecccd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.888+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.892+0000 7fc7ecccd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:03.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.892+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.892+0000 7fc7ecccd980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:03.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.892+0000 7fc7ecccd980 20 searching for the correct realm 2024-04-03T03:41:03.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.892+0000 7fc7e9fe7640 0 -- 172.21.15.104:0/2586399923 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fc7dc039040 msgr2=0x7fc7dc02a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:03.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.900+0000 7fc7eafe9640 0 -- 172.21.15.104:0/2586399923 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x564d42c5aa50 msgr2=0x564d42c5ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:03.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:03.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:03.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:03.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:03.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:03.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:03.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 zone default found 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 4 Realm: () 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 zonegroup default 2024-04-03T03:41:03.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:03.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 started sync module instance, tier type = 2024-04-03T03:41:03.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.912+0000 7fc7ecccd980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:03.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.932+0000 7fc7ecccd980 20 add_watcher() i=0 2024-04-03T03:41:03.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.932+0000 7fc7ecccd980 20 add_watcher() i=1 2024-04-03T03:41:03.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.932+0000 7fc7ecccd980 20 add_watcher() i=2 2024-04-03T03:41:03.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.932+0000 7fc7ecccd980 20 add_watcher() i=3 2024-04-03T03:41:03.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.932+0000 7fc7ecccd980 20 add_watcher() i=4 2024-04-03T03:41:03.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.932+0000 7fc7ecccd980 20 add_watcher() i=5 2024-04-03T03:41:03.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.932+0000 7fc7ecccd980 20 add_watcher() i=6 2024-04-03T03:41:03.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc7ecccd980 20 add_watcher() i=7 2024-04-03T03:41:03.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc7ecccd980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:03.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc6a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:03.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc7ecccd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:03.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc7ecccd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:03.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc7ecccd980 5 note: GC not initialized 2024-04-03T03:41:03.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc69b7fe640 20 reqs_thread_entry: start 2024-04-03T03:41:03.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc7ecccd980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:03.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc7ecccd980 20 Filter name: none 2024-04-03T03:41:03.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc6997fa640 20 reqs_thread_entry: start 2024-04-03T03:41:03.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc7ecccd980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:41:03.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.936+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:03.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:41:03.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:41:03.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:41:03.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 20 rados->read ofs=0 len=0 2024-04-03T03:41:03.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:03.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:41:03.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:41:03.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:41:03.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:41:03.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:41:03.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:03.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 1 NOTICE: finished shard 0 (0 entries removed) 2024-04-03T03:41:03.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:03.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 1 NOTICE: finished shard 1 (0 entries removed) 2024-04-03T03:41:03.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:03.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 1 NOTICE: finished shard 2 (0 entries removed) 2024-04-03T03:41:03.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:03.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 1 NOTICE: finished shard 3 (0 entries removed) 2024-04-03T03:41:03.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.940+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:03.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 1 NOTICE: finished shard 4 (0 entries removed) 2024-04-03T03:41:03.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:03.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 get_obj_state: octx=0x564d429e0540 obj=check-bucket:d state=0x564d42c8b408 s->prefetch_data=0 2024-04-03T03:41:03.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:03.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 1 NOTICE: finished shard 6 (0 entries removed) 2024-04-03T03:41:03.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:03.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 1 NOTICE: finished shard 7 (0 entries removed) 2024-04-03T03:41:03.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:03.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 get_obj_state: octx=0x564d429f17f0 obj=check-bucket:c state=0x564d42c8cde8 s->prefetch_data=0 2024-04-03T03:41:03.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:03.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 1 NOTICE: finished shard 9 (0 entries removed) 2024-04-03T03:41:03.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:03.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 1 NOTICE: finished shard 10 (0 entries removed) 2024-04-03T03:41:03.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 get_obj_state: setting s->obj_tag to i50cokrq9aohry4fm4ctzdiojkem5wrg 2024-04-03T03:41:03.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 get_obj_state_impl: setting s->olh_tag to jpb6sesd6fcy0ysz0f8qioomasj64d1a 2024-04-03T03:41:03.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:03.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 get_obj_state: setting s->obj_tag to n54pqihlactmbe33ce4to9lksmdkfk9h 2024-04-03T03:41:03.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 get_obj_state_impl: setting s->olh_tag to 5itc4fyg43r70ysztiysr73jiodbxtgp 2024-04-03T03:41:03.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.944+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:03.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-04-03T03:41:03.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 olh_log_entry: epoch=4 op=3 key=d[p56BqaWLHVZv.9kY36mJeSvsSSGML6F] 2024-04-03T03:41:03.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 get_obj_state: octx=0x564d42cbe2b0 obj=check-bucket:_:p56BqaWLHVZv.9kY36mJeSvsSSGML6F_d state=0x564d42ce2b08 s->prefetch_data=0 2024-04-03T03:41:03.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-04-03T03:41:03.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 olh_log_entry: epoch=4 op=3 key=c[qUMqxWRzlBBaF5Rci9B4MiTnwpcB2WF] 2024-04-03T03:41:03.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 get_obj_state: octx=0x564d42cde2b0 obj=check-bucket:_:qUMqxWRzlBBaF5Rci9B4MiTnwpcB2WF_c state=0x564d42cea6d8 s->prefetch_data=0 2024-04-03T03:41:03.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 get_obj_state: octx=0x564d42cde2b0 obj=check-bucket:c state=0x564d42ce30e8 s->prefetch_data=0 2024-04-03T03:41:03.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 get_obj_state: setting s->obj_tag to n54pqihlactmbe33ce4to9lksmdkfk9h 2024-04-03T03:41:03.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 get_obj_state_impl: setting s->olh_tag to 5itc4fyg43r70ysztiysr73jiodbxtgp 2024-04-03T03:41:03.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.948+0000 7fc7ecccd980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5itc4fyg43r70ysztiysr73jiodbxtgp 2024-04-03T03:41:03.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.952+0000 7fc7ecccd980 20 get_obj_state: octx=0x564d42cbe2b0 obj=check-bucket:d state=0x564d42c900c8 s->prefetch_data=0 2024-04-03T03:41:03.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.952+0000 7fc7ecccd980 20 get_obj_state: setting s->obj_tag to i50cokrq9aohry4fm4ctzdiojkem5wrg 2024-04-03T03:41:03.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.952+0000 7fc7ecccd980 20 get_obj_state_impl: setting s->olh_tag to jpb6sesd6fcy0ysz0f8qioomasj64d1a 2024-04-03T03:41:03.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.952+0000 7fc7ecccd980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jpb6sesd6fcy0ysz0f8qioomasj64d1a 2024-04-03T03:41:03.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.956+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:03.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.960+0000 7fc7ecccd980 1 NOTICE: finished shard 8 (1 entries removed) 2024-04-03T03:41:03.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.960+0000 7fc7ecccd980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:03.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.960+0000 7fc7ecccd980 1 NOTICE: finished shard 5 (1 entries removed) 2024-04-03T03:41:03.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.960+0000 7fc7ecccd980 1 NOTICE: finished all shards (2 entries removed) 2024-04-03T03:41:03.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.964+0000 7fc6a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:03.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.968+0000 7fc7ecccd980 20 remove_watcher() i=0 2024-04-03T03:41:03.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.968+0000 7fc7ecccd980 2 removed watcher, disabling cache 2024-04-03T03:41:03.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.968+0000 7fc7ecccd980 20 remove_watcher() i=1 2024-04-03T03:41:03.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.972+0000 7fc7ecccd980 20 remove_watcher() i=2 2024-04-03T03:41:03.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.972+0000 7fc7ecccd980 20 remove_watcher() i=3 2024-04-03T03:41:03.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.976+0000 7fc7ecccd980 20 remove_watcher() i=4 2024-04-03T03:41:03.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.976+0000 7fc7ecccd980 20 remove_watcher() i=5 2024-04-03T03:41:03.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.980+0000 7fc7ecccd980 20 remove_watcher() i=6 2024-04-03T03:41:03.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:03.980+0000 7fc7ecccd980 20 remove_watcher() i=7 2024-04-03T03:41:03.996 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-04-03T03:41:04.023 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:04.024 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:04.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.064+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.064+0000 7f6456032980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.064+0000 7f6456032980 20 realm 2024-04-03T03:41:04.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.064+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.064+0000 7f6456032980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.064+0000 7f6456032980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:04.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.064+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.064+0000 7f6456032980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.064+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.068+0000 7f6456032980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:04.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.068+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.068+0000 7f6456032980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:04.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.068+0000 7f6456032980 20 searching for the correct realm 2024-04-03T03:41:04.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.072+0000 7f645334c640 0 -- 172.21.15.104:0/1988014209 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f644c02a060 msgr2=0x7f644c055850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:04.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.080+0000 7f645334c640 0 -- 172.21.15.104:0/1988014209 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f644405b470 msgr2=0x7f6444074750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:04.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.296+0000 7f6456032980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:04.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.296+0000 7f6456032980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:04.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.296+0000 7f6456032980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:04.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.296+0000 7f6456032980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:04.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.296+0000 7f6456032980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:04.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.296+0000 7f6456032980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:04.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.296+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.296+0000 7f6456032980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.296+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:04.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:04.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 zone default found 2024-04-03T03:41:04.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 4 Realm: () 2024-04-03T03:41:04.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:04.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:04.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:04.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 zonegroup default 2024-04-03T03:41:04.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 started sync module instance, tier type = 2024-04-03T03:41:04.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.300+0000 7f6456032980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:04.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.324+0000 7f6456032980 20 add_watcher() i=0 2024-04-03T03:41:04.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.324+0000 7f6456032980 20 add_watcher() i=1 2024-04-03T03:41:04.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.324+0000 7f6456032980 20 add_watcher() i=2 2024-04-03T03:41:04.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.324+0000 7f6456032980 20 add_watcher() i=3 2024-04-03T03:41:04.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.324+0000 7f6456032980 20 add_watcher() i=4 2024-04-03T03:41:04.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.324+0000 7f6456032980 20 add_watcher() i=5 2024-04-03T03:41:04.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.324+0000 7f6456032980 20 add_watcher() i=6 2024-04-03T03:41:04.330 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.328+0000 7f6456032980 20 add_watcher() i=7 2024-04-03T03:41:04.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.328+0000 7f6456032980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:04.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.332+0000 7f6309fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:04.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.332+0000 7f6456032980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:04.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.332+0000 7f6456032980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:04.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.332+0000 7f6456032980 5 note: GC not initialized 2024-04-03T03:41:04.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.332+0000 7f6308fe1640 20 reqs_thread_entry: start 2024-04-03T03:41:04.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.332+0000 7f6456032980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:04.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.332+0000 7f6456032980 20 Filter name: none 2024-04-03T03:41:04.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f62827fc640 20 reqs_thread_entry: start 2024-04-03T03:41:04.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:04.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:04.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:04.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:41:04.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 INFO: main: starting shard=0 2024-04-03T03:41:04.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:04.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 INFO: main: starting shard=1 2024-04-03T03:41:04.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:04.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 INFO: main: starting shard=2 2024-04-03T03:41:04.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.336+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:04.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: starting shard=3 2024-04-03T03:41:04.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:04.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: starting shard=4 2024-04-03T03:41:04.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:04.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: starting shard=5 2024-04-03T03:41:04.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:04.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: starting shard=6 2024-04-03T03:41:04.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:04.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: starting shard=7 2024-04-03T03:41:04.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:04.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 INFO: main: starting shard=8 2024-04-03T03:41:04.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.340+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:04.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.344+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.344+0000 7f6456032980 20 INFO: main: starting shard=9 2024-04-03T03:41:04.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.344+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:04.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.344+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.344+0000 7f6456032980 20 INFO: main: starting shard=10 2024-04-03T03:41:04.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.344+0000 7f6456032980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:04.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.344+0000 7f6456032980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.344+0000 7f6456032980 20 INFO: main: done 2024-04-03T03:41:04.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.344+0000 7f6309fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:04.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.352+0000 7f6456032980 20 remove_watcher() i=0 2024-04-03T03:41:04.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.352+0000 7f6456032980 2 removed watcher, disabling cache 2024-04-03T03:41:04.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.352+0000 7f6456032980 20 remove_watcher() i=1 2024-04-03T03:41:04.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.356+0000 7f6456032980 20 remove_watcher() i=2 2024-04-03T03:41:04.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.356+0000 7f6456032980 20 remove_watcher() i=3 2024-04-03T03:41:04.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.360+0000 7f6456032980 20 remove_watcher() i=4 2024-04-03T03:41:04.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.360+0000 7f6456032980 20 remove_watcher() i=5 2024-04-03T03:41:04.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.364+0000 7f6456032980 20 remove_watcher() i=6 2024-04-03T03:41:04.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.364+0000 7f6456032980 20 remove_watcher() i=7 2024-04-03T03:41:04.382 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-04-03T03:41:04.412 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:04.412 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:04.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.452+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 realm 2024-04-03T03:41:04.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:04.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:04.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:04.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.456+0000 7f02f10d5980 20 searching for the correct realm 2024-04-03T03:41:04.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.460+0000 7f02e7fff640 0 -- 172.21.15.104:0/4032661822 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f02e00c2400 msgr2=0x7f02e00c2860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:04.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.468+0000 7f02e7fff640 0 -- 172.21.15.104:0/4032661822 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f02e80808e0 msgr2=0x7f02e804d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:04.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:04.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:04.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:04.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:04.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:04.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:04.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:04.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.684+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:04.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 zone default found 2024-04-03T03:41:04.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 4 Realm: () 2024-04-03T03:41:04.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:04.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:04.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:04.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 zonegroup default 2024-04-03T03:41:04.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 started sync module instance, tier type = 2024-04-03T03:41:04.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.688+0000 7f02f10d5980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:04.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.716+0000 7f02f10d5980 20 add_watcher() i=0 2024-04-03T03:41:04.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.716+0000 7f02f10d5980 20 add_watcher() i=1 2024-04-03T03:41:04.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.716+0000 7f02f10d5980 20 add_watcher() i=2 2024-04-03T03:41:04.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.716+0000 7f02f10d5980 20 add_watcher() i=3 2024-04-03T03:41:04.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.716+0000 7f02f10d5980 20 add_watcher() i=4 2024-04-03T03:41:04.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.716+0000 7f02f10d5980 20 add_watcher() i=5 2024-04-03T03:41:04.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.716+0000 7f02f10d5980 20 add_watcher() i=6 2024-04-03T03:41:04.720 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.716+0000 7f02f10d5980 20 add_watcher() i=7 2024-04-03T03:41:04.720 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.716+0000 7f02f10d5980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:04.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.720+0000 7f01a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:04.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:04.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:04.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 5 note: GC not initialized 2024-04-03T03:41:04.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f011ffff640 20 reqs_thread_entry: start 2024-04-03T03:41:04.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:04.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 Filter name: none 2024-04-03T03:41:04.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f011dffb640 20 reqs_thread_entry: start 2024-04-03T03:41:04.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:04.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:04.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:04.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:41:04.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 INFO: main: starting shard=0 2024-04-03T03:41:04.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.724+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:04.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: starting shard=1 2024-04-03T03:41:04.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:04.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: starting shard=2 2024-04-03T03:41:04.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:04.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: starting shard=3 2024-04-03T03:41:04.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:04.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: starting shard=4 2024-04-03T03:41:04.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:04.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 INFO: main: starting shard=5 2024-04-03T03:41:04.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.728+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:04.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: starting shard=6 2024-04-03T03:41:04.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:04.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: starting shard=7 2024-04-03T03:41:04.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:04.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: starting shard=8 2024-04-03T03:41:04.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:04.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: starting shard=9 2024-04-03T03:41:04.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:04.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: starting shard=10 2024-04-03T03:41:04.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:04.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:04.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.732+0000 7f02f10d5980 20 INFO: main: done 2024-04-03T03:41:04.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.736+0000 7f01a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:04.744 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.740+0000 7f02f10d5980 20 remove_watcher() i=0 2024-04-03T03:41:04.744 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.740+0000 7f02f10d5980 2 removed watcher, disabling cache 2024-04-03T03:41:04.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.744+0000 7f02f10d5980 20 remove_watcher() i=1 2024-04-03T03:41:04.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.744+0000 7f02f10d5980 20 remove_watcher() i=2 2024-04-03T03:41:04.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.748+0000 7f02f10d5980 20 remove_watcher() i=3 2024-04-03T03:41:04.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.752+0000 7f02f10d5980 20 remove_watcher() i=4 2024-04-03T03:41:04.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.752+0000 7f02f10d5980 20 remove_watcher() i=5 2024-04-03T03:41:04.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.752+0000 7f02f10d5980 20 remove_watcher() i=6 2024-04-03T03:41:04.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.756+0000 7f02f10d5980 20 remove_watcher() i=7 2024-04-03T03:41:04.775 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-04-03T03:41:04.775 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:04.776 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-04-03T03:41:04.804 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:04.804 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:04.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.844+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.844+0000 7fd81e496980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.844+0000 7fd81e496980 20 realm 2024-04-03T03:41:04.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.844+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.844+0000 7fd81e496980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.844+0000 7fd81e496980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:04.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.844+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.848+0000 7fd81e496980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:04.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.848+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.848+0000 7fd81e496980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:04.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.848+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:04.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.848+0000 7fd81e496980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:04.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.848+0000 7fd81e496980 20 searching for the correct realm 2024-04-03T03:41:04.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.852+0000 7fd81c7b2640 0 -- 172.21.15.104:0/1871600609 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fd814061bb0 msgr2=0x7fd814065360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:04.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:04.860+0000 7fd81b7b0640 0 -- 172.21.15.104:0/1871600609 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fd81406a0a0 msgr2=0x7fd814080860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:05.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.076+0000 7fd81e496980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:05.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.076+0000 7fd81e496980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:05.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.076+0000 7fd81e496980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:05.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.076+0000 7fd81e496980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:05.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.076+0000 7fd81e496980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:05.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.076+0000 7fd81e496980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:05.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.076+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:05.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.076+0000 7fd81e496980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:05.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.076+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:05.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:05.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:05.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:05.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 zone default found 2024-04-03T03:41:05.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 4 Realm: () 2024-04-03T03:41:05.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:05.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:05.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:05.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 zonegroup default 2024-04-03T03:41:05.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:05.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:05.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:05.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:05.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:05.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:05.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 started sync module instance, tier type = 2024-04-03T03:41:05.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.080+0000 7fd81e496980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:05.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.104+0000 7fd81e496980 20 add_watcher() i=0 2024-04-03T03:41:05.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.104+0000 7fd81e496980 20 add_watcher() i=1 2024-04-03T03:41:05.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.104+0000 7fd81e496980 20 add_watcher() i=2 2024-04-03T03:41:05.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.104+0000 7fd81e496980 20 add_watcher() i=3 2024-04-03T03:41:05.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.104+0000 7fd81e496980 20 add_watcher() i=4 2024-04-03T03:41:05.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.104+0000 7fd81e496980 20 add_watcher() i=5 2024-04-03T03:41:05.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.104+0000 7fd81e496980 20 add_watcher() i=6 2024-04-03T03:41:05.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.108+0000 7fd81e496980 20 add_watcher() i=7 2024-04-03T03:41:05.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.108+0000 7fd81e496980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:05.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.112+0000 7fd6d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:05.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.112+0000 7fd81e496980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:05.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.112+0000 7fd81e496980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:05.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.112+0000 7fd81e496980 5 note: GC not initialized 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.112+0000 7fd6d0fe1640 20 reqs_thread_entry: start 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.112+0000 7fd81e496980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.112+0000 7fd81e496980 20 Filter name: none 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.112+0000 7fd64a7fc640 20 reqs_thread_entry: start 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:41:05.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:41:05.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 20 rados->read ofs=0 len=0 2024-04-03T03:41:05.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:05.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:41:05.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:41:05.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:41:05.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:41:05.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:41:05.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:05.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 1 NOTICE: finished shard 0 (0 entries found) 2024-04-03T03:41:05.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:05.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 1 NOTICE: finished shard 1 (0 entries found) 2024-04-03T03:41:05.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.116+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:05.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 1 NOTICE: finished shard 2 (0 entries found) 2024-04-03T03:41:05.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:05.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 1 NOTICE: finished shard 3 (0 entries found) 2024-04-03T03:41:05.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:05.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 1 NOTICE: finished shard 4 (0 entries found) 2024-04-03T03:41:05.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:05.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 1 NOTICE: finished shard 5 (0 entries found) 2024-04-03T03:41:05.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:05.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 1 NOTICE: finished shard 6 (0 entries found) 2024-04-03T03:41:05.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:05.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 1 NOTICE: finished shard 7 (0 entries found) 2024-04-03T03:41:05.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.120+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:05.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.124+0000 7fd81e496980 1 NOTICE: finished shard 8 (0 entries found) 2024-04-03T03:41:05.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.124+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:05.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.124+0000 7fd81e496980 1 NOTICE: finished shard 9 (0 entries found) 2024-04-03T03:41:05.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.124+0000 7fd81e496980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:05.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.124+0000 7fd81e496980 1 NOTICE: finished shard 10 (0 entries found) 2024-04-03T03:41:05.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.124+0000 7fd81e496980 1 NOTICE: finished all shards (0 entries found) 2024-04-03T03:41:05.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.124+0000 7fd6d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:05.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.132+0000 7fd81e496980 20 remove_watcher() i=0 2024-04-03T03:41:05.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.132+0000 7fd81e496980 2 removed watcher, disabling cache 2024-04-03T03:41:05.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.132+0000 7fd81e496980 20 remove_watcher() i=1 2024-04-03T03:41:05.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.136+0000 7fd81e496980 20 remove_watcher() i=2 2024-04-03T03:41:05.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.140+0000 7fd81e496980 20 remove_watcher() i=3 2024-04-03T03:41:05.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.140+0000 7fd81e496980 20 remove_watcher() i=4 2024-04-03T03:41:05.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.144+0000 7fd81e496980 20 remove_watcher() i=5 2024-04-03T03:41:05.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.144+0000 7fd81e496980 20 remove_watcher() i=6 2024-04-03T03:41:05.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:05.144+0000 7fd81e496980 20 remove_watcher() i=7 2024-04-03T03:41:05.163 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-04-03T03:41:05.163 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:05.166 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:05.166 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:05.191 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:05.191 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:05.229 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:05.229 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:05.349 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-04-03T03:41:05.349 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:41:05.352 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:05.352 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:05.474 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:05.474 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:05.987 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:05.987 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:06.144 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:06.145 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:06.206 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:06.206 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:06.351 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:06.351 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:06.414 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:06.414 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:06.552 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:06.552 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:06.614 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:06.614 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:06.758 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:06.758 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:06.821 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:06.821 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:06.960 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:06.961 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:07.022 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:07.022 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:07.159 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:07.159 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:07.216 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-04-03T03:41:07.643 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-04-03T03:41:09.072 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:09.072 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:09.226 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T03:41:09.227 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-04-03T03:41:09.262 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:09.262 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:09.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.304+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.304+0000 7f7fd0b85980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:09.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.304+0000 7f7fd0b85980 20 realm 2024-04-03T03:41:09.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.304+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.304+0000 7f7fd0b85980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:09.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.304+0000 7f7fd0b85980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:09.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.304+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.304+0000 7f7fd0b85980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:09.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.304+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.308+0000 7f7fd0b85980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:09.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.308+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.308+0000 7f7fd0b85980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:09.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.308+0000 7f7fd0b85980 20 searching for the correct realm 2024-04-03T03:41:09.315 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.312+0000 7f7fceea1640 0 -- 172.21.15.104:0/1041990985 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f7fc80f3040 msgr2=0x7f7fc80e8970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:09.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.528+0000 7f7fcde9f640 0 -- 172.21.15.104:0/1041990985 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f7fc8108950 msgr2=0x7f7fc80ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:09.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.744+0000 7f7fd0b85980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:09.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.744+0000 7f7fd0b85980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:09.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.744+0000 7f7fd0b85980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:09.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.744+0000 7f7fd0b85980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:09.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.744+0000 7f7fd0b85980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:09.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.744+0000 7f7fd0b85980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:09.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.744+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.744+0000 7f7fd0b85980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:09.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.744+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:09.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 zone default found 2024-04-03T03:41:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 4 Realm: () 2024-04-03T03:41:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 zonegroup default 2024-04-03T03:41:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:09.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.752 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:09.752 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 started sync module instance, tier type = 2024-04-03T03:41:09.752 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.748+0000 7f7fd0b85980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:09.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.772+0000 7f7fd0b85980 20 add_watcher() i=0 2024-04-03T03:41:09.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.772+0000 7f7fd0b85980 20 add_watcher() i=1 2024-04-03T03:41:09.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.772+0000 7f7fd0b85980 20 add_watcher() i=2 2024-04-03T03:41:09.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.772+0000 7f7fd0b85980 20 add_watcher() i=3 2024-04-03T03:41:09.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.772+0000 7f7fd0b85980 20 add_watcher() i=4 2024-04-03T03:41:09.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.772+0000 7f7fd0b85980 20 add_watcher() i=5 2024-04-03T03:41:09.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.772+0000 7f7fd0b85980 20 add_watcher() i=6 2024-04-03T03:41:09.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.776+0000 7f7fd0b85980 20 add_watcher() i=7 2024-04-03T03:41:09.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.776+0000 7f7fd0b85980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:09.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7e84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:09.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:09.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:09.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 5 note: GC not initialized 2024-04-03T03:41:09.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7dff7fe640 20 reqs_thread_entry: start 2024-04-03T03:41:09.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:09.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 Filter name: none 2024-04-03T03:41:09.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7dfd7fa640 20 reqs_thread_entry: start 2024-04-03T03:41:09.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:09.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 rados->read ofs=0 len=0 2024-04-03T03:41:09.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:09.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:09.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:41:09.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 INFO: main: starting shard=0 2024-04-03T03:41:09.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.780+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:09.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: starting shard=1 2024-04-03T03:41:09.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:09.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: starting shard=2 2024-04-03T03:41:09.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:09.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: starting shard=3 2024-04-03T03:41:09.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:09.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: starting shard=4 2024-04-03T03:41:09.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:09.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 INFO: main: starting shard=5 2024-04-03T03:41:09.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.784+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:09.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 INFO: main: starting shard=6 2024-04-03T03:41:09.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:09.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 INFO: main: starting shard=7 2024-04-03T03:41:09.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:09.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 INFO: main: starting shard=8 2024-04-03T03:41:09.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:09.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-04-03T03:41:09.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 INFO: main: starting shard=9 2024-04-03T03:41:09.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.788+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:09.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.792+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.792+0000 7f7fd0b85980 20 INFO: main: starting shard=10 2024-04-03T03:41:09.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.792+0000 7f7fd0b85980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:09.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.792+0000 7f7fd0b85980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:09.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.792+0000 7f7fd0b85980 20 INFO: main: done 2024-04-03T03:41:09.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.792+0000 7f7e84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:09.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.796+0000 7f7fd0b85980 20 remove_watcher() i=0 2024-04-03T03:41:09.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.796+0000 7f7fd0b85980 2 removed watcher, disabling cache 2024-04-03T03:41:09.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.800+0000 7f7fd0b85980 20 remove_watcher() i=1 2024-04-03T03:41:09.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.800+0000 7f7fd0b85980 20 remove_watcher() i=2 2024-04-03T03:41:09.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.804+0000 7f7fd0b85980 20 remove_watcher() i=3 2024-04-03T03:41:09.809 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.808+0000 7f7fd0b85980 20 remove_watcher() i=4 2024-04-03T03:41:09.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.808+0000 7f7fd0b85980 20 remove_watcher() i=5 2024-04-03T03:41:09.812 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.808+0000 7f7fd0b85980 20 remove_watcher() i=6 2024-04-03T03:41:09.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:09.812+0000 7f7fd0b85980 20 remove_watcher() i=7 2024-04-03T03:41:09.830 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:09.830 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:09.856 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:09.856 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:09.885 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:09.885 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:10.030 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T03:41:10.031 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-04-03T03:41:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:10.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.108+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.108+0000 7fefc5df8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.108+0000 7fefc5df8980 20 realm 2024-04-03T03:41:10.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.108+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.108+0000 7fefc5df8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.108+0000 7fefc5df8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:10.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.108+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.108+0000 7fefc5df8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.108+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.112+0000 7fefc5df8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:10.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.112+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.112+0000 7fefc5df8980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:10.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.112+0000 7fefc5df8980 20 searching for the correct realm 2024-04-03T03:41:10.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.116+0000 7fefc4114640 0 -- 172.21.15.104:0/2589115823 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fefbc10d1d0 msgr2=0x7fefbc0eef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:10.334 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.332+0000 7fefc3112640 0 -- 172.21.15.104:0/2589115823 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fefbc10d790 msgr2=0x7fefbc0ee670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:10.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:10.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:10.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:10.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:10.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:10.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:10.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:10.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.548+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:10.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 zone default found 2024-04-03T03:41:10.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 4 Realm: () 2024-04-03T03:41:10.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:10.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:10.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:10.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 zonegroup default 2024-04-03T03:41:10.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 started sync module instance, tier type = 2024-04-03T03:41:10.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.552+0000 7fefc5df8980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:10.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.576+0000 7fefc5df8980 20 add_watcher() i=0 2024-04-03T03:41:10.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.576+0000 7fefc5df8980 20 add_watcher() i=1 2024-04-03T03:41:10.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.576+0000 7fefc5df8980 20 add_watcher() i=2 2024-04-03T03:41:10.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.576+0000 7fefc5df8980 20 add_watcher() i=3 2024-04-03T03:41:10.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.576+0000 7fefc5df8980 20 add_watcher() i=4 2024-04-03T03:41:10.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.576+0000 7fefc5df8980 20 add_watcher() i=5 2024-04-03T03:41:10.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.576+0000 7fefc5df8980 20 add_watcher() i=6 2024-04-03T03:41:10.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.580+0000 7fefc5df8980 20 add_watcher() i=7 2024-04-03T03:41:10.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.580+0000 7fefc5df8980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:10.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fee79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:10.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fefc5df8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:10.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fefc5df8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:10.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fefc5df8980 5 note: GC not initialized 2024-04-03T03:41:10.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fee78fe1640 20 reqs_thread_entry: start 2024-04-03T03:41:10.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fefc5df8980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:10.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fefc5df8980 20 Filter name: none 2024-04-03T03:41:10.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fedf27fc640 20 reqs_thread_entry: start 2024-04-03T03:41:10.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fefc5df8980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:10.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.584+0000 7fefc5df8980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:10.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:10.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:41:10.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: starting shard=0 2024-04-03T03:41:10.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:10.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: starting shard=1 2024-04-03T03:41:10.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:10.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: starting shard=2 2024-04-03T03:41:10.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:10.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: starting shard=3 2024-04-03T03:41:10.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:10.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 INFO: main: starting shard=4 2024-04-03T03:41:10.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.588+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:10.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 INFO: main: starting shard=5 2024-04-03T03:41:10.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:10.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-04-03T03:41:10.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 INFO: main: starting shard=6 2024-04-03T03:41:10.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:10.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 INFO: main: starting shard=7 2024-04-03T03:41:10.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:10.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 INFO: main: starting shard=8 2024-04-03T03:41:10.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.592+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:10.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.596+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.596+0000 7fefc5df8980 20 INFO: main: starting shard=9 2024-04-03T03:41:10.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.596+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:10.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.596+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.596+0000 7fefc5df8980 20 INFO: main: starting shard=10 2024-04-03T03:41:10.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.596+0000 7fefc5df8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:10.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.596+0000 7fefc5df8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:10.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.596+0000 7fefc5df8980 20 INFO: main: done 2024-04-03T03:41:10.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.600+0000 7fee79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:10.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.604+0000 7fefc5df8980 20 remove_watcher() i=0 2024-04-03T03:41:10.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.604+0000 7fefc5df8980 2 removed watcher, disabling cache 2024-04-03T03:41:10.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.608+0000 7fefc5df8980 20 remove_watcher() i=1 2024-04-03T03:41:10.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.608+0000 7fefc5df8980 20 remove_watcher() i=2 2024-04-03T03:41:10.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.612+0000 7fefc5df8980 20 remove_watcher() i=3 2024-04-03T03:41:10.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.612+0000 7fefc5df8980 20 remove_watcher() i=4 2024-04-03T03:41:10.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.616+0000 7fefc5df8980 20 remove_watcher() i=5 2024-04-03T03:41:10.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.616+0000 7fefc5df8980 20 remove_watcher() i=6 2024-04-03T03:41:10.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.616+0000 7fefc5df8980 20 remove_watcher() i=7 2024-04-03T03:41:10.645 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:10.645 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:10.669 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:10.669 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:10.704 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:10.704 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:10.850 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T03:41:10.850 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-04-03T03:41:10.886 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:10.886 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:10.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.928+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.928+0000 7f73636fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.928+0000 7f73636fa980 20 realm 2024-04-03T03:41:10.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.928+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.928+0000 7f73636fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.928+0000 7f73636fa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:10.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.928+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.928+0000 7f73636fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:10.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.928+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.932+0000 7f73636fa980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:10.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.932+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:10.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.932+0000 7f73636fa980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:10.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.932+0000 7f73636fa980 20 searching for the correct realm 2024-04-03T03:41:10.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:10.936+0000 7f7361a16640 0 -- 172.21.15.104:0/4186132231 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f735c060040 msgr2=0x7f735c08bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:11.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.152+0000 7f7360a14640 0 -- 172.21.15.104:0/4186132231 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f735c018040 msgr2=0x7f735c0757f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:11.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.368+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:11.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 zone default found 2024-04-03T03:41:11.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 4 Realm: () 2024-04-03T03:41:11.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:11.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:11.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:11.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 zonegroup default 2024-04-03T03:41:11.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.376 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.376 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 started sync module instance, tier type = 2024-04-03T03:41:11.376 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.372+0000 7f73636fa980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:11.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.396+0000 7f73636fa980 20 add_watcher() i=0 2024-04-03T03:41:11.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.396+0000 7f73636fa980 20 add_watcher() i=1 2024-04-03T03:41:11.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.396+0000 7f73636fa980 20 add_watcher() i=2 2024-04-03T03:41:11.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.396+0000 7f73636fa980 20 add_watcher() i=3 2024-04-03T03:41:11.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.396+0000 7f73636fa980 20 add_watcher() i=4 2024-04-03T03:41:11.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.396+0000 7f73636fa980 20 add_watcher() i=5 2024-04-03T03:41:11.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.396+0000 7f73636fa980 20 add_watcher() i=6 2024-04-03T03:41:11.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.400+0000 7f73636fa980 20 add_watcher() i=7 2024-04-03T03:41:11.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.400+0000 7f73636fa980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:11.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.404+0000 7f72177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:11.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:11.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:11.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 5 note: GC not initialized 2024-04-03T03:41:11.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f72167e4640 20 reqs_thread_entry: start 2024-04-03T03:41:11.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:11.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 Filter name: none 2024-04-03T03:41:11.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f7187fff640 20 reqs_thread_entry: start 2024-04-03T03:41:11.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:11.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:11.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:11.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:41:11.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 INFO: main: starting shard=0 2024-04-03T03:41:11.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.408+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:11.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 INFO: main: starting shard=1 2024-04-03T03:41:11.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:11.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-04-03T03:41:11.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 INFO: main: starting shard=2 2024-04-03T03:41:11.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:11.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 INFO: main: starting shard=3 2024-04-03T03:41:11.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:11.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 INFO: main: starting shard=4 2024-04-03T03:41:11.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.412+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:11.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: starting shard=5 2024-04-03T03:41:11.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:11.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: starting shard=6 2024-04-03T03:41:11.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:11.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: starting shard=7 2024-04-03T03:41:11.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:11.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: starting shard=8 2024-04-03T03:41:11.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:11.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: starting shard=9 2024-04-03T03:41:11.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:11.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.416+0000 7f73636fa980 20 INFO: main: starting shard=10 2024-04-03T03:41:11.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.420+0000 7f73636fa980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:11.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.420+0000 7f73636fa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.422 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.420+0000 7f73636fa980 20 INFO: main: done 2024-04-03T03:41:11.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.420+0000 7f72177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:11.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.424+0000 7f73636fa980 20 remove_watcher() i=0 2024-04-03T03:41:11.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.424+0000 7f73636fa980 2 removed watcher, disabling cache 2024-04-03T03:41:11.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.428+0000 7f73636fa980 20 remove_watcher() i=1 2024-04-03T03:41:11.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.428+0000 7f73636fa980 20 remove_watcher() i=2 2024-04-03T03:41:11.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.432+0000 7f73636fa980 20 remove_watcher() i=3 2024-04-03T03:41:11.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.436+0000 7f73636fa980 20 remove_watcher() i=4 2024-04-03T03:41:11.438 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.436+0000 7f73636fa980 20 remove_watcher() i=5 2024-04-03T03:41:11.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.436+0000 7f73636fa980 20 remove_watcher() i=6 2024-04-03T03:41:11.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.440+0000 7f73636fa980 20 remove_watcher() i=7 2024-04-03T03:41:11.458 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:11.459 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:11.482 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:11.482 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:11.590 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T03:41:11.590 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-04-03T03:41:11.625 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:11.625 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:11.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.668+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.668+0000 7f1b7ac4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.668+0000 7f1b7ac4b980 20 realm 2024-04-03T03:41:11.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.668+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.668+0000 7f1b7ac4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.668+0000 7f1b7ac4b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:11.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.668+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.668+0000 7f1b7ac4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.668+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.672+0000 7f1b7ac4b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:11.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.672+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.672+0000 7f1b7ac4b980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:11.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.672+0000 7f1b7ac4b980 20 searching for the correct realm 2024-04-03T03:41:11.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.676+0000 7f1b78f67640 0 -- 172.21.15.104:0/827751105 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f1b70018040 msgr2=0x7f1b70089040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:11.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.684+0000 7f1b77f65640 0 -- 172.21.15.104:0/827751105 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f1b7006e920 msgr2=0x7f1b70028710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:11.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.900+0000 7f1b7ac4b980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:11.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.900+0000 7f1b7ac4b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:11.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.900+0000 7f1b7ac4b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:11.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.900+0000 7f1b7ac4b980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:11.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.900+0000 7f1b7ac4b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:11.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.900+0000 7f1b7ac4b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:11.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.900+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.900+0000 7f1b7ac4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.900+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:11.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:11.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 zone default found 2024-04-03T03:41:11.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 4 Realm: () 2024-04-03T03:41:11.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:11.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:11.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:11.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 zonegroup default 2024-04-03T03:41:11.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:11.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 started sync module instance, tier type = 2024-04-03T03:41:11.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.904+0000 7f1b7ac4b980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:11.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.928+0000 7f1b7ac4b980 20 add_watcher() i=0 2024-04-03T03:41:11.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.928+0000 7f1b7ac4b980 20 add_watcher() i=1 2024-04-03T03:41:11.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.928+0000 7f1b7ac4b980 20 add_watcher() i=2 2024-04-03T03:41:11.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.928+0000 7f1b7ac4b980 20 add_watcher() i=3 2024-04-03T03:41:11.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.928+0000 7f1b7ac4b980 20 add_watcher() i=4 2024-04-03T03:41:11.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.928+0000 7f1b7ac4b980 20 add_watcher() i=5 2024-04-03T03:41:11.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.928+0000 7f1b7ac4b980 20 add_watcher() i=6 2024-04-03T03:41:11.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.932+0000 7f1b7ac4b980 20 add_watcher() i=7 2024-04-03T03:41:11.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.932+0000 7f1b7ac4b980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:11.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.936+0000 7f1a2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.936+0000 7f1b7ac4b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.936+0000 7f1b7ac4b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.936+0000 7f1b7ac4b980 5 note: GC not initialized 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.936+0000 7f1a2dfdb640 20 reqs_thread_entry: start 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.936+0000 7f1b7ac4b980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.936+0000 7f1b7ac4b980 20 Filter name: none 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.936+0000 7f199f7fe640 20 reqs_thread_entry: start 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 rados->read ofs=0 len=0 2024-04-03T03:41:11.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:11.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:11.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T03:41:11.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 INFO: main: starting shard=0 2024-04-03T03:41:11.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:11.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 INFO: main: starting shard=1 2024-04-03T03:41:11.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:11.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 INFO: main: starting shard=2 2024-04-03T03:41:11.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:11.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 INFO: main: starting shard=3 2024-04-03T03:41:11.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.940+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:11.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: starting shard=4 2024-04-03T03:41:11.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:11.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: starting shard=5 2024-04-03T03:41:11.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:11.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: starting shard=6 2024-04-03T03:41:11.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:11.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: starting shard=7 2024-04-03T03:41:11.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:11.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: starting shard=8 2024-04-03T03:41:11.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:11.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 INFO: main: starting shard=9 2024-04-03T03:41:11.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.944+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:11.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.948+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T03:41:11.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.948+0000 7f1b7ac4b980 20 INFO: main: starting shard=10 2024-04-03T03:41:11.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.948+0000 7f1b7ac4b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:11.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.948+0000 7f1b7ac4b980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-04-03T03:41:11.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.948+0000 7f1b7ac4b980 20 INFO: main: done 2024-04-03T03:41:11.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.948+0000 7f1a2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:11.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.956+0000 7f1b7ac4b980 20 remove_watcher() i=0 2024-04-03T03:41:11.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.956+0000 7f1b7ac4b980 2 removed watcher, disabling cache 2024-04-03T03:41:11.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.956+0000 7f1b7ac4b980 20 remove_watcher() i=1 2024-04-03T03:41:11.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.960+0000 7f1b7ac4b980 20 remove_watcher() i=2 2024-04-03T03:41:11.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.964+0000 7f1b7ac4b980 20 remove_watcher() i=3 2024-04-03T03:41:11.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.964+0000 7f1b7ac4b980 20 remove_watcher() i=4 2024-04-03T03:41:11.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.968+0000 7f1b7ac4b980 20 remove_watcher() i=5 2024-04-03T03:41:11.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.968+0000 7f1b7ac4b980 20 remove_watcher() i=6 2024-04-03T03:41:11.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:11.968+0000 7f1b7ac4b980 20 remove_watcher() i=7 2024-04-03T03:41:11.990 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:11.990 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:12.013 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-04-03T03:41:12.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:12.340+0000 7f1d89139640 0 --2- 172.21.15.104:0/495687742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d84072910 0x7f1d8413eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-04-03T03:41:12.647 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-04-03T03:41:13.081 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-04-03T03:41:13.113 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:13.113 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:13.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.152+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.152+0000 7f32d34fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.152+0000 7f32d34fc980 20 realm 2024-04-03T03:41:13.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.152+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.152+0000 7f32d34fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.152+0000 7f32d34fc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:13.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.152+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.152+0000 7f32d34fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.152+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.156+0000 7f32d34fc980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:13.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.156+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.156+0000 7f32d34fc980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:13.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.156+0000 7f32d34fc980 20 searching for the correct realm 2024-04-03T03:41:13.165 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.160+0000 7f32d1818640 0 -- 172.21.15.104:0/2150913089 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f32cc021b30 msgr2=0x7f32cc055050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:13.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.168+0000 7f32d0816640 0 -- 172.21.15.104:0/2150913089 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f32cc021420 msgr2=0x7f32cc06e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:13.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.384+0000 7f32d34fc980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:13.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.384+0000 7f32d34fc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:13.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.384+0000 7f32d34fc980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:13.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.384+0000 7f32d34fc980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:13.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.384+0000 7f32d34fc980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:13.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.384+0000 7f32d34fc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:13.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.384+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.384+0000 7f32d34fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.384+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:13.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:13.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 zone default found 2024-04-03T03:41:13.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 4 Realm: () 2024-04-03T03:41:13.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:13.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:13.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:13.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 zonegroup default 2024-04-03T03:41:13.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 started sync module instance, tier type = 2024-04-03T03:41:13.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.388+0000 7f32d34fc980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:13.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.416+0000 7f32d34fc980 20 add_watcher() i=0 2024-04-03T03:41:13.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.416+0000 7f32d34fc980 20 add_watcher() i=1 2024-04-03T03:41:13.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.416+0000 7f32d34fc980 20 add_watcher() i=2 2024-04-03T03:41:13.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.416+0000 7f32d34fc980 20 add_watcher() i=3 2024-04-03T03:41:13.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.416+0000 7f32d34fc980 20 add_watcher() i=4 2024-04-03T03:41:13.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.416+0000 7f32d34fc980 20 add_watcher() i=5 2024-04-03T03:41:13.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.416+0000 7f32d34fc980 20 add_watcher() i=6 2024-04-03T03:41:13.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.416+0000 7f32d34fc980 20 add_watcher() i=7 2024-04-03T03:41:13.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.416+0000 7f32d34fc980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:13.424 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.420+0000 7f3187fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:13.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.420+0000 7f32d34fc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:13.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.420+0000 7f32d34fc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:13.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 5 note: GC not initialized 2024-04-03T03:41:13.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f3186fe5640 20 reqs_thread_entry: start 2024-04-03T03:41:13.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:13.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 20 Filter name: none 2024-04-03T03:41:13.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f3184fe1640 20 reqs_thread_entry: start 2024-04-03T03:41:13.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:41:13.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:13.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:41:13.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:41:13.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:41:13.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:13.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:41:13.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:41:13.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:41:13.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:41:13.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:41:13.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:41:13.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.424+0000 7f32d34fc980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:41:13.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.428+0000 7f32d34fc980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:41:13.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.428+0000 7f32d34fc980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:41:13.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.428+0000 7f32d34fc980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:41:13.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.428+0000 7f32d34fc980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:41:13.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.436+0000 7f3187fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:13.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.444+0000 7f32d34fc980 20 remove_watcher() i=0 2024-04-03T03:41:13.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.444+0000 7f32d34fc980 2 removed watcher, disabling cache 2024-04-03T03:41:13.447 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.444+0000 7f32d34fc980 20 remove_watcher() i=1 2024-04-03T03:41:13.450 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.448+0000 7f32d34fc980 20 remove_watcher() i=2 2024-04-03T03:41:13.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.448+0000 7f32d34fc980 20 remove_watcher() i=3 2024-04-03T03:41:13.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.452+0000 7f32d34fc980 20 remove_watcher() i=4 2024-04-03T03:41:13.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.452+0000 7f32d34fc980 20 remove_watcher() i=5 2024-04-03T03:41:13.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.452+0000 7f32d34fc980 20 remove_watcher() i=6 2024-04-03T03:41:13.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.456+0000 7f32d34fc980 20 remove_watcher() i=7 2024-04-03T03:41:13.473 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-04-03T03:41:13.509 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:13.509 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:13.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.552+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.552+0000 7f4485847980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.552+0000 7f4485847980 20 realm 2024-04-03T03:41:13.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.552+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.552+0000 7f4485847980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.552+0000 7f4485847980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:13.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.552+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.552+0000 7f4485847980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.552+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.556+0000 7f4485847980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:13.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.556+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.556+0000 7f4485847980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:13.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.556+0000 7f4485847980 20 searching for the correct realm 2024-04-03T03:41:13.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.560+0000 7f4483b63640 0 -- 172.21.15.104:0/3778362258 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f447c034040 msgr2=0x7f447c017930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:13.571 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.568+0000 7f4482b61640 0 -- 172.21.15.104:0/3778362258 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f447c034420 msgr2=0x7f447c0348a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:13.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:13.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:13.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:13.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:13.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:13.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:13.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:13.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.784+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:13.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 zone default found 2024-04-03T03:41:13.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 4 Realm: () 2024-04-03T03:41:13.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:13.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:13.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:13.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 zonegroup default 2024-04-03T03:41:13.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:13.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 started sync module instance, tier type = 2024-04-03T03:41:13.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.788+0000 7f4485847980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:13.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.808+0000 7f4485847980 20 add_watcher() i=0 2024-04-03T03:41:13.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.808+0000 7f4485847980 20 add_watcher() i=1 2024-04-03T03:41:13.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.808+0000 7f4485847980 20 add_watcher() i=2 2024-04-03T03:41:13.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.808+0000 7f4485847980 20 add_watcher() i=3 2024-04-03T03:41:13.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.808+0000 7f4485847980 20 add_watcher() i=4 2024-04-03T03:41:13.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.808+0000 7f4485847980 20 add_watcher() i=5 2024-04-03T03:41:13.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.808+0000 7f4485847980 20 add_watcher() i=6 2024-04-03T03:41:13.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.812+0000 7f4485847980 20 add_watcher() i=7 2024-04-03T03:41:13.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.812+0000 7f4485847980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:13.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f433a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 5 note: GC not initialized 2024-04-03T03:41:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f43397e2640 20 reqs_thread_entry: start 2024-04-03T03:41:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 20 Filter name: none 2024-04-03T03:41:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f43327fc640 20 reqs_thread_entry: start 2024-04-03T03:41:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-04-03T03:41:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:13.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-04-03T03:41:13.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-04-03T03:41:13.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 : miss 2024-04-03T03:41:13.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 20 rados->read ofs=0 len=0 2024-04-03T03:41:13.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:13.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 info.flags=0x17 2024-04-03T03:41:13.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 to cache LRU end 2024-04-03T03:41:13.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:41:13.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-04-03T03:41:13.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1 2024-04-03T03:41:13.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.816+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.0 2024-04-03T03:41:13.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.820+0000 7f4485847980 1 NOTICE: finished shard 0 (0 entries removed) 2024-04-03T03:41:13.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.820+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:13.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.820+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.2 2024-04-03T03:41:13.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.820+0000 7f4485847980 1 NOTICE: finished shard 2 (0 entries removed) 2024-04-03T03:41:13.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.820+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.3 2024-04-03T03:41:13.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.820+0000 7f4485847980 1 NOTICE: finished shard 3 (0 entries removed) 2024-04-03T03:41:13.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.820+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.4 2024-04-03T03:41:13.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.820+0000 7f4485847980 1 NOTICE: finished shard 4 (0 entries removed) 2024-04-03T03:41:13.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.820+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:13.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.824+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.6 2024-04-03T03:41:13.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.824+0000 7f4485847980 1 NOTICE: finished shard 6 (0 entries removed) 2024-04-03T03:41:13.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.824+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.7 2024-04-03T03:41:13.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.824+0000 7f4485847980 1 NOTICE: finished shard 7 (0 entries removed) 2024-04-03T03:41:13.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.824+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:13.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.824+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.9 2024-04-03T03:41:13.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.824+0000 7f4485847980 1 NOTICE: finished shard 9 (0 entries removed) 2024-04-03T03:41:13.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.824+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:13.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.824+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:13.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state: octx=0x56002c1e6550 obj=check-bucket:e state=0x56002c491348 s->prefetch_data=0 2024-04-03T03:41:13.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:13.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state: octx=0x56002c1f7800 obj=check-bucket:d state=0x56002c48fe88 s->prefetch_data=0 2024-04-03T03:41:13.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:13.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state: octx=0x56002c49a520 obj=check-bucket:c state=0x56002c491ea8 s->prefetch_data=0 2024-04-03T03:41:13.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:13.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state: octx=0x56002c49ba10 obj=check-bucket:f state=0x56002c492a08 s->prefetch_data=0 2024-04-03T03:41:13.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state: setting s->obj_tag to c43rl9vsk2whc0eiryv37q43qpxnzbsh 2024-04-03T03:41:13.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state_impl: setting s->olh_tag to obnqxpyafmxfzzmvpbe99ia1eskfaor6 2024-04-03T03:41:13.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=obnqxpyafmxfzzmvpbe99ia1eskfaor6 2024-04-03T03:41:13.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state: setting s->obj_tag to jx2s5qtq6538omez9ja6g7z4ne2dw9wx 2024-04-03T03:41:13.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state_impl: setting s->olh_tag to 3swrb4wpor91sectr8sflgjjzugsnz04 2024-04-03T03:41:13.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3swrb4wpor91sectr8sflgjjzugsnz04 2024-04-03T03:41:13.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state: setting s->obj_tag to a17oqjp5dco12b00b2w48d5kptrhzpma 2024-04-03T03:41:13.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state_impl: setting s->olh_tag to ikvtqku4u01q73b0qpz2mmscz7g21qsp 2024-04-03T03:41:13.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ikvtqku4u01q73b0qpz2mmscz7g21qsp 2024-04-03T03:41:13.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state: setting s->obj_tag to jih9uvs3dqgahwi0z03sj5q28w4l1y6y 2024-04-03T03:41:13.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 get_obj_state_impl: setting s->olh_tag to h9pozcjcwo3515ke8n5wlmfnj37nqhxe 2024-04-03T03:41:13.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.828+0000 7f4485847980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=h9pozcjcwo3515ke8n5wlmfnj37nqhxe 2024-04-03T03:41:13.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.832+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:13.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.832+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:13.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.832+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:13.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.832+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:13.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.832+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:13.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.832+0000 7f4485847980 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-04-03T03:41:13.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.832+0000 7f4485847980 20 olh_log_entry: epoch=2 op=3 key=e[B967ziIhmFDq8CWRts9NA9N2Thqql2f] 2024-04-03T03:41:13.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.832+0000 7f4485847980 20 get_obj_state: octx=0x56002c1e6550 obj=check-bucket:_:B967ziIhmFDq8CWRts9NA9N2Thqql2f_e state=0x56002c539248 s->prefetch_data=0 2024-04-03T03:41:13.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.832+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:13.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 olh_log_entry: epoch=3 op=3 key=c[sP9wZud4yOKD4G-YAy66oUKry3swvkX] 2024-04-03T03:41:13.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 get_obj_state: octx=0x56002c49a520 obj=check-bucket:_:sP9wZud4yOKD4G-YAy66oUKry3swvkX_c state=0x56002c541968 s->prefetch_data=0 2024-04-03T03:41:13.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 10 manifest: total_size = 11 2024-04-03T03:41:13.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9742136636713905955 2024-04-03T03:41:13.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 get_obj_state: octx=0x56002c1e6550 obj=check-bucket:_:B967ziIhmFDq8CWRts9NA9N2Thqql2f_e state=0x56002c539248 s->prefetch_data=0 2024-04-03T03:41:13.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 prepare_atomic_modification: state is not atomic. state=0x56002c539248 2024-04-03T03:41:13.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:13.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:13.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 10 manifest: total_size = 12 2024-04-03T03:41:13.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7964890312295020931 2024-04-03T03:41:13.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 get_obj_state: octx=0x56002c49a520 obj=check-bucket:_:sP9wZud4yOKD4G-YAy66oUKry3swvkX_c state=0x56002c541968 s->prefetch_data=0 2024-04-03T03:41:13.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 prepare_atomic_modification: state is not atomic. state=0x56002c541968 2024-04-03T03:41:13.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:13.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 olh_log_entry: epoch=3 op=3 key=d[WuvXU1gT05ZP0-ujp8YW42TvGcD45CR] 2024-04-03T03:41:13.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 get_obj_state: octx=0x56002c1f7800 obj=check-bucket:_:WuvXU1gT05ZP0-ujp8YW42TvGcD45CR_d state=0x56002c54e8a8 s->prefetch_data=0 2024-04-03T03:41:13.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 10 manifest: total_size = 11 2024-04-03T03:41:13.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9968085327802529054 2024-04-03T03:41:13.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 get_obj_state: octx=0x56002c1f7800 obj=check-bucket:_:WuvXU1gT05ZP0-ujp8YW42TvGcD45CR_d state=0x56002c54e8a8 s->prefetch_data=0 2024-04-03T03:41:13.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 prepare_atomic_modification: state is not atomic. state=0x56002c54e8a8 2024-04-03T03:41:13.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:13.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:13.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-04-03T03:41:13.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 olh_log_entry: epoch=2 op=3 key=f[JdgVfy1x6IEM.32PSCCpSEr5fAtroVa] 2024-04-03T03:41:13.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.836+0000 7f4485847980 20 get_obj_state: octx=0x56002c49ba10 obj=check-bucket:_:JdgVfy1x6IEM.32PSCCpSEr5fAtroVa_f state=0x56002c5584e8 s->prefetch_data=0 2024-04-03T03:41:13.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.840+0000 7f4485847980 10 manifest: total_size = 9 2024-04-03T03:41:13.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.840+0000 7f4485847980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9411921820719713328 2024-04-03T03:41:13.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.840+0000 7f4485847980 20 get_obj_state: octx=0x56002c49ba10 obj=check-bucket:_:JdgVfy1x6IEM.32PSCCpSEr5fAtroVa_f state=0x56002c5584e8 s->prefetch_data=0 2024-04-03T03:41:13.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.840+0000 7f4485847980 20 prepare_atomic_modification: state is not atomic. state=0x56002c5584e8 2024-04-03T03:41:13.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.840+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:13.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.844+0000 7f4485847980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:41:13.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.844+0000 7f4485847980 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-04-03T03:41:13.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.844+0000 7f4485847980 0 deleting objects inline since gc isn't initialized 2024-04-03T03:41:13.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.844+0000 7f4485847980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1__shadow:B967ziIhmFDq8CWRts9NA9N2Thqql2f_.Okn2Jr01U9RMAP-UJs6oA1OwbwF0l7m_0 2024-04-03T03:41:13.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.844+0000 7f4485847980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T03:41:13.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f4485847980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:41:13.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f4485847980 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-04-03T03:41:13.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f4485847980 0 deleting objects inline since gc isn't initialized 2024-04-03T03:41:13.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f4485847980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1__shadow:sP9wZud4yOKD4G-YAy66oUKry3swvkX_.AATTnNLTg70qMatAjrS9Z7F-REIGjtL_0 2024-04-03T03:41:13.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f43667fc640 20 handle_completion(): completion ok for obj=e[B967ziIhmFDq8CWRts9NA9N2Thqql2f] 2024-04-03T03:41:13.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f4485847980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T03:41:13.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f4485847980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:41:13.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f4485847980 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-04-03T03:41:13.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f4485847980 0 deleting objects inline since gc isn't initialized 2024-04-03T03:41:13.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.848+0000 7f4485847980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1__shadow:WuvXU1gT05ZP0-ujp8YW42TvGcD45CR_.imm0fJYSkCXFagxcsPHeROAdEJVC7OU_0 2024-04-03T03:41:13.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.852+0000 7f4366ffd640 20 handle_completion(): completion ok for obj=c[sP9wZud4yOKD4G-YAy66oUKry3swvkX] 2024-04-03T03:41:13.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4366ffd640 20 handle_completion(): completion ok for obj=d[WuvXU1gT05ZP0-ujp8YW42TvGcD45CR] 2024-04-03T03:41:13.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4485847980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T03:41:13.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4485847980 20 get_obj_state: octx=0x56002c1e6550 obj=check-bucket:e state=0x56002c491348 s->prefetch_data=0 2024-04-03T03:41:13.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4485847980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=obnqxpyafmxfzzmvpbe99ia1eskfaor6 2024-04-03T03:41:13.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:13.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:13.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4485847980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:41:13.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4485847980 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-04-03T03:41:13.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4485847980 0 deleting objects inline since gc isn't initialized 2024-04-03T03:41:13.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.856+0000 7f4485847980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1__shadow:JdgVfy1x6IEM.32PSCCpSEr5fAtroVa_.btddVEwmJmHx3DDeUWZDWjSyyJyk11e_0 2024-04-03T03:41:13.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.860+0000 7f4485847980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T03:41:13.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.860+0000 7f4366ffd640 20 handle_completion(): completion ok for obj=f[JdgVfy1x6IEM.32PSCCpSEr5fAtroVa] 2024-04-03T03:41:13.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.860+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.8 2024-04-03T03:41:13.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.860+0000 7f4485847980 1 NOTICE: finished shard 8 (1 entries removed) 2024-04-03T03:41:13.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.860+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:13.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.860+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:13.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.864+0000 7f4485847980 20 get_obj_state: octx=0x56002c49ba10 obj=check-bucket:f state=0x56002c492a08 s->prefetch_data=0 2024-04-03T03:41:13.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.864+0000 7f4485847980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=h9pozcjcwo3515ke8n5wlmfnj37nqhxe 2024-04-03T03:41:13.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.864+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.5 2024-04-03T03:41:13.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.864+0000 7f4485847980 1 NOTICE: finished shard 5 (1 entries removed) 2024-04-03T03:41:13.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.864+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:13.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.872+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.1 2024-04-03T03:41:13.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.872+0000 7f4485847980 1 NOTICE: finished shard 1 (1 entries removed) 2024-04-03T03:41:13.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.872+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:13.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.876+0000 7f4485847980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1.10 2024-04-03T03:41:13.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.876+0000 7f4485847980 1 NOTICE: finished shard 10 (1 entries removed) 2024-04-03T03:41:13.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.876+0000 7f4485847980 1 NOTICE: finished all shards (4 entries removed) 2024-04-03T03:41:13.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.876+0000 7f433a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:13.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.880+0000 7f4485847980 20 remove_watcher() i=0 2024-04-03T03:41:13.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.880+0000 7f4485847980 2 removed watcher, disabling cache 2024-04-03T03:41:13.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.884+0000 7f4485847980 20 remove_watcher() i=1 2024-04-03T03:41:13.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.884+0000 7f4485847980 20 remove_watcher() i=2 2024-04-03T03:41:13.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.888+0000 7f4485847980 20 remove_watcher() i=3 2024-04-03T03:41:13.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.888+0000 7f4485847980 20 remove_watcher() i=4 2024-04-03T03:41:13.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.892+0000 7f4485847980 20 remove_watcher() i=5 2024-04-03T03:41:13.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.892+0000 7f4485847980 20 remove_watcher() i=6 2024-04-03T03:41:13.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:13.896+0000 7f4485847980 20 remove_watcher() i=7 2024-04-03T03:41:13.915 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:13.915 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:13.961 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:13.961 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:14.304 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-04-03T03:41:14.334 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:41:14.334 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:41:14.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.376+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.376+0000 7f984a1d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:14.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.376+0000 7f984a1d0980 20 realm 2024-04-03T03:41:14.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.376+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.376+0000 7f984a1d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:14.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.376+0000 7f984a1d0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:41:14.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.376+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.376+0000 7f984a1d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:14.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.376+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.380+0000 7f984a1d0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:14.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.380+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.380+0000 7f984a1d0980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:41:14.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.380+0000 7f984a1d0980 20 searching for the correct realm 2024-04-03T03:41:14.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.384+0000 7f98484ec640 0 -- 172.21.15.104:0/2266229146 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f98400f90e0 msgr2=0x7f98400ef850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:41:14.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.392+0000 7f98474ea640 0 -- 172.21.15.104:0/2266229146 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f98400b8760 msgr2=0x7f9840118040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:41:14.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:41:14.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:41:14.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:41:14.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:41:14.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:41:14.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:41:14.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:14.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:41:14.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.608+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 zone default found 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 4 Realm: () 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 zonegroup default 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:14.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:41:14.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 started sync module instance, tier type = 2024-04-03T03:41:14.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.612+0000 7f984a1d0980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:41:14.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.636+0000 7f984a1d0980 20 add_watcher() i=0 2024-04-03T03:41:14.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.636+0000 7f984a1d0980 20 add_watcher() i=1 2024-04-03T03:41:14.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.636+0000 7f984a1d0980 20 add_watcher() i=2 2024-04-03T03:41:14.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.636+0000 7f984a1d0980 20 add_watcher() i=3 2024-04-03T03:41:14.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.636+0000 7f984a1d0980 20 add_watcher() i=4 2024-04-03T03:41:14.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.636+0000 7f984a1d0980 20 add_watcher() i=5 2024-04-03T03:41:14.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.636+0000 7f984a1d0980 20 add_watcher() i=6 2024-04-03T03:41:14.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.640+0000 7f984a1d0980 20 add_watcher() i=7 2024-04-03T03:41:14.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.640+0000 7f984a1d0980 2 all 8 watchers are set, enabling cache 2024-04-03T03:41:14.647 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.644+0000 7f96fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:14.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.644+0000 7f984a1d0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:41:14.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.644+0000 7f984a1d0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:41:14.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.644+0000 7f984a1d0980 5 note: GC not initialized 2024-04-03T03:41:14.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.644+0000 7f96fcfe1640 20 reqs_thread_entry: start 2024-04-03T03:41:14.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.644+0000 7f984a1d0980 20 init_complete bucket index max shards: 11 2024-04-03T03:41:14.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f984a1d0980 20 Filter name: none 2024-04-03T03:41:14.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f96767fc640 20 reqs_thread_entry: start 2024-04-03T03:41:14.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.650 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f984a1d0980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:14.650 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f984a1d0980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:14.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f984a1d0980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:14.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f984a1d0980 20 rados_obj.operate() r=0 bl.length=190 2024-04-03T03:41:14.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.648+0000 7f984a1d0980 20 rados->read ofs=0 len=0 2024-04-03T03:41:14.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.652+0000 7f984a1d0980 20 rados_obj.operate() r=0 bl.length=368 2024-04-03T03:41:14.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.652+0000 7f984a1d0980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:41:14.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.652+0000 7f96fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:41:14.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.660+0000 7f984a1d0980 20 remove_watcher() i=0 2024-04-03T03:41:14.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.660+0000 7f984a1d0980 2 removed watcher, disabling cache 2024-04-03T03:41:14.665 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.660+0000 7f984a1d0980 20 remove_watcher() i=1 2024-04-03T03:41:14.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.664+0000 7f984a1d0980 20 remove_watcher() i=2 2024-04-03T03:41:14.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.668+0000 7f984a1d0980 20 remove_watcher() i=3 2024-04-03T03:41:14.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.668+0000 7f984a1d0980 20 remove_watcher() i=4 2024-04-03T03:41:14.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.672+0000 7f984a1d0980 20 remove_watcher() i=5 2024-04-03T03:41:14.675 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.672+0000 7f984a1d0980 20 remove_watcher() i=6 2024-04-03T03:41:14.676 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:41:14.672+0000 7f984a1d0980 20 remove_watcher() i=7 2024-04-03T03:41:14.700 INFO:tasks.workunit.client.0.smithi104.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-04-03T03:41:14.700 INFO:tasks.workunit.client.0.smithi104.stderr:Deleting bucket check-bucket 2024-04-03T03:41:14.702 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:14.702 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:14.765 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:41:14.765 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:41:15.336 INFO:tasks.workunit.client.0.smithi104.stderr:Completed bucket check tests 2024-04-03T03:41:15.336 INFO:tasks.workunit.client.0.smithi104.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-04-03T03:41:15.336 INFO:tasks.workunit.client.0.smithi104.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-04-03T03:41:15.336 INFO:tasks.workunit.client.0.smithi104.stdout:connected to https://localhost:443 2024-04-03T03:41:15.436 INFO:tasks.workunit.client.0.smithi104.stderr:+ deactivate 2024-04-03T03:41:15.436 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-04-03T03:41:15.436 INFO:tasks.workunit.client.0.smithi104.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-04-03T03:41:15.436 INFO:tasks.workunit.client.0.smithi104.stderr:+ export PATH 2024-04-03T03:41:15.436 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset _OLD_VIRTUAL_PATH 2024-04-03T03:41:15.436 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n '' ']' 2024-04-03T03:41:15.437 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-04-03T03:41:15.437 INFO:tasks.workunit.client.0.smithi104.stderr:+ hash -r 2024-04-03T03:41:15.437 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n '' ']' 2024-04-03T03:41:15.437 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset VIRTUAL_ENV 2024-04-03T03:41:15.437 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-04-03T03:41:15.437 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' '!' '' = nondestructive ']' 2024-04-03T03:41:15.437 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset -f deactivate 2024-04-03T03:41:15.437 INFO:tasks.workunit.client.0.smithi104.stderr:+ echo OK. 2024-04-03T03:41:15.438 INFO:tasks.workunit.client.0.smithi104.stdout:OK. 2024-04-03T03:41:15.438 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:41:15.438 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:41:15.451 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-04-03T03:41:15.451 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-03T03:41:15.850 DEBUG:teuthology.parallel:result is None 2024-04-03T03:41:15.850 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T03:41:15.862 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T03:41:15.862 DEBUG:teuthology.orchestra.run.smithi104:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:41:15.923 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T03:41:15.924 INFO:teuthology.run_tasks:Running task workunit... 2024-04-03T03:41:15.937 INFO:tasks.workunit:Pulling workunits from ref 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:41:15.937 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-03T03:41:15.937 DEBUG:teuthology.orchestra.run.smithi104:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:41:15.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:41:15.973 INFO:teuthology.orchestra.run.smithi104.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-03T03:41:15.973 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:41:16.022 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-03T03:41:16.022 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-03T03:41:16.070 INFO:tasks.workunit:timeout=3h 2024-04-03T03:41:16.070 INFO:tasks.workunit:cleanup=True 2024-04-03T03:41:16.070 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:41:16.120 INFO:tasks.workunit.client.0.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-03T03:42:34.830 INFO:tasks.workunit.client.0.smithi104.stderr:Note: switching to '888a4a757aa90aa5ed4fb3291576474bc07507ce'. 2024-04-03T03:42:34.830 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:42:34.830 INFO:tasks.workunit.client.0.smithi104.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr:state without impacting any branches by switching back to a branch. 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr: git switch -c 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr:Or undo this operation with: 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr: git switch - 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-03T03:42:34.831 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:42:34.832 INFO:tasks.workunit.client.0.smithi104.stderr:HEAD is now at 888a4a757aa Merge branch 'pr-56562' into wip-cbodley-testing 2024-04-03T03:42:34.836 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-03T03:42:34.883 INFO:tasks.workunit.client.0.smithi104.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-03T03:42:34.886 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T03:42:34.886 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-03T03:42:34.948 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-03T03:42:35.001 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-03T03:42:35.046 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T03:42:35.047 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T03:42:35.047 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-03T03:42:35.092 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T03:42:35.096 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:42:35.096 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-03T03:42:35.141 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-04-03T03:42:35.142 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-04-03T03:42:35.142 DEBUG:teuthology.orchestra.run.smithi104:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-04-03T03:42:35.207 INFO:tasks.workunit.client.0.smithi104.stdout:Running main() from gmock_main.cc 2024-04-03T03:42:35.207 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 11 tests from 1 test suite. 2024-04-03T03:42:35.207 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:42:35.207 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 11 tests from ClsLock 2024-04-03T03:42:35.207 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-04-03T03:42:36.883 INFO:tasks.workunit.client.0.smithi104.stdout:lock: mylock 2024-04-03T03:42:36.884 INFO:tasks.workunit.client.0.smithi104.stdout: lock_type: exclusive 2024-04-03T03:42:36.884 INFO:tasks.workunit.client.0.smithi104.stdout: tag: 2024-04-03T03:42:36.884 INFO:tasks.workunit.client.0.smithi104.stdout: lockers: 2024-04-03T03:42:36.884 INFO:tasks.workunit.client.0.smithi104.stdout: client.4985 expiration=2024-04-03T03:44:36.879876+0000 addr=v1:172.21.15.104:0/1780467096 cookie= 2024-04-03T03:42:36.891 INFO:tasks.workunit.client.0.smithi104.stdout:lock: mylock 2024-04-03T03:42:36.891 INFO:tasks.workunit.client.0.smithi104.stdout: lock_type: shared 2024-04-03T03:42:36.891 INFO:tasks.workunit.client.0.smithi104.stdout: tag: 2024-04-03T03:42:36.891 INFO:tasks.workunit.client.0.smithi104.stdout: lockers: 2024-04-03T03:42:36.891 INFO:tasks.workunit.client.0.smithi104.stdout: client.4985 expiration=2024-04-03T03:44:36.891744+0000 addr=v1:172.21.15.104:0/1780467096 cookie= 2024-04-03T03:42:36.891 INFO:tasks.workunit.client.0.smithi104.stdout: client.4988 expiration=0.000000 addr=v1:172.21.15.104:0/2813939763 cookie= 2024-04-03T03:42:36.893 INFO:tasks.workunit.client.0.smithi104.stdout:lock: mylock 2024-04-03T03:42:36.893 INFO:tasks.workunit.client.0.smithi104.stdout: lock_type: shared 2024-04-03T03:42:36.893 INFO:tasks.workunit.client.0.smithi104.stdout: tag: 2024-04-03T03:42:36.893 INFO:tasks.workunit.client.0.smithi104.stdout: lockers: 2024-04-03T03:42:36.893 INFO:tasks.workunit.client.0.smithi104.stdout: client.4988 expiration=0.000000 addr=v1:172.21.15.104:0/2813939763 cookie= 2024-04-03T03:42:37.841 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestMultiLocking (2634 ms) 2024-04-03T03:42:37.841 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestMeta 2024-04-03T03:42:40.157 INFO:tasks.workunit.client.0.smithi104.stdout:lock: mylock 2024-04-03T03:42:40.157 INFO:tasks.workunit.client.0.smithi104.stdout: lock_type: shared 2024-04-03T03:42:40.157 INFO:tasks.workunit.client.0.smithi104.stdout: tag: 2024-04-03T03:42:40.158 INFO:tasks.workunit.client.0.smithi104.stdout: lockers: 2024-04-03T03:42:40.158 INFO:tasks.workunit.client.0.smithi104.stdout: client.5000 expiration=0.000000 addr=v1:172.21.15.104:0/433018162 cookie= 2024-04-03T03:42:40.164 INFO:tasks.workunit.client.0.smithi104.stdout:lock: mylock 2024-04-03T03:42:40.164 INFO:tasks.workunit.client.0.smithi104.stdout: lock_type: exclusive 2024-04-03T03:42:40.164 INFO:tasks.workunit.client.0.smithi104.stdout: tag: new_tag 2024-04-03T03:42:40.165 INFO:tasks.workunit.client.0.smithi104.stdout: lockers: 2024-04-03T03:42:40.165 INFO:tasks.workunit.client.0.smithi104.stdout: client.4994 expiration=0.000000 addr=v1:172.21.15.104:0/3165795380 cookie= 2024-04-03T03:42:40.900 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestMeta (3059 ms) 2024-04-03T03:42:40.900 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestCookie 2024-04-03T03:42:42.972 INFO:tasks.workunit.client.0.smithi104.stdout:lock: mylock 2024-04-03T03:42:42.972 INFO:tasks.workunit.client.0.smithi104.stdout: lock_type: exclusive 2024-04-03T03:42:42.973 INFO:tasks.workunit.client.0.smithi104.stdout: tag: 2024-04-03T03:42:42.973 INFO:tasks.workunit.client.0.smithi104.stdout: lockers: 2024-04-03T03:42:42.987 INFO:tasks.workunit.client.0.smithi104.stdout:lock: mylock 2024-04-03T03:42:42.987 INFO:tasks.workunit.client.0.smithi104.stdout: lock_type: shared 2024-04-03T03:42:42.987 INFO:tasks.workunit.client.0.smithi104.stdout: tag: 2024-04-03T03:42:42.987 INFO:tasks.workunit.client.0.smithi104.stdout: lockers: 2024-04-03T03:42:42.987 INFO:tasks.workunit.client.0.smithi104.stdout: client.5190 expiration=0.000000 addr=v1:172.21.15.104:0/2718940111 cookie= 2024-04-03T03:42:42.987 INFO:tasks.workunit.client.0.smithi104.stdout: client.5190 expiration=0.000000 addr=v1:172.21.15.104:0/2718940111 cookie=new cookie 2024-04-03T03:42:43.953 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestCookie (3053 ms) 2024-04-03T03:42:43.954 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-04-03T03:42:47.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestMultipleLocks (3056 ms) 2024-04-03T03:42:47.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestLockDuration 2024-04-03T03:42:54.078 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestLockDuration (7069 ms) 2024-04-03T03:42:54.078 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-04-03T03:42:57.081 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestAssertLocked (3003 ms) 2024-04-03T03:42:57.081 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestSetCookie 2024-04-03T03:43:00.145 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestSetCookie (3057 ms) 2024-04-03T03:43:00.145 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestRenew 2024-04-03T03:43:20.786 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestRenew (20648 ms) 2024-04-03T03:43:20.787 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-04-03T03:43:27.846 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7061 ms) 2024-04-03T03:43:27.846 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-04-03T03:43:35.897 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8044 ms) 2024-04-03T03:43:35.897 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-04-03T03:43:43.941 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8049 ms) 2024-04-03T03:43:43.941 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 11 tests from ClsLock (68733 ms total) 2024-04-03T03:43:43.942 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:43:43.942 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:43:43.942 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 11 tests from 1 test suite ran. (68734 ms total) 2024-04-03T03:43:43.942 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 11 tests. 2024-04-03T03:43:43.949 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:43:43.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:43:44.006 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-04-03T03:43:44.007 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-04-03T03:43:44.007 DEBUG:teuthology.orchestra.run.smithi104:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-04-03T03:43:44.072 INFO:tasks.workunit.client.0.smithi104.stdout:Running main() from gmock_main.cc 2024-04-03T03:43:44.072 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-03T03:43:44.072 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:43:44.072 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 4 tests from cls_log 2024-04-03T03:43:44.072 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-04-03T03:43:46.964 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_log.test_log_add_same_time (2892 ms) 2024-04-03T03:43:46.964 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-04-03T03:43:50.020 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_log.test_log_add_different_time (3055 ms) 2024-04-03T03:43:50.020 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_log.trim_by_time 2024-04-03T03:43:53.025 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_log.trim_by_time (3006 ms) 2024-04-03T03:43:53.026 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_log.trim_by_marker 2024-04-03T03:43:56.067 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_log.trim_by_marker (3041 ms) 2024-04-03T03:43:56.067 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 4 tests from cls_log (11995 ms total) 2024-04-03T03:43:56.067 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:43:56.067 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:43:56.067 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 4 tests from 1 test suite ran. (11995 ms total) 2024-04-03T03:43:56.067 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 4 tests. 2024-04-03T03:43:56.075 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:43:56.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:43:56.130 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-04-03T03:43:56.131 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-04-03T03:43:56.131 DEBUG:teuthology.orchestra.run.smithi104:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-04-03T03:43:56.194 INFO:tasks.workunit.client.0.smithi104.stdout:Running main() from gmock_main.cc 2024-04-03T03:43:56.195 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 10 tests from 1 test suite. 2024-04-03T03:43:56.195 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:43:56.195 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 10 tests from cls_refcount 2024-04-03T03:43:56.195 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.test_implicit 2024-04-03T03:43:59.087 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.test_implicit (2893 ms) 2024-04-03T03:43:59.088 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-04-03T03:44:02.141 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3053 ms) 2024-04-03T03:44:02.141 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.test_put_snap 2024-04-03T03:44:11.192 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.test_put_snap (9051 ms) 2024-04-03T03:44:11.192 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.test_explicit 2024-04-03T03:44:14.242 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.test_explicit (3050 ms) 2024-04-03T03:44:14.242 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.set 2024-04-03T03:44:17.272 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.set (3023 ms) 2024-04-03T03:44:17.273 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-04-03T03:44:24.379 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.test_implicit_ec (7115 ms) 2024-04-03T03:44:24.379 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-04-03T03:44:31.412 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7032 ms) 2024-04-03T03:44:31.412 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-04-03T03:44:43.487 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.test_put_snap_ec (12076 ms) 2024-04-03T03:44:43.488 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-04-03T03:44:50.520 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.test_explicit_ec (7034 ms) 2024-04-03T03:44:50.521 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_refcount.set_ec 2024-04-03T03:44:57.594 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_refcount.set_ec (7073 ms) 2024-04-03T03:44:57.595 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 10 tests from cls_refcount (61400 ms total) 2024-04-03T03:44:57.595 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:44:57.595 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:44:57.595 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 10 tests from 1 test suite ran. (61400 ms total) 2024-04-03T03:44:57.595 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 10 tests. 2024-04-03T03:44:57.598 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:44:57.599 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:44:57.655 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-04-03T03:44:57.657 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-04-03T03:44:57.658 DEBUG:teuthology.orchestra.run.smithi104:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-04-03T03:44:57.723 INFO:tasks.workunit.client.0.smithi104.stdout:Running main() from gmock_main.cc 2024-04-03T03:44:57.723 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 16 tests from 1 test suite. 2024-04-03T03:44:57.723 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:44:57.723 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 16 tests from cls_rgw 2024-04-03T03:44:59.619 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.index_basic 2024-04-03T03:44:59.687 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.index_basic (68 ms) 2024-04-03T03:44:59.687 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-04-03T03:44:59.772 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (86 ms) 2024-04-03T03:44:59.772 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.index_remove_object 2024-04-03T03:44:59.887 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.index_remove_object (114 ms) 2024-04-03T03:44:59.887 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.index_suggest 2024-04-03T03:45:02.325 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.index_suggest (2438 ms) 2024-04-03T03:45:02.325 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-04-03T03:45:02.338 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.index_suggest_complete (14 ms) 2024-04-03T03:45:02.338 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.index_list 2024-04-03T03:45:02.392 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.index_list (53 ms) 2024-04-03T03:45:02.392 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-04-03T03:45:45.134 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.index_list_delimited (42743 ms) 2024-04-03T03:45:45.134 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.bi_list 2024-04-03T03:45:45.287 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.bi_list (155 ms) 2024-04-03T03:45:45.288 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.gc_set 2024-04-03T03:45:45.306 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.gc_set (18 ms) 2024-04-03T03:45:45.306 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.gc_list 2024-04-03T03:45:45.326 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.gc_list (20 ms) 2024-04-03T03:45:45.326 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.gc_defer 2024-04-03T03:45:52.949 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.gc_defer (7622 ms) 2024-04-03T03:45:52.949 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.usage_basic 2024-04-03T03:45:53.157 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.usage_basic (209 ms) 2024-04-03T03:45:53.157 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-04-03T03:45:53.160 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.usage_clear_no_obj (4 ms) 2024-04-03T03:45:53.160 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.usage_clear 2024-04-03T03:45:53.386 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.usage_clear (226 ms) 2024-04-03T03:45:53.386 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-04-03T03:45:53.482 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.bi_log_trim (95 ms) 2024-04-03T03:45:53.482 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-04-03T03:45:53.514 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw.index_racing_removes (33 ms) 2024-04-03T03:45:53.956 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 16 tests from cls_rgw (53898 ms total) 2024-04-03T03:45:53.956 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:45:53.956 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:45:53.956 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 16 tests from 1 test suite ran. (56236 ms total) 2024-04-03T03:45:53.956 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 16 tests. 2024-04-03T03:45:53.962 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:45:53.963 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:45:54.018 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-04-03T03:45:54.019 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-04-03T03:45:54.020 DEBUG:teuthology.orchestra.run.smithi104:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-04-03T03:45:54.084 INFO:tasks.workunit.client.0.smithi104.stdout:Running main() from gmock_main.cc 2024-04-03T03:45:54.084 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 9 tests from 1 test suite. 2024-04-03T03:45:54.084 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:45:54.084 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 9 tests from cls_rgw_gc 2024-04-03T03:45:54.084 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_gc.init 2024-04-03T03:45:55.974 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_gc.init (1888 ms) 2024-04-03T03:45:55.974 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-04-03T03:45:56.022 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (50 ms) 2024-04-03T03:45:56.022 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-04-03T03:45:56.022 INFO:tasks.workunit.client.0.smithi104.stderr:[ ] list info tag = chain-0 2024-04-03T03:45:56.033 INFO:tasks.workunit.client.0.smithi104.stderr:[ ] next_marker is: = 0/4263 2024-04-03T03:45:56.033 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (11 ms) 2024-04-03T03:45:56.033 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-04-03T03:45:56.047 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (14 ms) 2024-04-03T03:45:56.047 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-04-03T03:45:56.068 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (21 ms) 2024-04-03T03:45:56.068 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-04-03T03:45:56.086 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (18 ms) 2024-04-03T03:45:56.086 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-04-03T03:45:56.105 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (19 ms) 2024-04-03T03:45:56.105 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-04-03T03:45:56.121 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (16 ms) 2024-04-03T03:45:56.121 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_gc.finalize 2024-04-03T03:45:56.972 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_gc.finalize (851 ms) 2024-04-03T03:45:56.972 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 9 tests from cls_rgw_gc (2888 ms total) 2024-04-03T03:45:56.973 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:45:56.973 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:45:56.973 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 9 tests from 1 test suite ran. (2888 ms total) 2024-04-03T03:45:56.973 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 9 tests. 2024-04-03T03:45:56.982 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:45:56.982 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:45:57.038 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-04-03T03:45:57.040 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-04-03T03:45:57.040 DEBUG:teuthology.orchestra.run.smithi104:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-04-03T03:45:57.115 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:45:57.115 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:45:57.115 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 1 test from 1 test suite. 2024-04-03T03:45:57.115 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:45:58.979 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 1 test from cls_rgw_stats 2024-04-03T03:45:58.979 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] cls_rgw_stats.simulate 2024-04-03T03:45:59.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.006+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=XAE5KGIHTAI1 type=del size=4122844 2024-04-03T03:45:59.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.006+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=P80UP550FGTX type=del size=195286 2024-04-03T03:45:59.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.010+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=1LA2XW8ZJ3RQ type=write size=795265 2024-04-03T03:45:59.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.014+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=3CZ1G4AAD59T type=write size=695339 2024-04-03T03:45:59.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.014+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=B4POZK97HONN type=del size=2400617 2024-04-03T03:45:59.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.018+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=3VL5N34KSW19 type=write size=105022 2024-04-03T03:45:59.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.018+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=9T4ZYGJW7DQP type=del size=2935389 2024-04-03T03:45:59.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.022+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~4KZJH9AOQJCF.0 size=1048576 2024-04-03T03:45:59.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.022+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~4KZJH9AOQJCF.1 size=615760 2024-04-03T03:45:59.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.022+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=4KZJH9AOQJCF tag=CI628O486DHS type=write size=2712912 2024-04-03T03:45:59.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.026+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=AQFC5FJLII1K type=del size=2864183 2024-04-03T03:45:59.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.030+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~5TFQOE569TKJ.0 size=1048576 2024-04-03T03:45:59.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.030+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~5TFQOE569TKJ.1 size=1048576 2024-04-03T03:45:59.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.030+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~5TFQOE569TKJ.2 size=113675 2024-04-03T03:45:59.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.030+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=5TFQOE569TKJ tag=T6Z7IC0A5TKL type=write size=3259403 2024-04-03T03:45:59.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.034+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~9MJKM60G5WNV.0 size=1048576 2024-04-03T03:45:59.033 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.034+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~9MJKM60G5WNV.1 size=1048576 2024-04-03T03:45:59.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.038+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~9MJKM60G5WNV.2 size=276788 2024-04-03T03:45:59.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.038+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=9MJKM60G5WNV tag=BOPENJWXBJ05 type=write size=3422516 2024-04-03T03:45:59.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.038+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=U5EVSAPWW2CZ type=del size=2299238 2024-04-03T03:45:59.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.042+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~L2BW167T3SBZ.0 size=1048576 2024-04-03T03:45:59.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.046+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~L2BW167T3SBZ.1 size=990355 2024-04-03T03:45:59.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.046+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=L2BW167T3SBZ tag=58JXT0IF3PL6 type=write size=3087507 2024-04-03T03:45:59.043 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.046+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=6MWSYJP9BZ43 type=del size=2906692 2024-04-03T03:45:59.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.050+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~CIO3CS0ZLH0D.0 size=1048576 2024-04-03T03:45:59.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.050+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~CIO3CS0ZLH0D.1 size=1048576 2024-04-03T03:45:59.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.054+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~CIO3CS0ZLH0D.2 size=921070 2024-04-03T03:45:59.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.054+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=CIO3CS0ZLH0D tag=IIA0HVLL047W type=write size=4066798 2024-04-03T03:45:59.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.054+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=RV045WRQZNSW type=del size=9265 2024-04-03T03:45:59.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.058+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=XAE5KGIHTAI1 type=del size=4122844 2024-04-03T03:45:59.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.058+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=TBR6WUM5I9R1 type=del size=4149408 2024-04-03T03:45:59.057 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.062+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=P80UP550FGTX type=del 2024-04-03T03:45:59.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.062+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=RK3P2KHRRVPX type=del size=3332447 2024-04-03T03:45:59.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.066+0000 7f55269288c0 1 < completed write operation key=JAXVD60NI5YW tag=1LA2XW8ZJ3RQ type=write size=795265 2024-04-03T03:45:59.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.066+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=39U37SLV6RF8 type=del size=3523722 2024-04-03T03:45:59.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.070+0000 7f55269288c0 1 < completed write operation key=IOHMF3ADC6EU tag=3CZ1G4AAD59T type=write size=695339 2024-04-03T03:45:59.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.070+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=JXSWKFKGO566 type=del size=2153918 2024-04-03T03:45:59.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.074+0000 7f55269288c0 1 < suggested update operation key=KDSE2XB4D1XI tag=B4POZK97HONN type=del size=2400617 2024-04-03T03:45:59.072 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.074+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=935CRCKA8QOE type=del size=293207 2024-04-03T03:45:59.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.078+0000 7f55269288c0 1 < completed write operation key=8BMP0HIS520R tag=3VL5N34KSW19 type=write size=105022 2024-04-03T03:45:59.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.078+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=831XT0HHA5Z9 type=del size=2926296 2024-04-03T03:45:59.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.082+0000 7f55269288c0 1 < canceled operation key=JAXVD60NI5YW tag=9T4ZYGJW7DQP type=del size=2935389 2024-04-03T03:45:59.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.086+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~UH9QZZKX0NEF.0 size=1048576 2024-04-03T03:45:59.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.086+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~UH9QZZKX0NEF.1 size=1048576 2024-04-03T03:45:59.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.086+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~UH9QZZKX0NEF.2 size=472203 2024-04-03T03:45:59.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.086+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=UH9QZZKX0NEF tag=O8I1G3OOTBVY type=write size=3617931 2024-04-03T03:45:59.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.090+0000 7f55269288c0 1 < canceled part key=_multipart_X3YCYKP2P9IM.2~4KZJH9AOQJCF.0 size=1048576 2024-04-03T03:45:59.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.090+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~4KZJH9AOQJCF.1 size=615760 2024-04-03T03:45:59.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.094+0000 7f55269288c0 1 < canceled multipart upload key=X3YCYKP2P9IM upload=4KZJH9AOQJCF tag=CI628O486DHS type=write size=2712912 2024-04-03T03:45:59.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.098+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~KILILCDC5KBF.0 size=1048576 2024-04-03T03:45:59.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.098+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~KILILCDC5KBF.1 size=377219 2024-04-03T03:45:59.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.098+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=KILILCDC5KBF tag=FELCS50PM4H5 type=write size=2474371 2024-04-03T03:45:59.096 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.098+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=AQFC5FJLII1K type=del 2024-04-03T03:45:59.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.102+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=BV1WIN1PX0QY type=del size=1724165 2024-04-03T03:45:59.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.102+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~5TFQOE569TKJ.0 size=1048576 2024-04-03T03:45:59.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.106+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~5TFQOE569TKJ.1 size=1048576 2024-04-03T03:45:59.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.106+0000 7f55269288c0 1 < canceled part key=_multipart_B5BI0HJ5S1Y1.2~5TFQOE569TKJ.2 size=113675 2024-04-03T03:45:59.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.110+0000 7f55269288c0 1 < canceled multipart upload key=B5BI0HJ5S1Y1 upload=5TFQOE569TKJ tag=T6Z7IC0A5TKL type=write size=3259403 2024-04-03T03:45:59.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.110+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=A0V1NEBRN1N2 type=del size=2417181 2024-04-03T03:45:59.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.114+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~9MJKM60G5WNV.0 size=1048576 2024-04-03T03:45:59.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.114+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~9MJKM60G5WNV.1 size=1048576 2024-04-03T03:45:59.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.118+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~9MJKM60G5WNV.2 size=276788 2024-04-03T03:45:59.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.118+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=9MJKM60G5WNV tag=BOPENJWXBJ05 type=write size=3422516 2024-04-03T03:45:59.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.122+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=LES4V2YYJS55 type=write size=697847 2024-04-03T03:45:59.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.122+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=U5EVSAPWW2CZ type=del 2024-04-03T03:45:59.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.126+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=IU96JHK18GNX type=del size=2233897 2024-04-03T03:45:59.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.126+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~L2BW167T3SBZ.0 size=1048576 2024-04-03T03:45:59.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.130+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~L2BW167T3SBZ.1 size=990355 2024-04-03T03:45:59.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.130+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=L2BW167T3SBZ tag=58JXT0IF3PL6 type=write size=3087507 2024-04-03T03:45:59.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.134+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=URVUN6X8OTTX type=write size=730487 2024-04-03T03:45:59.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.134+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=6MWSYJP9BZ43 type=del 2024-04-03T03:45:59.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.138+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~A9QXR5HXAPGJ.0 size=935578 2024-04-03T03:45:59.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.138+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=A9QXR5HXAPGJ tag=NWQHUMKR5BJN type=write size=1984154 2024-04-03T03:45:59.138 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.142+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~CIO3CS0ZLH0D.0 size=1048576 2024-04-03T03:45:59.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.142+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~CIO3CS0ZLH0D.1 size=1048576 2024-04-03T03:45:59.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.142+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~CIO3CS0ZLH0D.2 size=921070 2024-04-03T03:45:59.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.146+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=CIO3CS0ZLH0D tag=IIA0HVLL047W type=write size=4066798 2024-04-03T03:45:59.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.150+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=Q1T6DIXKHL32 type=del size=1124883 2024-04-03T03:45:59.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.150+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=RV045WRQZNSW type=del 2024-04-03T03:45:59.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.154+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=2PA105LEF8S0 type=del size=4083998 2024-04-03T03:45:59.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.154+0000 7f55269288c0 1 < canceled operation key=TW860A14J9RC tag=TBR6WUM5I9R1 type=del size=4149408 2024-04-03T03:45:59.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.158+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=AFPR7HBT8AN1 type=del size=1137825 2024-04-03T03:45:59.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.158+0000 7f55269288c0 -1 < failed to complete operation key=KDSE2XB4D1XI tag=RK3P2KHRRVPX type=del size=3332447: (22) Invalid argument 2024-04-03T03:45:59.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.162+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=BW83HI6X3AUT type=write size=990622 2024-04-03T03:45:59.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.162+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=39U37SLV6RF8 type=del 2024-04-03T03:45:59.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.166+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~VUU3W8D6U2WQ.0 size=1048576 2024-04-03T03:45:59.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.166+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~VUU3W8D6U2WQ.1 size=1039645 2024-04-03T03:45:59.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.166+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=VUU3W8D6U2WQ tag=1JWM209LUSTQ type=write size=3136797 2024-04-03T03:45:59.165 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.170+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=JXSWKFKGO566 type=del 2024-04-03T03:45:59.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.170+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=VBNK507D8912 type=del size=1631208 2024-04-03T03:45:59.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.174+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=935CRCKA8QOE type=del 2024-04-03T03:45:59.173 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.178+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~ZHV563N8WEOM.0 size=1048576 2024-04-03T03:45:59.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.178+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~ZHV563N8WEOM.1 size=731672 2024-04-03T03:45:59.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.178+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=ZHV563N8WEOM tag=4V9831MYPX9Z type=write size=2828824 2024-04-03T03:45:59.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.182+0000 7f55269288c0 1 < suggested remove operation key=MB7HTWATXRMB tag=831XT0HHA5Z9 type=del 2024-04-03T03:45:59.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.186+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=3WJNJL550FBZ type=del size=3031017 2024-04-03T03:45:59.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.186+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~UH9QZZKX0NEF.0 size=1048576 2024-04-03T03:45:59.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.190+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~UH9QZZKX0NEF.1 size=1048576 2024-04-03T03:45:59.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.190+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~UH9QZZKX0NEF.2 size=472203 2024-04-03T03:45:59.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.194+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=UH9QZZKX0NEF tag=O8I1G3OOTBVY type=write size=3617931 2024-04-03T03:45:59.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.198+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=3UB8IBL2RXU3 type=write size=1016992 2024-04-03T03:45:59.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.202+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~KILILCDC5KBF.0 size=1048576 2024-04-03T03:45:59.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.202+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~KILILCDC5KBF.1 size=377219 2024-04-03T03:45:59.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.210+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=KILILCDC5KBF tag=FELCS50PM4H5 type=write size=2474371 2024-04-03T03:45:59.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.210+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=57Y1D6BN6121 type=del size=2911145 2024-04-03T03:45:59.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.214+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=BV1WIN1PX0QY type=del 2024-04-03T03:45:59.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.214+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=SR2WMB6BF64O type=del size=3781515 2024-04-03T03:45:59.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.218+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=A0V1NEBRN1N2 type=del 2024-04-03T03:45:59.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.222+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~F8PF6QYWSW1M.0 size=1048576 2024-04-03T03:45:59.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.222+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~F8PF6QYWSW1M.1 size=777095 2024-04-03T03:45:59.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.222+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=F8PF6QYWSW1M tag=CVTUYDNQGW5K type=write size=2874247 2024-04-03T03:45:59.222 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.226+0000 7f55269288c0 1 < completed write operation key=KU1R0YLDP1V3 tag=LES4V2YYJS55 type=write size=697847 2024-04-03T03:45:59.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.230+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~ZJK00Z66A9WN.0 size=1048576 2024-04-03T03:45:59.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.230+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~ZJK00Z66A9WN.1 size=1048576 2024-04-03T03:45:59.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.234+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~ZJK00Z66A9WN.2 size=840443 2024-04-03T03:45:59.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.234+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=ZJK00Z66A9WN tag=IITQRT715VMJ type=write size=3986171 2024-04-03T03:45:59.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.234+0000 7f55269288c0 -1 < failed to complete operation key=MB7HTWATXRMB tag=IU96JHK18GNX type=del size=2233897: (22) Invalid argument 2024-04-03T03:45:59.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.238+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~TYN5UG3TNY1O.0 size=1048576 2024-04-03T03:45:59.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.242+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~TYN5UG3TNY1O.1 size=1048576 2024-04-03T03:45:59.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.242+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~TYN5UG3TNY1O.2 size=375813 2024-04-03T03:45:59.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.242+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=TYN5UG3TNY1O tag=BLW89AJ93TCX type=write size=3521541 2024-04-03T03:45:59.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.246+0000 7f55269288c0 1 < completed write operation key=TW860A14J9RC tag=URVUN6X8OTTX type=write size=730487 2024-04-03T03:45:59.247 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.250+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~4HHG6MQY0HQT.0 size=912510 2024-04-03T03:45:59.247 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.250+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=4HHG6MQY0HQT tag=81DA0N92V0A7 type=write size=1961086 2024-04-03T03:45:59.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.254+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~A9QXR5HXAPGJ.0 size=935578 2024-04-03T03:45:59.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.258+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=A9QXR5HXAPGJ tag=NWQHUMKR5BJN type=write size=1984154 2024-04-03T03:45:59.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.258+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=I1JS8A7FCTU1 type=write size=329681 2024-04-03T03:45:59.257 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.262+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=Q1T6DIXKHL32 type=del 2024-04-03T03:45:59.260 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.262+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=45S7U2DWGUN8 type=del size=2934398 2024-04-03T03:45:59.262 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.266+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=2PA105LEF8S0 type=del 2024-04-03T03:45:59.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.266+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=C5S7HFLYW6NQ type=del size=168587 2024-04-03T03:45:59.268 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.270+0000 7f55269288c0 1 < suggested remove operation key=AXL5RVPSVDY5 tag=AFPR7HBT8AN1 type=del 2024-04-03T03:45:59.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.274+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=H8UYH37HHAXP type=write size=886165 2024-04-03T03:45:59.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.274+0000 7f55269288c0 1 < canceled operation key=JAXVD60NI5YW tag=BW83HI6X3AUT type=write size=990622 2024-04-03T03:45:59.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.278+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~MJT0XGQ18KBR.0 size=1048576 2024-04-03T03:45:59.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.282+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~MJT0XGQ18KBR.1 size=1048576 2024-04-03T03:45:59.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.282+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~MJT0XGQ18KBR.2 size=604690 2024-04-03T03:45:59.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.282+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=MJT0XGQ18KBR tag=Q4M2I5HQHPQU type=write size=3750418 2024-04-03T03:45:59.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.286+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~VUU3W8D6U2WQ.0 size=1048576 2024-04-03T03:45:59.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.286+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~VUU3W8D6U2WQ.1 size=1039645 2024-04-03T03:45:59.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.290+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=VUU3W8D6U2WQ tag=1JWM209LUSTQ type=write size=3136797 2024-04-03T03:45:59.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.294+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~TMZJKL6RHAVV.0 size=1048576 2024-04-03T03:45:59.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.298+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~TMZJKL6RHAVV.1 size=1048576 2024-04-03T03:45:59.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.298+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~TMZJKL6RHAVV.2 size=790828 2024-04-03T03:45:59.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.298+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=TMZJKL6RHAVV tag=2YZT4DQDPZ06 type=write size=3936556 2024-04-03T03:45:59.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.302+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=VBNK507D8912 type=del 2024-04-03T03:45:59.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.302+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=7EJ0N5BH5L62 type=del size=3879161 2024-04-03T03:45:59.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.306+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~ZHV563N8WEOM.0 size=1048576 2024-04-03T03:45:59.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.306+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~ZHV563N8WEOM.1 size=731672 2024-04-03T03:45:59.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.310+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=ZHV563N8WEOM tag=4V9831MYPX9Z type=write size=2828824 2024-04-03T03:45:59.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.314+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~YS40XQRAYCZM.0 size=339126 2024-04-03T03:45:59.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.314+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=YS40XQRAYCZM tag=GHFXOQ5AR4M6 type=write size=1387702 2024-04-03T03:45:59.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.318+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=3WJNJL550FBZ type=del 2024-04-03T03:45:59.315 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.318+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=L8FL2BL48EC8 type=del size=2212725 2024-04-03T03:45:59.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.322+0000 7f55269288c0 1 < suggested remove operation key=D8W2ZKIZFI8H tag=3UB8IBL2RXU3 type=write 2024-04-03T03:45:59.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.326+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=9710ZZ4Z3DH9 type=del size=822293 2024-04-03T03:45:59.323 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.326+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=57Y1D6BN6121 type=del 2024-04-03T03:45:59.326 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.330+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=MV3M1X2NS28U type=del size=2422236 2024-04-03T03:45:59.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.334+0000 7f55269288c0 1 < suggested update operation key=TW860A14J9RC tag=SR2WMB6BF64O type=del size=3781515 2024-04-03T03:45:59.334 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.338+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=QX0PHE5130I1 type=del size=2231019 2024-04-03T03:45:59.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.338+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~F8PF6QYWSW1M.0 size=1048576 2024-04-03T03:45:59.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.342+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~F8PF6QYWSW1M.1 size=777095 2024-04-03T03:45:59.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.346+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=F8PF6QYWSW1M tag=CVTUYDNQGW5K type=write size=2874247 2024-04-03T03:45:59.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.350+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~FCA8QPW2US5R.0 size=1048576 2024-04-03T03:45:59.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.350+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~FCA8QPW2US5R.1 size=1048576 2024-04-03T03:45:59.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.354+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~FCA8QPW2US5R.2 size=392429 2024-04-03T03:45:59.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.354+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=FCA8QPW2US5R tag=LUQ7O154IAKV type=write size=3538157 2024-04-03T03:45:59.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.354+0000 7f55269288c0 1 < canceled part key=_multipart_TW860A14J9RC.2~ZJK00Z66A9WN.0 size=1048576 2024-04-03T03:45:59.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.354+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~ZJK00Z66A9WN.1 size=1048576 2024-04-03T03:45:59.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.358+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~ZJK00Z66A9WN.2 size=840443 2024-04-03T03:45:59.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.362+0000 7f55269288c0 1 < canceled multipart upload key=TW860A14J9RC upload=ZJK00Z66A9WN tag=IITQRT715VMJ type=write size=3986171 2024-04-03T03:45:59.361 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.366+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~JJD6JPLDNDWO.0 size=1023000 2024-04-03T03:45:59.361 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.366+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=JJD6JPLDNDWO tag=RT0DHE3PRCMW type=write size=2071576 2024-04-03T03:45:59.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.366+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~TYN5UG3TNY1O.0 size=1048576 2024-04-03T03:45:59.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.370+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~TYN5UG3TNY1O.1 size=1048576 2024-04-03T03:45:59.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.370+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~TYN5UG3TNY1O.2 size=375813 2024-04-03T03:45:59.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.374+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=TYN5UG3TNY1O tag=BLW89AJ93TCX type=write size=3521541 2024-04-03T03:45:59.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.382+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~W20D8XJ5OJ3V.0 size=1048576 2024-04-03T03:45:59.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.382+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~W20D8XJ5OJ3V.1 size=685228 2024-04-03T03:45:59.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.382+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=W20D8XJ5OJ3V tag=77J28QNMR35A type=write size=2782380 2024-04-03T03:45:59.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.386+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~4HHG6MQY0HQT.0 size=912510 2024-04-03T03:45:59.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.390+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=4HHG6MQY0HQT tag=81DA0N92V0A7 type=write size=1961086 2024-04-03T03:45:59.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.390+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=OK3JLFZJDIVR type=del size=1792015 2024-04-03T03:45:59.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.394+0000 7f55269288c0 1 < completed write operation key=K3Z9W19WEJBM tag=I1JS8A7FCTU1 type=write size=329681 2024-04-03T03:45:59.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.394+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=XCUBBIBXXXXV type=del size=1573277 2024-04-03T03:45:59.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.398+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=45S7U2DWGUN8 type=del 2024-04-03T03:45:59.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.402+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~4ILV788T7EVT.0 size=1048576 2024-04-03T03:45:59.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.406+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~4ILV788T7EVT.1 size=330927 2024-04-03T03:45:59.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.406+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=4ILV788T7EVT tag=JDUMC3LU540N type=write size=2428079 2024-04-03T03:45:59.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.406+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=C5S7HFLYW6NQ type=del 2024-04-03T03:45:59.406 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.410+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=02EVWVAE9VHD type=del size=683897 2024-04-03T03:45:59.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.414+0000 7f55269288c0 1 < canceled operation key=F6IBZ80J4SDM tag=H8UYH37HHAXP type=write size=886165 2024-04-03T03:45:59.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.414+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=PHW5PT2GD3MF type=del size=469694 2024-04-03T03:45:59.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.418+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~MJT0XGQ18KBR.0 size=1048576 2024-04-03T03:45:59.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.422+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~MJT0XGQ18KBR.1 size=1048576 2024-04-03T03:45:59.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.426+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~MJT0XGQ18KBR.2 size=604690 2024-04-03T03:45:59.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.430+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=MJT0XGQ18KBR tag=Q4M2I5HQHPQU type=write size=3750418 2024-04-03T03:45:59.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.430+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=70147YRHB1PU type=del size=2951456 2024-04-03T03:45:59.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.434+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~TMZJKL6RHAVV.0 size=1048576 2024-04-03T03:45:59.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.434+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~TMZJKL6RHAVV.1 size=1048576 2024-04-03T03:45:59.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.438+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~TMZJKL6RHAVV.2 size=790828 2024-04-03T03:45:59.439 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.442+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=TMZJKL6RHAVV tag=2YZT4DQDPZ06 type=write size=3936556 2024-04-03T03:45:59.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.446+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~XCFU4DY4V4JQ.0 size=726980 2024-04-03T03:45:59.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.446+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=XCFU4DY4V4JQ tag=10XA750WAV1E type=write size=1775556 2024-04-03T03:45:59.447 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.450+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=7EJ0N5BH5L62 type=del 2024-04-03T03:45:59.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.454+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~TOGKV023P1DJ.0 size=833706 2024-04-03T03:45:59.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.454+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=TOGKV023P1DJ tag=0ZDNR7808FBZ type=write size=1882282 2024-04-03T03:45:59.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.458+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~YS40XQRAYCZM.0 size=339126 2024-04-03T03:45:59.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.462+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=YS40XQRAYCZM tag=GHFXOQ5AR4M6 type=write size=1387702 2024-04-03T03:45:59.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.466+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=QKRHYHX0V2P3 type=del size=1926045 2024-04-03T03:45:59.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.466+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=L8FL2BL48EC8 type=del 2024-04-03T03:45:59.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.470+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=4P4W7C0TC5E6 type=del size=1318867 2024-04-03T03:45:59.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.474+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=9710ZZ4Z3DH9 type=del 2024-04-03T03:45:59.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.478+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~GB91LGH3HVQ9.0 size=1048576 2024-04-03T03:45:59.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.478+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~GB91LGH3HVQ9.1 size=1048576 2024-04-03T03:45:59.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.482+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~GB91LGH3HVQ9.2 size=210608 2024-04-03T03:45:59.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.482+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=GB91LGH3HVQ9 tag=BPD988L07DXR type=write size=3356336 2024-04-03T03:45:59.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.486+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=MV3M1X2NS28U type=del 2024-04-03T03:45:59.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.490+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~HJWLIOSTG3K3.0 size=1035883 2024-04-03T03:45:59.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.490+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=HJWLIOSTG3K3 tag=1U07558QE4EM type=write size=2084459 2024-04-03T03:45:59.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.490+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=QX0PHE5130I1 type=del 2024-04-03T03:45:59.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.494+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~K6HZ7782DRGP.0 size=1048576 2024-04-03T03:45:59.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.498+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~K6HZ7782DRGP.1 size=184732 2024-04-03T03:45:59.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.498+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=K6HZ7782DRGP tag=SMT3WAURR3DD type=write size=2281884 2024-04-03T03:45:59.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.498+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~FCA8QPW2US5R.0 size=1048576 2024-04-03T03:45:59.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.502+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~FCA8QPW2US5R.1 size=1048576 2024-04-03T03:45:59.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.502+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~FCA8QPW2US5R.2 size=392429 2024-04-03T03:45:59.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.506+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=FCA8QPW2US5R tag=LUQ7O154IAKV type=write size=3538157 2024-04-03T03:45:59.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.510+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=IFD4EN40QVKF type=del size=245942 2024-04-03T03:45:59.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.510+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~JJD6JPLDNDWO.0 size=1023000 2024-04-03T03:45:59.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.514+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=JJD6JPLDNDWO tag=RT0DHE3PRCMW type=write size=2071576 2024-04-03T03:45:59.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.522+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~VQ53LSV3AOQ9.0 size=1048576 2024-04-03T03:45:59.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.522+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~VQ53LSV3AOQ9.1 size=411719 2024-04-03T03:45:59.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.522+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=VQ53LSV3AOQ9 tag=6WOBFSYH3YQ5 type=write size=2508871 2024-04-03T03:45:59.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.526+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~W20D8XJ5OJ3V.0 size=1048576 2024-04-03T03:45:59.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.526+0000 7f55269288c0 1 < canceled part key=_multipart_Z42NDVEX1SOL.2~W20D8XJ5OJ3V.1 size=685228 2024-04-03T03:45:59.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.530+0000 7f55269288c0 1 < canceled multipart upload key=Z42NDVEX1SOL upload=W20D8XJ5OJ3V tag=77J28QNMR35A type=write size=2782380 2024-04-03T03:45:59.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.534+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~WIB9CZ1X0VD9.0 size=849964 2024-04-03T03:45:59.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.534+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=WIB9CZ1X0VD9 tag=JFMJVIA7PNCO type=write size=1898540 2024-04-03T03:45:59.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.534+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=OK3JLFZJDIVR type=del 2024-04-03T03:45:59.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.542+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~PJGQF1ZH5JGE.0 size=795215 2024-04-03T03:45:59.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.542+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=PJGQF1ZH5JGE tag=ONRJZRVFO2SB type=write size=1843791 2024-04-03T03:45:59.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.542+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=XCUBBIBXXXXV type=del 2024-04-03T03:45:59.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.546+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~6PDTQM0O1163.0 size=624000 2024-04-03T03:45:59.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.546+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=6PDTQM0O1163 tag=QSGCU3V96ZT9 type=write size=1672576 2024-04-03T03:45:59.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.546+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~4ILV788T7EVT.0 size=1048576 2024-04-03T03:45:59.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.550+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~4ILV788T7EVT.1 size=330927 2024-04-03T03:45:59.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.554+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=4ILV788T7EVT tag=JDUMC3LU540N type=write size=2428079 2024-04-03T03:45:59.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.558+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~AI5HQKNH0SAT.0 size=1048576 2024-04-03T03:45:59.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.558+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~AI5HQKNH0SAT.1 size=160841 2024-04-03T03:45:59.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.558+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=AI5HQKNH0SAT tag=7033QITCCVU4 type=write size=2257993 2024-04-03T03:45:59.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.562+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=02EVWVAE9VHD type=del 2024-04-03T03:45:59.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.566+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~ABAONXS9F3FK.0 size=1048576 2024-04-03T03:45:59.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.566+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~ABAONXS9F3FK.1 size=1048576 2024-04-03T03:45:59.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.566+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~ABAONXS9F3FK.2 size=1005923 2024-04-03T03:45:59.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.566+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=ABAONXS9F3FK tag=AOSO1BY614E9 type=write size=4151651 2024-04-03T03:45:59.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.570+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=PHW5PT2GD3MF type=del 2024-04-03T03:45:59.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.570+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=T99TZBQHX4K0 type=del size=3076123 2024-04-03T03:45:59.573 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.578+0000 7f55269288c0 1 < suggested remove operation key=B5BI0HJ5S1Y1 tag=70147YRHB1PU type=del 2024-04-03T03:45:59.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.582+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~44X37LBWL4SR.0 size=1048576 2024-04-03T03:45:59.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.582+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~44X37LBWL4SR.1 size=292995 2024-04-03T03:45:59.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.582+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=44X37LBWL4SR tag=0GWWF39WQT9L type=write size=2390147 2024-04-03T03:45:59.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.586+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~XCFU4DY4V4JQ.0 size=726980 2024-04-03T03:45:59.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.590+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=XCFU4DY4V4JQ tag=10XA750WAV1E type=write size=1775556 2024-04-03T03:45:59.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.590+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=E2A2QSOBBT9D type=del size=61092 2024-04-03T03:45:59.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.594+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~TOGKV023P1DJ.0 size=833706 2024-04-03T03:45:59.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.594+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=TOGKV023P1DJ tag=0ZDNR7808FBZ type=write size=1882282 2024-04-03T03:45:59.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.598+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~7WJO7J2ID379.0 size=1048576 2024-04-03T03:45:59.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.602+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~7WJO7J2ID379.1 size=423366 2024-04-03T03:45:59.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.602+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=7WJO7J2ID379 tag=YO7Q9H63RPE2 type=write size=2520518 2024-04-03T03:45:59.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.606+0000 7f55269288c0 1 < suggested remove operation key=F6IBZ80J4SDM tag=QKRHYHX0V2P3 type=del 2024-04-03T03:45:59.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.610+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~M84XLGALJ8ZU.0 size=621426 2024-04-03T03:45:59.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.610+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=M84XLGALJ8ZU tag=VA9UR5919PVZ type=write size=1670002 2024-04-03T03:45:59.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.610+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=4P4W7C0TC5E6 type=del 2024-04-03T03:45:59.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.614+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=YZR553L4D33R type=del size=499815 2024-04-03T03:45:59.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.618+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~GB91LGH3HVQ9.0 size=1048576 2024-04-03T03:45:59.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.618+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~GB91LGH3HVQ9.1 size=1048576 2024-04-03T03:45:59.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.622+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~GB91LGH3HVQ9.2 size=210608 2024-04-03T03:45:59.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.626+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=GB91LGH3HVQ9 tag=BPD988L07DXR type=write size=3356336 2024-04-03T03:45:59.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.630+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~6ID6EXJ5P8A1.0 size=1048576 2024-04-03T03:45:59.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.630+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~6ID6EXJ5P8A1.1 size=906119 2024-04-03T03:45:59.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.630+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=6ID6EXJ5P8A1 tag=GYRXLLJIW4QU type=write size=3003271 2024-04-03T03:45:59.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.634+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~HJWLIOSTG3K3.0 size=1035883 2024-04-03T03:45:59.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.638+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=HJWLIOSTG3K3 tag=1U07558QE4EM type=write size=2084459 2024-04-03T03:45:59.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.642+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=T3XF4EIEC5NS type=del size=3798000 2024-04-03T03:45:59.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.646+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~K6HZ7782DRGP.0 size=1048576 2024-04-03T03:45:59.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.646+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~K6HZ7782DRGP.1 size=184732 2024-04-03T03:45:59.647 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.650+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=K6HZ7782DRGP tag=SMT3WAURR3DD type=write size=2281884 2024-04-03T03:45:59.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.654+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~1POD13UA3PO1.0 size=1048576 2024-04-03T03:45:59.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.658+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~1POD13UA3PO1.1 size=1048576 2024-04-03T03:45:59.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.658+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~1POD13UA3PO1.2 size=541672 2024-04-03T03:45:59.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.658+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=1POD13UA3PO1 tag=0EC9YYEF6ACO type=write size=3687400 2024-04-03T03:45:59.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.662+0000 7f55269288c0 -1 < failed to complete operation key=B5BI0HJ5S1Y1 tag=IFD4EN40QVKF type=del size=245942: (22) Invalid argument 2024-04-03T03:45:59.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.662+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=YJWEDTX20676 type=del size=1654151 2024-04-03T03:45:59.663 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.666+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~VQ53LSV3AOQ9.0 size=1048576 2024-04-03T03:45:59.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.670+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~VQ53LSV3AOQ9.1 size=411719 2024-04-03T03:45:59.670 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.674+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=VQ53LSV3AOQ9 tag=6WOBFSYH3YQ5 type=write size=2508871 2024-04-03T03:45:59.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.674+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=7I1VD4S1KJE5 type=del size=1012449 2024-04-03T03:45:59.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.678+0000 7f55269288c0 1 < canceled part key=_multipart_X3YCYKP2P9IM.2~WIB9CZ1X0VD9.0 size=849964 2024-04-03T03:45:59.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.682+0000 7f55269288c0 1 < canceled multipart upload key=X3YCYKP2P9IM upload=WIB9CZ1X0VD9 tag=JFMJVIA7PNCO type=write size=1898540 2024-04-03T03:45:59.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.682+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=LR2WILELGTAP type=del size=2971893 2024-04-03T03:45:59.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.686+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~PJGQF1ZH5JGE.0 size=795215 2024-04-03T03:45:59.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.690+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=PJGQF1ZH5JGE tag=ONRJZRVFO2SB type=write size=1843791 2024-04-03T03:45:59.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.694+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=5RGVTS8TL0MM type=del size=3808195 2024-04-03T03:45:59.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.694+0000 7f55269288c0 1 < canceled part key=_multipart_8SBTVHL09P63.2~6PDTQM0O1163.0 size=624000 2024-04-03T03:45:59.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.702+0000 7f55269288c0 1 < canceled multipart upload key=8SBTVHL09P63 upload=6PDTQM0O1163 tag=QSGCU3V96ZT9 type=write size=1672576 2024-04-03T03:45:59.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.706+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=3VQXL291S3R1 type=write size=201292 2024-04-03T03:45:59.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.706+0000 7f55269288c0 1 < canceled part key=_multipart_JAXVD60NI5YW.2~AI5HQKNH0SAT.0 size=1048576 2024-04-03T03:45:59.706 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.710+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~AI5HQKNH0SAT.1 size=160841 2024-04-03T03:45:59.710 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.714+0000 7f55269288c0 1 < canceled multipart upload key=JAXVD60NI5YW upload=AI5HQKNH0SAT tag=7033QITCCVU4 type=write size=2257993 2024-04-03T03:45:59.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.714+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=UN4CJ9X2ACTN type=del size=1158124 2024-04-03T03:45:59.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.718+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~ABAONXS9F3FK.0 size=1048576 2024-04-03T03:45:59.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.718+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~ABAONXS9F3FK.1 size=1048576 2024-04-03T03:45:59.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.722+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~ABAONXS9F3FK.2 size=1005923 2024-04-03T03:45:59.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.726+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=ABAONXS9F3FK tag=AOSO1BY614E9 type=write size=4151651 2024-04-03T03:45:59.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.730+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=UHZ9J13SLCQJ type=del size=1710372 2024-04-03T03:45:59.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.734+0000 7f55269288c0 1 < suggested remove operation key=K7A1O21ZURWQ tag=T99TZBQHX4K0 type=del 2024-04-03T03:45:59.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.738+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=QMAE9OU2JMA2 type=del size=3568406 2024-04-03T03:45:59.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.738+0000 7f55269288c0 1 < canceled part key=_multipart_JAXVD60NI5YW.2~44X37LBWL4SR.0 size=1048576 2024-04-03T03:45:59.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.738+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~44X37LBWL4SR.1 size=292995 2024-04-03T03:45:59.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.742+0000 7f55269288c0 1 < canceled multipart upload key=JAXVD60NI5YW upload=44X37LBWL4SR tag=0GWWF39WQT9L type=write size=2390147 2024-04-03T03:45:59.742 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.746+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=DWQPHT5ZQIDP type=del size=2656713 2024-04-03T03:45:59.744 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.746+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=E2A2QSOBBT9D type=del 2024-04-03T03:45:59.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.750+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=2MDJPMS4H8VO type=del size=2427491 2024-04-03T03:45:59.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.754+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~7WJO7J2ID379.0 size=1048576 2024-04-03T03:45:59.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.754+0000 7f55269288c0 1 < canceled part key=_multipart_LZQGL2UAWOTU.2~7WJO7J2ID379.1 size=423366 2024-04-03T03:45:59.752 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.754+0000 7f55269288c0 1 < canceled multipart upload key=LZQGL2UAWOTU upload=7WJO7J2ID379 tag=YO7Q9H63RPE2 type=write size=2520518 2024-04-03T03:45:59.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.758+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=7ZLJ26XKXPXR type=del size=3689317 2024-04-03T03:45:59.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.762+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~M84XLGALJ8ZU.0 size=621426 2024-04-03T03:45:59.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.762+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=M84XLGALJ8ZU tag=VA9UR5919PVZ type=write size=1670002 2024-04-03T03:45:59.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.766+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~O6EI51A887F1.0 size=1048576 2024-04-03T03:45:59.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.770+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~O6EI51A887F1.1 size=917329 2024-04-03T03:45:59.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.770+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=O6EI51A887F1 tag=66EP6NTCMCCX type=write size=3014481 2024-04-03T03:45:59.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.770+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=YZR553L4D33R type=del 2024-04-03T03:45:59.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.774+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=KAUBL0A953Z8 type=del size=2381226 2024-04-03T03:45:59.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.774+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~6ID6EXJ5P8A1.0 size=1048576 2024-04-03T03:45:59.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.778+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~6ID6EXJ5P8A1.1 size=906119 2024-04-03T03:45:59.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.782+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=6ID6EXJ5P8A1 tag=GYRXLLJIW4QU type=write size=3003271 2024-04-03T03:45:59.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.786+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~XZEC7MDG8376.0 size=1048576 2024-04-03T03:45:59.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.786+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~XZEC7MDG8376.1 size=592454 2024-04-03T03:45:59.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.786+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=XZEC7MDG8376 tag=7IJZWQWTK70M type=write size=2689606 2024-04-03T03:45:59.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.790+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=T3XF4EIEC5NS type=del 2024-04-03T03:45:59.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.794+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~ZTW1HN8RBWM2.0 size=42842 2024-04-03T03:45:59.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.794+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=ZTW1HN8RBWM2 tag=4VYH6W5D4KZG type=write size=1091418 2024-04-03T03:45:59.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.794+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~1POD13UA3PO1.0 size=1048576 2024-04-03T03:45:59.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.798+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~1POD13UA3PO1.1 size=1048576 2024-04-03T03:45:59.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.798+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~1POD13UA3PO1.2 size=541672 2024-04-03T03:45:59.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.802+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=1POD13UA3PO1 tag=0EC9YYEF6ACO type=write size=3687400 2024-04-03T03:45:59.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.806+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~HTIHTDXTA4Y7.0 size=1048576 2024-04-03T03:45:59.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.806+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~HTIHTDXTA4Y7.1 size=1048576 2024-04-03T03:45:59.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.810+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~HTIHTDXTA4Y7.2 size=990870 2024-04-03T03:45:59.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.810+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=HTIHTDXTA4Y7 tag=LJYYOLKA6ZIC type=write size=4136598 2024-04-03T03:45:59.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.810+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=YJWEDTX20676 type=del 2024-04-03T03:45:59.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.814+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=20MRSXL5YEQE type=del size=65521 2024-04-03T03:45:59.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.818+0000 7f55269288c0 1 < canceled operation key=XFCPX90N2NYC tag=7I1VD4S1KJE5 type=del size=1012449 2024-04-03T03:45:59.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.822+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~L8UP98I3TWSH.0 size=1048576 2024-04-03T03:45:59.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.822+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~L8UP98I3TWSH.1 size=774742 2024-04-03T03:45:59.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.822+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=L8UP98I3TWSH tag=YYEINU2SYL57 type=write size=2871894 2024-04-03T03:45:59.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.822+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=LR2WILELGTAP type=del 2024-04-03T03:45:59.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.826+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=8G58RQO680WE type=del size=1076351 2024-04-03T03:45:59.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.830+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=5RGVTS8TL0MM type=del 2024-04-03T03:45:59.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.830+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=OIMQ9ZVPY55G type=del size=2222983 2024-04-03T03:45:59.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.834+0000 7f55269288c0 1 < completed write operation key=D9OEPPT37WSJ tag=3VQXL291S3R1 type=write size=201292 2024-04-03T03:45:59.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.834+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=KMIUURKRIW27 type=del size=3661016 2024-04-03T03:45:59.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.838+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=UN4CJ9X2ACTN type=del 2024-04-03T03:45:59.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.842+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=E83XDWV65R6Y type=write size=628774 2024-04-03T03:45:59.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.842+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=UHZ9J13SLCQJ type=del 2024-04-03T03:45:59.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.846+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=EFAOPJDLZR24 type=write size=664825 2024-04-03T03:45:59.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.846+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=QMAE9OU2JMA2 type=del 2024-04-03T03:45:59.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.850+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=AKMUOHHST9FV type=write size=508151 2024-04-03T03:45:59.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.854+0000 7f55269288c0 1 < suggested remove operation key=SFN1M3HPGT18 tag=DWQPHT5ZQIDP type=del 2024-04-03T03:45:59.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.858+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~K48BZA23940B.0 size=1048576 2024-04-03T03:45:59.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.862+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~K48BZA23940B.1 size=1048576 2024-04-03T03:45:59.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.862+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~K48BZA23940B.2 size=1003674 2024-04-03T03:45:59.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.862+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=K48BZA23940B tag=11XP3BWI0926 type=write size=4149402 2024-04-03T03:45:59.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.866+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=2MDJPMS4H8VO type=del 2024-04-03T03:45:59.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.870+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=L8WDQO6KKGIT type=del size=1104153 2024-04-03T03:45:59.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.870+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=7ZLJ26XKXPXR type=del 2024-04-03T03:45:59.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.874+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=OTIM5S1EFDRK type=del size=716195 2024-04-03T03:45:59.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.874+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~O6EI51A887F1.0 size=1048576 2024-04-03T03:45:59.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.878+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~O6EI51A887F1.1 size=917329 2024-04-03T03:45:59.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.882+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=O6EI51A887F1 tag=66EP6NTCMCCX type=write size=3014481 2024-04-03T03:45:59.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.886+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~NZS0BFK0KDJD.0 size=1048576 2024-04-03T03:45:59.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.886+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~NZS0BFK0KDJD.1 size=1048576 2024-04-03T03:45:59.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.890+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~NZS0BFK0KDJD.2 size=259661 2024-04-03T03:45:59.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.890+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=NZS0BFK0KDJD tag=KZQNA87KY27V type=write size=3405389 2024-04-03T03:45:59.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.890+0000 7f55269288c0 1 < canceled operation key=D8W2ZKIZFI8H tag=KAUBL0A953Z8 type=del size=2381226 2024-04-03T03:45:59.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.894+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=F4HTR0M9LAN1 type=write size=143149 2024-04-03T03:45:59.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.894+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~XZEC7MDG8376.0 size=1048576 2024-04-03T03:45:59.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.898+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~XZEC7MDG8376.1 size=592454 2024-04-03T03:45:59.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.902+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=XZEC7MDG8376 tag=7IJZWQWTK70M type=write size=2689606 2024-04-03T03:45:59.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.906+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~I34B6L50O2YN.0 size=1043072 2024-04-03T03:45:59.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.906+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=I34B6L50O2YN tag=TZT83SP459B4 type=write size=2091648 2024-04-03T03:45:59.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.906+0000 7f55269288c0 1 < canceled part key=_multipart_TXFMKXUGMEA8.2~ZTW1HN8RBWM2.0 size=42842 2024-04-03T03:45:59.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.906+0000 7f55269288c0 1 < canceled multipart upload key=TXFMKXUGMEA8 upload=ZTW1HN8RBWM2 tag=4VYH6W5D4KZG type=write size=1091418 2024-04-03T03:45:59.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.910+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~A6CR98BQDUIM.0 size=1048576 2024-04-03T03:45:59.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.914+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~A6CR98BQDUIM.1 size=1048576 2024-04-03T03:45:59.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.914+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~A6CR98BQDUIM.2 size=608679 2024-04-03T03:45:59.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.914+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=A6CR98BQDUIM tag=2XB1Q2ZG3HEB type=write size=3754407 2024-04-03T03:45:59.913 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.918+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~HTIHTDXTA4Y7.0 size=1048576 2024-04-03T03:45:59.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.918+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~HTIHTDXTA4Y7.1 size=1048576 2024-04-03T03:45:59.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.918+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~HTIHTDXTA4Y7.2 size=990870 2024-04-03T03:45:59.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.922+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=HTIHTDXTA4Y7 tag=LJYYOLKA6ZIC type=write size=4136598 2024-04-03T03:45:59.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.926+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~RVV601XHAJS5.0 size=166623 2024-04-03T03:45:59.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.926+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=RVV601XHAJS5 tag=ZC30ZN1W6VEP type=write size=1215199 2024-04-03T03:45:59.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.930+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=20MRSXL5YEQE type=del 2024-04-03T03:45:59.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.934+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~H55PZ58K85TJ.0 size=1048576 2024-04-03T03:45:59.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.938+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~H55PZ58K85TJ.1 size=439874 2024-04-03T03:45:59.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.938+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=H55PZ58K85TJ tag=IS46GXCE8HTK type=write size=2537026 2024-04-03T03:45:59.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.938+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~L8UP98I3TWSH.0 size=1048576 2024-04-03T03:45:59.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.942+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~L8UP98I3TWSH.1 size=774742 2024-04-03T03:45:59.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.942+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=L8UP98I3TWSH tag=YYEINU2SYL57 type=write size=2871894 2024-04-03T03:45:59.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.946+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=WN9EJ9CLRXHU type=del size=1152485 2024-04-03T03:45:59.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.950+0000 7f55269288c0 1 < suggested update operation key=AXL5RVPSVDY5 tag=8G58RQO680WE type=del size=1076351 2024-04-03T03:45:59.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.954+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~6PPQUYJDL9BV.0 size=748627 2024-04-03T03:45:59.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.954+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=6PPQUYJDL9BV tag=HSTFQ7GG78G0 type=write size=1797203 2024-04-03T03:45:59.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.958+0000 7f55269288c0 -1 < failed to complete operation key=AXL5RVPSVDY5 tag=OIMQ9ZVPY55G type=del size=2222983: (22) Invalid argument 2024-04-03T03:45:59.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.958+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=8Z377E3929VP type=del size=2852457 2024-04-03T03:45:59.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.962+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=KMIUURKRIW27 type=del 2024-04-03T03:45:59.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.966+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~B84OE22QEX48.0 size=1048576 2024-04-03T03:45:59.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.970+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~B84OE22QEX48.1 size=1048576 2024-04-03T03:45:59.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.970+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~B84OE22QEX48.2 size=113908 2024-04-03T03:45:59.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.970+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=B84OE22QEX48 tag=NAPAZAYWZQTB type=write size=3259636 2024-04-03T03:45:59.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.974+0000 7f55269288c0 1 < suggested update operation key=K3Z9W19WEJBM tag=E83XDWV65R6Y type=write size=628774 2024-04-03T03:45:59.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.974+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=LWFUF0K0CINS type=del size=1097523 2024-04-03T03:45:59.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.978+0000 7f55269288c0 1 < suggested remove operation key=B5BI0HJ5S1Y1 tag=EFAOPJDLZR24 type=write 2024-04-03T03:45:59.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.982+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=8IGV6J4YY745 type=del size=176524 2024-04-03T03:45:59.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.982+0000 7f55269288c0 1 < completed write operation key=3XKXK1JXKOHU tag=AKMUOHHST9FV type=write size=508151 2024-04-03T03:45:59.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.986+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=25IDN5R7D2RG type=del size=641366 2024-04-03T03:45:59.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.990+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~K48BZA23940B.0 size=1048576 2024-04-03T03:45:59.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.990+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~K48BZA23940B.1 size=1048576 2024-04-03T03:45:59.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.990+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~K48BZA23940B.2 size=1003674 2024-04-03T03:45:59.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:45:59.998+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=K48BZA23940B tag=11XP3BWI0926 type=write size=4149402 2024-04-03T03:46:00.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.006+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=2O811CX33FPS type=del size=2753760 2024-04-03T03:46:00.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.010+0000 7f55269288c0 1 < canceled operation key=LZQGL2UAWOTU tag=L8WDQO6KKGIT type=del size=1104153 2024-04-03T03:46:00.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.014+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~JD71UQFJE2VK.0 size=972255 2024-04-03T03:46:00.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.014+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=JD71UQFJE2VK tag=I1LSD1X5B574 type=write size=2020831 2024-04-03T03:46:00.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.014+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=OTIM5S1EFDRK type=del 2024-04-03T03:46:00.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.018+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~FZ81ADD62A4A.0 size=1048576 2024-04-03T03:46:00.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.018+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~FZ81ADD62A4A.1 size=1048576 2024-04-03T03:46:00.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.022+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~FZ81ADD62A4A.2 size=256150 2024-04-03T03:46:00.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.022+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=FZ81ADD62A4A tag=81LP7D2V8LWZ type=write size=3401878 2024-04-03T03:46:00.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.022+0000 7f55269288c0 1 < canceled part key=_multipart_6KH6TASZS3UG.2~NZS0BFK0KDJD.0 size=1048576 2024-04-03T03:46:00.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.022+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~NZS0BFK0KDJD.1 size=1048576 2024-04-03T03:46:00.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.022+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~NZS0BFK0KDJD.2 size=259661 2024-04-03T03:46:00.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.026+0000 7f55269288c0 1 < canceled multipart upload key=6KH6TASZS3UG upload=NZS0BFK0KDJD tag=KZQNA87KY27V type=write size=3405389 2024-04-03T03:46:00.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.026+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=KJ1XSH392Z1Q type=del size=457264 2024-04-03T03:46:00.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.030+0000 7f55269288c0 1 < completed write operation key=U62RSK21LJEF tag=F4HTR0M9LAN1 type=write size=143149 2024-04-03T03:46:00.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.030+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=K0J651EEJIAB type=del size=20095 2024-04-03T03:46:00.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.034+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~I34B6L50O2YN.0 size=1043072 2024-04-03T03:46:00.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.034+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=I34B6L50O2YN tag=TZT83SP459B4 type=write size=2091648 2024-04-03T03:46:00.033 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.038+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=UU23YQZZ6OIU type=del size=1541686 2024-04-03T03:46:00.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.038+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~A6CR98BQDUIM.0 size=1048576 2024-04-03T03:46:00.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.038+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~A6CR98BQDUIM.1 size=1048576 2024-04-03T03:46:00.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.042+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~A6CR98BQDUIM.2 size=608679 2024-04-03T03:46:00.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.042+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=A6CR98BQDUIM tag=2XB1Q2ZG3HEB type=write size=3754407 2024-04-03T03:46:00.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.046+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=4XUOB47K2BZB type=del size=1725378 2024-04-03T03:46:00.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.046+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~RVV601XHAJS5.0 size=166623 2024-04-03T03:46:00.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.050+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=RVV601XHAJS5 tag=ZC30ZN1W6VEP type=write size=1215199 2024-04-03T03:46:00.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.050+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~25JNHLLL5IWI.0 size=1048576 2024-04-03T03:46:00.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.054+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~25JNHLLL5IWI.1 size=752501 2024-04-03T03:46:00.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.054+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=25JNHLLL5IWI tag=1HWE1SWGMJLY type=write size=2849653 2024-04-03T03:46:00.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.054+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~H55PZ58K85TJ.0 size=1048576 2024-04-03T03:46:00.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.054+0000 7f55269288c0 1 < canceled part key=_multipart_YCEKDT5EQD9D.2~H55PZ58K85TJ.1 size=439874 2024-04-03T03:46:00.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.058+0000 7f55269288c0 1 < canceled multipart upload key=YCEKDT5EQD9D upload=H55PZ58K85TJ tag=IS46GXCE8HTK type=write size=2537026 2024-04-03T03:46:00.058 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.062+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~MIQWE6HXVHMH.0 size=1048576 2024-04-03T03:46:00.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.062+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~MIQWE6HXVHMH.1 size=1048576 2024-04-03T03:46:00.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.066+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~MIQWE6HXVHMH.2 size=317010 2024-04-03T03:46:00.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.066+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=MIQWE6HXVHMH tag=DEZE7BXH8EYB type=write size=3462738 2024-04-03T03:46:00.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.066+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=WN9EJ9CLRXHU type=del 2024-04-03T03:46:00.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.066+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=8ZSUJ0E9EID2 type=del size=1900947 2024-04-03T03:46:00.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.070+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~6PPQUYJDL9BV.0 size=748627 2024-04-03T03:46:00.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.070+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=6PPQUYJDL9BV tag=HSTFQ7GG78G0 type=write size=1797203 2024-04-03T03:46:00.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.074+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=839M7SKQ99MW type=del size=2000466 2024-04-03T03:46:00.072 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.074+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=8Z377E3929VP type=del 2024-04-03T03:46:00.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.078+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=JWLH9WPCDMMU type=del size=1926103 2024-04-03T03:46:00.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.078+0000 7f55269288c0 1 < canceled part key=_multipart_Z42NDVEX1SOL.2~B84OE22QEX48.0 size=1048576 2024-04-03T03:46:00.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.078+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~B84OE22QEX48.1 size=1048576 2024-04-03T03:46:00.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.078+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~B84OE22QEX48.2 size=113908 2024-04-03T03:46:00.079 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.082+0000 7f55269288c0 1 < canceled multipart upload key=Z42NDVEX1SOL upload=B84OE22QEX48 tag=NAPAZAYWZQTB type=write size=3259636 2024-04-03T03:46:00.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.086+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~CIVP9YAJ9D2G.0 size=1048576 2024-04-03T03:46:00.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.086+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~CIVP9YAJ9D2G.1 size=1048576 2024-04-03T03:46:00.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.090+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~CIVP9YAJ9D2G.2 size=790245 2024-04-03T03:46:00.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.090+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=CIVP9YAJ9D2G tag=8WHG1KLDWP6U type=write size=3935973 2024-04-03T03:46:00.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.090+0000 7f55269288c0 1 < canceled operation key=Z42NDVEX1SOL tag=LWFUF0K0CINS type=del size=1097523 2024-04-03T03:46:00.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.094+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~UHG6EY2S3OGG.0 size=358731 2024-04-03T03:46:00.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.094+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=UHG6EY2S3OGG tag=1GAV9635CDZ8 type=write size=1407307 2024-04-03T03:46:00.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.098+0000 7f55269288c0 1 < suggested remove operation key=X3YCYKP2P9IM tag=8IGV6J4YY745 type=del 2024-04-03T03:46:00.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.098+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=XJQUYS42XZPZ type=del size=312150 2024-04-03T03:46:00.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.102+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=25IDN5R7D2RG type=del 2024-04-03T03:46:00.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.102+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~MO0A8UHLKWLL.0 size=1048576 2024-04-03T03:46:00.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.106+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~MO0A8UHLKWLL.1 size=697025 2024-04-03T03:46:00.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.106+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=MO0A8UHLKWLL tag=8KW29RA7PSY8 type=write size=2794177 2024-04-03T03:46:00.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.106+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=2O811CX33FPS type=del 2024-04-03T03:46:00.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.106+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=BL1DVINK1FDK type=del size=1430336 2024-04-03T03:46:00.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.110+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~JD71UQFJE2VK.0 size=972255 2024-04-03T03:46:00.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.110+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=JD71UQFJE2VK tag=I1LSD1X5B574 type=write size=2020831 2024-04-03T03:46:00.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.114+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=YC9SM8LQOJA0 type=del size=472361 2024-04-03T03:46:00.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.114+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~FZ81ADD62A4A.0 size=1048576 2024-04-03T03:46:00.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.114+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~FZ81ADD62A4A.1 size=1048576 2024-04-03T03:46:00.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.118+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~FZ81ADD62A4A.2 size=256150 2024-04-03T03:46:00.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.118+0000 7f55269288c0 1 < canceled multipart upload key=0OSIL0R5ZJ54 upload=FZ81ADD62A4A tag=81LP7D2V8LWZ type=write size=3401878 2024-04-03T03:46:00.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.122+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=7FDF53GUZTA6 type=del size=1856081 2024-04-03T03:46:00.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.122+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=KJ1XSH392Z1Q type=del 2024-04-03T03:46:00.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.122+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=PKHS4Q74UNOA type=del size=418392 2024-04-03T03:46:00.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.126+0000 7f55269288c0 1 < suggested remove operation key=SFN1M3HPGT18 tag=K0J651EEJIAB type=del 2024-04-03T03:46:00.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.130+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~ISMPAIUAQMOK.0 size=1048576 2024-04-03T03:46:00.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.130+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~ISMPAIUAQMOK.1 size=1048576 2024-04-03T03:46:00.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.134+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~ISMPAIUAQMOK.2 size=1036917 2024-04-03T03:46:00.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.134+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=ISMPAIUAQMOK tag=Z0NB533OGXAL type=write size=4182645 2024-04-03T03:46:00.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.134+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=UU23YQZZ6OIU type=del 2024-04-03T03:46:00.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.134+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=8OGGAJ4N3F9P type=del size=2824243 2024-04-03T03:46:00.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.138+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=4XUOB47K2BZB type=del 2024-04-03T03:46:00.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.138+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=5YCOV3C3B76T type=del size=3961056 2024-04-03T03:46:00.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.142+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~25JNHLLL5IWI.0 size=1048576 2024-04-03T03:46:00.138 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.142+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~25JNHLLL5IWI.1 size=752501 2024-04-03T03:46:00.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.146+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=25JNHLLL5IWI tag=1HWE1SWGMJLY type=write size=2849653 2024-04-03T03:46:00.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.146+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=J7CQ5UR6WHHR type=del size=3287343 2024-04-03T03:46:00.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.150+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~MIQWE6HXVHMH.0 size=1048576 2024-04-03T03:46:00.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.150+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~MIQWE6HXVHMH.1 size=1048576 2024-04-03T03:46:00.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.150+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~MIQWE6HXVHMH.2 size=317010 2024-04-03T03:46:00.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.154+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=MIQWE6HXVHMH tag=DEZE7BXH8EYB type=write size=3462738 2024-04-03T03:46:00.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.154+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=5GTX83D1FGSX type=write size=1037981 2024-04-03T03:46:00.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.158+0000 7f55269288c0 1 < suggested update operation key=LZQGL2UAWOTU tag=8ZSUJ0E9EID2 type=del size=1900947 2024-04-03T03:46:00.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.162+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~HF9NXKUX0JWG.0 size=1048576 2024-04-03T03:46:00.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.162+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~HF9NXKUX0JWG.1 size=1001832 2024-04-03T03:46:00.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.162+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=HF9NXKUX0JWG tag=HG6URI2S06RH type=write size=3098984 2024-04-03T03:46:00.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.166+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=839M7SKQ99MW type=del 2024-04-03T03:46:00.165 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.170+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~UBXIIKQGL5W3.0 size=1048576 2024-04-03T03:46:00.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.170+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~UBXIIKQGL5W3.1 size=1048576 2024-04-03T03:46:00.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.170+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~UBXIIKQGL5W3.2 size=821806 2024-04-03T03:46:00.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.170+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=UBXIIKQGL5W3 tag=UNOFR0W8SYOH type=write size=3967534 2024-04-03T03:46:00.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.174+0000 7f55269288c0 -1 < no bi entry to suggest for operation key=X3YCYKP2P9IM tag=JWLH9WPCDMMU type=del size=1926103: (2) No such file or directory 2024-04-03T03:46:00.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.174+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~4DZZY8AW7SXW.0 size=1048576 2024-04-03T03:46:00.173 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.178+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~4DZZY8AW7SXW.1 size=1048576 2024-04-03T03:46:00.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.178+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~4DZZY8AW7SXW.2 size=865075 2024-04-03T03:46:00.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.178+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=4DZZY8AW7SXW tag=IXQIXCGASGA8 type=write size=4010803 2024-04-03T03:46:00.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.178+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~CIVP9YAJ9D2G.0 size=1048576 2024-04-03T03:46:00.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.182+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~CIVP9YAJ9D2G.1 size=1048576 2024-04-03T03:46:00.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.186+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~CIVP9YAJ9D2G.2 size=790245 2024-04-03T03:46:00.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.186+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=CIVP9YAJ9D2G tag=8WHG1KLDWP6U type=write size=3935973 2024-04-03T03:46:00.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.190+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=M66UFK3BOPN2 type=write size=413753 2024-04-03T03:46:00.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.190+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~UHG6EY2S3OGG.0 size=358731 2024-04-03T03:46:00.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.194+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=UHG6EY2S3OGG tag=1GAV9635CDZ8 type=write size=1407307 2024-04-03T03:46:00.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.198+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~1NMPYQTLL30M.0 size=1048576 2024-04-03T03:46:00.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.202+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~1NMPYQTLL30M.1 size=334290 2024-04-03T03:46:00.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.202+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=1NMPYQTLL30M tag=90JVIB31WGBJ type=write size=2431442 2024-04-03T03:46:00.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.202+0000 7f55269288c0 1 < canceled operation key=U62RSK21LJEF tag=XJQUYS42XZPZ type=del size=312150 2024-04-03T03:46:00.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.206+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~PL6RDIFAWSR8.0 size=942862 2024-04-03T03:46:00.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.206+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=PL6RDIFAWSR8 tag=0W22J1JIANVZ type=write size=1991438 2024-04-03T03:46:00.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.206+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~MO0A8UHLKWLL.0 size=1048576 2024-04-03T03:46:00.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.210+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~MO0A8UHLKWLL.1 size=697025 2024-04-03T03:46:00.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.210+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=MO0A8UHLKWLL tag=8KW29RA7PSY8 type=write size=2794177 2024-04-03T03:46:00.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.214+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=X7GAZZF8KQ7D type=del size=2904515 2024-04-03T03:46:00.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.214+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=BL1DVINK1FDK type=del 2024-04-03T03:46:00.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.218+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~VUAZ6OZ9BYCV.0 size=1048576 2024-04-03T03:46:00.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.222+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~VUAZ6OZ9BYCV.1 size=8160 2024-04-03T03:46:00.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.222+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=VUAZ6OZ9BYCV tag=54SBDY5XOS7H type=write size=2105312 2024-04-03T03:46:00.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.222+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=YC9SM8LQOJA0 type=del 2024-04-03T03:46:00.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.222+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=7JXCJTU0SYFY type=del size=3992375 2024-04-03T03:46:00.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.226+0000 7f55269288c0 1 < completed delete operation key=K3Z9W19WEJBM tag=7FDF53GUZTA6 type=del 2024-04-03T03:46:00.223 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.226+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=XGR80TW0OWF3 type=del size=686928 2024-04-03T03:46:00.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.230+0000 7f55269288c0 1 < suggested remove operation key=7POFUQ9CX6B1 tag=PKHS4Q74UNOA type=del 2024-04-03T03:46:00.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.230+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=5S91ECRQ2WC6 type=del size=1700926 2024-04-03T03:46:00.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.234+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~ISMPAIUAQMOK.0 size=1048576 2024-04-03T03:46:00.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.234+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~ISMPAIUAQMOK.1 size=1048576 2024-04-03T03:46:00.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.238+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~ISMPAIUAQMOK.2 size=1036917 2024-04-03T03:46:00.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.238+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=ISMPAIUAQMOK tag=Z0NB533OGXAL type=write size=4182645 2024-04-03T03:46:00.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.242+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=QNQGCKCFD8BB type=del size=2944752 2024-04-03T03:46:00.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.242+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=8OGGAJ4N3F9P type=del 2024-04-03T03:46:00.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.246+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=YBKTWVCJ7B2S type=del size=2653825 2024-04-03T03:46:00.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.246+0000 7f55269288c0 -1 < failed to complete operation key=7POFUQ9CX6B1 tag=5YCOV3C3B76T type=del size=3961056: (22) Invalid argument 2024-04-03T03:46:00.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.250+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~MGQZ88HZ0NPK.0 size=1048576 2024-04-03T03:46:00.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.250+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~MGQZ88HZ0NPK.1 size=551423 2024-04-03T03:46:00.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.250+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=MGQZ88HZ0NPK tag=J11EM6O6250S type=write size=2648575 2024-04-03T03:46:00.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.254+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=J7CQ5UR6WHHR type=del 2024-04-03T03:46:00.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.254+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=BXW43QRQHBXQ type=del size=1692708 2024-04-03T03:46:00.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.258+0000 7f55269288c0 1 < completed write operation key=ZKSA09OSFSYN tag=5GTX83D1FGSX type=write size=1037981 2024-04-03T03:46:00.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.258+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=7T1LUL51U4QL type=del size=2454126 2024-04-03T03:46:00.257 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.262+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~HF9NXKUX0JWG.0 size=1048576 2024-04-03T03:46:00.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.262+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~HF9NXKUX0JWG.1 size=1001832 2024-04-03T03:46:00.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.266+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=HF9NXKUX0JWG tag=HG6URI2S06RH type=write size=3098984 2024-04-03T03:46:00.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.266+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~PU5UMRW5515Y.0 size=1048576 2024-04-03T03:46:00.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.270+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~PU5UMRW5515Y.1 size=625644 2024-04-03T03:46:00.266 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.270+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=PU5UMRW5515Y tag=F7BQDYSDMTD6 type=write size=2722796 2024-04-03T03:46:00.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.270+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~UBXIIKQGL5W3.0 size=1048576 2024-04-03T03:46:00.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.270+0000 7f55269288c0 1 < canceled part key=_multipart_B5BI0HJ5S1Y1.2~UBXIIKQGL5W3.1 size=1048576 2024-04-03T03:46:00.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.270+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~UBXIIKQGL5W3.2 size=821806 2024-04-03T03:46:00.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.274+0000 7f55269288c0 1 < canceled multipart upload key=B5BI0HJ5S1Y1 upload=UBXIIKQGL5W3 tag=UNOFR0W8SYOH type=write size=3967534 2024-04-03T03:46:00.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.278+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=2YAFHHZQZSPM type=del size=3863793 2024-04-03T03:46:00.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.278+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~4DZZY8AW7SXW.0 size=1048576 2024-04-03T03:46:00.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.278+0000 7f55269288c0 1 < canceled part key=_multipart_TW860A14J9RC.2~4DZZY8AW7SXW.1 size=1048576 2024-04-03T03:46:00.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.282+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~4DZZY8AW7SXW.2 size=865075 2024-04-03T03:46:00.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.282+0000 7f55269288c0 1 < canceled multipart upload key=TW860A14J9RC upload=4DZZY8AW7SXW tag=IXQIXCGASGA8 type=write size=4010803 2024-04-03T03:46:00.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.286+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~P6Y0B1P5G4BX.0 size=1048576 2024-04-03T03:46:00.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.290+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~P6Y0B1P5G4BX.1 size=1048576 2024-04-03T03:46:00.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.290+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~P6Y0B1P5G4BX.2 size=615319 2024-04-03T03:46:00.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.290+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=P6Y0B1P5G4BX tag=MAF8KKJHMVQ3 type=write size=3761047 2024-04-03T03:46:00.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.294+0000 7f55269288c0 1 < completed write operation key=K3Z9W19WEJBM tag=M66UFK3BOPN2 type=write size=413753 2024-04-03T03:46:00.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.294+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=WWG57E15H0LV type=del size=3312760 2024-04-03T03:46:00.293 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.298+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~1NMPYQTLL30M.0 size=1048576 2024-04-03T03:46:00.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.298+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~1NMPYQTLL30M.1 size=334290 2024-04-03T03:46:00.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.302+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=1NMPYQTLL30M tag=90JVIB31WGBJ type=write size=2431442 2024-04-03T03:46:00.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.302+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=JH50VWH2UY46 type=write size=214139 2024-04-03T03:46:00.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.306+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~PL6RDIFAWSR8.0 size=942862 2024-04-03T03:46:00.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.310+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=PL6RDIFAWSR8 tag=0W22J1JIANVZ type=write size=1991438 2024-04-03T03:46:00.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.310+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=V86D73N6RDT2 type=del size=3606842 2024-04-03T03:46:00.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.314+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=X7GAZZF8KQ7D type=del 2024-04-03T03:46:00.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.314+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=GKRGHLFK57WI type=del size=3915072 2024-04-03T03:46:00.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.318+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~VUAZ6OZ9BYCV.0 size=1048576 2024-04-03T03:46:00.316 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.318+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~VUAZ6OZ9BYCV.1 size=8160 2024-04-03T03:46:00.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.322+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=VUAZ6OZ9BYCV tag=54SBDY5XOS7H type=write size=2105312 2024-04-03T03:46:00.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.326+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=DCSD7FOXFWP6 type=del size=417148 2024-04-03T03:46:00.326 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.330+0000 7f55269288c0 1 < suggested remove operation key=X3YCYKP2P9IM tag=7JXCJTU0SYFY type=del 2024-04-03T03:46:00.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.330+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=8H8G27J6B0UH type=del size=2154930 2024-04-03T03:46:00.332 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.334+0000 7f55269288c0 1 < suggested update operation key=K3Z9W19WEJBM tag=XGR80TW0OWF3 type=del size=686928 2024-04-03T03:46:00.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.338+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~TFXS31ONZI83.0 size=1048576 2024-04-03T03:46:00.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.342+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~TFXS31ONZI83.1 size=336651 2024-04-03T03:46:00.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.342+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=TFXS31ONZI83 tag=EC6TI36OQPDZ type=write size=2433803 2024-04-03T03:46:00.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.342+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=5S91ECRQ2WC6 type=del 2024-04-03T03:46:00.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.346+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~9KDR3106XCS6.0 size=535948 2024-04-03T03:46:00.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.346+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=9KDR3106XCS6 tag=0FRB2F6FEX1G type=write size=1584524 2024-04-03T03:46:00.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.350+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=QNQGCKCFD8BB type=del 2024-04-03T03:46:00.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.350+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=2USGJC7X5S25 type=del size=2586610 2024-04-03T03:46:00.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.354+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=YBKTWVCJ7B2S type=del 2024-04-03T03:46:00.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.358+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=21W0GHM2J0YL type=write size=733396 2024-04-03T03:46:00.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.358+0000 7f55269288c0 1 < canceled part key=_multipart_7POFUQ9CX6B1.2~MGQZ88HZ0NPK.0 size=1048576 2024-04-03T03:46:00.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.358+0000 7f55269288c0 1 < canceled part key=_multipart_7POFUQ9CX6B1.2~MGQZ88HZ0NPK.1 size=551423 2024-04-03T03:46:00.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.362+0000 7f55269288c0 1 < canceled multipart upload key=7POFUQ9CX6B1 upload=MGQZ88HZ0NPK tag=J11EM6O6250S type=write size=2648575 2024-04-03T03:46:00.359 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.362+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=1W4G88TG9MZ8 type=del size=3995956 2024-04-03T03:46:00.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.366+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=BXW43QRQHBXQ type=del 2024-04-03T03:46:00.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.366+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=IBAB2S2A3QJ2 type=write size=171455 2024-04-03T03:46:00.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.370+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=7T1LUL51U4QL type=del 2024-04-03T03:46:00.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.374+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~7ZHXF80OZZL2.0 size=1048576 2024-04-03T03:46:00.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.378+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~7ZHXF80OZZL2.1 size=122414 2024-04-03T03:46:00.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.378+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=7ZHXF80OZZL2 tag=MXPGQ6XZV3GO type=write size=2219566 2024-04-03T03:46:00.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.378+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~PU5UMRW5515Y.0 size=1048576 2024-04-03T03:46:00.377 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.382+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~PU5UMRW5515Y.1 size=625644 2024-04-03T03:46:00.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.386+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=PU5UMRW5515Y tag=F7BQDYSDMTD6 type=write size=2722796 2024-04-03T03:46:00.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.386+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=69G6C2W4Q923 type=del size=1912948 2024-04-03T03:46:00.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.390+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=2YAFHHZQZSPM type=del 2024-04-03T03:46:00.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.390+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=ZJFD5KQT6RA2 type=del size=3209230 2024-04-03T03:46:00.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.394+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~P6Y0B1P5G4BX.0 size=1048576 2024-04-03T03:46:00.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.394+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~P6Y0B1P5G4BX.1 size=1048576 2024-04-03T03:46:00.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.398+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~P6Y0B1P5G4BX.2 size=615319 2024-04-03T03:46:00.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.402+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=P6Y0B1P5G4BX tag=MAF8KKJHMVQ3 type=write size=3761047 2024-04-03T03:46:00.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.406+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=2Z1FGUGO0RV3 type=del size=1693994 2024-04-03T03:46:00.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.406+0000 7f55269288c0 -1 < failed to complete operation key=K3Z9W19WEJBM tag=WWG57E15H0LV type=del size=3312760: (22) Invalid argument 2024-04-03T03:46:00.406 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.410+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=MAMMPP0O4EEW type=del size=2592954 2024-04-03T03:46:00.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.410+0000 7f55269288c0 1 < completed write operation key=AXL5RVPSVDY5 tag=JH50VWH2UY46 type=write size=214139 2024-04-03T03:46:00.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.414+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=VKJVCMCCR01W type=del size=4011283 2024-04-03T03:46:00.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.418+0000 7f55269288c0 1 < suggested remove operation key=AXL5RVPSVDY5 tag=V86D73N6RDT2 type=del 2024-04-03T03:46:00.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.422+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~NH9I3AYOOLMU.0 size=1048576 2024-04-03T03:46:00.422 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.426+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~NH9I3AYOOLMU.1 size=786953 2024-04-03T03:46:00.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.426+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=NH9I3AYOOLMU tag=68EF7KFSFGX6 type=write size=2884105 2024-04-03T03:46:00.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.430+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=GKRGHLFK57WI type=del 2024-04-03T03:46:00.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.430+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=SILTJ0FAE88S type=del size=491154 2024-04-03T03:46:00.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.438+0000 7f55269288c0 1 < suggested remove operation key=IOHMF3ADC6EU tag=DCSD7FOXFWP6 type=del 2024-04-03T03:46:00.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.442+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~QYNAK6V6GOW1.0 size=1048576 2024-04-03T03:46:00.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.446+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~QYNAK6V6GOW1.1 size=159522 2024-04-03T03:46:00.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.446+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=QYNAK6V6GOW1 tag=7ERBS83GYIQU type=write size=2256674 2024-04-03T03:46:00.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.446+0000 7f55269288c0 1 < canceled operation key=6KH6TASZS3UG tag=8H8G27J6B0UH type=del size=2154930 2024-04-03T03:46:00.446 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.450+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=FIUT6TSJFCOT type=del size=1178555 2024-04-03T03:46:00.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.454+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~TFXS31ONZI83.0 size=1048576 2024-04-03T03:46:00.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.454+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~TFXS31ONZI83.1 size=336651 2024-04-03T03:46:00.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.458+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=TFXS31ONZI83 tag=EC6TI36OQPDZ type=write size=2433803 2024-04-03T03:46:00.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.462+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=VS3CBA9K1HLT type=write size=295860 2024-04-03T03:46:00.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.466+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~9KDR3106XCS6.0 size=535948 2024-04-03T03:46:00.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.470+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=9KDR3106XCS6 tag=0FRB2F6FEX1G type=write size=1584524 2024-04-03T03:46:00.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.474+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=K9NC6C5E6WJ6 type=del size=3647405 2024-04-03T03:46:00.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.478+0000 7f55269288c0 1 < completed delete operation key=K3Z9W19WEJBM tag=2USGJC7X5S25 type=del 2024-04-03T03:46:00.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.478+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=5T7FFCUI5ZNR type=del size=2653252 2024-04-03T03:46:00.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.482+0000 7f55269288c0 1 < canceled operation key=JAXVD60NI5YW tag=21W0GHM2J0YL type=write size=733396 2024-04-03T03:46:00.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.486+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=ZKCUAQ46YNBX type=del size=728707 2024-04-03T03:46:00.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.494+0000 7f55269288c0 1 < suggested remove operation key=LZQGL2UAWOTU tag=1W4G88TG9MZ8 type=del 2024-04-03T03:46:00.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.494+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=M66WCUC56RIF type=write size=331062 2024-04-03T03:46:00.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.498+0000 7f55269288c0 1 < canceled operation key=K3Z9W19WEJBM tag=IBAB2S2A3QJ2 type=write size=171455 2024-04-03T03:46:00.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.502+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~PNXYY717IDH4.0 size=1048576 2024-04-03T03:46:00.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.506+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~PNXYY717IDH4.1 size=836431 2024-04-03T03:46:00.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.506+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=PNXYY717IDH4 tag=XFWC7CO2B06N type=write size=2933583 2024-04-03T03:46:00.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.510+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~7ZHXF80OZZL2.0 size=1048576 2024-04-03T03:46:00.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.510+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~7ZHXF80OZZL2.1 size=122414 2024-04-03T03:46:00.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.514+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=7ZHXF80OZZL2 tag=MXPGQ6XZV3GO type=write size=2219566 2024-04-03T03:46:00.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.518+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=LEAIEQ7ZMCTK type=write size=408937 2024-04-03T03:46:00.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.522+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=69G6C2W4Q923 type=del 2024-04-03T03:46:00.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.526+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~NSGZNHVO260U.0 size=860119 2024-04-03T03:46:00.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.526+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=NSGZNHVO260U tag=PE291OX1IHMQ type=write size=1908695 2024-04-03T03:46:00.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.530+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=ZJFD5KQT6RA2 type=del 2024-04-03T03:46:00.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.534+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~GCMGF0YOC7IF.0 size=1048576 2024-04-03T03:46:00.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.534+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~GCMGF0YOC7IF.1 size=1048576 2024-04-03T03:46:00.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.538+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~GCMGF0YOC7IF.2 size=1038412 2024-04-03T03:46:00.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.538+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=GCMGF0YOC7IF tag=WK2QZ25O7BX2 type=write size=4184140 2024-04-03T03:46:00.536 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.538+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=2Z1FGUGO0RV3 type=del 2024-04-03T03:46:00.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.542+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=VNP55COTROYE type=del size=12929 2024-04-03T03:46:00.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.546+0000 7f55269288c0 1 < completed delete operation key=K3Z9W19WEJBM tag=MAMMPP0O4EEW type=del 2024-04-03T03:46:00.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.546+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=CB1LSHYKE4KU type=del size=4099001 2024-04-03T03:46:00.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.550+0000 7f55269288c0 1 < canceled operation key=B5BI0HJ5S1Y1 tag=VKJVCMCCR01W type=del size=4011283 2024-04-03T03:46:00.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.554+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~F3P7RXBZ623X.0 size=451497 2024-04-03T03:46:00.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.554+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=F3P7RXBZ623X tag=Q3JGOPQ2LZL2 type=write size=1500073 2024-04-03T03:46:00.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.558+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~NH9I3AYOOLMU.0 size=1048576 2024-04-03T03:46:00.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.558+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~NH9I3AYOOLMU.1 size=786953 2024-04-03T03:46:00.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.562+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=NH9I3AYOOLMU tag=68EF7KFSFGX6 type=write size=2884105 2024-04-03T03:46:00.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.566+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=N334SFUWL1AB type=del size=4146995 2024-04-03T03:46:00.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.566+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=SILTJ0FAE88S type=del 2024-04-03T03:46:00.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.570+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~DT4F8MTLOM1J.0 size=1048576 2024-04-03T03:46:00.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.574+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~DT4F8MTLOM1J.1 size=1048576 2024-04-03T03:46:00.571 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.574+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~DT4F8MTLOM1J.2 size=835778 2024-04-03T03:46:00.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.574+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=DT4F8MTLOM1J tag=WNYQXC0S3GT8 type=write size=3981506 2024-04-03T03:46:00.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.578+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~QYNAK6V6GOW1.0 size=1048576 2024-04-03T03:46:00.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.578+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~QYNAK6V6GOW1.1 size=159522 2024-04-03T03:46:00.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.582+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=QYNAK6V6GOW1 tag=7ERBS83GYIQU type=write size=2256674 2024-04-03T03:46:00.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.586+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~ZWL35N7T0SR2.0 size=1048576 2024-04-03T03:46:00.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.590+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~ZWL35N7T0SR2.1 size=190103 2024-04-03T03:46:00.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.590+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=ZWL35N7T0SR2 tag=R6D7G49WNY95 type=write size=2287255 2024-04-03T03:46:00.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.594+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=FIUT6TSJFCOT type=del 2024-04-03T03:46:00.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.598+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~B754VODXCE3K.0 size=1048576 2024-04-03T03:46:00.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.598+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~B754VODXCE3K.1 size=886631 2024-04-03T03:46:00.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.598+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=B754VODXCE3K tag=KLCH8KQ3IA31 type=write size=2983783 2024-04-03T03:46:00.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.602+0000 7f55269288c0 1 < completed write operation key=U62RSK21LJEF tag=VS3CBA9K1HLT type=write size=295860 2024-04-03T03:46:00.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.606+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~CMWGOCKJQX7I.0 size=1048576 2024-04-03T03:46:00.603 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.606+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~CMWGOCKJQX7I.1 size=690623 2024-04-03T03:46:00.603 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.606+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=CMWGOCKJQX7I tag=8BYDJEVZ0NZJ type=write size=2787775 2024-04-03T03:46:00.605 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.610+0000 7f55269288c0 1 < canceled operation key=K3Z9W19WEJBM tag=K9NC6C5E6WJ6 type=del size=3647405 2024-04-03T03:46:00.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.610+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=CR0LD9N62BCQ type=del size=1665106 2024-04-03T03:46:00.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.614+0000 7f55269288c0 1 < suggested remove operation key=AXL5RVPSVDY5 tag=5T7FFCUI5ZNR type=del 2024-04-03T03:46:00.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.618+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=YWE13KB8S62P type=del size=68947 2024-04-03T03:46:00.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.618+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=ZKCUAQ46YNBX type=del 2024-04-03T03:46:00.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.622+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~NUPIZOTT78U4.0 size=1048576 2024-04-03T03:46:00.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.626+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~NUPIZOTT78U4.1 size=1048576 2024-04-03T03:46:00.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.626+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~NUPIZOTT78U4.2 size=408554 2024-04-03T03:46:00.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.626+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=NUPIZOTT78U4 tag=J52DY6OS7SE1 type=write size=3554282 2024-04-03T03:46:00.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.630+0000 7f55269288c0 1 < completed write operation key=KDSE2XB4D1XI tag=M66WCUC56RIF type=write size=331062 2024-04-03T03:46:00.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.634+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=AN2X5AI1D8JJ type=del size=174588 2024-04-03T03:46:00.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.634+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~PNXYY717IDH4.0 size=1048576 2024-04-03T03:46:00.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.638+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~PNXYY717IDH4.1 size=836431 2024-04-03T03:46:00.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.642+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=PNXYY717IDH4 tag=XFWC7CO2B06N type=write size=2933583 2024-04-03T03:46:00.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.650+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~25BGS7BTN3SN.0 size=463697 2024-04-03T03:46:00.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.650+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=25BGS7BTN3SN tag=CF3F5EUF2032 type=write size=1512273 2024-04-03T03:46:00.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.650+0000 7f55269288c0 1 < completed write operation key=TW860A14J9RC tag=LEAIEQ7ZMCTK type=write size=408937 2024-04-03T03:46:00.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.658+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~FC0XY3ASSCU8.0 size=1048576 2024-04-03T03:46:00.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.658+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~FC0XY3ASSCU8.1 size=1048576 2024-04-03T03:46:00.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.662+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~FC0XY3ASSCU8.2 size=679723 2024-04-03T03:46:00.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.662+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=FC0XY3ASSCU8 tag=WTEFASMFGDPE type=write size=3825451 2024-04-03T03:46:00.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.662+0000 7f55269288c0 1 < canceled part key=_multipart_LZQGL2UAWOTU.2~NSGZNHVO260U.0 size=860119 2024-04-03T03:46:00.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.666+0000 7f55269288c0 1 < canceled multipart upload key=LZQGL2UAWOTU upload=NSGZNHVO260U tag=PE291OX1IHMQ type=write size=1908695 2024-04-03T03:46:00.664 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.666+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=8M05OWU2Z6JA type=del size=471843 2024-04-03T03:46:00.664 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.666+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~GCMGF0YOC7IF.0 size=1048576 2024-04-03T03:46:00.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.670+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~GCMGF0YOC7IF.1 size=1048576 2024-04-03T03:46:00.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.670+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~GCMGF0YOC7IF.2 size=1038412 2024-04-03T03:46:00.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.674+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=GCMGF0YOC7IF tag=WK2QZ25O7BX2 type=write size=4184140 2024-04-03T03:46:00.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.682+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~P0SQHOZRCN1R.0 size=909275 2024-04-03T03:46:00.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.682+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=P0SQHOZRCN1R tag=DGOP7GDOS5Q1 type=write size=1957851 2024-04-03T03:46:00.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.682+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=VNP55COTROYE type=del 2024-04-03T03:46:00.683 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.686+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~040OMPNCM2RJ.0 size=1048576 2024-04-03T03:46:00.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.690+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~040OMPNCM2RJ.1 size=544266 2024-04-03T03:46:00.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.690+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=040OMPNCM2RJ tag=3MRLVDJLY6CU type=write size=2641418 2024-04-03T03:46:00.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.690+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=CB1LSHYKE4KU type=del 2024-04-03T03:46:00.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.694+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=ESIT1LB9TWRX type=del size=1538420 2024-04-03T03:46:00.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.694+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~F3P7RXBZ623X.0 size=451497 2024-04-03T03:46:00.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.698+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=F3P7RXBZ623X tag=Q3JGOPQ2LZL2 type=write size=1500073 2024-04-03T03:46:00.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.702+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=II34950G78OE type=del size=3693987 2024-04-03T03:46:00.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.706+0000 7f55269288c0 1 < suggested remove operation key=AGTQQYXO7453 tag=N334SFUWL1AB type=del 2024-04-03T03:46:00.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.710+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=F8YOGNTPB7J3 type=write size=890884 2024-04-03T03:46:00.708 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.710+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~DT4F8MTLOM1J.0 size=1048576 2024-04-03T03:46:00.710 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.714+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~DT4F8MTLOM1J.1 size=1048576 2024-04-03T03:46:00.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.714+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~DT4F8MTLOM1J.2 size=835778 2024-04-03T03:46:00.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.718+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=DT4F8MTLOM1J tag=WNYQXC0S3GT8 type=write size=3981506 2024-04-03T03:46:00.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.722+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=YUOJN27GM4KY type=del size=1939174 2024-04-03T03:46:00.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.726+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~ZWL35N7T0SR2.0 size=1048576 2024-04-03T03:46:00.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.726+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~ZWL35N7T0SR2.1 size=190103 2024-04-03T03:46:00.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.730+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=ZWL35N7T0SR2 tag=R6D7G49WNY95 type=write size=2287255 2024-04-03T03:46:00.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.734+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~M8MM4Z1227LT.0 size=171679 2024-04-03T03:46:00.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.734+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=M8MM4Z1227LT tag=B2WPT47MTMYC type=write size=1220255 2024-04-03T03:46:00.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.734+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~B754VODXCE3K.0 size=1048576 2024-04-03T03:46:00.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.738+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~B754VODXCE3K.1 size=886631 2024-04-03T03:46:00.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.742+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=B754VODXCE3K tag=KLCH8KQ3IA31 type=write size=2983783 2024-04-03T03:46:00.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.746+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=O2ZR7K3TBAUQ type=del size=749592 2024-04-03T03:46:00.744 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.746+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~CMWGOCKJQX7I.0 size=1048576 2024-04-03T03:46:00.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.750+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~CMWGOCKJQX7I.1 size=690623 2024-04-03T03:46:00.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.754+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=CMWGOCKJQX7I tag=8BYDJEVZ0NZJ type=write size=2787775 2024-04-03T03:46:00.753 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.754+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=UMQSJ4UZZ2SI type=del size=2722105 2024-04-03T03:46:00.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.758+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=CR0LD9N62BCQ type=del 2024-04-03T03:46:00.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.762+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=KJHZHWWXMWFV type=write size=94275 2024-04-03T03:46:00.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.762+0000 7f55269288c0 1 < canceled operation key=JAXVD60NI5YW tag=YWE13KB8S62P type=del size=68947 2024-04-03T03:46:00.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.766+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=UHD9DGASGMXF type=del size=3311367 2024-04-03T03:46:00.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.766+0000 7f55269288c0 1 < canceled part key=_multipart_8SBTVHL09P63.2~NUPIZOTT78U4.0 size=1048576 2024-04-03T03:46:00.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.770+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~NUPIZOTT78U4.1 size=1048576 2024-04-03T03:46:00.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.770+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~NUPIZOTT78U4.2 size=408554 2024-04-03T03:46:00.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.774+0000 7f55269288c0 1 < canceled multipart upload key=8SBTVHL09P63 upload=NUPIZOTT78U4 tag=J52DY6OS7SE1 type=write size=3554282 2024-04-03T03:46:00.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.778+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~Y0CN36XSR2JP.0 size=414449 2024-04-03T03:46:00.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.778+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=Y0CN36XSR2JP tag=0Y6QA0YT2GZ8 type=write size=1463025 2024-04-03T03:46:00.778 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.782+0000 7f55269288c0 1 < canceled operation key=8SBTVHL09P63 tag=AN2X5AI1D8JJ type=del size=174588 2024-04-03T03:46:00.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.786+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~DZU39S4I3VZ3.0 size=1048576 2024-04-03T03:46:00.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.786+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~DZU39S4I3VZ3.1 size=1048576 2024-04-03T03:46:00.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.790+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~DZU39S4I3VZ3.2 size=923716 2024-04-03T03:46:00.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.790+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=DZU39S4I3VZ3 tag=1Y2NSO39XND4 type=write size=4069444 2024-04-03T03:46:00.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.790+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~25BGS7BTN3SN.0 size=463697 2024-04-03T03:46:00.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.794+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=25BGS7BTN3SN tag=CF3F5EUF2032 type=write size=1512273 2024-04-03T03:46:00.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.798+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~BUDSC5N9BRPU.0 size=869390 2024-04-03T03:46:00.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.798+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=BUDSC5N9BRPU tag=4WQ68PGTJ56O type=write size=1917966 2024-04-03T03:46:00.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.802+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~FC0XY3ASSCU8.0 size=1048576 2024-04-03T03:46:00.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.802+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~FC0XY3ASSCU8.1 size=1048576 2024-04-03T03:46:00.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.802+0000 7f55269288c0 1 < canceled part key=_multipart_LZQGL2UAWOTU.2~FC0XY3ASSCU8.2 size=679723 2024-04-03T03:46:00.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.806+0000 7f55269288c0 1 < canceled multipart upload key=LZQGL2UAWOTU upload=FC0XY3ASSCU8 tag=WTEFASMFGDPE type=write size=3825451 2024-04-03T03:46:00.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.810+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=U2RQGJYFFX2G type=write size=1032731 2024-04-03T03:46:00.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.814+0000 7f55269288c0 1 < suggested update operation key=D9OEPPT37WSJ tag=8M05OWU2Z6JA type=del size=471843 2024-04-03T03:46:00.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.818+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=F3L3G935FJGE type=del size=3123817 2024-04-03T03:46:00.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.818+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~P0SQHOZRCN1R.0 size=909275 2024-04-03T03:46:00.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.822+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=P0SQHOZRCN1R tag=DGOP7GDOS5Q1 type=write size=1957851 2024-04-03T03:46:00.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.822+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=6BQSB0NSCBFA type=del size=3175337 2024-04-03T03:46:00.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.822+0000 7f55269288c0 1 < canceled part key=_multipart_TLM1C3B9J2A3.2~040OMPNCM2RJ.0 size=1048576 2024-04-03T03:46:00.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.826+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~040OMPNCM2RJ.1 size=544266 2024-04-03T03:46:00.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.830+0000 7f55269288c0 1 < canceled multipart upload key=TLM1C3B9J2A3 upload=040OMPNCM2RJ tag=3MRLVDJLY6CU type=write size=2641418 2024-04-03T03:46:00.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.830+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=RH3PUN6WNIOI type=del size=3664692 2024-04-03T03:46:00.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.834+0000 7f55269288c0 1 < suggested update operation key=8BMP0HIS520R tag=ESIT1LB9TWRX type=del size=1538420 2024-04-03T03:46:00.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.838+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=7G1DO0BS1S9E type=del size=3039638 2024-04-03T03:46:00.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.842+0000 7f55269288c0 -1 < failed to complete operation key=AGTQQYXO7453 tag=II34950G78OE type=del size=3693987: (22) Invalid argument 2024-04-03T03:46:00.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.842+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=CVTMV0404CUP type=del size=907368 2024-04-03T03:46:00.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.846+0000 7f55269288c0 1 < completed write operation key=CPR27NMHPIPQ tag=F8YOGNTPB7J3 type=write size=890884 2024-04-03T03:46:00.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.850+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=M27YSKUTB7H5 type=del size=3525574 2024-04-03T03:46:00.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.854+0000 7f55269288c0 -1 < failed to complete operation key=8BMP0HIS520R tag=YUOJN27GM4KY type=del size=1939174: (22) Invalid argument 2024-04-03T03:46:00.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.854+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=M8ZCH7P4KP9J type=write size=680168 2024-04-03T03:46:00.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.858+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~M8MM4Z1227LT.0 size=171679 2024-04-03T03:46:00.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.862+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=M8MM4Z1227LT tag=B2WPT47MTMYC type=write size=1220255 2024-04-03T03:46:00.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.870+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~ODKBDK2HKN9Z.0 size=398517 2024-04-03T03:46:00.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.870+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=ODKBDK2HKN9Z tag=OUV4M665GPVA type=write size=1447093 2024-04-03T03:46:00.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.874+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=O2ZR7K3TBAUQ type=del 2024-04-03T03:46:00.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.878+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=C5X0JQAAGP1L type=del size=455658 2024-04-03T03:46:00.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.878+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=UMQSJ4UZZ2SI type=del 2024-04-03T03:46:00.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.882+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=IDOLK1RNQI7B type=write size=440497 2024-04-03T03:46:00.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.882+0000 7f55269288c0 1 < completed write operation key=AGTQQYXO7453 tag=KJHZHWWXMWFV type=write size=94275 2024-04-03T03:46:00.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.886+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~2PJG3OO80UUC.0 size=1048576 2024-04-03T03:46:00.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.890+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~2PJG3OO80UUC.1 size=449709 2024-04-03T03:46:00.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.890+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=2PJG3OO80UUC tag=DCY2HV4VE8NL type=write size=2546861 2024-04-03T03:46:00.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.894+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=UHD9DGASGMXF type=del 2024-04-03T03:46:00.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.898+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~H9MCLYU5VCXX.0 size=1048576 2024-04-03T03:46:00.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.898+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~H9MCLYU5VCXX.1 size=1048576 2024-04-03T03:46:00.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.902+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~H9MCLYU5VCXX.2 size=375734 2024-04-03T03:46:00.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.902+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=H9MCLYU5VCXX tag=KS48MF6AFQRV type=write size=3521462 2024-04-03T03:46:00.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.902+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~Y0CN36XSR2JP.0 size=414449 2024-04-03T03:46:00.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.906+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=Y0CN36XSR2JP tag=0Y6QA0YT2GZ8 type=write size=1463025 2024-04-03T03:46:00.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.910+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=NMHSQ3BU9C7K type=del size=1551551 2024-04-03T03:46:00.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.910+0000 7f55269288c0 1 < canceled part key=_multipart_IOHMF3ADC6EU.2~DZU39S4I3VZ3.0 size=1048576 2024-04-03T03:46:00.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.910+0000 7f55269288c0 1 < canceled part key=_multipart_IOHMF3ADC6EU.2~DZU39S4I3VZ3.1 size=1048576 2024-04-03T03:46:00.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.914+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~DZU39S4I3VZ3.2 size=923716 2024-04-03T03:46:00.913 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.918+0000 7f55269288c0 1 < canceled multipart upload key=IOHMF3ADC6EU upload=DZU39S4I3VZ3 tag=1Y2NSO39XND4 type=write size=4069444 2024-04-03T03:46:00.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.922+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~JIA1H9H84GWV.0 size=1048576 2024-04-03T03:46:00.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.922+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~JIA1H9H84GWV.1 size=1048576 2024-04-03T03:46:00.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.926+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~JIA1H9H84GWV.2 size=871108 2024-04-03T03:46:00.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.926+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=JIA1H9H84GWV tag=MJTST06G54H0 type=write size=4016836 2024-04-03T03:46:00.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.926+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~BUDSC5N9BRPU.0 size=869390 2024-04-03T03:46:00.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.930+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=BUDSC5N9BRPU tag=4WQ68PGTJ56O type=write size=1917966 2024-04-03T03:46:00.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.934+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~UATMSQMGE6TR.0 size=1048576 2024-04-03T03:46:00.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.938+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~UATMSQMGE6TR.1 size=146938 2024-04-03T03:46:00.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.938+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=UATMSQMGE6TR tag=6WT41THJO9YB type=write size=2244090 2024-04-03T03:46:00.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.938+0000 7f55269288c0 1 < completed write operation key=MB7HTWATXRMB tag=U2RQGJYFFX2G type=write size=1032731 2024-04-03T03:46:00.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.942+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~GLKV6BD58I9S.0 size=76730 2024-04-03T03:46:00.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.942+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=GLKV6BD58I9S tag=A531ER62DZTE type=write size=1125306 2024-04-03T03:46:00.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.946+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=F3L3G935FJGE type=del 2024-04-03T03:46:00.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.950+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~24DU7A41PDDX.0 size=919274 2024-04-03T03:46:00.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.950+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=24DU7A41PDDX tag=0R89W5VQQ4NS type=write size=1967850 2024-04-03T03:46:00.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.954+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=6BQSB0NSCBFA type=del 2024-04-03T03:46:00.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.958+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~37K36CQNR0TQ.0 size=612945 2024-04-03T03:46:00.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.958+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=37K36CQNR0TQ tag=YGPUOU9V0VY5 type=write size=1661521 2024-04-03T03:46:00.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.958+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=RH3PUN6WNIOI type=del 2024-04-03T03:46:00.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.962+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~QIW1IHSQPDR7.0 size=143454 2024-04-03T03:46:00.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.962+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=QIW1IHSQPDR7 tag=78MVLVW4I3S4 type=write size=1192030 2024-04-03T03:46:00.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.966+0000 7f55269288c0 1 < suggested remove operation key=7POFUQ9CX6B1 tag=7G1DO0BS1S9E type=del 2024-04-03T03:46:00.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.970+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~S474QK9BG5W9.0 size=1048576 2024-04-03T03:46:00.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.974+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~S474QK9BG5W9.1 size=1048576 2024-04-03T03:46:00.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.974+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~S474QK9BG5W9.2 size=860470 2024-04-03T03:46:00.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.974+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=S474QK9BG5W9 tag=XN44UJ855PHE type=write size=4006198 2024-04-03T03:46:00.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.978+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=CVTMV0404CUP type=del 2024-04-03T03:46:00.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.982+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~ZY46L6PX6REA.0 size=1048576 2024-04-03T03:46:00.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.982+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~ZY46L6PX6REA.1 size=1048576 2024-04-03T03:46:00.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.986+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~ZY46L6PX6REA.2 size=465745 2024-04-03T03:46:00.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.986+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=ZY46L6PX6REA tag=B9HJ1M7JKDIR type=write size=3611473 2024-04-03T03:46:00.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.990+0000 7f55269288c0 1 < suggested remove operation key=TLM1C3B9J2A3 tag=M27YSKUTB7H5 type=del 2024-04-03T03:46:00.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.990+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=FVCAWTTNJ9O6 type=write size=765770 2024-04-03T03:46:00.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.994+0000 7f55269288c0 1 < completed write operation key=Z42NDVEX1SOL tag=M8ZCH7P4KP9J type=write size=680168 2024-04-03T03:46:00.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.994+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=BF9VCAR4VEJC type=del size=2069190 2024-04-03T03:46:00.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:00.998+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~ODKBDK2HKN9Z.0 size=398517 2024-04-03T03:46:00.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.002+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=ODKBDK2HKN9Z tag=OUV4M665GPVA type=write size=1447093 2024-04-03T03:46:01.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.006+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~2YNKPBR8AFJC.0 size=414879 2024-04-03T03:46:01.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.006+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=2YNKPBR8AFJC tag=YLIV634PGQDW type=write size=1463455 2024-04-03T03:46:01.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.010+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=C5X0JQAAGP1L type=del 2024-04-03T03:46:01.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.014+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~HGJY0VDMSF7C.0 size=1048576 2024-04-03T03:46:01.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.014+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~HGJY0VDMSF7C.1 size=1048576 2024-04-03T03:46:01.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.018+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~HGJY0VDMSF7C.2 size=883959 2024-04-03T03:46:01.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.018+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=HGJY0VDMSF7C tag=WOD0CVUWMJIV type=write size=4029687 2024-04-03T03:46:01.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.022+0000 7f55269288c0 1 < completed write operation key=MLTDNCZ4E5D8 tag=IDOLK1RNQI7B type=write size=440497 2024-04-03T03:46:01.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.026+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~XWNKWUT6AETJ.0 size=1048576 2024-04-03T03:46:01.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.026+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~XWNKWUT6AETJ.1 size=1048576 2024-04-03T03:46:01.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.030+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~XWNKWUT6AETJ.2 size=810194 2024-04-03T03:46:01.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.030+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=XWNKWUT6AETJ tag=LHI2PGI6N2AB type=write size=3955922 2024-04-03T03:46:01.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.030+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~2PJG3OO80UUC.0 size=1048576 2024-04-03T03:46:01.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.034+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~2PJG3OO80UUC.1 size=449709 2024-04-03T03:46:01.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.038+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=2PJG3OO80UUC tag=DCY2HV4VE8NL type=write size=2546861 2024-04-03T03:46:01.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.038+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=YQA3SE3L1NU3 type=del size=2347767 2024-04-03T03:46:01.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.042+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~H9MCLYU5VCXX.0 size=1048576 2024-04-03T03:46:01.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.042+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~H9MCLYU5VCXX.1 size=1048576 2024-04-03T03:46:01.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.042+0000 7f55269288c0 1 < canceled part key=_multipart_U62RSK21LJEF.2~H9MCLYU5VCXX.2 size=375734 2024-04-03T03:46:01.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.046+0000 7f55269288c0 1 < canceled multipart upload key=U62RSK21LJEF upload=H9MCLYU5VCXX tag=KS48MF6AFQRV type=write size=3521462 2024-04-03T03:46:01.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.050+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~AJYWVTDOFKBL.0 size=798885 2024-04-03T03:46:01.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.050+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=AJYWVTDOFKBL tag=ZDXLA2S1K1QI type=write size=1847461 2024-04-03T03:46:01.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.054+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=NMHSQ3BU9C7K type=del 2024-04-03T03:46:01.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.058+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=CRL5A6LC86K9 type=del size=3750676 2024-04-03T03:46:01.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.058+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~JIA1H9H84GWV.0 size=1048576 2024-04-03T03:46:01.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.058+0000 7f55269288c0 1 < canceled part key=_multipart_XFCPX90N2NYC.2~JIA1H9H84GWV.1 size=1048576 2024-04-03T03:46:01.057 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.062+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~JIA1H9H84GWV.2 size=871108 2024-04-03T03:46:01.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.066+0000 7f55269288c0 1 < canceled multipart upload key=XFCPX90N2NYC upload=JIA1H9H84GWV tag=MJTST06G54H0 type=write size=4016836 2024-04-03T03:46:01.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.070+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=7NHYVDF50SP0 type=del size=3887228 2024-04-03T03:46:01.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.070+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~UATMSQMGE6TR.0 size=1048576 2024-04-03T03:46:01.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.070+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~UATMSQMGE6TR.1 size=146938 2024-04-03T03:46:01.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.074+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=UATMSQMGE6TR tag=6WT41THJO9YB type=write size=2244090 2024-04-03T03:46:01.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.078+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~2K89FV5SSY3Q.0 size=1048576 2024-04-03T03:46:01.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.078+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~2K89FV5SSY3Q.1 size=1048576 2024-04-03T03:46:01.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.082+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~2K89FV5SSY3Q.2 size=793987 2024-04-03T03:46:01.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.082+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=2K89FV5SSY3Q tag=AT6AQCTUBLH1 type=write size=3939715 2024-04-03T03:46:01.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.082+0000 7f55269288c0 1 < canceled part key=_multipart_MLTDNCZ4E5D8.2~GLKV6BD58I9S.0 size=76730 2024-04-03T03:46:01.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.086+0000 7f55269288c0 1 < canceled multipart upload key=MLTDNCZ4E5D8 upload=GLKV6BD58I9S tag=A531ER62DZTE type=write size=1125306 2024-04-03T03:46:01.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.090+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~U2BIF2LAPKW6.0 size=1048576 2024-04-03T03:46:01.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.090+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~U2BIF2LAPKW6.1 size=985740 2024-04-03T03:46:01.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.090+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=U2BIF2LAPKW6 tag=2DP64TO6JEYV type=write size=3082892 2024-04-03T03:46:01.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.094+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~24DU7A41PDDX.0 size=919274 2024-04-03T03:46:01.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.098+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=24DU7A41PDDX tag=0R89W5VQQ4NS type=write size=1967850 2024-04-03T03:46:01.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.102+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~WP2A4H6FE54N.0 size=1048576 2024-04-03T03:46:01.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.102+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~WP2A4H6FE54N.1 size=1048576 2024-04-03T03:46:01.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.102+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~WP2A4H6FE54N.2 size=453829 2024-04-03T03:46:01.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.102+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=WP2A4H6FE54N tag=AQC53U34ZBLU type=write size=3599557 2024-04-03T03:46:01.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.106+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~37K36CQNR0TQ.0 size=612945 2024-04-03T03:46:01.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.110+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=37K36CQNR0TQ tag=YGPUOU9V0VY5 type=write size=1661521 2024-04-03T03:46:01.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.110+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=T2C3XIBP1GOJ type=del size=2636273 2024-04-03T03:46:01.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.114+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~QIW1IHSQPDR7.0 size=143454 2024-04-03T03:46:01.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.114+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=QIW1IHSQPDR7 tag=78MVLVW4I3S4 type=write size=1192030 2024-04-03T03:46:01.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.118+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=W1L62PGT4WPU type=del size=3144080 2024-04-03T03:46:01.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.118+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~S474QK9BG5W9.0 size=1048576 2024-04-03T03:46:01.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.118+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~S474QK9BG5W9.1 size=1048576 2024-04-03T03:46:01.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.122+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~S474QK9BG5W9.2 size=860470 2024-04-03T03:46:01.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.126+0000 7f55269288c0 1 < canceled multipart upload key=8BMP0HIS520R upload=S474QK9BG5W9 tag=XN44UJ855PHE type=write size=4006198 2024-04-03T03:46:01.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.126+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=NG8LR7R8S7LH type=del size=520766 2024-04-03T03:46:01.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.130+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~ZY46L6PX6REA.0 size=1048576 2024-04-03T03:46:01.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.130+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~ZY46L6PX6REA.1 size=1048576 2024-04-03T03:46:01.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.134+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~ZY46L6PX6REA.2 size=465745 2024-04-03T03:46:01.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.138+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=ZY46L6PX6REA tag=B9HJ1M7JKDIR type=write size=3611473 2024-04-03T03:46:01.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.138+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=165L1T3HGSN0 type=del size=2193010 2024-04-03T03:46:01.138 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.142+0000 7f55269288c0 1 < completed write operation key=TW860A14J9RC tag=FVCAWTTNJ9O6 type=write size=765770 2024-04-03T03:46:01.142 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.146+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~O0S9QHTQZ930.0 size=781213 2024-04-03T03:46:01.142 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.146+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=O0S9QHTQZ930 tag=9WXON5FBDIF8 type=write size=1829789 2024-04-03T03:46:01.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.146+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=BF9VCAR4VEJC type=del 2024-04-03T03:46:01.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.154+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~1ZWPR3RQ0XRW.0 size=1048576 2024-04-03T03:46:01.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.154+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~1ZWPR3RQ0XRW.1 size=258596 2024-04-03T03:46:01.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.154+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=1ZWPR3RQ0XRW tag=XKTFCC3AYQRZ type=write size=2355748 2024-04-03T03:46:01.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.158+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~2YNKPBR8AFJC.0 size=414879 2024-04-03T03:46:01.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.162+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=2YNKPBR8AFJC tag=YLIV634PGQDW type=write size=1463455 2024-04-03T03:46:01.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.162+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=DS7OUNAUPKRL type=del size=300977 2024-04-03T03:46:01.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.166+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~HGJY0VDMSF7C.0 size=1048576 2024-04-03T03:46:01.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.166+0000 7f55269288c0 1 < canceled part key=_multipart_MB7HTWATXRMB.2~HGJY0VDMSF7C.1 size=1048576 2024-04-03T03:46:01.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.166+0000 7f55269288c0 1 < canceled part key=_multipart_MB7HTWATXRMB.2~HGJY0VDMSF7C.2 size=883959 2024-04-03T03:46:01.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.170+0000 7f55269288c0 1 < canceled multipart upload key=MB7HTWATXRMB upload=HGJY0VDMSF7C tag=WOD0CVUWMJIV type=write size=4029687 2024-04-03T03:46:01.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.174+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~MPAOYT93PWXO.0 size=1048576 2024-04-03T03:46:01.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.174+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~MPAOYT93PWXO.1 size=302193 2024-04-03T03:46:01.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.174+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=MPAOYT93PWXO tag=H3HIXP0MY3MU type=write size=2399345 2024-04-03T03:46:01.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.178+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~XWNKWUT6AETJ.0 size=1048576 2024-04-03T03:46:01.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.178+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~XWNKWUT6AETJ.1 size=1048576 2024-04-03T03:46:01.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.178+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~XWNKWUT6AETJ.2 size=810194 2024-04-03T03:46:01.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.182+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=XWNKWUT6AETJ tag=LHI2PGI6N2AB type=write size=3955922 2024-04-03T03:46:01.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.186+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=G1U055X2538B type=write size=1044465 2024-04-03T03:46:01.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.186+0000 7f55269288c0 1 < canceled operation key=MB7HTWATXRMB tag=YQA3SE3L1NU3 type=del size=2347767 2024-04-03T03:46:01.189 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.194+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~016TJ704YJ07.0 size=1048576 2024-04-03T03:46:01.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.194+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~016TJ704YJ07.1 size=1048576 2024-04-03T03:46:01.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.198+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~016TJ704YJ07.2 size=870786 2024-04-03T03:46:01.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.198+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=016TJ704YJ07 tag=SS60Z073F70M type=write size=4016514 2024-04-03T03:46:01.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.198+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~AJYWVTDOFKBL.0 size=798885 2024-04-03T03:46:01.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.202+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=AJYWVTDOFKBL tag=ZDXLA2S1K1QI type=write size=1847461 2024-04-03T03:46:01.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.202+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=KNJ4H9ZE56II type=del size=2560005 2024-04-03T03:46:01.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.210+0000 7f55269288c0 1 < suggested update operation key=D9OEPPT37WSJ tag=CRL5A6LC86K9 type=del size=3750676 2024-04-03T03:46:01.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.214+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~30SQFXTZP7XW.0 size=305010 2024-04-03T03:46:01.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.214+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=30SQFXTZP7XW tag=IDD5NC8KI9K8 type=write size=1353586 2024-04-03T03:46:01.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.214+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=7NHYVDF50SP0 type=del 2024-04-03T03:46:01.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.218+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=5WD8G5RB4L4R type=del size=2976531 2024-04-03T03:46:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.218+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~2K89FV5SSY3Q.0 size=1048576 2024-04-03T03:46:01.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.222+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~2K89FV5SSY3Q.1 size=1048576 2024-04-03T03:46:01.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.222+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~2K89FV5SSY3Q.2 size=793987 2024-04-03T03:46:01.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.230+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=2K89FV5SSY3Q tag=AT6AQCTUBLH1 type=write size=3939715 2024-04-03T03:46:01.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.230+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=4OADXL469U5N type=del size=1770132 2024-04-03T03:46:01.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.234+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~U2BIF2LAPKW6.0 size=1048576 2024-04-03T03:46:01.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.234+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~U2BIF2LAPKW6.1 size=985740 2024-04-03T03:46:01.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.238+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=U2BIF2LAPKW6 tag=2DP64TO6JEYV type=write size=3082892 2024-04-03T03:46:01.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.246+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~82X34N34KTAB.0 size=990205 2024-04-03T03:46:01.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.246+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=82X34N34KTAB tag=PWZ0JJRI1V3U type=write size=2038781 2024-04-03T03:46:01.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.246+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~WP2A4H6FE54N.0 size=1048576 2024-04-03T03:46:01.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.250+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~WP2A4H6FE54N.1 size=1048576 2024-04-03T03:46:01.247 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.250+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~WP2A4H6FE54N.2 size=453829 2024-04-03T03:46:01.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.254+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=WP2A4H6FE54N tag=AQC53U34ZBLU type=write size=3599557 2024-04-03T03:46:01.257 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.262+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~PEVI2JP50RRP.0 size=1048576 2024-04-03T03:46:01.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.262+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~PEVI2JP50RRP.1 size=727867 2024-04-03T03:46:01.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.262+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=PEVI2JP50RRP tag=SGL58WDK2VCH type=write size=2825019 2024-04-03T03:46:01.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.266+0000 7f55269288c0 1 < canceled operation key=KDSE2XB4D1XI tag=T2C3XIBP1GOJ type=del size=2636273 2024-04-03T03:46:01.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.266+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=O110UP5IEYK8 type=del size=372625 2024-04-03T03:46:01.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.274+0000 7f55269288c0 1 < suggested remove operation key=YCEKDT5EQD9D tag=W1L62PGT4WPU type=del 2024-04-03T03:46:01.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.278+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~OCZSO2XO0NUC.0 size=973513 2024-04-03T03:46:01.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.278+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=OCZSO2XO0NUC tag=SURTH8Z2WEC6 type=write size=2022089 2024-04-03T03:46:01.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.278+0000 7f55269288c0 -1 < failed to complete operation key=YCEKDT5EQD9D tag=NG8LR7R8S7LH type=del size=520766: (22) Invalid argument 2024-04-03T03:46:01.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.286+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~KIYIN7E20847.0 size=1048576 2024-04-03T03:46:01.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.286+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~KIYIN7E20847.1 size=1048576 2024-04-03T03:46:01.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.290+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~KIYIN7E20847.2 size=778079 2024-04-03T03:46:01.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.290+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=KIYIN7E20847 tag=EO5JU332DJZ7 type=write size=3923807 2024-04-03T03:46:01.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.294+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=165L1T3HGSN0 type=del 2024-04-03T03:46:01.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.294+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=PSUU4ZURPFD8 type=del size=2616068 2024-04-03T03:46:01.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.298+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~O0S9QHTQZ930.0 size=781213 2024-04-03T03:46:01.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.306+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=O0S9QHTQZ930 tag=9WXON5FBDIF8 type=write size=1829789 2024-04-03T03:46:01.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.310+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=M94X26Y87GRJ type=del size=509742 2024-04-03T03:46:01.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.314+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~1ZWPR3RQ0XRW.0 size=1048576 2024-04-03T03:46:01.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.314+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~1ZWPR3RQ0XRW.1 size=258596 2024-04-03T03:46:01.317 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.322+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=1ZWPR3RQ0XRW tag=XKTFCC3AYQRZ type=write size=2355748 2024-04-03T03:46:01.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.326+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=G2OA8FP9CK0J type=del size=3598008 2024-04-03T03:46:01.324 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.326+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=DS7OUNAUPKRL type=del 2024-04-03T03:46:01.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.334+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~NNICJOVT942L.0 size=1048576 2024-04-03T03:46:01.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.334+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~NNICJOVT942L.1 size=1048576 2024-04-03T03:46:01.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.338+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~NNICJOVT942L.2 size=183456 2024-04-03T03:46:01.334 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.338+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=NNICJOVT942L tag=FFOJBEQ0HZUJ type=write size=3329184 2024-04-03T03:46:01.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.338+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~MPAOYT93PWXO.0 size=1048576 2024-04-03T03:46:01.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.342+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~MPAOYT93PWXO.1 size=302193 2024-04-03T03:46:01.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.346+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=MPAOYT93PWXO tag=H3HIXP0MY3MU type=write size=2399345 2024-04-03T03:46:01.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.350+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~UOCGDCJ3F83Z.0 size=1048576 2024-04-03T03:46:01.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.354+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~UOCGDCJ3F83Z.1 size=860678 2024-04-03T03:46:01.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.354+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=UOCGDCJ3F83Z tag=EUP1HDP9S3LX type=write size=2957830 2024-04-03T03:46:01.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.358+0000 7f55269288c0 1 < suggested update operation key=KU1R0YLDP1V3 tag=G1U055X2538B type=write size=1044465 2024-04-03T03:46:01.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.362+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=5O1OAZ1CPH3Y type=del size=2006283 2024-04-03T03:46:01.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.362+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~016TJ704YJ07.0 size=1048576 2024-04-03T03:46:01.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.366+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~016TJ704YJ07.1 size=1048576 2024-04-03T03:46:01.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.366+0000 7f55269288c0 1 < canceled part key=_multipart_AXL5RVPSVDY5.2~016TJ704YJ07.2 size=870786 2024-04-03T03:46:01.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.370+0000 7f55269288c0 1 < canceled multipart upload key=AXL5RVPSVDY5 upload=016TJ704YJ07 tag=SS60Z073F70M type=write size=4016514 2024-04-03T03:46:01.369 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.374+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~OJVK9OWZ09ED.0 size=502128 2024-04-03T03:46:01.369 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.374+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=OJVK9OWZ09ED tag=Q8OSHFHLQ0VR type=write size=1550704 2024-04-03T03:46:01.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.374+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=KNJ4H9ZE56II type=del 2024-04-03T03:46:01.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.378+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=VX6PH7YJATB9 type=del size=2358729 2024-04-03T03:46:01.376 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.378+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~30SQFXTZP7XW.0 size=305010 2024-04-03T03:46:01.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.382+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=30SQFXTZP7XW tag=IDD5NC8KI9K8 type=write size=1353586 2024-04-03T03:46:01.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.386+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=DZXGN3WL9SSB type=del size=2455179 2024-04-03T03:46:01.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.386+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=5WD8G5RB4L4R type=del 2024-04-03T03:46:01.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.394+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~HIE1IBTAMZIM.0 size=1048576 2024-04-03T03:46:01.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.394+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~HIE1IBTAMZIM.1 size=117901 2024-04-03T03:46:01.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.394+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=HIE1IBTAMZIM tag=SQVL9ZGJZQ5H type=write size=2215053 2024-04-03T03:46:01.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.398+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=4OADXL469U5N type=del 2024-04-03T03:46:01.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.402+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~3WE9PY8ZOV9O.0 size=1048576 2024-04-03T03:46:01.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.402+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~3WE9PY8ZOV9O.1 size=1048576 2024-04-03T03:46:01.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.406+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~3WE9PY8ZOV9O.2 size=1034840 2024-04-03T03:46:01.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.406+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=3WE9PY8ZOV9O tag=C06A2UZSLDG9 type=write size=4180568 2024-04-03T03:46:01.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.406+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~82X34N34KTAB.0 size=990205 2024-04-03T03:46:01.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.410+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=82X34N34KTAB tag=PWZ0JJRI1V3U type=write size=2038781 2024-04-03T03:46:01.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.414+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~FZ5XOH029T0J.0 size=1048576 2024-04-03T03:46:01.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.418+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~FZ5XOH029T0J.1 size=872871 2024-04-03T03:46:01.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.418+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=FZ5XOH029T0J tag=K7X4OEG8MHIH type=write size=2970023 2024-04-03T03:46:01.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.422+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~PEVI2JP50RRP.0 size=1048576 2024-04-03T03:46:01.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.422+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~PEVI2JP50RRP.1 size=727867 2024-04-03T03:46:01.422 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.426+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=PEVI2JP50RRP tag=SGL58WDK2VCH type=write size=2825019 2024-04-03T03:46:01.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.430+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~W3J92C5S41ZG.0 size=1048576 2024-04-03T03:46:01.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.430+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~W3J92C5S41ZG.1 size=192119 2024-04-03T03:46:01.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.430+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=W3J92C5S41ZG tag=DDVRQRRCN082 type=write size=2289271 2024-04-03T03:46:01.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.434+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=O110UP5IEYK8 type=del 2024-04-03T03:46:01.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.438+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~X038YBBJ2FSI.0 size=375006 2024-04-03T03:46:01.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.438+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=X038YBBJ2FSI tag=0IUT4S1CNHR7 type=write size=1423582 2024-04-03T03:46:01.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.442+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~OCZSO2XO0NUC.0 size=973513 2024-04-03T03:46:01.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.446+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=OCZSO2XO0NUC tag=SURTH8Z2WEC6 type=write size=2022089 2024-04-03T03:46:01.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.450+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~H79BE0ZEADTC.0 size=287771 2024-04-03T03:46:01.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.450+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=H79BE0ZEADTC tag=BCUFAAZNY6VO type=write size=1336347 2024-04-03T03:46:01.447 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.450+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~KIYIN7E20847.0 size=1048576 2024-04-03T03:46:01.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.454+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~KIYIN7E20847.1 size=1048576 2024-04-03T03:46:01.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.454+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~KIYIN7E20847.2 size=778079 2024-04-03T03:46:01.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.458+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=KIYIN7E20847 tag=EO5JU332DJZ7 type=write size=3923807 2024-04-03T03:46:01.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.462+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=ZAR8VGZ6CV86 type=write size=295609 2024-04-03T03:46:01.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.466+0000 7f55269288c0 1 < suggested remove operation key=3XKXK1JXKOHU tag=PSUU4ZURPFD8 type=del 2024-04-03T03:46:01.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.466+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=UL2670KY30XH type=del size=836478 2024-04-03T03:46:01.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.470+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=M94X26Y87GRJ type=del 2024-04-03T03:46:01.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.470+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=86M10YPWRYD2 type=del size=4133018 2024-04-03T03:46:01.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.474+0000 7f55269288c0 1 < canceled operation key=SFN1M3HPGT18 tag=G2OA8FP9CK0J type=del size=3598008 2024-04-03T03:46:01.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.478+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~0C3Y2LESW52G.0 size=1048576 2024-04-03T03:46:01.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.482+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~0C3Y2LESW52G.1 size=674803 2024-04-03T03:46:01.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.482+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=0C3Y2LESW52G tag=XOC1WNTGZZEV type=write size=2771955 2024-04-03T03:46:01.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.482+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~NNICJOVT942L.0 size=1048576 2024-04-03T03:46:01.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.486+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~NNICJOVT942L.1 size=1048576 2024-04-03T03:46:01.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.486+0000 7f55269288c0 1 < canceled part key=_multipart_7POFUQ9CX6B1.2~NNICJOVT942L.2 size=183456 2024-04-03T03:46:01.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.490+0000 7f55269288c0 1 < canceled multipart upload key=7POFUQ9CX6B1 upload=NNICJOVT942L tag=FFOJBEQ0HZUJ type=write size=3329184 2024-04-03T03:46:01.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.490+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=IFO1Z0Z1EFH0 type=del size=417351 2024-04-03T03:46:01.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.494+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~UOCGDCJ3F83Z.0 size=1048576 2024-04-03T03:46:01.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.494+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~UOCGDCJ3F83Z.1 size=860678 2024-04-03T03:46:01.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.498+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=UOCGDCJ3F83Z tag=EUP1HDP9S3LX type=write size=2957830 2024-04-03T03:46:01.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.502+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=UIC7MFFUB5U4 type=del size=3340176 2024-04-03T03:46:01.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.506+0000 7f55269288c0 1 < suggested remove operation key=JAXVD60NI5YW tag=5O1OAZ1CPH3Y type=del 2024-04-03T03:46:01.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.510+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=4HQP9SJWRZJ6 type=del size=1041925 2024-04-03T03:46:01.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.510+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~OJVK9OWZ09ED.0 size=502128 2024-04-03T03:46:01.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.514+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=OJVK9OWZ09ED tag=Q8OSHFHLQ0VR type=write size=1550704 2024-04-03T03:46:01.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.518+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=OYT2ADRX5KG2 type=del size=135395 2024-04-03T03:46:01.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.522+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=VX6PH7YJATB9 type=del 2024-04-03T03:46:01.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.522+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=ZKDH93LX9UV9 type=del size=3090560 2024-04-03T03:46:01.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.526+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=DZXGN3WL9SSB type=del 2024-04-03T03:46:01.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.534+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~2TOO8JSMKJK1.0 size=1048576 2024-04-03T03:46:01.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.534+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~2TOO8JSMKJK1.1 size=1048576 2024-04-03T03:46:01.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.538+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~2TOO8JSMKJK1.2 size=106807 2024-04-03T03:46:01.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.538+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=2TOO8JSMKJK1 tag=ZEOP7L6HJVQ0 type=write size=3252535 2024-04-03T03:46:01.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.538+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~HIE1IBTAMZIM.0 size=1048576 2024-04-03T03:46:01.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.542+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~HIE1IBTAMZIM.1 size=117901 2024-04-03T03:46:01.541 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.546+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=HIE1IBTAMZIM tag=SQVL9ZGJZQ5H type=write size=2215053 2024-04-03T03:46:01.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.546+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=FEEXRCW9E2JM type=del size=3515303 2024-04-03T03:46:01.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.550+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~3WE9PY8ZOV9O.0 size=1048576 2024-04-03T03:46:01.548 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.550+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~3WE9PY8ZOV9O.1 size=1048576 2024-04-03T03:46:01.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.554+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~3WE9PY8ZOV9O.2 size=1034840 2024-04-03T03:46:01.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.558+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=3WE9PY8ZOV9O tag=C06A2UZSLDG9 type=write size=4180568 2024-04-03T03:46:01.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.558+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=1SEOOYW5XHE0 type=del size=1172058 2024-04-03T03:46:01.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.562+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~FZ5XOH029T0J.0 size=1048576 2024-04-03T03:46:01.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.562+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~FZ5XOH029T0J.1 size=872871 2024-04-03T03:46:01.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.566+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=FZ5XOH029T0J tag=K7X4OEG8MHIH type=write size=2970023 2024-04-03T03:46:01.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.570+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~XP3GSI663TC1.0 size=1048576 2024-04-03T03:46:01.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.574+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~XP3GSI663TC1.1 size=1048576 2024-04-03T03:46:01.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.574+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~XP3GSI663TC1.2 size=704690 2024-04-03T03:46:01.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.574+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=XP3GSI663TC1 tag=6001CWM83AJJ type=write size=3850418 2024-04-03T03:46:01.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.578+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~W3J92C5S41ZG.0 size=1048576 2024-04-03T03:46:01.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.578+0000 7f55269288c0 1 < canceled part key=_multipart_YCEKDT5EQD9D.2~W3J92C5S41ZG.1 size=192119 2024-04-03T03:46:01.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.582+0000 7f55269288c0 1 < canceled multipart upload key=YCEKDT5EQD9D upload=W3J92C5S41ZG tag=DDVRQRRCN082 type=write size=2289271 2024-04-03T03:46:01.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.582+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=AKKTOO3M6M46 type=del size=1709745 2024-04-03T03:46:01.583 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.586+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~X038YBBJ2FSI.0 size=375006 2024-04-03T03:46:01.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.590+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=X038YBBJ2FSI tag=0IUT4S1CNHR7 type=write size=1423582 2024-04-03T03:46:01.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.594+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=5X0O9QEJL9JS type=del size=950309 2024-04-03T03:46:01.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.598+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~H79BE0ZEADTC.0 size=287771 2024-04-03T03:46:01.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.602+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=H79BE0ZEADTC tag=BCUFAAZNY6VO type=write size=1336347 2024-04-03T03:46:01.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.602+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=WU7UTT0DBMC3 type=write size=913893 2024-04-03T03:46:01.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.606+0000 7f55269288c0 1 < completed write operation key=TLM1C3B9J2A3 tag=ZAR8VGZ6CV86 type=write size=295609 2024-04-03T03:46:01.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.610+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~GD2O1ZBCZCDG.0 size=1048576 2024-04-03T03:46:01.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.610+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~GD2O1ZBCZCDG.1 size=728918 2024-04-03T03:46:01.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.610+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=GD2O1ZBCZCDG tag=0C06ZONXHEEB type=write size=2826070 2024-04-03T03:46:01.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.614+0000 7f55269288c0 1 < suggested remove operation key=U62RSK21LJEF tag=UL2670KY30XH type=del 2024-04-03T03:46:01.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.618+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=0V7RCPLC1A8Z type=del size=3409153 2024-04-03T03:46:01.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.622+0000 7f55269288c0 1 < suggested update operation key=B5BI0HJ5S1Y1 tag=86M10YPWRYD2 type=del size=4133018 2024-04-03T03:46:01.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.626+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=BCHF7JP5F0V0 type=del size=875274 2024-04-03T03:46:01.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.626+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~0C3Y2LESW52G.0 size=1048576 2024-04-03T03:46:01.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.630+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~0C3Y2LESW52G.1 size=674803 2024-04-03T03:46:01.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.634+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=0C3Y2LESW52G tag=XOC1WNTGZZEV type=write size=2771955 2024-04-03T03:46:01.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.634+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=P6Y1NMV613YI type=del size=4061839 2024-04-03T03:46:01.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.638+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=IFO1Z0Z1EFH0 type=del 2024-04-03T03:46:01.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.642+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~F9QA0S2NUI7B.0 size=1048576 2024-04-03T03:46:01.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.642+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~F9QA0S2NUI7B.1 size=79980 2024-04-03T03:46:01.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.642+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=F9QA0S2NUI7B tag=5PH1XNW7OM2U type=write size=2177132 2024-04-03T03:46:01.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.646+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=UIC7MFFUB5U4 type=del 2024-04-03T03:46:01.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.650+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~36FM2SPJSTGK.0 size=1048576 2024-04-03T03:46:01.650 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.654+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~36FM2SPJSTGK.1 size=1048576 2024-04-03T03:46:01.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.654+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~36FM2SPJSTGK.2 size=122919 2024-04-03T03:46:01.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.654+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=36FM2SPJSTGK tag=VX5A4TDU7VFV type=write size=3268647 2024-04-03T03:46:01.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.662+0000 7f55269288c0 1 < suggested remove operation key=LZQGL2UAWOTU tag=4HQP9SJWRZJ6 type=del 2024-04-03T03:46:01.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.662+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=K3DW6T8481HL type=del size=2328357 2024-04-03T03:46:01.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.666+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=OYT2ADRX5KG2 type=del 2024-04-03T03:46:01.664 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.666+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=4DBI4Y6GNVKI type=del size=2415523 2024-04-03T03:46:01.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.670+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=ZKDH93LX9UV9 type=del 2024-04-03T03:46:01.670 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.674+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=S43CK3EA0P5N type=del size=2458671 2024-04-03T03:46:01.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.678+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~2TOO8JSMKJK1.0 size=1048576 2024-04-03T03:46:01.675 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.678+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~2TOO8JSMKJK1.1 size=1048576 2024-04-03T03:46:01.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.682+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~2TOO8JSMKJK1.2 size=106807 2024-04-03T03:46:01.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.686+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=2TOO8JSMKJK1 tag=ZEOP7L6HJVQ0 type=write size=3252535 2024-04-03T03:46:01.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.690+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=8T5H7HPXAPZY type=del size=976401 2024-04-03T03:46:01.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.690+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=FEEXRCW9E2JM type=del 2024-04-03T03:46:01.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.698+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~2XTF49N8DOSM.0 size=1048576 2024-04-03T03:46:01.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.698+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~2XTF49N8DOSM.1 size=927184 2024-04-03T03:46:01.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.698+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=2XTF49N8DOSM tag=TZE6XIUH24IL type=write size=3024336 2024-04-03T03:46:01.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.702+0000 7f55269288c0 1 < suggested update operation key=8BMP0HIS520R tag=1SEOOYW5XHE0 type=del size=1172058 2024-04-03T03:46:01.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.706+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~ZSQSNWNGW5HB.0 size=366832 2024-04-03T03:46:01.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.706+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=ZSQSNWNGW5HB tag=ML2ZILCL9JG6 type=write size=1415408 2024-04-03T03:46:01.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.710+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~XP3GSI663TC1.0 size=1048576 2024-04-03T03:46:01.707 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.710+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~XP3GSI663TC1.1 size=1048576 2024-04-03T03:46:01.709 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.714+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~XP3GSI663TC1.2 size=704690 2024-04-03T03:46:01.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.718+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=XP3GSI663TC1 tag=6001CWM83AJJ type=write size=3850418 2024-04-03T03:46:01.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.722+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~2698U9U9K0US.0 size=1048576 2024-04-03T03:46:01.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.722+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~2698U9U9K0US.1 size=395605 2024-04-03T03:46:01.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.722+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=2698U9U9K0US tag=WCPW1OJJKVMJ type=write size=2492757 2024-04-03T03:46:01.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.726+0000 7f55269288c0 1 < suggested remove operation key=3XKXK1JXKOHU tag=AKKTOO3M6M46 type=del 2024-04-03T03:46:01.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.730+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=3VWU9ENNTHUG type=del size=2758228 2024-04-03T03:46:01.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.730+0000 7f55269288c0 -1 < failed to complete operation key=B5BI0HJ5S1Y1 tag=5X0O9QEJL9JS type=del size=950309: (22) Invalid argument 2024-04-03T03:46:01.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.734+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=GB9JEP5ZQUC8 type=del size=1750142 2024-04-03T03:46:01.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.738+0000 7f55269288c0 1 < suggested remove operation key=D8W2ZKIZFI8H tag=WU7UTT0DBMC3 type=write 2024-04-03T03:46:01.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.738+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=3F6O43LPF723 type=del size=4095437 2024-04-03T03:46:01.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.742+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~GD2O1ZBCZCDG.0 size=1048576 2024-04-03T03:46:01.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.742+0000 7f55269288c0 1 < canceled part key=_multipart_JAXVD60NI5YW.2~GD2O1ZBCZCDG.1 size=728918 2024-04-03T03:46:01.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.746+0000 7f55269288c0 1 < canceled multipart upload key=JAXVD60NI5YW upload=GD2O1ZBCZCDG tag=0C06ZONXHEEB type=write size=2826070 2024-04-03T03:46:01.744 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.746+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=5G06VZ5UXXA1 type=del size=3995518 2024-04-03T03:46:01.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.754+0000 7f55269288c0 1 < suggested update operation key=AGTQQYXO7453 tag=0V7RCPLC1A8Z type=del size=3409153 2024-04-03T03:46:01.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.758+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~2NQO3TVLKR5Q.0 size=50473 2024-04-03T03:46:01.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.758+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=2NQO3TVLKR5Q tag=K91ZYDXA1EUE type=write size=1099049 2024-04-03T03:46:01.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.762+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=BCHF7JP5F0V0 type=del 2024-04-03T03:46:01.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.766+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~RV6NRT1QRVVU.0 size=722978 2024-04-03T03:46:01.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.766+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=RV6NRT1QRVVU tag=RH4M70ITKLXP type=write size=1771554 2024-04-03T03:46:01.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.766+0000 7f55269288c0 -1 < failed to complete operation key=LZQGL2UAWOTU tag=P6Y1NMV613YI type=del size=4061839: (22) Invalid argument 2024-04-03T03:46:01.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.770+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=IEQXBJNXYLEK type=del size=2410424 2024-04-03T03:46:01.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.770+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~F9QA0S2NUI7B.0 size=1048576 2024-04-03T03:46:01.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.774+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~F9QA0S2NUI7B.1 size=79980 2024-04-03T03:46:01.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.778+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=F9QA0S2NUI7B tag=5PH1XNW7OM2U type=write size=2177132 2024-04-03T03:46:01.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.782+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~G3WX7IPA3DGG.0 size=902433 2024-04-03T03:46:01.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.782+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=G3WX7IPA3DGG tag=W52BOR3OZYUV type=write size=1951009 2024-04-03T03:46:01.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.786+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~36FM2SPJSTGK.0 size=1048576 2024-04-03T03:46:01.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.790+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~36FM2SPJSTGK.1 size=1048576 2024-04-03T03:46:01.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.790+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~36FM2SPJSTGK.2 size=122919 2024-04-03T03:46:01.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.794+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=36FM2SPJSTGK tag=VX5A4TDU7VFV type=write size=3268647 2024-04-03T03:46:01.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.798+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=FRLG7U91OEHJ type=del size=2503730 2024-04-03T03:46:01.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.802+0000 7f55269288c0 1 < suggested update operation key=K3Z9W19WEJBM tag=K3DW6T8481HL type=del size=2328357 2024-04-03T03:46:01.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.806+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=OOSNSSUE4PPP type=del size=2080143 2024-04-03T03:46:01.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.806+0000 7f55269288c0 1 < canceled operation key=CPR27NMHPIPQ tag=4DBI4Y6GNVKI type=del size=2415523 2024-04-03T03:46:01.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.810+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=DDT164OWN82J type=del size=2092097 2024-04-03T03:46:01.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.814+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=S43CK3EA0P5N type=del 2024-04-03T03:46:01.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.818+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=QYXJQ08HBLZR type=del size=2182292 2024-04-03T03:46:01.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.818+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=8T5H7HPXAPZY type=del 2024-04-03T03:46:01.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.822+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=UHWAGZ0G7DXR type=del size=354811 2024-04-03T03:46:01.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.826+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~2XTF49N8DOSM.0 size=1048576 2024-04-03T03:46:01.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.826+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~2XTF49N8DOSM.1 size=927184 2024-04-03T03:46:01.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.830+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=2XTF49N8DOSM tag=TZE6XIUH24IL type=write size=3024336 2024-04-03T03:46:01.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.834+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~8HV0YUAPNJ92.0 size=1048576 2024-04-03T03:46:01.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.838+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~8HV0YUAPNJ92.1 size=939096 2024-04-03T03:46:01.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.838+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=8HV0YUAPNJ92 tag=QEHKPBOGWD7Z type=write size=3036248 2024-04-03T03:46:01.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.842+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~ZSQSNWNGW5HB.0 size=366832 2024-04-03T03:46:01.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.846+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=ZSQSNWNGW5HB tag=ML2ZILCL9JG6 type=write size=1415408 2024-04-03T03:46:01.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.850+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=LSG8NN9R1AVB type=del size=2683163 2024-04-03T03:46:01.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.854+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~2698U9U9K0US.0 size=1048576 2024-04-03T03:46:01.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.854+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~2698U9U9K0US.1 size=395605 2024-04-03T03:46:01.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.858+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=2698U9U9K0US tag=WCPW1OJJKVMJ type=write size=2492757 2024-04-03T03:46:01.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.862+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=KW0PUQ1R20KD type=del size=3095932 2024-04-03T03:46:01.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.866+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=3VWU9ENNTHUG type=del 2024-04-03T03:46:01.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.866+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=MFMGX0Q3F89T type=write size=354234 2024-04-03T03:46:01.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.870+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=GB9JEP5ZQUC8 type=del 2024-04-03T03:46:01.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.874+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=7GR98AN6DN3S type=write size=633135 2024-04-03T03:46:01.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.878+0000 7f55269288c0 1 < canceled operation key=K7A1O21ZURWQ tag=3F6O43LPF723 type=del size=4095437 2024-04-03T03:46:01.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.882+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=2QL5HITMU2TO type=del size=4166621 2024-04-03T03:46:01.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.882+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=5G06VZ5UXXA1 type=del 2024-04-03T03:46:01.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.886+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=RW0A8SREZBL7 type=del size=630162 2024-04-03T03:46:01.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.890+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~2NQO3TVLKR5Q.0 size=50473 2024-04-03T03:46:01.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.894+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=2NQO3TVLKR5Q tag=K91ZYDXA1EUE type=write size=1099049 2024-04-03T03:46:01.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.894+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=DFFUQJN1BSU1 type=del size=587286 2024-04-03T03:46:01.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.898+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~RV6NRT1QRVVU.0 size=722978 2024-04-03T03:46:01.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.902+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=RV6NRT1QRVVU tag=RH4M70ITKLXP type=write size=1771554 2024-04-03T03:46:01.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.910+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~SN8HBIKV6WZS.0 size=1048576 2024-04-03T03:46:01.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.910+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~SN8HBIKV6WZS.1 size=714084 2024-04-03T03:46:01.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.910+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=SN8HBIKV6WZS tag=P37MVEW7D31V type=write size=2811236 2024-04-03T03:46:01.910 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.914+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=IEQXBJNXYLEK type=del 2024-04-03T03:46:01.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.918+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~TC8LE4VDJH5H.0 size=1048576 2024-04-03T03:46:01.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.922+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~TC8LE4VDJH5H.1 size=109684 2024-04-03T03:46:01.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.922+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=TC8LE4VDJH5H tag=EH2TGRSWEQTH type=write size=2206836 2024-04-03T03:46:01.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.922+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~G3WX7IPA3DGG.0 size=902433 2024-04-03T03:46:01.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.930+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=G3WX7IPA3DGG tag=W52BOR3OZYUV type=write size=1951009 2024-04-03T03:46:01.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.934+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~UBR6ONM3YNR7.0 size=60191 2024-04-03T03:46:01.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.934+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=UBR6ONM3YNR7 tag=OXQ9S8Z926PG type=write size=1108767 2024-04-03T03:46:01.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.938+0000 7f55269288c0 1 < suggested remove operation key=3XKXK1JXKOHU tag=FRLG7U91OEHJ type=del 2024-04-03T03:46:01.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.942+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=1LA8Q02RJ850 type=del size=1419986 2024-04-03T03:46:01.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.946+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=OOSNSSUE4PPP type=del 2024-04-03T03:46:01.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.950+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~FYM3UAF91GBF.0 size=1042723 2024-04-03T03:46:01.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.950+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=FYM3UAF91GBF tag=RJ5RZDUW5KNB type=write size=2091299 2024-04-03T03:46:01.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.954+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=DDT164OWN82J type=del 2024-04-03T03:46:01.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.958+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~L6U9ZXISK30C.0 size=1048576 2024-04-03T03:46:01.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.962+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~L6U9ZXISK30C.1 size=1103 2024-04-03T03:46:01.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.962+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=L6U9ZXISK30C tag=PMKU8S6K3YJ2 type=write size=2098255 2024-04-03T03:46:01.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.966+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=QYXJQ08HBLZR type=del 2024-04-03T03:46:01.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.966+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=48LC8H672GD8 type=del size=837418 2024-04-03T03:46:01.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.970+0000 7f55269288c0 1 < canceled operation key=0OSIL0R5ZJ54 tag=UHWAGZ0G7DXR type=del size=354811 2024-04-03T03:46:01.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.974+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~SVDH9KYFUWUH.0 size=1048576 2024-04-03T03:46:01.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.978+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~SVDH9KYFUWUH.1 size=154763 2024-04-03T03:46:01.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.978+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=SVDH9KYFUWUH tag=A1MJQWO1K9F6 type=write size=2251915 2024-04-03T03:46:01.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.978+0000 7f55269288c0 1 < canceled part key=_multipart_JAXVD60NI5YW.2~8HV0YUAPNJ92.0 size=1048576 2024-04-03T03:46:01.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.982+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~8HV0YUAPNJ92.1 size=939096 2024-04-03T03:46:01.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.986+0000 7f55269288c0 1 < canceled multipart upload key=JAXVD60NI5YW upload=8HV0YUAPNJ92 tag=QEHKPBOGWD7Z type=write size=3036248 2024-04-03T03:46:01.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.990+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=S9ZT9F3OHJOC type=del size=4090861 2024-04-03T03:46:01.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.990+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=LSG8NN9R1AVB type=del 2024-04-03T03:46:01.991 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.994+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=VVFOWJ932ARU type=del size=3214350 2024-04-03T03:46:01.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:01.998+0000 7f55269288c0 1 < canceled operation key=F6IBZ80J4SDM tag=KW0PUQ1R20KD type=del size=3095932 2024-04-03T03:46:01.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.002+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~ZZGGYSCS1R7D.0 size=442908 2024-04-03T03:46:01.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.002+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=ZZGGYSCS1R7D tag=6KKGY02HMWWD type=write size=1491484 2024-04-03T03:46:02.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.002+0000 7f55269288c0 1 < completed write operation key=U62RSK21LJEF tag=MFMGX0Q3F89T type=write size=354234 2024-04-03T03:46:02.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.010+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~4DQ1PNAKH4P3.0 size=1048576 2024-04-03T03:46:02.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.014+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~4DQ1PNAKH4P3.1 size=1048576 2024-04-03T03:46:02.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.014+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~4DQ1PNAKH4P3.2 size=555204 2024-04-03T03:46:02.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.014+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=4DQ1PNAKH4P3 tag=2GTCMNE4V4KA type=write size=3700932 2024-04-03T03:46:02.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.018+0000 7f55269288c0 1 < canceled operation key=7POFUQ9CX6B1 tag=7GR98AN6DN3S type=write size=633135 2024-04-03T03:46:02.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.022+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=U55BABQV3URM type=del size=2665617 2024-04-03T03:46:02.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.026+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=2QL5HITMU2TO type=del 2024-04-03T03:46:02.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.030+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~0HVZ3AX1VB3E.0 size=126395 2024-04-03T03:46:02.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.030+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=0HVZ3AX1VB3E tag=VQOFP1GD5H30 type=write size=1174971 2024-04-03T03:46:02.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.034+0000 7f55269288c0 1 < canceled operation key=D9OEPPT37WSJ tag=RW0A8SREZBL7 type=del size=630162 2024-04-03T03:46:02.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.034+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=39VHS9N4F1I9 type=del size=1807559 2024-04-03T03:46:02.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.038+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=DFFUQJN1BSU1 type=del 2024-04-03T03:46:02.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.042+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~6L520E5NIV7T.0 size=1048576 2024-04-03T03:46:02.043 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.046+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~6L520E5NIV7T.1 size=1048576 2024-04-03T03:46:02.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.050+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~6L520E5NIV7T.2 size=409977 2024-04-03T03:46:02.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.050+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=6L520E5NIV7T tag=YH2AY19TIXJK type=write size=3555705 2024-04-03T03:46:02.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.050+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~SN8HBIKV6WZS.0 size=1048576 2024-04-03T03:46:02.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.054+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~SN8HBIKV6WZS.1 size=714084 2024-04-03T03:46:02.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.058+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=SN8HBIKV6WZS tag=P37MVEW7D31V type=write size=2811236 2024-04-03T03:46:02.057 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.062+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=CT21JOIY6HOA type=write size=801988 2024-04-03T03:46:02.060 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.062+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~TC8LE4VDJH5H.0 size=1048576 2024-04-03T03:46:02.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.066+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~TC8LE4VDJH5H.1 size=109684 2024-04-03T03:46:02.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.070+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=TC8LE4VDJH5H tag=EH2TGRSWEQTH type=write size=2206836 2024-04-03T03:46:02.069 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.074+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=X3S515A649BJ type=del size=1319829 2024-04-03T03:46:02.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.074+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~UBR6ONM3YNR7.0 size=60191 2024-04-03T03:46:02.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.078+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=UBR6ONM3YNR7 tag=OXQ9S8Z926PG type=write size=1108767 2024-04-03T03:46:02.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.082+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=QJ4CYL2DPOL8 type=del size=3192195 2024-04-03T03:46:02.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.082+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=1LA8Q02RJ850 type=del 2024-04-03T03:46:02.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.086+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=HIB0HSD3PV9B type=write size=35510 2024-04-03T03:46:02.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.086+0000 7f55269288c0 1 < canceled part key=_multipart_KDSE2XB4D1XI.2~FYM3UAF91GBF.0 size=1042723 2024-04-03T03:46:02.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.090+0000 7f55269288c0 1 < canceled multipart upload key=KDSE2XB4D1XI upload=FYM3UAF91GBF tag=RJ5RZDUW5KNB type=write size=2091299 2024-04-03T03:46:02.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.094+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=I40BY30EAFPM type=del size=4041478 2024-04-03T03:46:02.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.098+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~L6U9ZXISK30C.0 size=1048576 2024-04-03T03:46:02.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.098+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~L6U9ZXISK30C.1 size=1103 2024-04-03T03:46:02.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.106+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=L6U9ZXISK30C tag=PMKU8S6K3YJ2 type=write size=2098255 2024-04-03T03:46:02.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.110+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=NC26QVUEWGLT type=del size=4099200 2024-04-03T03:46:02.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.110+0000 7f55269288c0 1 < completed delete operation key=K3Z9W19WEJBM tag=48LC8H672GD8 type=del 2024-04-03T03:46:02.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.114+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~424FIUR1XDDI.0 size=57125 2024-04-03T03:46:02.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.114+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=424FIUR1XDDI tag=IPTPEN4GIZCS type=write size=1105701 2024-04-03T03:46:02.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.118+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~SVDH9KYFUWUH.0 size=1048576 2024-04-03T03:46:02.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.122+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~SVDH9KYFUWUH.1 size=154763 2024-04-03T03:46:02.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.126+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=SVDH9KYFUWUH tag=A1MJQWO1K9F6 type=write size=2251915 2024-04-03T03:46:02.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.130+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~1ZEY1YIL971Q.0 size=115506 2024-04-03T03:46:02.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.130+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=1ZEY1YIL971Q tag=GUOJ5JJBZZXB type=write size=1164082 2024-04-03T03:46:02.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.134+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=S9ZT9F3OHJOC type=del 2024-04-03T03:46:02.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.138+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=E62RZGONECDU type=write size=463802 2024-04-03T03:46:02.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.138+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=VVFOWJ932ARU type=del 2024-04-03T03:46:02.138 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.142+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=X3Q7I4CEXWTE type=del size=2390921 2024-04-03T03:46:02.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.146+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~ZZGGYSCS1R7D.0 size=442908 2024-04-03T03:46:02.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.150+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=ZZGGYSCS1R7D tag=6KKGY02HMWWD type=write size=1491484 2024-04-03T03:46:02.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.150+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=XG89ET38QBYP type=del size=1518239 2024-04-03T03:46:02.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.154+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~4DQ1PNAKH4P3.0 size=1048576 2024-04-03T03:46:02.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.158+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~4DQ1PNAKH4P3.1 size=1048576 2024-04-03T03:46:02.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.158+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~4DQ1PNAKH4P3.2 size=555204 2024-04-03T03:46:02.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.166+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=4DQ1PNAKH4P3 tag=2GTCMNE4V4KA type=write size=3700932 2024-04-03T03:46:02.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.170+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~7QZZVFJ94K6K.0 size=1048576 2024-04-03T03:46:02.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.174+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~7QZZVFJ94K6K.1 size=1048576 2024-04-03T03:46:02.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.174+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~7QZZVFJ94K6K.2 size=753252 2024-04-03T03:46:02.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.174+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=7QZZVFJ94K6K tag=D7JRM7JZFC3E type=write size=3898980 2024-04-03T03:46:02.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.178+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=U55BABQV3URM type=del size=2665617 2024-04-03T03:46:02.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.182+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=OLUPOWQQLQPJ type=del size=2822269 2024-04-03T03:46:02.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.182+0000 7f55269288c0 1 < canceled part key=_multipart_LZQGL2UAWOTU.2~0HVZ3AX1VB3E.0 size=126395 2024-04-03T03:46:02.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.186+0000 7f55269288c0 1 < canceled multipart upload key=LZQGL2UAWOTU upload=0HVZ3AX1VB3E tag=VQOFP1GD5H30 type=write size=1174971 2024-04-03T03:46:02.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.190+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~615EM1ORV0LL.0 size=714323 2024-04-03T03:46:02.189 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.190+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=615EM1ORV0LL tag=K66V7W9R6V57 type=write size=1762899 2024-04-03T03:46:02.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.194+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=39VHS9N4F1I9 type=del 2024-04-03T03:46:02.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.198+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=E00VC4A67V6T type=del size=2667091 2024-04-03T03:46:02.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.202+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~6L520E5NIV7T.0 size=1048576 2024-04-03T03:46:02.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.202+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~6L520E5NIV7T.1 size=1048576 2024-04-03T03:46:02.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.206+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~6L520E5NIV7T.2 size=409977 2024-04-03T03:46:02.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.210+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=6L520E5NIV7T tag=YH2AY19TIXJK type=write size=3555705 2024-04-03T03:46:02.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.214+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=SQO0W9Q6JAGK type=del size=149488 2024-04-03T03:46:02.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.214+0000 7f55269288c0 1 < completed write operation key=CPR27NMHPIPQ tag=CT21JOIY6HOA type=write size=801988 2024-04-03T03:46:02.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.222+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~9A2L6PC6Z7ET.0 size=1048576 2024-04-03T03:46:02.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.222+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~9A2L6PC6Z7ET.1 size=1048576 2024-04-03T03:46:02.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.226+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~9A2L6PC6Z7ET.2 size=1023957 2024-04-03T03:46:02.222 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.226+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=9A2L6PC6Z7ET tag=87OG1YWZO81R type=write size=4169685 2024-04-03T03:46:02.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.226+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=X3S515A649BJ type=del 2024-04-03T03:46:02.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.230+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=K44ISDKK15UV type=write size=754663 2024-04-03T03:46:02.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.234+0000 7f55269288c0 1 < suggested update operation key=0OSIL0R5ZJ54 tag=QJ4CYL2DPOL8 type=del size=3192195 2024-04-03T03:46:02.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.238+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=RGDF8UAKDL5U type=del size=3281387 2024-04-03T03:46:02.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.246+0000 7f55269288c0 1 < suggested update operation key=K7A1O21ZURWQ tag=HIB0HSD3PV9B type=write size=35510 2024-04-03T03:46:02.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.246+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=O15XCSO0T580 type=del size=3710465 2024-04-03T03:46:02.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.254+0000 7f55269288c0 1 < suggested update operation key=KU1R0YLDP1V3 tag=I40BY30EAFPM type=del size=4041478 2024-04-03T03:46:02.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.254+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=DNQWXM14Q175 type=write size=314143 2024-04-03T03:46:02.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.258+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=NC26QVUEWGLT type=del 2024-04-03T03:46:02.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.262+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=CAWU8H3ZEEBG type=write size=208177 2024-04-03T03:46:02.260 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.262+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~424FIUR1XDDI.0 size=57125 2024-04-03T03:46:02.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.270+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=424FIUR1XDDI tag=IPTPEN4GIZCS type=write size=1105701 2024-04-03T03:46:02.268 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.270+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=3FV21JRW666K type=write size=433006 2024-04-03T03:46:02.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.278+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~1ZEY1YIL971Q.0 size=115506 2024-04-03T03:46:02.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.282+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=1ZEY1YIL971Q tag=GUOJ5JJBZZXB type=write size=1164082 2024-04-03T03:46:02.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.286+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=E1Z1GX6MYW3B type=del size=726504 2024-04-03T03:46:02.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.286+0000 7f55269288c0 1 < completed write operation key=LZQGL2UAWOTU tag=E62RZGONECDU type=write size=463802 2024-04-03T03:46:02.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.290+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=2PM7AC34HQ6S type=del size=356609 2024-04-03T03:46:02.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.294+0000 7f55269288c0 1 < suggested update operation key=CPR27NMHPIPQ tag=X3Q7I4CEXWTE type=del size=2390921 2024-04-03T03:46:02.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.298+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=WB1XY365VTL9 type=del size=3963622 2024-04-03T03:46:02.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.302+0000 7f55269288c0 -1 < failed to complete operation key=K7A1O21ZURWQ tag=XG89ET38QBYP type=del size=1518239: (22) Invalid argument 2024-04-03T03:46:02.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.306+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~QXTQLXAF2L42.0 size=1048576 2024-04-03T03:46:02.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.306+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~QXTQLXAF2L42.1 size=1048576 2024-04-03T03:46:02.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.310+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~QXTQLXAF2L42.2 size=716792 2024-04-03T03:46:02.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.310+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=QXTQLXAF2L42 tag=YW8KML9U124S type=write size=3862520 2024-04-03T03:46:02.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.310+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~7QZZVFJ94K6K.0 size=1048576 2024-04-03T03:46:02.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.314+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~7QZZVFJ94K6K.1 size=1048576 2024-04-03T03:46:02.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.314+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~7QZZVFJ94K6K.2 size=753252 2024-04-03T03:46:02.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.322+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=7QZZVFJ94K6K tag=D7JRM7JZFC3E type=write size=3898980 2024-04-03T03:46:02.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.326+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=3NM1FNFHR97A type=del size=2519878 2024-04-03T03:46:02.325 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.330+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=OLUPOWQQLQPJ type=del 2024-04-03T03:46:02.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.330+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=BFTKEJ6M5EOV type=del size=3561730 2024-04-03T03:46:02.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.334+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~615EM1ORV0LL.0 size=714323 2024-04-03T03:46:02.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.338+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=615EM1ORV0LL tag=K66V7W9R6V57 type=write size=1762899 2024-04-03T03:46:02.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.342+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=28N14TU0OB4F type=del size=2807274 2024-04-03T03:46:02.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.342+0000 7f55269288c0 1 < canceled operation key=AXL5RVPSVDY5 tag=E00VC4A67V6T type=del size=2667091 2024-04-03T03:46:02.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.346+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=Y2LRKI2W4KE3 type=del size=4181959 2024-04-03T03:46:02.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.346+0000 7f55269288c0 -1 < failed to complete operation key=CPR27NMHPIPQ tag=SQO0W9Q6JAGK type=del size=149488: (22) Invalid argument 2024-04-03T03:46:02.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.350+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=BDE1FVJ2HD05 type=write size=301347 2024-04-03T03:46:02.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.354+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~9A2L6PC6Z7ET.0 size=1048576 2024-04-03T03:46:02.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.354+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~9A2L6PC6Z7ET.1 size=1048576 2024-04-03T03:46:02.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.358+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~9A2L6PC6Z7ET.2 size=1023957 2024-04-03T03:46:02.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.362+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=9A2L6PC6Z7ET tag=87OG1YWZO81R type=write size=4169685 2024-04-03T03:46:02.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.362+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=AN0PKFVRFURN type=del size=2844431 2024-04-03T03:46:02.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.366+0000 7f55269288c0 1 < completed write operation key=AXL5RVPSVDY5 tag=K44ISDKK15UV type=write size=754663 2024-04-03T03:46:02.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.370+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~939HY0CULYHH.0 size=1048576 2024-04-03T03:46:02.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.370+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~939HY0CULYHH.1 size=1020904 2024-04-03T03:46:02.369 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.370+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=939HY0CULYHH tag=586D5H83Q9MH type=write size=3118056 2024-04-03T03:46:02.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.374+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=RGDF8UAKDL5U type=del 2024-04-03T03:46:02.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.378+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=0L3VS6MG41OL type=del size=3194171 2024-04-03T03:46:02.376 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.378+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=O15XCSO0T580 type=del 2024-04-03T03:46:02.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.386+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~6KZ29NH0OWHL.0 size=1048576 2024-04-03T03:46:02.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.386+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~6KZ29NH0OWHL.1 size=1048576 2024-04-03T03:46:02.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.390+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~6KZ29NH0OWHL.2 size=527763 2024-04-03T03:46:02.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.390+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=6KZ29NH0OWHL tag=YESX7QS1O7T9 type=write size=3673491 2024-04-03T03:46:02.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.394+0000 7f55269288c0 1 < suggested remove operation key=AGTQQYXO7453 tag=DNQWXM14Q175 type=write 2024-04-03T03:46:02.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.398+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=13C8VTYOALH2 type=del size=1588618 2024-04-03T03:46:02.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.398+0000 7f55269288c0 1 < completed write operation key=7POFUQ9CX6B1 tag=CAWU8H3ZEEBG type=write size=208177 2024-04-03T03:46:02.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.402+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=HNU5P1XQ8Y9A type=del size=508989 2024-04-03T03:46:02.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.406+0000 7f55269288c0 1 < completed write operation key=YCEKDT5EQD9D tag=3FV21JRW666K type=write size=433006 2024-04-03T03:46:02.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.410+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~PNMJVU0BRV1W.0 size=1048576 2024-04-03T03:46:02.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.414+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~PNMJVU0BRV1W.1 size=159917 2024-04-03T03:46:02.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.414+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=PNMJVU0BRV1W tag=8FLVQNWCX7GA type=write size=2257069 2024-04-03T03:46:02.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.414+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=E1Z1GX6MYW3B type=del 2024-04-03T03:46:02.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.422+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~D3QAT1TSBV4L.0 size=1048576 2024-04-03T03:46:02.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.422+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~D3QAT1TSBV4L.1 size=1048576 2024-04-03T03:46:02.422 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.426+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~D3QAT1TSBV4L.2 size=30866 2024-04-03T03:46:02.422 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.426+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=D3QAT1TSBV4L tag=NC9BLA6O9FVG type=write size=3176594 2024-04-03T03:46:02.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.430+0000 7f55269288c0 1 < canceled operation key=TLM1C3B9J2A3 tag=2PM7AC34HQ6S type=del size=356609 2024-04-03T03:46:02.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.430+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=9S14S2YY03FM type=del size=4096389 2024-04-03T03:46:02.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.434+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=WB1XY365VTL9 type=del 2024-04-03T03:46:02.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.438+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~MG3MSIUMD8BO.0 size=1048576 2024-04-03T03:46:02.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.442+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~MG3MSIUMD8BO.1 size=851909 2024-04-03T03:46:02.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.442+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=MG3MSIUMD8BO tag=MIY9UFA9SQGP type=write size=2949061 2024-04-03T03:46:02.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.442+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~QXTQLXAF2L42.0 size=1048576 2024-04-03T03:46:02.442 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.446+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~QXTQLXAF2L42.1 size=1048576 2024-04-03T03:46:02.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.446+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~QXTQLXAF2L42.2 size=716792 2024-04-03T03:46:02.450 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.454+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=QXTQLXAF2L42 tag=YW8KML9U124S type=write size=3862520 2024-04-03T03:46:02.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.458+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~UOFGLE4SIE5D.0 size=1048576 2024-04-03T03:46:02.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.458+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~UOFGLE4SIE5D.1 size=610317 2024-04-03T03:46:02.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.458+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=UOFGLE4SIE5D tag=HA16CU4X22QK type=write size=2707469 2024-04-03T03:46:02.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.462+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=3NM1FNFHR97A type=del 2024-04-03T03:46:02.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.466+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~AZ90NANXV5NR.0 size=1048576 2024-04-03T03:46:02.465 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.470+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~AZ90NANXV5NR.1 size=630969 2024-04-03T03:46:02.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.470+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=AZ90NANXV5NR tag=KLNU7NEN4M5S type=write size=2728121 2024-04-03T03:46:02.468 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.470+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=BFTKEJ6M5EOV type=del 2024-04-03T03:46:02.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.478+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~U17PN6LF4F7D.0 size=1048576 2024-04-03T03:46:02.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.478+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~U17PN6LF4F7D.1 size=1048576 2024-04-03T03:46:02.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.482+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~U17PN6LF4F7D.2 size=946457 2024-04-03T03:46:02.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.482+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=U17PN6LF4F7D tag=KO6WXKXUX0WI type=write size=4092185 2024-04-03T03:46:02.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.482+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=28N14TU0OB4F type=del 2024-04-03T03:46:02.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.486+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=0M0SR1Z4SX1K type=del size=1958361 2024-04-03T03:46:02.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.490+0000 7f55269288c0 1 < canceled operation key=TW860A14J9RC tag=Y2LRKI2W4KE3 type=del size=4181959 2024-04-03T03:46:02.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.494+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~UTSXPU06XFHC.0 size=1048576 2024-04-03T03:46:02.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.494+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~UTSXPU06XFHC.1 size=99001 2024-04-03T03:46:02.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.494+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=UTSXPU06XFHC tag=6FIS1HIP4OUC type=write size=2196153 2024-04-03T03:46:02.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.498+0000 7f55269288c0 1 < canceled operation key=AXL5RVPSVDY5 tag=BDE1FVJ2HD05 type=write size=301347 2024-04-03T03:46:02.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.502+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=GJRG7NDKFHZ3 type=write size=971673 2024-04-03T03:46:02.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.502+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=AN0PKFVRFURN type=del 2024-04-03T03:46:02.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.506+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=AYCLX8SMATUG type=write size=97769 2024-04-03T03:46:02.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.506+0000 7f55269288c0 1 < canceled part key=_multipart_X3YCYKP2P9IM.2~939HY0CULYHH.0 size=1048576 2024-04-03T03:46:02.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.510+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~939HY0CULYHH.1 size=1020904 2024-04-03T03:46:02.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.514+0000 7f55269288c0 1 < canceled multipart upload key=X3YCYKP2P9IM upload=939HY0CULYHH tag=586D5H83Q9MH type=write size=3118056 2024-04-03T03:46:02.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.518+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=K9D0UTQI4OW0 type=del size=204842 2024-04-03T03:46:02.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.518+0000 7f55269288c0 -1 < no bi entry to suggest for operation key=AGTQQYXO7453 tag=0L3VS6MG41OL type=del size=3194171: (2) No such file or directory 2024-04-03T03:46:02.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.526+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~V99CBZGLZ5RT.0 size=150708 2024-04-03T03:46:02.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.526+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=V99CBZGLZ5RT tag=KGYI9PC9UF8A type=write size=1199284 2024-04-03T03:46:02.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.530+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~6KZ29NH0OWHL.0 size=1048576 2024-04-03T03:46:02.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.534+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~6KZ29NH0OWHL.1 size=1048576 2024-04-03T03:46:02.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.538+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~6KZ29NH0OWHL.2 size=527763 2024-04-03T03:46:02.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.542+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=6KZ29NH0OWHL tag=YESX7QS1O7T9 type=write size=3673491 2024-04-03T03:46:02.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.546+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~P7Q9SHZVFX71.0 size=245563 2024-04-03T03:46:02.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.546+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=P7Q9SHZVFX71 tag=H20F7JEQ0QQF type=write size=1294139 2024-04-03T03:46:02.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.550+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=13C8VTYOALH2 type=del 2024-04-03T03:46:02.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.554+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=DXCK1XN71O5O type=del size=3358474 2024-04-03T03:46:02.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.558+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=HNU5P1XQ8Y9A type=del 2024-04-03T03:46:02.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.558+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=WUHW23JKIXGZ type=del size=4162248 2024-04-03T03:46:02.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.562+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~PNMJVU0BRV1W.0 size=1048576 2024-04-03T03:46:02.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.566+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~PNMJVU0BRV1W.1 size=159917 2024-04-03T03:46:02.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.570+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=PNMJVU0BRV1W tag=8FLVQNWCX7GA type=write size=2257069 2024-04-03T03:46:02.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.574+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=TYLVN0UYKDS4 type=write size=904462 2024-04-03T03:46:02.573 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.578+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~D3QAT1TSBV4L.0 size=1048576 2024-04-03T03:46:02.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.578+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~D3QAT1TSBV4L.1 size=1048576 2024-04-03T03:46:02.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.582+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~D3QAT1TSBV4L.2 size=30866 2024-04-03T03:46:02.583 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.586+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=D3QAT1TSBV4L tag=NC9BLA6O9FVG type=write size=3176594 2024-04-03T03:46:02.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.594+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~YDP4GQDFBVYC.0 size=22780 2024-04-03T03:46:02.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.594+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=YDP4GQDFBVYC tag=7FGXUGZFSPE8 type=write size=1071356 2024-04-03T03:46:02.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.598+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=9S14S2YY03FM type=del 2024-04-03T03:46:02.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.602+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~X0C9I2ZIBIIB.0 size=432434 2024-04-03T03:46:02.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.602+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=X0C9I2ZIBIIB tag=NT6R6Y3CVBE1 type=write size=1481010 2024-04-03T03:46:02.603 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.606+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~MG3MSIUMD8BO.0 size=1048576 2024-04-03T03:46:02.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.610+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~MG3MSIUMD8BO.1 size=851909 2024-04-03T03:46:02.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.614+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=MG3MSIUMD8BO tag=MIY9UFA9SQGP type=write size=2949061 2024-04-03T03:46:02.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.618+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=MAHII58CDDNG type=write size=329079 2024-04-03T03:46:02.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.618+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~UOFGLE4SIE5D.0 size=1048576 2024-04-03T03:46:02.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.622+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~UOFGLE4SIE5D.1 size=610317 2024-04-03T03:46:02.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.626+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=UOFGLE4SIE5D tag=HA16CU4X22QK type=write size=2707469 2024-04-03T03:46:02.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.630+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=ZU9T1Y960SNH type=write size=305088 2024-04-03T03:46:02.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.634+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~AZ90NANXV5NR.0 size=1048576 2024-04-03T03:46:02.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.638+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~AZ90NANXV5NR.1 size=630969 2024-04-03T03:46:02.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.642+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=AZ90NANXV5NR tag=KLNU7NEN4M5S type=write size=2728121 2024-04-03T03:46:02.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.650+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~ZAQDUGAHLR0B.0 size=198188 2024-04-03T03:46:02.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.650+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=ZAQDUGAHLR0B tag=FIO26JKQO6X9 type=write size=1246764 2024-04-03T03:46:02.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.654+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~U17PN6LF4F7D.0 size=1048576 2024-04-03T03:46:02.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.654+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~U17PN6LF4F7D.1 size=1048576 2024-04-03T03:46:02.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.658+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~U17PN6LF4F7D.2 size=946457 2024-04-03T03:46:02.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.662+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=U17PN6LF4F7D tag=KO6WXKXUX0WI type=write size=4092185 2024-04-03T03:46:02.665 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.670+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~OU97J21N2NDJ.0 size=1048576 2024-04-03T03:46:02.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.670+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~OU97J21N2NDJ.1 size=1048576 2024-04-03T03:46:02.670 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.674+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~OU97J21N2NDJ.2 size=1011602 2024-04-03T03:46:02.670 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.674+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=OU97J21N2NDJ tag=44IZ61PE5YK9 type=write size=4157330 2024-04-03T03:46:02.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.678+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=0M0SR1Z4SX1K type=del 2024-04-03T03:46:02.676 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.678+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=1Z8SONYNY22W type=del size=924289 2024-04-03T03:46:02.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.682+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~UTSXPU06XFHC.0 size=1048576 2024-04-03T03:46:02.683 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.686+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~UTSXPU06XFHC.1 size=99001 2024-04-03T03:46:02.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.690+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=UTSXPU06XFHC tag=6FIS1HIP4OUC type=write size=2196153 2024-04-03T03:46:02.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.694+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=OVFZQH3A5Y3W type=write size=916285 2024-04-03T03:46:02.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.698+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=GJRG7NDKFHZ3 type=write size=971673 2024-04-03T03:46:02.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.702+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=T6NJNA36FQ9G type=del size=1448608 2024-04-03T03:46:02.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.706+0000 7f55269288c0 1 < completed write operation key=U62RSK21LJEF tag=AYCLX8SMATUG type=write size=97769 2024-04-03T03:46:02.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.706+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=SLMFEEX4WFSC type=del size=2253771 2024-04-03T03:46:02.707 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.710+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=K9D0UTQI4OW0 type=del 2024-04-03T03:46:02.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.718+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~Z47MEA6HBMR3.0 size=1048576 2024-04-03T03:46:02.715 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.718+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~Z47MEA6HBMR3.1 size=984269 2024-04-03T03:46:02.715 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.718+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=Z47MEA6HBMR3 tag=VAT2KOFPONI1 type=write size=3081421 2024-04-03T03:46:02.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.722+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~V99CBZGLZ5RT.0 size=150708 2024-04-03T03:46:02.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.726+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=V99CBZGLZ5RT tag=KGYI9PC9UF8A type=write size=1199284 2024-04-03T03:46:02.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.730+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=FF62044AFDQI type=del size=1873959 2024-04-03T03:46:02.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.734+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~P7Q9SHZVFX71.0 size=245563 2024-04-03T03:46:02.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.738+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=P7Q9SHZVFX71 tag=H20F7JEQ0QQF type=write size=1294139 2024-04-03T03:46:02.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.742+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~YGIHMXNZB5RP.0 size=1048576 2024-04-03T03:46:02.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.746+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~YGIHMXNZB5RP.1 size=1048576 2024-04-03T03:46:02.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.750+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~YGIHMXNZB5RP.2 size=725181 2024-04-03T03:46:02.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.750+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=YGIHMXNZB5RP tag=ETBR3NAQS1UA type=write size=3870909 2024-04-03T03:46:02.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.750+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=DXCK1XN71O5O type=del 2024-04-03T03:46:02.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.758+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~YGVXOQJL4TDY.0 size=1048576 2024-04-03T03:46:02.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.758+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~YGVXOQJL4TDY.1 size=1048576 2024-04-03T03:46:02.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.762+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~YGVXOQJL4TDY.2 size=793532 2024-04-03T03:46:02.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.762+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=YGVXOQJL4TDY tag=XX21P9U93E6H type=write size=3939260 2024-04-03T03:46:02.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.770+0000 7f55269288c0 1 < suggested update operation key=Z42NDVEX1SOL tag=WUHW23JKIXGZ type=del size=4162248 2024-04-03T03:46:02.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.770+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=6AYTL5N608IL type=del size=1763572 2024-04-03T03:46:02.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.774+0000 7f55269288c0 1 < canceled operation key=TXFMKXUGMEA8 tag=TYLVN0UYKDS4 type=write size=904462 2024-04-03T03:46:02.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.782+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~1R40H2AZJVWP.0 size=1048576 2024-04-03T03:46:02.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.782+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~1R40H2AZJVWP.1 size=126221 2024-04-03T03:46:02.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.782+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=1R40H2AZJVWP tag=GE7Y8MD2B4I7 type=write size=2223373 2024-04-03T03:46:02.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.786+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~YDP4GQDFBVYC.0 size=22780 2024-04-03T03:46:02.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.790+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=YDP4GQDFBVYC tag=7FGXUGZFSPE8 type=write size=1071356 2024-04-03T03:46:02.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.794+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~KVX1GORK48SN.0 size=1048576 2024-04-03T03:46:02.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.798+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~KVX1GORK48SN.1 size=1048576 2024-04-03T03:46:02.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.798+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~KVX1GORK48SN.2 size=140990 2024-04-03T03:46:02.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.798+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=KVX1GORK48SN tag=LMFHS3811ZXT type=write size=3286718 2024-04-03T03:46:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.802+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~X0C9I2ZIBIIB.0 size=432434 2024-04-03T03:46:02.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.806+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=X0C9I2ZIBIIB tag=NT6R6Y3CVBE1 type=write size=1481010 2024-04-03T03:46:02.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.810+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~B4K1GGZTBHB9.0 size=1048576 2024-04-03T03:46:02.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.818+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~B4K1GGZTBHB9.1 size=1048576 2024-04-03T03:46:02.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.818+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~B4K1GGZTBHB9.2 size=361992 2024-04-03T03:46:02.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.818+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=B4K1GGZTBHB9 tag=ULZ6HFQGKNUI type=write size=3507720 2024-04-03T03:46:02.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.822+0000 7f55269288c0 1 < completed write operation key=JAXVD60NI5YW tag=MAHII58CDDNG type=write size=329079 2024-04-03T03:46:02.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.826+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=I2RN6C70ZRAG type=write size=821945 2024-04-03T03:46:02.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.830+0000 7f55269288c0 1 < suggested update operation key=TW860A14J9RC tag=ZU9T1Y960SNH type=write size=305088 2024-04-03T03:46:02.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.834+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=GF6TXN355LEN type=del size=492267 2024-04-03T03:46:02.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.834+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~ZAQDUGAHLR0B.0 size=198188 2024-04-03T03:46:02.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.838+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=ZAQDUGAHLR0B tag=FIO26JKQO6X9 type=write size=1246764 2024-04-03T03:46:02.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.842+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~CPJ1SEZO38BZ.0 size=1048576 2024-04-03T03:46:02.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.846+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~CPJ1SEZO38BZ.1 size=851363 2024-04-03T03:46:02.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.846+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=CPJ1SEZO38BZ tag=7WVKU19JILXC type=write size=2948515 2024-04-03T03:46:02.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.850+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~OU97J21N2NDJ.0 size=1048576 2024-04-03T03:46:02.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.850+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~OU97J21N2NDJ.1 size=1048576 2024-04-03T03:46:02.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.854+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~OU97J21N2NDJ.2 size=1011602 2024-04-03T03:46:02.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.858+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=OU97J21N2NDJ tag=44IZ61PE5YK9 type=write size=4157330 2024-04-03T03:46:02.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.858+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=1ZGY28VCAHX2 type=del size=3671447 2024-04-03T03:46:02.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.862+0000 7f55269288c0 1 < suggested update operation key=7POFUQ9CX6B1 tag=1Z8SONYNY22W type=del size=924289 2024-04-03T03:46:02.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.866+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~H552ZD9WVB72.0 size=1048576 2024-04-03T03:46:02.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.870+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~H552ZD9WVB72.1 size=84394 2024-04-03T03:46:02.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.870+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=H552ZD9WVB72 tag=BZYJB6ZQDB72 type=write size=2181546 2024-04-03T03:46:02.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.874+0000 7f55269288c0 1 < completed write operation key=CPR27NMHPIPQ tag=OVFZQH3A5Y3W type=write size=916285 2024-04-03T03:46:02.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.878+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~U4ROMYMQM1DU.0 size=1048576 2024-04-03T03:46:02.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.878+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~U4ROMYMQM1DU.1 size=1048576 2024-04-03T03:46:02.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.882+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~U4ROMYMQM1DU.2 size=895664 2024-04-03T03:46:02.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.882+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=U4ROMYMQM1DU tag=ZWTH058C7RPC type=write size=4041392 2024-04-03T03:46:02.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.882+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=T6NJNA36FQ9G type=del 2024-04-03T03:46:02.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.886+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=WUQ8SJVZM64O type=del size=1979920 2024-04-03T03:46:02.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.890+0000 7f55269288c0 1 < suggested remove operation key=D9OEPPT37WSJ tag=SLMFEEX4WFSC type=del 2024-04-03T03:46:02.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.894+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=X9CFL487VDNL type=del size=3359023 2024-04-03T03:46:02.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.894+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~Z47MEA6HBMR3.0 size=1048576 2024-04-03T03:46:02.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.898+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~Z47MEA6HBMR3.1 size=984269 2024-04-03T03:46:02.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.902+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=Z47MEA6HBMR3 tag=VAT2KOFPONI1 type=write size=3081421 2024-04-03T03:46:02.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.902+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=QK2TTMK6ZDDM type=del size=1829719 2024-04-03T03:46:02.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.906+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=FF62044AFDQI type=del 2024-04-03T03:46:02.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.910+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~0LLAPMXFFX17.0 size=972302 2024-04-03T03:46:02.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.910+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=0LLAPMXFFX17 tag=9WWFRKW9EV39 type=write size=2020878 2024-04-03T03:46:02.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.910+0000 7f55269288c0 1 < canceled part key=_multipart_TXFMKXUGMEA8.2~YGIHMXNZB5RP.0 size=1048576 2024-04-03T03:46:02.910 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.914+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~YGIHMXNZB5RP.1 size=1048576 2024-04-03T03:46:02.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.914+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~YGIHMXNZB5RP.2 size=725181 2024-04-03T03:46:02.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.922+0000 7f55269288c0 1 < canceled multipart upload key=TXFMKXUGMEA8 upload=YGIHMXNZB5RP tag=ETBR3NAQS1UA type=write size=3870909 2024-04-03T03:46:02.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.922+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=VM655ZZVZ3P7 type=del size=1988544 2024-04-03T03:46:02.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.926+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~YGVXOQJL4TDY.0 size=1048576 2024-04-03T03:46:02.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.926+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~YGVXOQJL4TDY.1 size=1048576 2024-04-03T03:46:02.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.930+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~YGVXOQJL4TDY.2 size=793532 2024-04-03T03:46:02.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.934+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=YGVXOQJL4TDY tag=XX21P9U93E6H type=write size=3939260 2024-04-03T03:46:02.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.938+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=TOE3JMIM5YMT type=del size=2993185 2024-04-03T03:46:02.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.938+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=6AYTL5N608IL type=del 2024-04-03T03:46:02.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.942+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=0WMK7BLXHTEO type=del size=1467103 2024-04-03T03:46:02.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.942+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~1R40H2AZJVWP.0 size=1048576 2024-04-03T03:46:02.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.946+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~1R40H2AZJVWP.1 size=126221 2024-04-03T03:46:02.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.950+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=1R40H2AZJVWP tag=GE7Y8MD2B4I7 type=write size=2223373 2024-04-03T03:46:02.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.950+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=GAM4VUI80M2L type=write size=910373 2024-04-03T03:46:02.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.954+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~KVX1GORK48SN.0 size=1048576 2024-04-03T03:46:02.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.954+0000 7f55269288c0 1 < canceled part key=_multipart_AXL5RVPSVDY5.2~KVX1GORK48SN.1 size=1048576 2024-04-03T03:46:02.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.954+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~KVX1GORK48SN.2 size=140990 2024-04-03T03:46:02.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.958+0000 7f55269288c0 1 < canceled multipart upload key=AXL5RVPSVDY5 upload=KVX1GORK48SN tag=LMFHS3811ZXT type=write size=3286718 2024-04-03T03:46:02.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.962+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=M01SHLDT4TVI type=write size=323132 2024-04-03T03:46:02.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.962+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~B4K1GGZTBHB9.0 size=1048576 2024-04-03T03:46:02.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.966+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~B4K1GGZTBHB9.1 size=1048576 2024-04-03T03:46:02.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.966+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~B4K1GGZTBHB9.2 size=361992 2024-04-03T03:46:02.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.970+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=B4K1GGZTBHB9 tag=ULZ6HFQGKNUI type=write size=3507720 2024-04-03T03:46:02.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.974+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~Q1CML3HM2V5K.0 size=192044 2024-04-03T03:46:02.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.974+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=Q1CML3HM2V5K tag=6C2FRWXAGN1Q type=write size=1240620 2024-04-03T03:46:02.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.978+0000 7f55269288c0 1 < completed write operation key=K7A1O21ZURWQ tag=I2RN6C70ZRAG type=write size=821945 2024-04-03T03:46:02.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.982+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~HT5CN00F88BG.0 size=1048576 2024-04-03T03:46:02.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.982+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~HT5CN00F88BG.1 size=930369 2024-04-03T03:46:02.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.982+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=HT5CN00F88BG tag=YI4J5W6K3QTQ type=write size=3027521 2024-04-03T03:46:02.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.986+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=GF6TXN355LEN type=del 2024-04-03T03:46:02.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.986+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=9S09UTS6P4CV type=del size=3817701 2024-04-03T03:46:02.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.986+0000 7f55269288c0 1 < canceled part key=_multipart_SFN1M3HPGT18.2~CPJ1SEZO38BZ.0 size=1048576 2024-04-03T03:46:02.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.990+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~CPJ1SEZO38BZ.1 size=851363 2024-04-03T03:46:02.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.994+0000 7f55269288c0 1 < canceled multipart upload key=SFN1M3HPGT18 upload=CPJ1SEZO38BZ tag=7WVKU19JILXC type=write size=2948515 2024-04-03T03:46:02.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.994+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=1HBG49X77WIP type=write size=361523 2024-04-03T03:46:02.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:02.998+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=1ZGY28VCAHX2 type=del 2024-04-03T03:46:02.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.002+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=MHNQYXIKBIMC type=del size=3491356 2024-04-03T03:46:03.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.002+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~H552ZD9WVB72.0 size=1048576 2024-04-03T03:46:03.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.006+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~H552ZD9WVB72.1 size=84394 2024-04-03T03:46:03.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.010+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=H552ZD9WVB72 tag=BZYJB6ZQDB72 type=write size=2181546 2024-04-03T03:46:03.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.014+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~NE6W6T1F4P9R.0 size=1048576 2024-04-03T03:46:03.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.014+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~NE6W6T1F4P9R.1 size=1048576 2024-04-03T03:46:03.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.018+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~NE6W6T1F4P9R.2 size=217695 2024-04-03T03:46:03.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.018+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=NE6W6T1F4P9R tag=3I6MHP9G5GMF type=write size=3363423 2024-04-03T03:46:03.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.018+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~U4ROMYMQM1DU.0 size=1048576 2024-04-03T03:46:03.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.022+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~U4ROMYMQM1DU.1 size=1048576 2024-04-03T03:46:03.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.022+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~U4ROMYMQM1DU.2 size=895664 2024-04-03T03:46:03.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.026+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=U4ROMYMQM1DU tag=ZWTH058C7RPC type=write size=4041392 2024-04-03T03:46:03.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.030+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=83V5C80INI7E type=del size=582908 2024-04-03T03:46:03.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.034+0000 7f55269288c0 1 < suggested remove operation key=AGTQQYXO7453 tag=WUQ8SJVZM64O type=del 2024-04-03T03:46:03.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.038+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=96N27CBIUI5T type=del size=4167326 2024-04-03T03:46:03.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.042+0000 7f55269288c0 1 < suggested remove operation key=K3Z9W19WEJBM tag=X9CFL487VDNL type=del 2024-04-03T03:46:03.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.046+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=ET2ZCLZFUNY3 type=del size=3014816 2024-04-03T03:46:03.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.046+0000 7f55269288c0 1 < canceled operation key=MLTDNCZ4E5D8 tag=QK2TTMK6ZDDM type=del size=1829719 2024-04-03T03:46:03.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.050+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~W1Q16C2KKEWD.0 size=1048576 2024-04-03T03:46:03.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.054+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~W1Q16C2KKEWD.1 size=1045137 2024-04-03T03:46:03.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.054+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=W1Q16C2KKEWD tag=MB9FPF1BTQS7 type=write size=3142289 2024-04-03T03:46:03.052 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.054+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~0LLAPMXFFX17.0 size=972302 2024-04-03T03:46:03.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.058+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=0LLAPMXFFX17 tag=9WWFRKW9EV39 type=write size=2020878 2024-04-03T03:46:03.060 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.062+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~LS9AAZ8DHXJW.0 size=1048576 2024-04-03T03:46:03.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.066+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~LS9AAZ8DHXJW.1 size=1048576 2024-04-03T03:46:03.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.066+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~LS9AAZ8DHXJW.2 size=605533 2024-04-03T03:46:03.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.066+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=LS9AAZ8DHXJW tag=OGCOKU5APIB5 type=write size=3751261 2024-04-03T03:46:03.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.070+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=VM655ZZVZ3P7 type=del 2024-04-03T03:46:03.069 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.074+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=YA6IRAJYBC2Q type=del size=1164040 2024-04-03T03:46:03.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.074+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=TOE3JMIM5YMT type=del 2024-04-03T03:46:03.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.078+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~YK6W9NUMOYQT.0 size=43701 2024-04-03T03:46:03.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.078+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=YK6W9NUMOYQT tag=V9FJ88DSEOXZ type=write size=1092277 2024-04-03T03:46:03.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.082+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=0WMK7BLXHTEO type=del 2024-04-03T03:46:03.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.086+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~O6W1O99J6JAI.0 size=1048576 2024-04-03T03:46:03.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.086+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~O6W1O99J6JAI.1 size=1048576 2024-04-03T03:46:03.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.090+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~O6W1O99J6JAI.2 size=209092 2024-04-03T03:46:03.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.090+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=O6W1O99J6JAI tag=DDTK923ER16H type=write size=3354820 2024-04-03T03:46:03.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.090+0000 7f55269288c0 1 < completed write operation key=AXL5RVPSVDY5 tag=GAM4VUI80M2L type=write size=910373 2024-04-03T03:46:03.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.094+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=UL6Z842GIHIZ type=del size=2108148 2024-04-03T03:46:03.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.098+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=M01SHLDT4TVI type=write size=323132 2024-04-03T03:46:03.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.102+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~CG982SRPWYLK.0 size=86664 2024-04-03T03:46:03.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.102+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=CG982SRPWYLK tag=CSM6C4RT9H6P type=write size=1135240 2024-04-03T03:46:03.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.102+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~Q1CML3HM2V5K.0 size=192044 2024-04-03T03:46:03.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.106+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=Q1CML3HM2V5K tag=6C2FRWXAGN1Q type=write size=1240620 2024-04-03T03:46:03.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.110+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~N75LDWZA5IJA.0 size=1048576 2024-04-03T03:46:03.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.114+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~N75LDWZA5IJA.1 size=109295 2024-04-03T03:46:03.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.114+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=N75LDWZA5IJA tag=DBS5IFIFK4JC type=write size=2206447 2024-04-03T03:46:03.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.114+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~HT5CN00F88BG.0 size=1048576 2024-04-03T03:46:03.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.118+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~HT5CN00F88BG.1 size=930369 2024-04-03T03:46:03.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.122+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=HT5CN00F88BG tag=YI4J5W6K3QTQ type=write size=3027521 2024-04-03T03:46:03.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.122+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=O6OLMNZP6SZ8 type=del size=2350955 2024-04-03T03:46:03.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.130+0000 7f55269288c0 1 < suggested update operation key=K7A1O21ZURWQ tag=9S09UTS6P4CV type=del size=3817701 2024-04-03T03:46:03.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.130+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=IH4HAG30CPZL type=write size=232815 2024-04-03T03:46:03.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.134+0000 7f55269288c0 1 < canceled operation key=ZKSA09OSFSYN tag=1HBG49X77WIP type=write size=361523 2024-04-03T03:46:03.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.138+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=LEW6O7K8P8A6 type=del size=1077306 2024-04-03T03:46:03.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.138+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=MHNQYXIKBIMC type=del 2024-04-03T03:46:03.140 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.142+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~FD680J7YSWZX.0 size=1048576 2024-04-03T03:46:03.142 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.146+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~FD680J7YSWZX.1 size=699589 2024-04-03T03:46:03.142 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.146+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=FD680J7YSWZX tag=X2D28QZ8T9LU type=write size=2796741 2024-04-03T03:46:03.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.146+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~NE6W6T1F4P9R.0 size=1048576 2024-04-03T03:46:03.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.146+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~NE6W6T1F4P9R.1 size=1048576 2024-04-03T03:46:03.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.150+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~NE6W6T1F4P9R.2 size=217695 2024-04-03T03:46:03.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.154+0000 7f55269288c0 1 < canceled multipart upload key=8BMP0HIS520R upload=NE6W6T1F4P9R tag=3I6MHP9G5GMF type=write size=3363423 2024-04-03T03:46:03.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.154+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=O5LD78YOQDGI type=del size=2041024 2024-04-03T03:46:03.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.158+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=83V5C80INI7E type=del 2024-04-03T03:46:03.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.162+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~9NFICBARYOYN.0 size=1048576 2024-04-03T03:46:03.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.162+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~9NFICBARYOYN.1 size=81712 2024-04-03T03:46:03.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.162+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=9NFICBARYOYN tag=BQIHBY6BVL8N type=write size=2178864 2024-04-03T03:46:03.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.166+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=96N27CBIUI5T type=del 2024-04-03T03:46:03.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.166+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=YJYXIHG3ZF3K type=del size=3449729 2024-04-03T03:46:03.165 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.170+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=ET2ZCLZFUNY3 type=del 2024-04-03T03:46:03.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.170+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=PU2IXJV1UKFC type=del size=1105813 2024-04-03T03:46:03.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.174+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~W1Q16C2KKEWD.0 size=1048576 2024-04-03T03:46:03.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.174+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~W1Q16C2KKEWD.1 size=1045137 2024-04-03T03:46:03.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.178+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=W1Q16C2KKEWD tag=MB9FPF1BTQS7 type=write size=3142289 2024-04-03T03:46:03.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.178+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=UW88IAN1EMS9 type=del size=3120774 2024-04-03T03:46:03.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.182+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~LS9AAZ8DHXJW.0 size=1048576 2024-04-03T03:46:03.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.182+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~LS9AAZ8DHXJW.1 size=1048576 2024-04-03T03:46:03.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.186+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~LS9AAZ8DHXJW.2 size=605533 2024-04-03T03:46:03.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.190+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=LS9AAZ8DHXJW tag=OGCOKU5APIB5 type=write size=3751261 2024-04-03T03:46:03.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.194+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=SAG5DRESNBUX type=del size=4024195 2024-04-03T03:46:03.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.194+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=YA6IRAJYBC2Q type=del 2024-04-03T03:46:03.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.198+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=XKGOVGD0QL9P type=del size=3100211 2024-04-03T03:46:03.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.202+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~YK6W9NUMOYQT.0 size=43701 2024-04-03T03:46:03.201 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.206+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=YK6W9NUMOYQT tag=V9FJ88DSEOXZ type=write size=1092277 2024-04-03T03:46:03.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.206+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~1EA1HG9TT3YC.0 size=1048576 2024-04-03T03:46:03.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.210+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~1EA1HG9TT3YC.1 size=1048576 2024-04-03T03:46:03.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.210+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~1EA1HG9TT3YC.2 size=161169 2024-04-03T03:46:03.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.210+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=1EA1HG9TT3YC tag=WLTVHPAPFMX4 type=write size=3306897 2024-04-03T03:46:03.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.214+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~O6W1O99J6JAI.0 size=1048576 2024-04-03T03:46:03.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.214+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~O6W1O99J6JAI.1 size=1048576 2024-04-03T03:46:03.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.218+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~O6W1O99J6JAI.2 size=209092 2024-04-03T03:46:03.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.222+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=O6W1O99J6JAI tag=DDTK923ER16H type=write size=3354820 2024-04-03T03:46:03.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.222+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=56V7ESGVHY66 type=del size=545149 2024-04-03T03:46:03.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.230+0000 7f55269288c0 1 < suggested update operation key=JAXVD60NI5YW tag=UL6Z842GIHIZ type=del size=2108148 2024-04-03T03:46:03.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.230+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=5ZTTL9NZP8FR type=del size=1914952 2024-04-03T03:46:03.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.234+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~CG982SRPWYLK.0 size=86664 2024-04-03T03:46:03.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.238+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=CG982SRPWYLK tag=CSM6C4RT9H6P type=write size=1135240 2024-04-03T03:46:03.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.242+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~SKYI32MIC50R.0 size=512034 2024-04-03T03:46:03.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.242+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=SKYI32MIC50R tag=BW0F3SBVBWWY type=write size=1560610 2024-04-03T03:46:03.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.246+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~N75LDWZA5IJA.0 size=1048576 2024-04-03T03:46:03.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.246+0000 7f55269288c0 1 < canceled part key=_multipart_F6IBZ80J4SDM.2~N75LDWZA5IJA.1 size=109295 2024-04-03T03:46:03.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.250+0000 7f55269288c0 1 < canceled multipart upload key=F6IBZ80J4SDM upload=N75LDWZA5IJA tag=DBS5IFIFK4JC type=write size=2206447 2024-04-03T03:46:03.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.254+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~A1L2PJ5PTJUN.0 size=844475 2024-04-03T03:46:03.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.254+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=A1L2PJ5PTJUN tag=5M3IAIW02IEX type=write size=1893051 2024-04-03T03:46:03.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.258+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=O6OLMNZP6SZ8 type=del 2024-04-03T03:46:03.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.258+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=U1WIY1OQPHS4 type=del size=378505 2024-04-03T03:46:03.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.262+0000 7f55269288c0 1 < completed write operation key=TXFMKXUGMEA8 tag=IH4HAG30CPZL type=write size=232815 2024-04-03T03:46:03.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.270+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~Y36HPZC3W2YF.0 size=1048576 2024-04-03T03:46:03.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.270+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~Y36HPZC3W2YF.1 size=1048576 2024-04-03T03:46:03.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.274+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~Y36HPZC3W2YF.2 size=893968 2024-04-03T03:46:03.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.274+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=Y36HPZC3W2YF tag=Q9057I2ELC6U type=write size=4039696 2024-04-03T03:46:03.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.274+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=LEW6O7K8P8A6 type=del 2024-04-03T03:46:03.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.282+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~DMG6JS7KHM86.0 size=1048576 2024-04-03T03:46:03.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.282+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~DMG6JS7KHM86.1 size=194540 2024-04-03T03:46:03.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.282+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=DMG6JS7KHM86 tag=S1QZ6MPSXKRH type=write size=2291692 2024-04-03T03:46:03.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.286+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~FD680J7YSWZX.0 size=1048576 2024-04-03T03:46:03.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.286+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~FD680J7YSWZX.1 size=699589 2024-04-03T03:46:03.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.294+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=FD680J7YSWZX tag=X2D28QZ8T9LU type=write size=2796741 2024-04-03T03:46:03.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.294+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=YWPKC76140UL type=del size=2203328 2024-04-03T03:46:03.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.298+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=O5LD78YOQDGI type=del 2024-04-03T03:46:03.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.302+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~HQS81KWZADEE.0 size=1048576 2024-04-03T03:46:03.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.306+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~HQS81KWZADEE.1 size=648464 2024-04-03T03:46:03.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.306+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=HQS81KWZADEE tag=1SPTVLQPS9OD type=write size=2745616 2024-04-03T03:46:03.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.310+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~9NFICBARYOYN.0 size=1048576 2024-04-03T03:46:03.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.310+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~9NFICBARYOYN.1 size=81712 2024-04-03T03:46:03.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.318+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=9NFICBARYOYN tag=BQIHBY6BVL8N type=write size=2178864 2024-04-03T03:46:03.316 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.318+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=5RGE8S3MYEC2 type=del size=2052581 2024-04-03T03:46:03.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.322+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=YJYXIHG3ZF3K type=del 2024-04-03T03:46:03.322 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.326+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=SC8FMUQV14W7 type=del size=1016265 2024-04-03T03:46:03.325 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.330+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=PU2IXJV1UKFC type=del 2024-04-03T03:46:03.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.334+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~W5V24IMQV7AM.0 size=1048576 2024-04-03T03:46:03.332 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.334+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~W5V24IMQV7AM.1 size=963094 2024-04-03T03:46:03.332 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.334+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=W5V24IMQV7AM tag=WZ44PAXLYIRG type=write size=3060246 2024-04-03T03:46:03.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.338+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=UW88IAN1EMS9 type=del 2024-04-03T03:46:03.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.342+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~OM70MDUPDFGA.0 size=1048576 2024-04-03T03:46:03.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.346+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~OM70MDUPDFGA.1 size=1048576 2024-04-03T03:46:03.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.346+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~OM70MDUPDFGA.2 size=659184 2024-04-03T03:46:03.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.346+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=OM70MDUPDFGA tag=KLYTLTBS8I1J type=write size=3804912 2024-04-03T03:46:03.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.350+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=SAG5DRESNBUX type=del 2024-04-03T03:46:03.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.354+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~JVG2EPI9JALB.0 size=1048576 2024-04-03T03:46:03.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.354+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~JVG2EPI9JALB.1 size=1048576 2024-04-03T03:46:03.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.358+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~JVG2EPI9JALB.2 size=515902 2024-04-03T03:46:03.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.358+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=JVG2EPI9JALB tag=71204YSLZFV9 type=write size=3661630 2024-04-03T03:46:03.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.362+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=XKGOVGD0QL9P type=del 2024-04-03T03:46:03.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.362+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=06H6HEY4WKET type=del size=4061493 2024-04-03T03:46:03.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.362+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~1EA1HG9TT3YC.0 size=1048576 2024-04-03T03:46:03.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.366+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~1EA1HG9TT3YC.1 size=1048576 2024-04-03T03:46:03.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.366+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~1EA1HG9TT3YC.2 size=161169 2024-04-03T03:46:03.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.370+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=1EA1HG9TT3YC tag=WLTVHPAPFMX4 type=write size=3306897 2024-04-03T03:46:03.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.374+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=PC4DU2SVAIPE type=del size=2993526 2024-04-03T03:46:03.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.378+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=56V7ESGVHY66 type=del 2024-04-03T03:46:03.377 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.382+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~77J7O6P8ABV9.0 size=276035 2024-04-03T03:46:03.377 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.382+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=77J7O6P8ABV9 tag=13CMEXDQ605Y type=write size=1324611 2024-04-03T03:46:03.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.382+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=5ZTTL9NZP8FR type=del 2024-04-03T03:46:03.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.390+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~AVVIVS1ZRB69.0 size=1048576 2024-04-03T03:46:03.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.390+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~AVVIVS1ZRB69.1 size=34111 2024-04-03T03:46:03.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.390+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=AVVIVS1ZRB69 tag=5DYAQM9IEXB9 type=write size=2131263 2024-04-03T03:46:03.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.394+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~SKYI32MIC50R.0 size=512034 2024-04-03T03:46:03.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.398+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=SKYI32MIC50R tag=BW0F3SBVBWWY type=write size=1560610 2024-04-03T03:46:03.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.402+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~PE48LQLCF5OT.0 size=1048576 2024-04-03T03:46:03.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.402+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~PE48LQLCF5OT.1 size=605703 2024-04-03T03:46:03.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.402+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=PE48LQLCF5OT tag=022R3MMI49OG type=write size=2702855 2024-04-03T03:46:03.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.406+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~A1L2PJ5PTJUN.0 size=844475 2024-04-03T03:46:03.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.410+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=A1L2PJ5PTJUN tag=5M3IAIW02IEX type=write size=1893051 2024-04-03T03:46:03.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.414+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~9BE3PVH1EGHR.0 size=1048576 2024-04-03T03:46:03.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.418+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~9BE3PVH1EGHR.1 size=1048576 2024-04-03T03:46:03.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.418+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~9BE3PVH1EGHR.2 size=456573 2024-04-03T03:46:03.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.418+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=9BE3PVH1EGHR tag=IVDK9AOZ3LO9 type=write size=3602301 2024-04-03T03:46:03.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.422+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=U1WIY1OQPHS4 type=del 2024-04-03T03:46:03.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.426+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=T30NQBM9YO35 type=del size=2497102 2024-04-03T03:46:03.424 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.426+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~Y36HPZC3W2YF.0 size=1048576 2024-04-03T03:46:03.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.430+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~Y36HPZC3W2YF.1 size=1048576 2024-04-03T03:46:03.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.430+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~Y36HPZC3W2YF.2 size=893968 2024-04-03T03:46:03.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.434+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=Y36HPZC3W2YF tag=Q9057I2ELC6U type=write size=4039696 2024-04-03T03:46:03.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.438+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=RQVIGOKQ2KL6 type=del size=1724745 2024-04-03T03:46:03.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.442+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~DMG6JS7KHM86.0 size=1048576 2024-04-03T03:46:03.439 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.442+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~DMG6JS7KHM86.1 size=194540 2024-04-03T03:46:03.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.446+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=DMG6JS7KHM86 tag=S1QZ6MPSXKRH type=write size=2291692 2024-04-03T03:46:03.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.450+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~8IR5735CLPLD.0 size=1048576 2024-04-03T03:46:03.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.454+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~8IR5735CLPLD.1 size=1048576 2024-04-03T03:46:03.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.454+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~8IR5735CLPLD.2 size=684739 2024-04-03T03:46:03.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.454+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=8IR5735CLPLD tag=SR4IW2SEOUD2 type=write size=3830467 2024-04-03T03:46:03.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.458+0000 7f55269288c0 1 < canceled operation key=YCEKDT5EQD9D tag=YWPKC76140UL type=del size=2203328 2024-04-03T03:46:03.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.458+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=278C33LXSA91 type=del size=2034146 2024-04-03T03:46:03.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.462+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~HQS81KWZADEE.0 size=1048576 2024-04-03T03:46:03.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.466+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~HQS81KWZADEE.1 size=648464 2024-04-03T03:46:03.465 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.470+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=HQS81KWZADEE tag=1SPTVLQPS9OD type=write size=2745616 2024-04-03T03:46:03.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.470+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=VDQN0VZV6H8O type=del size=298084 2024-04-03T03:46:03.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.474+0000 7f55269288c0 1 < suggested update operation key=U62RSK21LJEF tag=5RGE8S3MYEC2 type=del size=2052581 2024-04-03T03:46:03.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.478+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~5EQT9I0N49S1.0 size=1048576 2024-04-03T03:46:03.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.482+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~5EQT9I0N49S1.1 size=647115 2024-04-03T03:46:03.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.482+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=5EQT9I0N49S1 tag=GFCO402GV00D type=write size=2744267 2024-04-03T03:46:03.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.482+0000 7f55269288c0 1 < canceled operation key=D8W2ZKIZFI8H tag=SC8FMUQV14W7 type=del size=1016265 2024-04-03T03:46:03.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.490+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~4D41BBEHTZAY.0 size=1048576 2024-04-03T03:46:03.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.490+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~4D41BBEHTZAY.1 size=996122 2024-04-03T03:46:03.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.490+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=4D41BBEHTZAY tag=HPZSKY4IZTCB type=write size=3093274 2024-04-03T03:46:03.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.494+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~W5V24IMQV7AM.0 size=1048576 2024-04-03T03:46:03.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.494+0000 7f55269288c0 1 < canceled part key=_multipart_AGTQQYXO7453.2~W5V24IMQV7AM.1 size=963094 2024-04-03T03:46:03.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.494+0000 7f55269288c0 1 < canceled multipart upload key=AGTQQYXO7453 upload=W5V24IMQV7AM tag=WZ44PAXLYIRG type=write size=3060246 2024-04-03T03:46:03.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.498+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=YUA48YULT8RF type=del size=2726468 2024-04-03T03:46:03.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.502+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~OM70MDUPDFGA.0 size=1048576 2024-04-03T03:46:03.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.502+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~OM70MDUPDFGA.1 size=1048576 2024-04-03T03:46:03.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.502+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~OM70MDUPDFGA.2 size=659184 2024-04-03T03:46:03.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.506+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=OM70MDUPDFGA tag=KLYTLTBS8I1J type=write size=3804912 2024-04-03T03:46:03.510 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.510+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~Q7FGO8LET5FY.0 size=1048576 2024-04-03T03:46:03.510 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.514+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~Q7FGO8LET5FY.1 size=1048576 2024-04-03T03:46:03.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.514+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~Q7FGO8LET5FY.2 size=723304 2024-04-03T03:46:03.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.514+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=Q7FGO8LET5FY tag=B9S3GUW3HRX5 type=write size=3869032 2024-04-03T03:46:03.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.518+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~JVG2EPI9JALB.0 size=1048576 2024-04-03T03:46:03.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.518+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~JVG2EPI9JALB.1 size=1048576 2024-04-03T03:46:03.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.522+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~JVG2EPI9JALB.2 size=515902 2024-04-03T03:46:03.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.526+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=JVG2EPI9JALB tag=71204YSLZFV9 type=write size=3661630 2024-04-03T03:46:03.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.530+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=XG4XKGM3AWJ5 type=del size=2911902 2024-04-03T03:46:03.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.534+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=06H6HEY4WKET type=del 2024-04-03T03:46:03.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.534+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=36RZ1VXGU19M type=del size=3778769 2024-04-03T03:46:03.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.538+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=PC4DU2SVAIPE type=del 2024-04-03T03:46:03.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.542+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=A1MR0WRLE3G4 type=del size=4014281 2024-04-03T03:46:03.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.542+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~77J7O6P8ABV9.0 size=276035 2024-04-03T03:46:03.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.550+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=77J7O6P8ABV9 tag=13CMEXDQ605Y type=write size=1324611 2024-04-03T03:46:03.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.554+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~Y89B7NEKGUAE.0 size=1048576 2024-04-03T03:46:03.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.558+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~Y89B7NEKGUAE.1 size=1048576 2024-04-03T03:46:03.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.558+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~Y89B7NEKGUAE.2 size=881798 2024-04-03T03:46:03.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.558+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=Y89B7NEKGUAE tag=1VA027I1FT61 type=write size=4027526 2024-04-03T03:46:03.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.562+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~AVVIVS1ZRB69.0 size=1048576 2024-04-03T03:46:03.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.562+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~AVVIVS1ZRB69.1 size=34111 2024-04-03T03:46:03.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.566+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=AVVIVS1ZRB69 tag=5DYAQM9IEXB9 type=write size=2131263 2024-04-03T03:46:03.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.570+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~H9ESJ298AAY0.0 size=1022217 2024-04-03T03:46:03.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.570+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=H9ESJ298AAY0 tag=FF5I325PH5CM type=write size=2070793 2024-04-03T03:46:03.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.574+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~PE48LQLCF5OT.0 size=1048576 2024-04-03T03:46:03.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.574+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~PE48LQLCF5OT.1 size=605703 2024-04-03T03:46:03.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.582+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=PE48LQLCF5OT tag=022R3MMI49OG type=write size=2702855 2024-04-03T03:46:03.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.582+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=NQYVLU6GSJ3U type=del size=4108763 2024-04-03T03:46:03.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.582+0000 7f55269288c0 1 < canceled part key=_multipart_K3Z9W19WEJBM.2~9BE3PVH1EGHR.0 size=1048576 2024-04-03T03:46:03.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.582+0000 7f55269288c0 1 < canceled part key=_multipart_K3Z9W19WEJBM.2~9BE3PVH1EGHR.1 size=1048576 2024-04-03T03:46:03.583 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.586+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~9BE3PVH1EGHR.2 size=456573 2024-04-03T03:46:03.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.590+0000 7f55269288c0 1 < canceled multipart upload key=K3Z9W19WEJBM upload=9BE3PVH1EGHR tag=IVDK9AOZ3LO9 type=write size=3602301 2024-04-03T03:46:03.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.598+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~XPQJXBWYVQJZ.0 size=671758 2024-04-03T03:46:03.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.598+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=XPQJXBWYVQJZ tag=OZAE2IXOCD1B type=write size=1720334 2024-04-03T03:46:03.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.598+0000 7f55269288c0 1 < canceled operation key=TW860A14J9RC tag=T30NQBM9YO35 type=del size=2497102 2024-04-03T03:46:03.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.606+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~3X8SUXT6ZUPR.0 size=943363 2024-04-03T03:46:03.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.606+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=3X8SUXT6ZUPR tag=3YWXAUPYE2M7 type=write size=1991939 2024-04-03T03:46:03.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.606+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=RQVIGOKQ2KL6 type=del 2024-04-03T03:46:03.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.614+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~HFKF14UF69ZC.0 size=1048576 2024-04-03T03:46:03.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.614+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~HFKF14UF69ZC.1 size=1048576 2024-04-03T03:46:03.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.618+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~HFKF14UF69ZC.2 size=295258 2024-04-03T03:46:03.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.618+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=HFKF14UF69ZC tag=00VW77C0T77S type=write size=3440986 2024-04-03T03:46:03.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.622+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~8IR5735CLPLD.0 size=1048576 2024-04-03T03:46:03.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.622+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~8IR5735CLPLD.1 size=1048576 2024-04-03T03:46:03.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.626+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~8IR5735CLPLD.2 size=684739 2024-04-03T03:46:03.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.630+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=8IR5735CLPLD tag=SR4IW2SEOUD2 type=write size=3830467 2024-04-03T03:46:03.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.634+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=9229HUINM7SY type=del size=1840105 2024-04-03T03:46:03.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.638+0000 7f55269288c0 1 < canceled operation key=YCEKDT5EQD9D tag=278C33LXSA91 type=del size=2034146 2024-04-03T03:46:03.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.638+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=98ZBVG494AG1 type=del size=2470800 2024-04-03T03:46:03.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.642+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=VDQN0VZV6H8O type=del 2024-04-03T03:46:03.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.646+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=QQKO5BZA277W type=del size=3073300 2024-04-03T03:46:03.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.646+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~5EQT9I0N49S1.0 size=1048576 2024-04-03T03:46:03.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.650+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~5EQT9I0N49S1.1 size=647115 2024-04-03T03:46:03.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.654+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=5EQT9I0N49S1 tag=GFCO402GV00D type=write size=2744267 2024-04-03T03:46:03.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.658+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~2BDHJIAT9N6Q.0 size=1048576 2024-04-03T03:46:03.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.662+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~2BDHJIAT9N6Q.1 size=46357 2024-04-03T03:46:03.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.662+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=2BDHJIAT9N6Q tag=RBXNFZ2WE9NO type=write size=2143509 2024-04-03T03:46:03.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.662+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~4D41BBEHTZAY.0 size=1048576 2024-04-03T03:46:03.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.666+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~4D41BBEHTZAY.1 size=996122 2024-04-03T03:46:03.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.670+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=4D41BBEHTZAY tag=HPZSKY4IZTCB type=write size=3093274 2024-04-03T03:46:03.670 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.674+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~11WQB7S8HZMB.0 size=1048576 2024-04-03T03:46:03.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.674+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~11WQB7S8HZMB.1 size=1048576 2024-04-03T03:46:03.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.678+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~11WQB7S8HZMB.2 size=317630 2024-04-03T03:46:03.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.678+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=11WQB7S8HZMB tag=NCOR7CTGKOUB type=write size=3463358 2024-04-03T03:46:03.676 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.678+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=YUA48YULT8RF type=del 2024-04-03T03:46:03.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.682+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=M3PUC1F8DYOT type=del size=3421388 2024-04-03T03:46:03.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.682+0000 7f55269288c0 1 < canceled part key=_multipart_K3Z9W19WEJBM.2~Q7FGO8LET5FY.0 size=1048576 2024-04-03T03:46:03.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.686+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~Q7FGO8LET5FY.1 size=1048576 2024-04-03T03:46:03.683 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.686+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~Q7FGO8LET5FY.2 size=723304 2024-04-03T03:46:03.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.690+0000 7f55269288c0 1 < canceled multipart upload key=K3Z9W19WEJBM upload=Q7FGO8LET5FY tag=B9S3GUW3HRX5 type=write size=3869032 2024-04-03T03:46:03.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.694+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=JGP7TUMWCENJ type=del size=611626 2024-04-03T03:46:03.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.698+0000 7f55269288c0 1 < canceled operation key=KU1R0YLDP1V3 tag=XG4XKGM3AWJ5 type=del size=2911902 2024-04-03T03:46:03.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.698+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=D6H2MBN4IBWZ type=del size=3542732 2024-04-03T03:46:03.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.702+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=36RZ1VXGU19M type=del 2024-04-03T03:46:03.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.706+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~RZ6PVPT00ZOC.0 size=1048576 2024-04-03T03:46:03.706 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.710+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~RZ6PVPT00ZOC.1 size=936927 2024-04-03T03:46:03.706 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.710+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=RZ6PVPT00ZOC tag=3F9SVWO16WSV type=write size=3034079 2024-04-03T03:46:03.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.714+0000 7f55269288c0 1 < suggested update operation key=D9OEPPT37WSJ tag=A1MR0WRLE3G4 type=del size=4014281 2024-04-03T03:46:03.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.718+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=3H9ESQEUV7WR type=del size=3908961 2024-04-03T03:46:03.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.718+0000 7f55269288c0 1 < canceled part key=_multipart_KDSE2XB4D1XI.2~Y89B7NEKGUAE.0 size=1048576 2024-04-03T03:46:03.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.722+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~Y89B7NEKGUAE.1 size=1048576 2024-04-03T03:46:03.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.722+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~Y89B7NEKGUAE.2 size=881798 2024-04-03T03:46:03.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.730+0000 7f55269288c0 1 < canceled multipart upload key=KDSE2XB4D1XI upload=Y89B7NEKGUAE tag=1VA027I1FT61 type=write size=4027526 2024-04-03T03:46:03.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.734+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=986ZQ966D4HA type=del size=3651887 2024-04-03T03:46:03.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.738+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~H9ESJ298AAY0.0 size=1022217 2024-04-03T03:46:03.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.742+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=H9ESJ298AAY0 tag=FF5I325PH5CM type=write size=2070793 2024-04-03T03:46:03.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.746+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~EY4YVOTW4EDC.0 size=1048576 2024-04-03T03:46:03.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.750+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~EY4YVOTW4EDC.1 size=173741 2024-04-03T03:46:03.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.750+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=EY4YVOTW4EDC tag=KSSRB884BLII type=write size=2270893 2024-04-03T03:46:03.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.750+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=NQYVLU6GSJ3U type=del 2024-04-03T03:46:03.753 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.758+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~W50JGV9C12WF.0 size=1048576 2024-04-03T03:46:03.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.758+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~W50JGV9C12WF.1 size=1048576 2024-04-03T03:46:03.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.762+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~W50JGV9C12WF.2 size=59017 2024-04-03T03:46:03.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.762+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=W50JGV9C12WF tag=IRJUEL9IDDPB type=write size=3204745 2024-04-03T03:46:03.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.766+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~XPQJXBWYVQJZ.0 size=671758 2024-04-03T03:46:03.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.770+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=XPQJXBWYVQJZ tag=OZAE2IXOCD1B type=write size=1720334 2024-04-03T03:46:03.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.774+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=N1B5J2TZ0COJ type=del size=744228 2024-04-03T03:46:03.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.778+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~3X8SUXT6ZUPR.0 size=943363 2024-04-03T03:46:03.778 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.782+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=3X8SUXT6ZUPR tag=3YWXAUPYE2M7 type=write size=1991939 2024-04-03T03:46:03.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.786+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=GAEWU6YYG7V4 type=del size=2396200 2024-04-03T03:46:03.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.786+0000 7f55269288c0 1 < canceled part key=_multipart_IOHMF3ADC6EU.2~HFKF14UF69ZC.0 size=1048576 2024-04-03T03:46:03.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.786+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~HFKF14UF69ZC.1 size=1048576 2024-04-03T03:46:03.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.790+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~HFKF14UF69ZC.2 size=295258 2024-04-03T03:46:03.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.794+0000 7f55269288c0 1 < canceled multipart upload key=IOHMF3ADC6EU upload=HFKF14UF69ZC tag=00VW77C0T77S type=write size=3440986 2024-04-03T03:46:03.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.798+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=NXREZDLPWYKY type=del size=237755 2024-04-03T03:46:03.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.802+0000 7f55269288c0 1 < completed delete operation key=K3Z9W19WEJBM tag=9229HUINM7SY type=del 2024-04-03T03:46:03.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.806+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~ZB4DPEV0GGSY.0 size=727756 2024-04-03T03:46:03.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.806+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=ZB4DPEV0GGSY tag=NJKUASP4W92M type=write size=1776332 2024-04-03T03:46:03.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.810+0000 7f55269288c0 1 < canceled operation key=D8W2ZKIZFI8H tag=98ZBVG494AG1 type=del size=2470800 2024-04-03T03:46:03.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.810+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=HDK82XX3HL5C type=del size=3535073 2024-04-03T03:46:03.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.814+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=QQKO5BZA277W type=del 2024-04-03T03:46:03.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.818+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~JAYGPSUJT6PI.0 size=1048576 2024-04-03T03:46:03.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.822+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~JAYGPSUJT6PI.1 size=845412 2024-04-03T03:46:03.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.822+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=JAYGPSUJT6PI tag=KEKIZB2NFM07 type=write size=2942564 2024-04-03T03:46:03.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.826+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~2BDHJIAT9N6Q.0 size=1048576 2024-04-03T03:46:03.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.830+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~2BDHJIAT9N6Q.1 size=46357 2024-04-03T03:46:03.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.834+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=2BDHJIAT9N6Q tag=RBXNFZ2WE9NO type=write size=2143509 2024-04-03T03:46:03.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.834+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=BLGK7CRA8HC2 type=del size=1324328 2024-04-03T03:46:03.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.838+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~11WQB7S8HZMB.0 size=1048576 2024-04-03T03:46:03.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.842+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~11WQB7S8HZMB.1 size=1048576 2024-04-03T03:46:03.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.842+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~11WQB7S8HZMB.2 size=317630 2024-04-03T03:46:03.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.846+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=11WQB7S8HZMB tag=NCOR7CTGKOUB type=write size=3463358 2024-04-03T03:46:03.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.850+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~N3KJLYVK0UKH.0 size=1048576 2024-04-03T03:46:03.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.854+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~N3KJLYVK0UKH.1 size=1048576 2024-04-03T03:46:03.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.854+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~N3KJLYVK0UKH.2 size=1001962 2024-04-03T03:46:03.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.854+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=N3KJLYVK0UKH tag=W3IKWGS8N3L9 type=write size=4147690 2024-04-03T03:46:03.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.858+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=M3PUC1F8DYOT type=del 2024-04-03T03:46:03.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.862+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=M3HLRVB8HGQ0 type=write size=409261 2024-04-03T03:46:03.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.862+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=JGP7TUMWCENJ type=del 2024-04-03T03:46:03.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.870+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~05HK00I68XXB.0 size=775730 2024-04-03T03:46:03.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.870+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=05HK00I68XXB tag=XUE9H2LGZTM9 type=write size=1824306 2024-04-03T03:46:03.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.870+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=D6H2MBN4IBWZ type=del 2024-04-03T03:46:03.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.874+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=VMMM1P5E2ELN type=del size=616130 2024-04-03T03:46:03.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.874+0000 7f55269288c0 1 < canceled part key=_multipart_TXFMKXUGMEA8.2~RZ6PVPT00ZOC.0 size=1048576 2024-04-03T03:46:03.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.878+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~RZ6PVPT00ZOC.1 size=936927 2024-04-03T03:46:03.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.882+0000 7f55269288c0 1 < canceled multipart upload key=TXFMKXUGMEA8 upload=RZ6PVPT00ZOC tag=3F9SVWO16WSV type=write size=3034079 2024-04-03T03:46:03.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.886+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~J8T7ETY0UO65.0 size=571068 2024-04-03T03:46:03.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.886+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=J8T7ETY0UO65 tag=KY3WXEQIP0F4 type=write size=1619644 2024-04-03T03:46:03.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.890+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=3H9ESQEUV7WR type=del 2024-04-03T03:46:03.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.894+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=INVRRD38Z5C0 type=write size=464870 2024-04-03T03:46:03.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.898+0000 7f55269288c0 1 < suggested update operation key=LZQGL2UAWOTU tag=986ZQ966D4HA type=del size=3651887 2024-04-03T03:46:03.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.902+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=0DD5F7OW23FU type=del size=3685693 2024-04-03T03:46:03.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.902+0000 7f55269288c0 1 < canceled part key=_multipart_KDSE2XB4D1XI.2~EY4YVOTW4EDC.0 size=1048576 2024-04-03T03:46:03.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.906+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~EY4YVOTW4EDC.1 size=173741 2024-04-03T03:46:03.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.910+0000 7f55269288c0 1 < canceled multipart upload key=KDSE2XB4D1XI upload=EY4YVOTW4EDC tag=KSSRB884BLII type=write size=2270893 2024-04-03T03:46:03.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.910+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=UVY8V67L2O2A type=del size=3483211 2024-04-03T03:46:03.910 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.914+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~W50JGV9C12WF.0 size=1048576 2024-04-03T03:46:03.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.914+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~W50JGV9C12WF.1 size=1048576 2024-04-03T03:46:03.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.918+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~W50JGV9C12WF.2 size=59017 2024-04-03T03:46:03.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.922+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=W50JGV9C12WF tag=IRJUEL9IDDPB type=write size=3204745 2024-04-03T03:46:03.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.922+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=WHEU41XWDIBO type=del size=1879954 2024-04-03T03:46:03.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.926+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=N1B5J2TZ0COJ type=del 2024-04-03T03:46:03.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.930+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=LOVODMIPT2IU type=del size=565052 2024-04-03T03:46:03.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.930+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=GAEWU6YYG7V4 type=del 2024-04-03T03:46:03.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.934+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=RTHOGFXIRG0X type=del size=1323262 2024-04-03T03:46:03.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.938+0000 7f55269288c0 1 < canceled operation key=7POFUQ9CX6B1 tag=NXREZDLPWYKY type=del size=237755 2024-04-03T03:46:03.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.938+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=RWDYVA3I4A23 type=del size=2405709 2024-04-03T03:46:03.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.938+0000 7f55269288c0 1 < canceled part key=_multipart_X3YCYKP2P9IM.2~ZB4DPEV0GGSY.0 size=727756 2024-04-03T03:46:03.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.942+0000 7f55269288c0 1 < canceled multipart upload key=X3YCYKP2P9IM upload=ZB4DPEV0GGSY tag=NJKUASP4W92M type=write size=1776332 2024-04-03T03:46:03.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.946+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=ZKKC8WZ75INF type=del size=1172338 2024-04-03T03:46:03.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.950+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=HDK82XX3HL5C type=del 2024-04-03T03:46:03.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.950+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=RITGUFFMRESF type=write size=822364 2024-04-03T03:46:03.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.954+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~JAYGPSUJT6PI.0 size=1048576 2024-04-03T03:46:03.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.958+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~JAYGPSUJT6PI.1 size=845412 2024-04-03T03:46:03.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.962+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=JAYGPSUJT6PI tag=KEKIZB2NFM07 type=write size=2942564 2024-04-03T03:46:03.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.962+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=1GUFRT2WJ3CT type=del size=4156255 2024-04-03T03:46:03.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.966+0000 7f55269288c0 1 < canceled operation key=JAXVD60NI5YW tag=BLGK7CRA8HC2 type=del size=1324328 2024-04-03T03:46:03.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.970+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=46YLC9T7XNW6 type=del size=583224 2024-04-03T03:46:03.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.970+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~N3KJLYVK0UKH.0 size=1048576 2024-04-03T03:46:03.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.974+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~N3KJLYVK0UKH.1 size=1048576 2024-04-03T03:46:03.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.974+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~N3KJLYVK0UKH.2 size=1001962 2024-04-03T03:46:03.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.978+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=N3KJLYVK0UKH tag=W3IKWGS8N3L9 type=write size=4147690 2024-04-03T03:46:03.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.982+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=0LVNHYR53UV4 type=del size=2584145 2024-04-03T03:46:03.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.986+0000 7f55269288c0 1 < completed write operation key=0OSIL0R5ZJ54 tag=M3HLRVB8HGQ0 type=write size=409261 2024-04-03T03:46:03.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.990+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=HL43PRIZZE2V type=del size=258506 2024-04-03T03:46:03.989 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.994+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~05HK00I68XXB.0 size=775730 2024-04-03T03:46:03.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.998+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=05HK00I68XXB tag=XUE9H2LGZTM9 type=write size=1824306 2024-04-03T03:46:03.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:03.998+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=JC9A7V59PRC7 type=del size=1298386 2024-04-03T03:46:03.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.002+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=VMMM1P5E2ELN type=del 2024-04-03T03:46:04.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.002+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=B0LPZGHXC13K type=del size=3255167 2024-04-03T03:46:04.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.006+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~J8T7ETY0UO65.0 size=571068 2024-04-03T03:46:04.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.010+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=J8T7ETY0UO65 tag=KY3WXEQIP0F4 type=write size=1619644 2024-04-03T03:46:04.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.014+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=P4P8YY2PP9H1 type=write size=701142 2024-04-03T03:46:04.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.018+0000 7f55269288c0 1 < canceled operation key=SFN1M3HPGT18 tag=INVRRD38Z5C0 type=write size=464870 2024-04-03T03:46:04.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.022+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~JXOVXSM6RC2G.0 size=242298 2024-04-03T03:46:04.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.022+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=JXOVXSM6RC2G tag=TMSZ44M5DOMH type=write size=1290874 2024-04-03T03:46:04.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.022+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=0DD5F7OW23FU type=del 2024-04-03T03:46:04.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.026+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=KIZEILSXO7G9 type=del size=3642613 2024-04-03T03:46:04.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.030+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=UVY8V67L2O2A type=del 2024-04-03T03:46:04.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.034+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~Q72KUJ2H75KH.0 size=1048576 2024-04-03T03:46:04.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.034+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~Q72KUJ2H75KH.1 size=531680 2024-04-03T03:46:04.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.034+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=Q72KUJ2H75KH tag=KDMYV5OMJFJV type=write size=2628832 2024-04-03T03:46:04.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.038+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=WHEU41XWDIBO type=del 2024-04-03T03:46:04.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.042+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~JXY74KN53TEQ.0 size=1048576 2024-04-03T03:46:04.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.042+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~JXY74KN53TEQ.1 size=1048576 2024-04-03T03:46:04.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.046+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~JXY74KN53TEQ.2 size=730492 2024-04-03T03:46:04.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.046+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=JXY74KN53TEQ tag=C3GUQSY5RSXA type=write size=3876220 2024-04-03T03:46:04.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.046+0000 7f55269288c0 1 < canceled operation key=TLM1C3B9J2A3 tag=LOVODMIPT2IU type=del size=565052 2024-04-03T03:46:04.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.054+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~I7HYP75ZYZXN.0 size=1048576 2024-04-03T03:46:04.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.054+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~I7HYP75ZYZXN.1 size=573238 2024-04-03T03:46:04.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.054+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=I7HYP75ZYZXN tag=3T37ENDR63WB type=write size=2670390 2024-04-03T03:46:04.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.058+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=RTHOGFXIRG0X type=del 2024-04-03T03:46:04.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.062+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~EIWLY43F7R50.0 size=1048576 2024-04-03T03:46:04.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.066+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~EIWLY43F7R50.1 size=450743 2024-04-03T03:46:04.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.066+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=EIWLY43F7R50 tag=IOWUAKGKV1PB type=write size=2547895 2024-04-03T03:46:04.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.066+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=RWDYVA3I4A23 type=del 2024-04-03T03:46:04.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.070+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~NGUXF0NFUCI1.0 size=1048576 2024-04-03T03:46:04.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.074+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~NGUXF0NFUCI1.1 size=1048576 2024-04-03T03:46:04.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.074+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~NGUXF0NFUCI1.2 size=628051 2024-04-03T03:46:04.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.074+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=NGUXF0NFUCI1 tag=J3U2T9463XD1 type=write size=3773779 2024-04-03T03:46:04.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.078+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=ZKKC8WZ75INF type=del 2024-04-03T03:46:04.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.082+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~OE7JVQUIYQJA.0 size=1048576 2024-04-03T03:46:04.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.082+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~OE7JVQUIYQJA.1 size=1048576 2024-04-03T03:46:04.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.086+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~OE7JVQUIYQJA.2 size=71985 2024-04-03T03:46:04.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.086+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=OE7JVQUIYQJA tag=CK90QRZ37IPL type=write size=3217713 2024-04-03T03:46:04.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.086+0000 7f55269288c0 1 < completed write operation key=KDSE2XB4D1XI tag=RITGUFFMRESF type=write size=822364 2024-04-03T03:46:04.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.090+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=0E48P20ZETYM type=del size=3244393 2024-04-03T03:46:04.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.094+0000 7f55269288c0 1 < suggested remove operation key=CPR27NMHPIPQ tag=1GUFRT2WJ3CT type=del 2024-04-03T03:46:04.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.098+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=Z6VO1RFGH8CX type=write size=761188 2024-04-03T03:46:04.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.102+0000 7f55269288c0 1 < suggested update operation key=K7A1O21ZURWQ tag=46YLC9T7XNW6 type=del size=583224 2024-04-03T03:46:04.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.106+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~LADKYEXWEY7J.0 size=1048576 2024-04-03T03:46:04.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.106+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~LADKYEXWEY7J.1 size=390839 2024-04-03T03:46:04.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.106+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=LADKYEXWEY7J tag=3XM1PQCGNBWH type=write size=2487991 2024-04-03T03:46:04.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.110+0000 7f55269288c0 1 < suggested update operation key=K7A1O21ZURWQ tag=0LVNHYR53UV4 type=del size=2584145 2024-04-03T03:46:04.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.114+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=JHI659UN449M type=del size=3963110 2024-04-03T03:46:04.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.118+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=HL43PRIZZE2V type=del 2024-04-03T03:46:04.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.122+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~O1PRP3Q7MBED.0 size=1048576 2024-04-03T03:46:04.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.122+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~O1PRP3Q7MBED.1 size=205491 2024-04-03T03:46:04.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.122+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=O1PRP3Q7MBED tag=5VQZ8N2EPX5S type=write size=2302643 2024-04-03T03:46:04.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.126+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=JC9A7V59PRC7 type=del 2024-04-03T03:46:04.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.130+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=R4AA4LK3NB1I type=write size=1010847 2024-04-03T03:46:04.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.130+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=B0LPZGHXC13K type=del 2024-04-03T03:46:04.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.134+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~1XEQQQ5L2W80.0 size=671342 2024-04-03T03:46:04.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.134+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=1XEQQQ5L2W80 tag=YE25K2TFSTW6 type=write size=1719918 2024-04-03T03:46:04.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.138+0000 7f55269288c0 1 < completed write operation key=B5BI0HJ5S1Y1 tag=P4P8YY2PP9H1 type=write size=701142 2024-04-03T03:46:04.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.142+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=9EEPO2Q1L056 type=write size=587850 2024-04-03T03:46:04.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.142+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~JXOVXSM6RC2G.0 size=242298 2024-04-03T03:46:04.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.146+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=JXOVXSM6RC2G tag=TMSZ44M5DOMH type=write size=1290874 2024-04-03T03:46:04.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.150+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~9RV4ZBCLNPIC.0 size=1048576 2024-04-03T03:46:04.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.154+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~9RV4ZBCLNPIC.1 size=1048576 2024-04-03T03:46:04.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.154+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~9RV4ZBCLNPIC.2 size=667645 2024-04-03T03:46:04.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.154+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=9RV4ZBCLNPIC tag=M3K45VAOSJUG type=write size=3813373 2024-04-03T03:46:04.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.158+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=KIZEILSXO7G9 type=del 2024-04-03T03:46:04.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.162+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~7MHHZLOZEHA8.0 size=1048576 2024-04-03T03:46:04.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.162+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~7MHHZLOZEHA8.1 size=1048576 2024-04-03T03:46:04.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.166+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~7MHHZLOZEHA8.2 size=437285 2024-04-03T03:46:04.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.166+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=7MHHZLOZEHA8 tag=A0J66SKQMC1F type=write size=3583013 2024-04-03T03:46:04.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.166+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~Q72KUJ2H75KH.0 size=1048576 2024-04-03T03:46:04.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.170+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~Q72KUJ2H75KH.1 size=531680 2024-04-03T03:46:04.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.174+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=Q72KUJ2H75KH tag=KDMYV5OMJFJV type=write size=2628832 2024-04-03T03:46:04.173 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.178+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~06JXQ2FE12I1.0 size=1048576 2024-04-03T03:46:04.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.178+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~06JXQ2FE12I1.1 size=1048576 2024-04-03T03:46:04.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.178+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~06JXQ2FE12I1.2 size=214222 2024-04-03T03:46:04.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.178+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=06JXQ2FE12I1 tag=DPGWVLO3VSV4 type=write size=3359950 2024-04-03T03:46:04.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.182+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~JXY74KN53TEQ.0 size=1048576 2024-04-03T03:46:04.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.182+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~JXY74KN53TEQ.1 size=1048576 2024-04-03T03:46:04.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.186+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~JXY74KN53TEQ.2 size=730492 2024-04-03T03:46:04.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.190+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=JXY74KN53TEQ tag=C3GUQSY5RSXA type=write size=3876220 2024-04-03T03:46:04.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.190+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=B380A2TNB3CJ type=del size=778380 2024-04-03T03:46:04.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.194+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~I7HYP75ZYZXN.0 size=1048576 2024-04-03T03:46:04.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.194+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~I7HYP75ZYZXN.1 size=573238 2024-04-03T03:46:04.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.198+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=I7HYP75ZYZXN tag=3T37ENDR63WB type=write size=2670390 2024-04-03T03:46:04.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.202+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=8ICSPZJDUCC2 type=del size=4025256 2024-04-03T03:46:04.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.202+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~EIWLY43F7R50.0 size=1048576 2024-04-03T03:46:04.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.206+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~EIWLY43F7R50.1 size=450743 2024-04-03T03:46:04.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.210+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=EIWLY43F7R50 tag=IOWUAKGKV1PB type=write size=2547895 2024-04-03T03:46:04.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.214+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=L85MET80LL6M type=del size=855826 2024-04-03T03:46:04.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.218+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~NGUXF0NFUCI1.0 size=1048576 2024-04-03T03:46:04.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.218+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~NGUXF0NFUCI1.1 size=1048576 2024-04-03T03:46:04.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.218+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~NGUXF0NFUCI1.2 size=628051 2024-04-03T03:46:04.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.222+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=NGUXF0NFUCI1 tag=J3U2T9463XD1 type=write size=3773779 2024-04-03T03:46:04.222 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.226+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=FQN02TUWVZ2D type=del size=3425043 2024-04-03T03:46:04.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.226+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~OE7JVQUIYQJA.0 size=1048576 2024-04-03T03:46:04.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.226+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~OE7JVQUIYQJA.1 size=1048576 2024-04-03T03:46:04.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.230+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~OE7JVQUIYQJA.2 size=71985 2024-04-03T03:46:04.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.234+0000 7f55269288c0 1 < canceled multipart upload key=0OSIL0R5ZJ54 upload=OE7JVQUIYQJA tag=CK90QRZ37IPL type=write size=3217713 2024-04-03T03:46:04.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.238+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~96O04FY48ZJR.0 size=1048576 2024-04-03T03:46:04.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.242+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~96O04FY48ZJR.1 size=1048576 2024-04-03T03:46:04.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.242+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~96O04FY48ZJR.2 size=300704 2024-04-03T03:46:04.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.242+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=96O04FY48ZJR tag=2781ZQXZVVGC type=write size=3446432 2024-04-03T03:46:04.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.246+0000 7f55269288c0 1 < suggested remove operation key=YCEKDT5EQD9D tag=0E48P20ZETYM type=del 2024-04-03T03:46:04.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.250+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=1GER1MZEFOW0 type=del size=1497785 2024-04-03T03:46:04.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.254+0000 7f55269288c0 1 < canceled operation key=D9OEPPT37WSJ tag=Z6VO1RFGH8CX type=write size=761188 2024-04-03T03:46:04.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.258+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~VRDFQWKIMEHF.0 size=1048576 2024-04-03T03:46:04.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.258+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~VRDFQWKIMEHF.1 size=514714 2024-04-03T03:46:04.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.258+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=VRDFQWKIMEHF tag=U3XY0JNN4JBA type=write size=2611866 2024-04-03T03:46:04.257 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.262+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~LADKYEXWEY7J.0 size=1048576 2024-04-03T03:46:04.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.262+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~LADKYEXWEY7J.1 size=390839 2024-04-03T03:46:04.262 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.266+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=LADKYEXWEY7J tag=3XM1PQCGNBWH type=write size=2487991 2024-04-03T03:46:04.266 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.270+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~8NDCR6TZ3WHO.0 size=64926 2024-04-03T03:46:04.266 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.270+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=8NDCR6TZ3WHO tag=5NZK3XAH3G2W type=write size=1113502 2024-04-03T03:46:04.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.274+0000 7f55269288c0 1 < suggested update operation key=SFN1M3HPGT18 tag=JHI659UN449M type=del size=3963110 2024-04-03T03:46:04.273 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.278+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=30BWGVY9YCMH type=del size=1805051 2024-04-03T03:46:04.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.278+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~O1PRP3Q7MBED.0 size=1048576 2024-04-03T03:46:04.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.282+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~O1PRP3Q7MBED.1 size=205491 2024-04-03T03:46:04.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.286+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=O1PRP3Q7MBED tag=5VQZ8N2EPX5S type=write size=2302643 2024-04-03T03:46:04.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.286+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=80WMN4JSQSUR type=del size=970167 2024-04-03T03:46:04.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.290+0000 7f55269288c0 1 < completed write operation key=B5BI0HJ5S1Y1 tag=R4AA4LK3NB1I type=write size=1010847 2024-04-03T03:46:04.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.294+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~2UBMB3D0ONIT.0 size=1048576 2024-04-03T03:46:04.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.294+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~2UBMB3D0ONIT.1 size=1048576 2024-04-03T03:46:04.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.298+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~2UBMB3D0ONIT.2 size=463921 2024-04-03T03:46:04.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.298+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=2UBMB3D0ONIT tag=QY1OX6U5KHZG type=write size=3609649 2024-04-03T03:46:04.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.298+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~1XEQQQ5L2W80.0 size=671342 2024-04-03T03:46:04.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.302+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=1XEQQQ5L2W80 tag=YE25K2TFSTW6 type=write size=1719918 2024-04-03T03:46:04.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.306+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=DTZOO1T8IIUM type=del size=2545618 2024-04-03T03:46:04.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.310+0000 7f55269288c0 1 < completed write operation key=AXL5RVPSVDY5 tag=9EEPO2Q1L056 type=write size=587850 2024-04-03T03:46:04.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.310+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=AGPB5ZSN5HAU type=del size=83397 2024-04-03T03:46:04.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.314+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~9RV4ZBCLNPIC.0 size=1048576 2024-04-03T03:46:04.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.314+0000 7f55269288c0 1 < canceled part key=_multipart_TLM1C3B9J2A3.2~9RV4ZBCLNPIC.1 size=1048576 2024-04-03T03:46:04.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.314+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~9RV4ZBCLNPIC.2 size=667645 2024-04-03T03:46:04.316 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.318+0000 7f55269288c0 1 < canceled multipart upload key=TLM1C3B9J2A3 upload=9RV4ZBCLNPIC tag=M3K45VAOSJUG type=write size=3813373 2024-04-03T03:46:04.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.322+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=5E1N3YSP1GA1 type=del size=1220726 2024-04-03T03:46:04.320 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.322+0000 7f55269288c0 1 < canceled part key=_multipart_SFN1M3HPGT18.2~7MHHZLOZEHA8.0 size=1048576 2024-04-03T03:46:04.320 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.322+0000 7f55269288c0 1 < canceled part key=_multipart_SFN1M3HPGT18.2~7MHHZLOZEHA8.1 size=1048576 2024-04-03T03:46:04.322 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.326+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~7MHHZLOZEHA8.2 size=437285 2024-04-03T03:46:04.326 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.330+0000 7f55269288c0 1 < canceled multipart upload key=SFN1M3HPGT18 upload=7MHHZLOZEHA8 tag=A0J66SKQMC1F type=write size=3583013 2024-04-03T03:46:04.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.334+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=Q66SJ3XUSF8G type=del size=2267940 2024-04-03T03:46:04.332 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.334+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~06JXQ2FE12I1.0 size=1048576 2024-04-03T03:46:04.334 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.338+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~06JXQ2FE12I1.1 size=1048576 2024-04-03T03:46:04.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.338+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~06JXQ2FE12I1.2 size=214222 2024-04-03T03:46:04.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.342+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=06JXQ2FE12I1 tag=DPGWVLO3VSV4 type=write size=3359950 2024-04-03T03:46:04.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.346+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~2T54XDCLEHSE.0 size=1048576 2024-04-03T03:46:04.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.350+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~2T54XDCLEHSE.1 size=1048576 2024-04-03T03:46:04.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.350+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~2T54XDCLEHSE.2 size=641919 2024-04-03T03:46:04.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.350+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=2T54XDCLEHSE tag=IBN9P0MP14QY type=write size=3787647 2024-04-03T03:46:04.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.354+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=B380A2TNB3CJ type=del 2024-04-03T03:46:04.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.358+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=Y35LJSOAI8HT type=write size=288281 2024-04-03T03:46:04.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.358+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=8ICSPZJDUCC2 type=del 2024-04-03T03:46:04.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.362+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~1S3V699VTBH8.0 size=142370 2024-04-03T03:46:04.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.362+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=1S3V699VTBH8 tag=HEB2XO4PLDHC type=write size=1190946 2024-04-03T03:46:04.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.366+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=L85MET80LL6M type=del 2024-04-03T03:46:04.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.370+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~H1M5YKKMYBAX.0 size=1048576 2024-04-03T03:46:04.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.370+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~H1M5YKKMYBAX.1 size=1048576 2024-04-03T03:46:04.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.374+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~H1M5YKKMYBAX.2 size=672337 2024-04-03T03:46:04.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.374+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=H1M5YKKMYBAX tag=E40VXBIYZXGW type=write size=3818065 2024-04-03T03:46:04.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.378+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=FQN02TUWVZ2D type=del 2024-04-03T03:46:04.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.378+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=B3KKBSLGGFAD type=write size=861537 2024-04-03T03:46:04.377 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.382+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~96O04FY48ZJR.0 size=1048576 2024-04-03T03:46:04.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.382+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~96O04FY48ZJR.1 size=1048576 2024-04-03T03:46:04.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.386+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~96O04FY48ZJR.2 size=300704 2024-04-03T03:46:04.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.390+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=96O04FY48ZJR tag=2781ZQXZVVGC type=write size=3446432 2024-04-03T03:46:04.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.394+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=NLHTGV7PM1MK type=del size=1300937 2024-04-03T03:46:04.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.394+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=1GER1MZEFOW0 type=del 2024-04-03T03:46:04.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.398+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=XQWTW24Y8QRO type=del size=1911720 2024-04-03T03:46:04.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.402+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~VRDFQWKIMEHF.0 size=1048576 2024-04-03T03:46:04.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.402+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~VRDFQWKIMEHF.1 size=514714 2024-04-03T03:46:04.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.406+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=VRDFQWKIMEHF tag=U3XY0JNN4JBA type=write size=2611866 2024-04-03T03:46:04.406 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.410+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=TD4HZ2APAI66 type=del size=2465763 2024-04-03T03:46:04.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.414+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~8NDCR6TZ3WHO.0 size=64926 2024-04-03T03:46:04.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.418+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=8NDCR6TZ3WHO tag=5NZK3XAH3G2W type=write size=1113502 2024-04-03T03:46:04.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.422+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=DXO2XIQLWG5N type=del size=2242580 2024-04-03T03:46:04.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.422+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=30BWGVY9YCMH type=del 2024-04-03T03:46:04.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.426+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=T5H4QAKLFC4J type=del size=221346 2024-04-03T03:46:04.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.434+0000 7f55269288c0 1 < suggested remove operation key=CPR27NMHPIPQ tag=80WMN4JSQSUR type=del 2024-04-03T03:46:04.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.438+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=GBTXZNH2Y28J type=del size=1547761 2024-04-03T03:46:04.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.442+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~2UBMB3D0ONIT.0 size=1048576 2024-04-03T03:46:04.442 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.446+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~2UBMB3D0ONIT.1 size=1048576 2024-04-03T03:46:04.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.446+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~2UBMB3D0ONIT.2 size=463921 2024-04-03T03:46:04.450 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.454+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=2UBMB3D0ONIT tag=QY1OX6U5KHZG type=write size=3609649 2024-04-03T03:46:04.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.458+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=P5CAI532QPVZ type=del size=2199815 2024-04-03T03:46:04.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.458+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=DTZOO1T8IIUM type=del 2024-04-03T03:46:04.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.462+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=58UUHR6MFDOT type=del size=1159202 2024-04-03T03:46:04.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.466+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=AGPB5ZSN5HAU type=del 2024-04-03T03:46:04.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.470+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=ZDB1IO5MTSYV type=del size=1379286 2024-04-03T03:46:04.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.478+0000 7f55269288c0 1 < suggested update operation key=SFN1M3HPGT18 tag=5E1N3YSP1GA1 type=del size=1220726 2024-04-03T03:46:04.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.482+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=J1YWUHOVKTOM type=del size=3390261 2024-04-03T03:46:04.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.486+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=Q66SJ3XUSF8G type=del 2024-04-03T03:46:04.484 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.486+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=4H4S51E0JYZE type=del size=3231991 2024-04-03T03:46:04.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.490+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~2T54XDCLEHSE.0 size=1048576 2024-04-03T03:46:04.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.494+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~2T54XDCLEHSE.1 size=1048576 2024-04-03T03:46:04.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.494+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~2T54XDCLEHSE.2 size=641919 2024-04-03T03:46:04.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.502+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=2T54XDCLEHSE tag=IBN9P0MP14QY type=write size=3787647 2024-04-03T03:46:04.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.506+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=KCWCZG9MEVTS type=del size=767118 2024-04-03T03:46:04.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.510+0000 7f55269288c0 1 < completed write operation key=8BMP0HIS520R tag=Y35LJSOAI8HT type=write size=288281 2024-04-03T03:46:04.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.510+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=RYXDGL8928HJ type=del size=3842177 2024-04-03T03:46:04.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.514+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~1S3V699VTBH8.0 size=142370 2024-04-03T03:46:04.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.522+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=1S3V699VTBH8 tag=HEB2XO4PLDHC type=write size=1190946 2024-04-03T03:46:04.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.526+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~EXUXQNRFKPRZ.0 size=658790 2024-04-03T03:46:04.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.526+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=EXUXQNRFKPRZ tag=BE2T6BPFECJG type=write size=1707366 2024-04-03T03:46:04.527 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.530+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~H1M5YKKMYBAX.0 size=1048576 2024-04-03T03:46:04.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.534+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~H1M5YKKMYBAX.1 size=1048576 2024-04-03T03:46:04.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.534+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~H1M5YKKMYBAX.2 size=672337 2024-04-03T03:46:04.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.542+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=H1M5YKKMYBAX tag=E40VXBIYZXGW type=write size=3818065 2024-04-03T03:46:04.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.546+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~FSIC26AHRHC3.0 size=677708 2024-04-03T03:46:04.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.546+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=FSIC26AHRHC3 tag=DKXR0S6QYLAY type=write size=1726284 2024-04-03T03:46:04.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.550+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=B3KKBSLGGFAD type=write size=861537 2024-04-03T03:46:04.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.558+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~76PNXR99WS35.0 size=1048576 2024-04-03T03:46:04.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.558+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~76PNXR99WS35.1 size=103974 2024-04-03T03:46:04.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.558+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=76PNXR99WS35 tag=8EUOM13BC9ZD type=write size=2201126 2024-04-03T03:46:04.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.562+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=NLHTGV7PM1MK type=del 2024-04-03T03:46:04.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.570+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~7MX3VNVK9ZCP.0 size=1048576 2024-04-03T03:46:04.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.574+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~7MX3VNVK9ZCP.1 size=238466 2024-04-03T03:46:04.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.574+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=7MX3VNVK9ZCP tag=HRV64SUYS3UH type=write size=2335618 2024-04-03T03:46:04.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.578+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=XQWTW24Y8QRO type=del 2024-04-03T03:46:04.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.582+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~G4849O4TNIY0.0 size=1048576 2024-04-03T03:46:04.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.586+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~G4849O4TNIY0.1 size=881071 2024-04-03T03:46:04.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.586+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=G4849O4TNIY0 tag=8YY82TQXP47K type=write size=2978223 2024-04-03T03:46:04.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.590+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=TD4HZ2APAI66 type=del 2024-04-03T03:46:04.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.590+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=QHST743WO5N9 type=del size=1037770 2024-04-03T03:46:04.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.594+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=DXO2XIQLWG5N type=del 2024-04-03T03:46:04.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.602+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~UKPIKL6B1JCT.0 size=1048576 2024-04-03T03:46:04.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.606+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~UKPIKL6B1JCT.1 size=1048576 2024-04-03T03:46:04.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.606+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~UKPIKL6B1JCT.2 size=319184 2024-04-03T03:46:04.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.606+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=UKPIKL6B1JCT tag=BM2229OWTT4A type=write size=3464912 2024-04-03T03:46:04.610 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.614+0000 7f55269288c0 1 < suggested update operation key=8SBTVHL09P63 tag=T5H4QAKLFC4J type=del size=221346 2024-04-03T03:46:04.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.618+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=J5WMAYG38DH3 type=del size=2230478 2024-04-03T03:46:04.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.626+0000 7f55269288c0 1 < suggested remove operation key=KDSE2XB4D1XI tag=GBTXZNH2Y28J type=del 2024-04-03T03:46:04.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.626+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=KKH8J88X9XLO type=write size=553265 2024-04-03T03:46:04.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.630+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=P5CAI532QPVZ type=del 2024-04-03T03:46:04.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.634+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=V1XSD0VLKANE type=del size=3974660 2024-04-03T03:46:04.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.638+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=58UUHR6MFDOT type=del 2024-04-03T03:46:04.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.642+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=DT7W73ZA82ZS type=del size=547732 2024-04-03T03:46:04.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.646+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=ZDB1IO5MTSYV type=del 2024-04-03T03:46:04.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.650+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=B866XISQZGTZ type=del size=3975020 2024-04-03T03:46:04.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.654+0000 7f55269288c0 1 < suggested update operation key=8BMP0HIS520R tag=J1YWUHOVKTOM type=del size=3390261 2024-04-03T03:46:04.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.658+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=2O0AIPH0E8II type=del size=295020 2024-04-03T03:46:04.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.662+0000 7f55269288c0 -1 < failed to complete operation key=8SBTVHL09P63 tag=4H4S51E0JYZE type=del size=3231991: (22) Invalid argument 2024-04-03T03:46:04.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.666+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=O6W6SVQ3N30S type=del size=156952 2024-04-03T03:46:04.664 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.666+0000 7f55269288c0 1 < completed delete operation key=K3Z9W19WEJBM tag=KCWCZG9MEVTS type=del 2024-04-03T03:46:04.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.670+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=2JAAT2M463RE type=del size=2501943 2024-04-03T03:46:04.671 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.674+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=RYXDGL8928HJ type=del 2024-04-03T03:46:04.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.678+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=EEA9RFBY3FCG type=write size=881309 2024-04-03T03:46:04.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.682+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~EXUXQNRFKPRZ.0 size=658790 2024-04-03T03:46:04.683 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.686+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=EXUXQNRFKPRZ tag=BE2T6BPFECJG type=write size=1707366 2024-04-03T03:46:04.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.690+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=PU57UZ50RN40 type=del size=3462377 2024-04-03T03:46:04.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.694+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~FSIC26AHRHC3.0 size=677708 2024-04-03T03:46:04.694 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.698+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=FSIC26AHRHC3 tag=DKXR0S6QYLAY type=write size=1726284 2024-04-03T03:46:04.700 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.702+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~4KF91Z87HCDM.0 size=717724 2024-04-03T03:46:04.700 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.702+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=4KF91Z87HCDM tag=2UUTLKFU1WLI type=write size=1766300 2024-04-03T03:46:04.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.706+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~76PNXR99WS35.0 size=1048576 2024-04-03T03:46:04.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.710+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~76PNXR99WS35.1 size=103974 2024-04-03T03:46:04.710 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.714+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=76PNXR99WS35 tag=8EUOM13BC9ZD type=write size=2201126 2024-04-03T03:46:04.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.718+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~FKO730827L30.0 size=1048576 2024-04-03T03:46:04.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.722+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~FKO730827L30.1 size=345908 2024-04-03T03:46:04.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.722+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=FKO730827L30 tag=YT9E7XQ8IOKH type=write size=2443060 2024-04-03T03:46:04.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.726+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~7MX3VNVK9ZCP.0 size=1048576 2024-04-03T03:46:04.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.726+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~7MX3VNVK9ZCP.1 size=238466 2024-04-03T03:46:04.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.734+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=7MX3VNVK9ZCP tag=HRV64SUYS3UH type=write size=2335618 2024-04-03T03:46:04.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.738+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=GXGWMSCM3W9D type=del size=3837483 2024-04-03T03:46:04.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.738+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~G4849O4TNIY0.0 size=1048576 2024-04-03T03:46:04.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.738+0000 7f55269288c0 1 < canceled part key=_multipart_D9OEPPT37WSJ.2~G4849O4TNIY0.1 size=881071 2024-04-03T03:46:04.744 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.746+0000 7f55269288c0 1 < canceled multipart upload key=D9OEPPT37WSJ upload=G4849O4TNIY0 tag=8YY82TQXP47K type=write size=2978223 2024-04-03T03:46:04.747 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.750+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=JCC0NOEUJ2MB type=del size=2587478 2024-04-03T03:46:04.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.754+0000 7f55269288c0 1 < canceled operation key=X3YCYKP2P9IM tag=QHST743WO5N9 type=del size=1037770 2024-04-03T03:46:04.753 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.758+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=A1FOJ6TPFOXL type=write size=806721 2024-04-03T03:46:04.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.762+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~UKPIKL6B1JCT.0 size=1048576 2024-04-03T03:46:04.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.762+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~UKPIKL6B1JCT.1 size=1048576 2024-04-03T03:46:04.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.766+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~UKPIKL6B1JCT.2 size=319184 2024-04-03T03:46:04.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.770+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=UKPIKL6B1JCT tag=BM2229OWTT4A type=write size=3464912 2024-04-03T03:46:04.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.774+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=ICWJWHG2ZK8D type=del size=1062544 2024-04-03T03:46:04.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.778+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=J5WMAYG38DH3 type=del 2024-04-03T03:46:04.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.786+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~PWXRUUOZERG1.0 size=1048576 2024-04-03T03:46:04.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.786+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~PWXRUUOZERG1.1 size=1048576 2024-04-03T03:46:04.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.790+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~PWXRUUOZERG1.2 size=61662 2024-04-03T03:46:04.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.790+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=PWXRUUOZERG1 tag=BEGC77HVJKBS type=write size=3207390 2024-04-03T03:46:04.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.798+0000 7f55269288c0 1 < suggested remove operation key=MB7HTWATXRMB tag=KKH8J88X9XLO type=write 2024-04-03T03:46:04.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.798+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=5ODXZZBFY5G1 type=del size=867130 2024-04-03T03:46:04.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.801+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=V1XSD0VLKANE type=del 2024-04-03T03:46:04.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.805+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=FHRAEVFJX560 type=del size=1141505 2024-04-03T03:46:04.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.813+0000 7f55269288c0 1 < suggested update operation key=U62RSK21LJEF tag=DT7W73ZA82ZS type=del size=547732 2024-04-03T03:46:04.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.817+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=W1MBN2FZ3MTX type=del size=432813 2024-04-03T03:46:04.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.817+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=B866XISQZGTZ type=del 2024-04-03T03:46:04.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.825+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~BX7WRWEZF2J6.0 size=1048576 2024-04-03T03:46:04.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.829+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~BX7WRWEZF2J6.1 size=1048576 2024-04-03T03:46:04.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.829+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~BX7WRWEZF2J6.2 size=295369 2024-04-03T03:46:04.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.829+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=BX7WRWEZF2J6 tag=5R4XNWFVTME2 type=write size=3441097 2024-04-03T03:46:04.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.833+0000 7f55269288c0 -1 < failed to complete operation key=MB7HTWATXRMB tag=2O0AIPH0E8II type=del size=295020: (22) Invalid argument 2024-04-03T03:46:04.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.841+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~YOJCYWVNOOCS.0 size=1048576 2024-04-03T03:46:04.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.845+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~YOJCYWVNOOCS.1 size=582628 2024-04-03T03:46:04.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.845+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=YOJCYWVNOOCS tag=HI9R2WNZ3SFN type=write size=2679780 2024-04-03T03:46:04.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.849+0000 7f55269288c0 1 < suggested update operation key=AXL5RVPSVDY5 tag=O6W6SVQ3N30S type=del size=156952 2024-04-03T03:46:04.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.857+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~8U0D8QQ721Y6.0 size=781391 2024-04-03T03:46:04.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.857+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=8U0D8QQ721Y6 tag=97FOJB4I8S22 type=write size=1829967 2024-04-03T03:46:04.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.861+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=2JAAT2M463RE type=del 2024-04-03T03:46:04.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.861+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=3ZNJDFDL2F7Z type=del size=2786851 2024-04-03T03:46:04.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.865+0000 7f55269288c0 -1 < failed to complete operation key=U62RSK21LJEF tag=EEA9RFBY3FCG type=write size=881309: (22) Invalid argument 2024-04-03T03:46:04.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.869+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=FW6FOI7HOYQS type=del size=1201287 2024-04-03T03:46:04.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.877+0000 7f55269288c0 1 < suggested remove operation key=0OSIL0R5ZJ54 tag=PU57UZ50RN40 type=del 2024-04-03T03:46:04.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.881+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~5XC3ZT6NWV0A.0 size=1048576 2024-04-03T03:46:04.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.885+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~5XC3ZT6NWV0A.1 size=1048576 2024-04-03T03:46:04.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.885+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~5XC3ZT6NWV0A.2 size=818219 2024-04-03T03:46:04.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.885+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=5XC3ZT6NWV0A tag=0I42E7QHM5Y1 type=write size=3963947 2024-04-03T03:46:04.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.889+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~4KF91Z87HCDM.0 size=717724 2024-04-03T03:46:04.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.897+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=4KF91Z87HCDM tag=2UUTLKFU1WLI type=write size=1766300 2024-04-03T03:46:04.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.901+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=6D8QOIQUKS9D type=del size=1826555 2024-04-03T03:46:04.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.901+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~FKO730827L30.0 size=1048576 2024-04-03T03:46:04.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.905+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~FKO730827L30.1 size=345908 2024-04-03T03:46:04.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.909+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=FKO730827L30 tag=YT9E7XQ8IOKH type=write size=2443060 2024-04-03T03:46:04.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.913+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=T31MQA1DYPCD type=del size=3120088 2024-04-03T03:46:04.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.917+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=GXGWMSCM3W9D type=del size=3837483 2024-04-03T03:46:04.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.921+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~B3H9L1DV9DEQ.0 size=988893 2024-04-03T03:46:04.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.921+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=B3H9L1DV9DEQ tag=QPDM4OJ270F5 type=write size=2037469 2024-04-03T03:46:04.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.925+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=JCC0NOEUJ2MB type=del 2024-04-03T03:46:04.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.929+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=DG9R8UAF8T24 type=del size=903366 2024-04-03T03:46:04.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.933+0000 7f55269288c0 1 < completed write operation key=TLM1C3B9J2A3 tag=A1FOJ6TPFOXL type=write size=806721 2024-04-03T03:46:04.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.937+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~0VKZ5XGYB5YV.0 size=1048576 2024-04-03T03:46:04.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.941+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~0VKZ5XGYB5YV.1 size=1048576 2024-04-03T03:46:04.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.945+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~0VKZ5XGYB5YV.2 size=686286 2024-04-03T03:46:04.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.945+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=0VKZ5XGYB5YV tag=SINN2ZP8W1WA type=write size=3832014 2024-04-03T03:46:04.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.949+0000 7f55269288c0 1 < suggested remove operation key=YCEKDT5EQD9D tag=ICWJWHG2ZK8D type=del 2024-04-03T03:46:04.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.953+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=4YNZNBNIYGGS type=del size=127044 2024-04-03T03:46:04.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.953+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~PWXRUUOZERG1.0 size=1048576 2024-04-03T03:46:04.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.957+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~PWXRUUOZERG1.1 size=1048576 2024-04-03T03:46:04.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.961+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~PWXRUUOZERG1.2 size=61662 2024-04-03T03:46:04.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.965+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=PWXRUUOZERG1 tag=BEGC77HVJKBS type=write size=3207390 2024-04-03T03:46:04.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.969+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=9TDAM7F17LJW type=del size=3903232 2024-04-03T03:46:04.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.973+0000 7f55269288c0 1 < canceled operation key=TXFMKXUGMEA8 tag=5ODXZZBFY5G1 type=del size=867130 2024-04-03T03:46:04.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.977+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=D7YBS8SP5WVS type=del size=4172539 2024-04-03T03:46:04.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.985+0000 7f55269288c0 1 < suggested update operation key=TXFMKXUGMEA8 tag=FHRAEVFJX560 type=del size=1141505 2024-04-03T03:46:04.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.985+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=HW3MGIVWF7MX type=write size=344016 2024-04-03T03:46:04.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.989+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=W1MBN2FZ3MTX type=del 2024-04-03T03:46:04.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.997+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~68OOS8PT5Z4Z.0 size=110475 2024-04-03T03:46:04.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:04.997+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=68OOS8PT5Z4Z tag=4HO6ZJA3NRQL type=write size=1159051 2024-04-03T03:46:04.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.001+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~BX7WRWEZF2J6.0 size=1048576 2024-04-03T03:46:05.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.005+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~BX7WRWEZF2J6.1 size=1048576 2024-04-03T03:46:05.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.005+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~BX7WRWEZF2J6.2 size=295369 2024-04-03T03:46:05.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.013+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=BX7WRWEZF2J6 tag=5R4XNWFVTME2 type=write size=3441097 2024-04-03T03:46:05.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.017+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=4DSDR02SOQQO type=write size=738611 2024-04-03T03:46:05.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.021+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~YOJCYWVNOOCS.0 size=1048576 2024-04-03T03:46:05.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.021+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~YOJCYWVNOOCS.1 size=582628 2024-04-03T03:46:05.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.029+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=YOJCYWVNOOCS tag=HI9R2WNZ3SFN type=write size=2679780 2024-04-03T03:46:05.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.033+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=DPD05J8E11TD type=del size=2148246 2024-04-03T03:46:05.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.033+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~8U0D8QQ721Y6.0 size=781391 2024-04-03T03:46:05.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.041+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=8U0D8QQ721Y6 tag=97FOJB4I8S22 type=write size=1829967 2024-04-03T03:46:05.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.045+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~EU9TIY2AW63Q.0 size=1048576 2024-04-03T03:46:05.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.049+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~EU9TIY2AW63Q.1 size=1048576 2024-04-03T03:46:05.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.053+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~EU9TIY2AW63Q.2 size=233277 2024-04-03T03:46:05.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.053+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=EU9TIY2AW63Q tag=KHER74W5ME8V type=write size=3379005 2024-04-03T03:46:05.052 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.053+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=3ZNJDFDL2F7Z type=del 2024-04-03T03:46:05.058 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.061+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=0QEOAD62YJLM type=del size=599886 2024-04-03T03:46:05.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.069+0000 7f55269288c0 1 < suggested update operation key=D9OEPPT37WSJ tag=FW6FOI7HOYQS type=del size=1201287 2024-04-03T03:46:05.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.073+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~BJOZK6ENPO9M.0 size=1048576 2024-04-03T03:46:05.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.077+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~BJOZK6ENPO9M.1 size=1048576 2024-04-03T03:46:05.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.077+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~BJOZK6ENPO9M.2 size=493896 2024-04-03T03:46:05.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.077+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=BJOZK6ENPO9M tag=YNS8BVNK8OQR type=write size=3639624 2024-04-03T03:46:05.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.081+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~5XC3ZT6NWV0A.0 size=1048576 2024-04-03T03:46:05.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.085+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~5XC3ZT6NWV0A.1 size=1048576 2024-04-03T03:46:05.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.089+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~5XC3ZT6NWV0A.2 size=818219 2024-04-03T03:46:05.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.093+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=5XC3ZT6NWV0A tag=0I42E7QHM5Y1 type=write size=3963947 2024-04-03T03:46:05.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.097+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=TG0QGUTG1M8B type=del size=3627225 2024-04-03T03:46:05.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.105+0000 7f55269288c0 1 < suggested remove operation key=K7A1O21ZURWQ tag=6D8QOIQUKS9D type=del 2024-04-03T03:46:05.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.109+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=CL3NQ09MHD8A type=del size=3463271 2024-04-03T03:46:05.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.109+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=T31MQA1DYPCD type=del 2024-04-03T03:46:05.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.117+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~CJ98A7FFY18Q.0 size=512179 2024-04-03T03:46:05.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.117+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=CJ98A7FFY18Q tag=V92878K276MI type=write size=1560755 2024-04-03T03:46:05.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.121+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~B3H9L1DV9DEQ.0 size=988893 2024-04-03T03:46:05.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.125+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=B3H9L1DV9DEQ tag=QPDM4OJ270F5 type=write size=2037469 2024-04-03T03:46:05.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.129+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~DQM5FXP2KLFV.0 size=1048576 2024-04-03T03:46:05.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.133+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~DQM5FXP2KLFV.1 size=467569 2024-04-03T03:46:05.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.133+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=DQM5FXP2KLFV tag=HB3SX8XU3TNE type=write size=2564721 2024-04-03T03:46:05.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.137+0000 7f55269288c0 -1 < failed to complete operation key=TXFMKXUGMEA8 tag=DG9R8UAF8T24 type=del size=903366: (22) Invalid argument 2024-04-03T03:46:05.140 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.141+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~ZC3D2IF5AC7T.0 size=1048576 2024-04-03T03:46:05.142 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.145+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~ZC3D2IF5AC7T.1 size=1048576 2024-04-03T03:46:05.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.149+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~ZC3D2IF5AC7T.2 size=27459 2024-04-03T03:46:05.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.149+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=ZC3D2IF5AC7T tag=XOMS0T9OECQQ type=write size=3173187 2024-04-03T03:46:05.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.149+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~0VKZ5XGYB5YV.0 size=1048576 2024-04-03T03:46:05.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.153+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~0VKZ5XGYB5YV.1 size=1048576 2024-04-03T03:46:05.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.157+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~0VKZ5XGYB5YV.2 size=686286 2024-04-03T03:46:05.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.161+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=0VKZ5XGYB5YV tag=SINN2ZP8W1WA type=write size=3832014 2024-04-03T03:46:05.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.165+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=8A2AMALZ0P4D type=del size=3579230 2024-04-03T03:46:05.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.165+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=4YNZNBNIYGGS type=del 2024-04-03T03:46:05.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.173+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~TQUDQT8O06DV.0 size=968042 2024-04-03T03:46:05.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.173+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=TQUDQT8O06DV tag=BOGD2ITQOSYJ type=write size=2016618 2024-04-03T03:46:05.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.173+0000 7f55269288c0 1 < canceled operation key=KU1R0YLDP1V3 tag=9TDAM7F17LJW type=del size=3903232 2024-04-03T03:46:05.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.177+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=DYQ7OJFHM7UX type=del size=3065523 2024-04-03T03:46:05.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.181+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=D7YBS8SP5WVS type=del 2024-04-03T03:46:05.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.185+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=V7ZIYENIWOEQ type=del size=1523576 2024-04-03T03:46:05.187 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.189+0000 7f55269288c0 1 < suggested update operation key=7POFUQ9CX6B1 tag=HW3MGIVWF7MX type=write size=344016 2024-04-03T03:46:05.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.193+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~RRBMS28RH9WY.0 size=1048576 2024-04-03T03:46:05.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.197+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~RRBMS28RH9WY.1 size=1048576 2024-04-03T03:46:05.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.201+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~RRBMS28RH9WY.2 size=661464 2024-04-03T03:46:05.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.201+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=RRBMS28RH9WY tag=ZYBE32PCVP9N type=write size=3807192 2024-04-03T03:46:05.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.201+0000 7f55269288c0 1 < canceled part key=_multipart_6KH6TASZS3UG.2~68OOS8PT5Z4Z.0 size=110475 2024-04-03T03:46:05.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.205+0000 7f55269288c0 1 < canceled multipart upload key=6KH6TASZS3UG upload=68OOS8PT5Z4Z tag=4HO6ZJA3NRQL type=write size=1159051 2024-04-03T03:46:05.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.209+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~0DMFFMBP50OL.0 size=1048576 2024-04-03T03:46:05.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.213+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~0DMFFMBP50OL.1 size=1048576 2024-04-03T03:46:05.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.217+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~0DMFFMBP50OL.2 size=444697 2024-04-03T03:46:05.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.217+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=0DMFFMBP50OL tag=KGW9M15ZSR2S type=write size=3590425 2024-04-03T03:46:05.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.217+0000 7f55269288c0 1 < canceled operation key=CPR27NMHPIPQ tag=4DSDR02SOQQO type=write size=738611 2024-04-03T03:46:05.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.221+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=423KVE8F10X5 type=write size=615656 2024-04-03T03:46:05.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.229+0000 7f55269288c0 1 < suggested update operation key=D8W2ZKIZFI8H tag=DPD05J8E11TD type=del size=2148246 2024-04-03T03:46:05.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.233+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~O23H2ODK0S6I.0 size=716269 2024-04-03T03:46:05.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.233+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=O23H2ODK0S6I tag=YVXJG4XAEVF4 type=write size=1764845 2024-04-03T03:46:05.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.233+0000 7f55269288c0 1 < canceled part key=_multipart_8SBTVHL09P63.2~EU9TIY2AW63Q.0 size=1048576 2024-04-03T03:46:05.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.237+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~EU9TIY2AW63Q.1 size=1048576 2024-04-03T03:46:05.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.237+0000 7f55269288c0 1 < canceled part key=_multipart_8SBTVHL09P63.2~EU9TIY2AW63Q.2 size=233277 2024-04-03T03:46:05.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.245+0000 7f55269288c0 1 < canceled multipart upload key=8SBTVHL09P63 upload=EU9TIY2AW63Q tag=KHER74W5ME8V type=write size=3379005 2024-04-03T03:46:05.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.249+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~LJ3NE4U3T18V.0 size=1048576 2024-04-03T03:46:05.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.253+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~LJ3NE4U3T18V.1 size=500904 2024-04-03T03:46:05.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.253+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=LJ3NE4U3T18V tag=K2VRVTON575M type=write size=2598056 2024-04-03T03:46:05.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.253+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=0QEOAD62YJLM type=del 2024-04-03T03:46:05.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.261+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~473G89PN5WYR.0 size=813107 2024-04-03T03:46:05.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.261+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=473G89PN5WYR tag=IS4H0OSRM78V type=write size=1861683 2024-04-03T03:46:05.262 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.265+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~BJOZK6ENPO9M.0 size=1048576 2024-04-03T03:46:05.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.265+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~BJOZK6ENPO9M.1 size=1048576 2024-04-03T03:46:05.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.269+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~BJOZK6ENPO9M.2 size=493896 2024-04-03T03:46:05.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.273+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=BJOZK6ENPO9M tag=YNS8BVNK8OQR type=write size=3639624 2024-04-03T03:46:05.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.277+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=Q5ZMD6TED9FX type=del size=701846 2024-04-03T03:46:05.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.281+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=TG0QGUTG1M8B type=del 2024-04-03T03:46:05.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.285+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=8Q70BKM3FS6B type=del size=1488497 2024-04-03T03:46:05.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.285+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=CL3NQ09MHD8A type=del 2024-04-03T03:46:05.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.289+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=BRHE67RLY4N0 type=del size=3680710 2024-04-03T03:46:05.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.293+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~CJ98A7FFY18Q.0 size=512179 2024-04-03T03:46:05.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.297+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=CJ98A7FFY18Q tag=V92878K276MI type=write size=1560755 2024-04-03T03:46:05.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.305+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~03LE7791NZWD.0 size=788364 2024-04-03T03:46:05.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.305+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=03LE7791NZWD tag=XQIKD789YNZG type=write size=1836940 2024-04-03T03:46:05.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.309+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~DQM5FXP2KLFV.0 size=1048576 2024-04-03T03:46:05.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.309+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~DQM5FXP2KLFV.1 size=467569 2024-04-03T03:46:05.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.313+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=DQM5FXP2KLFV tag=HB3SX8XU3TNE type=write size=2564721 2024-04-03T03:46:05.315 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.317+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=MRWZHY9LJ0GZ type=del size=2444891 2024-04-03T03:46:05.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.321+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~ZC3D2IF5AC7T.0 size=1048576 2024-04-03T03:46:05.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.325+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~ZC3D2IF5AC7T.1 size=1048576 2024-04-03T03:46:05.323 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.325+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~ZC3D2IF5AC7T.2 size=27459 2024-04-03T03:46:05.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.333+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=ZC3D2IF5AC7T tag=XOMS0T9OECQQ type=write size=3173187 2024-04-03T03:46:05.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.337+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~48ITIW71I3FZ.0 size=697490 2024-04-03T03:46:05.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.337+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=48ITIW71I3FZ tag=H8IX21TKZ8S5 type=write size=1746066 2024-04-03T03:46:05.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.341+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=8A2AMALZ0P4D type=del 2024-04-03T03:46:05.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.345+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~RG67LML0KYWQ.0 size=1048576 2024-04-03T03:46:05.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.349+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~RG67LML0KYWQ.1 size=300472 2024-04-03T03:46:05.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.349+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=RG67LML0KYWQ tag=44R7YJJYKRYO type=write size=2397624 2024-04-03T03:46:05.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.353+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~TQUDQT8O06DV.0 size=968042 2024-04-03T03:46:05.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.361+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=TQUDQT8O06DV tag=BOGD2ITQOSYJ type=write size=2016618 2024-04-03T03:46:05.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.365+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~Q8ECT1EQC2M1.0 size=1048576 2024-04-03T03:46:05.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.369+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~Q8ECT1EQC2M1.1 size=882561 2024-04-03T03:46:05.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.369+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=Q8ECT1EQC2M1 tag=NK7QSIQM6A9Q type=write size=2979713 2024-04-03T03:46:05.369 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.373+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=DYQ7OJFHM7UX type=del 2024-04-03T03:46:05.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.373+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=ML7N2M5SBZID type=del size=1790435 2024-04-03T03:46:05.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.377+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=V7ZIYENIWOEQ type=del 2024-04-03T03:46:05.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.385+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~I7Z9JFAJKCGC.0 size=1048576 2024-04-03T03:46:05.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.385+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~I7Z9JFAJKCGC.1 size=722238 2024-04-03T03:46:05.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.385+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=I7Z9JFAJKCGC tag=D3PKUT7HYTJF type=write size=2819390 2024-04-03T03:46:05.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.389+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~RRBMS28RH9WY.0 size=1048576 2024-04-03T03:46:05.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.393+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~RRBMS28RH9WY.1 size=1048576 2024-04-03T03:46:05.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.397+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~RRBMS28RH9WY.2 size=661464 2024-04-03T03:46:05.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.401+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=RRBMS28RH9WY tag=ZYBE32PCVP9N type=write size=3807192 2024-04-03T03:46:05.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.405+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=FSQEWK25BRJJ type=write size=801492 2024-04-03T03:46:05.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.409+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~0DMFFMBP50OL.0 size=1048576 2024-04-03T03:46:05.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.409+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~0DMFFMBP50OL.1 size=1048576 2024-04-03T03:46:05.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.413+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~0DMFFMBP50OL.2 size=444697 2024-04-03T03:46:05.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.417+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=0DMFFMBP50OL tag=KGW9M15ZSR2S type=write size=3590425 2024-04-03T03:46:05.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.421+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~OODHBGZRUGAL.0 size=752362 2024-04-03T03:46:05.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.421+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=OODHBGZRUGAL tag=VBZVBI893726 type=write size=1800938 2024-04-03T03:46:05.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.425+0000 7f55269288c0 1 < completed write operation key=KDSE2XB4D1XI tag=423KVE8F10X5 type=write size=615656 2024-04-03T03:46:05.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.429+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=ZR4D8DVJO7D7 type=del size=2771175 2024-04-03T03:46:05.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.433+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~O23H2ODK0S6I.0 size=716269 2024-04-03T03:46:05.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.437+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=O23H2ODK0S6I tag=YVXJG4XAEVF4 type=write size=1764845 2024-04-03T03:46:05.438 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.441+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=EY33NGI93YNA type=del size=525724 2024-04-03T03:46:05.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.445+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~LJ3NE4U3T18V.0 size=1048576 2024-04-03T03:46:05.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.445+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~LJ3NE4U3T18V.1 size=500904 2024-04-03T03:46:05.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.449+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=LJ3NE4U3T18V tag=K2VRVTON575M type=write size=2598056 2024-04-03T03:46:05.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.453+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=X6F3K50OYPGS type=del size=2384160 2024-04-03T03:46:05.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.457+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~473G89PN5WYR.0 size=813107 2024-04-03T03:46:05.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.461+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=473G89PN5WYR tag=IS4H0OSRM78V type=write size=1861683 2024-04-03T03:46:05.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.465+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=SJDDYXC54MP7 type=del size=2866471 2024-04-03T03:46:05.465 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.469+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=Q5ZMD6TED9FX type=del 2024-04-03T03:46:05.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.473+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~I6RK2T4IMVS5.0 size=1048576 2024-04-03T03:46:05.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.473+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~I6RK2T4IMVS5.1 size=1048576 2024-04-03T03:46:05.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.477+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~I6RK2T4IMVS5.2 size=783497 2024-04-03T03:46:05.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.477+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=I6RK2T4IMVS5 tag=1YWGGP5DM83J type=write size=3929225 2024-04-03T03:46:05.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.481+0000 7f55269288c0 1 < canceled operation key=7POFUQ9CX6B1 tag=8Q70BKM3FS6B type=del size=1488497 2024-04-03T03:46:05.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.481+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=EC3UIMCQM3E8 type=del size=4148111 2024-04-03T03:46:05.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.485+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=BRHE67RLY4N0 type=del 2024-04-03T03:46:05.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.489+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=3QX92YS5GKVN type=del size=2703572 2024-04-03T03:46:05.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.489+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~03LE7791NZWD.0 size=788364 2024-04-03T03:46:05.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.497+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=03LE7791NZWD tag=XQIKD789YNZG type=write size=1836940 2024-04-03T03:46:05.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.501+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~MLLQUSJC1FZR.0 size=195063 2024-04-03T03:46:05.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.501+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=MLLQUSJC1FZR tag=UNHDWKJKH96S type=write size=1243639 2024-04-03T03:46:05.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.505+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=MRWZHY9LJ0GZ type=del 2024-04-03T03:46:05.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.509+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=UPNMAT0HUU6E type=del size=3351361 2024-04-03T03:46:05.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.509+0000 7f55269288c0 1 < canceled part key=_multipart_YCEKDT5EQD9D.2~48ITIW71I3FZ.0 size=697490 2024-04-03T03:46:05.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.513+0000 7f55269288c0 1 < canceled multipart upload key=YCEKDT5EQD9D upload=48ITIW71I3FZ tag=H8IX21TKZ8S5 type=write size=1746066 2024-04-03T03:46:05.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.517+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=G10THAEJN33O type=del size=3992476 2024-04-03T03:46:05.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.517+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~RG67LML0KYWQ.0 size=1048576 2024-04-03T03:46:05.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.521+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~RG67LML0KYWQ.1 size=300472 2024-04-03T03:46:05.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.525+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=RG67LML0KYWQ tag=44R7YJJYKRYO type=write size=2397624 2024-04-03T03:46:05.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.529+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=F87WIL13KNR4 type=del size=2794682 2024-04-03T03:46:05.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.533+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~Q8ECT1EQC2M1.0 size=1048576 2024-04-03T03:46:05.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.533+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~Q8ECT1EQC2M1.1 size=882561 2024-04-03T03:46:05.536 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.537+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=Q8ECT1EQC2M1 tag=NK7QSIQM6A9Q type=write size=2979713 2024-04-03T03:46:05.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.541+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=A8T79P4SJ20Q type=del size=1336260 2024-04-03T03:46:05.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.545+0000 7f55269288c0 1 < canceled operation key=TXFMKXUGMEA8 tag=ML7N2M5SBZID type=del size=1790435 2024-04-03T03:46:05.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.549+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=4UQVRDGS3QFE type=del size=3905339 2024-04-03T03:46:05.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.553+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~I7Z9JFAJKCGC.0 size=1048576 2024-04-03T03:46:05.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.553+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~I7Z9JFAJKCGC.1 size=722238 2024-04-03T03:46:05.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.557+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=I7Z9JFAJKCGC tag=D3PKUT7HYTJF type=write size=2819390 2024-04-03T03:46:05.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.561+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=I5M30MU9SNJD type=del size=484635 2024-04-03T03:46:05.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.565+0000 7f55269288c0 1 < suggested update operation key=SFN1M3HPGT18 tag=FSQEWK25BRJJ type=write size=801492 2024-04-03T03:46:05.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.569+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=YIJUF55FKWI6 type=del size=1038005 2024-04-03T03:46:05.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.573+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~OODHBGZRUGAL.0 size=752362 2024-04-03T03:46:05.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.577+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=OODHBGZRUGAL tag=VBZVBI893726 type=write size=1800938 2024-04-03T03:46:05.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.581+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=4JS0MN40YJM1 type=del size=3061980 2024-04-03T03:46:05.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.585+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=ZR4D8DVJO7D7 type=del 2024-04-03T03:46:05.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.585+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=47345450YNW8 type=del size=1473029 2024-04-03T03:46:05.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.589+0000 7f55269288c0 1 < canceled operation key=AGTQQYXO7453 tag=EY33NGI93YNA type=del size=525724 2024-04-03T03:46:05.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.593+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~YPOV39Z9Y0BG.0 size=1048576 2024-04-03T03:46:05.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.597+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~YPOV39Z9Y0BG.1 size=80980 2024-04-03T03:46:05.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.597+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=YPOV39Z9Y0BG tag=KOI8YGB1TL7M type=write size=2178132 2024-04-03T03:46:05.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.601+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=X6F3K50OYPGS type=del 2024-04-03T03:46:05.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.605+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~99L26FMJIYVG.0 size=1048576 2024-04-03T03:46:05.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.605+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~99L26FMJIYVG.1 size=119846 2024-04-03T03:46:05.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.605+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=99L26FMJIYVG tag=1ARX96VGWX0G type=write size=2216998 2024-04-03T03:46:05.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.609+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=SJDDYXC54MP7 type=del 2024-04-03T03:46:05.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.613+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=EC36HX5VYG8R type=del size=2461492 2024-04-03T03:46:05.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.613+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~I6RK2T4IMVS5.0 size=1048576 2024-04-03T03:46:05.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.617+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~I6RK2T4IMVS5.1 size=1048576 2024-04-03T03:46:05.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.621+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~I6RK2T4IMVS5.2 size=783497 2024-04-03T03:46:05.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.625+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=I6RK2T4IMVS5 tag=1YWGGP5DM83J type=write size=3929225 2024-04-03T03:46:05.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.633+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~RKZE722XEEFW.0 size=1048576 2024-04-03T03:46:05.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.637+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~RKZE722XEEFW.1 size=823336 2024-04-03T03:46:05.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.637+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=RKZE722XEEFW tag=LP1MVDVII5X6 type=write size=2920488 2024-04-03T03:46:05.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.641+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=EC3UIMCQM3E8 type=del 2024-04-03T03:46:05.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.641+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=PQFCGW3VR9HQ type=del size=1453429 2024-04-03T03:46:05.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.645+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=3QX92YS5GKVN type=del 2024-04-03T03:46:05.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.649+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~8LTCUPCB1QRQ.0 size=1048576 2024-04-03T03:46:05.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.653+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~8LTCUPCB1QRQ.1 size=1048576 2024-04-03T03:46:05.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.657+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~8LTCUPCB1QRQ.2 size=622764 2024-04-03T03:46:05.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.657+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=8LTCUPCB1QRQ tag=4HX03BV2W55D type=write size=3768492 2024-04-03T03:46:05.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.657+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~MLLQUSJC1FZR.0 size=195063 2024-04-03T03:46:05.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.661+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=MLLQUSJC1FZR tag=UNHDWKJKH96S type=write size=1243639 2024-04-03T03:46:05.663 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.665+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=MU4RCQWLKEY8 type=del size=3812495 2024-04-03T03:46:05.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.673+0000 7f55269288c0 1 < suggested remove operation key=AXL5RVPSVDY5 tag=UPNMAT0HUU6E type=del 2024-04-03T03:46:05.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.673+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=0SEXL6SG6Z8N type=del size=1789218 2024-04-03T03:46:05.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.677+0000 7f55269288c0 -1 < failed to complete operation key=SFN1M3HPGT18 tag=G10THAEJN33O type=del size=3992476: (22) Invalid argument 2024-04-03T03:46:05.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.681+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=MEKC5NNSFXE0 type=del size=582605 2024-04-03T03:46:05.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.681+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=F87WIL13KNR4 type=del 2024-04-03T03:46:05.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.689+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~B213P0Y062H1.0 size=1048576 2024-04-03T03:46:05.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.689+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~B213P0Y062H1.1 size=318400 2024-04-03T03:46:05.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.689+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=B213P0Y062H1 tag=5UOBNWR1XHD0 type=write size=2415552 2024-04-03T03:46:05.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.693+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=A8T79P4SJ20Q type=del 2024-04-03T03:46:05.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.693+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=TLQIEEWIIDR3 type=write size=561504 2024-04-03T03:46:05.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.697+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=4UQVRDGS3QFE type=del 2024-04-03T03:46:05.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.705+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~2GTIOSM88Z8X.0 size=853876 2024-04-03T03:46:05.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.705+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=2GTIOSM88Z8X tag=ODUO8FL4D253 type=write size=1902452 2024-04-03T03:46:05.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.705+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=I5M30MU9SNJD type=del 2024-04-03T03:46:05.707 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.709+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=8GF2Z25URSWO type=del size=1107231 2024-04-03T03:46:05.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.717+0000 7f55269288c0 1 < suggested update operation key=YCEKDT5EQD9D tag=YIJUF55FKWI6 type=del size=1038005 2024-04-03T03:46:05.715 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.717+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=U8ACT4IW4TGV type=del size=33933 2024-04-03T03:46:05.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.721+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=4JS0MN40YJM1 type=del 2024-04-03T03:46:05.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.725+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=VDENGOBETQUP type=write size=635266 2024-04-03T03:46:05.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.725+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=47345450YNW8 type=del 2024-04-03T03:46:05.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.729+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=4YGIQ2ROYCP3 type=del size=882302 2024-04-03T03:46:05.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.733+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~YPOV39Z9Y0BG.0 size=1048576 2024-04-03T03:46:05.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.737+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~YPOV39Z9Y0BG.1 size=80980 2024-04-03T03:46:05.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.741+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=YPOV39Z9Y0BG tag=KOI8YGB1TL7M type=write size=2178132 2024-04-03T03:46:05.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.741+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=Q3GGHJZCG3CH type=del size=2702005 2024-04-03T03:46:05.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.745+0000 7f55269288c0 1 < canceled part key=_multipart_F6IBZ80J4SDM.2~99L26FMJIYVG.0 size=1048576 2024-04-03T03:46:05.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.745+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~99L26FMJIYVG.1 size=119846 2024-04-03T03:46:05.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.749+0000 7f55269288c0 1 < canceled multipart upload key=F6IBZ80J4SDM upload=99L26FMJIYVG tag=1ARX96VGWX0G type=write size=2216998 2024-04-03T03:46:05.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.753+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=MSQR9GPPL3WI type=del size=1038625 2024-04-03T03:46:05.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.757+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=EC36HX5VYG8R type=del 2024-04-03T03:46:05.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.761+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=8EE7XHA4PHMI type=del size=2047843 2024-04-03T03:46:05.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.765+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~RKZE722XEEFW.0 size=1048576 2024-04-03T03:46:05.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.765+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~RKZE722XEEFW.1 size=823336 2024-04-03T03:46:05.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.773+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=RKZE722XEEFW tag=LP1MVDVII5X6 type=write size=2920488 2024-04-03T03:46:05.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.777+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~DINGYU7RASUI.0 size=1048576 2024-04-03T03:46:05.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.781+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~DINGYU7RASUI.1 size=879209 2024-04-03T03:46:05.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.781+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=DINGYU7RASUI tag=5QDE5N1KZB3G type=write size=2976361 2024-04-03T03:46:05.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.785+0000 7f55269288c0 1 < suggested remove operation key=K7A1O21ZURWQ tag=PQFCGW3VR9HQ type=del 2024-04-03T03:46:05.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.789+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=SHWPDFHKKO38 type=write size=62039 2024-04-03T03:46:05.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.793+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~8LTCUPCB1QRQ.0 size=1048576 2024-04-03T03:46:05.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.793+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~8LTCUPCB1QRQ.1 size=1048576 2024-04-03T03:46:05.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.797+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~8LTCUPCB1QRQ.2 size=622764 2024-04-03T03:46:05.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.805+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=8LTCUPCB1QRQ tag=4HX03BV2W55D type=write size=3768492 2024-04-03T03:46:05.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.809+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~HHU6UGXJKW40.0 size=1048576 2024-04-03T03:46:05.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.809+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~HHU6UGXJKW40.1 size=458977 2024-04-03T03:46:05.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.809+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=HHU6UGXJKW40 tag=CSTYPR3U3G2D type=write size=2556129 2024-04-03T03:46:05.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.813+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=MU4RCQWLKEY8 type=del 2024-04-03T03:46:05.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.817+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~AXE73LTOJWKL.0 size=681533 2024-04-03T03:46:05.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.817+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=AXE73LTOJWKL tag=W2A457149QJE type=write size=1730109 2024-04-03T03:46:05.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.825+0000 7f55269288c0 1 < suggested update operation key=KU1R0YLDP1V3 tag=0SEXL6SG6Z8N type=del size=1789218 2024-04-03T03:46:05.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.825+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=0NTT6GWV37ZB type=del size=1185835 2024-04-03T03:46:05.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.829+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=MEKC5NNSFXE0 type=del 2024-04-03T03:46:05.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.833+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~UGI7UI7RQ13O.0 size=142462 2024-04-03T03:46:05.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.833+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=UGI7UI7RQ13O tag=AEZWFPK0LPK9 type=write size=1191038 2024-04-03T03:46:05.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.837+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~B213P0Y062H1.0 size=1048576 2024-04-03T03:46:05.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.841+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~B213P0Y062H1.1 size=318400 2024-04-03T03:46:05.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.845+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=B213P0Y062H1 tag=5UOBNWR1XHD0 type=write size=2415552 2024-04-03T03:46:05.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.849+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=4Y0N3DIQE103 type=del size=1738646 2024-04-03T03:46:05.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.849+0000 7f55269288c0 1 < completed write operation key=CPR27NMHPIPQ tag=TLQIEEWIIDR3 type=write size=561504 2024-04-03T03:46:05.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.853+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=10NR5RJLJFN3 type=del size=2561872 2024-04-03T03:46:05.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.853+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~2GTIOSM88Z8X.0 size=853876 2024-04-03T03:46:05.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.857+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=2GTIOSM88Z8X tag=ODUO8FL4D253 type=write size=1902452 2024-04-03T03:46:05.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.861+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=72AFQWJAGCLE type=write size=598929 2024-04-03T03:46:05.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.865+0000 7f55269288c0 1 < suggested remove operation key=AGTQQYXO7453 tag=8GF2Z25URSWO type=del 2024-04-03T03:46:05.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.869+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=LCQ0ZDOFL4Y9 type=write size=78059 2024-04-03T03:46:05.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.873+0000 7f55269288c0 1 < suggested update operation key=D8W2ZKIZFI8H tag=U8ACT4IW4TGV type=del size=33933 2024-04-03T03:46:05.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.877+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=JDBD9AP67Q6T type=del size=3837774 2024-04-03T03:46:05.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.877+0000 7f55269288c0 1 < completed write operation key=TW860A14J9RC tag=VDENGOBETQUP type=write size=635266 2024-04-03T03:46:05.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.881+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=6H2LBHU0M9DN type=del size=893266 2024-04-03T03:46:05.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.885+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=4YGIQ2ROYCP3 type=del 2024-04-03T03:46:05.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.889+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~AZ1ROD38FN8T.0 size=222558 2024-04-03T03:46:05.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.889+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=AZ1ROD38FN8T tag=IKK2XXYJYOQH type=write size=1271134 2024-04-03T03:46:05.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.889+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=Q3GGHJZCG3CH type=del 2024-04-03T03:46:05.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.893+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=PYNT4IYPT88D type=write size=540647 2024-04-03T03:46:05.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.901+0000 7f55269288c0 1 < suggested update operation key=D9OEPPT37WSJ tag=MSQR9GPPL3WI type=del size=1038625 2024-04-03T03:46:05.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.905+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=B4IDAWS4DURX type=del size=2659219 2024-04-03T03:46:05.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.905+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=8EE7XHA4PHMI type=del 2024-04-03T03:46:05.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.909+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=33EY4F9WKDSN type=del size=2108249 2024-04-03T03:46:05.910 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.913+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~DINGYU7RASUI.0 size=1048576 2024-04-03T03:46:05.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.913+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~DINGYU7RASUI.1 size=879209 2024-04-03T03:46:05.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.917+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=DINGYU7RASUI tag=5QDE5N1KZB3G type=write size=2976361 2024-04-03T03:46:05.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.921+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=Z4TOUEZ5D14U type=del size=3269919 2024-04-03T03:46:05.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.925+0000 7f55269288c0 1 < completed write operation key=F6IBZ80J4SDM tag=SHWPDFHKKO38 type=write size=62039 2024-04-03T03:46:05.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.925+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=7BNMJ2HR0O1B type=del size=4096851 2024-04-03T03:46:05.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.929+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~HHU6UGXJKW40.0 size=1048576 2024-04-03T03:46:05.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.933+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~HHU6UGXJKW40.1 size=458977 2024-04-03T03:46:05.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.937+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=HHU6UGXJKW40 tag=CSTYPR3U3G2D type=write size=2556129 2024-04-03T03:46:05.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.937+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=EAJ8Y8L98MO5 type=del size=278161 2024-04-03T03:46:05.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.941+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~AXE73LTOJWKL.0 size=681533 2024-04-03T03:46:05.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.945+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=AXE73LTOJWKL tag=W2A457149QJE type=write size=1730109 2024-04-03T03:46:05.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.949+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=KFHBJ9Y62U96 type=write size=915528 2024-04-03T03:46:05.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.949+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=0NTT6GWV37ZB type=del 2024-04-03T03:46:05.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.953+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=P5HASH3ULZQQ type=del size=3476658 2024-04-03T03:46:05.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.957+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~UGI7UI7RQ13O.0 size=142462 2024-04-03T03:46:05.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.961+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=UGI7UI7RQ13O tag=AEZWFPK0LPK9 type=write size=1191038 2024-04-03T03:46:05.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.961+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=8D7O1OLG0OCG type=del size=467103 2024-04-03T03:46:05.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.965+0000 7f55269288c0 1 < canceled operation key=U62RSK21LJEF tag=4Y0N3DIQE103 type=del size=1738646 2024-04-03T03:46:05.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.969+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~9WWO0WG1MN8M.0 size=1048576 2024-04-03T03:46:05.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.973+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~9WWO0WG1MN8M.1 size=941957 2024-04-03T03:46:05.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.973+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=9WWO0WG1MN8M tag=58UHVQ48RMH5 type=write size=3039109 2024-04-03T03:46:05.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.977+0000 7f55269288c0 1 < suggested remove operation key=Z42NDVEX1SOL tag=10NR5RJLJFN3 type=del 2024-04-03T03:46:05.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.981+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~0B1E5Y43N33I.0 size=262374 2024-04-03T03:46:05.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.981+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=0B1E5Y43N33I tag=8JQMBBP692KW type=write size=1310950 2024-04-03T03:46:05.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.985+0000 7f55269288c0 1 < completed write operation key=7POFUQ9CX6B1 tag=72AFQWJAGCLE type=write size=598929 2024-04-03T03:46:05.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.989+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=47EWGM1BUJAJ type=del size=2611967 2024-04-03T03:46:05.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.989+0000 7f55269288c0 1 < completed write operation key=K7A1O21ZURWQ tag=LCQ0ZDOFL4Y9 type=write size=78059 2024-04-03T03:46:05.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.993+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=S2C0TGOXJCVS type=del size=2727991 2024-04-03T03:46:05.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.997+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=JDBD9AP67Q6T type=del 2024-04-03T03:46:05.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:05.997+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=3DP87281MV8R type=del size=1747588 2024-04-03T03:46:05.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.001+0000 7f55269288c0 -1 < failed to complete operation key=D9OEPPT37WSJ tag=6H2LBHU0M9DN type=del size=893266: (22) Invalid argument 2024-04-03T03:46:06.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.005+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=78WCH4DJ2H0Z type=write size=453797 2024-04-03T03:46:06.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.005+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~AZ1ROD38FN8T.0 size=222558 2024-04-03T03:46:06.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.009+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=AZ1ROD38FN8T tag=IKK2XXYJYOQH type=write size=1271134 2024-04-03T03:46:06.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.013+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=YTT746Y51K3U type=del size=3321697 2024-04-03T03:46:06.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.017+0000 7f55269288c0 1 < completed write operation key=ZKSA09OSFSYN tag=PYNT4IYPT88D type=write size=540647 2024-04-03T03:46:06.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.017+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=PNTCXLHFQGKQ type=write size=918293 2024-04-03T03:46:06.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.021+0000 7f55269288c0 -1 < failed to complete operation key=Z42NDVEX1SOL tag=B4IDAWS4DURX type=del size=2659219: (22) Invalid argument 2024-04-03T03:46:06.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.025+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=E3E2QSUYIZW3 type=del size=1569158 2024-04-03T03:46:06.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.025+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=33EY4F9WKDSN type=del 2024-04-03T03:46:06.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.029+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=WCMJO10B1HA2 type=del size=88503 2024-04-03T03:46:06.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.033+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=Z4TOUEZ5D14U type=del 2024-04-03T03:46:06.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.037+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~BTSPYUN7NFAA.0 size=1048576 2024-04-03T03:46:06.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.041+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~BTSPYUN7NFAA.1 size=549324 2024-04-03T03:46:06.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.041+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=BTSPYUN7NFAA tag=1H23DCOOD6U7 type=write size=2646476 2024-04-03T03:46:06.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.045+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=7BNMJ2HR0O1B type=del 2024-04-03T03:46:06.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.045+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=A9OQR5Z1I2ES type=write size=133315 2024-04-03T03:46:06.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.053+0000 7f55269288c0 1 < suggested update operation key=KU1R0YLDP1V3 tag=EAJ8Y8L98MO5 type=del size=278161 2024-04-03T03:46:06.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.057+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=XW1GVXV4559H type=del size=977545 2024-04-03T03:46:06.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.057+0000 7f55269288c0 1 < completed write operation key=IOHMF3ADC6EU tag=KFHBJ9Y62U96 type=write size=915528 2024-04-03T03:46:06.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.061+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=5D6LAKN9ORKS type=del size=3978018 2024-04-03T03:46:06.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.069+0000 7f55269288c0 1 < suggested update operation key=AGTQQYXO7453 tag=P5HASH3ULZQQ type=del size=3476658 2024-04-03T03:46:06.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.073+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=B3GRY2YB3QW4 type=del size=2199404 2024-04-03T03:46:06.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.077+0000 7f55269288c0 1 < canceled operation key=AXL5RVPSVDY5 tag=8D7O1OLG0OCG type=del size=467103 2024-04-03T03:46:06.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.077+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=8V7P5HW4OOZ7 type=del size=713170 2024-04-03T03:46:06.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.081+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~9WWO0WG1MN8M.0 size=1048576 2024-04-03T03:46:06.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.085+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~9WWO0WG1MN8M.1 size=941957 2024-04-03T03:46:06.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.089+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=9WWO0WG1MN8M tag=58UHVQ48RMH5 type=write size=3039109 2024-04-03T03:46:06.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.093+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=J0D240NSR8Z2 type=del size=3166980 2024-04-03T03:46:06.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.097+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~0B1E5Y43N33I.0 size=262374 2024-04-03T03:46:06.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.105+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=0B1E5Y43N33I tag=8JQMBBP692KW type=write size=1310950 2024-04-03T03:46:06.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.105+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=LX1XDC0VXB2T type=del size=58551 2024-04-03T03:46:06.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.113+0000 7f55269288c0 1 < suggested update operation key=MB7HTWATXRMB tag=47EWGM1BUJAJ type=del size=2611967 2024-04-03T03:46:06.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.117+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=OHACFM2SJI17 type=del size=3808857 2024-04-03T03:46:06.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.121+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=S2C0TGOXJCVS type=del 2024-04-03T03:46:06.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.125+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=50MSMS4V02Z3 type=del size=550067 2024-04-03T03:46:06.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.129+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=3DP87281MV8R type=del 2024-04-03T03:46:06.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.133+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=F7O184PU0R6Z type=write size=117854 2024-04-03T03:46:06.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.137+0000 7f55269288c0 1 < completed write operation key=3XKXK1JXKOHU tag=78WCH4DJ2H0Z type=write size=453797 2024-04-03T03:46:06.142 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.145+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~8PS13NNSE29L.0 size=1048576 2024-04-03T03:46:06.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.149+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~8PS13NNSE29L.1 size=87359 2024-04-03T03:46:06.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.149+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=8PS13NNSE29L tag=1BDD2HPLMVJD type=write size=2184511 2024-04-03T03:46:06.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.153+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=YTT746Y51K3U type=del 2024-04-03T03:46:06.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.157+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~ZCHCBZP4YF4G.0 size=570994 2024-04-03T03:46:06.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.157+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=ZCHCBZP4YF4G tag=2U39WIC6B097 type=write size=1619570 2024-04-03T03:46:06.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.165+0000 7f55269288c0 1 < suggested update operation key=8SBTVHL09P63 tag=PNTCXLHFQGKQ type=write size=918293 2024-04-03T03:46:06.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.173+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~Y6RXHHU6E1JF.0 size=1048576 2024-04-03T03:46:06.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.177+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~Y6RXHHU6E1JF.1 size=1048576 2024-04-03T03:46:06.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.181+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~Y6RXHHU6E1JF.2 size=138764 2024-04-03T03:46:06.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.181+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=Y6RXHHU6E1JF tag=WI7ETR5SKP99 type=write size=3284492 2024-04-03T03:46:06.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.185+0000 7f55269288c0 -1 < failed to complete operation key=8SBTVHL09P63 tag=E3E2QSUYIZW3 type=del size=1569158: (22) Invalid argument 2024-04-03T03:46:06.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.189+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=HRAZPT7G14AC type=write size=228509 2024-04-03T03:46:06.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.193+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=WCMJO10B1HA2 type=del 2024-04-03T03:46:06.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.197+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=UBVS624JDO2K type=del size=2729905 2024-04-03T03:46:06.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.201+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~BTSPYUN7NFAA.0 size=1048576 2024-04-03T03:46:06.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.205+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~BTSPYUN7NFAA.1 size=549324 2024-04-03T03:46:06.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.209+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=BTSPYUN7NFAA tag=1H23DCOOD6U7 type=write size=2646476 2024-04-03T03:46:06.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.213+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=B2UMVA2MRE94 type=del size=794233 2024-04-03T03:46:06.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.217+0000 7f55269288c0 1 < completed write operation key=JAXVD60NI5YW tag=A9OQR5Z1I2ES type=write size=133315 2024-04-03T03:46:06.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.221+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=W7BYVKN1A4NC type=del size=2838661 2024-04-03T03:46:06.223 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.225+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=XW1GVXV4559H type=del 2024-04-03T03:46:06.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.229+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~BIUXAYQNQRIM.0 size=1048576 2024-04-03T03:46:06.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.233+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~BIUXAYQNQRIM.1 size=687326 2024-04-03T03:46:06.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.233+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=BIUXAYQNQRIM tag=PSAU3PGKCOIJ type=write size=2784478 2024-04-03T03:46:06.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.237+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=5D6LAKN9ORKS type=del 2024-04-03T03:46:06.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.241+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~P0C3GIM66ZGP.0 size=1048576 2024-04-03T03:46:06.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.245+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~P0C3GIM66ZGP.1 size=1048576 2024-04-03T03:46:06.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.245+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~P0C3GIM66ZGP.2 size=459334 2024-04-03T03:46:06.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.245+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=P0C3GIM66ZGP tag=S4M73MTFGBD8 type=write size=3605062 2024-04-03T03:46:06.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.249+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=B3GRY2YB3QW4 type=del 2024-04-03T03:46:06.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.253+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=AEXZW8PK3NCS type=del size=3272668 2024-04-03T03:46:06.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.261+0000 7f55269288c0 1 < suggested remove operation key=YCEKDT5EQD9D tag=8V7P5HW4OOZ7 type=del 2024-04-03T03:46:06.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.265+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=IH2RO1W002WO type=del size=2003625 2024-04-03T03:46:06.266 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.269+0000 7f55269288c0 1 < canceled operation key=KU1R0YLDP1V3 tag=J0D240NSR8Z2 type=del size=3166980 2024-04-03T03:46:06.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.273+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=LS1T7A9ECIMR type=write size=215004 2024-04-03T03:46:06.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.273+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=LX1XDC0VXB2T type=del 2024-04-03T03:46:06.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.277+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=HBZG5X1VV3P9 type=del size=1067930 2024-04-03T03:46:06.280 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.281+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=OHACFM2SJI17 type=del 2024-04-03T03:46:06.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.285+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=NPLSMMPCT1H6 type=del size=1307895 2024-04-03T03:46:06.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.289+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=50MSMS4V02Z3 type=del 2024-04-03T03:46:06.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.293+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=0QA98WW2D6GO type=write size=435074 2024-04-03T03:46:06.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.297+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=F7O184PU0R6Z type=write size=117854 2024-04-03T03:46:06.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.301+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=BKHBZ1K7M1XU type=del size=1676508 2024-04-03T03:46:06.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.305+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~8PS13NNSE29L.0 size=1048576 2024-04-03T03:46:06.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.309+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~8PS13NNSE29L.1 size=87359 2024-04-03T03:46:06.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.313+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=8PS13NNSE29L tag=1BDD2HPLMVJD type=write size=2184511 2024-04-03T03:46:06.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.317+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=COZ5K2ZW7X0E type=del size=4002990 2024-04-03T03:46:06.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.317+0000 7f55269288c0 1 < canceled part key=_multipart_TXFMKXUGMEA8.2~ZCHCBZP4YF4G.0 size=570994 2024-04-03T03:46:06.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.321+0000 7f55269288c0 1 < canceled multipart upload key=TXFMKXUGMEA8 upload=ZCHCBZP4YF4G tag=2U39WIC6B097 type=write size=1619570 2024-04-03T03:46:06.323 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.325+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=E00TSIMJ5LVK type=write size=598763 2024-04-03T03:46:06.326 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.329+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~Y6RXHHU6E1JF.0 size=1048576 2024-04-03T03:46:06.326 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.329+0000 7f55269288c0 1 < canceled part key=_multipart_LZQGL2UAWOTU.2~Y6RXHHU6E1JF.1 size=1048576 2024-04-03T03:46:06.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.333+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~Y6RXHHU6E1JF.2 size=138764 2024-04-03T03:46:06.334 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.337+0000 7f55269288c0 1 < canceled multipart upload key=LZQGL2UAWOTU upload=Y6RXHHU6E1JF tag=WI7ETR5SKP99 type=write size=3284492 2024-04-03T03:46:06.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.341+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=7PGHJH8MKHA7 type=del size=4130997 2024-04-03T03:46:06.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.345+0000 7f55269288c0 1 < completed write operation key=D8W2ZKIZFI8H tag=HRAZPT7G14AC type=write size=228509 2024-04-03T03:46:06.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.345+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=T7L0LZ31MXIT type=del size=2804850 2024-04-03T03:46:06.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.349+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=UBVS624JDO2K type=del 2024-04-03T03:46:06.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.353+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=0AB7COS3T0EP type=del size=2377608 2024-04-03T03:46:06.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.357+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=B2UMVA2MRE94 type=del 2024-04-03T03:46:06.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.361+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=RARSV9D6JRB1 type=write size=827050 2024-04-03T03:46:06.361 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.365+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=W7BYVKN1A4NC type=del 2024-04-03T03:46:06.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.365+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=NK9VZH69MVS9 type=del size=4150659 2024-04-03T03:46:06.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.369+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~BIUXAYQNQRIM.0 size=1048576 2024-04-03T03:46:06.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.373+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~BIUXAYQNQRIM.1 size=687326 2024-04-03T03:46:06.377 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.381+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=BIUXAYQNQRIM tag=PSAU3PGKCOIJ type=write size=2784478 2024-04-03T03:46:06.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.385+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~BDUD9D83P8H5.0 size=1048576 2024-04-03T03:46:06.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.389+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~BDUD9D83P8H5.1 size=557016 2024-04-03T03:46:06.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.389+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=BDUD9D83P8H5 tag=5RA475C7TR2N type=write size=2654168 2024-04-03T03:46:06.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.393+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~P0C3GIM66ZGP.0 size=1048576 2024-04-03T03:46:06.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.397+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~P0C3GIM66ZGP.1 size=1048576 2024-04-03T03:46:06.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.401+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~P0C3GIM66ZGP.2 size=459334 2024-04-03T03:46:06.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.405+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=P0C3GIM66ZGP tag=S4M73MTFGBD8 type=write size=3605062 2024-04-03T03:46:06.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.409+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=P8OIRNZ5JM8Q type=write size=546585 2024-04-03T03:46:06.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.413+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=AEXZW8PK3NCS type=del 2024-04-03T03:46:06.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.421+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~E4RNRARFBLZ9.0 size=241438 2024-04-03T03:46:06.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.421+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=E4RNRARFBLZ9 tag=TA3LQ9V9AMO8 type=write size=1290014 2024-04-03T03:46:06.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.425+0000 7f55269288c0 1 < suggested update operation key=XFCPX90N2NYC tag=IH2RO1W002WO type=del size=2003625 2024-04-03T03:46:06.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.429+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=HHUWJADMSM91 type=del size=873919 2024-04-03T03:46:06.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.433+0000 7f55269288c0 1 < canceled operation key=8BMP0HIS520R tag=LS1T7A9ECIMR type=write size=215004 2024-04-03T03:46:06.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.437+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~8R4P6PO4G17D.0 size=439018 2024-04-03T03:46:06.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.437+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=8R4P6PO4G17D tag=JQMZX5HMCQ78 type=write size=1487594 2024-04-03T03:46:06.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.445+0000 7f55269288c0 1 < suggested remove operation key=AXL5RVPSVDY5 tag=HBZG5X1VV3P9 type=del 2024-04-03T03:46:06.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.453+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~JV7STX1TY7UM.0 size=1048576 2024-04-03T03:46:06.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.453+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~JV7STX1TY7UM.1 size=1048576 2024-04-03T03:46:06.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.457+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~JV7STX1TY7UM.2 size=36638 2024-04-03T03:46:06.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.457+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=JV7STX1TY7UM tag=T0JEARWM1MFA type=write size=3182366 2024-04-03T03:46:06.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.465+0000 7f55269288c0 1 < suggested update operation key=7POFUQ9CX6B1 tag=NPLSMMPCT1H6 type=del size=1307895 2024-04-03T03:46:06.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.469+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~6B0QPWJ5RBQH.0 size=1048576 2024-04-03T03:46:06.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.473+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~6B0QPWJ5RBQH.1 size=962276 2024-04-03T03:46:06.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.473+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=6B0QPWJ5RBQH tag=O8U41FO909BP type=write size=3059428 2024-04-03T03:46:06.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.477+0000 7f55269288c0 1 < completed write operation key=B5BI0HJ5S1Y1 tag=0QA98WW2D6GO type=write size=435074 2024-04-03T03:46:06.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.481+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~U106BYNVOMD8.0 size=1048576 2024-04-03T03:46:06.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.485+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~U106BYNVOMD8.1 size=1048576 2024-04-03T03:46:06.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.489+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~U106BYNVOMD8.2 size=741411 2024-04-03T03:46:06.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.489+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=U106BYNVOMD8 tag=ERZTT70W87B3 type=write size=3887139 2024-04-03T03:46:06.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.489+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=BKHBZ1K7M1XU type=del 2024-04-03T03:46:06.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.497+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~MFKZN4ELQM4Y.0 size=510945 2024-04-03T03:46:06.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.497+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=MFKZN4ELQM4Y tag=2DEJCEZE5M3R type=write size=1559521 2024-04-03T03:46:06.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.501+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=COZ5K2ZW7X0E type=del 2024-04-03T03:46:06.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.501+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=EUUL05A129HL type=del size=1838165 2024-04-03T03:46:06.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.505+0000 7f55269288c0 -1 < failed to complete operation key=AXL5RVPSVDY5 tag=E00TSIMJ5LVK type=write size=598763: (22) Invalid argument 2024-04-03T03:46:06.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.509+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=C75DAIMBDA9B type=write size=721754 2024-04-03T03:46:06.510 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.513+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=7PGHJH8MKHA7 type=del 2024-04-03T03:46:06.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.521+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~IFAYJ7G82E9T.0 size=608679 2024-04-03T03:46:06.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.521+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=IFAYJ7G82E9T tag=H911X6UASJFW type=write size=1657255 2024-04-03T03:46:06.523 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.525+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=T7L0LZ31MXIT type=del 2024-04-03T03:46:06.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.529+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~JOXKVPLAMY7W.0 size=1048576 2024-04-03T03:46:06.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.533+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~JOXKVPLAMY7W.1 size=287138 2024-04-03T03:46:06.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.533+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=JOXKVPLAMY7W tag=KHIFOK4MSM92 type=write size=2384290 2024-04-03T03:46:06.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.537+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=0AB7COS3T0EP type=del 2024-04-03T03:46:06.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.541+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=HM1XV0ARED1L type=write size=309533 2024-04-03T03:46:06.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.541+0000 7f55269288c0 1 < completed write operation key=LZQGL2UAWOTU tag=RARSV9D6JRB1 type=write size=827050 2024-04-03T03:46:06.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.549+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~88FRJV4TC2V2.0 size=760312 2024-04-03T03:46:06.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.549+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=88FRJV4TC2V2 tag=PSISA8UX3Q1T type=write size=1808888 2024-04-03T03:46:06.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.553+0000 7f55269288c0 1 < suggested remove operation key=3XKXK1JXKOHU tag=NK9VZH69MVS9 type=del 2024-04-03T03:46:06.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.557+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=RZEZD45BXA40 type=del size=2656572 2024-04-03T03:46:06.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.561+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~BDUD9D83P8H5.0 size=1048576 2024-04-03T03:46:06.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.561+0000 7f55269288c0 1 < canceled part key=_multipart_TW860A14J9RC.2~BDUD9D83P8H5.1 size=557016 2024-04-03T03:46:06.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.565+0000 7f55269288c0 1 < canceled multipart upload key=TW860A14J9RC upload=BDUD9D83P8H5 tag=5RA475C7TR2N type=write size=2654168 2024-04-03T03:46:06.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.569+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=LVA9EWVENHMA type=del size=4070875 2024-04-03T03:46:06.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.573+0000 7f55269288c0 -1 < failed to complete operation key=AXL5RVPSVDY5 tag=P8OIRNZ5JM8Q type=write size=546585: (22) Invalid argument 2024-04-03T03:46:06.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.577+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~B1YDQEOX3UW5.0 size=1048576 2024-04-03T03:46:06.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.581+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~B1YDQEOX3UW5.1 size=1048576 2024-04-03T03:46:06.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.585+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~B1YDQEOX3UW5.2 size=133307 2024-04-03T03:46:06.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.585+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=B1YDQEOX3UW5 tag=W225WRZ26LH7 type=write size=3279035 2024-04-03T03:46:06.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.589+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~E4RNRARFBLZ9.0 size=241438 2024-04-03T03:46:06.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.593+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=E4RNRARFBLZ9 tag=TA3LQ9V9AMO8 type=write size=1290014 2024-04-03T03:46:06.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.597+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=34S1F4QJYW62 type=del size=1751358 2024-04-03T03:46:06.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.601+0000 7f55269288c0 1 < suggested update operation key=U62RSK21LJEF tag=HHUWJADMSM91 type=del size=873919 2024-04-03T03:46:06.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.609+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~ADPXTG7NY9C1.0 size=284289 2024-04-03T03:46:06.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.609+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=ADPXTG7NY9C1 tag=J23PRA43GZ0A type=write size=1332865 2024-04-03T03:46:06.610 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.613+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~8R4P6PO4G17D.0 size=439018 2024-04-03T03:46:06.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.617+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=8R4P6PO4G17D tag=JQMZX5HMCQ78 type=write size=1487594 2024-04-03T03:46:06.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.621+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=735KRZSMZFI0 type=del size=1850776 2024-04-03T03:46:06.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.625+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~JV7STX1TY7UM.0 size=1048576 2024-04-03T03:46:06.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.625+0000 7f55269288c0 1 < canceled part key=_multipart_D9OEPPT37WSJ.2~JV7STX1TY7UM.1 size=1048576 2024-04-03T03:46:06.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.629+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~JV7STX1TY7UM.2 size=36638 2024-04-03T03:46:06.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.633+0000 7f55269288c0 1 < canceled multipart upload key=D9OEPPT37WSJ upload=JV7STX1TY7UM tag=T0JEARWM1MFA type=write size=3182366 2024-04-03T03:46:06.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.637+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~TIVPM62QWHRN.0 size=232445 2024-04-03T03:46:06.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.637+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=TIVPM62QWHRN tag=E3LSZQ2RD4NT type=write size=1281021 2024-04-03T03:46:06.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.641+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~6B0QPWJ5RBQH.0 size=1048576 2024-04-03T03:46:06.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.645+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~6B0QPWJ5RBQH.1 size=962276 2024-04-03T03:46:06.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.649+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=6B0QPWJ5RBQH tag=O8U41FO909BP type=write size=3059428 2024-04-03T03:46:06.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.657+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~62OW0C7OAJC0.0 size=1048576 2024-04-03T03:46:06.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.661+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~62OW0C7OAJC0.1 size=1048576 2024-04-03T03:46:06.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.661+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~62OW0C7OAJC0.2 size=317140 2024-04-03T03:46:06.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.661+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=62OW0C7OAJC0 tag=29N2S4YMLPD5 type=write size=3462868 2024-04-03T03:46:06.664 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.665+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~U106BYNVOMD8.0 size=1048576 2024-04-03T03:46:06.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.669+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~U106BYNVOMD8.1 size=1048576 2024-04-03T03:46:06.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.673+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~U106BYNVOMD8.2 size=741411 2024-04-03T03:46:06.675 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.677+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=U106BYNVOMD8 tag=ERZTT70W87B3 type=write size=3887139 2024-04-03T03:46:06.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.681+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=5L732PUI7L6Y type=del size=3077230 2024-04-03T03:46:06.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.685+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~MFKZN4ELQM4Y.0 size=510945 2024-04-03T03:46:06.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.689+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=MFKZN4ELQM4Y tag=2DEJCEZE5M3R type=write size=1559521 2024-04-03T03:46:06.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.693+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=PVNUF22730D8 type=del size=512041 2024-04-03T03:46:06.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.697+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=EUUL05A129HL type=del 2024-04-03T03:46:06.700 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.701+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~UL4185A01D3Y.0 size=1048576 2024-04-03T03:46:06.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.705+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~UL4185A01D3Y.1 size=639403 2024-04-03T03:46:06.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.705+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=UL4185A01D3Y tag=9GCELD495I80 type=write size=2736555 2024-04-03T03:46:06.710 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.713+0000 7f55269288c0 1 < suggested remove operation key=JAXVD60NI5YW tag=C75DAIMBDA9B type=write 2024-04-03T03:46:06.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.717+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=6RT3PR33E0DU type=del size=3833315 2024-04-03T03:46:06.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.721+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~IFAYJ7G82E9T.0 size=608679 2024-04-03T03:46:06.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.725+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=IFAYJ7G82E9T tag=H911X6UASJFW type=write size=1657255 2024-04-03T03:46:06.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.729+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=EPOGXO7QVZOR type=del size=3533813 2024-04-03T03:46:06.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.733+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~JOXKVPLAMY7W.0 size=1048576 2024-04-03T03:46:06.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.733+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~JOXKVPLAMY7W.1 size=287138 2024-04-03T03:46:06.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.741+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=JOXKVPLAMY7W tag=KHIFOK4MSM92 type=write size=2384290 2024-04-03T03:46:06.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.741+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=V5H40UWXMHXL type=del size=2469917 2024-04-03T03:46:06.744 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.745+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=HM1XV0ARED1L type=write size=309533 2024-04-03T03:46:06.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.753+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~S4OSX514LYYK.0 size=956524 2024-04-03T03:46:06.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.753+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=S4OSX514LYYK tag=3BIVIXK0RVYG type=write size=2005100 2024-04-03T03:46:06.753 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.757+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~88FRJV4TC2V2.0 size=760312 2024-04-03T03:46:06.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.761+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=88FRJV4TC2V2 tag=PSISA8UX3Q1T type=write size=1808888 2024-04-03T03:46:06.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.765+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=4UB4X29373AN type=write size=701804 2024-04-03T03:46:06.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.769+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=RZEZD45BXA40 type=del 2024-04-03T03:46:06.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.773+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=V2JI0S3B0MZF type=del size=127549 2024-04-03T03:46:06.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.777+0000 7f55269288c0 1 < canceled operation key=KU1R0YLDP1V3 tag=LVA9EWVENHMA type=del size=4070875 2024-04-03T03:46:06.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.781+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=6TH0FXUQL5OE type=write size=545631 2024-04-03T03:46:06.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.781+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~B1YDQEOX3UW5.0 size=1048576 2024-04-03T03:46:06.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.785+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~B1YDQEOX3UW5.1 size=1048576 2024-04-03T03:46:06.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.789+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~B1YDQEOX3UW5.2 size=133307 2024-04-03T03:46:06.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.793+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=B1YDQEOX3UW5 tag=W225WRZ26LH7 type=write size=3279035 2024-04-03T03:46:06.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.797+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=5SNLCTHQF4O6 type=write size=467810 2024-04-03T03:46:06.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.801+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=34S1F4QJYW62 type=del 2024-04-03T03:46:06.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.805+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~Q7OCMT34KMHV.0 size=1048576 2024-04-03T03:46:06.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.805+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~Q7OCMT34KMHV.1 size=1048576 2024-04-03T03:46:06.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.809+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~Q7OCMT34KMHV.2 size=937485 2024-04-03T03:46:06.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.809+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=Q7OCMT34KMHV tag=UJ2Q9W8ZC9AA type=write size=4083213 2024-04-03T03:46:06.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.813+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~ADPXTG7NY9C1.0 size=284289 2024-04-03T03:46:06.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.817+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=ADPXTG7NY9C1 tag=J23PRA43GZ0A type=write size=1332865 2024-04-03T03:46:06.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.821+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=TS2C2KW3GYBL type=write size=1028152 2024-04-03T03:46:06.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.829+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=735KRZSMZFI0 type=del 2024-04-03T03:46:06.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.829+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=SHT9BL2HX8W1 type=del size=873821 2024-04-03T03:46:06.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.833+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~TIVPM62QWHRN.0 size=232445 2024-04-03T03:46:06.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.837+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=TIVPM62QWHRN tag=E3LSZQ2RD4NT type=write size=1281021 2024-04-03T03:46:06.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.845+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~VVGBANLQ36HB.0 size=643081 2024-04-03T03:46:06.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.845+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=VVGBANLQ36HB tag=DA4PFRXC9DJC type=write size=1691657 2024-04-03T03:46:06.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.845+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~62OW0C7OAJC0.0 size=1048576 2024-04-03T03:46:06.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.849+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~62OW0C7OAJC0.1 size=1048576 2024-04-03T03:46:06.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.849+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~62OW0C7OAJC0.2 size=317140 2024-04-03T03:46:06.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.857+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=62OW0C7OAJC0 tag=29N2S4YMLPD5 type=write size=3462868 2024-04-03T03:46:06.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.861+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~FKX0ZP4JKOZE.0 size=98864 2024-04-03T03:46:06.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.861+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=FKX0ZP4JKOZE tag=M66HLW34BYTV type=write size=1147440 2024-04-03T03:46:06.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.861+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=5L732PUI7L6Y type=del 2024-04-03T03:46:06.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.865+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=86O2OFV7ZNPZ type=del size=494121 2024-04-03T03:46:06.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.869+0000 7f55269288c0 1 < suggested update operation key=YCEKDT5EQD9D tag=PVNUF22730D8 type=del size=512041 2024-04-03T03:46:06.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.873+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=J76J0CQ80KA9 type=write size=889282 2024-04-03T03:46:06.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.877+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~UL4185A01D3Y.0 size=1048576 2024-04-03T03:46:06.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.877+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~UL4185A01D3Y.1 size=639403 2024-04-03T03:46:06.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.881+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=UL4185A01D3Y tag=9GCELD495I80 type=write size=2736555 2024-04-03T03:46:06.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.885+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~5A3UJA0SE0EE.0 size=1048576 2024-04-03T03:46:06.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.889+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~5A3UJA0SE0EE.1 size=876412 2024-04-03T03:46:06.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.889+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=5A3UJA0SE0EE tag=R05XS72KBJIH type=write size=2973564 2024-04-03T03:46:06.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.893+0000 7f55269288c0 1 < canceled operation key=TLM1C3B9J2A3 tag=6RT3PR33E0DU type=del size=3833315 2024-04-03T03:46:06.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.897+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~TEM9R1M40RKE.0 size=681249 2024-04-03T03:46:06.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.897+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=TEM9R1M40RKE tag=ZR1Q3S7KODJI type=write size=1729825 2024-04-03T03:46:06.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.897+0000 7f55269288c0 1 < canceled operation key=0OSIL0R5ZJ54 tag=EPOGXO7QVZOR type=del size=3533813 2024-04-03T03:46:06.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.905+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~T5YUZ2T576R1.0 size=1048576 2024-04-03T03:46:06.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.905+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~T5YUZ2T576R1.1 size=514372 2024-04-03T03:46:06.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.905+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=T5YUZ2T576R1 tag=YUEO83YH28GT type=write size=2611524 2024-04-03T03:46:06.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.913+0000 7f55269288c0 1 < suggested update operation key=KDSE2XB4D1XI tag=V5H40UWXMHXL type=del size=2469917 2024-04-03T03:46:06.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.913+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=J5UBEXFZJ8P0 type=del size=4153583 2024-04-03T03:46:06.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.917+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~S4OSX514LYYK.0 size=956524 2024-04-03T03:46:06.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.921+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=S4OSX514LYYK tag=3BIVIXK0RVYG type=write size=2005100 2024-04-03T03:46:06.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.925+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=L0NKUZX2WNME type=del size=2684873 2024-04-03T03:46:06.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.929+0000 7f55269288c0 1 < completed write operation key=MB7HTWATXRMB tag=4UB4X29373AN type=write size=701804 2024-04-03T03:46:06.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.933+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~ULE8YD9DXIE4.0 size=1048576 2024-04-03T03:46:06.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.937+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~ULE8YD9DXIE4.1 size=1048576 2024-04-03T03:46:06.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.941+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~ULE8YD9DXIE4.2 size=888118 2024-04-03T03:46:06.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.941+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=ULE8YD9DXIE4 tag=PN123BGLIBN0 type=write size=4033846 2024-04-03T03:46:06.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.941+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=V2JI0S3B0MZF type=del 2024-04-03T03:46:06.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.945+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=OE1AU77BTXUK type=del size=2968754 2024-04-03T03:46:06.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.949+0000 7f55269288c0 1 < completed write operation key=JAXVD60NI5YW tag=6TH0FXUQL5OE type=write size=545631 2024-04-03T03:46:06.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.953+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=QEUQ27633UT1 type=del size=3044084 2024-04-03T03:46:06.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.957+0000 7f55269288c0 1 < suggested update operation key=AGTQQYXO7453 tag=5SNLCTHQF4O6 type=write size=467810 2024-04-03T03:46:06.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.961+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=O9TM3MLBBN5U type=write size=597474 2024-04-03T03:46:06.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.961+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~Q7OCMT34KMHV.0 size=1048576 2024-04-03T03:46:06.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.965+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~Q7OCMT34KMHV.1 size=1048576 2024-04-03T03:46:06.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.969+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~Q7OCMT34KMHV.2 size=937485 2024-04-03T03:46:06.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.973+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=Q7OCMT34KMHV tag=UJ2Q9W8ZC9AA type=write size=4083213 2024-04-03T03:46:06.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.977+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~GB5ESOUM03K0.0 size=314027 2024-04-03T03:46:06.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.977+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=GB5ESOUM03K0 tag=W79M7UQOAFBO type=write size=1362603 2024-04-03T03:46:06.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.977+0000 7f55269288c0 1 < completed write operation key=3XKXK1JXKOHU tag=TS2C2KW3GYBL type=write size=1028152 2024-04-03T03:46:06.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.985+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~2R5BQI8AKUPS.0 size=1048576 2024-04-03T03:46:06.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.985+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~2R5BQI8AKUPS.1 size=1048576 2024-04-03T03:46:06.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.985+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~2R5BQI8AKUPS.2 size=693413 2024-04-03T03:46:06.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.985+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=2R5BQI8AKUPS tag=A776BLK41BH7 type=write size=3839141 2024-04-03T03:46:06.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.989+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=SHT9BL2HX8W1 type=del 2024-04-03T03:46:06.991 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.993+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~FYB23D8FHVK4.0 size=1048576 2024-04-03T03:46:06.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.997+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~FYB23D8FHVK4.1 size=486904 2024-04-03T03:46:06.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:06.997+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=FYB23D8FHVK4 tag=2B073AT26QUP type=write size=2584056 2024-04-03T03:46:06.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.001+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~VVGBANLQ36HB.0 size=643081 2024-04-03T03:46:07.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.005+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=VVGBANLQ36HB tag=DA4PFRXC9DJC type=write size=1691657 2024-04-03T03:46:07.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.005+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=81BR3HG63SPI type=del size=503317 2024-04-03T03:46:07.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.009+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~FKX0ZP4JKOZE.0 size=98864 2024-04-03T03:46:07.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.013+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=FKX0ZP4JKOZE tag=M66HLW34BYTV type=write size=1147440 2024-04-03T03:46:07.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.017+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~ARE5HWCUGQL6.0 size=1048576 2024-04-03T03:46:07.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.021+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~ARE5HWCUGQL6.1 size=59785 2024-04-03T03:46:07.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.021+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=ARE5HWCUGQL6 tag=2WC3N3DAXAGL type=write size=2156937 2024-04-03T03:46:07.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.025+0000 7f55269288c0 1 < suggested update operation key=Z42NDVEX1SOL tag=86O2OFV7ZNPZ type=del size=494121 2024-04-03T03:46:07.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.029+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~234M2GGU6UBG.0 size=1048576 2024-04-03T03:46:07.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.029+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~234M2GGU6UBG.1 size=858829 2024-04-03T03:46:07.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.029+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=234M2GGU6UBG tag=KC11S2YH3YJG type=write size=2955981 2024-04-03T03:46:07.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.033+0000 7f55269288c0 1 < completed write operation key=F6IBZ80J4SDM tag=J76J0CQ80KA9 type=write size=889282 2024-04-03T03:46:07.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.037+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~6YZS1YG7207A.0 size=1048576 2024-04-03T03:46:07.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.041+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~6YZS1YG7207A.1 size=611580 2024-04-03T03:46:07.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.041+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=6YZS1YG7207A tag=VOYFI3J9ZTUB type=write size=2708732 2024-04-03T03:46:07.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.041+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~5A3UJA0SE0EE.0 size=1048576 2024-04-03T03:46:07.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.045+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~5A3UJA0SE0EE.1 size=876412 2024-04-03T03:46:07.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.049+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=5A3UJA0SE0EE tag=R05XS72KBJIH type=write size=2973564 2024-04-03T03:46:07.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.049+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=LJRSHV26SJVO type=del size=3083550 2024-04-03T03:46:07.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.053+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~TEM9R1M40RKE.0 size=681249 2024-04-03T03:46:07.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.057+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=TEM9R1M40RKE tag=ZR1Q3S7KODJI type=write size=1729825 2024-04-03T03:46:07.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.061+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=CHOS452D48WM type=del size=1234344 2024-04-03T03:46:07.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.061+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~T5YUZ2T576R1.0 size=1048576 2024-04-03T03:46:07.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.061+0000 7f55269288c0 1 < canceled part key=_multipart_Z42NDVEX1SOL.2~T5YUZ2T576R1.1 size=514372 2024-04-03T03:46:07.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.065+0000 7f55269288c0 1 < canceled multipart upload key=Z42NDVEX1SOL upload=T5YUZ2T576R1 tag=YUEO83YH28GT type=write size=2611524 2024-04-03T03:46:07.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.073+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~L7LYZJNE355G.0 size=1048576 2024-04-03T03:46:07.072 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.073+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~L7LYZJNE355G.1 size=1048576 2024-04-03T03:46:07.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.077+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~L7LYZJNE355G.2 size=276831 2024-04-03T03:46:07.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.077+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=L7LYZJNE355G tag=T4HDKE9GVDH9 type=write size=3422559 2024-04-03T03:46:07.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.081+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=J5UBEXFZJ8P0 type=del 2024-04-03T03:46:07.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.085+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~S7MYZ6VC3GOF.0 size=1048576 2024-04-03T03:46:07.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.085+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~S7MYZ6VC3GOF.1 size=1048576 2024-04-03T03:46:07.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.089+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~S7MYZ6VC3GOF.2 size=921865 2024-04-03T03:46:07.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.089+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=S7MYZ6VC3GOF tag=Y2OEQNE5O7Y1 type=write size=4067593 2024-04-03T03:46:07.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.089+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=L0NKUZX2WNME type=del 2024-04-03T03:46:07.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.097+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~6SRHHPUBDB3B.0 size=1048576 2024-04-03T03:46:07.096 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.097+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~6SRHHPUBDB3B.1 size=1048576 2024-04-03T03:46:07.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.101+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~6SRHHPUBDB3B.2 size=445562 2024-04-03T03:46:07.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.101+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=6SRHHPUBDB3B tag=0O61U5QAQU8W type=write size=3591290 2024-04-03T03:46:07.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.105+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~ULE8YD9DXIE4.0 size=1048576 2024-04-03T03:46:07.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.105+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~ULE8YD9DXIE4.1 size=1048576 2024-04-03T03:46:07.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.109+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~ULE8YD9DXIE4.2 size=888118 2024-04-03T03:46:07.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.113+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=ULE8YD9DXIE4 tag=PN123BGLIBN0 type=write size=4033846 2024-04-03T03:46:07.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.113+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=340PMNYCO8FO type=del size=455984 2024-04-03T03:46:07.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.117+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=OE1AU77BTXUK type=del 2024-04-03T03:46:07.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.121+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~CGAI2HLNMT6V.0 size=645603 2024-04-03T03:46:07.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.121+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=CGAI2HLNMT6V tag=J6IMLSSF3ZKL type=write size=1694179 2024-04-03T03:46:07.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.125+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=QEUQ27633UT1 type=del 2024-04-03T03:46:07.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.125+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=5MF9TUV70QEU type=del size=1994658 2024-04-03T03:46:07.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.129+0000 7f55269288c0 1 < suggested update operation key=ZKSA09OSFSYN tag=O9TM3MLBBN5U type=write size=597474 2024-04-03T03:46:07.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.133+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=50O0075WE389 type=del size=2506092 2024-04-03T03:46:07.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.133+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~GB5ESOUM03K0.0 size=314027 2024-04-03T03:46:07.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.137+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=GB5ESOUM03K0 tag=W79M7UQOAFBO type=write size=1362603 2024-04-03T03:46:07.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.141+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~8VKSXFQO0ENR.0 size=1048576 2024-04-03T03:46:07.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.145+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~8VKSXFQO0ENR.1 size=594624 2024-04-03T03:46:07.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.145+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=8VKSXFQO0ENR tag=22GVBH6FXS6U type=write size=2691776 2024-04-03T03:46:07.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.145+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~2R5BQI8AKUPS.0 size=1048576 2024-04-03T03:46:07.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.145+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~2R5BQI8AKUPS.1 size=1048576 2024-04-03T03:46:07.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.149+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~2R5BQI8AKUPS.2 size=693413 2024-04-03T03:46:07.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.153+0000 7f55269288c0 1 < canceled multipart upload key=0OSIL0R5ZJ54 upload=2R5BQI8AKUPS tag=A776BLK41BH7 type=write size=3839141 2024-04-03T03:46:07.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.153+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=XCOSHMLEG8PB type=del size=2635642 2024-04-03T03:46:07.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.157+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~FYB23D8FHVK4.0 size=1048576 2024-04-03T03:46:07.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.157+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~FYB23D8FHVK4.1 size=486904 2024-04-03T03:46:07.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.161+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=FYB23D8FHVK4 tag=2B073AT26QUP type=write size=2584056 2024-04-03T03:46:07.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.165+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~2VIXLXCJQU08.0 size=666500 2024-04-03T03:46:07.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.165+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=2VIXLXCJQU08 tag=LA4LLOSVC3K6 type=write size=1715076 2024-04-03T03:46:07.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.165+0000 7f55269288c0 1 < canceled operation key=F6IBZ80J4SDM tag=81BR3HG63SPI type=del size=503317 2024-04-03T03:46:07.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.169+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~VKJE090M4ERV.0 size=907285 2024-04-03T03:46:07.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.169+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=VKJE090M4ERV tag=NJKFLO0EPZ3S type=write size=1955861 2024-04-03T03:46:07.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.169+0000 7f55269288c0 1 < canceled part key=_multipart_F6IBZ80J4SDM.2~ARE5HWCUGQL6.0 size=1048576 2024-04-03T03:46:07.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.173+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~ARE5HWCUGQL6.1 size=59785 2024-04-03T03:46:07.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.173+0000 7f55269288c0 1 < canceled multipart upload key=F6IBZ80J4SDM upload=ARE5HWCUGQL6 tag=2WC3N3DAXAGL type=write size=2156937 2024-04-03T03:46:07.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.177+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=CBFEDZ6GWO5G type=del size=2068510 2024-04-03T03:46:07.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.177+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~234M2GGU6UBG.0 size=1048576 2024-04-03T03:46:07.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.181+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~234M2GGU6UBG.1 size=858829 2024-04-03T03:46:07.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.185+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=234M2GGU6UBG tag=KC11S2YH3YJG type=write size=2955981 2024-04-03T03:46:07.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.189+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~1ABGJEUBLTH9.0 size=1048576 2024-04-03T03:46:07.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.189+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~1ABGJEUBLTH9.1 size=218833 2024-04-03T03:46:07.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.189+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=1ABGJEUBLTH9 tag=3TYS0CZ728F1 type=write size=2315985 2024-04-03T03:46:07.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.189+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~6YZS1YG7207A.0 size=1048576 2024-04-03T03:46:07.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.193+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~6YZS1YG7207A.1 size=611580 2024-04-03T03:46:07.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.197+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=6YZS1YG7207A tag=VOYFI3J9ZTUB type=write size=2708732 2024-04-03T03:46:07.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.201+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~WAVI3O9M50XK.0 size=1048576 2024-04-03T03:46:07.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.201+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~WAVI3O9M50XK.1 size=824165 2024-04-03T03:46:07.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.201+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=WAVI3O9M50XK tag=174YZDRTJV50 type=write size=2921317 2024-04-03T03:46:07.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.205+0000 7f55269288c0 1 < suggested update operation key=LZQGL2UAWOTU tag=LJRSHV26SJVO type=del size=3083550 2024-04-03T03:46:07.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.209+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~0ZFP0UEH8UZD.0 size=1048576 2024-04-03T03:46:07.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.209+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~0ZFP0UEH8UZD.1 size=23645 2024-04-03T03:46:07.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.209+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=0ZFP0UEH8UZD tag=ACCN2X7NZ38S type=write size=2120797 2024-04-03T03:46:07.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.213+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=CHOS452D48WM type=del 2024-04-03T03:46:07.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.213+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=BQ0D3V6CA1KK type=write size=441423 2024-04-03T03:46:07.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.217+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~L7LYZJNE355G.0 size=1048576 2024-04-03T03:46:07.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.217+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~L7LYZJNE355G.1 size=1048576 2024-04-03T03:46:07.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.217+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~L7LYZJNE355G.2 size=276831 2024-04-03T03:46:07.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.221+0000 7f55269288c0 1 < canceled multipart upload key=8BMP0HIS520R upload=L7LYZJNE355G tag=T4HDKE9GVDH9 type=write size=3422559 2024-04-03T03:46:07.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.225+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=1DPLEIVRGGP6 type=write size=302746 2024-04-03T03:46:07.223 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.225+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~S7MYZ6VC3GOF.0 size=1048576 2024-04-03T03:46:07.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.229+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~S7MYZ6VC3GOF.1 size=1048576 2024-04-03T03:46:07.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.229+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~S7MYZ6VC3GOF.2 size=921865 2024-04-03T03:46:07.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.233+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=S7MYZ6VC3GOF tag=Y2OEQNE5O7Y1 type=write size=4067593 2024-04-03T03:46:07.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.233+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=U90IP6P1NNY7 type=del size=1132207 2024-04-03T03:46:07.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.237+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~6SRHHPUBDB3B.0 size=1048576 2024-04-03T03:46:07.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.237+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~6SRHHPUBDB3B.1 size=1048576 2024-04-03T03:46:07.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.237+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~6SRHHPUBDB3B.2 size=445562 2024-04-03T03:46:07.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.241+0000 7f55269288c0 1 < canceled multipart upload key=8BMP0HIS520R upload=6SRHHPUBDB3B tag=0O61U5QAQU8W type=write size=3591290 2024-04-03T03:46:07.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.245+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~O49BL3610V8E.0 size=1048576 2024-04-03T03:46:07.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.249+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~O49BL3610V8E.1 size=1048576 2024-04-03T03:46:07.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.249+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~O49BL3610V8E.2 size=112311 2024-04-03T03:46:07.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.249+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=O49BL3610V8E tag=MQC0TF4DNMXX type=write size=3258039 2024-04-03T03:46:07.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.253+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=340PMNYCO8FO type=del 2024-04-03T03:46:07.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.253+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=282MPZP9U3K5 type=del size=2247872 2024-04-03T03:46:07.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.257+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~CGAI2HLNMT6V.0 size=645603 2024-04-03T03:46:07.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.261+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=CGAI2HLNMT6V tag=J6IMLSSF3ZKL type=write size=1694179 2024-04-03T03:46:07.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.261+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=BM13Z1FON1T0 type=del size=417000 2024-04-03T03:46:07.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.265+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=5MF9TUV70QEU type=del 2024-04-03T03:46:07.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.265+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=GMK9TZ38T82K type=write size=877159 2024-04-03T03:46:07.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.269+0000 7f55269288c0 -1 < failed to complete operation key=LZQGL2UAWOTU tag=50O0075WE389 type=del size=2506092: (22) Invalid argument 2024-04-03T03:46:07.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.273+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~AIMOW8ZXO0UI.0 size=1048576 2024-04-03T03:46:07.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.277+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~AIMOW8ZXO0UI.1 size=719313 2024-04-03T03:46:07.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.277+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=AIMOW8ZXO0UI tag=P2DUJFU2JAUO type=write size=2816465 2024-04-03T03:46:07.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.277+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~8VKSXFQO0ENR.0 size=1048576 2024-04-03T03:46:07.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.281+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~8VKSXFQO0ENR.1 size=594624 2024-04-03T03:46:07.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.285+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=8VKSXFQO0ENR tag=22GVBH6FXS6U type=write size=2691776 2024-04-03T03:46:07.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.289+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~5B8X1HPKI9G9.0 size=61205 2024-04-03T03:46:07.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.289+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=5B8X1HPKI9G9 tag=KJNXKA5LOC5R type=write size=1109781 2024-04-03T03:46:07.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.289+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=XCOSHMLEG8PB type=del 2024-04-03T03:46:07.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.293+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=AQFNIG7DQS56 type=del size=1902473 2024-04-03T03:46:07.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.293+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~2VIXLXCJQU08.0 size=666500 2024-04-03T03:46:07.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.297+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=2VIXLXCJQU08 tag=LA4LLOSVC3K6 type=write size=1715076 2024-04-03T03:46:07.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.301+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=48ZXKLG4DJ06 type=del size=3633342 2024-04-03T03:46:07.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.301+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~VKJE090M4ERV.0 size=907285 2024-04-03T03:46:07.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.305+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=VKJE090M4ERV tag=NJKFLO0EPZ3S type=write size=1955861 2024-04-03T03:46:07.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.309+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=CP9YAH355RMA type=del size=164106 2024-04-03T03:46:07.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.309+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=CBFEDZ6GWO5G type=del 2024-04-03T03:46:07.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.313+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~YK6UO2CVSHHT.0 size=1048576 2024-04-03T03:46:07.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.317+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~YK6UO2CVSHHT.1 size=161896 2024-04-03T03:46:07.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.317+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=YK6UO2CVSHHT tag=L6Q0EFZECZRD type=write size=2259048 2024-04-03T03:46:07.316 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.317+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~1ABGJEUBLTH9.0 size=1048576 2024-04-03T03:46:07.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.321+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~1ABGJEUBLTH9.1 size=218833 2024-04-03T03:46:07.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.325+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=1ABGJEUBLTH9 tag=3TYS0CZ728F1 type=write size=2315985 2024-04-03T03:46:07.325 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.329+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~1SS1S1NACV9A.0 size=1048576 2024-04-03T03:46:07.326 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.329+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~1SS1S1NACV9A.1 size=1048576 2024-04-03T03:46:07.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.329+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~1SS1S1NACV9A.2 size=996967 2024-04-03T03:46:07.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.329+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=1SS1S1NACV9A tag=QHR2AS3SWCLQ type=write size=4142695 2024-04-03T03:46:07.330 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.333+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~WAVI3O9M50XK.0 size=1048576 2024-04-03T03:46:07.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.333+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~WAVI3O9M50XK.1 size=824165 2024-04-03T03:46:07.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.337+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=WAVI3O9M50XK tag=174YZDRTJV50 type=write size=2921317 2024-04-03T03:46:07.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.341+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=V8A9R6QQM5HQ type=del size=3115056 2024-04-03T03:46:07.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.341+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~0ZFP0UEH8UZD.0 size=1048576 2024-04-03T03:46:07.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.345+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~0ZFP0UEH8UZD.1 size=23645 2024-04-03T03:46:07.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.349+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=0ZFP0UEH8UZD tag=ACCN2X7NZ38S type=write size=2120797 2024-04-03T03:46:07.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.349+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~3JO9LO1UQZNV.0 size=1048576 2024-04-03T03:46:07.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.353+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~3JO9LO1UQZNV.1 size=203408 2024-04-03T03:46:07.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.353+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=3JO9LO1UQZNV tag=7I4JNSLTS7PO type=write size=2300560 2024-04-03T03:46:07.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.353+0000 7f55269288c0 1 < completed write operation key=6KH6TASZS3UG tag=BQ0D3V6CA1KK type=write size=441423 2024-04-03T03:46:07.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.357+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=BSYLW6QZA94M type=del size=1079483 2024-04-03T03:46:07.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.361+0000 7f55269288c0 1 < suggested update operation key=MB7HTWATXRMB tag=1DPLEIVRGGP6 type=write size=302746 2024-04-03T03:46:07.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.361+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=AWKWGBM31Y36 type=del size=4128586 2024-04-03T03:46:07.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.365+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=U90IP6P1NNY7 type=del 2024-04-03T03:46:07.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.365+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=MR47GX2EGUNN type=del size=875075 2024-04-03T03:46:07.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.369+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~O49BL3610V8E.0 size=1048576 2024-04-03T03:46:07.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.369+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~O49BL3610V8E.1 size=1048576 2024-04-03T03:46:07.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.373+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~O49BL3610V8E.2 size=112311 2024-04-03T03:46:07.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.377+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=O49BL3610V8E tag=MQC0TF4DNMXX type=write size=3258039 2024-04-03T03:46:07.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.381+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~AL3KVH8HJJT0.0 size=513590 2024-04-03T03:46:07.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.381+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=AL3KVH8HJJT0 tag=LL0BDKPNR132 type=write size=1562166 2024-04-03T03:46:07.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.381+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=282MPZP9U3K5 type=del 2024-04-03T03:46:07.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.385+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=W4TPV15VUQC7 type=del size=578741 2024-04-03T03:46:07.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.385+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=BM13Z1FON1T0 type=del 2024-04-03T03:46:07.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.389+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~WAHIJV5B20T3.0 size=885136 2024-04-03T03:46:07.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.389+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=WAHIJV5B20T3 tag=CPL7AA5F4JEH type=write size=1933712 2024-04-03T03:46:07.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.393+0000 7f55269288c0 1 < completed write operation key=AGTQQYXO7453 tag=GMK9TZ38T82K type=write size=877159 2024-04-03T03:46:07.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.397+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~FO2IF35O601G.0 size=1048576 2024-04-03T03:46:07.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.401+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~FO2IF35O601G.1 size=694529 2024-04-03T03:46:07.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.401+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=FO2IF35O601G tag=QBD6DX5SZ0N1 type=write size=2791681 2024-04-03T03:46:07.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.401+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~AIMOW8ZXO0UI.0 size=1048576 2024-04-03T03:46:07.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.405+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~AIMOW8ZXO0UI.1 size=719313 2024-04-03T03:46:07.406 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.409+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=AIMOW8ZXO0UI tag=P2DUJFU2JAUO type=write size=2816465 2024-04-03T03:46:07.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.413+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~JI9IFZSK2NQR.0 size=31035 2024-04-03T03:46:07.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.413+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=JI9IFZSK2NQR tag=07FMHNK861MT type=write size=1079611 2024-04-03T03:46:07.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.417+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~5B8X1HPKI9G9.0 size=61205 2024-04-03T03:46:07.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.421+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=5B8X1HPKI9G9 tag=KJNXKA5LOC5R type=write size=1109781 2024-04-03T03:46:07.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.421+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=382DXQNQWVZD type=del size=3761159 2024-04-03T03:46:07.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.425+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=AQFNIG7DQS56 type=del 2024-04-03T03:46:07.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.429+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=DUGFVVW35SHI type=del size=1093638 2024-04-03T03:46:07.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.429+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=48ZXKLG4DJ06 type=del 2024-04-03T03:46:07.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.433+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~HW0XNWOCICPN.0 size=546175 2024-04-03T03:46:07.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.433+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=HW0XNWOCICPN tag=IEONCUDW1ONA type=write size=1594751 2024-04-03T03:46:07.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.437+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=CP9YAH355RMA type=del 2024-04-03T03:46:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.441+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~WV8K1S7GJIVH.0 size=1048576 2024-04-03T03:46:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.441+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~WV8K1S7GJIVH.1 size=851286 2024-04-03T03:46:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.441+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=WV8K1S7GJIVH tag=Y6ALQVVE2KOB type=write size=2948438 2024-04-03T03:46:07.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.445+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~YK6UO2CVSHHT.0 size=1048576 2024-04-03T03:46:07.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.445+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~YK6UO2CVSHHT.1 size=161896 2024-04-03T03:46:07.447 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.449+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=YK6UO2CVSHHT tag=L6Q0EFZECZRD type=write size=2259048 2024-04-03T03:46:07.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.453+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~89HZ9W5IPONK.0 size=47177 2024-04-03T03:46:07.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.453+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=89HZ9W5IPONK tag=7IAIB2KGQVPZ type=write size=1095753 2024-04-03T03:46:07.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.457+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~1SS1S1NACV9A.0 size=1048576 2024-04-03T03:46:07.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.457+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~1SS1S1NACV9A.1 size=1048576 2024-04-03T03:46:07.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.461+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~1SS1S1NACV9A.2 size=996967 2024-04-03T03:46:07.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.465+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=1SS1S1NACV9A tag=QHR2AS3SWCLQ type=write size=4142695 2024-04-03T03:46:07.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.465+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=2RKB742TSN06 type=del size=3086672 2024-04-03T03:46:07.465 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.469+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=V8A9R6QQM5HQ type=del 2024-04-03T03:46:07.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.473+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~WG0P54H2H4FY.0 size=1048576 2024-04-03T03:46:07.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.477+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~WG0P54H2H4FY.1 size=836391 2024-04-03T03:46:07.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.477+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=WG0P54H2H4FY tag=9535X2RGWCEK type=write size=2933543 2024-04-03T03:46:07.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.477+0000 7f55269288c0 1 < canceled part key=_multipart_XFCPX90N2NYC.2~3JO9LO1UQZNV.0 size=1048576 2024-04-03T03:46:07.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.477+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~3JO9LO1UQZNV.1 size=203408 2024-04-03T03:46:07.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.481+0000 7f55269288c0 1 < canceled multipart upload key=XFCPX90N2NYC upload=3JO9LO1UQZNV tag=7I4JNSLTS7PO type=write size=2300560 2024-04-03T03:46:07.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.481+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=XRV377KS47N7 type=del size=5078 2024-04-03T03:46:07.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.485+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=BSYLW6QZA94M type=del 2024-04-03T03:46:07.484 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.485+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=YIA8GO8AZUI1 type=write size=663849 2024-04-03T03:46:07.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.489+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=AWKWGBM31Y36 type=del 2024-04-03T03:46:07.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.493+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~ES1QWXTY1KB3.0 size=1048576 2024-04-03T03:46:07.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.493+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~ES1QWXTY1KB3.1 size=1048576 2024-04-03T03:46:07.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.497+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~ES1QWXTY1KB3.2 size=388619 2024-04-03T03:46:07.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.497+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=ES1QWXTY1KB3 tag=GVCLT54OMJ9K type=write size=3534347 2024-04-03T03:46:07.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.497+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=MR47GX2EGUNN type=del 2024-04-03T03:46:07.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.501+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=V0BZWYAIVKHC type=del size=778254 2024-04-03T03:46:07.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.501+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~AL3KVH8HJJT0.0 size=513590 2024-04-03T03:46:07.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.505+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=AL3KVH8HJJT0 tag=LL0BDKPNR132 type=write size=1562166 2024-04-03T03:46:07.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.509+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=37K1H5U9UCTU type=del size=3009807 2024-04-03T03:46:07.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.513+0000 7f55269288c0 1 < canceled operation key=XFCPX90N2NYC tag=W4TPV15VUQC7 type=del size=578741 2024-04-03T03:46:07.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.517+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~4XM376WVL2SU.0 size=1048576 2024-04-03T03:46:07.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.517+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~4XM376WVL2SU.1 size=862167 2024-04-03T03:46:07.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.517+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=4XM376WVL2SU tag=Y0FCTY116X4I type=write size=2959319 2024-04-03T03:46:07.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.521+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~WAHIJV5B20T3.0 size=885136 2024-04-03T03:46:07.523 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.525+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=WAHIJV5B20T3 tag=CPL7AA5F4JEH type=write size=1933712 2024-04-03T03:46:07.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.529+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=MQVVXX85G93Z type=del size=797548 2024-04-03T03:46:07.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.529+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~FO2IF35O601G.0 size=1048576 2024-04-03T03:46:07.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.533+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~FO2IF35O601G.1 size=694529 2024-04-03T03:46:07.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.537+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=FO2IF35O601G tag=QBD6DX5SZ0N1 type=write size=2791681 2024-04-03T03:46:07.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.541+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=3ZDXGY9TK5LP type=write size=922043 2024-04-03T03:46:07.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.541+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~JI9IFZSK2NQR.0 size=31035 2024-04-03T03:46:07.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.545+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=JI9IFZSK2NQR tag=07FMHNK861MT type=write size=1079611 2024-04-03T03:46:07.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.553+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~RM86YC9ZACAJ.0 size=1048576 2024-04-03T03:46:07.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.553+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~RM86YC9ZACAJ.1 size=1048576 2024-04-03T03:46:07.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.557+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~RM86YC9ZACAJ.2 size=94057 2024-04-03T03:46:07.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.557+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=RM86YC9ZACAJ tag=1QTU8VLFVS6D type=write size=3239785 2024-04-03T03:46:07.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.557+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=382DXQNQWVZD type=del 2024-04-03T03:46:07.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.561+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=ZLQYBP13U4A5 type=del size=3731922 2024-04-03T03:46:07.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.561+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=DUGFVVW35SHI type=del 2024-04-03T03:46:07.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.565+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=W6E7ZTVFHIN7 type=write size=552638 2024-04-03T03:46:07.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.569+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~HW0XNWOCICPN.0 size=546175 2024-04-03T03:46:07.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.573+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=HW0XNWOCICPN tag=IEONCUDW1ONA type=write size=1594751 2024-04-03T03:46:07.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.573+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=QHVM6WR3IIF5 type=del size=2175536 2024-04-03T03:46:07.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.577+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~WV8K1S7GJIVH.0 size=1048576 2024-04-03T03:46:07.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.581+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~WV8K1S7GJIVH.1 size=851286 2024-04-03T03:46:07.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.585+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=WV8K1S7GJIVH tag=Y6ALQVVE2KOB type=write size=2948438 2024-04-03T03:46:07.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.589+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=9H50UN0K5V55 type=del size=2547675 2024-04-03T03:46:07.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.589+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~89HZ9W5IPONK.0 size=47177 2024-04-03T03:46:07.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.593+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=89HZ9W5IPONK tag=7IAIB2KGQVPZ type=write size=1095753 2024-04-03T03:46:07.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.597+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~3QXCNND93LV6.0 size=22251 2024-04-03T03:46:07.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.597+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=3QXCNND93LV6 tag=JP3Z25KAYDF3 type=write size=1070827 2024-04-03T03:46:07.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.601+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=2RKB742TSN06 type=del 2024-04-03T03:46:07.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.605+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~BXK7PN85HS7F.0 size=1048576 2024-04-03T03:46:07.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.609+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~BXK7PN85HS7F.1 size=540543 2024-04-03T03:46:07.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.609+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=BXK7PN85HS7F tag=RMR6046ZC3NC type=write size=2637695 2024-04-03T03:46:07.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.609+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~WG0P54H2H4FY.0 size=1048576 2024-04-03T03:46:07.610 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.613+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~WG0P54H2H4FY.1 size=836391 2024-04-03T03:46:07.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.617+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=WG0P54H2H4FY tag=9535X2RGWCEK type=write size=2933543 2024-04-03T03:46:07.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.617+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=0NFQYW6HVG5K type=write size=688077 2024-04-03T03:46:07.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.621+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=XRV377KS47N7 type=del 2024-04-03T03:46:07.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.621+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=32N66T8K6GYG type=write size=420841 2024-04-03T03:46:07.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.625+0000 7f55269288c0 1 < canceled operation key=JAXVD60NI5YW tag=YIA8GO8AZUI1 type=write size=663849 2024-04-03T03:46:07.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.629+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=NGP5Y4X472Y9 type=del size=2098957 2024-04-03T03:46:07.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.629+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~ES1QWXTY1KB3.0 size=1048576 2024-04-03T03:46:07.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.629+0000 7f55269288c0 1 < canceled part key=_multipart_B5BI0HJ5S1Y1.2~ES1QWXTY1KB3.1 size=1048576 2024-04-03T03:46:07.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.633+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~ES1QWXTY1KB3.2 size=388619 2024-04-03T03:46:07.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.633+0000 7f55269288c0 1 < canceled multipart upload key=B5BI0HJ5S1Y1 upload=ES1QWXTY1KB3 tag=GVCLT54OMJ9K type=write size=3534347 2024-04-03T03:46:07.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.637+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=TGY6ZU7MD4FO type=del size=1386199 2024-04-03T03:46:07.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.641+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=V0BZWYAIVKHC type=del 2024-04-03T03:46:07.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.641+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=S99IXWYM7NAQ type=del size=439127 2024-04-03T03:46:07.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.645+0000 7f55269288c0 1 < suggested update operation key=MB7HTWATXRMB tag=37K1H5U9UCTU type=del size=3009807 2024-04-03T03:46:07.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.649+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=YA9T34K5RAU2 type=del size=4148196 2024-04-03T03:46:07.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.649+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~4XM376WVL2SU.0 size=1048576 2024-04-03T03:46:07.650 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.653+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~4XM376WVL2SU.1 size=862167 2024-04-03T03:46:07.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.657+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=4XM376WVL2SU tag=Y0FCTY116X4I type=write size=2959319 2024-04-03T03:46:07.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.661+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=4X52RY1OHSCA type=del size=3132566 2024-04-03T03:46:07.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.661+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=MQVVXX85G93Z type=del 2024-04-03T03:46:07.663 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.665+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~QXL3QC7F1A1A.0 size=1048576 2024-04-03T03:46:07.665 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.669+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~QXL3QC7F1A1A.1 size=138684 2024-04-03T03:46:07.665 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.669+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=QXL3QC7F1A1A tag=TQ4GESF0HRTQ type=write size=2235836 2024-04-03T03:46:07.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.669+0000 7f55269288c0 1 < completed write operation key=6KH6TASZS3UG tag=3ZDXGY9TK5LP type=write size=922043 2024-04-03T03:46:07.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.673+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=WJ6KZF41KF06 type=del size=1471662 2024-04-03T03:46:07.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.673+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~RM86YC9ZACAJ.0 size=1048576 2024-04-03T03:46:07.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.677+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~RM86YC9ZACAJ.1 size=1048576 2024-04-03T03:46:07.675 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.677+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~RM86YC9ZACAJ.2 size=94057 2024-04-03T03:46:07.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.681+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=RM86YC9ZACAJ tag=1QTU8VLFVS6D type=write size=3239785 2024-04-03T03:46:07.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.685+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=H8E7ON6KH45A type=del size=2542430 2024-04-03T03:46:07.683 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.685+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=ZLQYBP13U4A5 type=del 2024-04-03T03:46:07.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.689+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=W3HXJBIPAQMG type=del size=1073017 2024-04-03T03:46:07.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.693+0000 7f55269288c0 1 < suggested remove operation key=8SBTVHL09P63 tag=W6E7ZTVFHIN7 type=write 2024-04-03T03:46:07.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.701+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~WNREQ27BREX5.0 size=1048576 2024-04-03T03:46:07.700 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.701+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~WNREQ27BREX5.1 size=1048576 2024-04-03T03:46:07.702 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.705+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~WNREQ27BREX5.2 size=732305 2024-04-03T03:46:07.702 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.705+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=WNREQ27BREX5 tag=URMA4KLO2RS7 type=write size=3878033 2024-04-03T03:46:07.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.709+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=QHVM6WR3IIF5 type=del 2024-04-03T03:46:07.709 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.713+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~1X0K2FH7VCZ5.0 size=1048576 2024-04-03T03:46:07.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.713+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~1X0K2FH7VCZ5.1 size=959837 2024-04-03T03:46:07.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.713+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=1X0K2FH7VCZ5 tag=3QRMSID2HQ7F type=write size=3056989 2024-04-03T03:46:07.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.717+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=9H50UN0K5V55 type=del 2024-04-03T03:46:07.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.721+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~UDM1W4TVIYVX.0 size=1048576 2024-04-03T03:46:07.720 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.721+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~UDM1W4TVIYVX.1 size=1048576 2024-04-03T03:46:07.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.725+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~UDM1W4TVIYVX.2 size=367151 2024-04-03T03:46:07.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.725+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=UDM1W4TVIYVX tag=G5BBSW1W9Q3F type=write size=3512879 2024-04-03T03:46:07.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.729+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~3QXCNND93LV6.0 size=22251 2024-04-03T03:46:07.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.733+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=3QXCNND93LV6 tag=JP3Z25KAYDF3 type=write size=1070827 2024-04-03T03:46:07.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.737+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~0CTWDOFSKUM6.0 size=1048576 2024-04-03T03:46:07.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.737+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~0CTWDOFSKUM6.1 size=1048576 2024-04-03T03:46:07.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.741+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~0CTWDOFSKUM6.2 size=634791 2024-04-03T03:46:07.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.741+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=0CTWDOFSKUM6 tag=MIA0L1W20F7T type=write size=3780519 2024-04-03T03:46:07.739 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.741+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~BXK7PN85HS7F.0 size=1048576 2024-04-03T03:46:07.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.745+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~BXK7PN85HS7F.1 size=540543 2024-04-03T03:46:07.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.749+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=BXK7PN85HS7F tag=RMR6046ZC3NC type=write size=2637695 2024-04-03T03:46:07.747 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.749+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=JD8PHOCJDNRL type=del size=2529782 2024-04-03T03:46:07.752 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.753+0000 7f55269288c0 1 < suggested remove operation key=KU1R0YLDP1V3 tag=0NFQYW6HVG5K type=write 2024-04-03T03:46:07.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.757+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=DIO1RCOLRL6B type=del size=4137721 2024-04-03T03:46:07.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.761+0000 7f55269288c0 1 < completed write operation key=YCEKDT5EQD9D tag=32N66T8K6GYG type=write size=420841 2024-04-03T03:46:07.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.761+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=KTA9YB0G5VT9 type=del size=546419 2024-04-03T03:46:07.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.765+0000 7f55269288c0 1 < suggested remove operation key=B5BI0HJ5S1Y1 tag=NGP5Y4X472Y9 type=del 2024-04-03T03:46:07.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.769+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=5TKMOEU181H2 type=del size=1680269 2024-04-03T03:46:07.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.769+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=TGY6ZU7MD4FO type=del 2024-04-03T03:46:07.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.777+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~SN18DR3L5DLK.0 size=814679 2024-04-03T03:46:07.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.777+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=SN18DR3L5DLK tag=51SFL16IUY1W type=write size=1863255 2024-04-03T03:46:07.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.777+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=S99IXWYM7NAQ type=del 2024-04-03T03:46:07.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.781+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~ROWD6A974AJZ.0 size=159128 2024-04-03T03:46:07.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.781+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=ROWD6A974AJZ tag=W4FKSHRU80OP type=write size=1207704 2024-04-03T03:46:07.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.785+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=YA9T34K5RAU2 type=del 2024-04-03T03:46:07.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.785+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=VZFDBKHXZIBB type=del size=2486870 2024-04-03T03:46:07.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.789+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=4X52RY1OHSCA type=del 2024-04-03T03:46:07.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.793+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~5H75WBFT42PU.0 size=236265 2024-04-03T03:46:07.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.793+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=5H75WBFT42PU tag=GZZHU7WUYGV8 type=write size=1284841 2024-04-03T03:46:07.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.793+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~QXL3QC7F1A1A.0 size=1048576 2024-04-03T03:46:07.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.797+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~QXL3QC7F1A1A.1 size=138684 2024-04-03T03:46:07.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.801+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=QXL3QC7F1A1A tag=TQ4GESF0HRTQ type=write size=2235836 2024-04-03T03:46:07.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.801+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=0W3KOQRCXBLI type=write size=1032360 2024-04-03T03:46:07.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.805+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=WJ6KZF41KF06 type=del 2024-04-03T03:46:07.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.809+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~2ZIDGLVJG156.0 size=1048576 2024-04-03T03:46:07.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.809+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~2ZIDGLVJG156.1 size=1048576 2024-04-03T03:46:07.809 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.813+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~2ZIDGLVJG156.2 size=871392 2024-04-03T03:46:07.809 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.813+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=2ZIDGLVJG156 tag=W1XMS9DTX7NS type=write size=4017120 2024-04-03T03:46:07.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.813+0000 7f55269288c0 -1 < failed to complete operation key=8SBTVHL09P63 tag=H8E7ON6KH45A type=del size=2542430: (22) Invalid argument 2024-04-03T03:46:07.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.817+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=NLMNJJKC2ECH type=del size=2206622 2024-04-03T03:46:07.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.817+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=W3HXJBIPAQMG type=del 2024-04-03T03:46:07.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.821+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=S1NJ571B6LE5 type=del size=3542291 2024-04-03T03:46:07.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.821+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~WNREQ27BREX5.0 size=1048576 2024-04-03T03:46:07.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.825+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~WNREQ27BREX5.1 size=1048576 2024-04-03T03:46:07.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.825+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~WNREQ27BREX5.2 size=732305 2024-04-03T03:46:07.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.829+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=WNREQ27BREX5 tag=URMA4KLO2RS7 type=write size=3878033 2024-04-03T03:46:07.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.829+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=ADFK2Q2WKHN6 type=del size=1737499 2024-04-03T03:46:07.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.833+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~1X0K2FH7VCZ5.0 size=1048576 2024-04-03T03:46:07.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.837+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~1X0K2FH7VCZ5.1 size=959837 2024-04-03T03:46:07.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.841+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=1X0K2FH7VCZ5 tag=3QRMSID2HQ7F type=write size=3056989 2024-04-03T03:46:07.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.845+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=5ESDL0282TIX type=del size=1071765 2024-04-03T03:46:07.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.845+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~UDM1W4TVIYVX.0 size=1048576 2024-04-03T03:46:07.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.849+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~UDM1W4TVIYVX.1 size=1048576 2024-04-03T03:46:07.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.849+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~UDM1W4TVIYVX.2 size=367151 2024-04-03T03:46:07.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.853+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=UDM1W4TVIYVX tag=G5BBSW1W9Q3F type=write size=3512879 2024-04-03T03:46:07.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.857+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~Q2N7GS2MDBG1.0 size=917788 2024-04-03T03:46:07.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.857+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=Q2N7GS2MDBG1 tag=N5NBTUTT6B3C type=write size=1966364 2024-04-03T03:46:07.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.861+0000 7f55269288c0 1 < canceled part key=_multipart_X3YCYKP2P9IM.2~0CTWDOFSKUM6.0 size=1048576 2024-04-03T03:46:07.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.861+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~0CTWDOFSKUM6.1 size=1048576 2024-04-03T03:46:07.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.865+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~0CTWDOFSKUM6.2 size=634791 2024-04-03T03:46:07.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.865+0000 7f55269288c0 1 < canceled multipart upload key=X3YCYKP2P9IM upload=0CTWDOFSKUM6 tag=MIA0L1W20F7T type=write size=3780519 2024-04-03T03:46:07.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.869+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=UHUPDCBE2KFP type=del size=3521307 2024-04-03T03:46:07.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.873+0000 7f55269288c0 -1 < failed to complete operation key=B5BI0HJ5S1Y1 tag=JD8PHOCJDNRL type=del size=2529782: (22) Invalid argument 2024-04-03T03:46:07.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.873+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=300XK7BUNXLE type=del size=2028261 2024-04-03T03:46:07.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.877+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=DIO1RCOLRL6B type=del 2024-04-03T03:46:07.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.881+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~5GF2H0QJZ1IL.0 size=424233 2024-04-03T03:46:07.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.881+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=5GF2H0QJZ1IL tag=1031X2CZH8K1 type=write size=1472809 2024-04-03T03:46:07.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.885+0000 7f55269288c0 1 < suggested update operation key=AXL5RVPSVDY5 tag=KTA9YB0G5VT9 type=del size=546419 2024-04-03T03:46:07.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.889+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=2GMUF4PL8ZT3 type=del size=3549882 2024-04-03T03:46:07.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.889+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=5TKMOEU181H2 type=del 2024-04-03T03:46:07.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.893+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=S8J2IQYIS822 type=del size=918296 2024-04-03T03:46:07.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.893+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~SN18DR3L5DLK.0 size=814679 2024-04-03T03:46:07.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.897+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=SN18DR3L5DLK tag=51SFL16IUY1W type=write size=1863255 2024-04-03T03:46:07.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.901+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=I4R7FEKFJQ02 type=write size=963513 2024-04-03T03:46:07.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.905+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~ROWD6A974AJZ.0 size=159128 2024-04-03T03:46:07.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.905+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=ROWD6A974AJZ tag=W4FKSHRU80OP type=write size=1207704 2024-04-03T03:46:07.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.909+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=ZECV6VC06ZUN type=del size=332504 2024-04-03T03:46:07.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.913+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=VZFDBKHXZIBB type=del 2024-04-03T03:46:07.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.921+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~Z621GAL058HM.0 size=1048576 2024-04-03T03:46:07.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.921+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~Z621GAL058HM.1 size=887873 2024-04-03T03:46:07.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.921+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=Z621GAL058HM tag=0N4GLJMMJH12 type=write size=2985025 2024-04-03T03:46:07.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.925+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~5H75WBFT42PU.0 size=236265 2024-04-03T03:46:07.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.929+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=5H75WBFT42PU tag=GZZHU7WUYGV8 type=write size=1284841 2024-04-03T03:46:07.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.929+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=4D6MZT0K2VVV type=del size=1797696 2024-04-03T03:46:07.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.933+0000 7f55269288c0 1 < completed write operation key=YCEKDT5EQD9D tag=0W3KOQRCXBLI type=write size=1032360 2024-04-03T03:46:07.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.937+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~90QT0YIL3TEX.0 size=122390 2024-04-03T03:46:07.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.937+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=90QT0YIL3TEX tag=Y0I61SDEZ3VZ type=write size=1170966 2024-04-03T03:46:07.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.937+0000 7f55269288c0 1 < canceled part key=_multipart_7POFUQ9CX6B1.2~2ZIDGLVJG156.0 size=1048576 2024-04-03T03:46:07.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.941+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~2ZIDGLVJG156.1 size=1048576 2024-04-03T03:46:07.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.941+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~2ZIDGLVJG156.2 size=871392 2024-04-03T03:46:07.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.945+0000 7f55269288c0 1 < canceled multipart upload key=7POFUQ9CX6B1 upload=2ZIDGLVJG156 tag=W1XMS9DTX7NS type=write size=4017120 2024-04-03T03:46:07.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.949+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~FRE16HAG8FFM.0 size=1048576 2024-04-03T03:46:07.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.949+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~FRE16HAG8FFM.1 size=1048576 2024-04-03T03:46:07.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.953+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~FRE16HAG8FFM.2 size=445614 2024-04-03T03:46:07.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.953+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=FRE16HAG8FFM tag=BTUN5MRQV4I8 type=write size=3591342 2024-04-03T03:46:07.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.957+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=NLMNJJKC2ECH type=del 2024-04-03T03:46:07.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.957+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=SK0FG3Y9Q5A8 type=del size=3652929 2024-04-03T03:46:07.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.961+0000 7f55269288c0 1 < canceled operation key=Z42NDVEX1SOL tag=S1NJ571B6LE5 type=del size=3542291 2024-04-03T03:46:07.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.961+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=T0N9CSF8M3D9 type=del size=972233 2024-04-03T03:46:07.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.969+0000 7f55269288c0 1 < suggested remove operation key=3XKXK1JXKOHU tag=ADFK2Q2WKHN6 type=del 2024-04-03T03:46:07.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.973+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~5UA71XY3D3IB.0 size=1048576 2024-04-03T03:46:07.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.973+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~5UA71XY3D3IB.1 size=1048576 2024-04-03T03:46:07.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.977+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~5UA71XY3D3IB.2 size=169747 2024-04-03T03:46:07.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.977+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=5UA71XY3D3IB tag=AQ1A3MM3COO0 type=write size=3315475 2024-04-03T03:46:07.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.981+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=5ESDL0282TIX type=del 2024-04-03T03:46:07.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.981+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=DWK4XEIMAUG4 type=del size=335543 2024-04-03T03:46:07.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.985+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~Q2N7GS2MDBG1.0 size=917788 2024-04-03T03:46:07.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.989+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=Q2N7GS2MDBG1 tag=N5NBTUTT6B3C type=write size=1966364 2024-04-03T03:46:07.989 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.993+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=01BO74ZSDWOU type=write size=490037 2024-04-03T03:46:07.991 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.993+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=UHUPDCBE2KFP type=del 2024-04-03T03:46:07.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:07.997+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=J16BORRU2CVZ type=del size=492721 2024-04-03T03:46:07.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.001+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=300XK7BUNXLE type=del 2024-04-03T03:46:08.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.001+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=9S6YREEIP8AO type=del size=3944381 2024-04-03T03:46:08.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.005+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~5GF2H0QJZ1IL.0 size=424233 2024-04-03T03:46:08.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.009+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=5GF2H0QJZ1IL tag=1031X2CZH8K1 type=write size=1472809 2024-04-03T03:46:08.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.013+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=162KIR3F2HWW type=write size=766130 2024-04-03T03:46:08.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.013+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=2GMUF4PL8ZT3 type=del 2024-04-03T03:46:08.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.017+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=A8TBWSHTJ4BQ type=del size=2769156 2024-04-03T03:46:08.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.021+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=S8J2IQYIS822 type=del 2024-04-03T03:46:08.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.025+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=913S4A4G1U61 type=del size=1493098 2024-04-03T03:46:08.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.025+0000 7f55269288c0 1 < completed write operation key=IOHMF3ADC6EU tag=I4R7FEKFJQ02 type=write size=963513 2024-04-03T03:46:08.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.029+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=BCPFZRW77PP3 type=write size=910579 2024-04-03T03:46:08.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.033+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=ZECV6VC06ZUN type=del 2024-04-03T03:46:08.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.033+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=CVTQ8DRNE5F7 type=write size=619652 2024-04-03T03:46:08.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.037+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~Z621GAL058HM.0 size=1048576 2024-04-03T03:46:08.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.037+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~Z621GAL058HM.1 size=887873 2024-04-03T03:46:08.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.045+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=Z621GAL058HM tag=0N4GLJMMJH12 type=write size=2985025 2024-04-03T03:46:08.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.049+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~C48QYHE6HGJU.0 size=1048576 2024-04-03T03:46:08.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.049+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~C48QYHE6HGJU.1 size=473699 2024-04-03T03:46:08.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.049+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=C48QYHE6HGJU tag=9LTEWL4C3FLB type=write size=2570851 2024-04-03T03:46:08.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.053+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=4D6MZT0K2VVV type=del 2024-04-03T03:46:08.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.057+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=5QRFFX1HCR9Q type=del size=3541625 2024-04-03T03:46:08.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.057+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~90QT0YIL3TEX.0 size=122390 2024-04-03T03:46:08.060 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.061+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=90QT0YIL3TEX tag=Y0I61SDEZ3VZ type=write size=1170966 2024-04-03T03:46:08.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.065+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=548IH7393GCT type=del size=454054 2024-04-03T03:46:08.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.069+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~FRE16HAG8FFM.0 size=1048576 2024-04-03T03:46:08.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.069+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~FRE16HAG8FFM.1 size=1048576 2024-04-03T03:46:08.069 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.073+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~FRE16HAG8FFM.2 size=445614 2024-04-03T03:46:08.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.077+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=FRE16HAG8FFM tag=BTUN5MRQV4I8 type=write size=3591342 2024-04-03T03:46:08.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.081+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=KJGXV1WZYNKD type=del size=39237 2024-04-03T03:46:08.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.081+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=SK0FG3Y9Q5A8 type=del 2024-04-03T03:46:08.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.089+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~EKK4AAF94R6N.0 size=1047106 2024-04-03T03:46:08.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.089+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=EKK4AAF94R6N tag=M6OKLJZP3X1J type=write size=2095682 2024-04-03T03:46:08.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.093+0000 7f55269288c0 1 < suggested remove operation key=B5BI0HJ5S1Y1 tag=T0N9CSF8M3D9 type=del 2024-04-03T03:46:08.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.097+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=46SR9AS3SZCM type=del size=86369 2024-04-03T03:46:08.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.101+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~5UA71XY3D3IB.0 size=1048576 2024-04-03T03:46:08.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.101+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~5UA71XY3D3IB.1 size=1048576 2024-04-03T03:46:08.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.105+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~5UA71XY3D3IB.2 size=169747 2024-04-03T03:46:08.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.109+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=5UA71XY3D3IB tag=AQ1A3MM3COO0 type=write size=3315475 2024-04-03T03:46:08.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.113+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=UF5CHQ1JJVKC type=write size=120573 2024-04-03T03:46:08.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.117+0000 7f55269288c0 1 < suggested remove operation key=XFCPX90N2NYC tag=DWK4XEIMAUG4 type=del 2024-04-03T03:46:08.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.121+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=EDJ7HXHU4Y3E type=write size=530431 2024-04-03T03:46:08.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.125+0000 7f55269288c0 1 < completed write operation key=7POFUQ9CX6B1 tag=01BO74ZSDWOU type=write size=490037 2024-04-03T03:46:08.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.129+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=4DMJ5IWWJ66R type=del size=3514484 2024-04-03T03:46:08.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.129+0000 7f55269288c0 -1 < failed to complete operation key=XFCPX90N2NYC tag=J16BORRU2CVZ type=del size=492721: (22) Invalid argument 2024-04-03T03:46:08.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.133+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~THS8EMN11L0A.0 size=1048576 2024-04-03T03:46:08.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.137+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~THS8EMN11L0A.1 size=903629 2024-04-03T03:46:08.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.137+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=THS8EMN11L0A tag=EW0DW1F44IX5 type=write size=3000781 2024-04-03T03:46:08.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.141+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=9S6YREEIP8AO type=del 2024-04-03T03:46:08.140 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.141+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=MLMYGBSU6PR6 type=del size=1238953 2024-04-03T03:46:08.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.145+0000 7f55269288c0 1 < completed write operation key=MLTDNCZ4E5D8 tag=162KIR3F2HWW type=write size=766130 2024-04-03T03:46:08.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.149+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~Q0LMIVKZ94BD.0 size=1048576 2024-04-03T03:46:08.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.153+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~Q0LMIVKZ94BD.1 size=161982 2024-04-03T03:46:08.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.153+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=Q0LMIVKZ94BD tag=D6S2HH17OJAN type=write size=2259134 2024-04-03T03:46:08.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.153+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=A8TBWSHTJ4BQ type=del 2024-04-03T03:46:08.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.157+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=2DU74IH0W05T type=del size=2746750 2024-04-03T03:46:08.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.161+0000 7f55269288c0 1 < canceled operation key=TXFMKXUGMEA8 tag=913S4A4G1U61 type=del size=1493098 2024-04-03T03:46:08.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.161+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=K978AFIEMNEC type=write size=511915 2024-04-03T03:46:08.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.169+0000 7f55269288c0 1 < suggested remove operation key=0OSIL0R5ZJ54 tag=BCPFZRW77PP3 type=write 2024-04-03T03:46:08.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.177+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~GMHDTLBR4PVG.0 size=1048576 2024-04-03T03:46:08.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.177+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~GMHDTLBR4PVG.1 size=445440 2024-04-03T03:46:08.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.177+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=GMHDTLBR4PVG tag=7VYR4A1I10H6 type=write size=2542592 2024-04-03T03:46:08.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.181+0000 7f55269288c0 1 < completed write operation key=8BMP0HIS520R tag=CVTQ8DRNE5F7 type=write size=619652 2024-04-03T03:46:08.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.185+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~Q2R2N82EJYJN.0 size=1048576 2024-04-03T03:46:08.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.185+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~Q2R2N82EJYJN.1 size=481654 2024-04-03T03:46:08.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.185+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=Q2R2N82EJYJN tag=JFK6IHVW7ZQA type=write size=2578806 2024-04-03T03:46:08.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.189+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~C48QYHE6HGJU.0 size=1048576 2024-04-03T03:46:08.187 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.189+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~C48QYHE6HGJU.1 size=473699 2024-04-03T03:46:08.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.193+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=C48QYHE6HGJU tag=9LTEWL4C3FLB type=write size=2570851 2024-04-03T03:46:08.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.197+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=W4URN2OROMUP type=del size=3479888 2024-04-03T03:46:08.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.197+0000 7f55269288c0 1 < canceled operation key=D9OEPPT37WSJ tag=5QRFFX1HCR9Q type=del size=3541625 2024-04-03T03:46:08.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.201+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=O5X8YY8N4PSA type=del size=2636139 2024-04-03T03:46:08.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.205+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=548IH7393GCT type=del 2024-04-03T03:46:08.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.209+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~GPTRK0NHXX3Y.0 size=1048576 2024-04-03T03:46:08.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.213+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~GPTRK0NHXX3Y.1 size=1048576 2024-04-03T03:46:08.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.217+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~GPTRK0NHXX3Y.2 size=694191 2024-04-03T03:46:08.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.217+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=GPTRK0NHXX3Y tag=SV217D8588BD type=write size=3839919 2024-04-03T03:46:08.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.217+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=KJGXV1WZYNKD type=del 2024-04-03T03:46:08.222 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.225+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~FG60JWNKTXTF.0 size=645319 2024-04-03T03:46:08.222 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.225+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=FG60JWNKTXTF tag=7JY4PVIDRGPW type=write size=1693895 2024-04-03T03:46:08.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.229+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~EKK4AAF94R6N.0 size=1047106 2024-04-03T03:46:08.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.233+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=EKK4AAF94R6N tag=M6OKLJZP3X1J type=write size=2095682 2024-04-03T03:46:08.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.233+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=G7DVIK5KX4GW type=del size=1243139 2024-04-03T03:46:08.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.237+0000 7f55269288c0 -1 < failed to complete operation key=0OSIL0R5ZJ54 tag=46SR9AS3SZCM type=del size=86369: (22) Invalid argument 2024-04-03T03:46:08.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.241+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=3D1YGY4ASJ49 type=write size=619492 2024-04-03T03:46:08.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.245+0000 7f55269288c0 1 < completed write operation key=MB7HTWATXRMB tag=UF5CHQ1JJVKC type=write size=120573 2024-04-03T03:46:08.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.249+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~GBZ8X79DAPWZ.0 size=1048576 2024-04-03T03:46:08.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.249+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~GBZ8X79DAPWZ.1 size=818241 2024-04-03T03:46:08.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.249+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=GBZ8X79DAPWZ tag=QBZYERBZ5PO5 type=write size=2915393 2024-04-03T03:46:08.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.253+0000 7f55269288c0 1 < completed write operation key=K3Z9W19WEJBM tag=EDJ7HXHU4Y3E type=write size=530431 2024-04-03T03:46:08.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.257+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=QHPW19HA3FN0 type=del size=1790538 2024-04-03T03:46:08.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.261+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=4DMJ5IWWJ66R type=del 2024-04-03T03:46:08.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.265+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=VYVDQLVOK0E6 type=del size=2648730 2024-04-03T03:46:08.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.265+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~THS8EMN11L0A.0 size=1048576 2024-04-03T03:46:08.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.269+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~THS8EMN11L0A.1 size=903629 2024-04-03T03:46:08.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.273+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=THS8EMN11L0A tag=EW0DW1F44IX5 type=write size=3000781 2024-04-03T03:46:08.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.277+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~0LB5VHV1DRM5.0 size=288214 2024-04-03T03:46:08.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.277+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=0LB5VHV1DRM5 tag=8SULFJ0RM9QP type=write size=1336790 2024-04-03T03:46:08.280 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.281+0000 7f55269288c0 1 < suggested update operation key=YCEKDT5EQD9D tag=MLMYGBSU6PR6 type=del size=1238953 2024-04-03T03:46:08.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.289+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~RXYDH6UWO3VG.0 size=729203 2024-04-03T03:46:08.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.289+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=RXYDH6UWO3VG tag=FXC183SK3WF5 type=write size=1777779 2024-04-03T03:46:08.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.293+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~Q0LMIVKZ94BD.0 size=1048576 2024-04-03T03:46:08.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.293+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~Q0LMIVKZ94BD.1 size=161982 2024-04-03T03:46:08.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.297+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=Q0LMIVKZ94BD tag=D6S2HH17OJAN type=write size=2259134 2024-04-03T03:46:08.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.301+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=MIYRRRHMFLSS type=del size=410121 2024-04-03T03:46:08.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.309+0000 7f55269288c0 1 < suggested update operation key=8SBTVHL09P63 tag=2DU74IH0W05T type=del size=2746750 2024-04-03T03:46:08.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.313+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=KIOFW0D8063K type=del size=1590925 2024-04-03T03:46:08.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.313+0000 7f55269288c0 1 < completed write operation key=8BMP0HIS520R tag=K978AFIEMNEC type=write size=511915 2024-04-03T03:46:08.315 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.317+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=TPT1J8NRVI3Q type=del size=2184219 2024-04-03T03:46:08.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.321+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~GMHDTLBR4PVG.0 size=1048576 2024-04-03T03:46:08.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.325+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~GMHDTLBR4PVG.1 size=445440 2024-04-03T03:46:08.327 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.329+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=GMHDTLBR4PVG tag=7VYR4A1I10H6 type=write size=2542592 2024-04-03T03:46:08.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.333+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=LZXWRIWR7734 type=del size=2137208 2024-04-03T03:46:08.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.337+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~Q2R2N82EJYJN.0 size=1048576 2024-04-03T03:46:08.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.341+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~Q2R2N82EJYJN.1 size=481654 2024-04-03T03:46:08.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.345+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=Q2R2N82EJYJN tag=JFK6IHVW7ZQA type=write size=2578806 2024-04-03T03:46:08.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.353+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~VQBHTT2WM2HQ.0 size=1048576 2024-04-03T03:46:08.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.353+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~VQBHTT2WM2HQ.1 size=399038 2024-04-03T03:46:08.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.353+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=VQBHTT2WM2HQ tag=3FZPLMIN6KXL type=write size=2496190 2024-04-03T03:46:08.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.357+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=W4URN2OROMUP type=del 2024-04-03T03:46:08.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.361+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=7CYICRO5FGPT type=del size=803257 2024-04-03T03:46:08.361 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.365+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=O5X8YY8N4PSA type=del 2024-04-03T03:46:08.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.369+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~2LSL5SS0158M.0 size=1048576 2024-04-03T03:46:08.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.373+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~2LSL5SS0158M.1 size=1048576 2024-04-03T03:46:08.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.377+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~2LSL5SS0158M.2 size=544689 2024-04-03T03:46:08.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.377+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=2LSL5SS0158M tag=TU4GPE4NNEO3 type=write size=3690417 2024-04-03T03:46:08.376 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.377+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~GPTRK0NHXX3Y.0 size=1048576 2024-04-03T03:46:08.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.381+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~GPTRK0NHXX3Y.1 size=1048576 2024-04-03T03:46:08.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.381+0000 7f55269288c0 1 < canceled part key=_multipart_XFCPX90N2NYC.2~GPTRK0NHXX3Y.2 size=694191 2024-04-03T03:46:08.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.389+0000 7f55269288c0 1 < canceled multipart upload key=XFCPX90N2NYC upload=GPTRK0NHXX3Y tag=SV217D8588BD type=write size=3839919 2024-04-03T03:46:08.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.393+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~ZDA96OBKORC5.0 size=1048576 2024-04-03T03:46:08.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.397+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~ZDA96OBKORC5.1 size=280828 2024-04-03T03:46:08.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.397+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=ZDA96OBKORC5 tag=X8C1HWRAT2FP type=write size=2377980 2024-04-03T03:46:08.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.401+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~FG60JWNKTXTF.0 size=645319 2024-04-03T03:46:08.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.405+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=FG60JWNKTXTF tag=7JY4PVIDRGPW type=write size=1693895 2024-04-03T03:46:08.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.409+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=5JLE4J1NIGB5 type=del size=2877812 2024-04-03T03:46:08.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.413+0000 7f55269288c0 1 < suggested update operation key=KDSE2XB4D1XI tag=G7DVIK5KX4GW type=del size=1243139 2024-04-03T03:46:08.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.421+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~DA04ATL6A2UC.0 size=624507 2024-04-03T03:46:08.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.421+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=DA04ATL6A2UC tag=GB9K2MZCKPUB type=write size=1673083 2024-04-03T03:46:08.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.425+0000 7f55269288c0 1 < suggested update operation key=CPR27NMHPIPQ tag=3D1YGY4ASJ49 type=write size=619492 2024-04-03T03:46:08.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.429+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=0SV9IKVCKE5K type=write size=538190 2024-04-03T03:46:08.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.433+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~GBZ8X79DAPWZ.0 size=1048576 2024-04-03T03:46:08.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.437+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~GBZ8X79DAPWZ.1 size=818241 2024-04-03T03:46:08.438 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.441+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=GBZ8X79DAPWZ tag=QBZYERBZ5PO5 type=write size=2915393 2024-04-03T03:46:08.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.445+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=1107J018OFBK type=del size=4113946 2024-04-03T03:46:08.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.453+0000 7f55269288c0 -1 < failed to complete operation key=KDSE2XB4D1XI tag=QHPW19HA3FN0 type=del size=1790538: (22) Invalid argument 2024-04-03T03:46:08.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.457+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=0ZV15HDSB07K type=del size=2654580 2024-04-03T03:46:08.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.457+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=VYVDQLVOK0E6 type=del 2024-04-03T03:46:08.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.461+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=829V7HJHYGHO type=del size=832402 2024-04-03T03:46:08.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.465+0000 7f55269288c0 1 < canceled part key=_multipart_K3Z9W19WEJBM.2~0LB5VHV1DRM5.0 size=288214 2024-04-03T03:46:08.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.469+0000 7f55269288c0 1 < canceled multipart upload key=K3Z9W19WEJBM upload=0LB5VHV1DRM5 tag=8SULFJ0RM9QP type=write size=1336790 2024-04-03T03:46:08.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.473+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=8QYF382PU14C type=write size=601614 2024-04-03T03:46:08.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.473+0000 7f55269288c0 1 < canceled part key=_multipart_MLTDNCZ4E5D8.2~RXYDH6UWO3VG.0 size=729203 2024-04-03T03:46:08.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.477+0000 7f55269288c0 1 < canceled multipart upload key=MLTDNCZ4E5D8 upload=RXYDH6UWO3VG tag=FXC183SK3WF5 type=write size=1777779 2024-04-03T03:46:08.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.485+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~9L3E1KF51R30.0 size=471557 2024-04-03T03:46:08.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.485+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=9L3E1KF51R30 tag=120DDVER0CYM type=write size=1520133 2024-04-03T03:46:08.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.489+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=MIYRRRHMFLSS type=del 2024-04-03T03:46:08.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.493+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=6ZRM3FC2EUA0 type=del size=2617588 2024-04-03T03:46:08.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.493+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=KIOFW0D8063K type=del 2024-04-03T03:46:08.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.501+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~CIPQTZXGBL6G.0 size=415697 2024-04-03T03:46:08.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.501+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=CIPQTZXGBL6G tag=M377FSCQ9RI1 type=write size=1464273 2024-04-03T03:46:08.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.505+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=TPT1J8NRVI3Q type=del size=2184219 2024-04-03T03:46:08.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.509+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~312VE8MWC3LQ.0 size=975330 2024-04-03T03:46:08.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.509+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=312VE8MWC3LQ tag=A7BVLF8XMBXK type=write size=2023906 2024-04-03T03:46:08.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.517+0000 7f55269288c0 1 < suggested update operation key=ZKSA09OSFSYN tag=LZXWRIWR7734 type=del size=2137208 2024-04-03T03:46:08.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.521+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~9PZ9OXWSF7PR.0 size=383120 2024-04-03T03:46:08.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.521+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=9PZ9OXWSF7PR tag=PCRBTZRT3K5X type=write size=1431696 2024-04-03T03:46:08.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.525+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~VQBHTT2WM2HQ.0 size=1048576 2024-04-03T03:46:08.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.529+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~VQBHTT2WM2HQ.1 size=399038 2024-04-03T03:46:08.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.533+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=VQBHTT2WM2HQ tag=3FZPLMIN6KXL type=write size=2496190 2024-04-03T03:46:08.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.537+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=Z69XTE6H00R3 type=del size=1949347 2024-04-03T03:46:08.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.541+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=7CYICRO5FGPT type=del 2024-04-03T03:46:08.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.541+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=SU0IX8G9JMZT type=del size=3564316 2024-04-03T03:46:08.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.545+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~2LSL5SS0158M.0 size=1048576 2024-04-03T03:46:08.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.549+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~2LSL5SS0158M.1 size=1048576 2024-04-03T03:46:08.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.549+0000 7f55269288c0 1 < canceled part key=_multipart_6KH6TASZS3UG.2~2LSL5SS0158M.2 size=544689 2024-04-03T03:46:08.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.553+0000 7f55269288c0 1 < canceled multipart upload key=6KH6TASZS3UG upload=2LSL5SS0158M tag=TU4GPE4NNEO3 type=write size=3690417 2024-04-03T03:46:08.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.561+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~6L4TFX9N407D.0 size=76986 2024-04-03T03:46:08.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.561+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=6L4TFX9N407D tag=9JO3YQ5N4VBB type=write size=1125562 2024-04-03T03:46:08.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.561+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~ZDA96OBKORC5.0 size=1048576 2024-04-03T03:46:08.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.561+0000 7f55269288c0 1 < canceled part key=_multipart_ZKSA09OSFSYN.2~ZDA96OBKORC5.1 size=280828 2024-04-03T03:46:08.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.569+0000 7f55269288c0 1 < canceled multipart upload key=ZKSA09OSFSYN upload=ZDA96OBKORC5 tag=X8C1HWRAT2FP type=write size=2377980 2024-04-03T03:46:08.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.569+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=7BU8LJBKBOSV type=write size=1044802 2024-04-03T03:46:08.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.573+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=5JLE4J1NIGB5 type=del 2024-04-03T03:46:08.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.577+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~UTJ6107EEX6D.0 size=584848 2024-04-03T03:46:08.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.577+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=UTJ6107EEX6D tag=OAI3GJIQ0WOA type=write size=1633424 2024-04-03T03:46:08.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.581+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~DA04ATL6A2UC.0 size=624507 2024-04-03T03:46:08.583 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.585+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=DA04ATL6A2UC tag=GB9K2MZCKPUB type=write size=1673083 2024-04-03T03:46:08.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.589+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=KHMODK932F27 type=del size=2460081 2024-04-03T03:46:08.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.593+0000 7f55269288c0 1 < completed write operation key=TXFMKXUGMEA8 tag=0SV9IKVCKE5K type=write size=538190 2024-04-03T03:46:08.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.597+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~SSPFG35MGRPM.0 size=1048576 2024-04-03T03:46:08.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.601+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~SSPFG35MGRPM.1 size=823522 2024-04-03T03:46:08.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.601+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=SSPFG35MGRPM tag=78ZCZHHSPCXR type=write size=2920674 2024-04-03T03:46:08.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.605+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=1107J018OFBK type=del 2024-04-03T03:46:08.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.605+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=OQTX45JD92SZ type=del size=2005419 2024-04-03T03:46:08.610 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.613+0000 7f55269288c0 1 < suggested remove operation key=Z42NDVEX1SOL tag=0ZV15HDSB07K type=del 2024-04-03T03:46:08.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.617+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=L0G04LI96A0T type=del size=326428 2024-04-03T03:46:08.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.617+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=829V7HJHYGHO type=del 2024-04-03T03:46:08.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.625+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~EWSJQJJ99Q5B.0 size=1048576 2024-04-03T03:46:08.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.625+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~EWSJQJJ99Q5B.1 size=580581 2024-04-03T03:46:08.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.625+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=EWSJQJJ99Q5B tag=B31A2GS4L39I type=write size=2677733 2024-04-03T03:46:08.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.629+0000 7f55269288c0 1 < completed write operation key=U62RSK21LJEF tag=8QYF382PU14C type=write size=601614 2024-04-03T03:46:08.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.633+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~6XE89GK57CLU.0 size=88363 2024-04-03T03:46:08.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.633+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=6XE89GK57CLU tag=M5W8NJV4FI0Z type=write size=1136939 2024-04-03T03:46:08.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.637+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~9L3E1KF51R30.0 size=471557 2024-04-03T03:46:08.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.641+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=9L3E1KF51R30 tag=120DDVER0CYM type=write size=1520133 2024-04-03T03:46:08.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.649+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~JJ03901M8LVX.0 size=1048576 2024-04-03T03:46:08.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.649+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~JJ03901M8LVX.1 size=582065 2024-04-03T03:46:08.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.649+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=JJ03901M8LVX tag=7UYM1SFDLA93 type=write size=2679217 2024-04-03T03:46:08.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.653+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=6ZRM3FC2EUA0 type=del 2024-04-03T03:46:08.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.661+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~RFUJWAJH8JAD.0 size=4886 2024-04-03T03:46:08.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.661+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=RFUJWAJH8JAD tag=OJO4YNGJ2RTW type=write size=1053462 2024-04-03T03:46:08.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.661+0000 7f55269288c0 1 < canceled part key=_multipart_MB7HTWATXRMB.2~CIPQTZXGBL6G.0 size=415697 2024-04-03T03:46:08.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.665+0000 7f55269288c0 1 < canceled multipart upload key=MB7HTWATXRMB upload=CIPQTZXGBL6G tag=M377FSCQ9RI1 type=write size=1464273 2024-04-03T03:46:08.665 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.669+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=ULXK42U9XSVM type=del size=2832299 2024-04-03T03:46:08.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.669+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~312VE8MWC3LQ.0 size=975330 2024-04-03T03:46:08.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.673+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=312VE8MWC3LQ tag=A7BVLF8XMBXK type=write size=2023906 2024-04-03T03:46:08.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.681+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~4ADY2E87RLK3.0 size=1048576 2024-04-03T03:46:08.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.681+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~4ADY2E87RLK3.1 size=561545 2024-04-03T03:46:08.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.681+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=4ADY2E87RLK3 tag=6O28P1S4HUIR type=write size=2658697 2024-04-03T03:46:08.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.685+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~9PZ9OXWSF7PR.0 size=383120 2024-04-03T03:46:08.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.689+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=9PZ9OXWSF7PR tag=PCRBTZRT3K5X type=write size=1431696 2024-04-03T03:46:08.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.693+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~CSADKQV5BICU.0 size=116296 2024-04-03T03:46:08.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.693+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=CSADKQV5BICU tag=ICAFTZPH87AX type=write size=1164872 2024-04-03T03:46:08.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.697+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=Z69XTE6H00R3 type=del 2024-04-03T03:46:08.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.697+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=CBW0OZTGCTV0 type=write size=419094 2024-04-03T03:46:08.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.701+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=SU0IX8G9JMZT type=del size=3564316 2024-04-03T03:46:08.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.705+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~828DMF1H3QJU.0 size=343885 2024-04-03T03:46:08.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.705+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=828DMF1H3QJU tag=P93IW9AHR8OK type=write size=1392461 2024-04-03T03:46:08.706 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.709+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~6L4TFX9N407D.0 size=76986 2024-04-03T03:46:08.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.713+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=6L4TFX9N407D tag=9JO3YQ5N4VBB type=write size=1125562 2024-04-03T03:46:08.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.717+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=ZUPO111JV0NL type=del size=1993501 2024-04-03T03:46:08.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.721+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=7BU8LJBKBOSV type=write size=1044802 2024-04-03T03:46:08.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.725+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~5AU7XW9IAJ4V.0 size=1048576 2024-04-03T03:46:08.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.729+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~5AU7XW9IAJ4V.1 size=465524 2024-04-03T03:46:08.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.729+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=5AU7XW9IAJ4V tag=3WWUAGU00AS9 type=write size=2562676 2024-04-03T03:46:08.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.729+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~UTJ6107EEX6D.0 size=584848 2024-04-03T03:46:08.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.737+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=UTJ6107EEX6D tag=OAI3GJIQ0WOA type=write size=1633424 2024-04-03T03:46:08.739 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.741+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~38JB1TO9CZF0.0 size=1048576 2024-04-03T03:46:08.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.745+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~38JB1TO9CZF0.1 size=1048576 2024-04-03T03:46:08.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.745+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~38JB1TO9CZF0.2 size=236958 2024-04-03T03:46:08.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.745+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=38JB1TO9CZF0 tag=ILOIAW4RI22R type=write size=3382686 2024-04-03T03:46:08.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.749+0000 7f55269288c0 1 < suggested remove operation key=D9OEPPT37WSJ tag=KHMODK932F27 type=del 2024-04-03T03:46:08.752 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.757+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~TV6JA8AU0A0V.0 size=1048576 2024-04-03T03:46:08.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.757+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~TV6JA8AU0A0V.1 size=1048576 2024-04-03T03:46:08.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.757+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~TV6JA8AU0A0V.2 size=245971 2024-04-03T03:46:08.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.757+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=TV6JA8AU0A0V tag=RJKNIHBVOA4M type=write size=3391699 2024-04-03T03:46:08.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.761+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~SSPFG35MGRPM.0 size=1048576 2024-04-03T03:46:08.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.765+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~SSPFG35MGRPM.1 size=823522 2024-04-03T03:46:08.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.769+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=SSPFG35MGRPM tag=78ZCZHHSPCXR type=write size=2920674 2024-04-03T03:46:08.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.773+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~56YBOJUE4C0T.0 size=557106 2024-04-03T03:46:08.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.773+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=56YBOJUE4C0T tag=5X2594OBD7E4 type=write size=1605682 2024-04-03T03:46:08.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.773+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=OQTX45JD92SZ type=del 2024-04-03T03:46:08.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.777+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=99NE24F53HCW type=write size=913335 2024-04-03T03:46:08.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.777+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=L0G04LI96A0T type=del 2024-04-03T03:46:08.778 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.781+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=Y42EJG9WUTOV type=del size=1012304 2024-04-03T03:46:08.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.785+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~EWSJQJJ99Q5B.0 size=1048576 2024-04-03T03:46:08.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.785+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~EWSJQJJ99Q5B.1 size=580581 2024-04-03T03:46:08.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.789+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=EWSJQJJ99Q5B tag=B31A2GS4L39I type=write size=2677733 2024-04-03T03:46:08.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.789+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=SBRGK953CLWW type=write size=1040211 2024-04-03T03:46:08.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.793+0000 7f55269288c0 1 < canceled part key=_multipart_MB7HTWATXRMB.2~6XE89GK57CLU.0 size=88363 2024-04-03T03:46:08.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.793+0000 7f55269288c0 1 < canceled multipart upload key=MB7HTWATXRMB upload=6XE89GK57CLU tag=M5W8NJV4FI0Z type=write size=1136939 2024-04-03T03:46:08.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.797+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=NS2ABE8TK3KV type=del size=3916831 2024-04-03T03:46:08.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.801+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~JJ03901M8LVX.0 size=1048576 2024-04-03T03:46:08.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.801+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~JJ03901M8LVX.1 size=582065 2024-04-03T03:46:08.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.805+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=JJ03901M8LVX tag=7UYM1SFDLA93 type=write size=2679217 2024-04-03T03:46:08.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.805+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=XOV9AY0SJ27P type=del size=3946583 2024-04-03T03:46:08.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.809+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~RFUJWAJH8JAD.0 size=4886 2024-04-03T03:46:08.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.813+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=RFUJWAJH8JAD tag=OJO4YNGJ2RTW type=write size=1053462 2024-04-03T03:46:08.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.817+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~7KJ7V8ARIYN6.0 size=1048576 2024-04-03T03:46:08.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.821+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~7KJ7V8ARIYN6.1 size=1048576 2024-04-03T03:46:08.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.821+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~7KJ7V8ARIYN6.2 size=626918 2024-04-03T03:46:08.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.821+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=7KJ7V8ARIYN6 tag=2EI9A5YBOCA6 type=write size=3772646 2024-04-03T03:46:08.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.825+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=ULXK42U9XSVM type=del 2024-04-03T03:46:08.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.825+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=84JB9C1AS0SO type=del size=1328008 2024-04-03T03:46:08.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.829+0000 7f55269288c0 1 < canceled part key=_multipart_F6IBZ80J4SDM.2~4ADY2E87RLK3.0 size=1048576 2024-04-03T03:46:08.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.829+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~4ADY2E87RLK3.1 size=561545 2024-04-03T03:46:08.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.833+0000 7f55269288c0 1 < canceled multipart upload key=F6IBZ80J4SDM upload=4ADY2E87RLK3 tag=6O28P1S4HUIR type=write size=2658697 2024-04-03T03:46:08.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.837+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=DFKOCUM07XYD type=del size=1444059 2024-04-03T03:46:08.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.841+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~CSADKQV5BICU.0 size=116296 2024-04-03T03:46:08.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.845+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=CSADKQV5BICU tag=ICAFTZPH87AX type=write size=1164872 2024-04-03T03:46:08.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.845+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=D4WQCF4J8S1F type=del size=3838904 2024-04-03T03:46:08.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.849+0000 7f55269288c0 1 < completed write operation key=JAXVD60NI5YW tag=CBW0OZTGCTV0 type=write size=419094 2024-04-03T03:46:08.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.849+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=Q5NMG4MCZ60X type=del size=322636 2024-04-03T03:46:08.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.853+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~828DMF1H3QJU.0 size=343885 2024-04-03T03:46:08.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.857+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=828DMF1H3QJU tag=P93IW9AHR8OK type=write size=1392461 2024-04-03T03:46:08.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.857+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=UVBE00S0X2PX type=del size=2516494 2024-04-03T03:46:08.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.861+0000 7f55269288c0 1 < suggested update operation key=LZQGL2UAWOTU tag=ZUPO111JV0NL type=del size=1993501 2024-04-03T03:46:08.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.865+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~5AI6GP2HB51A.0 size=1048576 2024-04-03T03:46:08.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.869+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~5AI6GP2HB51A.1 size=1048576 2024-04-03T03:46:08.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.869+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~5AI6GP2HB51A.2 size=245601 2024-04-03T03:46:08.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.869+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=5AI6GP2HB51A tag=3CJASSLXPG5H type=write size=3391329 2024-04-03T03:46:08.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.873+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~5AU7XW9IAJ4V.0 size=1048576 2024-04-03T03:46:08.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.877+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~5AU7XW9IAJ4V.1 size=465524 2024-04-03T03:46:08.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.881+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=5AU7XW9IAJ4V tag=3WWUAGU00AS9 type=write size=2562676 2024-04-03T03:46:08.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.881+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=DJMC08MOTMAY type=del size=3118005 2024-04-03T03:46:08.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.885+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~38JB1TO9CZF0.0 size=1048576 2024-04-03T03:46:08.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.885+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~38JB1TO9CZF0.1 size=1048576 2024-04-03T03:46:08.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.889+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~38JB1TO9CZF0.2 size=236958 2024-04-03T03:46:08.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.893+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=38JB1TO9CZF0 tag=ILOIAW4RI22R type=write size=3382686 2024-04-03T03:46:08.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.897+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=8TFPQRDY1M84 type=del size=987317 2024-04-03T03:46:08.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.897+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~TV6JA8AU0A0V.0 size=1048576 2024-04-03T03:46:08.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.901+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~TV6JA8AU0A0V.1 size=1048576 2024-04-03T03:46:08.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.901+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~TV6JA8AU0A0V.2 size=245971 2024-04-03T03:46:08.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.905+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=TV6JA8AU0A0V tag=RJKNIHBVOA4M type=write size=3391699 2024-04-03T03:46:08.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.909+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=9IJWRLLM8ZOA type=del size=485521 2024-04-03T03:46:08.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.913+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~56YBOJUE4C0T.0 size=557106 2024-04-03T03:46:08.913 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.917+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=56YBOJUE4C0T tag=5X2594OBD7E4 type=write size=1605682 2024-04-03T03:46:08.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.917+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=4WHON3DC16P2 type=del size=3018557 2024-04-03T03:46:08.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.921+0000 7f55269288c0 1 < canceled operation key=8SBTVHL09P63 tag=99NE24F53HCW type=write size=913335 2024-04-03T03:46:08.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.925+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=V9UHY213JEV2 type=del size=2910555 2024-04-03T03:46:08.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.929+0000 7f55269288c0 1 < suggested update operation key=KU1R0YLDP1V3 tag=Y42EJG9WUTOV type=del size=1012304 2024-04-03T03:46:08.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.933+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~Y2OH74UGX778.0 size=1048576 2024-04-03T03:46:08.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.933+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~Y2OH74UGX778.1 size=234049 2024-04-03T03:46:08.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.933+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=Y2OH74UGX778 tag=OW6PRQOBIB10 type=write size=2331201 2024-04-03T03:46:08.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.941+0000 7f55269288c0 1 < suggested update operation key=0OSIL0R5ZJ54 tag=SBRGK953CLWW type=write size=1040211 2024-04-03T03:46:08.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.941+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=3R4IUL1YSGGB type=del size=2906981 2024-04-03T03:46:08.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.945+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=NS2ABE8TK3KV type=del 2024-04-03T03:46:08.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.949+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=EZTQIVO36CO9 type=del size=630591 2024-04-03T03:46:08.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.949+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=XOV9AY0SJ27P type=del 2024-04-03T03:46:08.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.953+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~4285HBOA2DN1.0 size=1048576 2024-04-03T03:46:08.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.961+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~4285HBOA2DN1.1 size=1048576 2024-04-03T03:46:08.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.961+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~4285HBOA2DN1.2 size=709647 2024-04-03T03:46:08.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.961+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=4285HBOA2DN1 tag=Z9PJPAS172PG type=write size=3855375 2024-04-03T03:46:08.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.965+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~7KJ7V8ARIYN6.0 size=1048576 2024-04-03T03:46:08.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.965+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~7KJ7V8ARIYN6.1 size=1048576 2024-04-03T03:46:08.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.969+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~7KJ7V8ARIYN6.2 size=626918 2024-04-03T03:46:08.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.973+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=7KJ7V8ARIYN6 tag=2EI9A5YBOCA6 type=write size=3772646 2024-04-03T03:46:08.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.977+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=R3BUCYCJMRZ4 type=del size=2660197 2024-04-03T03:46:08.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.977+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=84JB9C1AS0SO type=del 2024-04-03T03:46:08.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.981+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~EZX102DXJAP8.0 size=1048576 2024-04-03T03:46:08.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.985+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~EZX102DXJAP8.1 size=1048576 2024-04-03T03:46:08.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.985+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~EZX102DXJAP8.2 size=56735 2024-04-03T03:46:08.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.985+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=EZX102DXJAP8 tag=S8GVEE7WWYGG type=write size=3202463 2024-04-03T03:46:08.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.989+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=DFKOCUM07XYD type=del 2024-04-03T03:46:08.989 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.993+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~Y9ZL6ZRERUKF.0 size=947646 2024-04-03T03:46:08.989 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.993+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=Y9ZL6ZRERUKF tag=RB1WB58REXGN type=write size=1996222 2024-04-03T03:46:08.991 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.993+0000 7f55269288c0 -1 < failed to complete operation key=0OSIL0R5ZJ54 tag=D4WQCF4J8S1F type=del size=3838904: (22) Invalid argument 2024-04-03T03:46:08.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.997+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=KKBKVCESK3OS type=del size=2528344 2024-04-03T03:46:08.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:08.997+0000 7f55269288c0 -1 < failed to complete operation key=KU1R0YLDP1V3 tag=Q5NMG4MCZ60X type=del size=322636: (22) Invalid argument 2024-04-03T03:46:08.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.001+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=JY5L105R8LBB type=del size=3114889 2024-04-03T03:46:09.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.005+0000 7f55269288c0 1 < suggested remove operation key=6KH6TASZS3UG tag=UVBE00S0X2PX type=del 2024-04-03T03:46:09.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.009+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=01W1ZV74OCLI type=del size=392123 2024-04-03T03:46:09.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.009+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~5AI6GP2HB51A.0 size=1048576 2024-04-03T03:46:09.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.013+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~5AI6GP2HB51A.1 size=1048576 2024-04-03T03:46:09.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.013+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~5AI6GP2HB51A.2 size=245601 2024-04-03T03:46:09.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.017+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=5AI6GP2HB51A tag=3CJASSLXPG5H type=write size=3391329 2024-04-03T03:46:09.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.021+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=G4HQUBZBL74M type=del size=1886673 2024-04-03T03:46:09.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.025+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=DJMC08MOTMAY type=del 2024-04-03T03:46:09.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.025+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=WIMH6BSX5SSV type=del size=600364 2024-04-03T03:46:09.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.029+0000 7f55269288c0 1 < canceled operation key=TW860A14J9RC tag=8TFPQRDY1M84 type=del size=987317 2024-04-03T03:46:09.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.033+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~HMJ5794OH5RZ.0 size=667785 2024-04-03T03:46:09.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.033+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=HMJ5794OH5RZ tag=81GS70EGVD85 type=write size=1716361 2024-04-03T03:46:09.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.037+0000 7f55269288c0 1 < suggested update operation key=TW860A14J9RC tag=9IJWRLLM8ZOA type=del size=485521 2024-04-03T03:46:09.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.041+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~B3ER9ALU39VZ.0 size=367254 2024-04-03T03:46:09.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.041+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=B3ER9ALU39VZ tag=EHOIICKCIU2M type=write size=1415830 2024-04-03T03:46:09.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.049+0000 7f55269288c0 1 < suggested remove operation key=XFCPX90N2NYC tag=4WHON3DC16P2 type=del 2024-04-03T03:46:09.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.049+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=DY3RTC03TI1H type=write size=511422 2024-04-03T03:46:09.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.053+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=V9UHY213JEV2 type=del 2024-04-03T03:46:09.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.057+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~G31BDB46YW3C.0 size=111492 2024-04-03T03:46:09.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.057+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=G31BDB46YW3C tag=PC2F19SG4T6Q type=write size=1160068 2024-04-03T03:46:09.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.061+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~Y2OH74UGX778.0 size=1048576 2024-04-03T03:46:09.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.065+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~Y2OH74UGX778.1 size=234049 2024-04-03T03:46:09.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.069+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=Y2OH74UGX778 tag=OW6PRQOBIB10 type=write size=2331201 2024-04-03T03:46:09.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.069+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=HHXDC9VNYZX7 type=write size=654715 2024-04-03T03:46:09.069 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.073+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=3R4IUL1YSGGB type=del 2024-04-03T03:46:09.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.073+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=3IOIJZE9IJ4V type=write size=213506 2024-04-03T03:46:09.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.077+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=EZTQIVO36CO9 type=del 2024-04-03T03:46:09.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.081+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~LKO2YBUCL4FK.0 size=208607 2024-04-03T03:46:09.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.081+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=LKO2YBUCL4FK tag=24I86XFRVLYI type=write size=1257183 2024-04-03T03:46:09.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.085+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~4285HBOA2DN1.0 size=1048576 2024-04-03T03:46:09.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.085+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~4285HBOA2DN1.1 size=1048576 2024-04-03T03:46:09.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.089+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~4285HBOA2DN1.2 size=709647 2024-04-03T03:46:09.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.093+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=4285HBOA2DN1 tag=Z9PJPAS172PG type=write size=3855375 2024-04-03T03:46:09.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.093+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=GQR6EV1UXITM type=del size=3272360 2024-04-03T03:46:09.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.097+0000 7f55269288c0 1 < canceled operation key=U62RSK21LJEF tag=R3BUCYCJMRZ4 type=del size=2660197 2024-04-03T03:46:09.096 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.097+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=5XGGI8EUXDUW type=del size=214519 2024-04-03T03:46:09.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.101+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~EZX102DXJAP8.0 size=1048576 2024-04-03T03:46:09.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.105+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~EZX102DXJAP8.1 size=1048576 2024-04-03T03:46:09.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.105+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~EZX102DXJAP8.2 size=56735 2024-04-03T03:46:09.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.109+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=EZX102DXJAP8 tag=S8GVEE7WWYGG type=write size=3202463 2024-04-03T03:46:09.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.113+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=SNHILTA8AFWX type=del size=204623 2024-04-03T03:46:09.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.117+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~Y9ZL6ZRERUKF.0 size=947646 2024-04-03T03:46:09.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.121+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=Y9ZL6ZRERUKF tag=RB1WB58REXGN type=write size=1996222 2024-04-03T03:46:09.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.121+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=VTZEKRYZBRXL type=del size=2131560 2024-04-03T03:46:09.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.125+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=KKBKVCESK3OS type=del 2024-04-03T03:46:09.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.129+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~9EM265MM0JQM.0 size=832177 2024-04-03T03:46:09.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.129+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=9EM265MM0JQM tag=LQ0MYGBIGG6N type=write size=1880753 2024-04-03T03:46:09.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.129+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=JY5L105R8LBB type=del 2024-04-03T03:46:09.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.133+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~DB06RTOYW40H.0 size=714917 2024-04-03T03:46:09.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.133+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=DB06RTOYW40H tag=Q1B6XJLW00G9 type=write size=1763493 2024-04-03T03:46:09.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.137+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=01W1ZV74OCLI type=del 2024-04-03T03:46:09.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.141+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=Q6O7G9HZY2HD type=del size=3649393 2024-04-03T03:46:09.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.141+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=G4HQUBZBL74M type=del 2024-04-03T03:46:09.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.145+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~OUBH42DKLJ9O.0 size=972731 2024-04-03T03:46:09.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.145+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=OUBH42DKLJ9O tag=HFS87F5NBHFE type=write size=2021307 2024-04-03T03:46:09.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.149+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=WIMH6BSX5SSV type=del 2024-04-03T03:46:09.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.149+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=LZAAOG9HXA24 type=del size=2980892 2024-04-03T03:46:09.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.153+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~HMJ5794OH5RZ.0 size=667785 2024-04-03T03:46:09.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.157+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=HMJ5794OH5RZ tag=81GS70EGVD85 type=write size=1716361 2024-04-03T03:46:09.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.161+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=4FBTHNI57A02 type=del size=107086 2024-04-03T03:46:09.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.161+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~B3ER9ALU39VZ.0 size=367254 2024-04-03T03:46:09.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.165+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=B3ER9ALU39VZ tag=EHOIICKCIU2M type=write size=1415830 2024-04-03T03:46:09.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.169+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=95JVIRBESMJQ type=del size=1812427 2024-04-03T03:46:09.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.173+0000 7f55269288c0 1 < completed write operation key=TXFMKXUGMEA8 tag=DY3RTC03TI1H type=write size=511422 2024-04-03T03:46:09.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.173+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=EXB4P3G3OF20 type=del size=904031 2024-04-03T03:46:09.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.177+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~G31BDB46YW3C.0 size=111492 2024-04-03T03:46:09.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.181+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=G31BDB46YW3C tag=PC2F19SG4T6Q type=write size=1160068 2024-04-03T03:46:09.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.185+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~PX0XAJPT36JW.0 size=1048576 2024-04-03T03:46:09.189 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.193+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~PX0XAJPT36JW.1 size=1048576 2024-04-03T03:46:09.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.193+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~PX0XAJPT36JW.2 size=405324 2024-04-03T03:46:09.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.193+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=PX0XAJPT36JW tag=H3C119JYCBR2 type=write size=3551052 2024-04-03T03:46:09.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.197+0000 7f55269288c0 1 < completed write operation key=KDSE2XB4D1XI tag=HHXDC9VNYZX7 type=write size=654715 2024-04-03T03:46:09.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.201+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=LJ6C316V3XAS type=write size=368579 2024-04-03T03:46:09.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.201+0000 7f55269288c0 1 < canceled operation key=0OSIL0R5ZJ54 tag=3IOIJZE9IJ4V type=write size=213506 2024-04-03T03:46:09.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.209+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~MKN9EQ5031UL.0 size=65013 2024-04-03T03:46:09.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.209+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=MKN9EQ5031UL tag=F12S2BJ47TRA type=write size=1113589 2024-04-03T03:46:09.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.209+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~LKO2YBUCL4FK.0 size=208607 2024-04-03T03:46:09.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.213+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=LKO2YBUCL4FK tag=24I86XFRVLYI type=write size=1257183 2024-04-03T03:46:09.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.221+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~UIRCYZZGMOZT.0 size=1039136 2024-04-03T03:46:09.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.221+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=UIRCYZZGMOZT tag=F6JB7LBJ1PHD type=write size=2087712 2024-04-03T03:46:09.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.221+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=GQR6EV1UXITM type=del 2024-04-03T03:46:09.222 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.225+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=IZF6M5XH9STS type=write size=333319 2024-04-03T03:46:09.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.229+0000 7f55269288c0 1 < canceled operation key=YCEKDT5EQD9D tag=5XGGI8EUXDUW type=del size=214519 2024-04-03T03:46:09.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.229+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=7SB1561302UU type=del size=2337993 2024-04-03T03:46:09.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.237+0000 7f55269288c0 1 < suggested remove operation key=D9OEPPT37WSJ tag=SNHILTA8AFWX type=del 2024-04-03T03:46:09.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.241+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~LYR17CAFUJDB.0 size=1048576 2024-04-03T03:46:09.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.241+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~LYR17CAFUJDB.1 size=1048576 2024-04-03T03:46:09.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.245+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~LYR17CAFUJDB.2 size=98968 2024-04-03T03:46:09.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.245+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=LYR17CAFUJDB tag=S65RMGC18VVQ type=write size=3244696 2024-04-03T03:46:09.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.249+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=VTZEKRYZBRXL type=del 2024-04-03T03:46:09.247 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.249+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=HLR9RSRE94K3 type=del size=4116991 2024-04-03T03:46:09.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.253+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~9EM265MM0JQM.0 size=832177 2024-04-03T03:46:09.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.257+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=9EM265MM0JQM tag=LQ0MYGBIGG6N type=write size=1880753 2024-04-03T03:46:09.257 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.261+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=LD54X359C6FX type=del size=1467161 2024-04-03T03:46:09.260 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.261+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~DB06RTOYW40H.0 size=714917 2024-04-03T03:46:09.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.269+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=DB06RTOYW40H tag=Q1B6XJLW00G9 type=write size=1763493 2024-04-03T03:46:09.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.273+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~426WPJIFPF1W.0 size=1048576 2024-04-03T03:46:09.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.273+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~426WPJIFPF1W.1 size=1048576 2024-04-03T03:46:09.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.277+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~426WPJIFPF1W.2 size=774326 2024-04-03T03:46:09.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.277+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=426WPJIFPF1W tag=E17CN9AXSLQ7 type=write size=3920054 2024-04-03T03:46:09.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.281+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=Q6O7G9HZY2HD type=del 2024-04-03T03:46:09.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.285+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~QZRZ8K9J7ZAY.0 size=1048576 2024-04-03T03:46:09.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.285+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~QZRZ8K9J7ZAY.1 size=754158 2024-04-03T03:46:09.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.285+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=QZRZ8K9J7ZAY tag=XC6CEIRI8IW5 type=write size=2851310 2024-04-03T03:46:09.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.289+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~OUBH42DKLJ9O.0 size=972731 2024-04-03T03:46:09.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.293+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=OUBH42DKLJ9O tag=HFS87F5NBHFE type=write size=2021307 2024-04-03T03:46:09.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.297+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~JXT0HY75QATP.0 size=1048576 2024-04-03T03:46:09.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.301+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~JXT0HY75QATP.1 size=1048576 2024-04-03T03:46:09.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.305+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~JXT0HY75QATP.2 size=23455 2024-04-03T03:46:09.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.305+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=JXT0HY75QATP tag=4J56WR31MSXB type=write size=3169183 2024-04-03T03:46:09.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.305+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=LZAAOG9HXA24 type=del 2024-04-03T03:46:09.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.313+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~SEI2D350QWHE.0 size=1048576 2024-04-03T03:46:09.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.313+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~SEI2D350QWHE.1 size=624297 2024-04-03T03:46:09.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.313+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=SEI2D350QWHE tag=EF5TA237ASWO type=write size=2721449 2024-04-03T03:46:09.315 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.317+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=4FBTHNI57A02 type=del 2024-04-03T03:46:09.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.321+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=KK2Y7G8YZVEA type=del size=2097673 2024-04-03T03:46:09.324 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.325+0000 7f55269288c0 1 < suggested update operation key=TXFMKXUGMEA8 tag=95JVIRBESMJQ type=del size=1812427 2024-04-03T03:46:09.327 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.329+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=E8P1T72PPDGD type=del size=3836347 2024-04-03T03:46:09.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.333+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=EXB4P3G3OF20 type=del 2024-04-03T03:46:09.334 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.337+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~B4I3DYLQ1PE2.0 size=600338 2024-04-03T03:46:09.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.337+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=B4I3DYLQ1PE2 tag=HE6NWPPS32W8 type=write size=1648914 2024-04-03T03:46:09.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.341+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~PX0XAJPT36JW.0 size=1048576 2024-04-03T03:46:09.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.341+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~PX0XAJPT36JW.1 size=1048576 2024-04-03T03:46:09.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.345+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~PX0XAJPT36JW.2 size=405324 2024-04-03T03:46:09.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.349+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=PX0XAJPT36JW tag=H3C119JYCBR2 type=write size=3551052 2024-04-03T03:46:09.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.353+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~WAMH83310EM2.0 size=1048576 2024-04-03T03:46:09.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.357+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~WAMH83310EM2.1 size=357264 2024-04-03T03:46:09.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.357+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=WAMH83310EM2 tag=ZVWQK60BI13K type=write size=2454416 2024-04-03T03:46:09.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.357+0000 7f55269288c0 1 < completed write operation key=MB7HTWATXRMB tag=LJ6C316V3XAS type=write size=368579 2024-04-03T03:46:09.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.361+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=KB9VM1HETCFX type=del size=3886247 2024-04-03T03:46:09.361 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.365+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~MKN9EQ5031UL.0 size=65013 2024-04-03T03:46:09.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.369+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=MKN9EQ5031UL tag=F12S2BJ47TRA type=write size=1113589 2024-04-03T03:46:09.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.369+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=N13BJ63WV50X type=write size=634428 2024-04-03T03:46:09.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.373+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~UIRCYZZGMOZT.0 size=1039136 2024-04-03T03:46:09.376 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.377+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=UIRCYZZGMOZT tag=F6JB7LBJ1PHD type=write size=2087712 2024-04-03T03:46:09.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.381+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=IWCIERYGWPON type=del size=1981720 2024-04-03T03:46:09.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.385+0000 7f55269288c0 1 < completed write operation key=8BMP0HIS520R tag=IZF6M5XH9STS type=write size=333319 2024-04-03T03:46:09.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.389+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=QC4ONIYP1MH5 type=del size=2694701 2024-04-03T03:46:09.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.389+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=7SB1561302UU type=del 2024-04-03T03:46:09.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.393+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=22X68DGLT0QI type=del size=3215158 2024-04-03T03:46:09.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.397+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~LYR17CAFUJDB.0 size=1048576 2024-04-03T03:46:09.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.401+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~LYR17CAFUJDB.1 size=1048576 2024-04-03T03:46:09.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.401+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~LYR17CAFUJDB.2 size=98968 2024-04-03T03:46:09.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.409+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=LYR17CAFUJDB tag=S65RMGC18VVQ type=write size=3244696 2024-04-03T03:46:09.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.409+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=VT8ZX0ZI0WA2 type=del size=326810 2024-04-03T03:46:09.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.413+0000 7f55269288c0 1 < canceled operation key=IOHMF3ADC6EU tag=HLR9RSRE94K3 type=del size=4116991 2024-04-03T03:46:09.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.417+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=0ZJH2R0NIIZK type=del size=1074039 2024-04-03T03:46:09.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.421+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=LD54X359C6FX type=del 2024-04-03T03:46:09.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.421+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=28QNV8TG9RB4 type=del size=788168 2024-04-03T03:46:09.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.421+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~426WPJIFPF1W.0 size=1048576 2024-04-03T03:46:09.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.421+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~426WPJIFPF1W.1 size=1048576 2024-04-03T03:46:09.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.421+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~426WPJIFPF1W.2 size=774326 2024-04-03T03:46:09.424 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.429+0000 7f55269288c0 1 < canceled multipart upload key=0OSIL0R5ZJ54 upload=426WPJIFPF1W tag=E17CN9AXSLQ7 type=write size=3920054 2024-04-03T03:46:09.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.429+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=O34XOGPVTX84 type=del size=2375597 2024-04-03T03:46:09.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.433+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~QZRZ8K9J7ZAY.0 size=1048576 2024-04-03T03:46:09.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.433+0000 7f55269288c0 1 < canceled part key=_multipart_7POFUQ9CX6B1.2~QZRZ8K9J7ZAY.1 size=754158 2024-04-03T03:46:09.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.437+0000 7f55269288c0 1 < canceled multipart upload key=7POFUQ9CX6B1 upload=QZRZ8K9J7ZAY tag=XC6CEIRI8IW5 type=write size=2851310 2024-04-03T03:46:09.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.441+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~UR2J3J5925Q7.0 size=1048576 2024-04-03T03:46:09.442 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.445+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~UR2J3J5925Q7.1 size=1048576 2024-04-03T03:46:09.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.449+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~UR2J3J5925Q7.2 size=136786 2024-04-03T03:46:09.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.449+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=UR2J3J5925Q7 tag=WX2Z8HT89IXF type=write size=3282514 2024-04-03T03:46:09.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.453+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~JXT0HY75QATP.0 size=1048576 2024-04-03T03:46:09.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.457+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~JXT0HY75QATP.1 size=1048576 2024-04-03T03:46:09.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.457+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~JXT0HY75QATP.2 size=23455 2024-04-03T03:46:09.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.461+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=JXT0HY75QATP tag=4J56WR31MSXB type=write size=3169183 2024-04-03T03:46:09.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.465+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=QERBADRUA8HE type=del size=2662382 2024-04-03T03:46:09.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.469+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~SEI2D350QWHE.0 size=1048576 2024-04-03T03:46:09.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.469+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~SEI2D350QWHE.1 size=624297 2024-04-03T03:46:09.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.473+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=SEI2D350QWHE tag=EF5TA237ASWO type=write size=2721449 2024-04-03T03:46:09.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.477+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=L92UDVIKUU0J type=write size=263434 2024-04-03T03:46:09.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.481+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=KK2Y7G8YZVEA type=del 2024-04-03T03:46:09.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.481+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=HJXQC0X586V0 type=del size=1938980 2024-04-03T03:46:09.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.485+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=E8P1T72PPDGD type=del 2024-04-03T03:46:09.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.489+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~QFE26WL62AUN.0 size=1048576 2024-04-03T03:46:09.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.493+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~QFE26WL62AUN.1 size=1048576 2024-04-03T03:46:09.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.493+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~QFE26WL62AUN.2 size=841112 2024-04-03T03:46:09.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.493+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=QFE26WL62AUN tag=VE1F3HNL9KX3 type=write size=3986840 2024-04-03T03:46:09.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.497+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~B4I3DYLQ1PE2.0 size=600338 2024-04-03T03:46:09.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.501+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=B4I3DYLQ1PE2 tag=HE6NWPPS32W8 type=write size=1648914 2024-04-03T03:46:09.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.505+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=DBWEFBTA3Z4B type=del size=3363944 2024-04-03T03:46:09.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.509+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~WAMH83310EM2.0 size=1048576 2024-04-03T03:46:09.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.509+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~WAMH83310EM2.1 size=357264 2024-04-03T03:46:09.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.517+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=WAMH83310EM2 tag=ZVWQK60BI13K type=write size=2454416 2024-04-03T03:46:09.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.521+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~DI7YFMP6UK8S.0 size=1048576 2024-04-03T03:46:09.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.521+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~DI7YFMP6UK8S.1 size=594870 2024-04-03T03:46:09.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.521+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=DI7YFMP6UK8S tag=YZ28W2KUER2H type=write size=2692022 2024-04-03T03:46:09.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.529+0000 7f55269288c0 1 < suggested update operation key=U62RSK21LJEF tag=KB9VM1HETCFX type=del size=3886247 2024-04-03T03:46:09.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.529+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=KA32Q9FFHIKC type=del size=971281 2024-04-03T03:46:09.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.533+0000 7f55269288c0 1 < completed write operation key=3XKXK1JXKOHU tag=N13BJ63WV50X type=write size=634428 2024-04-03T03:46:09.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.537+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=RKM6I9B0HASZ type=del size=4021777 2024-04-03T03:46:09.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.541+0000 7f55269288c0 1 < suggested update operation key=ZKSA09OSFSYN tag=IWCIERYGWPON type=del size=1981720 2024-04-03T03:46:09.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.545+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=122HA2MUMFS0 type=write size=869625 2024-04-03T03:46:09.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.549+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=QC4ONIYP1MH5 type=del 2024-04-03T03:46:09.548 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.549+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=1GIVPLSCOZNU type=del size=1361104 2024-04-03T03:46:09.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.553+0000 7f55269288c0 -1 < failed to complete operation key=U62RSK21LJEF tag=22X68DGLT0QI type=del size=3215158: (22) Invalid argument 2024-04-03T03:46:09.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.557+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=4BO6MFOOQVGN type=write size=640925 2024-04-03T03:46:09.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.561+0000 7f55269288c0 1 < suggested remove operation key=AXL5RVPSVDY5 tag=VT8ZX0ZI0WA2 type=del 2024-04-03T03:46:09.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.569+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~JZ0VYOQFN9FS.0 size=1048576 2024-04-03T03:46:09.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.569+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~JZ0VYOQFN9FS.1 size=368939 2024-04-03T03:46:09.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.569+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=JZ0VYOQFN9FS tag=B72X6G3BKC75 type=write size=2466091 2024-04-03T03:46:09.571 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.573+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=0ZJH2R0NIIZK type=del 2024-04-03T03:46:09.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.581+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~70Q0ASKMPT9U.0 size=1048576 2024-04-03T03:46:09.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.581+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~70Q0ASKMPT9U.1 size=62489 2024-04-03T03:46:09.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.581+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=70Q0ASKMPT9U tag=HXT5GG2KLHVL type=write size=2159641 2024-04-03T03:46:09.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.585+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=28QNV8TG9RB4 type=del 2024-04-03T03:46:09.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.589+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~UJHAKA08JI0X.0 size=1048576 2024-04-03T03:46:09.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.593+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~UJHAKA08JI0X.1 size=1048576 2024-04-03T03:46:09.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.597+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~UJHAKA08JI0X.2 size=317240 2024-04-03T03:46:09.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.597+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=UJHAKA08JI0X tag=JZE27EIHAXZ9 type=write size=3462968 2024-04-03T03:46:09.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.597+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=O34XOGPVTX84 type=del 2024-04-03T03:46:09.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.601+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=EF0MZ3WNWWHY type=del size=2749117 2024-04-03T03:46:09.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.605+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~UR2J3J5925Q7.0 size=1048576 2024-04-03T03:46:09.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.609+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~UR2J3J5925Q7.1 size=1048576 2024-04-03T03:46:09.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.609+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~UR2J3J5925Q7.2 size=136786 2024-04-03T03:46:09.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.617+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=UR2J3J5925Q7 tag=WX2Z8HT89IXF type=write size=3282514 2024-04-03T03:46:09.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.621+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~VLV99SN3DXM3.0 size=1048576 2024-04-03T03:46:09.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.621+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~VLV99SN3DXM3.1 size=1048576 2024-04-03T03:46:09.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.625+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~VLV99SN3DXM3.2 size=964771 2024-04-03T03:46:09.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.625+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=VLV99SN3DXM3 tag=6H77S8Z6GIK6 type=write size=4110499 2024-04-03T03:46:09.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.629+0000 7f55269288c0 1 < canceled operation key=8BMP0HIS520R tag=QERBADRUA8HE type=del size=2662382 2024-04-03T03:46:09.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.633+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~HVWDFCYRZLGG.0 size=1048576 2024-04-03T03:46:09.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.637+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~HVWDFCYRZLGG.1 size=728538 2024-04-03T03:46:09.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.637+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=HVWDFCYRZLGG tag=LJ80PU5QFRCF type=write size=2825690 2024-04-03T03:46:09.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.637+0000 7f55269288c0 1 < completed write operation key=K3Z9W19WEJBM tag=L92UDVIKUU0J type=write size=263434 2024-04-03T03:46:09.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.641+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=MTAL1FXHAJEV type=del size=3892033 2024-04-03T03:46:09.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.645+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=HJXQC0X586V0 type=del 2024-04-03T03:46:09.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.645+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=Q5LB8C9UH5O2 type=del size=366711 2024-04-03T03:46:09.647 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.649+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~QFE26WL62AUN.0 size=1048576 2024-04-03T03:46:09.650 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.653+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~QFE26WL62AUN.1 size=1048576 2024-04-03T03:46:09.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.657+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~QFE26WL62AUN.2 size=841112 2024-04-03T03:46:09.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.661+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=QFE26WL62AUN tag=VE1F3HNL9KX3 type=write size=3986840 2024-04-03T03:46:09.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.661+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=JQLWX4CWNF35 type=del size=1605694 2024-04-03T03:46:09.663 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.665+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=DBWEFBTA3Z4B type=del 2024-04-03T03:46:09.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.673+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~2SHZM43DHMAT.0 size=82952 2024-04-03T03:46:09.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.673+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=2SHZM43DHMAT tag=FFXHCXT4375J type=write size=1131528 2024-04-03T03:46:09.671 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.673+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~DI7YFMP6UK8S.0 size=1048576 2024-04-03T03:46:09.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.677+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~DI7YFMP6UK8S.1 size=594870 2024-04-03T03:46:09.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.681+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=DI7YFMP6UK8S tag=YZ28W2KUER2H type=write size=2692022 2024-04-03T03:46:09.683 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.685+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=5VECCFL3EGK2 type=del size=2640056 2024-04-03T03:46:09.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.689+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=KA32Q9FFHIKC type=del 2024-04-03T03:46:09.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.689+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=HG71A18O8CIR type=del size=3640141 2024-04-03T03:46:09.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.693+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=RKM6I9B0HASZ type=del 2024-04-03T03:46:09.697 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.701+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~WY0581UVSITL.0 size=860601 2024-04-03T03:46:09.697 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.701+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=WY0581UVSITL tag=HEIR8X5OHHYU type=write size=1909177 2024-04-03T03:46:09.700 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.701+0000 7f55269288c0 -1 < failed to complete operation key=AXL5RVPSVDY5 tag=122HA2MUMFS0 type=write size=869625: (22) Invalid argument 2024-04-03T03:46:09.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.709+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~04A0SYT4BE4A.0 size=1048576 2024-04-03T03:46:09.707 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.709+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~04A0SYT4BE4A.1 size=1048576 2024-04-03T03:46:09.709 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.713+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~04A0SYT4BE4A.2 size=504821 2024-04-03T03:46:09.710 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.713+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=04A0SYT4BE4A tag=6QSTLY0UGM55 type=write size=3650549 2024-04-03T03:46:09.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.713+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=1GIVPLSCOZNU type=del 2024-04-03T03:46:09.715 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.717+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=7NPY0J1S5W18 type=write size=1043998 2024-04-03T03:46:09.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.729+0000 7f55269288c0 1 < suggested remove operation key=D8W2ZKIZFI8H tag=4BO6MFOOQVGN type=write 2024-04-03T03:46:09.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.729+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=HFZKZ1O36629 type=del size=3875082 2024-04-03T03:46:09.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.733+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~JZ0VYOQFN9FS.0 size=1048576 2024-04-03T03:46:09.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.733+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~JZ0VYOQFN9FS.1 size=368939 2024-04-03T03:46:09.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.741+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=JZ0VYOQFN9FS tag=B72X6G3BKC75 type=write size=2466091 2024-04-03T03:46:09.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.745+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~B4KMBCVOM303.0 size=1048576 2024-04-03T03:46:09.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.745+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~B4KMBCVOM303.1 size=1048576 2024-04-03T03:46:09.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.749+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~B4KMBCVOM303.2 size=544781 2024-04-03T03:46:09.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.749+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=B4KMBCVOM303 tag=XRGPCHDX3SLT type=write size=3690509 2024-04-03T03:46:09.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.749+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~70Q0ASKMPT9U.0 size=1048576 2024-04-03T03:46:09.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.753+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~70Q0ASKMPT9U.1 size=62489 2024-04-03T03:46:09.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.757+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=70Q0ASKMPT9U tag=HXT5GG2KLHVL type=write size=2159641 2024-04-03T03:46:09.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.761+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=EAZK8XCT536N type=del size=923679 2024-04-03T03:46:09.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.761+0000 7f55269288c0 1 < canceled part key=_multipart_MLTDNCZ4E5D8.2~UJHAKA08JI0X.0 size=1048576 2024-04-03T03:46:09.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.761+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~UJHAKA08JI0X.1 size=1048576 2024-04-03T03:46:09.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.765+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~UJHAKA08JI0X.2 size=317240 2024-04-03T03:46:09.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.769+0000 7f55269288c0 1 < canceled multipart upload key=MLTDNCZ4E5D8 upload=UJHAKA08JI0X tag=JZE27EIHAXZ9 type=write size=3462968 2024-04-03T03:46:09.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.773+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=PUYS6SRW8JB1 type=del size=3743243 2024-04-03T03:46:09.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.777+0000 7f55269288c0 1 < suggested remove operation key=6KH6TASZS3UG tag=EF0MZ3WNWWHY type=del 2024-04-03T03:46:09.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.777+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=DOWU3V6M519X type=del size=2755235 2024-04-03T03:46:09.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.781+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~VLV99SN3DXM3.0 size=1048576 2024-04-03T03:46:09.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.785+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~VLV99SN3DXM3.1 size=1048576 2024-04-03T03:46:09.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.785+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~VLV99SN3DXM3.2 size=964771 2024-04-03T03:46:09.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.789+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=VLV99SN3DXM3 tag=6H77S8Z6GIK6 type=write size=4110499 2024-04-03T03:46:09.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.793+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=OTOJH9WW3AMM type=write size=924022 2024-04-03T03:46:09.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.797+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~HVWDFCYRZLGG.0 size=1048576 2024-04-03T03:46:09.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.797+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~HVWDFCYRZLGG.1 size=728538 2024-04-03T03:46:09.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.801+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=HVWDFCYRZLGG tag=LJ80PU5QFRCF type=write size=2825690 2024-04-03T03:46:09.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.809+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~KTC1T3UERHCW.0 size=57752 2024-04-03T03:46:09.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.809+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=KTC1T3UERHCW tag=ZRPX82RUKN8E type=write size=1106328 2024-04-03T03:46:09.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.809+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=MTAL1FXHAJEV type=del 2024-04-03T03:46:09.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.813+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=28IOSJJ4DYGX type=del size=2631557 2024-04-03T03:46:09.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.817+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=Q5LB8C9UH5O2 type=del 2024-04-03T03:46:09.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.821+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~S2A9QEQLU3FA.0 size=1048576 2024-04-03T03:46:09.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.821+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~S2A9QEQLU3FA.1 size=1048576 2024-04-03T03:46:09.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.825+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~S2A9QEQLU3FA.2 size=761515 2024-04-03T03:46:09.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.825+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=S2A9QEQLU3FA tag=ES8QNW667SY4 type=write size=3907243 2024-04-03T03:46:09.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.825+0000 7f55269288c0 -1 < no bi entry to suggest for operation key=D8W2ZKIZFI8H tag=JQLWX4CWNF35 type=del size=1605694: (2) No such file or directory 2024-04-03T03:46:09.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.829+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~YCN9VIE2TXUK.0 size=1048576 2024-04-03T03:46:09.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.833+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~YCN9VIE2TXUK.1 size=1048576 2024-04-03T03:46:09.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.833+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~YCN9VIE2TXUK.2 size=122070 2024-04-03T03:46:09.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.833+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=YCN9VIE2TXUK tag=OQNX8VPM27LT type=write size=3267798 2024-04-03T03:46:09.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.837+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~2SHZM43DHMAT.0 size=82952 2024-04-03T03:46:09.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.845+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=2SHZM43DHMAT tag=FFXHCXT4375J type=write size=1131528 2024-04-03T03:46:09.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.845+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=V4OZC9W4TG0E type=del size=3189418 2024-04-03T03:46:09.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.849+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=5VECCFL3EGK2 type=del 2024-04-03T03:46:09.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.853+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~Y7CU1A907WZW.0 size=1048576 2024-04-03T03:46:09.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.857+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~Y7CU1A907WZW.1 size=448603 2024-04-03T03:46:09.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.857+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=Y7CU1A907WZW tag=RH12GD0OPQ1W type=write size=2545755 2024-04-03T03:46:09.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.861+0000 7f55269288c0 1 < suggested update operation key=K7A1O21ZURWQ tag=HG71A18O8CIR type=del size=3640141 2024-04-03T03:46:09.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.865+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~QEM5AFOBF56P.0 size=1048576 2024-04-03T03:46:09.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.869+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~QEM5AFOBF56P.1 size=1048576 2024-04-03T03:46:09.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.869+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~QEM5AFOBF56P.2 size=18622 2024-04-03T03:46:09.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.869+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=QEM5AFOBF56P tag=N9F7LM13JIZ6 type=write size=3164350 2024-04-03T03:46:09.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.873+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~WY0581UVSITL.0 size=860601 2024-04-03T03:46:09.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.877+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=WY0581UVSITL tag=HEIR8X5OHHYU type=write size=1909177 2024-04-03T03:46:09.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.881+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~AI617V3BVWFA.0 size=1048576 2024-04-03T03:46:09.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.885+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~AI617V3BVWFA.1 size=1048576 2024-04-03T03:46:09.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.885+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~AI617V3BVWFA.2 size=469312 2024-04-03T03:46:09.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.885+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=AI617V3BVWFA tag=ELO8QXRBQBH0 type=write size=3615040 2024-04-03T03:46:09.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.889+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~04A0SYT4BE4A.0 size=1048576 2024-04-03T03:46:09.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.893+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~04A0SYT4BE4A.1 size=1048576 2024-04-03T03:46:09.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.893+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~04A0SYT4BE4A.2 size=504821 2024-04-03T03:46:09.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.897+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=04A0SYT4BE4A tag=6QSTLY0UGM55 type=write size=3650549 2024-04-03T03:46:09.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.901+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=0CQFQ3A0EBXL type=del size=2017312 2024-04-03T03:46:09.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.901+0000 7f55269288c0 -1 < failed to complete operation key=6KH6TASZS3UG tag=7NPY0J1S5W18 type=write size=1043998: (22) Invalid argument 2024-04-03T03:46:09.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.909+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~2PORF5WZL5D3.0 size=1048576 2024-04-03T03:46:09.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.909+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~2PORF5WZL5D3.1 size=1048576 2024-04-03T03:46:09.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.913+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~2PORF5WZL5D3.2 size=132716 2024-04-03T03:46:09.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.913+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=2PORF5WZL5D3 tag=Q4AEQ9PKPX6L type=write size=3278444 2024-04-03T03:46:09.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.913+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=HFZKZ1O36629 type=del 2024-04-03T03:46:09.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.921+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~1RZCGKEIXS8D.0 size=634796 2024-04-03T03:46:09.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.921+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=1RZCGKEIXS8D tag=1G6A55OIJ0S2 type=write size=1683372 2024-04-03T03:46:09.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.921+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~B4KMBCVOM303.0 size=1048576 2024-04-03T03:46:09.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.925+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~B4KMBCVOM303.1 size=1048576 2024-04-03T03:46:09.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.925+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~B4KMBCVOM303.2 size=544781 2024-04-03T03:46:09.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.929+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=B4KMBCVOM303 tag=XRGPCHDX3SLT type=write size=3690509 2024-04-03T03:46:09.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.933+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=NPOGSWVLFNRE type=del size=828332 2024-04-03T03:46:09.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.937+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=EAZK8XCT536N type=del 2024-04-03T03:46:09.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.941+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~0T0OUXU9I0FZ.0 size=1048576 2024-04-03T03:46:09.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.945+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~0T0OUXU9I0FZ.1 size=1048576 2024-04-03T03:46:09.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.949+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~0T0OUXU9I0FZ.2 size=61822 2024-04-03T03:46:09.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.949+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=0T0OUXU9I0FZ tag=1T6W3JRR7HRW type=write size=3207550 2024-04-03T03:46:09.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.953+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=PUYS6SRW8JB1 type=del 2024-04-03T03:46:09.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.957+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=A45UCA5DXHB5 type=write size=967014 2024-04-03T03:46:09.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.957+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=DOWU3V6M519X type=del 2024-04-03T03:46:09.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.961+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=IW4ZCCYPE1M6 type=write size=881752 2024-04-03T03:46:09.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.965+0000 7f55269288c0 1 < completed write operation key=YCEKDT5EQD9D tag=OTOJH9WW3AMM type=write size=924022 2024-04-03T03:46:09.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.969+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~8MAN9N1HB02E.0 size=1048576 2024-04-03T03:46:09.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.977+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~8MAN9N1HB02E.1 size=1048576 2024-04-03T03:46:09.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.977+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~8MAN9N1HB02E.2 size=499016 2024-04-03T03:46:09.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.977+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=8MAN9N1HB02E tag=ZII3DL6E30F1 type=write size=3644744 2024-04-03T03:46:09.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.981+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~KTC1T3UERHCW.0 size=57752 2024-04-03T03:46:09.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.985+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=KTC1T3UERHCW tag=ZRPX82RUKN8E type=write size=1106328 2024-04-03T03:46:09.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.989+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=60PQ84AOBWI0 type=del size=3986499 2024-04-03T03:46:09.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.993+0000 7f55269288c0 1 < suggested update operation key=7POFUQ9CX6B1 tag=28IOSJJ4DYGX type=del size=2631557 2024-04-03T03:46:09.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:09.997+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=Y2T86I0XVTMJ type=del size=1265325 2024-04-03T03:46:09.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.001+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~S2A9QEQLU3FA.0 size=1048576 2024-04-03T03:46:10.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.005+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~S2A9QEQLU3FA.1 size=1048576 2024-04-03T03:46:10.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.005+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~S2A9QEQLU3FA.2 size=761515 2024-04-03T03:46:10.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.009+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=S2A9QEQLU3FA tag=ES8QNW667SY4 type=write size=3907243 2024-04-03T03:46:10.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.013+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=3CIUC9ZG5LDG type=del size=1894124 2024-04-03T03:46:10.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.017+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~YCN9VIE2TXUK.0 size=1048576 2024-04-03T03:46:10.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.017+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~YCN9VIE2TXUK.1 size=1048576 2024-04-03T03:46:10.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.021+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~YCN9VIE2TXUK.2 size=122070 2024-04-03T03:46:10.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.025+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=YCN9VIE2TXUK tag=OQNX8VPM27LT type=write size=3267798 2024-04-03T03:46:10.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.029+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~KM99SMH5P332.0 size=1048576 2024-04-03T03:46:10.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.033+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~KM99SMH5P332.1 size=1048576 2024-04-03T03:46:10.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.033+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~KM99SMH5P332.2 size=593873 2024-04-03T03:46:10.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.033+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=KM99SMH5P332 tag=9TBRMOCO7R39 type=write size=3739601 2024-04-03T03:46:10.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.037+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=V4OZC9W4TG0E type=del 2024-04-03T03:46:10.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.041+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~CPSLHNP1FOSV.0 size=719712 2024-04-03T03:46:10.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.041+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=CPSLHNP1FOSV tag=9LFEW2Y3TJYF type=write size=1768288 2024-04-03T03:46:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.045+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~Y7CU1A907WZW.0 size=1048576 2024-04-03T03:46:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.045+0000 7f55269288c0 1 < canceled part key=_multipart_YCEKDT5EQD9D.2~Y7CU1A907WZW.1 size=448603 2024-04-03T03:46:10.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.049+0000 7f55269288c0 1 < canceled multipart upload key=YCEKDT5EQD9D upload=Y7CU1A907WZW tag=RH12GD0OPQ1W type=write size=2545755 2024-04-03T03:46:10.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.053+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=PXNO6S4EM98J type=write size=866697 2024-04-03T03:46:10.052 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.053+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~QEM5AFOBF56P.0 size=1048576 2024-04-03T03:46:10.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.057+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~QEM5AFOBF56P.1 size=1048576 2024-04-03T03:46:10.057 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.061+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~QEM5AFOBF56P.2 size=18622 2024-04-03T03:46:10.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.065+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=QEM5AFOBF56P tag=N9F7LM13JIZ6 type=write size=3164350 2024-04-03T03:46:10.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.065+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=5IMP7YNK07SU type=del size=354083 2024-04-03T03:46:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.069+0000 7f55269288c0 1 < canceled part key=_multipart_K3Z9W19WEJBM.2~AI617V3BVWFA.0 size=1048576 2024-04-03T03:46:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.069+0000 7f55269288c0 1 < canceled part key=_multipart_K3Z9W19WEJBM.2~AI617V3BVWFA.1 size=1048576 2024-04-03T03:46:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.069+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~AI617V3BVWFA.2 size=469312 2024-04-03T03:46:10.072 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.073+0000 7f55269288c0 1 < canceled multipart upload key=K3Z9W19WEJBM upload=AI617V3BVWFA tag=ELO8QXRBQBH0 type=write size=3615040 2024-04-03T03:46:10.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.081+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~VCNVGTZ6BGH3.0 size=482127 2024-04-03T03:46:10.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.081+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=VCNVGTZ6BGH3 tag=SWG39TFFMEY1 type=write size=1530703 2024-04-03T03:46:10.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.081+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=0CQFQ3A0EBXL type=del 2024-04-03T03:46:10.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.089+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~6L5KJR0WEQVP.0 size=887271 2024-04-03T03:46:10.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.089+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=6L5KJR0WEQVP tag=9W6USC6J5XWX type=write size=1935847 2024-04-03T03:46:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.089+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~2PORF5WZL5D3.0 size=1048576 2024-04-03T03:46:10.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.093+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~2PORF5WZL5D3.1 size=1048576 2024-04-03T03:46:10.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.097+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~2PORF5WZL5D3.2 size=132716 2024-04-03T03:46:10.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.101+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=2PORF5WZL5D3 tag=Q4AEQ9PKPX6L type=write size=3278444 2024-04-03T03:46:10.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.105+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~6XSRE36OI3QV.0 size=1048576 2024-04-03T03:46:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.105+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~6XSRE36OI3QV.1 size=1048576 2024-04-03T03:46:10.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.109+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~6XSRE36OI3QV.2 size=984988 2024-04-03T03:46:10.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.109+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=6XSRE36OI3QV tag=D9V5R7PUC497 type=write size=4130716 2024-04-03T03:46:10.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.113+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~1RZCGKEIXS8D.0 size=634796 2024-04-03T03:46:10.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.117+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=1RZCGKEIXS8D tag=1G6A55OIJ0S2 type=write size=1683372 2024-04-03T03:46:10.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.121+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~UVDXBREJDKI9.0 size=1048576 2024-04-03T03:46:10.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.125+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~UVDXBREJDKI9.1 size=607017 2024-04-03T03:46:10.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.125+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=UVDXBREJDKI9 tag=LV5D774XCP07 type=write size=2704169 2024-04-03T03:46:10.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.129+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=NPOGSWVLFNRE type=del 2024-04-03T03:46:10.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.133+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~P74UFHDHGMY1.0 size=1048576 2024-04-03T03:46:10.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.133+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~P74UFHDHGMY1.1 size=869589 2024-04-03T03:46:10.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.133+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=P74UFHDHGMY1 tag=IRTZ4YZJGY3G type=write size=2966741 2024-04-03T03:46:10.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.137+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~0T0OUXU9I0FZ.0 size=1048576 2024-04-03T03:46:10.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.141+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~0T0OUXU9I0FZ.1 size=1048576 2024-04-03T03:46:10.140 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.141+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~0T0OUXU9I0FZ.2 size=61822 2024-04-03T03:46:10.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.149+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=0T0OUXU9I0FZ tag=1T6W3JRR7HRW type=write size=3207550 2024-04-03T03:46:10.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.149+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=HKDX72IXSBS5 type=del size=625441 2024-04-03T03:46:10.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.153+0000 7f55269288c0 1 < completed write operation key=K7A1O21ZURWQ tag=A45UCA5DXHB5 type=write size=967014 2024-04-03T03:46:10.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.157+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~WV40N5XBEL6Q.0 size=328446 2024-04-03T03:46:10.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.157+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=WV40N5XBEL6Q tag=KP9BG37LASFI type=write size=1377022 2024-04-03T03:46:10.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.161+0000 7f55269288c0 1 < canceled operation key=SFN1M3HPGT18 tag=IW4ZCCYPE1M6 type=write size=881752 2024-04-03T03:46:10.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.165+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=1X3XOYB8PRWE type=del size=2129197 2024-04-03T03:46:10.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.165+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~8MAN9N1HB02E.0 size=1048576 2024-04-03T03:46:10.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.169+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~8MAN9N1HB02E.1 size=1048576 2024-04-03T03:46:10.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.173+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~8MAN9N1HB02E.2 size=499016 2024-04-03T03:46:10.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.177+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=8MAN9N1HB02E tag=ZII3DL6E30F1 type=write size=3644744 2024-04-03T03:46:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.181+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=C4A3VBL5SLR5 type=del size=3312410 2024-04-03T03:46:10.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.185+0000 7f55269288c0 1 < suggested remove operation key=SFN1M3HPGT18 tag=60PQ84AOBWI0 type=del 2024-04-03T03:46:10.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.193+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~GFWWZOAPRBQF.0 size=37485 2024-04-03T03:46:10.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.193+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=GFWWZOAPRBQF tag=1FR2ZKN3IPUL type=write size=1086061 2024-04-03T03:46:10.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.197+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=Y2T86I0XVTMJ type=del 2024-04-03T03:46:10.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.201+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~7T7PZX4GBGTL.0 size=1048576 2024-04-03T03:46:10.201 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.205+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~7T7PZX4GBGTL.1 size=1048576 2024-04-03T03:46:10.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.205+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~7T7PZX4GBGTL.2 size=142961 2024-04-03T03:46:10.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.205+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=7T7PZX4GBGTL tag=B2UF5GPM8YY6 type=write size=3288689 2024-04-03T03:46:10.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.209+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=3CIUC9ZG5LDG type=del 2024-04-03T03:46:10.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.209+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=T5SFKXIXTI1I type=write size=534969 2024-04-03T03:46:10.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.213+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~KM99SMH5P332.0 size=1048576 2024-04-03T03:46:10.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.217+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~KM99SMH5P332.1 size=1048576 2024-04-03T03:46:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.217+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~KM99SMH5P332.2 size=593873 2024-04-03T03:46:10.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.221+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=KM99SMH5P332 tag=9TBRMOCO7R39 type=write size=3739601 2024-04-03T03:46:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.225+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=LL8HM7HXJ1QA type=del size=262003 2024-04-03T03:46:10.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.229+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~CPSLHNP1FOSV.0 size=719712 2024-04-03T03:46:10.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.237+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=CPSLHNP1FOSV tag=9LFEW2Y3TJYF type=write size=1768288 2024-04-03T03:46:10.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.241+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~3RXC5T490GT9.0 size=1048576 2024-04-03T03:46:10.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.245+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~3RXC5T490GT9.1 size=857541 2024-04-03T03:46:10.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.245+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=3RXC5T490GT9 tag=ZCVOEXUBM0MO type=write size=2954693 2024-04-03T03:46:10.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.249+0000 7f55269288c0 1 < completed write operation key=3XKXK1JXKOHU tag=PXNO6S4EM98J type=write size=866697 2024-04-03T03:46:10.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.253+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=KMCGI6Y29MT1 type=del size=472835 2024-04-03T03:46:10.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.253+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=5IMP7YNK07SU type=del 2024-04-03T03:46:10.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.261+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~X1JHA0ELKP73.0 size=1048576 2024-04-03T03:46:10.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.265+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~X1JHA0ELKP73.1 size=639153 2024-04-03T03:46:10.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.265+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=X1JHA0ELKP73 tag=VIB4R5HNZXCQ type=write size=2736305 2024-04-03T03:46:10.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.269+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~VCNVGTZ6BGH3.0 size=482127 2024-04-03T03:46:10.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.273+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=VCNVGTZ6BGH3 tag=SWG39TFFMEY1 type=write size=1530703 2024-04-03T03:46:10.273 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.277+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=0MM7UPLUXIUI type=write size=369072 2024-04-03T03:46:10.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.277+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~6L5KJR0WEQVP.0 size=887271 2024-04-03T03:46:10.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.281+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=6L5KJR0WEQVP tag=9W6USC6J5XWX type=write size=1935847 2024-04-03T03:46:10.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.285+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=PPX0CZDCOGLI type=del size=2715850 2024-04-03T03:46:10.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.289+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~6XSRE36OI3QV.0 size=1048576 2024-04-03T03:46:10.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.289+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~6XSRE36OI3QV.1 size=1048576 2024-04-03T03:46:10.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.293+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~6XSRE36OI3QV.2 size=984988 2024-04-03T03:46:10.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.297+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=6XSRE36OI3QV tag=D9V5R7PUC497 type=write size=4130716 2024-04-03T03:46:10.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.301+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=IQJ5XNMCCJPG type=del size=855337 2024-04-03T03:46:10.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.305+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~UVDXBREJDKI9.0 size=1048576 2024-04-03T03:46:10.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.305+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~UVDXBREJDKI9.1 size=607017 2024-04-03T03:46:10.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.313+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=UVDXBREJDKI9 tag=LV5D774XCP07 type=write size=2704169 2024-04-03T03:46:10.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.317+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~1B651HB9SO3U.0 size=1048576 2024-04-03T03:46:10.316 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.321+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~1B651HB9SO3U.1 size=1048576 2024-04-03T03:46:10.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.321+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~1B651HB9SO3U.2 size=418741 2024-04-03T03:46:10.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.321+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=1B651HB9SO3U tag=AURIY2F7OA1L type=write size=3564469 2024-04-03T03:46:10.322 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.325+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~P74UFHDHGMY1.0 size=1048576 2024-04-03T03:46:10.325 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.329+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~P74UFHDHGMY1.1 size=869589 2024-04-03T03:46:10.330 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.333+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=P74UFHDHGMY1 tag=IRTZ4YZJGY3G type=write size=2966741 2024-04-03T03:46:10.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.337+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~9S9ECRA1BUF2.0 size=1048576 2024-04-03T03:46:10.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.341+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~9S9ECRA1BUF2.1 size=1048576 2024-04-03T03:46:10.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.341+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~9S9ECRA1BUF2.2 size=103973 2024-04-03T03:46:10.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.341+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=9S9ECRA1BUF2 tag=TGUJVEKHXYH3 type=write size=3249701 2024-04-03T03:46:10.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.345+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=HKDX72IXSBS5 type=del 2024-04-03T03:46:10.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.349+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=9H2FR602URXL type=del size=3699274 2024-04-03T03:46:10.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.353+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~WV40N5XBEL6Q.0 size=328446 2024-04-03T03:46:10.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.357+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=WV40N5XBEL6Q tag=KP9BG37LASFI type=write size=1377022 2024-04-03T03:46:10.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.361+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=TRU1LWOIM7LV type=write size=106352 2024-04-03T03:46:10.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.361+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=1X3XOYB8PRWE type=del 2024-04-03T03:46:10.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.365+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=7UHJV5Q1N4SI type=del size=2625164 2024-04-03T03:46:10.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.369+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=C4A3VBL5SLR5 type=del 2024-04-03T03:46:10.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.373+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~Q7UGWHM2XP5I.0 size=1048576 2024-04-03T03:46:10.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.377+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~Q7UGWHM2XP5I.1 size=1048576 2024-04-03T03:46:10.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.377+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~Q7UGWHM2XP5I.2 size=815331 2024-04-03T03:46:10.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.377+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=Q7UGWHM2XP5I tag=99M15L4CLBV4 type=write size=3961059 2024-04-03T03:46:10.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.381+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~GFWWZOAPRBQF.0 size=37485 2024-04-03T03:46:10.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.385+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=GFWWZOAPRBQF tag=1FR2ZKN3IPUL type=write size=1086061 2024-04-03T03:46:10.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.389+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=IWFE2RSYFUZ4 type=del size=1352546 2024-04-03T03:46:10.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.389+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~7T7PZX4GBGTL.0 size=1048576 2024-04-03T03:46:10.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.393+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~7T7PZX4GBGTL.1 size=1048576 2024-04-03T03:46:10.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.393+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~7T7PZX4GBGTL.2 size=142961 2024-04-03T03:46:10.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.401+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=7T7PZX4GBGTL tag=B2UF5GPM8YY6 type=write size=3288689 2024-04-03T03:46:10.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.405+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~0LUPBEP24G2O.0 size=1048576 2024-04-03T03:46:10.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.409+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~0LUPBEP24G2O.1 size=1048576 2024-04-03T03:46:10.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.409+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~0LUPBEP24G2O.2 size=712470 2024-04-03T03:46:10.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.409+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=0LUPBEP24G2O tag=264LB9LIHDH4 type=write size=3858198 2024-04-03T03:46:10.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.413+0000 7f55269288c0 1 < completed write operation key=8SBTVHL09P63 tag=T5SFKXIXTI1I type=write size=534969 2024-04-03T03:46:10.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.417+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=N7F82UDDQD3E type=del size=344391 2024-04-03T03:46:10.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.417+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=LL8HM7HXJ1QA type=del 2024-04-03T03:46:10.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.421+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=MWBBDOZPPLQK type=del size=3646807 2024-04-03T03:46:10.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.425+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~3RXC5T490GT9.0 size=1048576 2024-04-03T03:46:10.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.425+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~3RXC5T490GT9.1 size=857541 2024-04-03T03:46:10.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.433+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=3RXC5T490GT9 tag=ZCVOEXUBM0MO type=write size=2954693 2024-04-03T03:46:10.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.437+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~RX7LV0AQ0RLR.0 size=720088 2024-04-03T03:46:10.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.437+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=RX7LV0AQ0RLR tag=AQ3ANVXTJFYC type=write size=1768664 2024-04-03T03:46:10.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.441+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=KMCGI6Y29MT1 type=del 2024-04-03T03:46:10.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.441+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=JU59QM0O7DLD type=del size=3004026 2024-04-03T03:46:10.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.445+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~X1JHA0ELKP73.0 size=1048576 2024-04-03T03:46:10.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.445+0000 7f55269288c0 1 < canceled part key=_multipart_KDSE2XB4D1XI.2~X1JHA0ELKP73.1 size=639153 2024-04-03T03:46:10.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.453+0000 7f55269288c0 1 < canceled multipart upload key=KDSE2XB4D1XI upload=X1JHA0ELKP73 tag=VIB4R5HNZXCQ type=write size=2736305 2024-04-03T03:46:10.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.453+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=XY7Y8GRYH3GC type=del size=1341243 2024-04-03T03:46:10.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.457+0000 7f55269288c0 1 < completed write operation key=8SBTVHL09P63 tag=0MM7UPLUXIUI type=write size=369072 2024-04-03T03:46:10.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.461+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=OLTFY96KCHG6 type=write size=542201 2024-04-03T03:46:10.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.465+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=PPX0CZDCOGLI type=del 2024-04-03T03:46:10.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.469+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~ITLO164VR2IB.0 size=1048576 2024-04-03T03:46:10.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.473+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~ITLO164VR2IB.1 size=1048576 2024-04-03T03:46:10.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.477+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~ITLO164VR2IB.2 size=467836 2024-04-03T03:46:10.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.477+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=ITLO164VR2IB tag=0CCWHV2K51OW type=write size=3613564 2024-04-03T03:46:10.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.477+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=IQJ5XNMCCJPG type=del 2024-04-03T03:46:10.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.485+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~GDQAJ7RZ5Q79.0 size=1048576 2024-04-03T03:46:10.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.489+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~GDQAJ7RZ5Q79.1 size=744208 2024-04-03T03:46:10.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.489+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=GDQAJ7RZ5Q79 tag=83H3WJQBHGO3 type=write size=2841360 2024-04-03T03:46:10.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.489+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~1B651HB9SO3U.0 size=1048576 2024-04-03T03:46:10.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.493+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~1B651HB9SO3U.1 size=1048576 2024-04-03T03:46:10.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.497+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~1B651HB9SO3U.2 size=418741 2024-04-03T03:46:10.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.501+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=1B651HB9SO3U tag=AURIY2F7OA1L type=write size=3564469 2024-04-03T03:46:10.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.505+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=972C3EAQUGHS type=del size=1894000 2024-04-03T03:46:10.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.509+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~9S9ECRA1BUF2.0 size=1048576 2024-04-03T03:46:10.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.509+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~9S9ECRA1BUF2.1 size=1048576 2024-04-03T03:46:10.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.517+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~9S9ECRA1BUF2.2 size=103973 2024-04-03T03:46:10.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.521+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=9S9ECRA1BUF2 tag=TGUJVEKHXYH3 type=write size=3249701 2024-04-03T03:46:10.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.525+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=ZSY9PX5IBLMH type=del size=3873463 2024-04-03T03:46:10.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.529+0000 7f55269288c0 1 < canceled operation key=7POFUQ9CX6B1 tag=9H2FR602URXL type=del size=3699274 2024-04-03T03:46:10.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.533+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=U6CJ79H15H5R type=del size=1325061 2024-04-03T03:46:10.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.537+0000 7f55269288c0 1 < suggested remove operation key=KU1R0YLDP1V3 tag=TRU1LWOIM7LV type=write 2024-04-03T03:46:10.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.541+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=SIM26P6ZAIHU type=del size=4142261 2024-04-03T03:46:10.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.545+0000 7f55269288c0 1 < canceled operation key=7POFUQ9CX6B1 tag=7UHJV5Q1N4SI type=del size=2625164 2024-04-03T03:46:10.548 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.549+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~8CU9JU9QXCWK.0 size=404575 2024-04-03T03:46:10.548 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.549+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=8CU9JU9QXCWK tag=9DDU40KIQVFD type=write size=1453151 2024-04-03T03:46:10.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.553+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~Q7UGWHM2XP5I.0 size=1048576 2024-04-03T03:46:10.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.553+0000 7f55269288c0 1 < canceled part key=_multipart_KDSE2XB4D1XI.2~Q7UGWHM2XP5I.1 size=1048576 2024-04-03T03:46:10.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.557+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~Q7UGWHM2XP5I.2 size=815331 2024-04-03T03:46:10.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.561+0000 7f55269288c0 1 < canceled multipart upload key=KDSE2XB4D1XI upload=Q7UGWHM2XP5I tag=99M15L4CLBV4 type=write size=3961059 2024-04-03T03:46:10.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.565+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=670SSXGUYJAP type=del size=2134753 2024-04-03T03:46:10.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.569+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=IWFE2RSYFUZ4 type=del 2024-04-03T03:46:10.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.569+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=5NUOY8VIZLRC type=del size=1276013 2024-04-03T03:46:10.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.573+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~0LUPBEP24G2O.0 size=1048576 2024-04-03T03:46:10.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.573+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~0LUPBEP24G2O.1 size=1048576 2024-04-03T03:46:10.573 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.577+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~0LUPBEP24G2O.2 size=712470 2024-04-03T03:46:10.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.581+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=0LUPBEP24G2O tag=264LB9LIHDH4 type=write size=3858198 2024-04-03T03:46:10.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.585+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=K949M6EM8GJH type=write size=471823 2024-04-03T03:46:10.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.589+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=N7F82UDDQD3E type=del 2024-04-03T03:46:10.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.593+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~F0DNE2BV7MRE.0 size=1048576 2024-04-03T03:46:10.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.597+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~F0DNE2BV7MRE.1 size=20482 2024-04-03T03:46:10.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.597+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=F0DNE2BV7MRE tag=MQ8J1GLOZN9Q type=write size=2117634 2024-04-03T03:46:10.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.597+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=MWBBDOZPPLQK type=del 2024-04-03T03:46:10.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.601+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=THVOYB2UHAXJ type=del size=3047704 2024-04-03T03:46:10.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.605+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~RX7LV0AQ0RLR.0 size=720088 2024-04-03T03:46:10.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.609+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=RX7LV0AQ0RLR tag=AQ3ANVXTJFYC type=write size=1768664 2024-04-03T03:46:10.610 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.613+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=NZRX5CYZHMFM type=del size=3215115 2024-04-03T03:46:10.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.617+0000 7f55269288c0 1 < suggested update operation key=JAXVD60NI5YW tag=JU59QM0O7DLD type=del size=3004026 2024-04-03T03:46:10.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.621+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=0YBPCAK8QOWG type=del size=3952488 2024-04-03T03:46:10.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.625+0000 7f55269288c0 1 < canceled operation key=TW860A14J9RC tag=XY7Y8GRYH3GC type=del size=1341243 2024-04-03T03:46:10.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.633+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~OC1PCH7J1GDR.0 size=1048576 2024-04-03T03:46:10.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.633+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~OC1PCH7J1GDR.1 size=438214 2024-04-03T03:46:10.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.633+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=OC1PCH7J1GDR tag=77CYTQF1F32L type=write size=2535366 2024-04-03T03:46:10.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.637+0000 7f55269288c0 1 < completed write operation key=K3Z9W19WEJBM tag=OLTFY96KCHG6 type=write size=542201 2024-04-03T03:46:10.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.641+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~0KIVN3QGDV95.0 size=1048576 2024-04-03T03:46:10.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.645+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~0KIVN3QGDV95.1 size=182246 2024-04-03T03:46:10.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.645+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=0KIVN3QGDV95 tag=68JKIQALN8DL type=write size=2279398 2024-04-03T03:46:10.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.649+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~ITLO164VR2IB.0 size=1048576 2024-04-03T03:46:10.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.653+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~ITLO164VR2IB.1 size=1048576 2024-04-03T03:46:10.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.653+0000 7f55269288c0 1 < canceled part key=_multipart_YCEKDT5EQD9D.2~ITLO164VR2IB.2 size=467836 2024-04-03T03:46:10.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.657+0000 7f55269288c0 1 < canceled multipart upload key=YCEKDT5EQD9D upload=ITLO164VR2IB tag=0CCWHV2K51OW type=write size=3613564 2024-04-03T03:46:10.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.661+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=TNLQ8M7DUJ4C type=del size=1082911 2024-04-03T03:46:10.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.661+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~GDQAJ7RZ5Q79.0 size=1048576 2024-04-03T03:46:10.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.665+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~GDQAJ7RZ5Q79.1 size=744208 2024-04-03T03:46:10.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.669+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=GDQAJ7RZ5Q79 tag=83H3WJQBHGO3 type=write size=2841360 2024-04-03T03:46:10.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.673+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=T4HCDVSS26WO type=write size=621460 2024-04-03T03:46:10.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.673+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=972C3EAQUGHS type=del 2024-04-03T03:46:10.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.681+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~J3VNMU0H83X7.0 size=1048576 2024-04-03T03:46:10.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.681+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~J3VNMU0H83X7.1 size=1048576 2024-04-03T03:46:10.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.685+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~J3VNMU0H83X7.2 size=312707 2024-04-03T03:46:10.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.685+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=J3VNMU0H83X7 tag=H19CLLQHEFZQ type=write size=3458435 2024-04-03T03:46:10.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.689+0000 7f55269288c0 1 < suggested remove operation key=7POFUQ9CX6B1 tag=ZSY9PX5IBLMH type=del 2024-04-03T03:46:10.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.693+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~OFKVCI6ONH5Q.0 size=1048576 2024-04-03T03:46:10.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.697+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~OFKVCI6ONH5Q.1 size=810936 2024-04-03T03:46:10.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.697+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=OFKVCI6ONH5Q tag=Y927L3Q2Q7I5 type=write size=2908088 2024-04-03T03:46:10.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.701+0000 7f55269288c0 1 < suggested remove operation key=0OSIL0R5ZJ54 tag=U6CJ79H15H5R type=del 2024-04-03T03:46:10.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.705+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=9CWEODTKMMV1 type=del size=616063 2024-04-03T03:46:10.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.705+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=SIM26P6ZAIHU type=del 2024-04-03T03:46:10.709 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.713+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~2XMVPP1QBWKQ.0 size=1048576 2024-04-03T03:46:10.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.713+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~2XMVPP1QBWKQ.1 size=623513 2024-04-03T03:46:10.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.713+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=2XMVPP1QBWKQ tag=LXKSYILJONWU type=write size=2720665 2024-04-03T03:46:10.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.717+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~8CU9JU9QXCWK.0 size=404575 2024-04-03T03:46:10.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.721+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=8CU9JU9QXCWK tag=9DDU40KIQVFD type=write size=1453151 2024-04-03T03:46:10.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.725+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~W9MYK17OY71E.0 size=1048576 2024-04-03T03:46:10.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.729+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~W9MYK17OY71E.1 size=1048576 2024-04-03T03:46:10.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.729+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~W9MYK17OY71E.2 size=454160 2024-04-03T03:46:10.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.729+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=W9MYK17OY71E tag=3A0SJNOXY3MB type=write size=3599888 2024-04-03T03:46:10.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.733+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=670SSXGUYJAP type=del 2024-04-03T03:46:10.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.737+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=9HZEP15NVC6A type=del size=901120 2024-04-03T03:46:10.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.737+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=5NUOY8VIZLRC type=del 2024-04-03T03:46:10.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.741+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=RSCGUCEJXEDV type=write size=305651 2024-04-03T03:46:10.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.741+0000 7f55269288c0 1 < completed write operation key=K3Z9W19WEJBM tag=K949M6EM8GJH type=write size=471823 2024-04-03T03:46:10.742 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.745+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=JIIOKB77NYAE type=del size=1481008 2024-04-03T03:46:10.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.749+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~F0DNE2BV7MRE.0 size=1048576 2024-04-03T03:46:10.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.749+0000 7f55269288c0 1 < canceled part key=_multipart_TXFMKXUGMEA8.2~F0DNE2BV7MRE.1 size=20482 2024-04-03T03:46:10.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.753+0000 7f55269288c0 1 < canceled multipart upload key=TXFMKXUGMEA8 upload=F0DNE2BV7MRE tag=MQ8J1GLOZN9Q type=write size=2117634 2024-04-03T03:46:10.753 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.757+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~DMK0L2UG57WJ.0 size=1048576 2024-04-03T03:46:10.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.757+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~DMK0L2UG57WJ.1 size=505717 2024-04-03T03:46:10.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.757+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=DMK0L2UG57WJ tag=TAQJNKS7JNB4 type=write size=2602869 2024-04-03T03:46:10.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.761+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=THVOYB2UHAXJ type=del 2024-04-03T03:46:10.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.761+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=0BDN4QSH9WNR type=write size=149728 2024-04-03T03:46:10.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.765+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=NZRX5CYZHMFM type=del 2024-04-03T03:46:10.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.765+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=3WEM8FGX6PNB type=del size=2723598 2024-04-03T03:46:10.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.769+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=0YBPCAK8QOWG type=del 2024-04-03T03:46:10.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.773+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~A8TCOCK0YS23.0 size=648775 2024-04-03T03:46:10.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.773+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=A8TCOCK0YS23 tag=BAQVMPFX4P6W type=write size=1697351 2024-04-03T03:46:10.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.777+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~OC1PCH7J1GDR.0 size=1048576 2024-04-03T03:46:10.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.777+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~OC1PCH7J1GDR.1 size=438214 2024-04-03T03:46:10.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.781+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=OC1PCH7J1GDR tag=77CYTQF1F32L type=write size=2535366 2024-04-03T03:46:10.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.785+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~I14BSHNTDNPR.0 size=1048576 2024-04-03T03:46:10.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.789+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~I14BSHNTDNPR.1 size=1048576 2024-04-03T03:46:10.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.789+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~I14BSHNTDNPR.2 size=167568 2024-04-03T03:46:10.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.789+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=I14BSHNTDNPR tag=CEO39LRD3V2D type=write size=3313296 2024-04-03T03:46:10.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.793+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~0KIVN3QGDV95.0 size=1048576 2024-04-03T03:46:10.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.793+0000 7f55269288c0 1 < canceled part key=_multipart_B5BI0HJ5S1Y1.2~0KIVN3QGDV95.1 size=182246 2024-04-03T03:46:10.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.797+0000 7f55269288c0 1 < canceled multipart upload key=B5BI0HJ5S1Y1 upload=0KIVN3QGDV95 tag=68JKIQALN8DL type=write size=2279398 2024-04-03T03:46:10.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.797+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=NUYZOAK3KXE0 type=del size=2487411 2024-04-03T03:46:10.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.801+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=TNLQ8M7DUJ4C type=del 2024-04-03T03:46:10.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.801+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=HIVYZSAAFQ5E type=del size=2617449 2024-04-03T03:46:10.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.805+0000 7f55269288c0 1 < completed write operation key=8BMP0HIS520R tag=T4HCDVSS26WO type=write size=621460 2024-04-03T03:46:10.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.809+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=I7LUJ6K0SVSD type=del size=2276647 2024-04-03T03:46:10.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.809+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~J3VNMU0H83X7.0 size=1048576 2024-04-03T03:46:10.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.813+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~J3VNMU0H83X7.1 size=1048576 2024-04-03T03:46:10.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.813+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~J3VNMU0H83X7.2 size=312707 2024-04-03T03:46:10.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.817+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=J3VNMU0H83X7 tag=H19CLLQHEFZQ type=write size=3458435 2024-04-03T03:46:10.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.821+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=DYDC2HXSTP8D type=del size=767479 2024-04-03T03:46:10.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.821+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~OFKVCI6ONH5Q.0 size=1048576 2024-04-03T03:46:10.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.825+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~OFKVCI6ONH5Q.1 size=810936 2024-04-03T03:46:10.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.829+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=OFKVCI6ONH5Q tag=Y927L3Q2Q7I5 type=write size=2908088 2024-04-03T03:46:10.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.829+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=I82F4P78Q1U2 type=del size=2248950 2024-04-03T03:46:10.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.833+0000 7f55269288c0 1 < suggested update operation key=TXFMKXUGMEA8 tag=9CWEODTKMMV1 type=del size=616063 2024-04-03T03:46:10.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.837+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=3GNPIY68T01G type=del size=875535 2024-04-03T03:46:10.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.841+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~2XMVPP1QBWKQ.0 size=1048576 2024-04-03T03:46:10.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.841+0000 7f55269288c0 1 < canceled part key=_multipart_K3Z9W19WEJBM.2~2XMVPP1QBWKQ.1 size=623513 2024-04-03T03:46:10.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.845+0000 7f55269288c0 1 < canceled multipart upload key=K3Z9W19WEJBM upload=2XMVPP1QBWKQ tag=LXKSYILJONWU type=write size=2720665 2024-04-03T03:46:10.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.845+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=3XPLQIHXIH23 type=del size=492945 2024-04-03T03:46:10.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.849+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~W9MYK17OY71E.0 size=1048576 2024-04-03T03:46:10.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.849+0000 7f55269288c0 1 < canceled part key=_multipart_KDSE2XB4D1XI.2~W9MYK17OY71E.1 size=1048576 2024-04-03T03:46:10.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.853+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~W9MYK17OY71E.2 size=454160 2024-04-03T03:46:10.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.857+0000 7f55269288c0 1 < canceled multipart upload key=KDSE2XB4D1XI upload=W9MYK17OY71E tag=3A0SJNOXY3MB type=write size=3599888 2024-04-03T03:46:10.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.861+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=4VQSYMAC90SZ type=write size=901099 2024-04-03T03:46:10.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.861+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=9HZEP15NVC6A type=del 2024-04-03T03:46:10.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.865+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~RTJY2U7SGIBL.0 size=268371 2024-04-03T03:46:10.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.865+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=RTJY2U7SGIBL tag=H01VN9IJPIP8 type=write size=1316947 2024-04-03T03:46:10.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.869+0000 7f55269288c0 1 < completed write operation key=F6IBZ80J4SDM tag=RSCGUCEJXEDV type=write size=305651 2024-04-03T03:46:10.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.873+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=4GWYSN43HOSN type=write size=170790 2024-04-03T03:46:10.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.873+0000 7f55269288c0 1 < canceled operation key=AXL5RVPSVDY5 tag=JIIOKB77NYAE type=del size=1481008 2024-04-03T03:46:10.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.877+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=5R5LBPI358D0 type=del size=924522 2024-04-03T03:46:10.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.881+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~DMK0L2UG57WJ.0 size=1048576 2024-04-03T03:46:10.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.881+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~DMK0L2UG57WJ.1 size=505717 2024-04-03T03:46:10.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.885+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=DMK0L2UG57WJ tag=TAQJNKS7JNB4 type=write size=2602869 2024-04-03T03:46:10.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.889+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=88NQR9HMH3GM type=write size=616752 2024-04-03T03:46:10.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.889+0000 7f55269288c0 1 < completed write operation key=D8W2ZKIZFI8H tag=0BDN4QSH9WNR type=write size=149728 2024-04-03T03:46:10.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.893+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=7QTRWJ2OLKJ9 type=del size=2712397 2024-04-03T03:46:10.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.893+0000 7f55269288c0 1 < completed delete operation key=K3Z9W19WEJBM tag=3WEM8FGX6PNB type=del 2024-04-03T03:46:10.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.901+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~5XT4YV0HISZK.0 size=1048576 2024-04-03T03:46:10.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.901+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~5XT4YV0HISZK.1 size=1048576 2024-04-03T03:46:10.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.905+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~5XT4YV0HISZK.2 size=228882 2024-04-03T03:46:10.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.905+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=5XT4YV0HISZK tag=INXQ8VM1410K type=write size=3374610 2024-04-03T03:46:10.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.905+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~A8TCOCK0YS23.0 size=648775 2024-04-03T03:46:10.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.913+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=A8TCOCK0YS23 tag=BAQVMPFX4P6W type=write size=1697351 2024-04-03T03:46:10.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.913+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=W6WSMTQ9YGZL type=del size=62504 2024-04-03T03:46:10.913 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.917+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~I14BSHNTDNPR.0 size=1048576 2024-04-03T03:46:10.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.917+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~I14BSHNTDNPR.1 size=1048576 2024-04-03T03:46:10.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.921+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~I14BSHNTDNPR.2 size=167568 2024-04-03T03:46:10.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.925+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=I14BSHNTDNPR tag=CEO39LRD3V2D type=write size=3313296 2024-04-03T03:46:10.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.925+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=9287TFMM005Z type=del size=122350 2024-04-03T03:46:10.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.929+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=NUYZOAK3KXE0 type=del 2024-04-03T03:46:10.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.933+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=MXUU6A1NZ5DW type=del size=1556778 2024-04-03T03:46:10.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.933+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=HIVYZSAAFQ5E type=del 2024-04-03T03:46:10.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.937+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=9Z146LHJGGM3 type=del size=1515734 2024-04-03T03:46:10.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.941+0000 7f55269288c0 1 < completed delete operation key=K3Z9W19WEJBM tag=I7LUJ6K0SVSD type=del 2024-04-03T03:46:10.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.941+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=K9TJ4DJ9FJBO type=write size=850296 2024-04-03T03:46:10.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.945+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=DYDC2HXSTP8D type=del 2024-04-03T03:46:10.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.949+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~AR2HRBT1AOD5.0 size=600658 2024-04-03T03:46:10.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.949+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=AR2HRBT1AOD5 tag=XQC3BOIZQ2ZH type=write size=1649234 2024-04-03T03:46:10.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.949+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=I82F4P78Q1U2 type=del 2024-04-03T03:46:10.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.953+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=GR534BT8EODJ type=del size=576227 2024-04-03T03:46:10.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.957+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=3GNPIY68T01G type=del 2024-04-03T03:46:10.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.957+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=RO1TG4JQ85FT type=del size=1824332 2024-04-03T03:46:10.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.961+0000 7f55269288c0 1 < canceled operation key=Z42NDVEX1SOL tag=3XPLQIHXIH23 type=del size=492945 2024-04-03T03:46:10.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.965+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=0BVT82RA7BCK type=del size=2396483 2024-04-03T03:46:10.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.969+0000 7f55269288c0 1 < suggested update operation key=Z42NDVEX1SOL tag=4VQSYMAC90SZ type=write size=901099 2024-04-03T03:46:10.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.973+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~2VHLMB54ZQNO.0 size=1048576 2024-04-03T03:46:10.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.973+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~2VHLMB54ZQNO.1 size=1048576 2024-04-03T03:46:10.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.977+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~2VHLMB54ZQNO.2 size=509875 2024-04-03T03:46:10.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.977+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=2VHLMB54ZQNO tag=RWIJ7N2LH0YI type=write size=3655603 2024-04-03T03:46:10.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.977+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~RTJY2U7SGIBL.0 size=268371 2024-04-03T03:46:10.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.981+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=RTJY2U7SGIBL tag=H01VN9IJPIP8 type=write size=1316947 2024-04-03T03:46:10.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.985+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=SY9ONSJSV7B4 type=del size=714000 2024-04-03T03:46:10.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.985+0000 7f55269288c0 1 < completed write operation key=F6IBZ80J4SDM tag=4GWYSN43HOSN type=write size=170790 2024-04-03T03:46:10.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.989+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=80NRI8RTIBIB type=del size=688801 2024-04-03T03:46:10.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.993+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=5R5LBPI358D0 type=del 2024-04-03T03:46:10.991 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.993+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=2OXT216GG84Y type=del size=2036065 2024-04-03T03:46:10.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:10.997+0000 7f55269288c0 1 < completed write operation key=SFN1M3HPGT18 tag=88NQR9HMH3GM type=write size=616752 2024-04-03T03:46:10.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.001+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~6YXN0KPM8YQX.0 size=1048576 2024-04-03T03:46:10.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.001+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~6YXN0KPM8YQX.1 size=1005007 2024-04-03T03:46:10.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.001+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=6YXN0KPM8YQX tag=U4V9K0QEOPDK type=write size=3102159 2024-04-03T03:46:11.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.005+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=7QTRWJ2OLKJ9 type=del 2024-04-03T03:46:11.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.009+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=557YQKLUERXA type=del size=1990898 2024-04-03T03:46:11.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.013+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~5XT4YV0HISZK.0 size=1048576 2024-04-03T03:46:11.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.013+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~5XT4YV0HISZK.1 size=1048576 2024-04-03T03:46:11.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.013+0000 7f55269288c0 1 < canceled part key=_multipart_F6IBZ80J4SDM.2~5XT4YV0HISZK.2 size=228882 2024-04-03T03:46:11.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.017+0000 7f55269288c0 1 < canceled multipart upload key=F6IBZ80J4SDM upload=5XT4YV0HISZK tag=INXQ8VM1410K type=write size=3374610 2024-04-03T03:46:11.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.021+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~2JKC2VD7JE0G.0 size=1048576 2024-04-03T03:46:11.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.025+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~2JKC2VD7JE0G.1 size=54114 2024-04-03T03:46:11.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.025+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=2JKC2VD7JE0G tag=0YMTAPAIJSGH type=write size=2151266 2024-04-03T03:46:11.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.025+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=W6WSMTQ9YGZL type=del 2024-04-03T03:46:11.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.029+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~UZDH8HYTB3JO.0 size=293207 2024-04-03T03:46:11.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.029+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=UZDH8HYTB3JO tag=72WQ2WD6NN13 type=write size=1341783 2024-04-03T03:46:11.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.037+0000 7f55269288c0 1 < suggested update operation key=6KH6TASZS3UG tag=9287TFMM005Z type=del size=122350 2024-04-03T03:46:11.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.041+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~YQFQF4PBX4RH.0 size=758399 2024-04-03T03:46:11.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.041+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=YQFQF4PBX4RH tag=L6R501RK84E8 type=write size=1806975 2024-04-03T03:46:11.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.041+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=MXUU6A1NZ5DW type=del 2024-04-03T03:46:11.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.045+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=MTYV91TJDUX8 type=del size=500848 2024-04-03T03:46:11.043 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.045+0000 7f55269288c0 1 < canceled operation key=B5BI0HJ5S1Y1 tag=9Z146LHJGGM3 type=del size=1515734 2024-04-03T03:46:11.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.049+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~RUKAU25LWII3.0 size=859618 2024-04-03T03:46:11.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.049+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=RUKAU25LWII3 tag=8XA344J78R4R type=write size=1908194 2024-04-03T03:46:11.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.053+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=K9TJ4DJ9FJBO type=write size=850296 2024-04-03T03:46:11.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.053+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=G1I6K23WAN6U type=write size=909079 2024-04-03T03:46:11.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.057+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~AR2HRBT1AOD5.0 size=600658 2024-04-03T03:46:11.058 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.061+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=AR2HRBT1AOD5 tag=XQC3BOIZQ2ZH type=write size=1649234 2024-04-03T03:46:11.060 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.065+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=3KEYSI3IT706 type=del size=3235837 2024-04-03T03:46:11.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.065+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=GR534BT8EODJ type=del 2024-04-03T03:46:11.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.069+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~SVGRVQMNN2UZ.0 size=1048576 2024-04-03T03:46:11.069 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.073+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~SVGRVQMNN2UZ.1 size=801919 2024-04-03T03:46:11.069 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.073+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=SVGRVQMNN2UZ tag=FSNEQCFX6MDN type=write size=2899071 2024-04-03T03:46:11.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.077+0000 7f55269288c0 1 < suggested update operation key=XFCPX90N2NYC tag=RO1TG4JQ85FT type=del size=1824332 2024-04-03T03:46:11.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.081+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~LNUF1PP8KXDR.0 size=504550 2024-04-03T03:46:11.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.081+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=LNUF1PP8KXDR tag=RGP4QVWXZFNP type=write size=1553126 2024-04-03T03:46:11.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.081+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=0BVT82RA7BCK type=del 2024-04-03T03:46:11.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.085+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~BAEEM4GJNIDE.0 size=1019400 2024-04-03T03:46:11.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.085+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=BAEEM4GJNIDE tag=8Y1IYD0D6P6S type=write size=2067976 2024-04-03T03:46:11.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.089+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~2VHLMB54ZQNO.0 size=1048576 2024-04-03T03:46:11.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.089+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~2VHLMB54ZQNO.1 size=1048576 2024-04-03T03:46:11.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.089+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~2VHLMB54ZQNO.2 size=509875 2024-04-03T03:46:11.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.093+0000 7f55269288c0 1 < canceled multipart upload key=8BMP0HIS520R upload=2VHLMB54ZQNO tag=RWIJ7N2LH0YI type=write size=3655603 2024-04-03T03:46:11.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.097+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=KPQG91OXZPMI type=del size=1564484 2024-04-03T03:46:11.096 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.097+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=SY9ONSJSV7B4 type=del 2024-04-03T03:46:11.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.105+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~P07G7YY29G87.0 size=1048576 2024-04-03T03:46:11.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.105+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~P07G7YY29G87.1 size=1048576 2024-04-03T03:46:11.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.105+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~P07G7YY29G87.2 size=900477 2024-04-03T03:46:11.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.105+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=P07G7YY29G87 tag=BJ9CYHGZ2JAI type=write size=4046205 2024-04-03T03:46:11.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.109+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=80NRI8RTIBIB type=del 2024-04-03T03:46:11.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.113+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=FQFBY0DPESY8 type=del size=877025 2024-04-03T03:46:11.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.113+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=2OXT216GG84Y type=del 2024-04-03T03:46:11.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.117+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=11TAH77MUYUT type=del size=3887873 2024-04-03T03:46:11.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.121+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~6YXN0KPM8YQX.0 size=1048576 2024-04-03T03:46:11.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.121+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~6YXN0KPM8YQX.1 size=1005007 2024-04-03T03:46:11.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.125+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=6YXN0KPM8YQX tag=U4V9K0QEOPDK type=write size=3102159 2024-04-03T03:46:11.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.129+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=MIK21EUCEE66 type=del size=1507773 2024-04-03T03:46:11.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.129+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=557YQKLUERXA type=del 2024-04-03T03:46:11.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.133+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~9JJ3Q7YCIXD7.0 size=1048576 2024-04-03T03:46:11.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.137+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~9JJ3Q7YCIXD7.1 size=1048576 2024-04-03T03:46:11.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.137+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~9JJ3Q7YCIXD7.2 size=1020398 2024-04-03T03:46:11.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.137+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=9JJ3Q7YCIXD7 tag=XJF009IOSG5P type=write size=4166126 2024-04-03T03:46:11.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.141+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~2JKC2VD7JE0G.0 size=1048576 2024-04-03T03:46:11.138 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.141+0000 7f55269288c0 1 < canceled part key=_multipart_XFCPX90N2NYC.2~2JKC2VD7JE0G.1 size=54114 2024-04-03T03:46:11.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.145+0000 7f55269288c0 1 < canceled multipart upload key=XFCPX90N2NYC upload=2JKC2VD7JE0G tag=0YMTAPAIJSGH type=write size=2151266 2024-04-03T03:46:11.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.149+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~3ZJWT3GBUBGV.0 size=332873 2024-04-03T03:46:11.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.149+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=3ZJWT3GBUBGV tag=UU8GMHF9O04E type=write size=1381449 2024-04-03T03:46:11.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.149+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~UZDH8HYTB3JO.0 size=293207 2024-04-03T03:46:11.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.153+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=UZDH8HYTB3JO tag=72WQ2WD6NN13 type=write size=1341783 2024-04-03T03:46:11.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.157+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=60FLTIIV2REE type=del size=946858 2024-04-03T03:46:11.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.157+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~YQFQF4PBX4RH.0 size=758399 2024-04-03T03:46:11.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.161+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=YQFQF4PBX4RH tag=L6R501RK84E8 type=write size=1806975 2024-04-03T03:46:11.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.165+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=CT9098QH0YPF type=del size=670136 2024-04-03T03:46:11.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.165+0000 7f55269288c0 1 < canceled operation key=MLTDNCZ4E5D8 tag=MTYV91TJDUX8 type=del size=500848 2024-04-03T03:46:11.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.169+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~NAFI3YLLCNYA.0 size=58213 2024-04-03T03:46:11.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.169+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=NAFI3YLLCNYA tag=XGGLL23TF1RD type=write size=1106789 2024-04-03T03:46:11.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.173+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~RUKAU25LWII3.0 size=859618 2024-04-03T03:46:11.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.177+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=RUKAU25LWII3 tag=8XA344J78R4R type=write size=1908194 2024-04-03T03:46:11.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.181+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=VKNO10BDLZCH type=del size=3552665 2024-04-03T03:46:11.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.181+0000 7f55269288c0 1 < canceled operation key=KDSE2XB4D1XI tag=G1I6K23WAN6U type=write size=909079 2024-04-03T03:46:11.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.185+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=79KO2AFPKEK1 type=del size=1613116 2024-04-03T03:46:11.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.189+0000 7f55269288c0 1 < suggested remove operation key=TLM1C3B9J2A3 tag=3KEYSI3IT706 type=del 2024-04-03T03:46:11.189 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.193+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=OS0IN66SZ501 type=del size=665439 2024-04-03T03:46:11.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.193+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~SVGRVQMNN2UZ.0 size=1048576 2024-04-03T03:46:11.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.197+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~SVGRVQMNN2UZ.1 size=801919 2024-04-03T03:46:11.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.201+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=SVGRVQMNN2UZ tag=FSNEQCFX6MDN type=write size=2899071 2024-04-03T03:46:11.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.201+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=4B1MQ99DGMMX type=del size=522016 2024-04-03T03:46:11.201 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.205+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~LNUF1PP8KXDR.0 size=504550 2024-04-03T03:46:11.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.209+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=LNUF1PP8KXDR tag=RGP4QVWXZFNP type=write size=1553126 2024-04-03T03:46:11.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.213+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~RMX51SHHE47K.0 size=465374 2024-04-03T03:46:11.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.213+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=RMX51SHHE47K tag=5A453S99HW3S type=write size=1513950 2024-04-03T03:46:11.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.213+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~BAEEM4GJNIDE.0 size=1019400 2024-04-03T03:46:11.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.217+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=BAEEM4GJNIDE tag=8Y1IYD0D6P6S type=write size=2067976 2024-04-03T03:46:11.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.225+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~34S9YWY6XE5A.0 size=1048576 2024-04-03T03:46:11.223 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.225+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~34S9YWY6XE5A.1 size=1048576 2024-04-03T03:46:11.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.229+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~34S9YWY6XE5A.2 size=823752 2024-04-03T03:46:11.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.229+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=34S9YWY6XE5A tag=SO3QLGH3ESTV type=write size=3969480 2024-04-03T03:46:11.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.229+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=KPQG91OXZPMI type=del size=1564484 2024-04-03T03:46:11.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.233+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~VWNTG8UDW0IX.0 size=997356 2024-04-03T03:46:11.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.233+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=VWNTG8UDW0IX tag=W8MSMR5AYVU9 type=write size=2045932 2024-04-03T03:46:11.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.233+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~P07G7YY29G87.0 size=1048576 2024-04-03T03:46:11.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.237+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~P07G7YY29G87.1 size=1048576 2024-04-03T03:46:11.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.237+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~P07G7YY29G87.2 size=900477 2024-04-03T03:46:11.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.241+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=P07G7YY29G87 tag=BJ9CYHGZ2JAI type=write size=4046205 2024-04-03T03:46:11.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.245+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=MK2P7PSQZCTB type=del size=1081172 2024-04-03T03:46:11.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.245+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=FQFBY0DPESY8 type=del 2024-04-03T03:46:11.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.249+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=DJLTM3CYY2TH type=del size=3602036 2024-04-03T03:46:11.247 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.249+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=11TAH77MUYUT type=del 2024-04-03T03:46:11.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.253+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~JIBPWYUNGGHY.0 size=1048576 2024-04-03T03:46:11.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.257+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~JIBPWYUNGGHY.1 size=920540 2024-04-03T03:46:11.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.257+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=JIBPWYUNGGHY tag=11UX689QO7SA type=write size=3017692 2024-04-03T03:46:11.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.257+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=MIK21EUCEE66 type=del 2024-04-03T03:46:11.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.261+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~8MC72KGVC0F8.0 size=1048576 2024-04-03T03:46:11.260 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.265+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~8MC72KGVC0F8.1 size=1048576 2024-04-03T03:46:11.262 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.265+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~8MC72KGVC0F8.2 size=787708 2024-04-03T03:46:11.262 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.265+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=8MC72KGVC0F8 tag=6D88MFVWTN4E type=write size=3933436 2024-04-03T03:46:11.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.269+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~9JJ3Q7YCIXD7.0 size=1048576 2024-04-03T03:46:11.266 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.269+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~9JJ3Q7YCIXD7.1 size=1048576 2024-04-03T03:46:11.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.269+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~9JJ3Q7YCIXD7.2 size=1020398 2024-04-03T03:46:11.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.273+0000 7f55269288c0 1 < canceled multipart upload key=8BMP0HIS520R upload=9JJ3Q7YCIXD7 tag=XJF009IOSG5P type=write size=4166126 2024-04-03T03:46:11.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.273+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=CKIPM182454M type=del size=425374 2024-04-03T03:46:11.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.277+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~3ZJWT3GBUBGV.0 size=332873 2024-04-03T03:46:11.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.281+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=3ZJWT3GBUBGV tag=UU8GMHF9O04E type=write size=1381449 2024-04-03T03:46:11.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.285+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~12FDZV15LEUS.0 size=1048576 2024-04-03T03:46:11.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.285+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~12FDZV15LEUS.1 size=1048576 2024-04-03T03:46:11.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.289+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~12FDZV15LEUS.2 size=757622 2024-04-03T03:46:11.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.289+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=12FDZV15LEUS tag=FHE56VL3QUP0 type=write size=3903350 2024-04-03T03:46:11.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.293+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=60FLTIIV2REE type=del 2024-04-03T03:46:11.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.293+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=E8D3WSCRTLXA type=del size=862077 2024-04-03T03:46:11.293 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.297+0000 7f55269288c0 -1 < failed to complete operation key=TLM1C3B9J2A3 tag=CT9098QH0YPF type=del size=670136: (22) Invalid argument 2024-04-03T03:46:11.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.301+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~I9FBD10YY68L.0 size=175168 2024-04-03T03:46:11.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.301+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=I9FBD10YY68L tag=AZR5JCF9R7M1 type=write size=1223744 2024-04-03T03:46:11.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.301+0000 7f55269288c0 1 < canceled part key=_multipart_LZQGL2UAWOTU.2~NAFI3YLLCNYA.0 size=58213 2024-04-03T03:46:11.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.305+0000 7f55269288c0 1 < canceled multipart upload key=LZQGL2UAWOTU upload=NAFI3YLLCNYA tag=XGGLL23TF1RD type=write size=1106789 2024-04-03T03:46:11.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.309+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~5D23DCPXE1ZM.0 size=1048576 2024-04-03T03:46:11.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.313+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~5D23DCPXE1ZM.1 size=740291 2024-04-03T03:46:11.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.313+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=5D23DCPXE1ZM tag=A3TNQWIL1HYY type=write size=2837443 2024-04-03T03:46:11.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.313+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=VKNO10BDLZCH type=del 2024-04-03T03:46:11.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.317+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=4ZU4A5W5JDZ7 type=del size=791523 2024-04-03T03:46:11.317 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.321+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=79KO2AFPKEK1 type=del 2024-04-03T03:46:11.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.325+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~997I4ZRFLVXF.0 size=1048576 2024-04-03T03:46:11.323 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.325+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~997I4ZRFLVXF.1 size=1048576 2024-04-03T03:46:11.324 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.325+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~997I4ZRFLVXF.2 size=690702 2024-04-03T03:46:11.324 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.325+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=997I4ZRFLVXF tag=J2H3NUTV1HAW type=write size=3836430 2024-04-03T03:46:11.327 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.329+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=OS0IN66SZ501 type=del 2024-04-03T03:46:11.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.333+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=FLA3DONZ0K99 type=write size=162404 2024-04-03T03:46:11.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.333+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=4B1MQ99DGMMX type=del 2024-04-03T03:46:11.334 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.337+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=CPYEKPW2RFMY type=del size=2112211 2024-04-03T03:46:11.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.341+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~RMX51SHHE47K.0 size=465374 2024-04-03T03:46:11.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.345+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=RMX51SHHE47K tag=5A453S99HW3S type=write size=1513950 2024-04-03T03:46:11.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.345+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=0SCRPJUD9QCA type=write size=625438 2024-04-03T03:46:11.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.349+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~34S9YWY6XE5A.0 size=1048576 2024-04-03T03:46:11.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.349+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~34S9YWY6XE5A.1 size=1048576 2024-04-03T03:46:11.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.353+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~34S9YWY6XE5A.2 size=823752 2024-04-03T03:46:11.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.357+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=34S9YWY6XE5A tag=SO3QLGH3ESTV type=write size=3969480 2024-04-03T03:46:11.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.361+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~EN55DFJGKXFG.0 size=1048576 2024-04-03T03:46:11.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.361+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~EN55DFJGKXFG.1 size=917098 2024-04-03T03:46:11.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.361+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=EN55DFJGKXFG tag=ET4GH8KXYEET type=write size=3014250 2024-04-03T03:46:11.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.365+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~VWNTG8UDW0IX.0 size=997356 2024-04-03T03:46:11.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.369+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=VWNTG8UDW0IX tag=W8MSMR5AYVU9 type=write size=2045932 2024-04-03T03:46:11.369 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.373+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=5KXRHXHH0BKG type=del size=2595859 2024-04-03T03:46:11.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.373+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=MK2P7PSQZCTB type=del 2024-04-03T03:46:11.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.377+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=WFQU7ZP64I7E type=del size=2052373 2024-04-03T03:46:11.377 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.381+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=DJLTM3CYY2TH type=del 2024-04-03T03:46:11.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.385+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~NWAYE069CSBT.0 size=131564 2024-04-03T03:46:11.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.385+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=NWAYE069CSBT tag=LGWCK47FBJYX type=write size=1180140 2024-04-03T03:46:11.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.385+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~JIBPWYUNGGHY.0 size=1048576 2024-04-03T03:46:11.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.389+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~JIBPWYUNGGHY.1 size=920540 2024-04-03T03:46:11.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.393+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=JIBPWYUNGGHY tag=11UX689QO7SA type=write size=3017692 2024-04-03T03:46:11.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.401+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~X1L1UM1HLDI6.0 size=996156 2024-04-03T03:46:11.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.401+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=X1L1UM1HLDI6 tag=MN9K9GO2T8BQ type=write size=2044732 2024-04-03T03:46:11.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.401+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~8MC72KGVC0F8.0 size=1048576 2024-04-03T03:46:11.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.405+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~8MC72KGVC0F8.1 size=1048576 2024-04-03T03:46:11.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.409+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~8MC72KGVC0F8.2 size=787708 2024-04-03T03:46:11.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.413+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=8MC72KGVC0F8 tag=6D88MFVWTN4E type=write size=3933436 2024-04-03T03:46:11.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.417+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=H4IZT6VG25TE type=write size=1019441 2024-04-03T03:46:11.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.417+0000 7f55269288c0 1 < canceled operation key=8BMP0HIS520R tag=CKIPM182454M type=del size=425374 2024-04-03T03:46:11.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.425+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~7HBM48VWKDN4.0 size=1048576 2024-04-03T03:46:11.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.425+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~7HBM48VWKDN4.1 size=260625 2024-04-03T03:46:11.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.425+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=7HBM48VWKDN4 tag=E4CPQSN0WN35 type=write size=2357777 2024-04-03T03:46:11.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.429+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~12FDZV15LEUS.0 size=1048576 2024-04-03T03:46:11.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.429+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~12FDZV15LEUS.1 size=1048576 2024-04-03T03:46:11.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.433+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~12FDZV15LEUS.2 size=757622 2024-04-03T03:46:11.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.437+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=12FDZV15LEUS tag=FHE56VL3QUP0 type=write size=3903350 2024-04-03T03:46:11.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.441+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~YMBUTITFNXB8.0 size=738533 2024-04-03T03:46:11.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.441+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=YMBUTITFNXB8 tag=E1DQMEUVUQNZ type=write size=1787109 2024-04-03T03:46:11.450 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.453+0000 7f55269288c0 1 < suggested update operation key=XFCPX90N2NYC tag=E8D3WSCRTLXA type=del size=862077 2024-04-03T03:46:11.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.457+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=WBZ52KMT22ME type=del size=2394026 2024-04-03T03:46:11.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.457+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~I9FBD10YY68L.0 size=175168 2024-04-03T03:46:11.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.465+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=I9FBD10YY68L tag=AZR5JCF9R7M1 type=write size=1223744 2024-04-03T03:46:11.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.465+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=T1YUGC6EBK7Y type=del size=2774127 2024-04-03T03:46:11.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.469+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~5D23DCPXE1ZM.0 size=1048576 2024-04-03T03:46:11.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.473+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~5D23DCPXE1ZM.1 size=740291 2024-04-03T03:46:11.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.477+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=5D23DCPXE1ZM tag=A3TNQWIL1HYY type=write size=2837443 2024-04-03T03:46:11.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.481+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=YR1UTG32CH94 type=del size=1684146 2024-04-03T03:46:11.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.485+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=4ZU4A5W5JDZ7 type=del 2024-04-03T03:46:11.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.485+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=4H9LEY6SJ3X9 type=del size=8548 2024-04-03T03:46:11.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.489+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~997I4ZRFLVXF.0 size=1048576 2024-04-03T03:46:11.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.493+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~997I4ZRFLVXF.1 size=1048576 2024-04-03T03:46:11.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.493+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~997I4ZRFLVXF.2 size=690702 2024-04-03T03:46:11.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.501+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=997I4ZRFLVXF tag=J2H3NUTV1HAW type=write size=3836430 2024-04-03T03:46:11.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.505+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~HPWGHYYWTYDP.0 size=1048576 2024-04-03T03:46:11.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.509+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~HPWGHYYWTYDP.1 size=386203 2024-04-03T03:46:11.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.509+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=HPWGHYYWTYDP tag=JUH2JU09XMXA type=write size=2483355 2024-04-03T03:46:11.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.513+0000 7f55269288c0 1 < completed write operation key=D8W2ZKIZFI8H tag=FLA3DONZ0K99 type=write size=162404 2024-04-03T03:46:11.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.513+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=F8JCCM2JKO0Q type=del size=1827963 2024-04-03T03:46:11.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.517+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=CPYEKPW2RFMY type=del 2024-04-03T03:46:11.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.521+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=BV40JYT1JKC2 type=del size=706351 2024-04-03T03:46:11.523 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.525+0000 7f55269288c0 1 < completed write operation key=AGTQQYXO7453 tag=0SCRPJUD9QCA type=write size=625438 2024-04-03T03:46:11.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.529+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=DT3R2QVN561P type=write size=675880 2024-04-03T03:46:11.527 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.529+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~EN55DFJGKXFG.0 size=1048576 2024-04-03T03:46:11.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.533+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~EN55DFJGKXFG.1 size=917098 2024-04-03T03:46:11.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.537+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=EN55DFJGKXFG tag=ET4GH8KXYEET type=write size=3014250 2024-04-03T03:46:11.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.541+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=0S4GDMRBXR2P type=del size=3982301 2024-04-03T03:46:11.541 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.545+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=5KXRHXHH0BKG type=del 2024-04-03T03:46:11.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.549+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~2QQ14ZE2MJ2U.0 size=1048576 2024-04-03T03:46:11.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.553+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~2QQ14ZE2MJ2U.1 size=112300 2024-04-03T03:46:11.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.553+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=2QQ14ZE2MJ2U tag=YYMQC6YS85UE type=write size=2209452 2024-04-03T03:46:11.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.557+0000 7f55269288c0 1 < suggested remove operation key=TXFMKXUGMEA8 tag=WFQU7ZP64I7E type=del 2024-04-03T03:46:11.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.561+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=P40Y51KGHCQO type=write size=228513 2024-04-03T03:46:11.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.565+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~NWAYE069CSBT.0 size=131564 2024-04-03T03:46:11.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.569+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=NWAYE069CSBT tag=LGWCK47FBJYX type=write size=1180140 2024-04-03T03:46:11.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.573+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=1SNE6BIAEUPA type=del size=2789366 2024-04-03T03:46:11.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.577+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~X1L1UM1HLDI6.0 size=996156 2024-04-03T03:46:11.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.581+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=X1L1UM1HLDI6 tag=MN9K9GO2T8BQ type=write size=2044732 2024-04-03T03:46:11.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.585+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=VZFVYLJXWCPB type=del size=275886 2024-04-03T03:46:11.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.589+0000 7f55269288c0 1 < completed write operation key=6KH6TASZS3UG tag=H4IZT6VG25TE type=write size=1019441 2024-04-03T03:46:11.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.597+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~V1MKS7W2YWTG.0 size=71347 2024-04-03T03:46:11.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.597+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=V1MKS7W2YWTG tag=SCI82XI110PY type=write size=1119923 2024-04-03T03:46:11.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.597+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~7HBM48VWKDN4.0 size=1048576 2024-04-03T03:46:11.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.601+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~7HBM48VWKDN4.1 size=260625 2024-04-03T03:46:11.605 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.609+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=7HBM48VWKDN4 tag=E4CPQSN0WN35 type=write size=2357777 2024-04-03T03:46:11.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.613+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~DRCHFLN2S335.0 size=843870 2024-04-03T03:46:11.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.613+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=DRCHFLN2S335 tag=JMNB5AT535WL type=write size=1892446 2024-04-03T03:46:11.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.617+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~YMBUTITFNXB8.0 size=738533 2024-04-03T03:46:11.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.625+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=YMBUTITFNXB8 tag=E1DQMEUVUQNZ type=write size=1787109 2024-04-03T03:46:11.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.625+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=T74SHEK9C912 type=write size=993402 2024-04-03T03:46:11.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.629+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=WBZ52KMT22ME type=del 2024-04-03T03:46:11.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.633+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=PM8WWNAQBQEI type=del size=2729517 2024-04-03T03:46:11.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.637+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=T1YUGC6EBK7Y type=del size=2774127 2024-04-03T03:46:11.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.641+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=F8L30ULIG3GU type=del size=216662 2024-04-03T03:46:11.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.641+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=YR1UTG32CH94 type=del 2024-04-03T03:46:11.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.645+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=SLQ8UVWD91Y0 type=del size=157623 2024-04-03T03:46:11.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.649+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=4H9LEY6SJ3X9 type=del 2024-04-03T03:46:11.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.653+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=AV9ZC923J1OO type=del size=1724947 2024-04-03T03:46:11.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.657+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~HPWGHYYWTYDP.0 size=1048576 2024-04-03T03:46:11.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.657+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~HPWGHYYWTYDP.1 size=386203 2024-04-03T03:46:11.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.665+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=HPWGHYYWTYDP tag=JUH2JU09XMXA type=write size=2483355 2024-04-03T03:46:11.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.669+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~PV71JQQVHROP.0 size=1048576 2024-04-03T03:46:11.670 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.673+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~PV71JQQVHROP.1 size=922537 2024-04-03T03:46:11.670 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.673+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=PV71JQQVHROP tag=5234KB495A3F type=write size=3019689 2024-04-03T03:46:11.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.677+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=F8JCCM2JKO0Q type=del 2024-04-03T03:46:11.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.681+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=EKE7DBU43VMC type=del size=274294 2024-04-03T03:46:11.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.685+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=BV40JYT1JKC2 type=del 2024-04-03T03:46:11.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.689+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=I9WEGRC85B7S type=del size=3729743 2024-04-03T03:46:11.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.693+0000 7f55269288c0 1 < suggested remove operation key=Z42NDVEX1SOL tag=DT3R2QVN561P type=write 2024-04-03T03:46:11.697 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.701+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~2SK9SS04HGPF.0 size=745157 2024-04-03T03:46:11.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.701+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=2SK9SS04HGPF tag=16EAKLII7B1J type=write size=1793733 2024-04-03T03:46:11.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.705+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=0S4GDMRBXR2P type=del 2024-04-03T03:46:11.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.705+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=TJR4HVRU4PCF type=del size=513689 2024-04-03T03:46:11.708 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.709+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~2QQ14ZE2MJ2U.0 size=1048576 2024-04-03T03:46:11.710 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.713+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~2QQ14ZE2MJ2U.1 size=112300 2024-04-03T03:46:11.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.717+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=2QQ14ZE2MJ2U tag=YYMQC6YS85UE type=write size=2209452 2024-04-03T03:46:11.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.725+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~IVWWUCIHWHKM.0 size=701662 2024-04-03T03:46:11.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.725+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=IVWWUCIHWHKM tag=7XGQM51E5YRK type=write size=1750238 2024-04-03T03:46:11.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.729+0000 7f55269288c0 1 < completed write operation key=8SBTVHL09P63 tag=P40Y51KGHCQO type=write size=228513 2024-04-03T03:46:11.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.729+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=I06YPKQJK598 type=del size=2922978 2024-04-03T03:46:11.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.733+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=1SNE6BIAEUPA type=del 2024-04-03T03:46:11.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.737+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=FWT841D7FARU type=del size=3722940 2024-04-03T03:46:11.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.741+0000 7f55269288c0 1 < canceled operation key=B5BI0HJ5S1Y1 tag=VZFVYLJXWCPB type=del size=275886 2024-04-03T03:46:11.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.745+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=9168VWHRC6M0 type=del size=2511991 2024-04-03T03:46:11.744 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.745+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~V1MKS7W2YWTG.0 size=71347 2024-04-03T03:46:11.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.753+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=V1MKS7W2YWTG tag=SCI82XI110PY type=write size=1119923 2024-04-03T03:46:11.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.761+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=6DSIGULB5M0A type=del size=4031880 2024-04-03T03:46:11.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.761+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~DRCHFLN2S335.0 size=843870 2024-04-03T03:46:11.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.769+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=DRCHFLN2S335 tag=JMNB5AT535WL type=write size=1892446 2024-04-03T03:46:11.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.773+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=5NTQXUG84JRM type=del size=3544045 2024-04-03T03:46:11.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.773+0000 7f55269288c0 1 < completed write operation key=YCEKDT5EQD9D tag=T74SHEK9C912 type=write size=993402 2024-04-03T03:46:11.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.781+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~GG510E6SGPN3.0 size=1048576 2024-04-03T03:46:11.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.785+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~GG510E6SGPN3.1 size=864721 2024-04-03T03:46:11.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.785+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=GG510E6SGPN3 tag=ONJZ2TJOCJCJ type=write size=2961873 2024-04-03T03:46:11.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.789+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=PM8WWNAQBQEI type=del 2024-04-03T03:46:11.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.789+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=PPZI0E56X0SI type=del size=3931880 2024-04-03T03:46:11.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.793+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=F8L30ULIG3GU type=del 2024-04-03T03:46:11.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.797+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=BZGZDS1G0SBK type=write size=618522 2024-04-03T03:46:11.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.801+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=SLQ8UVWD91Y0 type=del 2024-04-03T03:46:11.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.805+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=PS0X8P24TK4K type=del size=589726 2024-04-03T03:46:11.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.809+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=AV9ZC923J1OO type=del 2024-04-03T03:46:11.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.809+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=8ZH2W8N639BW type=del size=153433 2024-04-03T03:46:11.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.813+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~PV71JQQVHROP.0 size=1048576 2024-04-03T03:46:11.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.817+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~PV71JQQVHROP.1 size=922537 2024-04-03T03:46:11.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.821+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=PV71JQQVHROP tag=5234KB495A3F type=write size=3019689 2024-04-03T03:46:11.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.825+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~FFF9SAB6RL3Z.0 size=1028527 2024-04-03T03:46:11.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.825+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=FFF9SAB6RL3Z tag=3KQNORUFHGK4 type=write size=2077103 2024-04-03T03:46:11.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.829+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=EKE7DBU43VMC type=del 2024-04-03T03:46:11.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.833+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=6JP9CWG47INJ type=del size=3247049 2024-04-03T03:46:11.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.837+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=I9WEGRC85B7S type=del 2024-04-03T03:46:11.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.841+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~KAOUJQ7496OZ.0 size=1048576 2024-04-03T03:46:11.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.845+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~KAOUJQ7496OZ.1 size=1048576 2024-04-03T03:46:11.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.845+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~KAOUJQ7496OZ.2 size=313688 2024-04-03T03:46:11.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.845+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=KAOUJQ7496OZ tag=YH795XVX14WZ type=write size=3459416 2024-04-03T03:46:11.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.849+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~2SK9SS04HGPF.0 size=745157 2024-04-03T03:46:11.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.853+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=2SK9SS04HGPF tag=16EAKLII7B1J type=write size=1793733 2024-04-03T03:46:11.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.857+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~N0JR9NGGBMVT.0 size=1048576 2024-04-03T03:46:11.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.861+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~N0JR9NGGBMVT.1 size=1048576 2024-04-03T03:46:11.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.861+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~N0JR9NGGBMVT.2 size=784295 2024-04-03T03:46:11.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.861+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=N0JR9NGGBMVT tag=2BPG7SD2GWHE type=write size=3930023 2024-04-03T03:46:11.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.869+0000 7f55269288c0 1 < suggested remove operation key=B5BI0HJ5S1Y1 tag=TJR4HVRU4PCF type=del 2024-04-03T03:46:11.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.873+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~3N5WG8QEW8DP.0 size=1048576 2024-04-03T03:46:11.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.877+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~3N5WG8QEW8DP.1 size=774797 2024-04-03T03:46:11.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.877+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=3N5WG8QEW8DP tag=4AHWKQB3QBMA type=write size=2871949 2024-04-03T03:46:11.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.881+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~IVWWUCIHWHKM.0 size=701662 2024-04-03T03:46:11.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.885+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=IVWWUCIHWHKM tag=7XGQM51E5YRK type=write size=1750238 2024-04-03T03:46:11.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.889+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~C7YY8PO8DKL0.0 size=1048576 2024-04-03T03:46:11.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.893+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~C7YY8PO8DKL0.1 size=1048576 2024-04-03T03:46:11.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.893+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~C7YY8PO8DKL0.2 size=901917 2024-04-03T03:46:11.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.893+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=C7YY8PO8DKL0 tag=K6M6YJI57USU type=write size=4047645 2024-04-03T03:46:11.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.897+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=I06YPKQJK598 type=del 2024-04-03T03:46:11.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.901+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~5D4YV011LLAF.0 size=1048576 2024-04-03T03:46:11.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.905+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~5D4YV011LLAF.1 size=417660 2024-04-03T03:46:11.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.905+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=5D4YV011LLAF tag=SIPGZ7UDJB1E type=write size=2514812 2024-04-03T03:46:11.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.905+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=FWT841D7FARU type=del 2024-04-03T03:46:11.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.913+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~Q8ZNM2PQ6TN3.0 size=1048576 2024-04-03T03:46:11.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.913+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~Q8ZNM2PQ6TN3.1 size=761339 2024-04-03T03:46:11.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.913+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=Q8ZNM2PQ6TN3 tag=5CXB32TS2XQ0 type=write size=2858491 2024-04-03T03:46:11.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.917+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=9168VWHRC6M0 type=del 2024-04-03T03:46:11.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.921+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=BLFBJ9DM0AEE type=del size=2779158 2024-04-03T03:46:11.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.921+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=6DSIGULB5M0A type=del 2024-04-03T03:46:11.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.925+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~FU1A26Z7WPHD.0 size=1048576 2024-04-03T03:46:11.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.929+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~FU1A26Z7WPHD.1 size=646823 2024-04-03T03:46:11.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.929+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=FU1A26Z7WPHD tag=1PA9BAS4I0HR type=write size=2743975 2024-04-03T03:46:11.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.933+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=5NTQXUG84JRM type=del 2024-04-03T03:46:11.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.937+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~CA4XHJNXSLCQ.0 size=1048576 2024-04-03T03:46:11.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.937+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~CA4XHJNXSLCQ.1 size=1048576 2024-04-03T03:46:11.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.941+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~CA4XHJNXSLCQ.2 size=47982 2024-04-03T03:46:11.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.941+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=CA4XHJNXSLCQ tag=UE7421GE92HZ type=write size=3193710 2024-04-03T03:46:11.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.941+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~GG510E6SGPN3.0 size=1048576 2024-04-03T03:46:11.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.945+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~GG510E6SGPN3.1 size=864721 2024-04-03T03:46:11.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.949+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=GG510E6SGPN3 tag=ONJZ2TJOCJCJ type=write size=2961873 2024-04-03T03:46:11.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.953+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=SUZ6EJQ20BMZ type=del size=1011583 2024-04-03T03:46:11.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.957+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=PPZI0E56X0SI type=del 2024-04-03T03:46:11.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.957+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=IMH8YRYY4CNH type=del size=3098142 2024-04-03T03:46:11.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.961+0000 7f55269288c0 1 < completed write operation key=6KH6TASZS3UG tag=BZGZDS1G0SBK type=write size=618522 2024-04-03T03:46:11.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.969+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~O3F1SN0ND4FL.0 size=1048576 2024-04-03T03:46:11.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.969+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~O3F1SN0ND4FL.1 size=379691 2024-04-03T03:46:11.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.969+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=O3F1SN0ND4FL tag=I624U9M2SJFD type=write size=2476843 2024-04-03T03:46:11.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.973+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=PS0X8P24TK4K type=del 2024-04-03T03:46:11.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.977+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=SO5DC961QZ08 type=del size=31157 2024-04-03T03:46:11.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.981+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=8ZH2W8N639BW type=del 2024-04-03T03:46:11.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.985+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~F0TPD8JV34C5.0 size=1048576 2024-04-03T03:46:11.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.989+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~F0TPD8JV34C5.1 size=930372 2024-04-03T03:46:11.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.989+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=F0TPD8JV34C5 tag=GVG10SVAK2N1 type=write size=3027524 2024-04-03T03:46:11.989 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.993+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~FFF9SAB6RL3Z.0 size=1028527 2024-04-03T03:46:11.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:11.997+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=FFF9SAB6RL3Z tag=3KQNORUFHGK4 type=write size=2077103 2024-04-03T03:46:11.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.001+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~JFUCJ4G8MSBP.0 size=108187 2024-04-03T03:46:11.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.001+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=JFUCJ4G8MSBP tag=GVMJS6ME5UVB type=write size=1156763 2024-04-03T03:46:12.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.005+0000 7f55269288c0 1 < suggested remove operation key=3XKXK1JXKOHU tag=6JP9CWG47INJ type=del 2024-04-03T03:46:12.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.009+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=YJR1UAT7U9N8 type=del size=1168718 2024-04-03T03:46:12.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.009+0000 7f55269288c0 1 < canceled part key=_multipart_U62RSK21LJEF.2~KAOUJQ7496OZ.0 size=1048576 2024-04-03T03:46:12.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.013+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~KAOUJQ7496OZ.1 size=1048576 2024-04-03T03:46:12.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.013+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~KAOUJQ7496OZ.2 size=313688 2024-04-03T03:46:12.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.021+0000 7f55269288c0 1 < canceled multipart upload key=U62RSK21LJEF upload=KAOUJQ7496OZ tag=YH795XVX14WZ type=write size=3459416 2024-04-03T03:46:12.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.021+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=K89GUCU5ZWIB type=write size=451773 2024-04-03T03:46:12.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.025+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~N0JR9NGGBMVT.0 size=1048576 2024-04-03T03:46:12.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.025+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~N0JR9NGGBMVT.1 size=1048576 2024-04-03T03:46:12.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.033+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~N0JR9NGGBMVT.2 size=784295 2024-04-03T03:46:12.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.037+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=N0JR9NGGBMVT tag=2BPG7SD2GWHE type=write size=3930023 2024-04-03T03:46:12.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.041+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=P7Z0OD5KLV8I type=del size=3608748 2024-04-03T03:46:12.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.041+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~3N5WG8QEW8DP.0 size=1048576 2024-04-03T03:46:12.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.045+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~3N5WG8QEW8DP.1 size=774797 2024-04-03T03:46:12.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.049+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=3N5WG8QEW8DP tag=4AHWKQB3QBMA type=write size=2871949 2024-04-03T03:46:12.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.049+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=TD5I9FMBNB44 type=del size=640466 2024-04-03T03:46:12.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.053+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~C7YY8PO8DKL0.0 size=1048576 2024-04-03T03:46:12.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.057+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~C7YY8PO8DKL0.1 size=1048576 2024-04-03T03:46:12.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.057+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~C7YY8PO8DKL0.2 size=901917 2024-04-03T03:46:12.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.061+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=C7YY8PO8DKL0 tag=K6M6YJI57USU type=write size=4047645 2024-04-03T03:46:12.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.065+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~N60QN37Q8JE7.0 size=1048576 2024-04-03T03:46:12.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.069+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~N60QN37Q8JE7.1 size=1048576 2024-04-03T03:46:12.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.069+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~N60QN37Q8JE7.2 size=718538 2024-04-03T03:46:12.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.069+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=N60QN37Q8JE7 tag=JBEVDMCTJMLI type=write size=3864266 2024-04-03T03:46:12.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.073+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~5D4YV011LLAF.0 size=1048576 2024-04-03T03:46:12.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.073+0000 7f55269288c0 1 < canceled part key=_multipart_D9OEPPT37WSJ.2~5D4YV011LLAF.1 size=417660 2024-04-03T03:46:12.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.077+0000 7f55269288c0 1 < canceled multipart upload key=D9OEPPT37WSJ upload=5D4YV011LLAF tag=SIPGZ7UDJB1E type=write size=2514812 2024-04-03T03:46:12.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.081+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=QN2ODH0XMMVJ type=del size=2076687 2024-04-03T03:46:12.079 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.081+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~Q8ZNM2PQ6TN3.0 size=1048576 2024-04-03T03:46:12.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.085+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~Q8ZNM2PQ6TN3.1 size=761339 2024-04-03T03:46:12.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.089+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=Q8ZNM2PQ6TN3 tag=5CXB32TS2XQ0 type=write size=2858491 2024-04-03T03:46:12.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.093+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~9H5CT9MO84CA.0 size=358588 2024-04-03T03:46:12.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.093+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=9H5CT9MO84CA tag=3XNHWHO3686K type=write size=1407164 2024-04-03T03:46:12.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.097+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=BLFBJ9DM0AEE type=del 2024-04-03T03:46:12.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.097+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=DLKE3WD2PRTZ type=del size=1979894 2024-04-03T03:46:12.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.101+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~FU1A26Z7WPHD.0 size=1048576 2024-04-03T03:46:12.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.105+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~FU1A26Z7WPHD.1 size=646823 2024-04-03T03:46:12.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.109+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=FU1A26Z7WPHD tag=1PA9BAS4I0HR type=write size=2743975 2024-04-03T03:46:12.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.113+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=7FISZDQRGTVW type=del size=4101751 2024-04-03T03:46:12.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.113+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~CA4XHJNXSLCQ.0 size=1048576 2024-04-03T03:46:12.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.117+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~CA4XHJNXSLCQ.1 size=1048576 2024-04-03T03:46:12.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.117+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~CA4XHJNXSLCQ.2 size=47982 2024-04-03T03:46:12.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.125+0000 7f55269288c0 1 < canceled multipart upload key=0OSIL0R5ZJ54 upload=CA4XHJNXSLCQ tag=UE7421GE92HZ type=write size=3193710 2024-04-03T03:46:12.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.125+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=6HAV84V8113L type=del size=3781275 2024-04-03T03:46:12.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.129+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=SUZ6EJQ20BMZ type=del 2024-04-03T03:46:12.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.133+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~LHRPC6LMZ8OX.0 size=46016 2024-04-03T03:46:12.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.133+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=LHRPC6LMZ8OX tag=XXLRY2SOABD6 type=write size=1094592 2024-04-03T03:46:12.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.137+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=IMH8YRYY4CNH type=del 2024-04-03T03:46:12.138 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.141+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=B9B13GWWD9MY type=del size=3263265 2024-04-03T03:46:12.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.145+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~O3F1SN0ND4FL.0 size=1048576 2024-04-03T03:46:12.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.145+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~O3F1SN0ND4FL.1 size=379691 2024-04-03T03:46:12.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.149+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=O3F1SN0ND4FL tag=I624U9M2SJFD type=write size=2476843 2024-04-03T03:46:12.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.153+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~S3H1DS1JP7PP.0 size=1048576 2024-04-03T03:46:12.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.157+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~S3H1DS1JP7PP.1 size=400878 2024-04-03T03:46:12.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.157+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=S3H1DS1JP7PP tag=TBM5YDIH1OKQ type=write size=2498030 2024-04-03T03:46:12.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.161+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=SO5DC961QZ08 type=del 2024-04-03T03:46:12.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.165+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~3XHAB0WDNXPZ.0 size=1048576 2024-04-03T03:46:12.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.165+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~3XHAB0WDNXPZ.1 size=681342 2024-04-03T03:46:12.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.165+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=3XHAB0WDNXPZ tag=ISNPR3HISXBB type=write size=2778494 2024-04-03T03:46:12.165 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.169+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~F0TPD8JV34C5.0 size=1048576 2024-04-03T03:46:12.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.169+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~F0TPD8JV34C5.1 size=930372 2024-04-03T03:46:12.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.173+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=F0TPD8JV34C5 tag=GVG10SVAK2N1 type=write size=3027524 2024-04-03T03:46:12.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.177+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=UZ4E3YOXPRY2 type=del size=3292412 2024-04-03T03:46:12.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.181+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~JFUCJ4G8MSBP.0 size=108187 2024-04-03T03:46:12.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.185+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=JFUCJ4G8MSBP tag=GVMJS6ME5UVB type=write size=1156763 2024-04-03T03:46:12.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.189+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=PFCW4WXN3DO2 type=del size=207471 2024-04-03T03:46:12.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.189+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=YJR1UAT7U9N8 type=del 2024-04-03T03:46:12.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.193+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=I0FWHD6T74Q3 type=del size=381392 2024-04-03T03:46:12.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.197+0000 7f55269288c0 1 < suggested remove operation key=XFCPX90N2NYC tag=K89GUCU5ZWIB type=write 2024-04-03T03:46:12.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.201+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=0U5HTPFQE5QV type=del size=2540516 2024-04-03T03:46:12.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.209+0000 7f55269288c0 1 < suggested remove operation key=K3Z9W19WEJBM tag=P7Z0OD5KLV8I type=del 2024-04-03T03:46:12.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.209+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=0O2RXSLIGTNB type=write size=111835 2024-04-03T03:46:12.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.217+0000 7f55269288c0 1 < suggested remove operation key=X3YCYKP2P9IM tag=TD5I9FMBNB44 type=del 2024-04-03T03:46:12.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.221+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~D0P1YF0HWM6O.0 size=1048576 2024-04-03T03:46:12.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.225+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~D0P1YF0HWM6O.1 size=999358 2024-04-03T03:46:12.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.225+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=D0P1YF0HWM6O tag=BEOCZ20ILYJ7 type=write size=3096510 2024-04-03T03:46:12.223 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.225+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~N60QN37Q8JE7.0 size=1048576 2024-04-03T03:46:12.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.229+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~N60QN37Q8JE7.1 size=1048576 2024-04-03T03:46:12.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.229+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~N60QN37Q8JE7.2 size=718538 2024-04-03T03:46:12.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.237+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=N60QN37Q8JE7 tag=JBEVDMCTJMLI type=write size=3864266 2024-04-03T03:46:12.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.237+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=YAU36G01ATEY type=write size=195210 2024-04-03T03:46:12.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.241+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=QN2ODH0XMMVJ type=del 2024-04-03T03:46:12.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.245+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~8BTVKW8T6K2B.0 size=1048576 2024-04-03T03:46:12.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.249+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~8BTVKW8T6K2B.1 size=1048576 2024-04-03T03:46:12.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.249+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~8BTVKW8T6K2B.2 size=981013 2024-04-03T03:46:12.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.249+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=8BTVKW8T6K2B tag=ID3RH4TN91GA type=write size=4126741 2024-04-03T03:46:12.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.253+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~9H5CT9MO84CA.0 size=358588 2024-04-03T03:46:12.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.257+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=9H5CT9MO84CA tag=3XNHWHO3686K type=write size=1407164 2024-04-03T03:46:12.257 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.261+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=6OKYID3UX5YL type=del size=3472540 2024-04-03T03:46:12.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.261+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=DLKE3WD2PRTZ type=del 2024-04-03T03:46:12.262 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.265+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=8OTKR06G0G41 type=del size=1101579 2024-04-03T03:46:12.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.269+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=7FISZDQRGTVW type=del 2024-04-03T03:46:12.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.269+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=4LI3K1MCZ8WI type=del size=1571140 2024-04-03T03:46:12.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.273+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=6HAV84V8113L type=del 2024-04-03T03:46:12.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.273+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=OYSWJLMBWWSC type=del size=3360224 2024-04-03T03:46:12.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.277+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~LHRPC6LMZ8OX.0 size=46016 2024-04-03T03:46:12.280 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.285+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=LHRPC6LMZ8OX tag=XXLRY2SOABD6 type=write size=1094592 2024-04-03T03:46:12.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.289+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~IMOQ1HZ3LEP3.0 size=907541 2024-04-03T03:46:12.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.289+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=IMOQ1HZ3LEP3 tag=OC87H8LNAT83 type=write size=1956117 2024-04-03T03:46:12.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.289+0000 7f55269288c0 1 < canceled operation key=Z42NDVEX1SOL tag=B9B13GWWD9MY type=del size=3263265 2024-04-03T03:46:12.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.297+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~0A2NZHEK2WT7.0 size=792876 2024-04-03T03:46:12.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.297+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=0A2NZHEK2WT7 tag=2R2L8R4VWTLE type=write size=1841452 2024-04-03T03:46:12.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.297+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~S3H1DS1JP7PP.0 size=1048576 2024-04-03T03:46:12.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.301+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~S3H1DS1JP7PP.1 size=400878 2024-04-03T03:46:12.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.305+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=S3H1DS1JP7PP tag=TBM5YDIH1OKQ type=write size=2498030 2024-04-03T03:46:12.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.309+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=UY4JJYPN0B0V type=write size=60330 2024-04-03T03:46:12.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.309+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~3XHAB0WDNXPZ.0 size=1048576 2024-04-03T03:46:12.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.313+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~3XHAB0WDNXPZ.1 size=681342 2024-04-03T03:46:12.315 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.317+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=3XHAB0WDNXPZ tag=ISNPR3HISXBB type=write size=2778494 2024-04-03T03:46:12.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.321+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=AIAJOXNP9B8J type=del size=2746706 2024-04-03T03:46:12.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.321+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=UZ4E3YOXPRY2 type=del 2024-04-03T03:46:12.323 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.325+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=1TQ0JR06VJH9 type=del size=902968 2024-04-03T03:46:12.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.329+0000 7f55269288c0 1 < suggested remove operation key=7POFUQ9CX6B1 tag=PFCW4WXN3DO2 type=del 2024-04-03T03:46:12.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.337+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~70TRECA2UQUW.0 size=1048576 2024-04-03T03:46:12.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.337+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~70TRECA2UQUW.1 size=1048576 2024-04-03T03:46:12.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.341+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~70TRECA2UQUW.2 size=56821 2024-04-03T03:46:12.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.341+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=70TRECA2UQUW tag=JXA193ODVLGS type=write size=3202549 2024-04-03T03:46:12.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.345+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=I0FWHD6T74Q3 type=del 2024-04-03T03:46:12.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.345+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=B7BT2D29H7Y2 type=del size=3847030 2024-04-03T03:46:12.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.349+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=0U5HTPFQE5QV type=del 2024-04-03T03:46:12.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.353+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=EHSLSVAASAG6 type=del size=1532354 2024-04-03T03:46:12.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.353+0000 7f55269288c0 1 < completed write operation key=8BMP0HIS520R tag=0O2RXSLIGTNB type=write size=111835 2024-04-03T03:46:12.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.357+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=XT10Q0ETH0G8 type=write size=585130 2024-04-03T03:46:12.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.357+0000 7f55269288c0 1 < canceled part key=_multipart_YCEKDT5EQD9D.2~D0P1YF0HWM6O.0 size=1048576 2024-04-03T03:46:12.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.361+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~D0P1YF0HWM6O.1 size=999358 2024-04-03T03:46:12.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.365+0000 7f55269288c0 1 < canceled multipart upload key=YCEKDT5EQD9D upload=D0P1YF0HWM6O tag=BEOCZ20ILYJ7 type=write size=3096510 2024-04-03T03:46:12.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.369+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~43KKXCUZ1MUZ.0 size=899149 2024-04-03T03:46:12.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.369+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=43KKXCUZ1MUZ tag=ET1RI1ZJEQLW type=write size=1947725 2024-04-03T03:46:12.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.373+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=YAU36G01ATEY type=write size=195210 2024-04-03T03:46:12.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.377+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~XEWT8NDCEK2J.0 size=1048576 2024-04-03T03:46:12.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.381+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~XEWT8NDCEK2J.1 size=633142 2024-04-03T03:46:12.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.381+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=XEWT8NDCEK2J tag=4IOSA1PVW8QN type=write size=2730294 2024-04-03T03:46:12.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.385+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~8BTVKW8T6K2B.0 size=1048576 2024-04-03T03:46:12.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.385+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~8BTVKW8T6K2B.1 size=1048576 2024-04-03T03:46:12.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.389+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~8BTVKW8T6K2B.2 size=981013 2024-04-03T03:46:12.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.393+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=8BTVKW8T6K2B tag=ID3RH4TN91GA type=write size=4126741 2024-04-03T03:46:12.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.401+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~RTDCOXFSEDDB.0 size=1048576 2024-04-03T03:46:12.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.401+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~RTDCOXFSEDDB.1 size=1048576 2024-04-03T03:46:12.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.405+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~RTDCOXFSEDDB.2 size=385845 2024-04-03T03:46:12.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.405+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=RTDCOXFSEDDB tag=ISANS3375ZZM type=write size=3531573 2024-04-03T03:46:12.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.409+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=6OKYID3UX5YL type=del 2024-04-03T03:46:12.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.413+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=MHDXDCP99IOU type=del size=4011100 2024-04-03T03:46:12.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.413+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=8OTKR06G0G41 type=del 2024-04-03T03:46:12.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.417+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=AQBPLK1HB5L0 type=del size=3522214 2024-04-03T03:46:12.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.425+0000 7f55269288c0 1 < suggested remove operation key=YCEKDT5EQD9D tag=4LI3K1MCZ8WI type=del 2024-04-03T03:46:12.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.429+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~TAWKPCGQ8ZQN.0 size=1048576 2024-04-03T03:46:12.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.429+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~TAWKPCGQ8ZQN.1 size=1048576 2024-04-03T03:46:12.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.433+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~TAWKPCGQ8ZQN.2 size=736631 2024-04-03T03:46:12.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.433+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=TAWKPCGQ8ZQN tag=WWRUBEGOANPC type=write size=3882359 2024-04-03T03:46:12.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.437+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=OYSWJLMBWWSC type=del 2024-04-03T03:46:12.439 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.441+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~JGC5YIH5FWT0.0 size=541026 2024-04-03T03:46:12.439 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.441+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=JGC5YIH5FWT0 tag=6FH5P77U0EXW type=write size=1589602 2024-04-03T03:46:12.442 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.445+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~IMOQ1HZ3LEP3.0 size=907541 2024-04-03T03:46:12.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.449+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=IMOQ1HZ3LEP3 tag=OC87H8LNAT83 type=write size=1956117 2024-04-03T03:46:12.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.453+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=S5WMFTG2MILJ type=del size=2563224 2024-04-03T03:46:12.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.457+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~0A2NZHEK2WT7.0 size=792876 2024-04-03T03:46:12.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.461+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=0A2NZHEK2WT7 tag=2R2L8R4VWTLE type=write size=1841452 2024-04-03T03:46:12.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.465+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=TKIFWL1SCRLY type=del size=3727670 2024-04-03T03:46:12.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.469+0000 7f55269288c0 1 < completed write operation key=U62RSK21LJEF tag=UY4JJYPN0B0V type=write size=60330 2024-04-03T03:46:12.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.477+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~FKJ9WL8L0ZY2.0 size=612676 2024-04-03T03:46:12.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.477+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=FKJ9WL8L0ZY2 tag=22EUA6XW6IBU type=write size=1661252 2024-04-03T03:46:12.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.477+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=AIAJOXNP9B8J type=del 2024-04-03T03:46:12.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.485+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~V3VB4QLC0LX1.0 size=1048576 2024-04-03T03:46:12.484 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.485+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~V3VB4QLC0LX1.1 size=1048576 2024-04-03T03:46:12.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.489+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~V3VB4QLC0LX1.2 size=119319 2024-04-03T03:46:12.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.489+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=V3VB4QLC0LX1 tag=0CLFEPUZVGJ6 type=write size=3265047 2024-04-03T03:46:12.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.493+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=1TQ0JR06VJH9 type=del 2024-04-03T03:46:12.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.497+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~OVHA3APL8ZBZ.0 size=1048576 2024-04-03T03:46:12.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.501+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~OVHA3APL8ZBZ.1 size=1048576 2024-04-03T03:46:12.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.501+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~OVHA3APL8ZBZ.2 size=856855 2024-04-03T03:46:12.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.501+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=OVHA3APL8ZBZ tag=CXU4N3E5NSLO type=write size=4002583 2024-04-03T03:46:12.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.505+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~70TRECA2UQUW.0 size=1048576 2024-04-03T03:46:12.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.505+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~70TRECA2UQUW.1 size=1048576 2024-04-03T03:46:12.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.509+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~70TRECA2UQUW.2 size=56821 2024-04-03T03:46:12.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.513+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=70TRECA2UQUW tag=JXA193ODVLGS type=write size=3202549 2024-04-03T03:46:12.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.517+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=5UABVRIY2LUZ type=del size=1657067 2024-04-03T03:46:12.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.521+0000 7f55269288c0 1 < canceled operation key=MB7HTWATXRMB tag=B7BT2D29H7Y2 type=del size=3847030 2024-04-03T03:46:12.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.521+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=EAOAI9I9VX4W type=write size=426395 2024-04-03T03:46:12.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.529+0000 7f55269288c0 1 < suggested remove operation key=TLM1C3B9J2A3 tag=EHSLSVAASAG6 type=del 2024-04-03T03:46:12.527 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.529+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=CCDF8VULOPHS type=write size=48592 2024-04-03T03:46:12.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.533+0000 7f55269288c0 1 < completed write operation key=LZQGL2UAWOTU tag=XT10Q0ETH0G8 type=write size=585130 2024-04-03T03:46:12.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.537+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=SN3MBJJROB1X type=del size=826891 2024-04-03T03:46:12.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.537+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~43KKXCUZ1MUZ.0 size=899149 2024-04-03T03:46:12.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.541+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=43KKXCUZ1MUZ tag=ET1RI1ZJEQLW type=write size=1947725 2024-04-03T03:46:12.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.549+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~897N6C0AKPHD.0 size=733064 2024-04-03T03:46:12.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.549+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=897N6C0AKPHD tag=SKZWY86I5W6Z type=write size=1781640 2024-04-03T03:46:12.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.553+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~XEWT8NDCEK2J.0 size=1048576 2024-04-03T03:46:12.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.557+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~XEWT8NDCEK2J.1 size=633142 2024-04-03T03:46:12.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.561+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=XEWT8NDCEK2J tag=4IOSA1PVW8QN type=write size=2730294 2024-04-03T03:46:12.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.565+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=4R4YBM6H2AJ2 type=del size=745883 2024-04-03T03:46:12.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.569+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~RTDCOXFSEDDB.0 size=1048576 2024-04-03T03:46:12.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.569+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~RTDCOXFSEDDB.1 size=1048576 2024-04-03T03:46:12.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.573+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~RTDCOXFSEDDB.2 size=385845 2024-04-03T03:46:12.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.577+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=RTDCOXFSEDDB tag=ISANS3375ZZM type=write size=3531573 2024-04-03T03:46:12.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.581+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~Y3BM69H5E1VR.0 size=1048576 2024-04-03T03:46:12.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.585+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~Y3BM69H5E1VR.1 size=1048576 2024-04-03T03:46:12.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.585+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~Y3BM69H5E1VR.2 size=956190 2024-04-03T03:46:12.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.585+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=Y3BM69H5E1VR tag=80DCKY7EEVYA type=write size=4101918 2024-04-03T03:46:12.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.589+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=MHDXDCP99IOU type=del 2024-04-03T03:46:12.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.597+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~KTBTPAX52RV7.0 size=160941 2024-04-03T03:46:12.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.597+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=KTBTPAX52RV7 tag=AI9DEVCND03Z type=write size=1209517 2024-04-03T03:46:12.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.601+0000 7f55269288c0 1 < suggested update operation key=8SBTVHL09P63 tag=AQBPLK1HB5L0 type=del size=3522214 2024-04-03T03:46:12.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.605+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=7TH7I9K5BVIB type=del size=2206398 2024-04-03T03:46:12.605 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.609+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~TAWKPCGQ8ZQN.0 size=1048576 2024-04-03T03:46:12.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.609+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~TAWKPCGQ8ZQN.1 size=1048576 2024-04-03T03:46:12.610 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.613+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~TAWKPCGQ8ZQN.2 size=736631 2024-04-03T03:46:12.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.617+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=TAWKPCGQ8ZQN tag=WWRUBEGOANPC type=write size=3882359 2024-04-03T03:46:12.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.621+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=CCFH1LM66I5F type=del size=2130772 2024-04-03T03:46:12.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.625+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~JGC5YIH5FWT0.0 size=541026 2024-04-03T03:46:12.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.629+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=JGC5YIH5FWT0 tag=6FH5P77U0EXW type=write size=1589602 2024-04-03T03:46:12.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.637+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~2BSRF55P5X1Z.0 size=1042543 2024-04-03T03:46:12.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.637+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=2BSRF55P5X1Z tag=ODOCQO5F8D9Y type=write size=2091119 2024-04-03T03:46:12.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.637+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=S5WMFTG2MILJ type=del 2024-04-03T03:46:12.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.645+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~Q2DPK63NMOAK.0 size=1048576 2024-04-03T03:46:12.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.649+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~Q2DPK63NMOAK.1 size=1048576 2024-04-03T03:46:12.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.649+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~Q2DPK63NMOAK.2 size=1006366 2024-04-03T03:46:12.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.649+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=Q2DPK63NMOAK tag=2R3NFM9DUTE1 type=write size=4152094 2024-04-03T03:46:12.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.653+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=TKIFWL1SCRLY type=del 2024-04-03T03:46:12.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.657+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=7Z96Z3G3UBXD type=del size=1396877 2024-04-03T03:46:12.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.661+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~FKJ9WL8L0ZY2.0 size=612676 2024-04-03T03:46:12.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.665+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=FKJ9WL8L0ZY2 tag=22EUA6XW6IBU type=write size=1661252 2024-04-03T03:46:12.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.669+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~V1B32FRTS1DF.0 size=181476 2024-04-03T03:46:12.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.669+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=V1B32FRTS1DF tag=KCOYB7JQC0XF type=write size=1230052 2024-04-03T03:46:12.671 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.673+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~V3VB4QLC0LX1.0 size=1048576 2024-04-03T03:46:12.671 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.673+0000 7f55269288c0 1 < canceled part key=_multipart_U62RSK21LJEF.2~V3VB4QLC0LX1.1 size=1048576 2024-04-03T03:46:12.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.677+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~V3VB4QLC0LX1.2 size=119319 2024-04-03T03:46:12.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.681+0000 7f55269288c0 1 < canceled multipart upload key=U62RSK21LJEF upload=V3VB4QLC0LX1 tag=0CLFEPUZVGJ6 type=write size=3265047 2024-04-03T03:46:12.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.685+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=ZEL48V12ZEI5 type=del size=1957885 2024-04-03T03:46:12.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.689+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~OVHA3APL8ZBZ.0 size=1048576 2024-04-03T03:46:12.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.689+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~OVHA3APL8ZBZ.1 size=1048576 2024-04-03T03:46:12.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.693+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~OVHA3APL8ZBZ.2 size=856855 2024-04-03T03:46:12.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.701+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=OVHA3APL8ZBZ tag=CXU4N3E5NSLO type=write size=4002583 2024-04-03T03:46:12.702 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.705+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~OA147QE41B8E.0 size=1048576 2024-04-03T03:46:12.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.705+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~OA147QE41B8E.1 size=1048576 2024-04-03T03:46:12.707 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.709+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~OA147QE41B8E.2 size=837630 2024-04-03T03:46:12.707 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.709+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=OA147QE41B8E tag=XUVSHY0VF5O1 type=write size=3983358 2024-04-03T03:46:12.710 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.713+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=5UABVRIY2LUZ type=del 2024-04-03T03:46:12.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.717+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~A77DWIAQI7M3.0 size=861022 2024-04-03T03:46:12.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.717+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=A77DWIAQI7M3 tag=G6A3QERSRVOQ type=write size=1909598 2024-04-03T03:46:12.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.721+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=EAOAI9I9VX4W type=write size=426395 2024-04-03T03:46:12.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.729+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~331T9WNNUCJH.0 size=1048576 2024-04-03T03:46:12.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.729+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~331T9WNNUCJH.1 size=404195 2024-04-03T03:46:12.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.729+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=331T9WNNUCJH tag=3ZPRFMP17WGM type=write size=2501347 2024-04-03T03:46:12.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.733+0000 7f55269288c0 1 < completed write operation key=MB7HTWATXRMB tag=CCDF8VULOPHS type=write size=48592 2024-04-03T03:46:12.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.737+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=B1NYHKFIE4VN type=del size=4119717 2024-04-03T03:46:12.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.741+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=SN3MBJJROB1X type=del 2024-04-03T03:46:12.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.745+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~1YYG8N2HR2Z6.0 size=747004 2024-04-03T03:46:12.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.745+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=1YYG8N2HR2Z6 tag=GEB7NZ1HRPNK type=write size=1795580 2024-04-03T03:46:12.744 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.745+0000 7f55269288c0 1 < canceled part key=_multipart_TXFMKXUGMEA8.2~897N6C0AKPHD.0 size=733064 2024-04-03T03:46:12.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.749+0000 7f55269288c0 1 < canceled multipart upload key=TXFMKXUGMEA8 upload=897N6C0AKPHD tag=SKZWY86I5W6Z type=write size=1781640 2024-04-03T03:46:12.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.753+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=QGWW0NC9G0FE type=del size=650376 2024-04-03T03:46:12.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.757+0000 7f55269288c0 1 < canceled operation key=U62RSK21LJEF tag=4R4YBM6H2AJ2 type=del size=745883 2024-04-03T03:46:12.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.761+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=L3QRVJWOYLVJ type=del size=1836303 2024-04-03T03:46:12.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.761+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~Y3BM69H5E1VR.0 size=1048576 2024-04-03T03:46:12.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.765+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~Y3BM69H5E1VR.1 size=1048576 2024-04-03T03:46:12.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.765+0000 7f55269288c0 1 < canceled part key=_multipart_AXL5RVPSVDY5.2~Y3BM69H5E1VR.2 size=956190 2024-04-03T03:46:12.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.769+0000 7f55269288c0 1 < canceled multipart upload key=AXL5RVPSVDY5 upload=Y3BM69H5E1VR tag=80DCKY7EEVYA type=write size=4101918 2024-04-03T03:46:12.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.773+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=AJCM01703WIK type=del size=404412 2024-04-03T03:46:12.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.777+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~KTBTPAX52RV7.0 size=160941 2024-04-03T03:46:12.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.781+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=KTBTPAX52RV7 tag=AI9DEVCND03Z type=write size=1209517 2024-04-03T03:46:12.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.789+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~WP9B93U4CDIN.0 size=1048576 2024-04-03T03:46:12.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.789+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~WP9B93U4CDIN.1 size=129248 2024-04-03T03:46:12.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.789+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=WP9B93U4CDIN tag=0MYY3MDTHM1T type=write size=2226400 2024-04-03T03:46:12.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.793+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=7TH7I9K5BVIB type=del 2024-04-03T03:46:12.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.797+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=D1A3ABU1HXH1 type=del size=2690768 2024-04-03T03:46:12.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.801+0000 7f55269288c0 1 < suggested update operation key=U62RSK21LJEF tag=CCFH1LM66I5F type=del size=2130772 2024-04-03T03:46:12.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.805+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=EIPBWVYS9722 type=del size=862253 2024-04-03T03:46:12.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.809+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~2BSRF55P5X1Z.0 size=1042543 2024-04-03T03:46:12.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.813+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=2BSRF55P5X1Z tag=ODOCQO5F8D9Y type=write size=2091119 2024-04-03T03:46:12.812 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.817+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=SKJY0BE7YV6U type=del size=1828878 2024-04-03T03:46:12.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.817+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~Q2DPK63NMOAK.0 size=1048576 2024-04-03T03:46:12.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.817+0000 7f55269288c0 1 < canceled part key=_multipart_3XKXK1JXKOHU.2~Q2DPK63NMOAK.1 size=1048576 2024-04-03T03:46:12.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.821+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~Q2DPK63NMOAK.2 size=1006366 2024-04-03T03:46:12.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.825+0000 7f55269288c0 1 < canceled multipart upload key=3XKXK1JXKOHU upload=Q2DPK63NMOAK tag=2R3NFM9DUTE1 type=write size=4152094 2024-04-03T03:46:12.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.829+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=F2QNFUCSVKGL type=del size=3009579 2024-04-03T03:46:12.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.837+0000 7f55269288c0 1 < suggested update operation key=KDSE2XB4D1XI tag=7Z96Z3G3UBXD type=del size=1396877 2024-04-03T03:46:12.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.849+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~MW0F2QTTAHSB.0 size=1048576 2024-04-03T03:46:12.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.849+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~MW0F2QTTAHSB.1 size=1048576 2024-04-03T03:46:12.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.853+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~MW0F2QTTAHSB.2 size=307422 2024-04-03T03:46:12.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.853+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=MW0F2QTTAHSB tag=PEXEA08E9233 type=write size=3453150 2024-04-03T03:46:12.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.853+0000 7f55269288c0 1 < canceled part key=_multipart_TLM1C3B9J2A3.2~V1B32FRTS1DF.0 size=181476 2024-04-03T03:46:12.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.857+0000 7f55269288c0 1 < canceled multipart upload key=TLM1C3B9J2A3 upload=V1B32FRTS1DF tag=KCOYB7JQC0XF type=write size=1230052 2024-04-03T03:46:12.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.861+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=J5GR8ESNNAS6 type=del size=1399393 2024-04-03T03:46:12.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.865+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=ZEL48V12ZEI5 type=del 2024-04-03T03:46:12.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.869+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=S57LY04IFK01 type=del size=2845123 2024-04-03T03:46:12.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.873+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~OA147QE41B8E.0 size=1048576 2024-04-03T03:46:12.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.873+0000 7f55269288c0 1 < canceled part key=_multipart_TLM1C3B9J2A3.2~OA147QE41B8E.1 size=1048576 2024-04-03T03:46:12.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.873+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~OA147QE41B8E.2 size=837630 2024-04-03T03:46:12.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.881+0000 7f55269288c0 1 < canceled multipart upload key=TLM1C3B9J2A3 upload=OA147QE41B8E tag=XUVSHY0VF5O1 type=write size=3983358 2024-04-03T03:46:12.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.885+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~J3HXYUBY4S33.0 size=1048576 2024-04-03T03:46:12.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.885+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~J3HXYUBY4S33.1 size=251850 2024-04-03T03:46:12.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.885+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=J3HXYUBY4S33 tag=ABOU0M9JPHVL type=write size=2349002 2024-04-03T03:46:12.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.889+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~A77DWIAQI7M3.0 size=861022 2024-04-03T03:46:12.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.893+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=A77DWIAQI7M3 tag=G6A3QERSRVOQ type=write size=1909598 2024-04-03T03:46:12.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.901+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~Y2B9VS2USZDN.0 size=1030189 2024-04-03T03:46:12.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.901+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=Y2B9VS2USZDN tag=0OUADXYHKV4N type=write size=2078765 2024-04-03T03:46:12.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.905+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~331T9WNNUCJH.0 size=1048576 2024-04-03T03:46:12.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.905+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~331T9WNNUCJH.1 size=404195 2024-04-03T03:46:12.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.909+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=331T9WNNUCJH tag=3ZPRFMP17WGM type=write size=2501347 2024-04-03T03:46:12.913 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.917+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~V1YH5E38H801.0 size=895289 2024-04-03T03:46:12.913 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.917+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=V1YH5E38H801 tag=5PXGG5DPPH07 type=write size=1943865 2024-04-03T03:46:12.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.921+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=B1NYHKFIE4VN type=del size=4119717 2024-04-03T03:46:12.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.925+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~TTCWI9TNO0N0.0 size=474282 2024-04-03T03:46:12.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.925+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=TTCWI9TNO0N0 tag=W9KUS3CNS1Z9 type=write size=1522858 2024-04-03T03:46:12.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.925+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~1YYG8N2HR2Z6.0 size=747004 2024-04-03T03:46:12.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.933+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=1YYG8N2HR2Z6 tag=GEB7NZ1HRPNK type=write size=1795580 2024-04-03T03:46:12.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.933+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=853RSZ56OR2E type=del size=631166 2024-04-03T03:46:12.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.941+0000 7f55269288c0 1 < suggested remove operation key=K7A1O21ZURWQ tag=QGWW0NC9G0FE type=del 2024-04-03T03:46:12.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.941+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=03DMIU5JPJD3 type=del size=3364030 2024-04-03T03:46:12.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.945+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=L3QRVJWOYLVJ type=del 2024-04-03T03:46:12.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.949+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=QDVXQ0NWTIP3 type=del size=4051155 2024-04-03T03:46:12.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.953+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=AJCM01703WIK type=del 2024-04-03T03:46:12.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.953+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=VPOA6AKYCGLJ type=del size=3070889 2024-04-03T03:46:12.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.957+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~WP9B93U4CDIN.0 size=1048576 2024-04-03T03:46:12.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.961+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~WP9B93U4CDIN.1 size=129248 2024-04-03T03:46:12.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.965+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=WP9B93U4CDIN tag=0MYY3MDTHM1T type=write size=2226400 2024-04-03T03:46:12.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.969+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=K1GED5VB4TSR type=del size=634516 2024-04-03T03:46:12.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.969+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=D1A3ABU1HXH1 type=del 2024-04-03T03:46:12.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.973+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=K8OZ8TG85LN3 type=write size=61116 2024-04-03T03:46:12.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.977+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=EIPBWVYS9722 type=del 2024-04-03T03:46:12.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.981+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~1TLXVPK56V53.0 size=1048576 2024-04-03T03:46:12.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.985+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~1TLXVPK56V53.1 size=96826 2024-04-03T03:46:12.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.985+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=1TLXVPK56V53 tag=NT3OY4KJ6430 type=write size=2193978 2024-04-03T03:46:12.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.985+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=SKJY0BE7YV6U type=del 2024-04-03T03:46:12.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.993+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~X68DW6C31KCU.0 size=1048576 2024-04-03T03:46:12.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.997+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~X68DW6C31KCU.1 size=1048576 2024-04-03T03:46:12.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.997+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~X68DW6C31KCU.2 size=552570 2024-04-03T03:46:12.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:12.997+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=X68DW6C31KCU tag=6RYQ1WFI9PO4 type=write size=3698298 2024-04-03T03:46:12.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.001+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=F2QNFUCSVKGL type=del 2024-04-03T03:46:13.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.005+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~90HMNDCF0DTD.0 size=659868 2024-04-03T03:46:13.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.005+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=90HMNDCF0DTD tag=L3L9GHZ5W15A type=write size=1708444 2024-04-03T03:46:13.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.009+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~MW0F2QTTAHSB.0 size=1048576 2024-04-03T03:46:13.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.013+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~MW0F2QTTAHSB.1 size=1048576 2024-04-03T03:46:13.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.013+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~MW0F2QTTAHSB.2 size=307422 2024-04-03T03:46:13.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.021+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=MW0F2QTTAHSB tag=PEXEA08E9233 type=write size=3453150 2024-04-03T03:46:13.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.025+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=TUYUA6417VHL type=write size=5285 2024-04-03T03:46:13.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.029+0000 7f55269288c0 1 < suggested update operation key=MB7HTWATXRMB tag=J5GR8ESNNAS6 type=del size=1399393 2024-04-03T03:46:13.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.033+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=1ALCHKC7JOZM type=del size=905531 2024-04-03T03:46:13.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.037+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=S57LY04IFK01 type=del 2024-04-03T03:46:13.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.041+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~2PR9XZDH5XGQ.0 size=990871 2024-04-03T03:46:13.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.041+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=2PR9XZDH5XGQ tag=JE6F2V9O2AXO type=write size=2039447 2024-04-03T03:46:13.043 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.045+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~J3HXYUBY4S33.0 size=1048576 2024-04-03T03:46:13.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.049+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~J3HXYUBY4S33.1 size=251850 2024-04-03T03:46:13.052 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.053+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=J3HXYUBY4S33 tag=ABOU0M9JPHVL type=write size=2349002 2024-04-03T03:46:13.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.061+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~YRRFT59ROFAL.0 size=1048576 2024-04-03T03:46:13.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.065+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~YRRFT59ROFAL.1 size=682532 2024-04-03T03:46:13.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.065+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=YRRFT59ROFAL tag=IGRDM1NU1SJ7 type=write size=2779684 2024-04-03T03:46:13.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.069+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~Y2B9VS2USZDN.0 size=1030189 2024-04-03T03:46:13.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.073+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=Y2B9VS2USZDN tag=0OUADXYHKV4N type=write size=2078765 2024-04-03T03:46:13.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.077+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=JKZXQ7SJFGLC type=del size=1663498 2024-04-03T03:46:13.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.081+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~V1YH5E38H801.0 size=895289 2024-04-03T03:46:13.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.085+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=V1YH5E38H801 tag=5PXGG5DPPH07 type=write size=1943865 2024-04-03T03:46:13.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.089+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=TPNHS7QCRKRH type=del size=4044954 2024-04-03T03:46:13.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.093+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~TTCWI9TNO0N0.0 size=474282 2024-04-03T03:46:13.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.097+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=TTCWI9TNO0N0 tag=W9KUS3CNS1Z9 type=write size=1522858 2024-04-03T03:46:13.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.101+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=FDVINA5MW250 type=write size=310325 2024-04-03T03:46:13.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.101+0000 7f55269288c0 1 < canceled operation key=8BMP0HIS520R tag=853RSZ56OR2E type=del size=631166 2024-04-03T03:46:13.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.105+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=R32QBDV4Q3S2 type=del size=803128 2024-04-03T03:46:13.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.109+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=03DMIU5JPJD3 type=del 2024-04-03T03:46:13.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.113+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~J5X9U52BFL69.0 size=1048576 2024-04-03T03:46:13.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.117+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~J5X9U52BFL69.1 size=652608 2024-04-03T03:46:13.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.117+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=J5X9U52BFL69 tag=THBH8650LJDE type=write size=2749760 2024-04-03T03:46:13.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.117+0000 7f55269288c0 1 < canceled operation key=YCEKDT5EQD9D tag=QDVXQ0NWTIP3 type=del size=4051155 2024-04-03T03:46:13.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.121+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=DQ2XOASQ8TUQ type=del size=3267645 2024-04-03T03:46:13.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.129+0000 7f55269288c0 1 < suggested remove operation key=MB7HTWATXRMB tag=VPOA6AKYCGLJ type=del 2024-04-03T03:46:13.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.133+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=R1PBAQM6MP2F type=del size=801687 2024-04-03T03:46:13.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.137+0000 7f55269288c0 1 < suggested update operation key=D8W2ZKIZFI8H tag=K1GED5VB4TSR type=del size=634516 2024-04-03T03:46:13.138 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.141+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=BWOZBP187W94 type=del size=1156229 2024-04-03T03:46:13.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.145+0000 7f55269288c0 1 < canceled operation key=8BMP0HIS520R tag=K8OZ8TG85LN3 type=write size=61116 2024-04-03T03:46:13.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.149+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~EKGOOIMXI5S4.0 size=1048576 2024-04-03T03:46:13.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.153+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~EKGOOIMXI5S4.1 size=919929 2024-04-03T03:46:13.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.153+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=EKGOOIMXI5S4 tag=XR2AOHDYV2FQ type=write size=3017081 2024-04-03T03:46:13.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.153+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~1TLXVPK56V53.0 size=1048576 2024-04-03T03:46:13.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.157+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~1TLXVPK56V53.1 size=96826 2024-04-03T03:46:13.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.161+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=1TLXVPK56V53 tag=NT3OY4KJ6430 type=write size=2193978 2024-04-03T03:46:13.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.165+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=MBATLOQ8356H type=del size=2572686 2024-04-03T03:46:13.165 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.169+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~X68DW6C31KCU.0 size=1048576 2024-04-03T03:46:13.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.169+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~X68DW6C31KCU.1 size=1048576 2024-04-03T03:46:13.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.173+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~X68DW6C31KCU.2 size=552570 2024-04-03T03:46:13.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.177+0000 7f55269288c0 1 < completed multipart upload key=7POFUQ9CX6B1 upload=X68DW6C31KCU tag=6RYQ1WFI9PO4 type=write size=3698298 2024-04-03T03:46:13.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.181+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=798SFPB7A5EB type=del size=2132732 2024-04-03T03:46:13.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.181+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~90HMNDCF0DTD.0 size=659868 2024-04-03T03:46:13.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.185+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=90HMNDCF0DTD tag=L3L9GHZ5W15A type=write size=1708444 2024-04-03T03:46:13.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.193+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~J834P0IJG5AU.0 size=1048576 2024-04-03T03:46:13.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.193+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~J834P0IJG5AU.1 size=1048576 2024-04-03T03:46:13.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.197+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~J834P0IJG5AU.2 size=691864 2024-04-03T03:46:13.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.197+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=J834P0IJG5AU tag=YTTY65CV2TQK type=write size=3837592 2024-04-03T03:46:13.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.201+0000 7f55269288c0 1 < completed write operation key=TXFMKXUGMEA8 tag=TUYUA6417VHL type=write size=5285 2024-04-03T03:46:13.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.205+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=JWBE7V3PSR4J type=del size=4125928 2024-04-03T03:46:13.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.205+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=1ALCHKC7JOZM type=del 2024-04-03T03:46:13.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.209+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=JVFTOUV2M73S type=del size=1504855 2024-04-03T03:46:13.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.213+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~2PR9XZDH5XGQ.0 size=990871 2024-04-03T03:46:13.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.217+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=2PR9XZDH5XGQ tag=JE6F2V9O2AXO type=write size=2039447 2024-04-03T03:46:13.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.221+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=9RJNC6XHPTVY type=write size=464082 2024-04-03T03:46:13.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.225+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~YRRFT59ROFAL.0 size=1048576 2024-04-03T03:46:13.223 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.225+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~YRRFT59ROFAL.1 size=682532 2024-04-03T03:46:13.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.233+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=YRRFT59ROFAL tag=IGRDM1NU1SJ7 type=write size=2779684 2024-04-03T03:46:13.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.233+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=IO0U7ES53QY4 type=del size=99203 2024-04-03T03:46:13.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.237+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=JKZXQ7SJFGLC type=del 2024-04-03T03:46:13.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.241+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=MWA1JU68I7I3 type=del size=630362 2024-04-03T03:46:13.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.245+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=TPNHS7QCRKRH type=del 2024-04-03T03:46:13.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.249+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~JDCWISCITZSA.0 size=1048576 2024-04-03T03:46:13.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.253+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~JDCWISCITZSA.1 size=1048576 2024-04-03T03:46:13.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.253+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~JDCWISCITZSA.2 size=820049 2024-04-03T03:46:13.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.253+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=JDCWISCITZSA tag=D6F24RN6POH0 type=write size=3965777 2024-04-03T03:46:13.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.261+0000 7f55269288c0 1 < suggested remove operation key=YCEKDT5EQD9D tag=FDVINA5MW250 type=write 2024-04-03T03:46:13.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.265+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~CDQX1EBX2Z4D.0 size=1048576 2024-04-03T03:46:13.266 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.269+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~CDQX1EBX2Z4D.1 size=369562 2024-04-03T03:46:13.266 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.269+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=CDQX1EBX2Z4D tag=1XUQ1T982Z3A type=write size=2466714 2024-04-03T03:46:13.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.273+0000 7f55269288c0 1 < canceled operation key=LZQGL2UAWOTU tag=R32QBDV4Q3S2 type=del size=803128 2024-04-03T03:46:13.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.277+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=96UQ9WA8H5D3 type=del size=2629068 2024-04-03T03:46:13.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.277+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~J5X9U52BFL69.0 size=1048576 2024-04-03T03:46:13.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.281+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~J5X9U52BFL69.1 size=652608 2024-04-03T03:46:13.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.285+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=J5X9U52BFL69 tag=THBH8650LJDE type=write size=2749760 2024-04-03T03:46:13.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.293+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~NLRMPOEQZT4B.0 size=584978 2024-04-03T03:46:13.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.293+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=NLRMPOEQZT4B tag=9IMFYK81RPZK type=write size=1633554 2024-04-03T03:46:13.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.293+0000 7f55269288c0 1 < canceled operation key=B5BI0HJ5S1Y1 tag=DQ2XOASQ8TUQ type=del size=3267645 2024-04-03T03:46:13.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.301+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~VPWUZRPRA5S2.0 size=1048576 2024-04-03T03:46:13.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.301+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~VPWUZRPRA5S2.1 size=236853 2024-04-03T03:46:13.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.301+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=VPWUZRPRA5S2 tag=SRI2CEXHA1T3 type=write size=2334005 2024-04-03T03:46:13.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.305+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=R1PBAQM6MP2F type=del 2024-04-03T03:46:13.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.305+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=WL72P5MIRFDU type=del size=1669781 2024-04-03T03:46:13.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.309+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=BWOZBP187W94 type=del 2024-04-03T03:46:13.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.313+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=XIJIAWVCL5RB type=del size=3227835 2024-04-03T03:46:13.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.313+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~EKGOOIMXI5S4.0 size=1048576 2024-04-03T03:46:13.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.317+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~EKGOOIMXI5S4.1 size=919929 2024-04-03T03:46:13.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.321+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=EKGOOIMXI5S4 tag=XR2AOHDYV2FQ type=write size=3017081 2024-04-03T03:46:13.323 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.325+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~1UH05MWYTIVJ.0 size=869749 2024-04-03T03:46:13.323 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.325+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=1UH05MWYTIVJ tag=SUK2O7BCLOUC type=write size=1918325 2024-04-03T03:46:13.325 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.329+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=MBATLOQ8356H type=del 2024-04-03T03:46:13.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.329+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=HLMIU44OC1YU type=del size=3136495 2024-04-03T03:46:13.330 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.333+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=798SFPB7A5EB type=del 2024-04-03T03:46:13.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.337+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~07KBQ817S01O.0 size=1048576 2024-04-03T03:46:13.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.341+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~07KBQ817S01O.1 size=1048576 2024-04-03T03:46:13.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.341+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~07KBQ817S01O.2 size=846256 2024-04-03T03:46:13.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.341+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=07KBQ817S01O tag=8H7R9VZLBKTF type=write size=3991984 2024-04-03T03:46:13.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.341+0000 7f55269288c0 1 < canceled part key=_multipart_MLTDNCZ4E5D8.2~J834P0IJG5AU.0 size=1048576 2024-04-03T03:46:13.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.345+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~J834P0IJG5AU.1 size=1048576 2024-04-03T03:46:13.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.345+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~J834P0IJG5AU.2 size=691864 2024-04-03T03:46:13.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.349+0000 7f55269288c0 1 < canceled multipart upload key=MLTDNCZ4E5D8 upload=J834P0IJG5AU tag=YTTY65CV2TQK type=write size=3837592 2024-04-03T03:46:13.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.353+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=0JJJ196BUZ8L type=del size=271309 2024-04-03T03:46:13.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.357+0000 7f55269288c0 1 < canceled operation key=XFCPX90N2NYC tag=JWBE7V3PSR4J type=del size=4125928 2024-04-03T03:46:13.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.361+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~3OT7S0DFVF4O.0 size=1048576 2024-04-03T03:46:13.359 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.361+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~3OT7S0DFVF4O.1 size=551531 2024-04-03T03:46:13.359 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.361+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=3OT7S0DFVF4O tag=727WJCIRJM75 type=write size=2648683 2024-04-03T03:46:13.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.365+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=JVFTOUV2M73S type=del 2024-04-03T03:46:13.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.369+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=30X220Q3RZFG type=write size=139206 2024-04-03T03:46:13.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.369+0000 7f55269288c0 1 < completed write operation key=0OSIL0R5ZJ54 tag=9RJNC6XHPTVY type=write size=464082 2024-04-03T03:46:13.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.377+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~6NWBHJ25LKSN.0 size=1048576 2024-04-03T03:46:13.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.377+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~6NWBHJ25LKSN.1 size=473215 2024-04-03T03:46:13.376 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.377+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=6NWBHJ25LKSN tag=UA9DIFYVCUFG type=write size=2570367 2024-04-03T03:46:13.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.381+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=IO0U7ES53QY4 type=del 2024-04-03T03:46:13.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.385+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=NTVDPRF2ULGS type=del size=2481525 2024-04-03T03:46:13.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.385+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=MWA1JU68I7I3 type=del 2024-04-03T03:46:13.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.397+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~XYB6K87YYUOM.0 size=1048576 2024-04-03T03:46:13.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.397+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~XYB6K87YYUOM.1 size=1048576 2024-04-03T03:46:13.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.401+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~XYB6K87YYUOM.2 size=229107 2024-04-03T03:46:13.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.401+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=XYB6K87YYUOM tag=58X9K59VXBPD type=write size=3374835 2024-04-03T03:46:13.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.401+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~JDCWISCITZSA.0 size=1048576 2024-04-03T03:46:13.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.405+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~JDCWISCITZSA.1 size=1048576 2024-04-03T03:46:13.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.409+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~JDCWISCITZSA.2 size=820049 2024-04-03T03:46:13.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.413+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=JDCWISCITZSA tag=D6F24RN6POH0 type=write size=3965777 2024-04-03T03:46:13.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.417+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~7U8ZV34DXVN0.0 size=1048576 2024-04-03T03:46:13.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.417+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~7U8ZV34DXVN0.1 size=1048576 2024-04-03T03:46:13.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.421+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~7U8ZV34DXVN0.2 size=314489 2024-04-03T03:46:13.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.421+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=7U8ZV34DXVN0 tag=LP3TNP2Q6ZUM type=write size=3460217 2024-04-03T03:46:13.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.425+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~CDQX1EBX2Z4D.0 size=1048576 2024-04-03T03:46:13.424 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.425+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~CDQX1EBX2Z4D.1 size=369562 2024-04-03T03:46:13.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.429+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=CDQX1EBX2Z4D tag=1XUQ1T982Z3A type=write size=2466714 2024-04-03T03:46:13.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.433+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=DFJQFJ5BEIUO type=del size=2016677 2024-04-03T03:46:13.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.437+0000 7f55269288c0 1 < suggested remove operation key=Z42NDVEX1SOL tag=96UQ9WA8H5D3 type=del 2024-04-03T03:46:13.438 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.441+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=POXBYBRBG7OD type=write size=569448 2024-04-03T03:46:13.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.445+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~NLRMPOEQZT4B.0 size=584978 2024-04-03T03:46:13.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.449+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=NLRMPOEQZT4B tag=9IMFYK81RPZK type=write size=1633554 2024-04-03T03:46:13.447 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.449+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=YVYYIUBJYTSG type=del size=320519 2024-04-03T03:46:13.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.453+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~VPWUZRPRA5S2.0 size=1048576 2024-04-03T03:46:13.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.453+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~VPWUZRPRA5S2.1 size=236853 2024-04-03T03:46:13.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.457+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=VPWUZRPRA5S2 tag=SRI2CEXHA1T3 type=write size=2334005 2024-04-03T03:46:13.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.461+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=14AXH618PD67 type=del size=3111925 2024-04-03T03:46:13.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.465+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=WL72P5MIRFDU type=del 2024-04-03T03:46:13.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.469+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~9Y74BWV2I93O.0 size=1048576 2024-04-03T03:46:13.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.473+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~9Y74BWV2I93O.1 size=850497 2024-04-03T03:46:13.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.473+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=9Y74BWV2I93O tag=FDR42M2YPFCL type=write size=2947649 2024-04-03T03:46:13.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.473+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=XIJIAWVCL5RB type=del 2024-04-03T03:46:13.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.481+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~976GQC5200HP.0 size=1048576 2024-04-03T03:46:13.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.481+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~976GQC5200HP.1 size=212644 2024-04-03T03:46:13.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.481+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=976GQC5200HP tag=KAJWIA2CHRR1 type=write size=2309796 2024-04-03T03:46:13.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.485+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~1UH05MWYTIVJ.0 size=869749 2024-04-03T03:46:13.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.489+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=1UH05MWYTIVJ tag=SUK2O7BCLOUC type=write size=1918325 2024-04-03T03:46:13.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.493+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=SE9ECN20Q2C0 type=del size=758128 2024-04-03T03:46:13.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.493+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=HLMIU44OC1YU type=del 2024-04-03T03:46:13.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.497+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=XK61R2DGD3F2 type=write size=559372 2024-04-03T03:46:13.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.497+0000 7f55269288c0 1 < canceled part key=_multipart_7POFUQ9CX6B1.2~07KBQ817S01O.0 size=1048576 2024-04-03T03:46:13.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.497+0000 7f55269288c0 1 < canceled part key=_multipart_7POFUQ9CX6B1.2~07KBQ817S01O.1 size=1048576 2024-04-03T03:46:13.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.501+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~07KBQ817S01O.2 size=846256 2024-04-03T03:46:13.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.505+0000 7f55269288c0 1 < canceled multipart upload key=7POFUQ9CX6B1 upload=07KBQ817S01O tag=8H7R9VZLBKTF type=write size=3991984 2024-04-03T03:46:13.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.509+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~J388H2OIFFZ0.0 size=1048576 2024-04-03T03:46:13.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.513+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~J388H2OIFFZ0.1 size=1048576 2024-04-03T03:46:13.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.513+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~J388H2OIFFZ0.2 size=965608 2024-04-03T03:46:13.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.513+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=J388H2OIFFZ0 tag=4X0KUQ4RWCTJ type=write size=4111336 2024-04-03T03:46:13.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.517+0000 7f55269288c0 -1 < failed to complete operation key=Z42NDVEX1SOL tag=0JJJ196BUZ8L type=del size=271309: (22) Invalid argument 2024-04-03T03:46:13.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.521+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=VPYQBCRZ478N type=del size=142407 2024-04-03T03:46:13.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.521+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~3OT7S0DFVF4O.0 size=1048576 2024-04-03T03:46:13.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.525+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~3OT7S0DFVF4O.1 size=551531 2024-04-03T03:46:13.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.529+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=3OT7S0DFVF4O tag=727WJCIRJM75 type=write size=2648683 2024-04-03T03:46:13.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.533+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~75F972XA7DY1.0 size=526834 2024-04-03T03:46:13.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.533+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=75F972XA7DY1 tag=RLAW02EQOP27 type=write size=1575410 2024-04-03T03:46:13.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.537+0000 7f55269288c0 1 < completed write operation key=TLM1C3B9J2A3 tag=30X220Q3RZFG type=write size=139206 2024-04-03T03:46:13.536 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.537+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=1JSGYF3METWF type=del size=1652281 2024-04-03T03:46:13.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.541+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~6NWBHJ25LKSN.0 size=1048576 2024-04-03T03:46:13.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.541+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~6NWBHJ25LKSN.1 size=473215 2024-04-03T03:46:13.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.549+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=6NWBHJ25LKSN tag=UA9DIFYVCUFG type=write size=2570367 2024-04-03T03:46:13.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.553+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~XVU27L8AJR01.0 size=1048576 2024-04-03T03:46:13.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.553+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~XVU27L8AJR01.1 size=931986 2024-04-03T03:46:13.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.553+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=XVU27L8AJR01 tag=IFXVQ4X1XCJN type=write size=3029138 2024-04-03T03:46:13.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.557+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=NTVDPRF2ULGS type=del 2024-04-03T03:46:13.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.561+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~YEZS07YZLVMJ.0 size=1048576 2024-04-03T03:46:13.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.565+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~YEZS07YZLVMJ.1 size=943197 2024-04-03T03:46:13.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.565+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=YEZS07YZLVMJ tag=B1V4Y0C7XLSM type=write size=3040349 2024-04-03T03:46:13.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.569+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~XYB6K87YYUOM.0 size=1048576 2024-04-03T03:46:13.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.569+0000 7f55269288c0 1 < canceled part key=_multipart_ZKSA09OSFSYN.2~XYB6K87YYUOM.1 size=1048576 2024-04-03T03:46:13.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.569+0000 7f55269288c0 1 < canceled part key=_multipart_ZKSA09OSFSYN.2~XYB6K87YYUOM.2 size=229107 2024-04-03T03:46:13.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.573+0000 7f55269288c0 1 < canceled multipart upload key=ZKSA09OSFSYN upload=XYB6K87YYUOM tag=58X9K59VXBPD type=write size=3374835 2024-04-03T03:46:13.573 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.577+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=AKFN4MD0MZK5 type=del size=1785902 2024-04-03T03:46:13.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.581+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~7U8ZV34DXVN0.0 size=1048576 2024-04-03T03:46:13.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.581+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~7U8ZV34DXVN0.1 size=1048576 2024-04-03T03:46:13.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.585+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~7U8ZV34DXVN0.2 size=314489 2024-04-03T03:46:13.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.589+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=7U8ZV34DXVN0 tag=LP3TNP2Q6ZUM type=write size=3460217 2024-04-03T03:46:13.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.593+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=RVS4O7JI98NM type=del size=627646 2024-04-03T03:46:13.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.601+0000 7f55269288c0 1 < suggested update operation key=ZKSA09OSFSYN tag=DFJQFJ5BEIUO type=del size=2016677 2024-04-03T03:46:13.603 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.605+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~3CR8KGGRTVMP.0 size=612084 2024-04-03T03:46:13.603 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.605+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=3CR8KGGRTVMP tag=XPWA83YEX3DP type=write size=1660660 2024-04-03T03:46:13.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.609+0000 7f55269288c0 1 < completed write operation key=TXFMKXUGMEA8 tag=POXBYBRBG7OD type=write size=569448 2024-04-03T03:46:13.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.613+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=AV0FSH7VGM7J type=write size=316901 2024-04-03T03:46:13.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.613+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=YVYYIUBJYTSG type=del 2024-04-03T03:46:13.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.621+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~7BH3H6D4R9GD.0 size=1048576 2024-04-03T03:46:13.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.625+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~7BH3H6D4R9GD.1 size=1048576 2024-04-03T03:46:13.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.625+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~7BH3H6D4R9GD.2 size=127313 2024-04-03T03:46:13.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.625+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=7BH3H6D4R9GD tag=T477CW1T8C3L type=write size=3273041 2024-04-03T03:46:13.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.629+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=14AXH618PD67 type=del 2024-04-03T03:46:13.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.633+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~R5MSYII1YIXL.0 size=1048576 2024-04-03T03:46:13.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.637+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~R5MSYII1YIXL.1 size=698788 2024-04-03T03:46:13.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.637+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=R5MSYII1YIXL tag=VQ0HAISFYCSI type=write size=2795940 2024-04-03T03:46:13.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.641+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~9Y74BWV2I93O.0 size=1048576 2024-04-03T03:46:13.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.645+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~9Y74BWV2I93O.1 size=850497 2024-04-03T03:46:13.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.653+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=9Y74BWV2I93O tag=FDR42M2YPFCL type=write size=2947649 2024-04-03T03:46:13.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.657+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=F46WRUXRNUUD type=del size=2911415 2024-04-03T03:46:13.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.661+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~976GQC5200HP.0 size=1048576 2024-04-03T03:46:13.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.661+0000 7f55269288c0 1 < canceled part key=_multipart_8SBTVHL09P63.2~976GQC5200HP.1 size=212644 2024-04-03T03:46:13.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.665+0000 7f55269288c0 1 < canceled multipart upload key=8SBTVHL09P63 upload=976GQC5200HP tag=KAJWIA2CHRR1 type=write size=2309796 2024-04-03T03:46:13.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.669+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~JRR1U7NFLNXY.0 size=1048576 2024-04-03T03:46:13.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.673+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~JRR1U7NFLNXY.1 size=1048576 2024-04-03T03:46:13.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.673+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~JRR1U7NFLNXY.2 size=534244 2024-04-03T03:46:13.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.673+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=JRR1U7NFLNXY tag=UE0CF9I6UVBI type=write size=3679972 2024-04-03T03:46:13.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.681+0000 7f55269288c0 1 < suggested remove operation key=MLTDNCZ4E5D8 tag=SE9ECN20Q2C0 type=del 2024-04-03T03:46:13.684 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.685+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~SY2WLG6WKGU3.0 size=21679 2024-04-03T03:46:13.684 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.685+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=SY2WLG6WKGU3 tag=Z53EKUFM9UPY type=write size=1070255 2024-04-03T03:46:13.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.693+0000 7f55269288c0 1 < suggested remove operation key=CPR27NMHPIPQ tag=XK61R2DGD3F2 type=write 2024-04-03T03:46:13.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.697+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=A5D357S3YFGT type=del size=3787736 2024-04-03T03:46:13.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.697+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~J388H2OIFFZ0.0 size=1048576 2024-04-03T03:46:13.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.701+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~J388H2OIFFZ0.1 size=1048576 2024-04-03T03:46:13.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.705+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~J388H2OIFFZ0.2 size=965608 2024-04-03T03:46:13.706 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.709+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=J388H2OIFFZ0 tag=4X0KUQ4RWCTJ type=write size=4111336 2024-04-03T03:46:13.709 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.713+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=6IJDAY26DWON type=del size=2993665 2024-04-03T03:46:13.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.717+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=VPYQBCRZ478N type=del 2024-04-03T03:46:13.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.717+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=OFOHCELBU8ZP type=write size=222700 2024-04-03T03:46:13.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.721+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~75F972XA7DY1.0 size=526834 2024-04-03T03:46:13.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.729+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=75F972XA7DY1 tag=RLAW02EQOP27 type=write size=1575410 2024-04-03T03:46:13.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.729+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=LQ8E88NJ6Z0D type=write size=457757 2024-04-03T03:46:13.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.733+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=1JSGYF3METWF type=del 2024-04-03T03:46:13.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.741+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~7YVVDEDXGCVO.0 size=1048576 2024-04-03T03:46:13.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.741+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~7YVVDEDXGCVO.1 size=1048576 2024-04-03T03:46:13.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.745+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~7YVVDEDXGCVO.2 size=432133 2024-04-03T03:46:13.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.745+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=7YVVDEDXGCVO tag=VOZAQ42D41SS type=write size=3577861 2024-04-03T03:46:13.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.749+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~XVU27L8AJR01.0 size=1048576 2024-04-03T03:46:13.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.753+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~XVU27L8AJR01.1 size=931986 2024-04-03T03:46:13.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.757+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=XVU27L8AJR01 tag=IFXVQ4X1XCJN type=write size=3029138 2024-04-03T03:46:13.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.761+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=SMHU41GF42ZT type=del size=2262755 2024-04-03T03:46:13.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.765+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~YEZS07YZLVMJ.0 size=1048576 2024-04-03T03:46:13.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.765+0000 7f55269288c0 1 < canceled part key=_multipart_TLM1C3B9J2A3.2~YEZS07YZLVMJ.1 size=943197 2024-04-03T03:46:13.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.769+0000 7f55269288c0 1 < canceled multipart upload key=TLM1C3B9J2A3 upload=YEZS07YZLVMJ tag=B1V4Y0C7XLSM type=write size=3040349 2024-04-03T03:46:13.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.773+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=J0GSSYA964JK type=del size=3570077 2024-04-03T03:46:13.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.777+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=AKFN4MD0MZK5 type=del 2024-04-03T03:46:13.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.777+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=1B4OHAVST7CZ type=del size=3761611 2024-04-03T03:46:13.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.781+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=RVS4O7JI98NM type=del 2024-04-03T03:46:13.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.785+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=VLIMRIE14NYJ type=del size=3370080 2024-04-03T03:46:13.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.789+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~3CR8KGGRTVMP.0 size=612084 2024-04-03T03:46:13.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.793+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=3CR8KGGRTVMP tag=XPWA83YEX3DP type=write size=1660660 2024-04-03T03:46:13.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.797+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=U021XKP2XJ7I type=del size=3652686 2024-04-03T03:46:13.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.801+0000 7f55269288c0 1 < canceled operation key=IOHMF3ADC6EU tag=AV0FSH7VGM7J type=write size=316901 2024-04-03T03:46:13.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.805+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~W4JSDTIRREL3.0 size=1048576 2024-04-03T03:46:13.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.809+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~W4JSDTIRREL3.1 size=391482 2024-04-03T03:46:13.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.809+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=W4JSDTIRREL3 tag=A7IZ2N2ZEX96 type=write size=2488634 2024-04-03T03:46:13.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.813+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~7BH3H6D4R9GD.0 size=1048576 2024-04-03T03:46:13.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.813+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~7BH3H6D4R9GD.1 size=1048576 2024-04-03T03:46:13.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.817+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~7BH3H6D4R9GD.2 size=127313 2024-04-03T03:46:13.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.821+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=7BH3H6D4R9GD tag=T477CW1T8C3L type=write size=3273041 2024-04-03T03:46:13.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.825+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=XOOKXWV46OV4 type=del size=731163 2024-04-03T03:46:13.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.829+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~R5MSYII1YIXL.0 size=1048576 2024-04-03T03:46:13.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.829+0000 7f55269288c0 1 < canceled part key=_multipart_X3YCYKP2P9IM.2~R5MSYII1YIXL.1 size=698788 2024-04-03T03:46:13.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.833+0000 7f55269288c0 1 < canceled multipart upload key=X3YCYKP2P9IM upload=R5MSYII1YIXL tag=VQ0HAISFYCSI type=write size=2795940 2024-04-03T03:46:13.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.837+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=22P5QQFPPSQX type=del size=709918 2024-04-03T03:46:13.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.837+0000 7f55269288c0 -1 < no bi entry to suggest for operation key=CPR27NMHPIPQ tag=F46WRUXRNUUD type=del size=2911415: (2) No such file or directory 2024-04-03T03:46:13.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.841+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~XJ54SRI6IIXF.0 size=1048576 2024-04-03T03:46:13.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.845+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~XJ54SRI6IIXF.1 size=763584 2024-04-03T03:46:13.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.845+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=XJ54SRI6IIXF tag=MPT1HCT2PJX1 type=write size=2860736 2024-04-03T03:46:13.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.849+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~JRR1U7NFLNXY.0 size=1048576 2024-04-03T03:46:13.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.853+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~JRR1U7NFLNXY.1 size=1048576 2024-04-03T03:46:13.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.853+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~JRR1U7NFLNXY.2 size=534244 2024-04-03T03:46:13.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.857+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=JRR1U7NFLNXY tag=UE0CF9I6UVBI type=write size=3679972 2024-04-03T03:46:13.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.861+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=UYX5YAN7RIBT type=del size=177654 2024-04-03T03:46:13.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.865+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~SY2WLG6WKGU3.0 size=21679 2024-04-03T03:46:13.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.869+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=SY2WLG6WKGU3 tag=Z53EKUFM9UPY type=write size=1070255 2024-04-03T03:46:13.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.869+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=2VEMKIKESJPT type=write size=386331 2024-04-03T03:46:13.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.873+0000 7f55269288c0 1 < canceled operation key=AXL5RVPSVDY5 tag=A5D357S3YFGT type=del size=3787736 2024-04-03T03:46:13.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.877+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~OS2HPF41HQV5.0 size=1048576 2024-04-03T03:46:13.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.881+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~OS2HPF41HQV5.1 size=191677 2024-04-03T03:46:13.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.881+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=OS2HPF41HQV5 tag=7H5ZZAGFIMV8 type=write size=2288829 2024-04-03T03:46:13.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.881+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=6IJDAY26DWON type=del 2024-04-03T03:46:13.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.885+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=HICQY2RUQ1QO type=del size=2419525 2024-04-03T03:46:13.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.889+0000 7f55269288c0 1 < completed write operation key=Z42NDVEX1SOL tag=OFOHCELBU8ZP type=write size=222700 2024-04-03T03:46:13.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.889+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=5GJMV5318D79 type=del size=182972 2024-04-03T03:46:13.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.893+0000 7f55269288c0 1 < completed write operation key=6KH6TASZS3UG tag=LQ8E88NJ6Z0D type=write size=457757 2024-04-03T03:46:13.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.897+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=8ZVYRAGAJG4Z type=del size=3972260 2024-04-03T03:46:13.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.901+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~7YVVDEDXGCVO.0 size=1048576 2024-04-03T03:46:13.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.901+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~7YVVDEDXGCVO.1 size=1048576 2024-04-03T03:46:13.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.901+0000 7f55269288c0 1 < canceled part key=_multipart_D9OEPPT37WSJ.2~7YVVDEDXGCVO.2 size=432133 2024-04-03T03:46:13.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.905+0000 7f55269288c0 1 < canceled multipart upload key=D9OEPPT37WSJ upload=7YVVDEDXGCVO tag=VOZAQ42D41SS type=write size=3577861 2024-04-03T03:46:13.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.909+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~7MPR79B10J80.0 size=841471 2024-04-03T03:46:13.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.909+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=7MPR79B10J80 tag=7O89XOWGVZUB type=write size=1890047 2024-04-03T03:46:13.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.913+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=SMHU41GF42ZT type=del 2024-04-03T03:46:13.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.917+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=MRG1FOIY3Q86 type=del size=2629477 2024-04-03T03:46:13.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.921+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=J0GSSYA964JK type=del 2024-04-03T03:46:13.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.921+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=0OTNYT8UK80W type=del size=3751698 2024-04-03T03:46:13.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.925+0000 7f55269288c0 1 < canceled operation key=SFN1M3HPGT18 tag=1B4OHAVST7CZ type=del size=3761611 2024-04-03T03:46:13.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.929+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=OO6WZOX0TMQ3 type=del size=2659449 2024-04-03T03:46:13.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.933+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=VLIMRIE14NYJ type=del 2024-04-03T03:46:13.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.941+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~2NBZOGK5IH1Z.0 size=705441 2024-04-03T03:46:13.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.941+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=2NBZOGK5IH1Z tag=BDLQRCVX92CV type=write size=1754017 2024-04-03T03:46:13.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.945+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=U021XKP2XJ7I type=del 2024-04-03T03:46:13.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.949+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~VJG966BZCCE4.0 size=169677 2024-04-03T03:46:13.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.949+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=VJG966BZCCE4 tag=WSZ5AFPOXR94 type=write size=1218253 2024-04-03T03:46:13.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.953+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~W4JSDTIRREL3.0 size=1048576 2024-04-03T03:46:13.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.957+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~W4JSDTIRREL3.1 size=391482 2024-04-03T03:46:13.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.961+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=W4JSDTIRREL3 tag=A7IZ2N2ZEX96 type=write size=2488634 2024-04-03T03:46:13.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.965+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=B8MLB5C4ATZJ type=del size=2727186 2024-04-03T03:46:13.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.965+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=XOOKXWV46OV4 type=del 2024-04-03T03:46:13.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.973+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~JRDZ3MZYH18C.0 size=152437 2024-04-03T03:46:13.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.973+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=JRDZ3MZYH18C tag=ZA9GEMM339Y8 type=write size=1201013 2024-04-03T03:46:13.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.977+0000 7f55269288c0 1 < suggested update operation key=XFCPX90N2NYC tag=22P5QQFPPSQX type=del size=709918 2024-04-03T03:46:13.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.985+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~YAZ3NU8YGOES.0 size=972210 2024-04-03T03:46:13.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.985+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=YAZ3NU8YGOES tag=S16VBBI7PO0K type=write size=2020786 2024-04-03T03:46:13.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.985+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~XJ54SRI6IIXF.0 size=1048576 2024-04-03T03:46:13.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.989+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~XJ54SRI6IIXF.1 size=763584 2024-04-03T03:46:13.991 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.993+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=XJ54SRI6IIXF tag=MPT1HCT2PJX1 type=write size=2860736 2024-04-03T03:46:13.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:13.997+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=4R5IM0WIAXBK type=del size=4101998 2024-04-03T03:46:13.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.001+0000 7f55269288c0 1 < canceled operation key=D9OEPPT37WSJ tag=UYX5YAN7RIBT type=del size=177654 2024-04-03T03:46:14.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.005+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=3QEBHUGDHGP1 type=del size=550355 2024-04-03T03:46:14.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.005+0000 7f55269288c0 1 < canceled operation key=8BMP0HIS520R tag=2VEMKIKESJPT type=write size=386331 2024-04-03T03:46:14.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.009+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=Z0571OH4JT05 type=del size=3581397 2024-04-03T03:46:14.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.013+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~OS2HPF41HQV5.0 size=1048576 2024-04-03T03:46:14.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.013+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~OS2HPF41HQV5.1 size=191677 2024-04-03T03:46:14.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.017+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=OS2HPF41HQV5 tag=7H5ZZAGFIMV8 type=write size=2288829 2024-04-03T03:46:14.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.025+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~GI23IVB9I8KL.0 size=1048576 2024-04-03T03:46:14.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.025+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~GI23IVB9I8KL.1 size=267206 2024-04-03T03:46:14.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.025+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=GI23IVB9I8KL tag=E6IECWK6CPCF type=write size=2364358 2024-04-03T03:46:14.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.029+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=HICQY2RUQ1QO type=del 2024-04-03T03:46:14.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.033+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=U2MX9Z76AMC3 type=del size=3908865 2024-04-03T03:46:14.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.037+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=5GJMV5318D79 type=del 2024-04-03T03:46:14.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.041+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=FA2EU91VT4PL type=write size=408582 2024-04-03T03:46:14.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.045+0000 7f55269288c0 1 < canceled operation key=AGTQQYXO7453 tag=8ZVYRAGAJG4Z type=del size=3972260 2024-04-03T03:46:14.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.049+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~A2T00G248892.0 size=1048576 2024-04-03T03:46:14.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.053+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~A2T00G248892.1 size=1048576 2024-04-03T03:46:14.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.053+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~A2T00G248892.2 size=95651 2024-04-03T03:46:14.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.053+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=A2T00G248892 tag=X66G9SQ0ICES type=write size=3241379 2024-04-03T03:46:14.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.057+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~7MPR79B10J80.0 size=841471 2024-04-03T03:46:14.060 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.061+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=7MPR79B10J80 tag=7O89XOWGVZUB type=write size=1890047 2024-04-03T03:46:14.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.069+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~RO1PNFHHYG7P.0 size=305052 2024-04-03T03:46:14.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.069+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=RO1PNFHHYG7P tag=XT2W44PTL5WM type=write size=1353628 2024-04-03T03:46:14.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.073+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=MRG1FOIY3Q86 type=del 2024-04-03T03:46:14.072 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.073+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=896JVR29FU69 type=del size=3894076 2024-04-03T03:46:14.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.077+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=0OTNYT8UK80W type=del 2024-04-03T03:46:14.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.081+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=KG6MU0EBW16B type=del size=744659 2024-04-03T03:46:14.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.081+0000 7f55269288c0 1 < canceled operation key=CPR27NMHPIPQ tag=OO6WZOX0TMQ3 type=del size=2659449 2024-04-03T03:46:14.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.089+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~Q9I7L8GYXSNF.0 size=1048576 2024-04-03T03:46:14.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.089+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~Q9I7L8GYXSNF.1 size=582745 2024-04-03T03:46:14.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.089+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=Q9I7L8GYXSNF tag=LFC6RP0E4DHI type=write size=2679897 2024-04-03T03:46:14.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.093+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~2NBZOGK5IH1Z.0 size=705441 2024-04-03T03:46:14.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.097+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=2NBZOGK5IH1Z tag=BDLQRCVX92CV type=write size=1754017 2024-04-03T03:46:14.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.101+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~TDB0SJYOHOJE.0 size=247372 2024-04-03T03:46:14.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.101+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=TDB0SJYOHOJE tag=QAO8J2EHUXYQ type=write size=1295948 2024-04-03T03:46:14.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.105+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~VJG966BZCCE4.0 size=169677 2024-04-03T03:46:14.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.109+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=VJG966BZCCE4 tag=WSZ5AFPOXR94 type=write size=1218253 2024-04-03T03:46:14.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.113+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~VYWCE2YAWETZ.0 size=769528 2024-04-03T03:46:14.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.113+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=VYWCE2YAWETZ tag=66GC9KMESD06 type=write size=1818104 2024-04-03T03:46:14.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.117+0000 7f55269288c0 1 < canceled operation key=YCEKDT5EQD9D tag=B8MLB5C4ATZJ type=del size=2727186 2024-04-03T03:46:14.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.117+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=XM3IHXK2PS8H type=write size=881733 2024-04-03T03:46:14.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.121+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~JRDZ3MZYH18C.0 size=152437 2024-04-03T03:46:14.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.125+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=JRDZ3MZYH18C tag=ZA9GEMM339Y8 type=write size=1201013 2024-04-03T03:46:14.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.129+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~KVQC2M7SEW3E.0 size=1048576 2024-04-03T03:46:14.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.133+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~KVQC2M7SEW3E.1 size=1048576 2024-04-03T03:46:14.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.137+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~KVQC2M7SEW3E.2 size=740974 2024-04-03T03:46:14.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.137+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=KVQC2M7SEW3E tag=NAQ3M01XGORL type=write size=3886702 2024-04-03T03:46:14.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.137+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~YAZ3NU8YGOES.0 size=972210 2024-04-03T03:46:14.140 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.141+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=YAZ3NU8YGOES tag=S16VBBI7PO0K type=write size=2020786 2024-04-03T03:46:14.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.145+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=DQ6ET5U5F55X type=del size=2744698 2024-04-03T03:46:14.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.149+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=4R5IM0WIAXBK type=del 2024-04-03T03:46:14.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.153+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=KGWBR753FJ4I type=del size=4042077 2024-04-03T03:46:14.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.153+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=3QEBHUGDHGP1 type=del 2024-04-03T03:46:14.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.157+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~26TAJB8F2GGY.0 size=1048576 2024-04-03T03:46:14.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.161+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~26TAJB8F2GGY.1 size=1048576 2024-04-03T03:46:14.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.165+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~26TAJB8F2GGY.2 size=244649 2024-04-03T03:46:14.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.165+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=26TAJB8F2GGY tag=6QY14ZVBZ49B type=write size=3390377 2024-04-03T03:46:14.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.165+0000 7f55269288c0 1 < canceled operation key=CPR27NMHPIPQ tag=Z0571OH4JT05 type=del size=3581397 2024-04-03T03:46:14.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.169+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=VNEZPINNMUBV type=del size=2933942 2024-04-03T03:46:14.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.173+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~GI23IVB9I8KL.0 size=1048576 2024-04-03T03:46:14.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.173+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~GI23IVB9I8KL.1 size=267206 2024-04-03T03:46:14.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.177+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=GI23IVB9I8KL tag=E6IECWK6CPCF type=write size=2364358 2024-04-03T03:46:14.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.181+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=10X1BISWVWDI type=del size=2058260 2024-04-03T03:46:14.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.185+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=U2MX9Z76AMC3 type=del 2024-04-03T03:46:14.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.189+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=P346NPSDCROV type=del size=282641 2024-04-03T03:46:14.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.189+0000 7f55269288c0 1 < completed write operation key=Z42NDVEX1SOL tag=FA2EU91VT4PL type=write size=408582 2024-04-03T03:46:14.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.197+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~A01GVMH936K9.0 size=1048576 2024-04-03T03:46:14.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.197+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~A01GVMH936K9.1 size=184089 2024-04-03T03:46:14.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.197+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=A01GVMH936K9 tag=D2AQZ7W9SC5M type=write size=2281241 2024-04-03T03:46:14.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.201+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~A2T00G248892.0 size=1048576 2024-04-03T03:46:14.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.201+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~A2T00G248892.1 size=1048576 2024-04-03T03:46:14.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.209+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~A2T00G248892.2 size=95651 2024-04-03T03:46:14.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.213+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=A2T00G248892 tag=X66G9SQ0ICES type=write size=3241379 2024-04-03T03:46:14.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.217+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~1ARAEUTGS40Q.0 size=334127 2024-04-03T03:46:14.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.217+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=1ARAEUTGS40Q tag=WHSZQEVO3UM3 type=write size=1382703 2024-04-03T03:46:14.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.221+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~RO1PNFHHYG7P.0 size=305052 2024-04-03T03:46:14.222 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.225+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=RO1PNFHHYG7P tag=XT2W44PTL5WM type=write size=1353628 2024-04-03T03:46:14.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.229+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~UX6ZCPBOCXL2.0 size=1048576 2024-04-03T03:46:14.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.233+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~UX6ZCPBOCXL2.1 size=1048576 2024-04-03T03:46:14.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.233+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~UX6ZCPBOCXL2.2 size=666437 2024-04-03T03:46:14.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.233+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=UX6ZCPBOCXL2 tag=FJLD41LUIEBE type=write size=3812165 2024-04-03T03:46:14.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.237+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=896JVR29FU69 type=del 2024-04-03T03:46:14.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.237+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=53A2DYP8ANLQ type=del size=2869090 2024-04-03T03:46:14.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.245+0000 7f55269288c0 1 < suggested remove operation key=AGTQQYXO7453 tag=KG6MU0EBW16B type=del 2024-04-03T03:46:14.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.245+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=JOCT8KX74GZG type=del size=4111260 2024-04-03T03:46:14.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.249+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~Q9I7L8GYXSNF.0 size=1048576 2024-04-03T03:46:14.247 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.249+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~Q9I7L8GYXSNF.1 size=582745 2024-04-03T03:46:14.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.253+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=Q9I7L8GYXSNF tag=LFC6RP0E4DHI type=write size=2679897 2024-04-03T03:46:14.257 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.261+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~GRXQ5LKM2VF3.0 size=403996 2024-04-03T03:46:14.257 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.261+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=GRXQ5LKM2VF3 tag=Y7HF5S6VPVVF type=write size=1452572 2024-04-03T03:46:14.260 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.261+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~TDB0SJYOHOJE.0 size=247372 2024-04-03T03:46:14.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.269+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=TDB0SJYOHOJE tag=QAO8J2EHUXYQ type=write size=1295948 2024-04-03T03:46:14.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.269+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=071PNV3DGM2B type=del size=803639 2024-04-03T03:46:14.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.273+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~VYWCE2YAWETZ.0 size=769528 2024-04-03T03:46:14.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.277+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=VYWCE2YAWETZ tag=66GC9KMESD06 type=write size=1818104 2024-04-03T03:46:14.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.281+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~Y5SQW7QF2QH1.0 size=1048576 2024-04-03T03:46:14.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.285+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~Y5SQW7QF2QH1.1 size=560785 2024-04-03T03:46:14.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.285+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=Y5SQW7QF2QH1 tag=BRIT4FA7E8AJ type=write size=2657937 2024-04-03T03:46:14.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.289+0000 7f55269288c0 1 < completed write operation key=YCEKDT5EQD9D tag=XM3IHXK2PS8H type=write size=881733 2024-04-03T03:46:14.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.289+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=JZNJ6AF6SZS2 type=write size=638695 2024-04-03T03:46:14.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.293+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~KVQC2M7SEW3E.0 size=1048576 2024-04-03T03:46:14.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.293+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~KVQC2M7SEW3E.1 size=1048576 2024-04-03T03:46:14.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.297+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~KVQC2M7SEW3E.2 size=740974 2024-04-03T03:46:14.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.305+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=KVQC2M7SEW3E tag=NAQ3M01XGORL type=write size=3886702 2024-04-03T03:46:14.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.305+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=VLGPIQAF9JUK type=del size=2317336 2024-04-03T03:46:14.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.309+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=DQ6ET5U5F55X type=del 2024-04-03T03:46:14.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.313+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=LF420YDMMR6T type=del size=259434 2024-04-03T03:46:14.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.317+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=KGWBR753FJ4I type=del 2024-04-03T03:46:14.317 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.321+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=VUH5VMF5HVAI type=del size=1603894 2024-04-03T03:46:14.320 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.321+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~26TAJB8F2GGY.0 size=1048576 2024-04-03T03:46:14.323 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.325+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~26TAJB8F2GGY.1 size=1048576 2024-04-03T03:46:14.325 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.329+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~26TAJB8F2GGY.2 size=244649 2024-04-03T03:46:14.330 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.333+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=26TAJB8F2GGY tag=6QY14ZVBZ49B type=write size=3390377 2024-04-03T03:46:14.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.341+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~4RP1IRAV014I.0 size=1048576 2024-04-03T03:46:14.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.341+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~4RP1IRAV014I.1 size=1048576 2024-04-03T03:46:14.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.345+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~4RP1IRAV014I.2 size=328400 2024-04-03T03:46:14.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.345+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=4RP1IRAV014I tag=QLY4CZZ2805K type=write size=3474128 2024-04-03T03:46:14.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.349+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=VNEZPINNMUBV type=del 2024-04-03T03:46:14.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.353+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=XHKVXHAMOAQA type=del size=1050945 2024-04-03T03:46:14.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.357+0000 7f55269288c0 1 < canceled operation key=AXL5RVPSVDY5 tag=10X1BISWVWDI type=del size=2058260 2024-04-03T03:46:14.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.357+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=U757M6E1PN7C type=del size=42848 2024-04-03T03:46:14.359 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.361+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=P346NPSDCROV type=del 2024-04-03T03:46:14.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.365+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=XUB9HIT7GYKI type=del size=2207797 2024-04-03T03:46:14.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.369+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~A01GVMH936K9.0 size=1048576 2024-04-03T03:46:14.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.373+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~A01GVMH936K9.1 size=184089 2024-04-03T03:46:14.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.377+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=A01GVMH936K9 tag=D2AQZ7W9SC5M type=write size=2281241 2024-04-03T03:46:14.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.385+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~4WJ2C7OMCMU7.0 size=1048576 2024-04-03T03:46:14.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.385+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~4WJ2C7OMCMU7.1 size=1048576 2024-04-03T03:46:14.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.389+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~4WJ2C7OMCMU7.2 size=854772 2024-04-03T03:46:14.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.389+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=4WJ2C7OMCMU7 tag=6ND7EYR2RK73 type=write size=4000500 2024-04-03T03:46:14.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.389+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~1ARAEUTGS40Q.0 size=334127 2024-04-03T03:46:14.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.393+0000 7f55269288c0 1 < canceled multipart upload key=8BMP0HIS520R upload=1ARAEUTGS40Q tag=WHSZQEVO3UM3 type=write size=1382703 2024-04-03T03:46:14.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.397+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=QE8VHLZCAA1S type=del size=598387 2024-04-03T03:46:14.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.401+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~UX6ZCPBOCXL2.0 size=1048576 2024-04-03T03:46:14.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.401+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~UX6ZCPBOCXL2.1 size=1048576 2024-04-03T03:46:14.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.405+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~UX6ZCPBOCXL2.2 size=666437 2024-04-03T03:46:14.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.409+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=UX6ZCPBOCXL2 tag=FJLD41LUIEBE type=write size=3812165 2024-04-03T03:46:14.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.417+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~HJGB9DVWZ0MK.0 size=1048576 2024-04-03T03:46:14.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.417+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~HJGB9DVWZ0MK.1 size=559707 2024-04-03T03:46:14.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.417+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=HJGB9DVWZ0MK tag=TQGAET8W1RKM type=write size=2656859 2024-04-03T03:46:14.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.421+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=53A2DYP8ANLQ type=del 2024-04-03T03:46:14.422 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.425+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=OHMUQ518YAMQ type=del size=973075 2024-04-03T03:46:14.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.429+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=JOCT8KX74GZG type=del 2024-04-03T03:46:14.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.433+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~FWQBBHO48NAM.0 size=1048576 2024-04-03T03:46:14.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.437+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~FWQBBHO48NAM.1 size=585888 2024-04-03T03:46:14.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.437+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=FWQBBHO48NAM tag=N0QTJ59VTPH6 type=write size=2683040 2024-04-03T03:46:14.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.441+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~GRXQ5LKM2VF3.0 size=403996 2024-04-03T03:46:14.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.445+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=GRXQ5LKM2VF3 tag=Y7HF5S6VPVVF type=write size=1452572 2024-04-03T03:46:14.446 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.449+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=S88FB3H69AYU type=write size=56369 2024-04-03T03:46:14.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.453+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=071PNV3DGM2B type=del 2024-04-03T03:46:14.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.457+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~DR6FSDKMZW9G.0 size=1048576 2024-04-03T03:46:14.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.461+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~DR6FSDKMZW9G.1 size=723992 2024-04-03T03:46:14.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.461+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=DR6FSDKMZW9G tag=D6ZJ9CD7J4CT type=write size=2821144 2024-04-03T03:46:14.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.461+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~Y5SQW7QF2QH1.0 size=1048576 2024-04-03T03:46:14.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.465+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~Y5SQW7QF2QH1.1 size=560785 2024-04-03T03:46:14.468 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.469+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=Y5SQW7QF2QH1 tag=BRIT4FA7E8AJ type=write size=2657937 2024-04-03T03:46:14.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.477+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~H62M4JL3FQRD.0 size=1048576 2024-04-03T03:46:14.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.477+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~H62M4JL3FQRD.1 size=1048576 2024-04-03T03:46:14.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.481+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~H62M4JL3FQRD.2 size=441968 2024-04-03T03:46:14.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.481+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=H62M4JL3FQRD tag=DLMN0VEUW338 type=write size=3587696 2024-04-03T03:46:14.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.489+0000 7f55269288c0 1 < suggested update operation key=AGTQQYXO7453 tag=JZNJ6AF6SZS2 type=write size=638695 2024-04-03T03:46:14.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.493+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=PA394ARSWODI type=del size=804884 2024-04-03T03:46:14.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.497+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=VLGPIQAF9JUK type=del 2024-04-03T03:46:14.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.497+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=ZVZBPJE33DEU type=del size=1755341 2024-04-03T03:46:14.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.501+0000 7f55269288c0 1 < canceled operation key=LZQGL2UAWOTU tag=LF420YDMMR6T type=del size=259434 2024-04-03T03:46:14.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.505+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=KB6EWHF09OUP type=write size=369786 2024-04-03T03:46:14.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.509+0000 7f55269288c0 1 < completed delete operation key=K3Z9W19WEJBM tag=VUH5VMF5HVAI type=del 2024-04-03T03:46:14.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.509+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=M4047LDLT5EI type=del size=2107225 2024-04-03T03:46:14.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.513+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~4RP1IRAV014I.0 size=1048576 2024-04-03T03:46:14.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.513+0000 7f55269288c0 1 < canceled part key=_multipart_JAXVD60NI5YW.2~4RP1IRAV014I.1 size=1048576 2024-04-03T03:46:14.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.517+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~4RP1IRAV014I.2 size=328400 2024-04-03T03:46:14.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.521+0000 7f55269288c0 1 < canceled multipart upload key=JAXVD60NI5YW upload=4RP1IRAV014I tag=QLY4CZZ2805K type=write size=3474128 2024-04-03T03:46:14.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.529+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~F5162BC3K6E3.0 size=444448 2024-04-03T03:46:14.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.529+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=F5162BC3K6E3 tag=DO8L7BSDBKU5 type=write size=1493024 2024-04-03T03:46:14.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.533+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=XHKVXHAMOAQA type=del size=1050945 2024-04-03T03:46:14.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.533+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=T34779SEFIRG type=write size=352556 2024-04-03T03:46:14.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.537+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=U757M6E1PN7C type=del 2024-04-03T03:46:14.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.541+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=NFP6SDU7FUEO type=write size=291497 2024-04-03T03:46:14.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.545+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=XUB9HIT7GYKI type=del 2024-04-03T03:46:14.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.549+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=F7Y03ETD29V4 type=del size=4174605 2024-04-03T03:46:14.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.553+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~4WJ2C7OMCMU7.0 size=1048576 2024-04-03T03:46:14.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.553+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~4WJ2C7OMCMU7.1 size=1048576 2024-04-03T03:46:14.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.557+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~4WJ2C7OMCMU7.2 size=854772 2024-04-03T03:46:14.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.561+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=4WJ2C7OMCMU7 tag=6ND7EYR2RK73 type=write size=4000500 2024-04-03T03:46:14.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.565+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=2NHIK9GHS0QT type=write size=638610 2024-04-03T03:46:14.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.569+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=QE8VHLZCAA1S type=del 2024-04-03T03:46:14.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.573+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=4N0F62RRJNMF type=del size=440414 2024-04-03T03:46:14.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.577+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~HJGB9DVWZ0MK.0 size=1048576 2024-04-03T03:46:14.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.577+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~HJGB9DVWZ0MK.1 size=559707 2024-04-03T03:46:14.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.581+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=HJGB9DVWZ0MK tag=TQGAET8W1RKM type=write size=2656859 2024-04-03T03:46:14.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.585+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=YHN0L39NEN7R type=del size=1309011 2024-04-03T03:46:14.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.589+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=OHMUQ518YAMQ type=del size=973075 2024-04-03T03:46:14.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.593+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=SE67TO8OJ59V type=del size=3615272 2024-04-03T03:46:14.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.593+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~FWQBBHO48NAM.0 size=1048576 2024-04-03T03:46:14.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.597+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~FWQBBHO48NAM.1 size=585888 2024-04-03T03:46:14.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.601+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=FWQBBHO48NAM tag=N0QTJ59VTPH6 type=write size=2683040 2024-04-03T03:46:14.603 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.605+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=AQGAGVIWD38F type=del size=1465856 2024-04-03T03:46:14.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.609+0000 7f55269288c0 1 < completed write operation key=CPR27NMHPIPQ tag=S88FB3H69AYU type=write size=56369 2024-04-03T03:46:14.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.613+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~JK090OC9WICC.0 size=1048576 2024-04-03T03:46:14.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.617+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~JK090OC9WICC.1 size=1048576 2024-04-03T03:46:14.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.621+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~JK090OC9WICC.2 size=212350 2024-04-03T03:46:14.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.621+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=JK090OC9WICC tag=DB9Z2TW5GIRZ type=write size=3358078 2024-04-03T03:46:14.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.621+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~DR6FSDKMZW9G.0 size=1048576 2024-04-03T03:46:14.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.625+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~DR6FSDKMZW9G.1 size=723992 2024-04-03T03:46:14.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.633+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=DR6FSDKMZW9G tag=D6ZJ9CD7J4CT type=write size=2821144 2024-04-03T03:46:14.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.637+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~P6TKHR1WR8CD.0 size=1048576 2024-04-03T03:46:14.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.641+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~P6TKHR1WR8CD.1 size=1048576 2024-04-03T03:46:14.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.641+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~P6TKHR1WR8CD.2 size=916470 2024-04-03T03:46:14.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.641+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=P6TKHR1WR8CD tag=MUYH34O7FEM4 type=write size=4062198 2024-04-03T03:46:14.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.645+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~H62M4JL3FQRD.0 size=1048576 2024-04-03T03:46:14.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.645+0000 7f55269288c0 1 < canceled part key=_multipart_IOHMF3ADC6EU.2~H62M4JL3FQRD.1 size=1048576 2024-04-03T03:46:14.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.649+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~H62M4JL3FQRD.2 size=441968 2024-04-03T03:46:14.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.653+0000 7f55269288c0 1 < canceled multipart upload key=IOHMF3ADC6EU upload=H62M4JL3FQRD tag=DLMN0VEUW338 type=write size=3587696 2024-04-03T03:46:14.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.657+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=49EY3G1N3XI3 type=write size=951779 2024-04-03T03:46:14.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.657+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=PA394ARSWODI type=del 2024-04-03T03:46:14.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.665+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~H43FV95Z92BT.0 size=1048576 2024-04-03T03:46:14.663 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.665+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~H43FV95Z92BT.1 size=1048576 2024-04-03T03:46:14.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.669+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~H43FV95Z92BT.2 size=586554 2024-04-03T03:46:14.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.669+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=H43FV95Z92BT tag=93VS538A5WOA type=write size=3732282 2024-04-03T03:46:14.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.673+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=ZVZBPJE33DEU type=del 2024-04-03T03:46:14.671 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.673+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=G6EMD5VI2TVN type=del size=3647583 2024-04-03T03:46:14.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.677+0000 7f55269288c0 1 < completed write operation key=0OSIL0R5ZJ54 tag=KB6EWHF09OUP type=write size=369786 2024-04-03T03:46:14.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.681+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~ZJD2C0HH14GB.0 size=1048576 2024-04-03T03:46:14.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.685+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~ZJD2C0HH14GB.1 size=1048576 2024-04-03T03:46:14.683 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.685+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~ZJD2C0HH14GB.2 size=471994 2024-04-03T03:46:14.683 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.685+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=ZJD2C0HH14GB tag=IPYGS33TM24F type=write size=3617722 2024-04-03T03:46:14.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.693+0000 7f55269288c0 1 < suggested remove operation key=X3YCYKP2P9IM tag=M4047LDLT5EI type=del 2024-04-03T03:46:14.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.693+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=2VKVBR2HJL8E type=del size=3863777 2024-04-03T03:46:14.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.697+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~F5162BC3K6E3.0 size=444448 2024-04-03T03:46:14.700 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.701+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=F5162BC3K6E3 tag=DO8L7BSDBKU5 type=write size=1493024 2024-04-03T03:46:14.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.705+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=F5IM1U38VGE9 type=del size=4193337 2024-04-03T03:46:14.706 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.709+0000 7f55269288c0 1 < completed write operation key=KU1R0YLDP1V3 tag=T34779SEFIRG type=write size=352556 2024-04-03T03:46:14.710 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.713+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=UJ5BQ9RQ11XG type=del size=3911020 2024-04-03T03:46:14.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.721+0000 7f55269288c0 1 < suggested remove operation key=AGTQQYXO7453 tag=NFP6SDU7FUEO type=write 2024-04-03T03:46:14.720 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.721+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=ADYOA70S81FX type=del size=2296529 2024-04-03T03:46:14.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.725+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=F7Y03ETD29V4 type=del 2024-04-03T03:46:14.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.729+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=GD3K1HE5E9GG type=del size=2815594 2024-04-03T03:46:14.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.733+0000 7f55269288c0 1 < completed write operation key=LZQGL2UAWOTU tag=2NHIK9GHS0QT type=write size=638610 2024-04-03T03:46:14.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.737+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=605KUHNMCCTQ type=del size=4081025 2024-04-03T03:46:14.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.741+0000 7f55269288c0 1 < suggested update operation key=LZQGL2UAWOTU tag=4N0F62RRJNMF type=del size=440414 2024-04-03T03:46:14.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.745+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=OFCL372XTS1R type=del size=2737773 2024-04-03T03:46:14.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.749+0000 7f55269288c0 1 < suggested update operation key=ZKSA09OSFSYN tag=YHN0L39NEN7R type=del size=1309011 2024-04-03T03:46:14.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.753+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~A7GLEV5AH17X.0 size=1048576 2024-04-03T03:46:14.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.753+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~A7GLEV5AH17X.1 size=1048576 2024-04-03T03:46:14.753 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.757+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~A7GLEV5AH17X.2 size=245751 2024-04-03T03:46:14.753 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.757+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=A7GLEV5AH17X tag=T4V0YZ0KEXO6 type=write size=3391479 2024-04-03T03:46:14.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.757+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=SE67TO8OJ59V type=del 2024-04-03T03:46:14.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.761+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=ZBEENB5KFJ8G type=del size=3887 2024-04-03T03:46:14.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.761+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=AQGAGVIWD38F type=del 2024-04-03T03:46:14.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.765+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=75BBNQHUJ871 type=del size=3904584 2024-04-03T03:46:14.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.769+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~JK090OC9WICC.0 size=1048576 2024-04-03T03:46:14.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.773+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~JK090OC9WICC.1 size=1048576 2024-04-03T03:46:14.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.777+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~JK090OC9WICC.2 size=212350 2024-04-03T03:46:14.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.781+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=JK090OC9WICC tag=DB9Z2TW5GIRZ type=write size=3358078 2024-04-03T03:46:14.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.785+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~XTATKM6IDZ1J.0 size=1048576 2024-04-03T03:46:14.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.785+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~XTATKM6IDZ1J.1 size=276238 2024-04-03T03:46:14.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.785+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=XTATKM6IDZ1J tag=QL5WIT5HNU45 type=write size=2373390 2024-04-03T03:46:14.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.789+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~P6TKHR1WR8CD.0 size=1048576 2024-04-03T03:46:14.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.789+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~P6TKHR1WR8CD.1 size=1048576 2024-04-03T03:46:14.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.789+0000 7f55269288c0 1 < canceled part key=_multipart_F6IBZ80J4SDM.2~P6TKHR1WR8CD.2 size=916470 2024-04-03T03:46:14.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.793+0000 7f55269288c0 1 < canceled multipart upload key=F6IBZ80J4SDM upload=P6TKHR1WR8CD tag=MUYH34O7FEM4 type=write size=4062198 2024-04-03T03:46:14.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.797+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=1DYI9XUR1AS4 type=del size=789123 2024-04-03T03:46:14.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.801+0000 7f55269288c0 1 < completed write operation key=YCEKDT5EQD9D tag=49EY3G1N3XI3 type=write size=951779 2024-04-03T03:46:14.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.805+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~LNU5SN5KBIOJ.0 size=183570 2024-04-03T03:46:14.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.805+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=LNU5SN5KBIOJ tag=ED9GS7J42XG6 type=write size=1232146 2024-04-03T03:46:14.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.805+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~H43FV95Z92BT.0 size=1048576 2024-04-03T03:46:14.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.809+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~H43FV95Z92BT.1 size=1048576 2024-04-03T03:46:14.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.809+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~H43FV95Z92BT.2 size=586554 2024-04-03T03:46:14.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.817+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=H43FV95Z92BT tag=93VS538A5WOA type=write size=3732282 2024-04-03T03:46:14.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.817+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=6GC0IPEORFYC type=write size=27065 2024-04-03T03:46:14.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.821+0000 7f55269288c0 1 < suggested remove operation key=ZKSA09OSFSYN tag=G6EMD5VI2TVN type=del 2024-04-03T03:46:14.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.825+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~55D4QPWK8QGC.0 size=568799 2024-04-03T03:46:14.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.825+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=55D4QPWK8QGC tag=HEAY9NC3FJ2F type=write size=1617375 2024-04-03T03:46:14.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.829+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~ZJD2C0HH14GB.0 size=1048576 2024-04-03T03:46:14.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.833+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~ZJD2C0HH14GB.1 size=1048576 2024-04-03T03:46:14.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.833+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~ZJD2C0HH14GB.2 size=471994 2024-04-03T03:46:14.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.837+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=ZJD2C0HH14GB tag=IPYGS33TM24F type=write size=3617722 2024-04-03T03:46:14.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.845+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~F4B3X6PCOAWS.0 size=1048576 2024-04-03T03:46:14.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.845+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~F4B3X6PCOAWS.1 size=1048576 2024-04-03T03:46:14.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.849+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~F4B3X6PCOAWS.2 size=627046 2024-04-03T03:46:14.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.849+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=F4B3X6PCOAWS tag=1GPD466U4F28 type=write size=3772774 2024-04-03T03:46:14.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.849+0000 7f55269288c0 -1 < failed to complete operation key=AGTQQYXO7453 tag=2VKVBR2HJL8E type=del size=3863777: (22) Invalid argument 2024-04-03T03:46:14.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.853+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=LB2C5W2ANEQP type=del size=1379892 2024-04-03T03:46:14.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.857+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=F5IM1U38VGE9 type=del 2024-04-03T03:46:14.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.857+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=HNA5L7BMTD99 type=del size=1552800 2024-04-03T03:46:14.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.861+0000 7f55269288c0 1 < canceled operation key=TXFMKXUGMEA8 tag=UJ5BQ9RQ11XG type=del size=3911020 2024-04-03T03:46:14.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.861+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=T569CU0YF96A type=del size=552781 2024-04-03T03:46:14.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.865+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=ADYOA70S81FX type=del 2024-04-03T03:46:14.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.865+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=KD76KU07CQR5 type=write size=348030 2024-04-03T03:46:14.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.869+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=GD3K1HE5E9GG type=del 2024-04-03T03:46:14.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.869+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=EZI9UMZFU4XP type=del size=1224671 2024-04-03T03:46:14.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.873+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=605KUHNMCCTQ type=del 2024-04-03T03:46:14.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.877+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=NWQ5EUBO7V2J type=write size=104993 2024-04-03T03:46:14.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.877+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=OFCL372XTS1R type=del 2024-04-03T03:46:14.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.881+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=J07KQR3UPED2 type=del size=2727123 2024-04-03T03:46:14.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.881+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~A7GLEV5AH17X.0 size=1048576 2024-04-03T03:46:14.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.885+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~A7GLEV5AH17X.1 size=1048576 2024-04-03T03:46:14.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.885+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~A7GLEV5AH17X.2 size=245751 2024-04-03T03:46:14.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.893+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=A7GLEV5AH17X tag=T4V0YZ0KEXO6 type=write size=3391479 2024-04-03T03:46:14.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.893+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=VA0AF262U585 type=del size=2714075 2024-04-03T03:46:14.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.897+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=ZBEENB5KFJ8G type=del 2024-04-03T03:46:14.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.901+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~7KBUU1NXNWNF.0 size=1048576 2024-04-03T03:46:14.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.905+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~7KBUU1NXNWNF.1 size=1048576 2024-04-03T03:46:14.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.905+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~7KBUU1NXNWNF.2 size=157104 2024-04-03T03:46:14.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.905+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=7KBUU1NXNWNF tag=7BT3B1RBQL32 type=write size=3302832 2024-04-03T03:46:14.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.909+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=75BBNQHUJ871 type=del 2024-04-03T03:46:14.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.913+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~HIKUVWTEYJ2S.0 size=1036664 2024-04-03T03:46:14.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.913+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=HIKUVWTEYJ2S tag=0KB2ACUT0JRB type=write size=2085240 2024-04-03T03:46:14.913 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.917+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~XTATKM6IDZ1J.0 size=1048576 2024-04-03T03:46:14.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.917+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~XTATKM6IDZ1J.1 size=276238 2024-04-03T03:46:14.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.921+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=XTATKM6IDZ1J tag=QL5WIT5HNU45 type=write size=2373390 2024-04-03T03:46:14.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.925+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=LT27C67SBKXI type=write size=468937 2024-04-03T03:46:14.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.929+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=1DYI9XUR1AS4 type=del 2024-04-03T03:46:14.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.933+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~7YW5SDUKQZIC.0 size=1048576 2024-04-03T03:46:14.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.933+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~7YW5SDUKQZIC.1 size=598938 2024-04-03T03:46:14.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.933+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=7YW5SDUKQZIC tag=DRGOIKMO2U3F type=write size=2696090 2024-04-03T03:46:14.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.937+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~LNU5SN5KBIOJ.0 size=183570 2024-04-03T03:46:14.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.941+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=LNU5SN5KBIOJ tag=ED9GS7J42XG6 type=write size=1232146 2024-04-03T03:46:14.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.945+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~1TENJRZVWA1N.0 size=1048576 2024-04-03T03:46:14.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.949+0000 7f55269288c0 1 > prepared part key=_multipart_7POFUQ9CX6B1.2~1TENJRZVWA1N.1 size=512996 2024-04-03T03:46:14.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.949+0000 7f55269288c0 1 > prepared multipart upload key=7POFUQ9CX6B1 upload=1TENJRZVWA1N tag=FT25ZYUMA241 type=write size=2610148 2024-04-03T03:46:14.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.949+0000 7f55269288c0 1 < completed write operation key=LZQGL2UAWOTU tag=6GC0IPEORFYC type=write size=27065 2024-04-03T03:46:14.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.957+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~7PMH1E6T2O46.0 size=1031817 2024-04-03T03:46:14.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.957+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=7PMH1E6T2O46 tag=310RSRK9MAIM type=write size=2080393 2024-04-03T03:46:14.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.957+0000 7f55269288c0 1 < canceled part key=_multipart_6KH6TASZS3UG.2~55D4QPWK8QGC.0 size=568799 2024-04-03T03:46:14.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.961+0000 7f55269288c0 1 < canceled multipart upload key=6KH6TASZS3UG upload=55D4QPWK8QGC tag=HEAY9NC3FJ2F type=write size=1617375 2024-04-03T03:46:14.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.961+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=OSOJOWYZ0VK3 type=del size=2714027 2024-04-03T03:46:14.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.965+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~F4B3X6PCOAWS.0 size=1048576 2024-04-03T03:46:14.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.965+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~F4B3X6PCOAWS.1 size=1048576 2024-04-03T03:46:14.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.969+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~F4B3X6PCOAWS.2 size=627046 2024-04-03T03:46:14.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.973+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=F4B3X6PCOAWS tag=1GPD466U4F28 type=write size=3772774 2024-04-03T03:46:14.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.973+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=FOQJJIUJU11Y type=write size=736965 2024-04-03T03:46:14.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.977+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=LB2C5W2ANEQP type=del 2024-04-03T03:46:14.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.977+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=PCFH49FGPTDW type=del size=1028796 2024-04-03T03:46:14.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.981+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=HNA5L7BMTD99 type=del 2024-04-03T03:46:14.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.985+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=3C3ZM1IVWTAT type=del size=1975793 2024-04-03T03:46:14.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.985+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=T569CU0YF96A type=del 2024-04-03T03:46:14.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.989+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~MIJD49PEUMA8.0 size=1048576 2024-04-03T03:46:14.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.993+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~MIJD49PEUMA8.1 size=1048576 2024-04-03T03:46:14.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.993+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~MIJD49PEUMA8.2 size=750978 2024-04-03T03:46:14.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.993+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=MIJD49PEUMA8 tag=C4OM3ZGD6L0E type=write size=3896706 2024-04-03T03:46:14.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:14.997+0000 7f55269288c0 1 < completed write operation key=AXL5RVPSVDY5 tag=KD76KU07CQR5 type=write size=348030 2024-04-03T03:46:15.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.001+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=2N3DISURTX1V type=del size=3034523 2024-04-03T03:46:15.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.005+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=EZI9UMZFU4XP type=del 2024-04-03T03:46:15.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.009+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=HTX1I9EDYPXH type=del size=3214344 2024-04-03T03:46:15.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.009+0000 7f55269288c0 1 < canceled operation key=KDSE2XB4D1XI tag=NWQ5EUBO7V2J type=write size=104993 2024-04-03T03:46:15.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.013+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=QRBQ7Z3BEX1A type=del size=181950 2024-04-03T03:46:15.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.017+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=J07KQR3UPED2 type=del 2024-04-03T03:46:15.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.017+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=XO9ED69X3ZZU type=del size=2296260 2024-04-03T03:46:15.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.021+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=VA0AF262U585 type=del 2024-04-03T03:46:15.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.025+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~T3L1T8Y4OH7T.0 size=1048576 2024-04-03T03:46:15.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.025+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~T3L1T8Y4OH7T.1 size=745992 2024-04-03T03:46:15.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.025+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=T3L1T8Y4OH7T tag=5ZP366T40EH1 type=write size=2843144 2024-04-03T03:46:15.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.029+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~7KBUU1NXNWNF.0 size=1048576 2024-04-03T03:46:15.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.029+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~7KBUU1NXNWNF.1 size=1048576 2024-04-03T03:46:15.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.029+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~7KBUU1NXNWNF.2 size=157104 2024-04-03T03:46:15.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.033+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=7KBUU1NXNWNF tag=7BT3B1RBQL32 type=write size=3302832 2024-04-03T03:46:15.033 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.037+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=6KZHR92BBMTM type=del size=1105952 2024-04-03T03:46:15.033 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.037+0000 7f55269288c0 1 < canceled part key=_multipart_IOHMF3ADC6EU.2~HIKUVWTEYJ2S.0 size=1036664 2024-04-03T03:46:15.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.041+0000 7f55269288c0 1 < canceled multipart upload key=IOHMF3ADC6EU upload=HIKUVWTEYJ2S tag=0KB2ACUT0JRB type=write size=2085240 2024-04-03T03:46:15.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.041+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=XDH0HNMSY12Y type=del size=3044124 2024-04-03T03:46:15.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.049+0000 7f55269288c0 1 < suggested remove operation key=KDSE2XB4D1XI tag=LT27C67SBKXI type=write 2024-04-03T03:46:15.052 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.053+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~BMABFLA2C8Y7.0 size=1048576 2024-04-03T03:46:15.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.057+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~BMABFLA2C8Y7.1 size=792335 2024-04-03T03:46:15.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.057+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=BMABFLA2C8Y7 tag=ZS6GJHCZDJD0 type=write size=2889487 2024-04-03T03:46:15.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.057+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~7YW5SDUKQZIC.0 size=1048576 2024-04-03T03:46:15.058 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.061+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~7YW5SDUKQZIC.1 size=598938 2024-04-03T03:46:15.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.065+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=7YW5SDUKQZIC tag=DRGOIKMO2U3F type=write size=2696090 2024-04-03T03:46:15.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.069+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~YDB0F4KOLW1R.0 size=1048576 2024-04-03T03:46:15.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.069+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~YDB0F4KOLW1R.1 size=110046 2024-04-03T03:46:15.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.069+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=YDB0F4KOLW1R tag=TEUW10TEERKJ type=write size=2207198 2024-04-03T03:46:15.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.073+0000 7f55269288c0 1 < completed part key=_multipart_7POFUQ9CX6B1.2~1TENJRZVWA1N.0 size=1048576 2024-04-03T03:46:15.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.073+0000 7f55269288c0 1 < canceled part key=_multipart_7POFUQ9CX6B1.2~1TENJRZVWA1N.1 size=512996 2024-04-03T03:46:15.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.077+0000 7f55269288c0 1 < canceled multipart upload key=7POFUQ9CX6B1 upload=1TENJRZVWA1N tag=FT25ZYUMA241 type=write size=2610148 2024-04-03T03:46:15.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.077+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=L4I3I5LQXE7V type=write size=485161 2024-04-03T03:46:15.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.081+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~7PMH1E6T2O46.0 size=1031817 2024-04-03T03:46:15.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.085+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=7PMH1E6T2O46 tag=310RSRK9MAIM type=write size=2080393 2024-04-03T03:46:15.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.089+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~VKERPDG6NXXR.0 size=1048576 2024-04-03T03:46:15.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.089+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~VKERPDG6NXXR.1 size=602903 2024-04-03T03:46:15.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.089+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=VKERPDG6NXXR tag=V4R5J9EHBQLX type=write size=2700055 2024-04-03T03:46:15.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.097+0000 7f55269288c0 1 < suggested remove operation key=TXFMKXUGMEA8 tag=OSOJOWYZ0VK3 type=del 2024-04-03T03:46:15.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.101+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~UUZHJZFUPRGQ.0 size=1048576 2024-04-03T03:46:15.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.101+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~UUZHJZFUPRGQ.1 size=1048576 2024-04-03T03:46:15.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.105+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~UUZHJZFUPRGQ.2 size=676677 2024-04-03T03:46:15.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.105+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=UUZHJZFUPRGQ tag=O86KMBOB22AF type=write size=3822405 2024-04-03T03:46:15.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.105+0000 7f55269288c0 1 < completed write operation key=KU1R0YLDP1V3 tag=FOQJJIUJU11Y type=write size=736965 2024-04-03T03:46:15.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.109+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~68CJZ78F4L6B.0 size=1048576 2024-04-03T03:46:15.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.109+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~68CJZ78F4L6B.1 size=1048576 2024-04-03T03:46:15.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.113+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~68CJZ78F4L6B.2 size=243408 2024-04-03T03:46:15.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.113+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=68CJZ78F4L6B tag=KBGNFQ80TLGH type=write size=3389136 2024-04-03T03:46:15.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.117+0000 7f55269288c0 1 < canceled operation key=LZQGL2UAWOTU tag=PCFH49FGPTDW type=del size=1028796 2024-04-03T03:46:15.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.121+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~YLZ75JFWUU16.0 size=1048576 2024-04-03T03:46:15.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.121+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~YLZ75JFWUU16.1 size=378673 2024-04-03T03:46:15.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.121+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=YLZ75JFWUU16 tag=TNDGOLMI9PE0 type=write size=2475825 2024-04-03T03:46:15.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.121+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=3C3ZM1IVWTAT type=del 2024-04-03T03:46:15.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.125+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=SE9VMKR0K38R type=del size=3470020 2024-04-03T03:46:15.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.129+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~MIJD49PEUMA8.0 size=1048576 2024-04-03T03:46:15.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.129+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~MIJD49PEUMA8.1 size=1048576 2024-04-03T03:46:15.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.129+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~MIJD49PEUMA8.2 size=750978 2024-04-03T03:46:15.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.133+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=MIJD49PEUMA8 tag=C4OM3ZGD6L0E type=write size=3896706 2024-04-03T03:46:15.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.137+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=A7TION5CF061 type=del size=588344 2024-04-03T03:46:15.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.141+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=2N3DISURTX1V type=del 2024-04-03T03:46:15.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.145+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~E5V55SML1Z0N.0 size=769677 2024-04-03T03:46:15.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.145+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=E5V55SML1Z0N tag=GC0DPBIA12CZ type=write size=1818253 2024-04-03T03:46:15.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.145+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=HTX1I9EDYPXH type=del 2024-04-03T03:46:15.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.149+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=7KE9HMRP3XME type=write size=295927 2024-04-03T03:46:15.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.149+0000 7f55269288c0 -1 < failed to complete operation key=TXFMKXUGMEA8 tag=QRBQ7Z3BEX1A type=del size=181950: (22) Invalid argument 2024-04-03T03:46:15.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.153+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~L0YED0PWT04N.0 size=1048576 2024-04-03T03:46:15.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.157+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~L0YED0PWT04N.1 size=1014549 2024-04-03T03:46:15.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.157+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=L0YED0PWT04N tag=YQS3UGEO4HLB type=write size=3111701 2024-04-03T03:46:15.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.157+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=XO9ED69X3ZZU type=del 2024-04-03T03:46:15.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.165+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~R2S2S48TG9JB.0 size=79513 2024-04-03T03:46:15.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.165+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=R2S2S48TG9JB tag=KMLUBTXHVGPL type=write size=1128089 2024-04-03T03:46:15.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.165+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~T3L1T8Y4OH7T.0 size=1048576 2024-04-03T03:46:15.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.169+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~T3L1T8Y4OH7T.1 size=745992 2024-04-03T03:46:15.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.169+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=T3L1T8Y4OH7T tag=5ZP366T40EH1 type=write size=2843144 2024-04-03T03:46:15.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.173+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=KEG3KAVTTY95 type=del size=111112 2024-04-03T03:46:15.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.177+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=6KZHR92BBMTM type=del 2024-04-03T03:46:15.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.177+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~BKCLDVXB3GML.0 size=1048576 2024-04-03T03:46:15.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.181+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~BKCLDVXB3GML.1 size=1048576 2024-04-03T03:46:15.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.181+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~BKCLDVXB3GML.2 size=436557 2024-04-03T03:46:15.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.181+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=BKCLDVXB3GML tag=MFY4OOM9SKNQ type=write size=3582285 2024-04-03T03:46:15.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.185+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=XDH0HNMSY12Y type=del 2024-04-03T03:46:15.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.189+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=MAUFKPUCRL4V type=del size=1351198 2024-04-03T03:46:15.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.189+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~BMABFLA2C8Y7.0 size=1048576 2024-04-03T03:46:15.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.189+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~BMABFLA2C8Y7.1 size=792335 2024-04-03T03:46:15.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.193+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=BMABFLA2C8Y7 tag=ZS6GJHCZDJD0 type=write size=2889487 2024-04-03T03:46:15.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.197+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=TNC89EGN7I8O type=del size=2708576 2024-04-03T03:46:15.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.197+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~YDB0F4KOLW1R.0 size=1048576 2024-04-03T03:46:15.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.201+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~YDB0F4KOLW1R.1 size=110046 2024-04-03T03:46:15.201 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.205+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=YDB0F4KOLW1R tag=TEUW10TEERKJ type=write size=2207198 2024-04-03T03:46:15.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.209+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~TUZRYI78XGGD.0 size=1048576 2024-04-03T03:46:15.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.213+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~TUZRYI78XGGD.1 size=77162 2024-04-03T03:46:15.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.213+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=TUZRYI78XGGD tag=XX5FPFKZOSVW type=write size=2174314 2024-04-03T03:46:15.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.213+0000 7f55269288c0 1 < completed write operation key=8BMP0HIS520R tag=L4I3I5LQXE7V type=write size=485161 2024-04-03T03:46:15.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.217+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=VY39SVUGY0I9 type=del size=1743251 2024-04-03T03:46:15.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.217+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~VKERPDG6NXXR.0 size=1048576 2024-04-03T03:46:15.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.221+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~VKERPDG6NXXR.1 size=602903 2024-04-03T03:46:15.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.221+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=VKERPDG6NXXR tag=V4R5J9EHBQLX type=write size=2700055 2024-04-03T03:46:15.222 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.225+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=SKS3BDHDDHMW type=del size=1375587 2024-04-03T03:46:15.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.229+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~UUZHJZFUPRGQ.0 size=1048576 2024-04-03T03:46:15.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.229+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~UUZHJZFUPRGQ.1 size=1048576 2024-04-03T03:46:15.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.229+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~UUZHJZFUPRGQ.2 size=676677 2024-04-03T03:46:15.231 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.233+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=UUZHJZFUPRGQ tag=O86KMBOB22AF type=write size=3822405 2024-04-03T03:46:15.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.237+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~P12VZ6TR16CB.0 size=1048576 2024-04-03T03:46:15.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.241+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~P12VZ6TR16CB.1 size=1048576 2024-04-03T03:46:15.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.241+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~P12VZ6TR16CB.2 size=137546 2024-04-03T03:46:15.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.241+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=P12VZ6TR16CB tag=0INV6IQYRHU5 type=write size=3283274 2024-04-03T03:46:15.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.245+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~68CJZ78F4L6B.0 size=1048576 2024-04-03T03:46:15.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.245+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~68CJZ78F4L6B.1 size=1048576 2024-04-03T03:46:15.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.249+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~68CJZ78F4L6B.2 size=243408 2024-04-03T03:46:15.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.253+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=68CJZ78F4L6B tag=KBGNFQ80TLGH type=write size=3389136 2024-04-03T03:46:15.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.257+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~C9O1PHXPDQ63.0 size=1048576 2024-04-03T03:46:15.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.257+0000 7f55269288c0 1 > prepared part key=_multipart_B5BI0HJ5S1Y1.2~C9O1PHXPDQ63.1 size=538774 2024-04-03T03:46:15.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.257+0000 7f55269288c0 1 > prepared multipart upload key=B5BI0HJ5S1Y1 upload=C9O1PHXPDQ63 tag=89FU5CVT1ASR type=write size=2635926 2024-04-03T03:46:15.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.261+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~YLZ75JFWUU16.0 size=1048576 2024-04-03T03:46:15.260 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.261+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~YLZ75JFWUU16.1 size=378673 2024-04-03T03:46:15.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.269+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=YLZ75JFWUU16 tag=TNDGOLMI9PE0 type=write size=2475825 2024-04-03T03:46:15.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.269+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=99LU79QKGC1M type=del size=3115532 2024-04-03T03:46:15.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.273+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=SE9VMKR0K38R type=del 2024-04-03T03:46:15.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.273+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=HSRA78GHW72Y type=del size=3601504 2024-04-03T03:46:15.273 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.277+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=A7TION5CF061 type=del 2024-04-03T03:46:15.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.277+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=WV4BZ8150JYK type=write size=201941 2024-04-03T03:46:15.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.281+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~E5V55SML1Z0N.0 size=769677 2024-04-03T03:46:15.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.285+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=E5V55SML1Z0N tag=GC0DPBIA12CZ type=write size=1818253 2024-04-03T03:46:15.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.289+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~C4ZZHDRD50R0.0 size=239632 2024-04-03T03:46:15.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.289+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=C4ZZHDRD50R0 tag=0BA22I74NA6S type=write size=1288208 2024-04-03T03:46:15.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.289+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=7KE9HMRP3XME type=write size=295927 2024-04-03T03:46:15.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.293+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=3YQOJIS9N45E type=del size=1998393 2024-04-03T03:46:15.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.297+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~L0YED0PWT04N.0 size=1048576 2024-04-03T03:46:15.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.297+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~L0YED0PWT04N.1 size=1014549 2024-04-03T03:46:15.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.301+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=L0YED0PWT04N tag=YQS3UGEO4HLB type=write size=3111701 2024-04-03T03:46:15.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.305+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=SS32CWOLNX87 type=del size=1148463 2024-04-03T03:46:15.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.305+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~R2S2S48TG9JB.0 size=79513 2024-04-03T03:46:15.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.309+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=R2S2S48TG9JB tag=KMLUBTXHVGPL type=write size=1128089 2024-04-03T03:46:15.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.313+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=N6Q2PKL4NJ6O type=del size=1986266 2024-04-03T03:46:15.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.313+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=KEG3KAVTTY95 type=del 2024-04-03T03:46:15.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.317+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=U74YLX1CD4JA type=del size=3678577 2024-04-03T03:46:15.316 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.317+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~BKCLDVXB3GML.0 size=1048576 2024-04-03T03:46:15.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.321+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~BKCLDVXB3GML.1 size=1048576 2024-04-03T03:46:15.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.321+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~BKCLDVXB3GML.2 size=436557 2024-04-03T03:46:15.323 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.325+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=BKCLDVXB3GML tag=MFY4OOM9SKNQ type=write size=3582285 2024-04-03T03:46:15.327 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.329+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~L3P095VN6OGV.0 size=1048576 2024-04-03T03:46:15.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.333+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~L3P095VN6OGV.1 size=1048576 2024-04-03T03:46:15.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.333+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~L3P095VN6OGV.2 size=533657 2024-04-03T03:46:15.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.333+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=L3P095VN6OGV tag=ZX0EPH2R5V4E type=write size=3679385 2024-04-03T03:46:15.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.337+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=MAUFKPUCRL4V type=del 2024-04-03T03:46:15.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.337+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=TR1N7XLYRRF9 type=del size=838063 2024-04-03T03:46:15.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.341+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=TNC89EGN7I8O type=del 2024-04-03T03:46:15.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.345+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=8DX5F6CC5XV1 type=del size=2570797 2024-04-03T03:46:15.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.345+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~TUZRYI78XGGD.0 size=1048576 2024-04-03T03:46:15.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.349+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~TUZRYI78XGGD.1 size=77162 2024-04-03T03:46:15.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.353+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=TUZRYI78XGGD tag=XX5FPFKZOSVW type=write size=2174314 2024-04-03T03:46:15.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.357+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~D8DMPQPF58K5.0 size=1048576 2024-04-03T03:46:15.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.357+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~D8DMPQPF58K5.1 size=1048576 2024-04-03T03:46:15.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.361+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~D8DMPQPF58K5.2 size=72061 2024-04-03T03:46:15.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.361+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=D8DMPQPF58K5 tag=LNT9ZGMDWQNV type=write size=3217789 2024-04-03T03:46:15.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.361+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=VY39SVUGY0I9 type=del 2024-04-03T03:46:15.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.365+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=DEC9W4YGC9BB type=write size=856292 2024-04-03T03:46:15.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.369+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=SKS3BDHDDHMW type=del 2024-04-03T03:46:15.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.373+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~XUI4H9YFSMNB.0 size=1048576 2024-04-03T03:46:15.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.373+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~XUI4H9YFSMNB.1 size=1048576 2024-04-03T03:46:15.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.377+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~XUI4H9YFSMNB.2 size=1012050 2024-04-03T03:46:15.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.377+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=XUI4H9YFSMNB tag=MXL0VQUI9CXL type=write size=4157778 2024-04-03T03:46:15.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.377+0000 7f55269288c0 1 < canceled part key=_multipart_AXL5RVPSVDY5.2~P12VZ6TR16CB.0 size=1048576 2024-04-03T03:46:15.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.377+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~P12VZ6TR16CB.1 size=1048576 2024-04-03T03:46:15.377 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.381+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~P12VZ6TR16CB.2 size=137546 2024-04-03T03:46:15.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.385+0000 7f55269288c0 1 < canceled multipart upload key=AXL5RVPSVDY5 upload=P12VZ6TR16CB tag=0INV6IQYRHU5 type=write size=3283274 2024-04-03T03:46:15.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.385+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=JXQY54MIX7U2 type=del size=1047674 2024-04-03T03:46:15.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.389+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~C9O1PHXPDQ63.0 size=1048576 2024-04-03T03:46:15.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.389+0000 7f55269288c0 1 < completed part key=_multipart_B5BI0HJ5S1Y1.2~C9O1PHXPDQ63.1 size=538774 2024-04-03T03:46:15.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.393+0000 7f55269288c0 1 < completed multipart upload key=B5BI0HJ5S1Y1 upload=C9O1PHXPDQ63 tag=89FU5CVT1ASR type=write size=2635926 2024-04-03T03:46:15.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.401+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~M45Z81W1G100.0 size=1048576 2024-04-03T03:46:15.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.401+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~M45Z81W1G100.1 size=775775 2024-04-03T03:46:15.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.401+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=M45Z81W1G100 tag=4P9I9P8UR7R0 type=write size=2872927 2024-04-03T03:46:15.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.405+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=99LU79QKGC1M type=del 2024-04-03T03:46:15.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.409+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~YJN42RQCP4IG.0 size=1048576 2024-04-03T03:46:15.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.413+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~YJN42RQCP4IG.1 size=583857 2024-04-03T03:46:15.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.413+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=YJN42RQCP4IG tag=CBQF2CWSPBTU type=write size=2681009 2024-04-03T03:46:15.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.413+0000 7f55269288c0 1 < canceled operation key=MLTDNCZ4E5D8 tag=HSRA78GHW72Y type=del size=3601504 2024-04-03T03:46:15.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.417+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~FK927EOG192H.0 size=358175 2024-04-03T03:46:15.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.417+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=FK927EOG192H tag=G32VZOMPIZ8B type=write size=1406751 2024-04-03T03:46:15.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.421+0000 7f55269288c0 1 < completed write operation key=KDSE2XB4D1XI tag=WV4BZ8150JYK type=write size=201941 2024-04-03T03:46:15.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.425+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=JWG8V8XU2LQQ type=del size=1580083 2024-04-03T03:46:15.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.429+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~C4ZZHDRD50R0.0 size=239632 2024-04-03T03:46:15.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.433+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=C4ZZHDRD50R0 tag=0BA22I74NA6S type=write size=1288208 2024-04-03T03:46:15.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.437+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=RBON5JML6NKI type=del size=3123586 2024-04-03T03:46:15.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.437+0000 7f55269288c0 1 < canceled operation key=TXFMKXUGMEA8 tag=3YQOJIS9N45E type=del size=1998393 2024-04-03T03:46:15.438 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.441+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=SO8B00YM94FS type=del size=1524427 2024-04-03T03:46:15.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.445+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=SS32CWOLNX87 type=del 2024-04-03T03:46:15.446 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.449+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~CBAGB1J1GJ0T.0 size=1048576 2024-04-03T03:46:15.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.453+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~CBAGB1J1GJ0T.1 size=235475 2024-04-03T03:46:15.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.453+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=CBAGB1J1GJ0T tag=4L5IBD75GVCD type=write size=2332627 2024-04-03T03:46:15.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.453+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=N6Q2PKL4NJ6O type=del 2024-04-03T03:46:15.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.457+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=TU2R3NL15GJR type=del size=3048479 2024-04-03T03:46:15.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.461+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=U74YLX1CD4JA type=del 2024-04-03T03:46:15.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.465+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=6KPXHB41MTJE type=del size=3066269 2024-04-03T03:46:15.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.465+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~L3P095VN6OGV.0 size=1048576 2024-04-03T03:46:15.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.469+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~L3P095VN6OGV.1 size=1048576 2024-04-03T03:46:15.468 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.473+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~L3P095VN6OGV.2 size=533657 2024-04-03T03:46:15.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.477+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=L3P095VN6OGV tag=ZX0EPH2R5V4E type=write size=3679385 2024-04-03T03:46:15.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.477+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=SS6MLQ1C2EOP type=del size=999594 2024-04-03T03:46:15.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.481+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=TR1N7XLYRRF9 type=del 2024-04-03T03:46:15.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.485+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=XTLHIZ1TXBYX type=del size=2676820 2024-04-03T03:46:15.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.485+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=8DX5F6CC5XV1 type=del 2024-04-03T03:46:15.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.489+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=KVAX22639NFI type=del size=561966 2024-04-03T03:46:15.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.493+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~D8DMPQPF58K5.0 size=1048576 2024-04-03T03:46:15.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.493+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~D8DMPQPF58K5.1 size=1048576 2024-04-03T03:46:15.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.493+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~D8DMPQPF58K5.2 size=72061 2024-04-03T03:46:15.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.497+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=D8DMPQPF58K5 tag=LNT9ZGMDWQNV type=write size=3217789 2024-04-03T03:46:15.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.505+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~6AJVRK2WGAFG.0 size=142733 2024-04-03T03:46:15.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.505+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=6AJVRK2WGAFG tag=FG6BO7W7315J type=write size=1191309 2024-04-03T03:46:15.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.505+0000 7f55269288c0 1 < completed write operation key=7POFUQ9CX6B1 tag=DEC9W4YGC9BB type=write size=856292 2024-04-03T03:46:15.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.513+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~YD32UALNRS51.0 size=1048576 2024-04-03T03:46:15.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.513+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~YD32UALNRS51.1 size=1048576 2024-04-03T03:46:15.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.517+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~YD32UALNRS51.2 size=123679 2024-04-03T03:46:15.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.517+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=YD32UALNRS51 tag=781ENNIBJKRG type=write size=3269407 2024-04-03T03:46:15.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.517+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~XUI4H9YFSMNB.0 size=1048576 2024-04-03T03:46:15.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.521+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~XUI4H9YFSMNB.1 size=1048576 2024-04-03T03:46:15.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.525+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~XUI4H9YFSMNB.2 size=1012050 2024-04-03T03:46:15.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.529+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=XUI4H9YFSMNB tag=MXL0VQUI9CXL type=write size=4157778 2024-04-03T03:46:15.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.533+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~PNNJB6N60RL2.0 size=477055 2024-04-03T03:46:15.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.533+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=PNNJB6N60RL2 tag=LNYVUIPT3I41 type=write size=1525631 2024-04-03T03:46:15.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.537+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=JXQY54MIX7U2 type=del 2024-04-03T03:46:15.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.537+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=J3ECWUTXHREG type=del size=2192209 2024-04-03T03:46:15.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.541+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~M45Z81W1G100.0 size=1048576 2024-04-03T03:46:15.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.545+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~M45Z81W1G100.1 size=775775 2024-04-03T03:46:15.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.549+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=M45Z81W1G100 tag=4P9I9P8UR7R0 type=write size=2872927 2024-04-03T03:46:15.548 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.553+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=3SB92U7YQ66E type=del size=1721089 2024-04-03T03:46:15.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.553+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~YJN42RQCP4IG.0 size=1048576 2024-04-03T03:46:15.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.557+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~YJN42RQCP4IG.1 size=583857 2024-04-03T03:46:15.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.561+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=YJN42RQCP4IG tag=CBQF2CWSPBTU type=write size=2681009 2024-04-03T03:46:15.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.565+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=M2PY3DYQ7L4Z type=del size=610423 2024-04-03T03:46:15.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.569+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~FK927EOG192H.0 size=358175 2024-04-03T03:46:15.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.573+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=FK927EOG192H tag=G32VZOMPIZ8B type=write size=1406751 2024-04-03T03:46:15.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.577+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=V8VYRUA2O5F3 type=del size=3683150 2024-04-03T03:46:15.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.577+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=JWG8V8XU2LQQ type=del 2024-04-03T03:46:15.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.581+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=HC1ZBW8GCERK type=del size=2179248 2024-04-03T03:46:15.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.585+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=RBON5JML6NKI type=del 2024-04-03T03:46:15.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.589+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~9FSG6FJSIK20.0 size=1048576 2024-04-03T03:46:15.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.593+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~9FSG6FJSIK20.1 size=931121 2024-04-03T03:46:15.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.593+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=9FSG6FJSIK20 tag=T4JBZH1HCBLW type=write size=3028273 2024-04-03T03:46:15.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.593+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=SO8B00YM94FS type=del 2024-04-03T03:46:15.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.597+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=0ICJN0Z29JU8 type=del size=50467 2024-04-03T03:46:15.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.601+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~CBAGB1J1GJ0T.0 size=1048576 2024-04-03T03:46:15.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.605+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~CBAGB1J1GJ0T.1 size=235475 2024-04-03T03:46:15.605 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.609+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=CBAGB1J1GJ0T tag=4L5IBD75GVCD type=write size=2332627 2024-04-03T03:46:15.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.613+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=GLE49HEDKT2E type=del size=2806174 2024-04-03T03:46:15.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.613+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=TU2R3NL15GJR type=del 2024-04-03T03:46:15.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.617+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=9M10MIZHP166 type=del size=2038414 2024-04-03T03:46:15.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.625+0000 7f55269288c0 1 < suggested update operation key=SFN1M3HPGT18 tag=6KPXHB41MTJE type=del size=3066269 2024-04-03T03:46:15.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.629+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~XCAWXPNYV0OF.0 size=671442 2024-04-03T03:46:15.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.629+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=XCAWXPNYV0OF tag=T0GPTSEN7ZST type=write size=1720018 2024-04-03T03:46:15.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.633+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=SS6MLQ1C2EOP type=del 2024-04-03T03:46:15.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.633+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=0MJBS1ELNWA9 type=del size=1849668 2024-04-03T03:46:15.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.637+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=XTLHIZ1TXBYX type=del 2024-04-03T03:46:15.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.641+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~2HSELXMTK4YF.0 size=1048576 2024-04-03T03:46:15.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.645+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~2HSELXMTK4YF.1 size=1048576 2024-04-03T03:46:15.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.645+0000 7f55269288c0 1 > prepared part key=_multipart_X3YCYKP2P9IM.2~2HSELXMTK4YF.2 size=1024256 2024-04-03T03:46:15.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.645+0000 7f55269288c0 1 > prepared multipart upload key=X3YCYKP2P9IM upload=2HSELXMTK4YF tag=FFEH3VY7LGWC type=write size=4169984 2024-04-03T03:46:15.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.649+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=KVAX22639NFI type=del 2024-04-03T03:46:15.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.653+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=8O4GIHMFFRZA type=del size=3263984 2024-04-03T03:46:15.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.653+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~6AJVRK2WGAFG.0 size=142733 2024-04-03T03:46:15.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.657+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=6AJVRK2WGAFG tag=FG6BO7W7315J type=write size=1191309 2024-04-03T03:46:15.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.661+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=0STCK2CM5NG6 type=del size=2581453 2024-04-03T03:46:15.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.665+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~YD32UALNRS51.0 size=1048576 2024-04-03T03:46:15.663 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.665+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~YD32UALNRS51.1 size=1048576 2024-04-03T03:46:15.664 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.669+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~YD32UALNRS51.2 size=123679 2024-04-03T03:46:15.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.673+0000 7f55269288c0 1 < completed multipart upload key=X3YCYKP2P9IM upload=YD32UALNRS51 tag=781ENNIBJKRG type=write size=3269407 2024-04-03T03:46:15.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.677+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~Q2HD5EIMDY2T.0 size=1048576 2024-04-03T03:46:15.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.677+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~Q2HD5EIMDY2T.1 size=1048576 2024-04-03T03:46:15.676 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.677+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~Q2HD5EIMDY2T.2 size=494908 2024-04-03T03:46:15.676 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.677+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=Q2HD5EIMDY2T tag=J30FJC8LFCB9 type=write size=3640636 2024-04-03T03:46:15.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.685+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~PNNJB6N60RL2.0 size=477055 2024-04-03T03:46:15.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.689+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=PNNJB6N60RL2 tag=LNYVUIPT3I41 type=write size=1525631 2024-04-03T03:46:15.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.689+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=ZOGL2OS396YF type=write size=778736 2024-04-03T03:46:15.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.693+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=J3ECWUTXHREG type=del 2024-04-03T03:46:15.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.697+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~QPP08TCATCKV.0 size=127416 2024-04-03T03:46:15.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.697+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=QPP08TCATCKV tag=TIHH7YPVC2D2 type=write size=1175992 2024-04-03T03:46:15.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.701+0000 7f55269288c0 1 < suggested update operation key=K7A1O21ZURWQ tag=3SB92U7YQ66E type=del size=1721089 2024-04-03T03:46:15.702 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.705+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~NUTIMLW0QQZY.0 size=597463 2024-04-03T03:46:15.702 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.705+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=NUTIMLW0QQZY tag=H0E3Z9GGBM4Q type=write size=1646039 2024-04-03T03:46:15.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.709+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=M2PY3DYQ7L4Z type=del 2024-04-03T03:46:15.708 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.713+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~I0HOSKMHW4YQ.0 size=811767 2024-04-03T03:46:15.709 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.713+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=I0HOSKMHW4YQ tag=XXIQ09UPAQXJ type=write size=1860343 2024-04-03T03:46:15.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.713+0000 7f55269288c0 1 < canceled operation key=IOHMF3ADC6EU tag=V8VYRUA2O5F3 type=del size=3683150 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.717+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=70VT6F0M32AW type=del size=199486 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.717+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=HC1ZBW8GCERK type=del 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.721+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=F9ACHPQMXZLN type=write size=74905 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.721+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~9FSG6FJSIK20.0 size=1048576 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.725+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~9FSG6FJSIK20.1 size=931121 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.729+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=9FSG6FJSIK20 tag=T4JBZH1HCBLW type=write size=3028273 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.733+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=QQ2T4TLUH9WA type=del size=724493 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.733+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=0ICJN0Z29JU8 type=del 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.737+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~IQ4Z3958KXXL.0 size=554090 2024-04-03T03:46:15.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.737+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=IQ4Z3958KXXL tag=EI93IJQYA8C3 type=write size=1602666 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.741+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=GLE49HEDKT2E type=del 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.745+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~50FVMKZE5N2T.0 size=1048576 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.749+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~50FVMKZE5N2T.1 size=253654 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.749+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=50FVMKZE5N2T tag=1WGQZ9YUCXE0 type=write size=2350806 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.753+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=9M10MIZHP166 type=del 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.757+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=WW7438TR3UE5 type=del size=3692887 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.757+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~XCAWXPNYV0OF.0 size=671442 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.765+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=XCAWXPNYV0OF tag=T0GPTSEN7ZST type=write size=1720018 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.765+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=O06UHO8VEUC7 type=write size=706774 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.769+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=0MJBS1ELNWA9 type=del 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.773+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=QS4WKJCG4T6I type=write size=231596 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.777+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~2HSELXMTK4YF.0 size=1048576 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.777+0000 7f55269288c0 1 < completed part key=_multipart_X3YCYKP2P9IM.2~2HSELXMTK4YF.1 size=1048576 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.777+0000 7f55269288c0 1 < canceled part key=_multipart_X3YCYKP2P9IM.2~2HSELXMTK4YF.2 size=1024256 2024-04-03T03:46:15.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.785+0000 7f55269288c0 1 < canceled multipart upload key=X3YCYKP2P9IM upload=2HSELXMTK4YF tag=FFEH3VY7LGWC type=write size=4169984 2024-04-03T03:46:15.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.785+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=9FEG2QU46LWG type=del size=133103 2024-04-03T03:46:15.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.789+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=8O4GIHMFFRZA type=del 2024-04-03T03:46:15.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.793+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=A2LITPE09T5N type=write size=199081 2024-04-03T03:46:15.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.801+0000 7f55269288c0 1 < suggested update operation key=IOHMF3ADC6EU tag=0STCK2CM5NG6 type=del size=2581453 2024-04-03T03:46:15.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.805+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=5PBE2JQ4823R type=del size=3618993 2024-04-03T03:46:15.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.809+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~Q2HD5EIMDY2T.0 size=1048576 2024-04-03T03:46:15.809 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.813+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~Q2HD5EIMDY2T.1 size=1048576 2024-04-03T03:46:15.812 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.813+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~Q2HD5EIMDY2T.2 size=494908 2024-04-03T03:46:15.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.821+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=Q2HD5EIMDY2T tag=J30FJC8LFCB9 type=write size=3640636 2024-04-03T03:46:15.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.821+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=H8YA6CACGV4V type=del size=3301031 2024-04-03T03:46:15.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.825+0000 7f55269288c0 1 < completed write operation key=D9OEPPT37WSJ tag=ZOGL2OS396YF type=write size=778736 2024-04-03T03:46:15.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.829+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=EAOCPK3UNRM9 type=del size=4036032 2024-04-03T03:46:15.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.833+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~QPP08TCATCKV.0 size=127416 2024-04-03T03:46:15.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.837+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=QPP08TCATCKV tag=TIHH7YPVC2D2 type=write size=1175992 2024-04-03T03:46:15.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.841+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=2KGD1TSFEB7Q type=del size=322689 2024-04-03T03:46:15.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.845+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~NUTIMLW0QQZY.0 size=597463 2024-04-03T03:46:15.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.849+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=NUTIMLW0QQZY tag=H0E3Z9GGBM4Q type=write size=1646039 2024-04-03T03:46:15.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.853+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=1FNHN0IW4LDB type=del size=800095 2024-04-03T03:46:15.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.853+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~I0HOSKMHW4YQ.0 size=811767 2024-04-03T03:46:15.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.861+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=I0HOSKMHW4YQ tag=XXIQ09UPAQXJ type=write size=1860343 2024-04-03T03:46:15.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.861+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=KWDPFTZBFRQE type=del size=2597565 2024-04-03T03:46:15.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.865+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=70VT6F0M32AW type=del 2024-04-03T03:46:15.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.869+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=ZF846B36L8I4 type=del size=1341874 2024-04-03T03:46:15.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.873+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=F9ACHPQMXZLN type=write size=74905 2024-04-03T03:46:15.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.877+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~7XHWA6NKO6BJ.0 size=1048576 2024-04-03T03:46:15.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.877+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~7XHWA6NKO6BJ.1 size=1048576 2024-04-03T03:46:15.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.881+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~7XHWA6NKO6BJ.2 size=235758 2024-04-03T03:46:15.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.881+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=7XHWA6NKO6BJ tag=ERAFE6E85IMB type=write size=3381486 2024-04-03T03:46:15.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.885+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=QQ2T4TLUH9WA type=del 2024-04-03T03:46:15.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.889+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~RF8IBIRG4G7T.0 size=266007 2024-04-03T03:46:15.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.889+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=RF8IBIRG4G7T tag=W4OQ8PIEFDAB type=write size=1314583 2024-04-03T03:46:15.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.889+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~IQ4Z3958KXXL.0 size=554090 2024-04-03T03:46:15.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.893+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=IQ4Z3958KXXL tag=EI93IJQYA8C3 type=write size=1602666 2024-04-03T03:46:15.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.897+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=DE9IFVZRKOZJ type=del size=18794 2024-04-03T03:46:15.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.901+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~50FVMKZE5N2T.0 size=1048576 2024-04-03T03:46:15.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.901+0000 7f55269288c0 1 < canceled part key=_multipart_LZQGL2UAWOTU.2~50FVMKZE5N2T.1 size=253654 2024-04-03T03:46:15.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.905+0000 7f55269288c0 1 < canceled multipart upload key=LZQGL2UAWOTU upload=50FVMKZE5N2T tag=1WGQZ9YUCXE0 type=write size=2350806 2024-04-03T03:46:15.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.909+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=JX2VNGCXE9JU type=del size=2609055 2024-04-03T03:46:15.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.913+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=WW7438TR3UE5 type=del 2024-04-03T03:46:15.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.913+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=NW85QIN5AEFT type=del size=1755655 2024-04-03T03:46:15.913 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.917+0000 7f55269288c0 1 < completed write operation key=YCEKDT5EQD9D tag=O06UHO8VEUC7 type=write size=706774 2024-04-03T03:46:15.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.917+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=34D5C22WMWXY type=del size=2995035 2024-04-03T03:46:15.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.921+0000 7f55269288c0 1 < completed write operation key=YCEKDT5EQD9D tag=QS4WKJCG4T6I type=write size=231596 2024-04-03T03:46:15.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.925+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=C1DNWKBDPGWH type=del size=1623439 2024-04-03T03:46:15.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.925+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=9FEG2QU46LWG type=del 2024-04-03T03:46:15.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.929+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=85E9V3DJM1SK type=del size=1402791 2024-04-03T03:46:15.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.933+0000 7f55269288c0 1 < suggested update operation key=TW860A14J9RC tag=A2LITPE09T5N type=write size=199081 2024-04-03T03:46:15.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.937+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~4NVBIIA95R2M.0 size=1048576 2024-04-03T03:46:15.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.941+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~4NVBIIA95R2M.1 size=1048576 2024-04-03T03:46:15.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.941+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~4NVBIIA95R2M.2 size=265436 2024-04-03T03:46:15.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.941+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=4NVBIIA95R2M tag=Z4I3XKAOHOUK type=write size=3411164 2024-04-03T03:46:15.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.949+0000 7f55269288c0 1 < suggested update operation key=X3YCYKP2P9IM tag=5PBE2JQ4823R type=del size=3618993 2024-04-03T03:46:15.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.953+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=WF0HN0ZEANOG type=del size=1678614 2024-04-03T03:46:15.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.957+0000 7f55269288c0 1 < suggested remove operation key=3XKXK1JXKOHU tag=H8YA6CACGV4V type=del 2024-04-03T03:46:15.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.961+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=4JK8I10FDNIN type=del size=76743 2024-04-03T03:46:15.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.961+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=EAOCPK3UNRM9 type=del 2024-04-03T03:46:15.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.969+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~T9GAX62LLKI4.0 size=1048576 2024-04-03T03:46:15.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.969+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~T9GAX62LLKI4.1 size=111492 2024-04-03T03:46:15.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.969+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=T9GAX62LLKI4 tag=UBYA3YCTPEFV type=write size=2208644 2024-04-03T03:46:15.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.973+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=2KGD1TSFEB7Q type=del 2024-04-03T03:46:15.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.973+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=PFZ9WI3AZPP7 type=del size=2248983 2024-04-03T03:46:15.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.977+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=1FNHN0IW4LDB type=del 2024-04-03T03:46:15.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.981+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=T2T31917BMR6 type=write size=1005123 2024-04-03T03:46:15.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.981+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=KWDPFTZBFRQE type=del 2024-04-03T03:46:15.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.985+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~RMI1YHBQ2RYB.0 size=20440 2024-04-03T03:46:15.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.985+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=RMI1YHBQ2RYB tag=1AAXN3EAH5L3 type=write size=1069016 2024-04-03T03:46:15.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.993+0000 7f55269288c0 1 < suggested remove operation key=XFCPX90N2NYC tag=ZF846B36L8I4 type=del 2024-04-03T03:46:15.991 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.993+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=LSNJD5O9IEY7 type=del size=467142 2024-04-03T03:46:15.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.997+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~7XHWA6NKO6BJ.0 size=1048576 2024-04-03T03:46:15.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.997+0000 7f55269288c0 1 < canceled part key=_multipart_6KH6TASZS3UG.2~7XHWA6NKO6BJ.1 size=1048576 2024-04-03T03:46:15.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:15.997+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~7XHWA6NKO6BJ.2 size=235758 2024-04-03T03:46:15.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.001+0000 7f55269288c0 1 < canceled multipart upload key=6KH6TASZS3UG upload=7XHWA6NKO6BJ tag=ERAFE6E85IMB type=write size=3381486 2024-04-03T03:46:16.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.005+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~0LIR1FGUCFDX.0 size=1048576 2024-04-03T03:46:16.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.009+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~0LIR1FGUCFDX.1 size=661538 2024-04-03T03:46:16.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.009+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=0LIR1FGUCFDX tag=V0J1LRCKZZLH type=write size=2758690 2024-04-03T03:46:16.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.009+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~RF8IBIRG4G7T.0 size=266007 2024-04-03T03:46:16.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.013+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=RF8IBIRG4G7T tag=W4OQ8PIEFDAB type=write size=1314583 2024-04-03T03:46:16.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.017+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=02PUCG9S8KQ1 type=write size=372128 2024-04-03T03:46:16.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.021+0000 7f55269288c0 1 < suggested remove operation key=AXL5RVPSVDY5 tag=DE9IFVZRKOZJ type=del 2024-04-03T03:46:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.025+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~8ZG2USQG22AJ.0 size=1048576 2024-04-03T03:46:16.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.029+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~8ZG2USQG22AJ.1 size=1048576 2024-04-03T03:46:16.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.029+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~8ZG2USQG22AJ.2 size=933936 2024-04-03T03:46:16.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.029+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=8ZG2USQG22AJ tag=LXQA0CIZMCID type=write size=4079664 2024-04-03T03:46:16.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.033+0000 7f55269288c0 1 < completed delete operation key=IOHMF3ADC6EU tag=JX2VNGCXE9JU type=del 2024-04-03T03:46:16.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.037+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~KP3WTL0LPOQL.0 size=1048576 2024-04-03T03:46:16.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.041+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~KP3WTL0LPOQL.1 size=764708 2024-04-03T03:46:16.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.041+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=KP3WTL0LPOQL tag=KT4K7QXNLZE6 type=write size=2861860 2024-04-03T03:46:16.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.041+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=NW85QIN5AEFT type=del 2024-04-03T03:46:16.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.045+0000 7f55269288c0 1 > prepared operation key=K3Z9W19WEJBM tag=BLRHLVVA4Q3R type=write size=592519 2024-04-03T03:46:16.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.049+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=34D5C22WMWXY type=del 2024-04-03T03:46:16.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.053+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~8ETD6VL0PQC5.0 size=1048576 2024-04-03T03:46:16.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.053+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~8ETD6VL0PQC5.1 size=1048576 2024-04-03T03:46:16.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.057+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~8ETD6VL0PQC5.2 size=144147 2024-04-03T03:46:16.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.057+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=8ETD6VL0PQC5 tag=LJLLGNU036HU type=write size=3289875 2024-04-03T03:46:16.058 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.061+0000 7f55269288c0 1 < suggested update operation key=Z42NDVEX1SOL tag=C1DNWKBDPGWH type=del size=1623439 2024-04-03T03:46:16.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.065+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~F5SPAFNVM710.0 size=1048576 2024-04-03T03:46:16.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.069+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~F5SPAFNVM710.1 size=538605 2024-04-03T03:46:16.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.069+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=F5SPAFNVM710 tag=FP11II02Q2JN type=write size=2635757 2024-04-03T03:46:16.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.073+0000 7f55269288c0 1 < suggested update operation key=6KH6TASZS3UG tag=85E9V3DJM1SK type=del size=1402791 2024-04-03T03:46:16.072 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.077+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=AQUK1W7GMR3J type=del size=1049387 2024-04-03T03:46:16.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.077+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~4NVBIIA95R2M.0 size=1048576 2024-04-03T03:46:16.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.081+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~4NVBIIA95R2M.1 size=1048576 2024-04-03T03:46:16.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.081+0000 7f55269288c0 1 < canceled part key=_multipart_D8W2ZKIZFI8H.2~4NVBIIA95R2M.2 size=265436 2024-04-03T03:46:16.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.085+0000 7f55269288c0 1 < canceled multipart upload key=D8W2ZKIZFI8H upload=4NVBIIA95R2M tag=Z4I3XKAOHOUK type=write size=3411164 2024-04-03T03:46:16.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.089+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~86UWLZ96BSUM.0 size=1048576 2024-04-03T03:46:16.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.093+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~86UWLZ96BSUM.1 size=729312 2024-04-03T03:46:16.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.093+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=86UWLZ96BSUM tag=XXMVOFYSJOQL type=write size=2826464 2024-04-03T03:46:16.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.093+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=WF0HN0ZEANOG type=del 2024-04-03T03:46:16.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.097+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=QHS99O12G90B type=del size=3038269 2024-04-03T03:46:16.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.101+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=4JK8I10FDNIN type=del 2024-04-03T03:46:16.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.101+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=U0JNFP7P7EIK type=del size=3373383 2024-04-03T03:46:16.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.105+0000 7f55269288c0 1 < canceled part key=_multipart_IOHMF3ADC6EU.2~T9GAX62LLKI4.0 size=1048576 2024-04-03T03:46:16.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.105+0000 7f55269288c0 1 < canceled part key=_multipart_IOHMF3ADC6EU.2~T9GAX62LLKI4.1 size=111492 2024-04-03T03:46:16.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.109+0000 7f55269288c0 1 < canceled multipart upload key=IOHMF3ADC6EU upload=T9GAX62LLKI4 tag=UBYA3YCTPEFV type=write size=2208644 2024-04-03T03:46:16.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.109+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=GU9C8U45OM3N type=del size=3029681 2024-04-03T03:46:16.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.113+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=PFZ9WI3AZPP7 type=del 2024-04-03T03:46:16.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.113+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=FK42YNHVTK6Z type=del size=2590967 2024-04-03T03:46:16.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.117+0000 7f55269288c0 1 < completed write operation key=F6IBZ80J4SDM tag=T2T31917BMR6 type=write size=1005123 2024-04-03T03:46:16.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.121+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~7ZWIBV2UJ1J5.0 size=1048576 2024-04-03T03:46:16.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.125+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~7ZWIBV2UJ1J5.1 size=183049 2024-04-03T03:46:16.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.125+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=7ZWIBV2UJ1J5 tag=N1AN7L1N1ZV1 type=write size=2280201 2024-04-03T03:46:16.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.125+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~RMI1YHBQ2RYB.0 size=20440 2024-04-03T03:46:16.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.129+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=RMI1YHBQ2RYB tag=1AAXN3EAH5L3 type=write size=1069016 2024-04-03T03:46:16.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.133+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=PQX1ZF812G0A type=write size=449676 2024-04-03T03:46:16.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.137+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=LSNJD5O9IEY7 type=del 2024-04-03T03:46:16.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.141+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~GDNJEVTSQCJ0.0 size=1048576 2024-04-03T03:46:16.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.141+0000 7f55269288c0 1 > prepared part key=_multipart_U62RSK21LJEF.2~GDNJEVTSQCJ0.1 size=513091 2024-04-03T03:46:16.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.141+0000 7f55269288c0 1 > prepared multipart upload key=U62RSK21LJEF upload=GDNJEVTSQCJ0 tag=KJM8UTKWU9X1 type=write size=2610243 2024-04-03T03:46:16.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.141+0000 7f55269288c0 1 < canceled part key=_multipart_KDSE2XB4D1XI.2~0LIR1FGUCFDX.0 size=1048576 2024-04-03T03:46:16.142 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.145+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~0LIR1FGUCFDX.1 size=661538 2024-04-03T03:46:16.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.149+0000 7f55269288c0 1 < canceled multipart upload key=KDSE2XB4D1XI upload=0LIR1FGUCFDX tag=V0J1LRCKZZLH type=write size=2758690 2024-04-03T03:46:16.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.153+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=1MAT8XAS40CX type=del size=1129216 2024-04-03T03:46:16.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.153+0000 7f55269288c0 1 < canceled operation key=JAXVD60NI5YW tag=02PUCG9S8KQ1 type=write size=372128 2024-04-03T03:46:16.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.161+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~JDLWMEN1REPF.0 size=862089 2024-04-03T03:46:16.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.161+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=JDLWMEN1REPF tag=REH3O10G6J3V type=write size=1910665 2024-04-03T03:46:16.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.161+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~8ZG2USQG22AJ.0 size=1048576 2024-04-03T03:46:16.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.165+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~8ZG2USQG22AJ.1 size=1048576 2024-04-03T03:46:16.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.165+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~8ZG2USQG22AJ.2 size=933936 2024-04-03T03:46:16.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.169+0000 7f55269288c0 1 < canceled multipart upload key=0OSIL0R5ZJ54 upload=8ZG2USQG22AJ tag=LXQA0CIZMCID type=write size=4079664 2024-04-03T03:46:16.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.173+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~PIGOZFTNHHQ2.0 size=1048576 2024-04-03T03:46:16.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.177+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~PIGOZFTNHHQ2.1 size=1048576 2024-04-03T03:46:16.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.181+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~PIGOZFTNHHQ2.2 size=931827 2024-04-03T03:46:16.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.181+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=PIGOZFTNHHQ2 tag=PLYTHGZY3V8B type=write size=4077555 2024-04-03T03:46:16.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.181+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~KP3WTL0LPOQL.0 size=1048576 2024-04-03T03:46:16.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.189+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~KP3WTL0LPOQL.1 size=764708 2024-04-03T03:46:16.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.193+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=KP3WTL0LPOQL tag=KT4K7QXNLZE6 type=write size=2861860 2024-04-03T03:46:16.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.201+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~YGEM593PP24E.0 size=1048576 2024-04-03T03:46:16.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.201+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~YGEM593PP24E.1 size=426076 2024-04-03T03:46:16.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.201+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=YGEM593PP24E tag=AAG4VY3QKOD7 type=write size=2523228 2024-04-03T03:46:16.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.205+0000 7f55269288c0 1 < canceled operation key=K3Z9W19WEJBM tag=BLRHLVVA4Q3R type=write size=592519 2024-04-03T03:46:16.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.209+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~FFRY1FHPS4QX.0 size=1048576 2024-04-03T03:46:16.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.213+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~FFRY1FHPS4QX.1 size=149121 2024-04-03T03:46:16.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.213+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=FFRY1FHPS4QX tag=PFN41AFL7CDR type=write size=2246273 2024-04-03T03:46:16.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.217+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~8ETD6VL0PQC5.0 size=1048576 2024-04-03T03:46:16.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.217+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~8ETD6VL0PQC5.1 size=1048576 2024-04-03T03:46:16.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.221+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~8ETD6VL0PQC5.2 size=144147 2024-04-03T03:46:16.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.225+0000 7f55269288c0 1 < completed multipart upload key=U62RSK21LJEF upload=8ETD6VL0PQC5 tag=LJLLGNU036HU type=write size=3289875 2024-04-03T03:46:16.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.233+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~27YTREK27YV3.0 size=1048576 2024-04-03T03:46:16.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.233+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~27YTREK27YV3.1 size=1048576 2024-04-03T03:46:16.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.237+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~27YTREK27YV3.2 size=608200 2024-04-03T03:46:16.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.237+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=27YTREK27YV3 tag=2YR1YHNBY61D type=write size=3753928 2024-04-03T03:46:16.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.241+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~F5SPAFNVM710.0 size=1048576 2024-04-03T03:46:16.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.241+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~F5SPAFNVM710.1 size=538605 2024-04-03T03:46:16.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.245+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=F5SPAFNVM710 tag=FP11II02Q2JN type=write size=2635757 2024-04-03T03:46:16.247 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.249+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=JZGLPNU370FL type=del size=1892563 2024-04-03T03:46:16.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.253+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=AQUK1W7GMR3J type=del 2024-04-03T03:46:16.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.257+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=6OHJAN3285O6 type=del size=135929 2024-04-03T03:46:16.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.257+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~86UWLZ96BSUM.0 size=1048576 2024-04-03T03:46:16.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.261+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~86UWLZ96BSUM.1 size=729312 2024-04-03T03:46:16.262 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.265+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=86UWLZ96BSUM tag=XXMVOFYSJOQL type=write size=2826464 2024-04-03T03:46:16.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.269+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=YERP7PR4KD4R type=del size=315535 2024-04-03T03:46:16.268 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.273+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=QHS99O12G90B type=del 2024-04-03T03:46:16.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.273+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=99JZO772NPWG type=write size=166006 2024-04-03T03:46:16.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.277+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=U0JNFP7P7EIK type=del 2024-04-03T03:46:16.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.281+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=K39PUNHF7Q11 type=del size=3585554 2024-04-03T03:46:16.280 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.281+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=GU9C8U45OM3N type=del 2024-04-03T03:46:16.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.285+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=2QUDDMRHDQIN type=del size=812889 2024-04-03T03:46:16.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.289+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=FK42YNHVTK6Z type=del 2024-04-03T03:46:16.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.293+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=154N3NUN1845 type=del size=790983 2024-04-03T03:46:16.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.293+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~7ZWIBV2UJ1J5.0 size=1048576 2024-04-03T03:46:16.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.297+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~7ZWIBV2UJ1J5.1 size=183049 2024-04-03T03:46:16.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.301+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=7ZWIBV2UJ1J5 tag=N1AN7L1N1ZV1 type=write size=2280201 2024-04-03T03:46:16.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.305+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~1O3VBX88TMB2.0 size=1048576 2024-04-03T03:46:16.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.309+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~1O3VBX88TMB2.1 size=956387 2024-04-03T03:46:16.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.309+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=1O3VBX88TMB2 tag=WI7U3NE6JDZT type=write size=3053539 2024-04-03T03:46:16.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.313+0000 7f55269288c0 1 < completed write operation key=TW860A14J9RC tag=PQX1ZF812G0A type=write size=449676 2024-04-03T03:46:16.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.317+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=BOSSKPCEFA46 type=del size=3630423 2024-04-03T03:46:16.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.317+0000 7f55269288c0 1 < canceled part key=_multipart_U62RSK21LJEF.2~GDNJEVTSQCJ0.0 size=1048576 2024-04-03T03:46:16.316 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.317+0000 7f55269288c0 1 < completed part key=_multipart_U62RSK21LJEF.2~GDNJEVTSQCJ0.1 size=513091 2024-04-03T03:46:16.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.325+0000 7f55269288c0 1 < canceled multipart upload key=U62RSK21LJEF upload=GDNJEVTSQCJ0 tag=KJM8UTKWU9X1 type=write size=2610243 2024-04-03T03:46:16.326 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.329+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~1DQ92MA2EWI9.0 size=1048576 2024-04-03T03:46:16.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.333+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~1DQ92MA2EWI9.1 size=105922 2024-04-03T03:46:16.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.333+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=1DQ92MA2EWI9 tag=ZZ03D77B6HWD type=write size=2203074 2024-04-03T03:46:16.332 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.333+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=1MAT8XAS40CX type=del 2024-04-03T03:46:16.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.341+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~JVACR2QGPL4J.0 size=1048576 2024-04-03T03:46:16.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.341+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~JVACR2QGPL4J.1 size=60965 2024-04-03T03:46:16.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.341+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=JVACR2QGPL4J tag=4OOTRKOD1LDX type=write size=2158117 2024-04-03T03:46:16.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.345+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~JDLWMEN1REPF.0 size=862089 2024-04-03T03:46:16.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.349+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=JDLWMEN1REPF tag=REH3O10G6J3V type=write size=1910665 2024-04-03T03:46:16.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.357+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~GEOCNQE3E5DP.0 size=289925 2024-04-03T03:46:16.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.357+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=GEOCNQE3E5DP tag=57LPBYV2B8BS type=write size=1338501 2024-04-03T03:46:16.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.357+0000 7f55269288c0 1 < canceled part key=_multipart_D9OEPPT37WSJ.2~PIGOZFTNHHQ2.0 size=1048576 2024-04-03T03:46:16.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.361+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~PIGOZFTNHHQ2.1 size=1048576 2024-04-03T03:46:16.359 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.361+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~PIGOZFTNHHQ2.2 size=931827 2024-04-03T03:46:16.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.369+0000 7f55269288c0 1 < canceled multipart upload key=D9OEPPT37WSJ upload=PIGOZFTNHHQ2 tag=PLYTHGZY3V8B type=write size=4077555 2024-04-03T03:46:16.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.369+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=ZZWTR4UQLH5E type=del size=3555316 2024-04-03T03:46:16.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.373+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~YGEM593PP24E.0 size=1048576 2024-04-03T03:46:16.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.373+0000 7f55269288c0 1 < canceled part key=_multipart_KDSE2XB4D1XI.2~YGEM593PP24E.1 size=426076 2024-04-03T03:46:16.376 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.377+0000 7f55269288c0 1 < canceled multipart upload key=KDSE2XB4D1XI upload=YGEM593PP24E tag=AAG4VY3QKOD7 type=write size=2523228 2024-04-03T03:46:16.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.385+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~JOHQLS3L0ABO.0 size=1048576 2024-04-03T03:46:16.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.385+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~JOHQLS3L0ABO.1 size=115372 2024-04-03T03:46:16.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.385+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=JOHQLS3L0ABO tag=JAGE9OULLTFP type=write size=2212524 2024-04-03T03:46:16.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.389+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~FFRY1FHPS4QX.0 size=1048576 2024-04-03T03:46:16.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.393+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~FFRY1FHPS4QX.1 size=149121 2024-04-03T03:46:16.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.397+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=FFRY1FHPS4QX tag=PFN41AFL7CDR type=write size=2246273 2024-04-03T03:46:16.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.401+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~DFF13O1NYSBM.0 size=1038887 2024-04-03T03:46:16.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.401+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=DFF13O1NYSBM tag=PJ9R1Z4GV3FK type=write size=2087463 2024-04-03T03:46:16.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.405+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~27YTREK27YV3.0 size=1048576 2024-04-03T03:46:16.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.409+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~27YTREK27YV3.1 size=1048576 2024-04-03T03:46:16.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.409+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~27YTREK27YV3.2 size=608200 2024-04-03T03:46:16.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.417+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=27YTREK27YV3 tag=2YR1YHNBY61D type=write size=3753928 2024-04-03T03:46:16.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.421+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=B2256Y5001ZG type=write size=533774 2024-04-03T03:46:16.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.421+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=JZGLPNU370FL type=del 2024-04-03T03:46:16.424 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.425+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~WGB3QJLDYZQL.0 size=120630 2024-04-03T03:46:16.424 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.425+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=WGB3QJLDYZQL tag=1SDUC5DS4P94 type=write size=1169206 2024-04-03T03:46:16.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.429+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=6OHJAN3285O6 type=del 2024-04-03T03:46:16.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.433+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=10P8O6O0AKY1 type=del size=432792 2024-04-03T03:46:16.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.433+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=YERP7PR4KD4R type=del 2024-04-03T03:46:16.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.437+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=WNKC70ENB3IX type=del size=2678777 2024-04-03T03:46:16.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.445+0000 7f55269288c0 1 < suggested update operation key=D8W2ZKIZFI8H tag=99JZO772NPWG type=write size=166006 2024-04-03T03:46:16.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.445+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=6R0GK6FDTYC7 type=del size=1024448 2024-04-03T03:46:16.446 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.449+0000 7f55269288c0 1 < canceled operation key=MLTDNCZ4E5D8 tag=K39PUNHF7Q11 type=del size=3585554 2024-04-03T03:46:16.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.453+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=2XJ7QFK4RX1P type=write size=309973 2024-04-03T03:46:16.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.457+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=2QUDDMRHDQIN type=del 2024-04-03T03:46:16.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.457+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=2WCE35DKYQCM type=del size=2353070 2024-04-03T03:46:16.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.465+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=154N3NUN1845 type=del 2024-04-03T03:46:16.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.469+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~ZADJB5OUD2W8.0 size=1029145 2024-04-03T03:46:16.468 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.469+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=ZADJB5OUD2W8 tag=FI55IN208V00 type=write size=2077721 2024-04-03T03:46:16.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.473+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~1O3VBX88TMB2.0 size=1048576 2024-04-03T03:46:16.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.477+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~1O3VBX88TMB2.1 size=956387 2024-04-03T03:46:16.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.481+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=1O3VBX88TMB2 tag=WI7U3NE6JDZT type=write size=3053539 2024-04-03T03:46:16.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.485+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=6Z0UOIMSCG9G type=del size=1604309 2024-04-03T03:46:16.484 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.489+0000 7f55269288c0 1 < canceled operation key=3XKXK1JXKOHU tag=BOSSKPCEFA46 type=del size=3630423 2024-04-03T03:46:16.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.489+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=EUJ2FV78SAXI type=del size=1224785 2024-04-03T03:46:16.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.493+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~1DQ92MA2EWI9.0 size=1048576 2024-04-03T03:46:16.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.497+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~1DQ92MA2EWI9.1 size=105922 2024-04-03T03:46:16.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.501+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=1DQ92MA2EWI9 tag=ZZ03D77B6HWD type=write size=2203074 2024-04-03T03:46:16.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.505+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~WNG0Z57OWEHF.0 size=1048576 2024-04-03T03:46:16.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.509+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~WNG0Z57OWEHF.1 size=980255 2024-04-03T03:46:16.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.509+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=WNG0Z57OWEHF tag=TLJUUQRVWB66 type=write size=3077407 2024-04-03T03:46:16.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.509+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~JVACR2QGPL4J.0 size=1048576 2024-04-03T03:46:16.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.513+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~JVACR2QGPL4J.1 size=60965 2024-04-03T03:46:16.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.517+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=JVACR2QGPL4J tag=4OOTRKOD1LDX type=write size=2158117 2024-04-03T03:46:16.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.521+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=53F6LGLGUS98 type=del size=3909556 2024-04-03T03:46:16.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.521+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~GEOCNQE3E5DP.0 size=289925 2024-04-03T03:46:16.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.529+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=GEOCNQE3E5DP tag=57LPBYV2B8BS type=write size=1338501 2024-04-03T03:46:16.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.533+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~HU4FJFR2OX3S.0 size=1048576 2024-04-03T03:46:16.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.537+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~HU4FJFR2OX3S.1 size=308304 2024-04-03T03:46:16.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.537+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=HU4FJFR2OX3S tag=JLO6MVL8LHE2 type=write size=2405456 2024-04-03T03:46:16.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.537+0000 7f55269288c0 1 < canceled operation key=KU1R0YLDP1V3 tag=ZZWTR4UQLH5E type=del size=3555316 2024-04-03T03:46:16.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.541+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=L7ZOH7H1SQCH type=write size=21485 2024-04-03T03:46:16.541 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.545+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~JOHQLS3L0ABO.0 size=1048576 2024-04-03T03:46:16.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.545+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~JOHQLS3L0ABO.1 size=115372 2024-04-03T03:46:16.548 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.549+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=JOHQLS3L0ABO tag=JAGE9OULLTFP type=write size=2212524 2024-04-03T03:46:16.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.553+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=DHS9WWC6Z5P7 type=write size=94657 2024-04-03T03:46:16.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.557+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~DFF13O1NYSBM.0 size=1038887 2024-04-03T03:46:16.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.561+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=DFF13O1NYSBM tag=PJ9R1Z4GV3FK type=write size=2087463 2024-04-03T03:46:16.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.565+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~T6Q1X53RAT7M.0 size=1048576 2024-04-03T03:46:16.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.565+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~T6Q1X53RAT7M.1 size=741159 2024-04-03T03:46:16.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.565+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=T6Q1X53RAT7M tag=CRSD75G4V4XR type=write size=2838311 2024-04-03T03:46:16.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.573+0000 7f55269288c0 1 < suggested update operation key=8SBTVHL09P63 tag=B2256Y5001ZG type=write size=533774 2024-04-03T03:46:16.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.573+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=R1100NQ3FQ52 type=write size=679029 2024-04-03T03:46:16.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.577+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~WGB3QJLDYZQL.0 size=120630 2024-04-03T03:46:16.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.581+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=WGB3QJLDYZQL tag=1SDUC5DS4P94 type=write size=1169206 2024-04-03T03:46:16.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.585+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=1BMNTFGTPF1B type=del size=1062145 2024-04-03T03:46:16.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.585+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=10P8O6O0AKY1 type=del 2024-04-03T03:46:16.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.589+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=JLHK4ZX5CYXK type=del size=2755885 2024-04-03T03:46:16.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.593+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=WNKC70ENB3IX type=del 2024-04-03T03:46:16.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.593+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=1LU6VA0B6HDQ type=del size=3467011 2024-04-03T03:46:16.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.597+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=6R0GK6FDTYC7 type=del 2024-04-03T03:46:16.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.601+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~G3JHHVRBZ7UZ.0 size=1048576 2024-04-03T03:46:16.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.605+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~G3JHHVRBZ7UZ.1 size=336449 2024-04-03T03:46:16.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.605+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=G3JHHVRBZ7UZ tag=0IAV5FMAU8OX type=write size=2433601 2024-04-03T03:46:16.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.605+0000 7f55269288c0 1 < completed write operation key=3XKXK1JXKOHU tag=2XJ7QFK4RX1P type=write size=309973 2024-04-03T03:46:16.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.609+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=GHINM4DX4MIS type=del size=2083127 2024-04-03T03:46:16.610 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.613+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=2WCE35DKYQCM type=del 2024-04-03T03:46:16.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.617+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=7FHN1AG4UVEQ type=del size=3794520 2024-04-03T03:46:16.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.617+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~ZADJB5OUD2W8.0 size=1029145 2024-04-03T03:46:16.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.621+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=ZADJB5OUD2W8 tag=FI55IN208V00 type=write size=2077721 2024-04-03T03:46:16.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.625+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=ATP03806RL6V type=del size=701737 2024-04-03T03:46:16.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.629+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=6Z0UOIMSCG9G type=del 2024-04-03T03:46:16.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.633+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=21FQUF2B1CH1 type=write size=729122 2024-04-03T03:46:16.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.633+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=EUJ2FV78SAXI type=del 2024-04-03T03:46:16.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.641+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~7VF40G3Z67OF.0 size=494861 2024-04-03T03:46:16.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.641+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=7VF40G3Z67OF tag=SFZWQDM7YUH0 type=write size=1543437 2024-04-03T03:46:16.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.645+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~WNG0Z57OWEHF.0 size=1048576 2024-04-03T03:46:16.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.645+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~WNG0Z57OWEHF.1 size=980255 2024-04-03T03:46:16.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.653+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=WNG0Z57OWEHF tag=TLJUUQRVWB66 type=write size=3077407 2024-04-03T03:46:16.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.653+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=HS9ATFUDFPRS type=del size=445045 2024-04-03T03:46:16.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.657+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=53F6LGLGUS98 type=del 2024-04-03T03:46:16.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.661+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~ALGF4748W5L2.0 size=1048576 2024-04-03T03:46:16.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.665+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~ALGF4748W5L2.1 size=656389 2024-04-03T03:46:16.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.665+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=ALGF4748W5L2 tag=IE57277MP1WG type=write size=2753541 2024-04-03T03:46:16.665 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.669+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~HU4FJFR2OX3S.0 size=1048576 2024-04-03T03:46:16.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.669+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~HU4FJFR2OX3S.1 size=308304 2024-04-03T03:46:16.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.677+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=HU4FJFR2OX3S tag=JLO6MVL8LHE2 type=write size=2405456 2024-04-03T03:46:16.675 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.677+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=MY7EP0GKQAMQ type=del size=2147586 2024-04-03T03:46:16.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.681+0000 7f55269288c0 1 < completed write operation key=7POFUQ9CX6B1 tag=L7ZOH7H1SQCH type=write size=21485 2024-04-03T03:46:16.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.685+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=2NWZRG0ETDSS type=del size=1623809 2024-04-03T03:46:16.684 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.689+0000 7f55269288c0 1 < canceled operation key=0OSIL0R5ZJ54 tag=DHS9WWC6Z5P7 type=write size=94657 2024-04-03T03:46:16.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.693+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~D2LDLOBUDS83.0 size=871261 2024-04-03T03:46:16.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.693+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=D2LDLOBUDS83 tag=4A41GB4FDKBR type=write size=1919837 2024-04-03T03:46:16.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.697+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~T6Q1X53RAT7M.0 size=1048576 2024-04-03T03:46:16.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.697+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~T6Q1X53RAT7M.1 size=741159 2024-04-03T03:46:16.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.701+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=T6Q1X53RAT7M tag=CRSD75G4V4XR type=write size=2838311 2024-04-03T03:46:16.702 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.705+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=Y2UXPRQGH9PA type=write size=516015 2024-04-03T03:46:16.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.709+0000 7f55269288c0 1 < completed write operation key=CPR27NMHPIPQ tag=R1100NQ3FQ52 type=write size=679029 2024-04-03T03:46:16.707 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.709+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=N3BNX6KFVX16 type=del size=2942989 2024-04-03T03:46:16.710 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.713+0000 7f55269288c0 1 < completed delete operation key=XFCPX90N2NYC tag=1BMNTFGTPF1B type=del 2024-04-03T03:46:16.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.717+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=U7NH01OFPLCJ type=write size=501191 2024-04-03T03:46:16.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.721+0000 7f55269288c0 1 < completed delete operation key=D9OEPPT37WSJ tag=JLHK4ZX5CYXK type=del 2024-04-03T03:46:16.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.725+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~1R61YSI1CYJX.0 size=287476 2024-04-03T03:46:16.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.725+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=1R61YSI1CYJX tag=N5SLHCMACKAR type=write size=1336052 2024-04-03T03:46:16.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.737+0000 7f55269288c0 1 < suggested remove operation key=KU1R0YLDP1V3 tag=1LU6VA0B6HDQ type=del 2024-04-03T03:46:16.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.741+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~W1OMKR44HIOG.0 size=1048576 2024-04-03T03:46:16.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.745+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~W1OMKR44HIOG.1 size=1048576 2024-04-03T03:46:16.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.745+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~W1OMKR44HIOG.2 size=72561 2024-04-03T03:46:16.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.745+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=W1OMKR44HIOG tag=T3WRFQEF6WE1 type=write size=3218289 2024-04-03T03:46:16.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.749+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~G3JHHVRBZ7UZ.0 size=1048576 2024-04-03T03:46:16.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.749+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~G3JHHVRBZ7UZ.1 size=336449 2024-04-03T03:46:16.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.753+0000 7f55269288c0 1 < canceled multipart upload key=8BMP0HIS520R upload=G3JHHVRBZ7UZ tag=0IAV5FMAU8OX type=write size=2433601 2024-04-03T03:46:16.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.757+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~R1PFDM2J67MC.0 size=1048576 2024-04-03T03:46:16.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.757+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~R1PFDM2J67MC.1 size=982508 2024-04-03T03:46:16.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.757+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=R1PFDM2J67MC tag=KJWLYGTAF5IZ type=write size=3079660 2024-04-03T03:46:16.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.761+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=GHINM4DX4MIS type=del 2024-04-03T03:46:16.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.765+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~ZHH8SX7PZLXB.0 size=426201 2024-04-03T03:46:16.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.765+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=ZHH8SX7PZLXB tag=0AV6R702XUEN type=write size=1474777 2024-04-03T03:46:16.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.765+0000 7f55269288c0 1 < canceled operation key=X3YCYKP2P9IM tag=7FHN1AG4UVEQ type=del size=3794520 2024-04-03T03:46:16.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.769+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=3HEKVD3TZO19 type=write size=555517 2024-04-03T03:46:16.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.773+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=ATP03806RL6V type=del 2024-04-03T03:46:16.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.777+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~IW7NSQYZU8KS.0 size=1048576 2024-04-03T03:46:16.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.777+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~IW7NSQYZU8KS.1 size=1048576 2024-04-03T03:46:16.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.781+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~IW7NSQYZU8KS.2 size=70165 2024-04-03T03:46:16.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.781+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=IW7NSQYZU8KS tag=CDRHS9X2FEOC type=write size=3215893 2024-04-03T03:46:16.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.785+0000 7f55269288c0 1 < suggested remove operation key=F6IBZ80J4SDM tag=21FQUF2B1CH1 type=write 2024-04-03T03:46:16.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.785+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~DTCD9FBW557I.0 size=146244 2024-04-03T03:46:16.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.785+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=DTCD9FBW557I tag=LXQHY49Q3TBM type=write size=1194820 2024-04-03T03:46:16.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.789+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~7VF40G3Z67OF.0 size=494861 2024-04-03T03:46:16.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.793+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=7VF40G3Z67OF tag=SFZWQDM7YUH0 type=write size=1543437 2024-04-03T03:46:16.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.797+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=FJQ4ELFPI6W0 type=del size=453735 2024-04-03T03:46:16.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.797+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=HS9ATFUDFPRS type=del 2024-04-03T03:46:16.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.801+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~U9TYKA9PXC4U.0 size=734820 2024-04-03T03:46:16.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.801+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=U9TYKA9PXC4U tag=VBKLOAZN2SES type=write size=1783396 2024-04-03T03:46:16.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.805+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~ALGF4748W5L2.0 size=1048576 2024-04-03T03:46:16.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.809+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~ALGF4748W5L2.1 size=656389 2024-04-03T03:46:16.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.813+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=ALGF4748W5L2 tag=IE57277MP1WG type=write size=2753541 2024-04-03T03:46:16.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.813+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=7XO5UBQ2LSVQ type=del size=2187461 2024-04-03T03:46:16.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.817+0000 7f55269288c0 1 < suggested remove operation key=8SBTVHL09P63 tag=MY7EP0GKQAMQ type=del 2024-04-03T03:46:16.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.821+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=Q802OF5DQSPJ type=del size=823484 2024-04-03T03:46:16.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.825+0000 7f55269288c0 -1 < failed to complete operation key=8SBTVHL09P63 tag=2NWZRG0ETDSS type=del size=1623809: (22) Invalid argument 2024-04-03T03:46:16.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.829+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~0H3A6X66CZHF.0 size=1048576 2024-04-03T03:46:16.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.829+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~0H3A6X66CZHF.1 size=1048576 2024-04-03T03:46:16.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.833+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~0H3A6X66CZHF.2 size=342001 2024-04-03T03:46:16.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.833+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=0H3A6X66CZHF tag=O1R40PGYTXIK type=write size=3487729 2024-04-03T03:46:16.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.833+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~D2LDLOBUDS83.0 size=871261 2024-04-03T03:46:16.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.837+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=D2LDLOBUDS83 tag=4A41GB4FDKBR type=write size=1919837 2024-04-03T03:46:16.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.841+0000 7f55269288c0 1 > prepared part key=_multipart_MLTDNCZ4E5D8.2~3TV1CL6PNFN8.0 size=715551 2024-04-03T03:46:16.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.841+0000 7f55269288c0 1 > prepared multipart upload key=MLTDNCZ4E5D8 upload=3TV1CL6PNFN8 tag=UOOXQ51NI85E type=write size=1764127 2024-04-03T03:46:16.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.845+0000 7f55269288c0 1 < suggested remove operation key=MLTDNCZ4E5D8 tag=Y2UXPRQGH9PA type=write 2024-04-03T03:46:16.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.849+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=JJBU6B9I6GX6 type=del size=1864375 2024-04-03T03:46:16.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.849+0000 7f55269288c0 -1 < no bi entry to suggest for operation key=KU1R0YLDP1V3 tag=N3BNX6KFVX16 type=del size=2942989: (2) No such file or directory 2024-04-03T03:46:16.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.857+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~LRITF1OGGZ9G.0 size=1048576 2024-04-03T03:46:16.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.857+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~LRITF1OGGZ9G.1 size=392740 2024-04-03T03:46:16.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.857+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=LRITF1OGGZ9G tag=ZBXEZT0GSV4Q type=write size=2489892 2024-04-03T03:46:16.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.861+0000 7f55269288c0 -1 < failed to complete operation key=F6IBZ80J4SDM tag=U7NH01OFPLCJ type=write size=501191: (22) Invalid argument 2024-04-03T03:46:16.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.865+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~5IQOMYGERNN5.0 size=1048576 2024-04-03T03:46:16.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.869+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~5IQOMYGERNN5.1 size=359975 2024-04-03T03:46:16.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.869+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=5IQOMYGERNN5 tag=N7FX2JKD1RNY type=write size=2457127 2024-04-03T03:46:16.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.869+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~1R61YSI1CYJX.0 size=287476 2024-04-03T03:46:16.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.873+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=1R61YSI1CYJX tag=N5SLHCMACKAR type=write size=1336052 2024-04-03T03:46:16.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.877+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=27LE30R919B0 type=del size=1568090 2024-04-03T03:46:16.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.877+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~W1OMKR44HIOG.0 size=1048576 2024-04-03T03:46:16.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.881+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~W1OMKR44HIOG.1 size=1048576 2024-04-03T03:46:16.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.881+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~W1OMKR44HIOG.2 size=72561 2024-04-03T03:46:16.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.885+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=W1OMKR44HIOG tag=T3WRFQEF6WE1 type=write size=3218289 2024-04-03T03:46:16.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.889+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=9V598BMRGOZJ type=del size=1648709 2024-04-03T03:46:16.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.889+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~R1PFDM2J67MC.0 size=1048576 2024-04-03T03:46:16.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.893+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~R1PFDM2J67MC.1 size=982508 2024-04-03T03:46:16.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.897+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=R1PFDM2J67MC tag=KJWLYGTAF5IZ type=write size=3079660 2024-04-03T03:46:16.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.901+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~CBQNUKS15316.0 size=1048576 2024-04-03T03:46:16.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.901+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~CBQNUKS15316.1 size=469385 2024-04-03T03:46:16.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.901+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=CBQNUKS15316 tag=T9Q1KNY4ASGO type=write size=2566537 2024-04-03T03:46:16.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.905+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~ZHH8SX7PZLXB.0 size=426201 2024-04-03T03:46:16.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.909+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=ZHH8SX7PZLXB tag=0AV6R702XUEN type=write size=1474777 2024-04-03T03:46:16.910 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.913+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~NA7IKFFPO1CK.0 size=1048576 2024-04-03T03:46:16.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.913+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~NA7IKFFPO1CK.1 size=1048576 2024-04-03T03:46:16.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.917+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~NA7IKFFPO1CK.2 size=849087 2024-04-03T03:46:16.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.917+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=NA7IKFFPO1CK tag=ISDDZW7H2680 type=write size=3994815 2024-04-03T03:46:16.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.921+0000 7f55269288c0 1 < completed write operation key=X3YCYKP2P9IM tag=3HEKVD3TZO19 type=write size=555517 2024-04-03T03:46:16.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.921+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=G317G92N1DZ6 type=del size=1702201 2024-04-03T03:46:16.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.925+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~IW7NSQYZU8KS.0 size=1048576 2024-04-03T03:46:16.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.925+0000 7f55269288c0 1 < canceled part key=_multipart_TXFMKXUGMEA8.2~IW7NSQYZU8KS.1 size=1048576 2024-04-03T03:46:16.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.925+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~IW7NSQYZU8KS.2 size=70165 2024-04-03T03:46:16.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.933+0000 7f55269288c0 1 < canceled multipart upload key=TXFMKXUGMEA8 upload=IW7NSQYZU8KS tag=CDRHS9X2FEOC type=write size=3215893 2024-04-03T03:46:16.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.937+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~DDZBVCVC87NE.0 size=142677 2024-04-03T03:46:16.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.937+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=DDZBVCVC87NE tag=2SJ308WON4VW type=write size=1191253 2024-04-03T03:46:16.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.937+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~DTCD9FBW557I.0 size=146244 2024-04-03T03:46:16.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.941+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=DTCD9FBW557I tag=LXQHY49Q3TBM type=write size=1194820 2024-04-03T03:46:16.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.945+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~IY14NDKWTC80.0 size=1048576 2024-04-03T03:46:16.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.949+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~IY14NDKWTC80.1 size=528107 2024-04-03T03:46:16.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.949+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=IY14NDKWTC80 tag=2RHUMOHP8CTH type=write size=2625259 2024-04-03T03:46:16.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.957+0000 7f55269288c0 1 < suggested update operation key=YCEKDT5EQD9D tag=FJQ4ELFPI6W0 type=del size=453735 2024-04-03T03:46:16.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.961+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=0FKQ0GD5GSNJ type=del size=3951189 2024-04-03T03:46:16.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.961+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~U9TYKA9PXC4U.0 size=734820 2024-04-03T03:46:16.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.965+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=U9TYKA9PXC4U tag=VBKLOAZN2SES type=write size=1783396 2024-04-03T03:46:16.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.969+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=44EN0JMX900T type=del size=975942 2024-04-03T03:46:16.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.969+0000 7f55269288c0 1 < canceled operation key=U62RSK21LJEF tag=7XO5UBQ2LSVQ type=del size=2187461 2024-04-03T03:46:16.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.973+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=L6F1J1602RBN type=del size=3916655 2024-04-03T03:46:16.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.973+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=Q802OF5DQSPJ type=del 2024-04-03T03:46:16.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.977+0000 7f55269288c0 1 > prepared part key=_multipart_MB7HTWATXRMB.2~X27IXVOZK84T.0 size=689574 2024-04-03T03:46:16.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.977+0000 7f55269288c0 1 > prepared multipart upload key=MB7HTWATXRMB upload=X27IXVOZK84T tag=QPLSHFAWQ9ES type=write size=1738150 2024-04-03T03:46:16.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.981+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~0H3A6X66CZHF.0 size=1048576 2024-04-03T03:46:16.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.985+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~0H3A6X66CZHF.1 size=1048576 2024-04-03T03:46:16.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.985+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~0H3A6X66CZHF.2 size=342001 2024-04-03T03:46:16.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.989+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=0H3A6X66CZHF tag=O1R40PGYTXIK type=write size=3487729 2024-04-03T03:46:16.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.993+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~VQ20S10J2EEZ.0 size=1048576 2024-04-03T03:46:16.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.993+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~VQ20S10J2EEZ.1 size=61408 2024-04-03T03:46:16.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.993+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=VQ20S10J2EEZ tag=TYIJ19MJSF84 type=write size=2158560 2024-04-03T03:46:16.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:16.997+0000 7f55269288c0 1 < completed part key=_multipart_MLTDNCZ4E5D8.2~3TV1CL6PNFN8.0 size=715551 2024-04-03T03:46:16.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.001+0000 7f55269288c0 1 < completed multipart upload key=MLTDNCZ4E5D8 upload=3TV1CL6PNFN8 tag=UOOXQ51NI85E type=write size=1764127 2024-04-03T03:46:17.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.001+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=4J3ARRYNGT8U type=del size=1872344 2024-04-03T03:46:17.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.005+0000 7f55269288c0 1 < canceled operation key=TLM1C3B9J2A3 tag=JJBU6B9I6GX6 type=del size=1864375 2024-04-03T03:46:17.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.005+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=W0D2BOCBCOJK type=write size=117851 2024-04-03T03:46:17.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.009+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~LRITF1OGGZ9G.0 size=1048576 2024-04-03T03:46:17.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.013+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~LRITF1OGGZ9G.1 size=392740 2024-04-03T03:46:17.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.017+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=LRITF1OGGZ9G tag=ZBXEZT0GSV4Q type=write size=2489892 2024-04-03T03:46:17.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.021+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~Z92J5L7DNBPV.0 size=138731 2024-04-03T03:46:17.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.021+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=Z92J5L7DNBPV tag=QIS7P0Q65NV8 type=write size=1187307 2024-04-03T03:46:17.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.025+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~5IQOMYGERNN5.0 size=1048576 2024-04-03T03:46:17.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.025+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~5IQOMYGERNN5.1 size=359975 2024-04-03T03:46:17.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.029+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=5IQOMYGERNN5 tag=N7FX2JKD1RNY type=write size=2457127 2024-04-03T03:46:17.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.033+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=4AFASEL5BAB2 type=del size=360489 2024-04-03T03:46:17.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.033+0000 7f55269288c0 1 < completed delete operation key=MLTDNCZ4E5D8 tag=27LE30R919B0 type=del 2024-04-03T03:46:17.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.037+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~T0AUCVHKE4ZT.0 size=1048576 2024-04-03T03:46:17.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.041+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~T0AUCVHKE4ZT.1 size=1048576 2024-04-03T03:46:17.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.041+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~T0AUCVHKE4ZT.2 size=151320 2024-04-03T03:46:17.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.041+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=T0AUCVHKE4ZT tag=48MAY5X0Y12T type=write size=3297048 2024-04-03T03:46:17.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.045+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=9V598BMRGOZJ type=del 2024-04-03T03:46:17.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.049+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~4VUXO4F7M6SB.0 size=1048576 2024-04-03T03:46:17.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.049+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~4VUXO4F7M6SB.1 size=1048576 2024-04-03T03:46:17.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.053+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~4VUXO4F7M6SB.2 size=17828 2024-04-03T03:46:17.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.053+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=4VUXO4F7M6SB tag=E4B7YQBM1W1J type=write size=3163556 2024-04-03T03:46:17.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.053+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~CBQNUKS15316.0 size=1048576 2024-04-03T03:46:17.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.057+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~CBQNUKS15316.1 size=469385 2024-04-03T03:46:17.057 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.061+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=CBQNUKS15316 tag=T9Q1KNY4ASGO type=write size=2566537 2024-04-03T03:46:17.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.061+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=J1BA4Y1T6MWJ type=del size=1880449 2024-04-03T03:46:17.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.065+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~NA7IKFFPO1CK.0 size=1048576 2024-04-03T03:46:17.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.065+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~NA7IKFFPO1CK.1 size=1048576 2024-04-03T03:46:17.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.069+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~NA7IKFFPO1CK.2 size=849087 2024-04-03T03:46:17.069 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.073+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=NA7IKFFPO1CK tag=ISDDZW7H2680 type=write size=3994815 2024-04-03T03:46:17.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.077+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~XIEFIL3AEAPA.0 size=1048576 2024-04-03T03:46:17.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.077+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~XIEFIL3AEAPA.1 size=611291 2024-04-03T03:46:17.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.077+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=XIEFIL3AEAPA tag=8NHGDBMHP8YV type=write size=2708443 2024-04-03T03:46:17.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.081+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=G317G92N1DZ6 type=del 2024-04-03T03:46:17.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.085+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~8W8KDJ1XLAFT.0 size=1048576 2024-04-03T03:46:17.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.085+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~8W8KDJ1XLAFT.1 size=1048576 2024-04-03T03:46:17.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.089+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~8W8KDJ1XLAFT.2 size=107873 2024-04-03T03:46:17.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.089+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=8W8KDJ1XLAFT tag=VG5AMQVG0U6W type=write size=3253601 2024-04-03T03:46:17.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.089+0000 7f55269288c0 1 < canceled part key=_multipart_JAXVD60NI5YW.2~DDZBVCVC87NE.0 size=142677 2024-04-03T03:46:17.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.093+0000 7f55269288c0 1 < canceled multipart upload key=JAXVD60NI5YW upload=DDZBVCVC87NE tag=2SJ308WON4VW type=write size=1191253 2024-04-03T03:46:17.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.093+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=ZPCO1R3QRYQV type=del size=785086 2024-04-03T03:46:17.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.097+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~IY14NDKWTC80.0 size=1048576 2024-04-03T03:46:17.096 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.097+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~IY14NDKWTC80.1 size=528107 2024-04-03T03:46:17.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.101+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=IY14NDKWTC80 tag=2RHUMOHP8CTH type=write size=2625259 2024-04-03T03:46:17.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.109+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~1HAQM25LEIWN.0 size=1048576 2024-04-03T03:46:17.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.109+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~1HAQM25LEIWN.1 size=1048576 2024-04-03T03:46:17.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.113+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~1HAQM25LEIWN.2 size=281829 2024-04-03T03:46:17.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.113+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=1HAQM25LEIWN tag=VA4K64OZ1MHS type=write size=3427557 2024-04-03T03:46:17.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.117+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=0FKQ0GD5GSNJ type=del 2024-04-03T03:46:17.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.121+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~HCNZ3BPM5UB3.0 size=714659 2024-04-03T03:46:17.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.121+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=HCNZ3BPM5UB3 tag=W71DGN5ASPUA type=write size=1763235 2024-04-03T03:46:17.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.125+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=44EN0JMX900T type=del 2024-04-03T03:46:17.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.125+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=A871S89T1HZ1 type=del size=2680945 2024-04-03T03:46:17.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.129+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=L6F1J1602RBN type=del 2024-04-03T03:46:17.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.137+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~JEC7EZPVZM4C.0 size=699685 2024-04-03T03:46:17.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.137+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=JEC7EZPVZM4C tag=ZKIKEX2SCWOR type=write size=1748261 2024-04-03T03:46:17.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.137+0000 7f55269288c0 1 < completed part key=_multipart_MB7HTWATXRMB.2~X27IXVOZK84T.0 size=689574 2024-04-03T03:46:17.140 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.141+0000 7f55269288c0 1 < completed multipart upload key=MB7HTWATXRMB upload=X27IXVOZK84T tag=QPLSHFAWQ9ES type=write size=1738150 2024-04-03T03:46:17.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.145+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=BK2FHDVYYTGH type=write size=103971 2024-04-03T03:46:17.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.149+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~VQ20S10J2EEZ.0 size=1048576 2024-04-03T03:46:17.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.149+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~VQ20S10J2EEZ.1 size=61408 2024-04-03T03:46:17.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.153+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=VQ20S10J2EEZ tag=TYIJ19MJSF84 type=write size=2158560 2024-04-03T03:46:17.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.157+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~6GSFSDTDB2GT.0 size=1048576 2024-04-03T03:46:17.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.161+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~6GSFSDTDB2GT.1 size=83145 2024-04-03T03:46:17.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.161+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=6GSFSDTDB2GT tag=DH42XIQQ0DLJ type=write size=2180297 2024-04-03T03:46:17.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.161+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=4J3ARRYNGT8U type=del 2024-04-03T03:46:17.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.165+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=EQZOB512GWJZ type=del size=3969697 2024-04-03T03:46:17.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.165+0000 7f55269288c0 1 < completed write operation key=K7A1O21ZURWQ tag=W0D2BOCBCOJK type=write size=117851 2024-04-03T03:46:17.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.169+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=VQQLZU7BES1K type=del size=1851041 2024-04-03T03:46:17.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.173+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~Z92J5L7DNBPV.0 size=138731 2024-04-03T03:46:17.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.177+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=Z92J5L7DNBPV tag=QIS7P0Q65NV8 type=write size=1187307 2024-04-03T03:46:17.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.181+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=C80FDU2PNAV4 type=write size=850563 2024-04-03T03:46:17.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.185+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=4AFASEL5BAB2 type=del 2024-04-03T03:46:17.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.185+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=VUA39MGOVMNK type=del size=3285689 2024-04-03T03:46:17.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.189+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~T0AUCVHKE4ZT.0 size=1048576 2024-04-03T03:46:17.187 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.189+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~T0AUCVHKE4ZT.1 size=1048576 2024-04-03T03:46:17.189 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.193+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~T0AUCVHKE4ZT.2 size=151320 2024-04-03T03:46:17.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.197+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=T0AUCVHKE4ZT tag=48MAY5X0Y12T type=write size=3297048 2024-04-03T03:46:17.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.197+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=ZDACCC4ZVSR6 type=del size=584115 2024-04-03T03:46:17.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.197+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~4VUXO4F7M6SB.0 size=1048576 2024-04-03T03:46:17.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.201+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~4VUXO4F7M6SB.1 size=1048576 2024-04-03T03:46:17.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.201+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~4VUXO4F7M6SB.2 size=17828 2024-04-03T03:46:17.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.205+0000 7f55269288c0 1 < canceled multipart upload key=0OSIL0R5ZJ54 upload=4VUXO4F7M6SB tag=E4B7YQBM1W1J type=write size=3163556 2024-04-03T03:46:17.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.209+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=L20JLF0DGLGI type=del size=3134351 2024-04-03T03:46:17.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.213+0000 7f55269288c0 1 < suggested update operation key=KU1R0YLDP1V3 tag=J1BA4Y1T6MWJ type=del size=1880449 2024-04-03T03:46:17.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.217+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=ZJ65L1JF5EFU type=del size=2342394 2024-04-03T03:46:17.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.217+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~XIEFIL3AEAPA.0 size=1048576 2024-04-03T03:46:17.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.221+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~XIEFIL3AEAPA.1 size=611291 2024-04-03T03:46:17.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.225+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=XIEFIL3AEAPA tag=8NHGDBMHP8YV type=write size=2708443 2024-04-03T03:46:17.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.225+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=FN4C3JFKMX2D type=write size=442407 2024-04-03T03:46:17.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.229+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~8W8KDJ1XLAFT.0 size=1048576 2024-04-03T03:46:17.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.233+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~8W8KDJ1XLAFT.1 size=1048576 2024-04-03T03:46:17.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.233+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~8W8KDJ1XLAFT.2 size=107873 2024-04-03T03:46:17.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.237+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=8W8KDJ1XLAFT tag=VG5AMQVG0U6W type=write size=3253601 2024-04-03T03:46:17.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.241+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~50MSGX36PNIE.0 size=1048576 2024-04-03T03:46:17.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.245+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~50MSGX36PNIE.1 size=82178 2024-04-03T03:46:17.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.245+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=50MSGX36PNIE tag=IRNQP0WPWML4 type=write size=2179330 2024-04-03T03:46:17.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.245+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=ZPCO1R3QRYQV type=del 2024-04-03T03:46:17.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.249+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=OA6H6HINYTYF type=del size=866833 2024-04-03T03:46:17.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.253+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~1HAQM25LEIWN.0 size=1048576 2024-04-03T03:46:17.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.253+0000 7f55269288c0 1 < canceled part key=_multipart_0OSIL0R5ZJ54.2~1HAQM25LEIWN.1 size=1048576 2024-04-03T03:46:17.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.253+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~1HAQM25LEIWN.2 size=281829 2024-04-03T03:46:17.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.257+0000 7f55269288c0 1 < canceled multipart upload key=0OSIL0R5ZJ54 upload=1HAQM25LEIWN tag=VA4K64OZ1MHS type=write size=3427557 2024-04-03T03:46:17.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.261+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=IZHODGV6OZJ0 type=del size=606755 2024-04-03T03:46:17.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.261+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~HCNZ3BPM5UB3.0 size=714659 2024-04-03T03:46:17.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.265+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=HCNZ3BPM5UB3 tag=W71DGN5ASPUA type=write size=1763235 2024-04-03T03:46:17.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.273+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~HORMK9RT3J4R.0 size=1048576 2024-04-03T03:46:17.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.273+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~HORMK9RT3J4R.1 size=468434 2024-04-03T03:46:17.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.273+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=HORMK9RT3J4R tag=Y8WWWX5DZAAC type=write size=2565586 2024-04-03T03:46:17.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.277+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=A871S89T1HZ1 type=del 2024-04-03T03:46:17.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.281+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~15D2UI27W4M6.0 size=1048576 2024-04-03T03:46:17.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.285+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~15D2UI27W4M6.1 size=1048576 2024-04-03T03:46:17.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.285+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~15D2UI27W4M6.2 size=276780 2024-04-03T03:46:17.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.285+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=15D2UI27W4M6 tag=WVQHKAQA914N type=write size=3422508 2024-04-03T03:46:17.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.289+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~JEC7EZPVZM4C.0 size=699685 2024-04-03T03:46:17.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.293+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=JEC7EZPVZM4C tag=ZKIKEX2SCWOR type=write size=1748261 2024-04-03T03:46:17.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.297+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=DYGYMT5JNN21 type=del size=644522 2024-04-03T03:46:17.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.297+0000 7f55269288c0 1 < completed write operation key=7POFUQ9CX6B1 tag=BK2FHDVYYTGH type=write size=103971 2024-04-03T03:46:17.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.305+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~5QN0OMXE0CA8.0 size=800198 2024-04-03T03:46:17.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.305+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=5QN0OMXE0CA8 tag=75EKR7WQTXVO type=write size=1848774 2024-04-03T03:46:17.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.305+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~6GSFSDTDB2GT.0 size=1048576 2024-04-03T03:46:17.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.309+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~6GSFSDTDB2GT.1 size=83145 2024-04-03T03:46:17.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.313+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=6GSFSDTDB2GT tag=DH42XIQQ0DLJ type=write size=2180297 2024-04-03T03:46:17.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.317+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=FR5NX06Z77XL type=del size=2268212 2024-04-03T03:46:17.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.321+0000 7f55269288c0 1 < suggested update operation key=F6IBZ80J4SDM tag=EQZOB512GWJZ type=del size=3969697 2024-04-03T03:46:17.321 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.325+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=X80K3BRDV8OF type=del size=1762157 2024-04-03T03:46:17.324 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.329+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=VQQLZU7BES1K type=del 2024-04-03T03:46:17.327 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.329+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=GH7ZE56GL5PI type=del size=3356977 2024-04-03T03:46:17.330 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.333+0000 7f55269288c0 1 < completed write operation key=3XKXK1JXKOHU tag=C80FDU2PNAV4 type=write size=850563 2024-04-03T03:46:17.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.337+0000 7f55269288c0 1 > prepared operation key=8BMP0HIS520R tag=QAR9D9WRK6TF type=del size=1203418 2024-04-03T03:46:17.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.337+0000 7f55269288c0 1 < completed delete operation key=D8W2ZKIZFI8H tag=VUA39MGOVMNK type=del 2024-04-03T03:46:17.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.341+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=V5OKHNPIMBNQ type=del size=2639063 2024-04-03T03:46:17.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.345+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=ZDACCC4ZVSR6 type=del 2024-04-03T03:46:17.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.349+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=2ICORZGCRYVE type=del size=3540475 2024-04-03T03:46:17.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.349+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=L20JLF0DGLGI type=del 2024-04-03T03:46:17.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.353+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=F0B7R13AVX18 type=del size=2295528 2024-04-03T03:46:17.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.357+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=ZJ65L1JF5EFU type=del 2024-04-03T03:46:17.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.357+0000 7f55269288c0 1 > prepared operation key=TXFMKXUGMEA8 tag=I2XKJEC4T6T9 type=del size=1107034 2024-04-03T03:46:17.359 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.361+0000 7f55269288c0 1 < completed write operation key=IOHMF3ADC6EU tag=FN4C3JFKMX2D type=write size=442407 2024-04-03T03:46:17.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.369+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~8FW22LNPP2Y1.0 size=464146 2024-04-03T03:46:17.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.369+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=8FW22LNPP2Y1 tag=4JVHPQVAEAV4 type=write size=1512722 2024-04-03T03:46:17.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.369+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~50MSGX36PNIE.0 size=1048576 2024-04-03T03:46:17.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.373+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~50MSGX36PNIE.1 size=82178 2024-04-03T03:46:17.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.377+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=50MSGX36PNIE tag=IRNQP0WPWML4 type=write size=2179330 2024-04-03T03:46:17.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.381+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~0MZV08RW9QIS.0 size=80055 2024-04-03T03:46:17.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.381+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=0MZV08RW9QIS tag=HG0HQ8FCEICO type=write size=1128631 2024-04-03T03:46:17.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.385+0000 7f55269288c0 1 < completed delete operation key=CPR27NMHPIPQ tag=OA6H6HINYTYF type=del 2024-04-03T03:46:17.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.393+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~8T2KI2PLH4YJ.0 size=1048576 2024-04-03T03:46:17.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.397+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~8T2KI2PLH4YJ.1 size=1048576 2024-04-03T03:46:17.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.397+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~8T2KI2PLH4YJ.2 size=863304 2024-04-03T03:46:17.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.397+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=8T2KI2PLH4YJ tag=DLI3TZCBXUVE type=write size=4009032 2024-04-03T03:46:17.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.405+0000 7f55269288c0 1 < suggested remove operation key=TW860A14J9RC tag=IZHODGV6OZJ0 type=del 2024-04-03T03:46:17.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.409+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~WIT41Z8DVHKN.0 size=1048576 2024-04-03T03:46:17.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.413+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~WIT41Z8DVHKN.1 size=1048576 2024-04-03T03:46:17.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.417+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~WIT41Z8DVHKN.2 size=91588 2024-04-03T03:46:17.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.417+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=WIT41Z8DVHKN tag=Y0NOVVXSCJYM type=write size=3237316 2024-04-03T03:46:17.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.417+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~HORMK9RT3J4R.0 size=1048576 2024-04-03T03:46:17.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.421+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~HORMK9RT3J4R.1 size=468434 2024-04-03T03:46:17.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.425+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=HORMK9RT3J4R tag=Y8WWWX5DZAAC type=write size=2565586 2024-04-03T03:46:17.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.433+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=9SIXKKPC8GVX type=del size=707222 2024-04-03T03:46:17.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.437+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~15D2UI27W4M6.0 size=1048576 2024-04-03T03:46:17.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.437+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~15D2UI27W4M6.1 size=1048576 2024-04-03T03:46:17.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.441+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~15D2UI27W4M6.2 size=276780 2024-04-03T03:46:17.442 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.445+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=15D2UI27W4M6 tag=WVQHKAQA914N type=write size=3422508 2024-04-03T03:46:17.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.449+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=LS4LBT5MA6UQ type=del size=802624 2024-04-03T03:46:17.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.453+0000 7f55269288c0 1 < completed delete operation key=B5BI0HJ5S1Y1 tag=DYGYMT5JNN21 type=del 2024-04-03T03:46:17.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.453+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=PG0Z1A8SDX96 type=del size=3647739 2024-04-03T03:46:17.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.457+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~5QN0OMXE0CA8.0 size=800198 2024-04-03T03:46:17.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.461+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=5QN0OMXE0CA8 tag=75EKR7WQTXVO type=write size=1848774 2024-04-03T03:46:17.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.465+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=W76LWVNN1GID type=write size=879737 2024-04-03T03:46:17.465 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.469+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=FR5NX06Z77XL type=del 2024-04-03T03:46:17.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.473+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=4JJ2AKTW4P00 type=del size=2813895 2024-04-03T03:46:17.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.473+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=X80K3BRDV8OF type=del 2024-04-03T03:46:17.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.477+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=6LAQU1Y60ZGB type=del size=2251986 2024-04-03T03:46:17.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.481+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=GH7ZE56GL5PI type=del 2024-04-03T03:46:17.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.485+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~LKV4WC9U9B6Y.0 size=1048576 2024-04-03T03:46:17.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.489+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~LKV4WC9U9B6Y.1 size=1048576 2024-04-03T03:46:17.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.489+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~LKV4WC9U9B6Y.2 size=935679 2024-04-03T03:46:17.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.489+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=LKV4WC9U9B6Y tag=XTQA5D479JG9 type=write size=4081407 2024-04-03T03:46:17.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.493+0000 7f55269288c0 1 < completed delete operation key=8BMP0HIS520R tag=QAR9D9WRK6TF type=del 2024-04-03T03:46:17.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.497+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=3FB9UAYPIRT2 type=del size=440950 2024-04-03T03:46:17.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.501+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=V5OKHNPIMBNQ type=del 2024-04-03T03:46:17.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.501+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=5ZTJTSWIWN33 type=del size=3061476 2024-04-03T03:46:17.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.505+0000 7f55269288c0 1 < completed delete operation key=AXL5RVPSVDY5 tag=2ICORZGCRYVE type=del 2024-04-03T03:46:17.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.509+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=9HUEOVBQ3GHP type=del size=4116600 2024-04-03T03:46:17.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.513+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=F0B7R13AVX18 type=del 2024-04-03T03:46:17.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.513+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=P9G3TM12RTIW type=del size=1334151 2024-04-03T03:46:17.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.517+0000 7f55269288c0 1 < completed delete operation key=TXFMKXUGMEA8 tag=I2XKJEC4T6T9 type=del 2024-04-03T03:46:17.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.521+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=7VL8IEU369RZ type=write size=595488 2024-04-03T03:46:17.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.525+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~8FW22LNPP2Y1.0 size=464146 2024-04-03T03:46:17.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.529+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=8FW22LNPP2Y1 tag=4JVHPQVAEAV4 type=write size=1512722 2024-04-03T03:46:17.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.529+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=BQSUZ4BQNLKI type=del size=1470705 2024-04-03T03:46:17.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.533+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~0MZV08RW9QIS.0 size=80055 2024-04-03T03:46:17.536 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.537+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=0MZV08RW9QIS tag=HG0HQ8FCEICO type=write size=1128631 2024-04-03T03:46:17.541 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.545+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~4F1RDA6QS3ES.0 size=15808 2024-04-03T03:46:17.541 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.545+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=4F1RDA6QS3ES tag=B8SXGUEYHBG2 type=write size=1064384 2024-04-03T03:46:17.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.549+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~8T2KI2PLH4YJ.0 size=1048576 2024-04-03T03:46:17.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.549+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~8T2KI2PLH4YJ.1 size=1048576 2024-04-03T03:46:17.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.549+0000 7f55269288c0 1 < canceled part key=_multipart_KU1R0YLDP1V3.2~8T2KI2PLH4YJ.2 size=863304 2024-04-03T03:46:17.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.553+0000 7f55269288c0 1 < canceled multipart upload key=KU1R0YLDP1V3 upload=8T2KI2PLH4YJ tag=DLI3TZCBXUVE type=write size=4009032 2024-04-03T03:46:17.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.561+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~OWT0ZBKI1JOM.0 size=704177 2024-04-03T03:46:17.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.561+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=OWT0ZBKI1JOM tag=604KXZTFZ8TN type=write size=1752753 2024-04-03T03:46:17.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.565+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~WIT41Z8DVHKN.0 size=1048576 2024-04-03T03:46:17.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.565+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~WIT41Z8DVHKN.1 size=1048576 2024-04-03T03:46:17.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.569+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~WIT41Z8DVHKN.2 size=91588 2024-04-03T03:46:17.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.577+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=WIT41Z8DVHKN tag=Y0NOVVXSCJYM type=write size=3237316 2024-04-03T03:46:17.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.577+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=E5S6WBJQ58XZ type=del size=1187062 2024-04-03T03:46:17.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.581+0000 7f55269288c0 1 < completed delete operation key=LZQGL2UAWOTU tag=9SIXKKPC8GVX type=del 2024-04-03T03:46:17.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.589+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~ZYU522XENLY5.0 size=436467 2024-04-03T03:46:17.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.589+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=ZYU522XENLY5 tag=WV61V3Y224KO type=write size=1485043 2024-04-03T03:46:17.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.589+0000 7f55269288c0 1 < canceled operation key=D9OEPPT37WSJ tag=LS4LBT5MA6UQ type=del size=802624 2024-04-03T03:46:17.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.597+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~DQZEUM6TD0SV.0 size=760770 2024-04-03T03:46:17.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.597+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=DQZEUM6TD0SV tag=WFEDT06QHI9R type=write size=1809346 2024-04-03T03:46:17.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.597+0000 7f55269288c0 1 < canceled operation key=KDSE2XB4D1XI tag=PG0Z1A8SDX96 type=del size=3647739 2024-04-03T03:46:17.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.601+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=6ZTIZ5LCVP5N type=del size=1624655 2024-04-03T03:46:17.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.605+0000 7f55269288c0 1 < completed write operation key=AXL5RVPSVDY5 tag=W76LWVNN1GID type=write size=879737 2024-04-03T03:46:17.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.609+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~S5QPQHZNILN4.0 size=1048576 2024-04-03T03:46:17.610 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.613+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~S5QPQHZNILN4.1 size=1048576 2024-04-03T03:46:17.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.613+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~S5QPQHZNILN4.2 size=605939 2024-04-03T03:46:17.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.613+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=S5QPQHZNILN4 tag=M31EYKLNZ1M8 type=write size=3751667 2024-04-03T03:46:17.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.617+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=4JJ2AKTW4P00 type=del 2024-04-03T03:46:17.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.621+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=H4BVEM8MVTAJ type=write size=939586 2024-04-03T03:46:17.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.621+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=6LAQU1Y60ZGB type=del 2024-04-03T03:46:17.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.625+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=9R250AYT08FX type=del size=2429715 2024-04-03T03:46:17.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.625+0000 7f55269288c0 1 < canceled part key=_multipart_XFCPX90N2NYC.2~LKV4WC9U9B6Y.0 size=1048576 2024-04-03T03:46:17.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.629+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~LKV4WC9U9B6Y.1 size=1048576 2024-04-03T03:46:17.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.629+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~LKV4WC9U9B6Y.2 size=935679 2024-04-03T03:46:17.632 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.633+0000 7f55269288c0 1 < canceled multipart upload key=XFCPX90N2NYC upload=LKV4WC9U9B6Y tag=XTQA5D479JG9 type=write size=4081407 2024-04-03T03:46:17.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.641+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~MREHUEYYF1WJ.0 size=1048576 2024-04-03T03:46:17.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.641+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~MREHUEYYF1WJ.1 size=1048576 2024-04-03T03:46:17.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.645+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~MREHUEYYF1WJ.2 size=659333 2024-04-03T03:46:17.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.645+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=MREHUEYYF1WJ tag=3813U4PLBJXR type=write size=3805061 2024-04-03T03:46:17.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.645+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=3FB9UAYPIRT2 type=del 2024-04-03T03:46:17.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.653+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~Q1K3QJ1OJQJK.0 size=766835 2024-04-03T03:46:17.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.653+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=Q1K3QJ1OJQJK tag=PC3JUWTD1HMV type=write size=1815411 2024-04-03T03:46:17.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.653+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=5ZTJTSWIWN33 type=del 2024-04-03T03:46:17.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.661+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~SY8D3173B1ZR.0 size=1048576 2024-04-03T03:46:17.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.661+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~SY8D3173B1ZR.1 size=731005 2024-04-03T03:46:17.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.661+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=SY8D3173B1ZR tag=BUTL3MMS88I1 type=write size=2828157 2024-04-03T03:46:17.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.665+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=9HUEOVBQ3GHP type=del 2024-04-03T03:46:17.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.669+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~TRLGQD8FTO7F.0 size=14432 2024-04-03T03:46:17.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.669+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=TRLGQD8FTO7F tag=PS7SHGDI2MGA type=write size=1063008 2024-04-03T03:46:17.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.677+0000 7f55269288c0 1 < suggested remove operation key=JAXVD60NI5YW tag=P9G3TM12RTIW type=del 2024-04-03T03:46:17.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.681+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~TIJNMC0PUXCQ.0 size=448972 2024-04-03T03:46:17.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.681+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=TIJNMC0PUXCQ tag=6KRUYPEMZ442 type=write size=1497548 2024-04-03T03:46:17.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.685+0000 7f55269288c0 1 < suggested update operation key=AGTQQYXO7453 tag=7VL8IEU369RZ type=write size=595488 2024-04-03T03:46:17.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.689+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~Y7GUVWYUBLFG.0 size=1048576 2024-04-03T03:46:17.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.693+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~Y7GUVWYUBLFG.1 size=1048576 2024-04-03T03:46:17.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.693+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~Y7GUVWYUBLFG.2 size=520422 2024-04-03T03:46:17.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.693+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=Y7GUVWYUBLFG tag=XPWOX32KHOLU type=write size=3666150 2024-04-03T03:46:17.694 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.697+0000 7f55269288c0 1 < completed delete operation key=TLM1C3B9J2A3 tag=BQSUZ4BQNLKI type=del 2024-04-03T03:46:17.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.705+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~BC8B3MCPLFRX.0 size=1048576 2024-04-03T03:46:17.706 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.709+0000 7f55269288c0 1 > prepared part key=_multipart_KDSE2XB4D1XI.2~BC8B3MCPLFRX.1 size=984010 2024-04-03T03:46:17.706 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.709+0000 7f55269288c0 1 > prepared multipart upload key=KDSE2XB4D1XI upload=BC8B3MCPLFRX tag=LW477Z2G9W8E type=write size=3081162 2024-04-03T03:46:17.709 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.713+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~4F1RDA6QS3ES.0 size=15808 2024-04-03T03:46:17.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.717+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=4F1RDA6QS3ES tag=B8SXGUEYHBG2 type=write size=1064384 2024-04-03T03:46:17.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.725+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~8FQ2L8F7SH0G.0 size=1048576 2024-04-03T03:46:17.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.725+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~8FQ2L8F7SH0G.1 size=290473 2024-04-03T03:46:17.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.725+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=8FQ2L8F7SH0G tag=8VFPF3XJ6AM7 type=write size=2387625 2024-04-03T03:46:17.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.729+0000 7f55269288c0 1 < completed part key=_multipart_YCEKDT5EQD9D.2~OWT0ZBKI1JOM.0 size=704177 2024-04-03T03:46:17.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.733+0000 7f55269288c0 1 < completed multipart upload key=YCEKDT5EQD9D upload=OWT0ZBKI1JOM tag=604KXZTFZ8TN type=write size=1752753 2024-04-03T03:46:17.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.737+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=DU2GL7KWFTYF type=del size=3048709 2024-04-03T03:46:17.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.737+0000 7f55269288c0 1 < completed delete operation key=F6IBZ80J4SDM tag=E5S6WBJQ58XZ type=del 2024-04-03T03:46:17.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.741+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~4TF3VVWMPMMM.0 size=341109 2024-04-03T03:46:17.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.741+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=4TF3VVWMPMMM tag=0K6GXOJC57X0 type=write size=1389685 2024-04-03T03:46:17.743 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.745+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~ZYU522XENLY5.0 size=436467 2024-04-03T03:46:17.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.749+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=ZYU522XENLY5 tag=WV61V3Y224KO type=write size=1485043 2024-04-03T03:46:17.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.753+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=31U92DV35RJQ type=del size=3117489 2024-04-03T03:46:17.753 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.757+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~DQZEUM6TD0SV.0 size=760770 2024-04-03T03:46:17.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.761+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=DQZEUM6TD0SV tag=WFEDT06QHI9R type=write size=1809346 2024-04-03T03:46:17.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.765+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=8VZ5LGM14OYN type=del size=1723087 2024-04-03T03:46:17.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.765+0000 7f55269288c0 1 < canceled operation key=6KH6TASZS3UG tag=6ZTIZ5LCVP5N type=del size=1624655 2024-04-03T03:46:17.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.773+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~MVRHWG38NLXW.0 size=82012 2024-04-03T03:46:17.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.773+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=MVRHWG38NLXW tag=9OM7Y0PTUZBC type=write size=1130588 2024-04-03T03:46:17.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.777+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~S5QPQHZNILN4.0 size=1048576 2024-04-03T03:46:17.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.777+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~S5QPQHZNILN4.1 size=1048576 2024-04-03T03:46:17.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.781+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~S5QPQHZNILN4.2 size=605939 2024-04-03T03:46:17.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.785+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=S5QPQHZNILN4 tag=M31EYKLNZ1M8 type=write size=3751667 2024-04-03T03:46:17.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.789+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=VZYCVIDBCRMM type=del size=1085286 2024-04-03T03:46:17.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.793+0000 7f55269288c0 1 < completed write operation key=MLTDNCZ4E5D8 tag=H4BVEM8MVTAJ type=write size=939586 2024-04-03T03:46:17.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.793+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=P2ZP2008KV3N type=del size=1012568 2024-04-03T03:46:17.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.797+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=9R250AYT08FX type=del 2024-04-03T03:46:17.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.801+0000 7f55269288c0 1 > prepared part key=_multipart_CPR27NMHPIPQ.2~CZK1TBUKGX0K.0 size=390400 2024-04-03T03:46:17.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.801+0000 7f55269288c0 1 > prepared multipart upload key=CPR27NMHPIPQ upload=CZK1TBUKGX0K tag=Z8W8MKTC4K2X type=write size=1438976 2024-04-03T03:46:17.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.805+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~MREHUEYYF1WJ.0 size=1048576 2024-04-03T03:46:17.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.809+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~MREHUEYYF1WJ.1 size=1048576 2024-04-03T03:46:17.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.809+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~MREHUEYYF1WJ.2 size=659333 2024-04-03T03:46:17.812 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.813+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=MREHUEYYF1WJ tag=3813U4PLBJXR type=write size=3805061 2024-04-03T03:46:17.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.821+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~OELW5792BAV7.0 size=1048576 2024-04-03T03:46:17.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.821+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~OELW5792BAV7.1 size=1048576 2024-04-03T03:46:17.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.825+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~OELW5792BAV7.2 size=813755 2024-04-03T03:46:17.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.825+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=OELW5792BAV7 tag=D07YC4JXUE8M type=write size=3959483 2024-04-03T03:46:17.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.825+0000 7f55269288c0 1 < canceled part key=_multipart_AGTQQYXO7453.2~Q1K3QJ1OJQJK.0 size=766835 2024-04-03T03:46:17.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.829+0000 7f55269288c0 1 < canceled multipart upload key=AGTQQYXO7453 upload=Q1K3QJ1OJQJK tag=PC3JUWTD1HMV type=write size=1815411 2024-04-03T03:46:17.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.833+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=3SNDS5P1FUC5 type=write size=418972 2024-04-03T03:46:17.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.837+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~SY8D3173B1ZR.0 size=1048576 2024-04-03T03:46:17.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.837+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~SY8D3173B1ZR.1 size=731005 2024-04-03T03:46:17.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.841+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=SY8D3173B1ZR tag=BUTL3MMS88I1 type=write size=2828157 2024-04-03T03:46:17.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.845+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=YJVJSA07EGQX type=del size=4006237 2024-04-03T03:46:17.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.845+0000 7f55269288c0 1 < canceled part key=_multipart_CPR27NMHPIPQ.2~TRLGQD8FTO7F.0 size=14432 2024-04-03T03:46:17.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.853+0000 7f55269288c0 1 < canceled multipart upload key=CPR27NMHPIPQ upload=TRLGQD8FTO7F tag=PS7SHGDI2MGA type=write size=1063008 2024-04-03T03:46:17.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.857+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~UE3TIFWDADEF.0 size=1048576 2024-04-03T03:46:17.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.861+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~UE3TIFWDADEF.1 size=323007 2024-04-03T03:46:17.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.861+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=UE3TIFWDADEF tag=HSGIYWHB1HJ3 type=write size=2420159 2024-04-03T03:46:17.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.861+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~TIJNMC0PUXCQ.0 size=448972 2024-04-03T03:46:17.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.869+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=TIJNMC0PUXCQ tag=6KRUYPEMZ442 type=write size=1497548 2024-04-03T03:46:17.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.869+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=V92R1Q2IF76J type=del size=361319 2024-04-03T03:46:17.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.869+0000 7f55269288c0 1 < canceled part key=_multipart_JAXVD60NI5YW.2~Y7GUVWYUBLFG.0 size=1048576 2024-04-03T03:46:17.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.873+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~Y7GUVWYUBLFG.1 size=1048576 2024-04-03T03:46:17.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.877+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~Y7GUVWYUBLFG.2 size=520422 2024-04-03T03:46:17.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.881+0000 7f55269288c0 1 < canceled multipart upload key=JAXVD60NI5YW upload=Y7GUVWYUBLFG tag=XPWOX32KHOLU type=write size=3666150 2024-04-03T03:46:17.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.885+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=G5OKPU2AYJUW type=del size=2764865 2024-04-03T03:46:17.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.885+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~BC8B3MCPLFRX.0 size=1048576 2024-04-03T03:46:17.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.889+0000 7f55269288c0 1 < completed part key=_multipart_KDSE2XB4D1XI.2~BC8B3MCPLFRX.1 size=984010 2024-04-03T03:46:17.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.893+0000 7f55269288c0 1 < completed multipart upload key=KDSE2XB4D1XI upload=BC8B3MCPLFRX tag=LW477Z2G9W8E type=write size=3081162 2024-04-03T03:46:17.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.897+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=TOVHQSILN99J type=del size=2588016 2024-04-03T03:46:17.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.897+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~8FQ2L8F7SH0G.0 size=1048576 2024-04-03T03:46:17.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.901+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~8FQ2L8F7SH0G.1 size=290473 2024-04-03T03:46:17.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.905+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=8FQ2L8F7SH0G tag=8VFPF3XJ6AM7 type=write size=2387625 2024-04-03T03:46:17.907 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.909+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~9VHV5YI0QVFQ.0 size=1048576 2024-04-03T03:46:17.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.913+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~9VHV5YI0QVFQ.1 size=430480 2024-04-03T03:46:17.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.913+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=9VHV5YI0QVFQ tag=0ZQEMRXVD4AL type=write size=2527632 2024-04-03T03:46:17.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.917+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=DU2GL7KWFTYF type=del 2024-04-03T03:46:17.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.921+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~JHPX0FOJ3XMA.0 size=1048576 2024-04-03T03:46:17.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.925+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~JHPX0FOJ3XMA.1 size=156038 2024-04-03T03:46:17.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.925+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=JHPX0FOJ3XMA tag=YH0HSM1MVV4C type=write size=2253190 2024-04-03T03:46:17.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.925+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~4TF3VVWMPMMM.0 size=341109 2024-04-03T03:46:17.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.933+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=4TF3VVWMPMMM tag=0K6GXOJC57X0 type=write size=1389685 2024-04-03T03:46:17.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.933+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=KMR39BFFMOE9 type=del size=591368 2024-04-03T03:46:17.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.937+0000 7f55269288c0 1 < canceled operation key=XFCPX90N2NYC tag=31U92DV35RJQ type=del size=3117489 2024-04-03T03:46:17.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.941+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~EBS2L7GZ7J22.0 size=1048576 2024-04-03T03:46:17.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.945+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~EBS2L7GZ7J22.1 size=1048576 2024-04-03T03:46:17.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.945+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~EBS2L7GZ7J22.2 size=80267 2024-04-03T03:46:17.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.945+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=EBS2L7GZ7J22 tag=SUHM8YDHJ8PA type=write size=3225995 2024-04-03T03:46:17.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.949+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=8VZ5LGM14OYN type=del 2024-04-03T03:46:17.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.953+0000 7f55269288c0 1 > prepared operation key=D9OEPPT37WSJ tag=72ZTY34LBKW2 type=del size=453749 2024-04-03T03:46:17.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.957+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~MVRHWG38NLXW.0 size=82012 2024-04-03T03:46:17.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.961+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=MVRHWG38NLXW tag=9OM7Y0PTUZBC type=write size=1130588 2024-04-03T03:46:17.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.961+0000 7f55269288c0 1 > prepared operation key=AXL5RVPSVDY5 tag=1ZHNN3XC2QP8 type=del size=309562 2024-04-03T03:46:17.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.965+0000 7f55269288c0 1 < canceled operation key=U62RSK21LJEF tag=VZYCVIDBCRMM type=del size=1085286 2024-04-03T03:46:17.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.969+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=9AIE4X87OT2G type=del size=1525574 2024-04-03T03:46:17.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.977+0000 7f55269288c0 1 < suggested update operation key=Z42NDVEX1SOL tag=P2ZP2008KV3N type=del size=1012568 2024-04-03T03:46:17.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.977+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=ZTFB5MNEB4L2 type=del size=1987535 2024-04-03T03:46:17.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.981+0000 7f55269288c0 1 < completed part key=_multipart_CPR27NMHPIPQ.2~CZK1TBUKGX0K.0 size=390400 2024-04-03T03:46:17.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.985+0000 7f55269288c0 1 < completed multipart upload key=CPR27NMHPIPQ upload=CZK1TBUKGX0K tag=Z8W8MKTC4K2X type=write size=1438976 2024-04-03T03:46:17.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.989+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=N3QRRQAP2KZR type=del size=4095246 2024-04-03T03:46:17.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.989+0000 7f55269288c0 1 < canceled part key=_multipart_K3Z9W19WEJBM.2~OELW5792BAV7.0 size=1048576 2024-04-03T03:46:17.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.993+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~OELW5792BAV7.1 size=1048576 2024-04-03T03:46:17.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:17.997+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~OELW5792BAV7.2 size=813755 2024-04-03T03:46:17.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.001+0000 7f55269288c0 1 < canceled multipart upload key=K3Z9W19WEJBM upload=OELW5792BAV7 tag=D07YC4JXUE8M type=write size=3959483 2024-04-03T03:46:18.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.005+0000 7f55269288c0 1 > prepared operation key=8SBTVHL09P63 tag=49567IEHPVXZ type=del size=2393725 2024-04-03T03:46:18.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.009+0000 7f55269288c0 1 < suggested update operation key=YCEKDT5EQD9D tag=3SNDS5P1FUC5 type=write size=418972 2024-04-03T03:46:18.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.013+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~UEC7QZE3KJEK.0 size=1048576 2024-04-03T03:46:18.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.017+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~UEC7QZE3KJEK.1 size=1048576 2024-04-03T03:46:18.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.017+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~UEC7QZE3KJEK.2 size=924407 2024-04-03T03:46:18.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.017+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=UEC7QZE3KJEK tag=9L4AXQTXQG7G type=write size=4070135 2024-04-03T03:46:18.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.021+0000 7f55269288c0 -1 < failed to complete operation key=Z42NDVEX1SOL tag=YJVJSA07EGQX type=del size=4006237: (22) Invalid argument 2024-04-03T03:46:18.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.029+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~EPQR19EHVRWL.0 size=1048576 2024-04-03T03:46:18.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.029+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~EPQR19EHVRWL.1 size=459454 2024-04-03T03:46:18.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.029+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=EPQR19EHVRWL tag=OGT74PI4RMCL type=write size=2556606 2024-04-03T03:46:18.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.033+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~UE3TIFWDADEF.0 size=1048576 2024-04-03T03:46:18.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.033+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~UE3TIFWDADEF.1 size=323007 2024-04-03T03:46:18.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.041+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=UE3TIFWDADEF tag=HSGIYWHB1HJ3 type=write size=2420159 2024-04-03T03:46:18.043 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.045+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~57T1UH2T1S21.0 size=1048576 2024-04-03T03:46:18.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.049+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~57T1UH2T1S21.1 size=1048576 2024-04-03T03:46:18.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.049+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~57T1UH2T1S21.2 size=701318 2024-04-03T03:46:18.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.049+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=57T1UH2T1S21 tag=E2Q3WNJUVMMD type=write size=3847046 2024-04-03T03:46:18.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.053+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=V92R1Q2IF76J type=del 2024-04-03T03:46:18.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.057+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~O5OEDHBNQSKU.0 size=1048576 2024-04-03T03:46:18.058 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.061+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~O5OEDHBNQSKU.1 size=1048576 2024-04-03T03:46:18.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.065+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~O5OEDHBNQSKU.2 size=723502 2024-04-03T03:46:18.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.065+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=O5OEDHBNQSKU tag=XP7ZWOVRGF38 type=write size=3869230 2024-04-03T03:46:18.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.069+0000 7f55269288c0 1 < suggested update operation key=AXL5RVPSVDY5 tag=G5OKPU2AYJUW type=del size=2764865 2024-04-03T03:46:18.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.073+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~BIQMJY00XKE1.0 size=511952 2024-04-03T03:46:18.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.073+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=BIQMJY00XKE1 tag=GZUEDNFQPMC3 type=write size=1560528 2024-04-03T03:46:18.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.077+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=TOVHQSILN99J type=del 2024-04-03T03:46:18.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.081+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=JNYCAV60UK4L type=del size=3535872 2024-04-03T03:46:18.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.085+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~9VHV5YI0QVFQ.0 size=1048576 2024-04-03T03:46:18.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.085+0000 7f55269288c0 1 < canceled part key=_multipart_F6IBZ80J4SDM.2~9VHV5YI0QVFQ.1 size=430480 2024-04-03T03:46:18.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.089+0000 7f55269288c0 1 < canceled multipart upload key=F6IBZ80J4SDM upload=9VHV5YI0QVFQ tag=0ZQEMRXVD4AL type=write size=2527632 2024-04-03T03:46:18.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.097+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~IFMY3EX4H8MK.0 size=1048576 2024-04-03T03:46:18.096 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.101+0000 7f55269288c0 1 > prepared part key=_multipart_AGTQQYXO7453.2~IFMY3EX4H8MK.1 size=369382 2024-04-03T03:46:18.096 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.101+0000 7f55269288c0 1 > prepared multipart upload key=AGTQQYXO7453 upload=IFMY3EX4H8MK tag=7864F6EELL1S type=write size=2466534 2024-04-03T03:46:18.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.101+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~JHPX0FOJ3XMA.0 size=1048576 2024-04-03T03:46:18.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.105+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~JHPX0FOJ3XMA.1 size=156038 2024-04-03T03:46:18.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.113+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=JHPX0FOJ3XMA tag=YH0HSM1MVV4C type=write size=2253190 2024-04-03T03:46:18.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.113+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=NZ1KS3UEB3Z9 type=del size=1152547 2024-04-03T03:46:18.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.117+0000 7f55269288c0 1 < completed delete operation key=8SBTVHL09P63 tag=KMR39BFFMOE9 type=del 2024-04-03T03:46:18.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.121+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=2F4DX5X5NMQY type=del size=4192324 2024-04-03T03:46:18.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.121+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~EBS2L7GZ7J22.0 size=1048576 2024-04-03T03:46:18.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.125+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~EBS2L7GZ7J22.1 size=1048576 2024-04-03T03:46:18.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.129+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~EBS2L7GZ7J22.2 size=80267 2024-04-03T03:46:18.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.133+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=EBS2L7GZ7J22 tag=SUHM8YDHJ8PA type=write size=3225995 2024-04-03T03:46:18.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.133+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=EHST8359MZE9 type=del size=3284373 2024-04-03T03:46:18.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.141+0000 7f55269288c0 1 < suggested update operation key=D9OEPPT37WSJ tag=72ZTY34LBKW2 type=del size=453749 2024-04-03T03:46:18.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.145+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~ZZZMKAKSWHF7.0 size=908495 2024-04-03T03:46:18.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.145+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=ZZZMKAKSWHF7 tag=9WYOMVK35LEX type=write size=1957071 2024-04-03T03:46:18.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.149+0000 7f55269288c0 -1 < failed to complete operation key=AXL5RVPSVDY5 tag=1ZHNN3XC2QP8 type=del size=309562: (22) Invalid argument 2024-04-03T03:46:18.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.153+0000 7f55269288c0 1 > prepared operation key=TW860A14J9RC tag=HFWTLR36V999 type=del size=481833 2024-04-03T03:46:18.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.157+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=9AIE4X87OT2G type=del 2024-04-03T03:46:18.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.161+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~VUDD1KW0THLH.0 size=1048576 2024-04-03T03:46:18.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.165+0000 7f55269288c0 1 > prepared part key=_multipart_TW860A14J9RC.2~VUDD1KW0THLH.1 size=789079 2024-04-03T03:46:18.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.165+0000 7f55269288c0 1 > prepared multipart upload key=TW860A14J9RC upload=VUDD1KW0THLH tag=YBMS6VRN2WI3 type=write size=2886231 2024-04-03T03:46:18.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.165+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=ZTFB5MNEB4L2 type=del 2024-04-03T03:46:18.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.173+0000 7f55269288c0 1 > prepared part key=_multipart_LZQGL2UAWOTU.2~MS7ERGY35XMG.0 size=5880 2024-04-03T03:46:18.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.173+0000 7f55269288c0 1 > prepared multipart upload key=LZQGL2UAWOTU upload=MS7ERGY35XMG tag=RLN9B1IZLC42 type=write size=1054456 2024-04-03T03:46:18.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.173+0000 7f55269288c0 1 < canceled operation key=MB7HTWATXRMB tag=N3QRRQAP2KZR type=del size=4095246 2024-04-03T03:46:18.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.181+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~DAJ8WNFYPZSD.0 size=1048576 2024-04-03T03:46:18.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.181+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~DAJ8WNFYPZSD.1 size=1048576 2024-04-03T03:46:18.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.185+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~DAJ8WNFYPZSD.2 size=399227 2024-04-03T03:46:18.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.185+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=DAJ8WNFYPZSD tag=YAYP3AW2GNP6 type=write size=3544955 2024-04-03T03:46:18.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.189+0000 7f55269288c0 1 < suggested remove operation key=8SBTVHL09P63 tag=49567IEHPVXZ type=del 2024-04-03T03:46:18.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.197+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~8AZS8UR9ILDL.0 size=1048576 2024-04-03T03:46:18.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.201+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~8AZS8UR9ILDL.1 size=1048576 2024-04-03T03:46:18.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.201+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~8AZS8UR9ILDL.2 size=930894 2024-04-03T03:46:18.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.201+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=8AZS8UR9ILDL tag=OVTH0F1E5JBH type=write size=4076622 2024-04-03T03:46:18.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.205+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~UEC7QZE3KJEK.0 size=1048576 2024-04-03T03:46:18.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.209+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~UEC7QZE3KJEK.1 size=1048576 2024-04-03T03:46:18.208 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.209+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~UEC7QZE3KJEK.2 size=924407 2024-04-03T03:46:18.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.217+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=UEC7QZE3KJEK tag=9L4AXQTXQG7G type=write size=4070135 2024-04-03T03:46:18.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.221+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~P28QVCKLYKLW.0 size=1048576 2024-04-03T03:46:18.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.225+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~P28QVCKLYKLW.1 size=613485 2024-04-03T03:46:18.220 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.225+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=P28QVCKLYKLW tag=0W118TPR8B4Z type=write size=2710637 2024-04-03T03:46:18.223 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.225+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~EPQR19EHVRWL.0 size=1048576 2024-04-03T03:46:18.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.229+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~EPQR19EHVRWL.1 size=459454 2024-04-03T03:46:18.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.233+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=EPQR19EHVRWL tag=OGT74PI4RMCL type=write size=2556606 2024-04-03T03:46:18.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.237+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=L90ISHHUI0H0 type=del size=2288916 2024-04-03T03:46:18.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.237+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~57T1UH2T1S21.0 size=1048576 2024-04-03T03:46:18.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.237+0000 7f55269288c0 1 < canceled part key=_multipart_8BMP0HIS520R.2~57T1UH2T1S21.1 size=1048576 2024-04-03T03:46:18.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.237+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~57T1UH2T1S21.2 size=701318 2024-04-03T03:46:18.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.249+0000 7f55269288c0 1 < canceled multipart upload key=8BMP0HIS520R upload=57T1UH2T1S21 tag=E2Q3WNJUVMMD type=write size=3847046 2024-04-03T03:46:18.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.253+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~F9XTQTIPED71.0 size=1048576 2024-04-03T03:46:18.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.253+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~F9XTQTIPED71.1 size=1048576 2024-04-03T03:46:18.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.257+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~F9XTQTIPED71.2 size=866992 2024-04-03T03:46:18.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.257+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=F9XTQTIPED71 tag=OATT8P7CICI9 type=write size=4012720 2024-04-03T03:46:18.257 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.261+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~O5OEDHBNQSKU.0 size=1048576 2024-04-03T03:46:18.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.261+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~O5OEDHBNQSKU.1 size=1048576 2024-04-03T03:46:18.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.265+0000 7f55269288c0 1 < completed part key=_multipart_Z42NDVEX1SOL.2~O5OEDHBNQSKU.2 size=723502 2024-04-03T03:46:18.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.269+0000 7f55269288c0 1 < completed multipart upload key=Z42NDVEX1SOL upload=O5OEDHBNQSKU tag=XP7ZWOVRGF38 type=write size=3869230 2024-04-03T03:46:18.268 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.273+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=O5X8ZTBVIQXH type=del size=1500953 2024-04-03T03:46:18.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.273+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~BIQMJY00XKE1.0 size=511952 2024-04-03T03:46:18.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.281+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=BIQMJY00XKE1 tag=GZUEDNFQPMC3 type=write size=1560528 2024-04-03T03:46:18.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.285+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~6NXT9MA7IAV0.0 size=1048576 2024-04-03T03:46:18.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.285+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~6NXT9MA7IAV0.1 size=1048576 2024-04-03T03:46:18.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.289+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~6NXT9MA7IAV0.2 size=973857 2024-04-03T03:46:18.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.289+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=6NXT9MA7IAV0 tag=4ELXB5MRU8WL type=write size=4119585 2024-04-03T03:46:18.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.293+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=JNYCAV60UK4L type=del 2024-04-03T03:46:18.293 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.297+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~PLSLMSKUWXI8.0 size=1048576 2024-04-03T03:46:18.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.297+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~PLSLMSKUWXI8.1 size=661676 2024-04-03T03:46:18.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.297+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=PLSLMSKUWXI8 tag=3UNDYBTN6G1R type=write size=2758828 2024-04-03T03:46:18.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.301+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~IFMY3EX4H8MK.0 size=1048576 2024-04-03T03:46:18.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.301+0000 7f55269288c0 1 < completed part key=_multipart_AGTQQYXO7453.2~IFMY3EX4H8MK.1 size=369382 2024-04-03T03:46:18.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.309+0000 7f55269288c0 1 < completed multipart upload key=AGTQQYXO7453 upload=IFMY3EX4H8MK tag=7864F6EELL1S type=write size=2466534 2024-04-03T03:46:18.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.309+0000 7f55269288c0 1 > prepared operation key=MLTDNCZ4E5D8 tag=0RBW47A2NUAE type=del size=1587372 2024-04-03T03:46:18.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.313+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=NZ1KS3UEB3Z9 type=del 2024-04-03T03:46:18.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.317+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=FITHL623I960 type=del size=3487040 2024-04-03T03:46:18.316 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.317+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=2F4DX5X5NMQY type=del 2024-04-03T03:46:18.319 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.321+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=P5U2AWFTORJD type=write size=40556 2024-04-03T03:46:18.326 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.329+0000 7f55269288c0 1 < suggested update operation key=SFN1M3HPGT18 tag=EHST8359MZE9 type=del size=3284373 2024-04-03T03:46:18.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.333+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=704IWIW1G1VK type=del size=642599 2024-04-03T03:46:18.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.333+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~ZZZMKAKSWHF7.0 size=908495 2024-04-03T03:46:18.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.341+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=ZZZMKAKSWHF7 tag=9WYOMVK35LEX type=write size=1957071 2024-04-03T03:46:18.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.341+0000 7f55269288c0 1 > prepared operation key=X3YCYKP2P9IM tag=RMNE3IFFLDQ7 type=write size=980548 2024-04-03T03:46:18.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.345+0000 7f55269288c0 1 < completed delete operation key=TW860A14J9RC tag=HFWTLR36V999 type=del 2024-04-03T03:46:18.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.349+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~OZMM2WZF0EJQ.0 size=1048576 2024-04-03T03:46:18.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.353+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~OZMM2WZF0EJQ.1 size=1048576 2024-04-03T03:46:18.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.353+0000 7f55269288c0 1 > prepared part key=_multipart_SFN1M3HPGT18.2~OZMM2WZF0EJQ.2 size=880441 2024-04-03T03:46:18.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.353+0000 7f55269288c0 1 > prepared multipart upload key=SFN1M3HPGT18 upload=OZMM2WZF0EJQ tag=WN1AV47WO8CM type=write size=4026169 2024-04-03T03:46:18.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.357+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~VUDD1KW0THLH.0 size=1048576 2024-04-03T03:46:18.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.361+0000 7f55269288c0 1 < completed part key=_multipart_TW860A14J9RC.2~VUDD1KW0THLH.1 size=789079 2024-04-03T03:46:18.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.365+0000 7f55269288c0 1 < completed multipart upload key=TW860A14J9RC upload=VUDD1KW0THLH tag=YBMS6VRN2WI3 type=write size=2886231 2024-04-03T03:46:18.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.369+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=H8WMHQQ5CHTJ type=write size=177245 2024-04-03T03:46:18.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.369+0000 7f55269288c0 1 < completed part key=_multipart_LZQGL2UAWOTU.2~MS7ERGY35XMG.0 size=5880 2024-04-03T03:46:18.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.377+0000 7f55269288c0 1 < completed multipart upload key=LZQGL2UAWOTU upload=MS7ERGY35XMG tag=RLN9B1IZLC42 type=write size=1054456 2024-04-03T03:46:18.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.377+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=ZYEQI86N02KX type=del size=1847619 2024-04-03T03:46:18.377 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.381+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~DAJ8WNFYPZSD.0 size=1048576 2024-04-03T03:46:18.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.381+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~DAJ8WNFYPZSD.1 size=1048576 2024-04-03T03:46:18.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.385+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~DAJ8WNFYPZSD.2 size=399227 2024-04-03T03:46:18.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.389+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=DAJ8WNFYPZSD tag=YAYP3AW2GNP6 type=write size=3544955 2024-04-03T03:46:18.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.393+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=ZB93S6SMYZD1 type=del size=497048 2024-04-03T03:46:18.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.397+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~8AZS8UR9ILDL.0 size=1048576 2024-04-03T03:46:18.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.397+0000 7f55269288c0 1 < canceled part key=_multipart_K3Z9W19WEJBM.2~8AZS8UR9ILDL.1 size=1048576 2024-04-03T03:46:18.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.397+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~8AZS8UR9ILDL.2 size=930894 2024-04-03T03:46:18.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.401+0000 7f55269288c0 1 < canceled multipart upload key=K3Z9W19WEJBM upload=8AZS8UR9ILDL tag=OVTH0F1E5JBH type=write size=4076622 2024-04-03T03:46:18.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.405+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~SXJAHMIXDICA.0 size=575764 2024-04-03T03:46:18.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.405+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=SXJAHMIXDICA tag=ZYDQE81FWU1M type=write size=1624340 2024-04-03T03:46:18.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.409+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~P28QVCKLYKLW.0 size=1048576 2024-04-03T03:46:18.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.413+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~P28QVCKLYKLW.1 size=613485 2024-04-03T03:46:18.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.417+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=P28QVCKLYKLW tag=0W118TPR8B4Z type=write size=2710637 2024-04-03T03:46:18.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.417+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=SFZDBYZCB9MA type=del size=110112 2024-04-03T03:46:18.419 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.421+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=L90ISHHUI0H0 type=del 2024-04-03T03:46:18.422 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.425+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=EV7VSWUWNLNJ type=write size=924977 2024-04-03T03:46:18.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.429+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~F9XTQTIPED71.0 size=1048576 2024-04-03T03:46:18.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.429+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~F9XTQTIPED71.1 size=1048576 2024-04-03T03:46:18.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.433+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~F9XTQTIPED71.2 size=866992 2024-04-03T03:46:18.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.437+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=F9XTQTIPED71 tag=OATT8P7CICI9 type=write size=4012720 2024-04-03T03:46:18.442 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.445+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~VVEKGOOYJB5A.0 size=1048576 2024-04-03T03:46:18.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.449+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~VVEKGOOYJB5A.1 size=1048576 2024-04-03T03:46:18.446 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.449+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~VVEKGOOYJB5A.2 size=802259 2024-04-03T03:46:18.446 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.449+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=VVEKGOOYJB5A tag=VUD9G7AK0LPJ type=write size=3947987 2024-04-03T03:46:18.450 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.453+0000 7f55269288c0 1 < canceled operation key=0OSIL0R5ZJ54 tag=O5X8ZTBVIQXH type=del size=1500953 2024-04-03T03:46:18.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.457+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~YORRD6LSZH9W.0 size=1048576 2024-04-03T03:46:18.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.461+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~YORRD6LSZH9W.1 size=169829 2024-04-03T03:46:18.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.461+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=YORRD6LSZH9W tag=E8I9ANECTYYV type=write size=2266981 2024-04-03T03:46:18.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.465+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~6NXT9MA7IAV0.0 size=1048576 2024-04-03T03:46:18.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.465+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~6NXT9MA7IAV0.1 size=1048576 2024-04-03T03:46:18.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.469+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~6NXT9MA7IAV0.2 size=973857 2024-04-03T03:46:18.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.473+0000 7f55269288c0 1 < completed multipart upload key=8SBTVHL09P63 upload=6NXT9MA7IAV0 tag=4ELXB5MRU8WL type=write size=4119585 2024-04-03T03:46:18.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.481+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~U70ACR2GO9JQ.0 size=1048576 2024-04-03T03:46:18.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.485+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~U70ACR2GO9JQ.1 size=1048576 2024-04-03T03:46:18.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.485+0000 7f55269288c0 1 > prepared part key=_multipart_8BMP0HIS520R.2~U70ACR2GO9JQ.2 size=1045725 2024-04-03T03:46:18.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.485+0000 7f55269288c0 1 > prepared multipart upload key=8BMP0HIS520R upload=U70ACR2GO9JQ tag=0A4XOSO2DYRF type=write size=4191453 2024-04-03T03:46:18.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.489+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~PLSLMSKUWXI8.0 size=1048576 2024-04-03T03:46:18.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.493+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~PLSLMSKUWXI8.1 size=661676 2024-04-03T03:46:18.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.497+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=PLSLMSKUWXI8 tag=3UNDYBTN6G1R type=write size=2758828 2024-04-03T03:46:18.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.505+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~SDE5R9SG4HTW.0 size=89682 2024-04-03T03:46:18.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.505+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=SDE5R9SG4HTW tag=NY240853YDNT type=write size=1138258 2024-04-03T03:46:18.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.513+0000 7f55269288c0 1 < suggested remove operation key=MLTDNCZ4E5D8 tag=0RBW47A2NUAE type=del 2024-04-03T03:46:18.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.517+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~RUJHLSB509S0.0 size=1048576 2024-04-03T03:46:18.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.521+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~RUJHLSB509S0.1 size=676965 2024-04-03T03:46:18.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.521+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=RUJHLSB509S0 tag=ZR510PB30OMJ type=write size=2774117 2024-04-03T03:46:18.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.525+0000 7f55269288c0 1 < completed delete operation key=X3YCYKP2P9IM tag=FITHL623I960 type=del 2024-04-03T03:46:18.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.525+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=XBYNBFS27C9E type=del size=871129 2024-04-03T03:46:18.527 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.529+0000 7f55269288c0 1 < completed write operation key=F6IBZ80J4SDM tag=P5U2AWFTORJD type=write size=40556 2024-04-03T03:46:18.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.533+0000 7f55269288c0 1 > prepared operation key=3XKXK1JXKOHU tag=S1KCMWTXG2VO type=del size=931437 2024-04-03T03:46:18.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.537+0000 7f55269288c0 1 < canceled operation key=CPR27NMHPIPQ tag=704IWIW1G1VK type=del size=642599 2024-04-03T03:46:18.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.541+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=DZ3HAA3L58AP type=del size=3284271 2024-04-03T03:46:18.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.545+0000 7f55269288c0 1 < completed write operation key=X3YCYKP2P9IM tag=RMNE3IFFLDQ7 type=write size=980548 2024-04-03T03:46:18.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.545+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=IL9OMFTUVO74 type=del size=1818031 2024-04-03T03:46:18.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.549+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~OZMM2WZF0EJQ.0 size=1048576 2024-04-03T03:46:18.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.553+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~OZMM2WZF0EJQ.1 size=1048576 2024-04-03T03:46:18.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.553+0000 7f55269288c0 1 < completed part key=_multipart_SFN1M3HPGT18.2~OZMM2WZF0EJQ.2 size=880441 2024-04-03T03:46:18.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.557+0000 7f55269288c0 1 < completed multipart upload key=SFN1M3HPGT18 upload=OZMM2WZF0EJQ tag=WN1AV47WO8CM type=write size=4026169 2024-04-03T03:46:18.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.561+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=WMY9ZCCIST56 type=del size=757207 2024-04-03T03:46:18.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.565+0000 7f55269288c0 1 < suggested remove operation key=F6IBZ80J4SDM tag=H8WMHQQ5CHTJ type=write 2024-04-03T03:46:18.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.573+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~1XH10O52CEOY.0 size=1048576 2024-04-03T03:46:18.571 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.573+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~1XH10O52CEOY.1 size=1048576 2024-04-03T03:46:18.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.577+0000 7f55269288c0 1 > prepared part key=_multipart_XFCPX90N2NYC.2~1XH10O52CEOY.2 size=512775 2024-04-03T03:46:18.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.577+0000 7f55269288c0 1 > prepared multipart upload key=XFCPX90N2NYC upload=1XH10O52CEOY tag=A6JSONKT3EDQ type=write size=3658503 2024-04-03T03:46:18.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.581+0000 7f55269288c0 1 < completed delete operation key=Z42NDVEX1SOL tag=ZYEQI86N02KX type=del 2024-04-03T03:46:18.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.585+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~IXK5RTNTZ6XN.0 size=1048576 2024-04-03T03:46:18.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.589+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~IXK5RTNTZ6XN.1 size=1048576 2024-04-03T03:46:18.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.589+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~IXK5RTNTZ6XN.2 size=849133 2024-04-03T03:46:18.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.589+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=IXK5RTNTZ6XN tag=QEK08J65DU40 type=write size=3994861 2024-04-03T03:46:18.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.593+0000 7f55269288c0 1 < completed delete operation key=KDSE2XB4D1XI tag=ZB93S6SMYZD1 type=del 2024-04-03T03:46:18.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.601+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~WGSCTW5QJTWH.0 size=997476 2024-04-03T03:46:18.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.601+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=WGSCTW5QJTWH tag=FWFN3M4H8H7V type=write size=2046052 2024-04-03T03:46:18.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.601+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~SXJAHMIXDICA.0 size=575764 2024-04-03T03:46:18.605 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.609+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=SXJAHMIXDICA tag=ZYDQE81FWU1M type=write size=1624340 2024-04-03T03:46:18.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.609+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=HMV9ZLFCTQG1 type=del size=2507234 2024-04-03T03:46:18.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.617+0000 7f55269288c0 1 < suggested update operation key=JAXVD60NI5YW tag=SFZDBYZCB9MA type=del size=110112 2024-04-03T03:46:18.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.621+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~QJTY0NYREDMC.0 size=1048576 2024-04-03T03:46:18.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.625+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~QJTY0NYREDMC.1 size=1048576 2024-04-03T03:46:18.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.625+0000 7f55269288c0 1 > prepared part key=_multipart_KU1R0YLDP1V3.2~QJTY0NYREDMC.2 size=679655 2024-04-03T03:46:18.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.625+0000 7f55269288c0 1 > prepared multipart upload key=KU1R0YLDP1V3 upload=QJTY0NYREDMC tag=SD6JEHS1LCI0 type=write size=3825383 2024-04-03T03:46:18.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.629+0000 7f55269288c0 1 < completed write operation key=U62RSK21LJEF tag=EV7VSWUWNLNJ type=write size=924977 2024-04-03T03:46:18.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.637+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~ZRYVFXV23JZ0.0 size=1048576 2024-04-03T03:46:18.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.641+0000 7f55269288c0 1 > prepared part key=_multipart_D8W2ZKIZFI8H.2~ZRYVFXV23JZ0.1 size=44963 2024-04-03T03:46:18.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.641+0000 7f55269288c0 1 > prepared multipart upload key=D8W2ZKIZFI8H upload=ZRYVFXV23JZ0 tag=BXTLC5QHABI0 type=write size=2142115 2024-04-03T03:46:18.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.641+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~VVEKGOOYJB5A.0 size=1048576 2024-04-03T03:46:18.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.645+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~VVEKGOOYJB5A.1 size=1048576 2024-04-03T03:46:18.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.645+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~VVEKGOOYJB5A.2 size=802259 2024-04-03T03:46:18.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.653+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=VVEKGOOYJB5A tag=VUD9G7AK0LPJ type=write size=3947987 2024-04-03T03:46:18.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.653+0000 7f55269288c0 1 > prepared operation key=KDSE2XB4D1XI tag=RH95BKJ269SP type=del size=3644034 2024-04-03T03:46:18.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.657+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~YORRD6LSZH9W.0 size=1048576 2024-04-03T03:46:18.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.661+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~YORRD6LSZH9W.1 size=169829 2024-04-03T03:46:18.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.665+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=YORRD6LSZH9W tag=E8I9ANECTYYV type=write size=2266981 2024-04-03T03:46:18.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.673+0000 7f55269288c0 1 > prepared part key=_multipart_3XKXK1JXKOHU.2~8TITB3XML9YB.0 size=38745 2024-04-03T03:46:18.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.673+0000 7f55269288c0 1 > prepared multipart upload key=3XKXK1JXKOHU upload=8TITB3XML9YB tag=WOQ4033KPOJ0 type=write size=1087321 2024-04-03T03:46:18.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.673+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~U70ACR2GO9JQ.0 size=1048576 2024-04-03T03:46:18.675 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.677+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~U70ACR2GO9JQ.1 size=1048576 2024-04-03T03:46:18.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.681+0000 7f55269288c0 1 < completed part key=_multipart_8BMP0HIS520R.2~U70ACR2GO9JQ.2 size=1045725 2024-04-03T03:46:18.684 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.685+0000 7f55269288c0 1 < completed multipart upload key=8BMP0HIS520R upload=U70ACR2GO9JQ tag=0A4XOSO2DYRF type=write size=4191453 2024-04-03T03:46:18.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.689+0000 7f55269288c0 1 > prepared operation key=YCEKDT5EQD9D tag=36KIZ00YS9WY type=del size=633737 2024-04-03T03:46:18.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.693+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~SDE5R9SG4HTW.0 size=89682 2024-04-03T03:46:18.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.697+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=SDE5R9SG4HTW tag=NY240853YDNT type=write size=1138258 2024-04-03T03:46:18.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.705+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~84Y48BWRO626.0 size=362338 2024-04-03T03:46:18.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.705+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=84Y48BWRO626 tag=UANPGSZ23WDV type=write size=1410914 2024-04-03T03:46:18.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.705+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~RUJHLSB509S0.0 size=1048576 2024-04-03T03:46:18.706 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.709+0000 7f55269288c0 1 < completed part key=_multipart_IOHMF3ADC6EU.2~RUJHLSB509S0.1 size=676965 2024-04-03T03:46:18.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.713+0000 7f55269288c0 1 < completed multipart upload key=IOHMF3ADC6EU upload=RUJHLSB509S0 tag=ZR510PB30OMJ type=write size=2774117 2024-04-03T03:46:18.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.717+0000 7f55269288c0 1 > prepared operation key=0OSIL0R5ZJ54 tag=BA3PP643ND3C type=del size=2717318 2024-04-03T03:46:18.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.725+0000 7f55269288c0 1 < suggested remove operation key=ZKSA09OSFSYN tag=XBYNBFS27C9E type=del 2024-04-03T03:46:18.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.725+0000 7f55269288c0 1 > prepared operation key=XFCPX90N2NYC tag=V45ZUW2LY6NG type=write size=582544 2024-04-03T03:46:18.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.729+0000 7f55269288c0 1 < completed delete operation key=3XKXK1JXKOHU tag=S1KCMWTXG2VO type=del 2024-04-03T03:46:18.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.733+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=VOMQ2OZ45FO6 type=del size=3535710 2024-04-03T03:46:18.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.741+0000 7f55269288c0 1 < suggested remove operation key=JAXVD60NI5YW tag=DZ3HAA3L58AP type=del 2024-04-03T03:46:18.742 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.745+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~PTJN2SF0AWEN.0 size=1048576 2024-04-03T03:46:18.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.749+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~PTJN2SF0AWEN.1 size=182658 2024-04-03T03:46:18.745 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.749+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=PTJN2SF0AWEN tag=YWLNHKC63LAE type=write size=2279810 2024-04-03T03:46:18.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.753+0000 7f55269288c0 1 < completed delete operation key=AGTQQYXO7453 tag=IL9OMFTUVO74 type=del 2024-04-03T03:46:18.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.753+0000 7f55269288c0 1 > prepared operation key=LZQGL2UAWOTU tag=IYN2YR9563G6 type=del size=3087215 2024-04-03T03:46:18.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.757+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=WMY9ZCCIST56 type=del 2024-04-03T03:46:18.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.765+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~C0CIE7DSSZOL.0 size=1048576 2024-04-03T03:46:18.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.765+0000 7f55269288c0 1 > prepared part key=_multipart_6KH6TASZS3UG.2~C0CIE7DSSZOL.1 size=101403 2024-04-03T03:46:18.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.765+0000 7f55269288c0 1 > prepared multipart upload key=6KH6TASZS3UG upload=C0CIE7DSSZOL tag=R4TBQKN92H2O type=write size=2198555 2024-04-03T03:46:18.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.769+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~1XH10O52CEOY.0 size=1048576 2024-04-03T03:46:18.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.769+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~1XH10O52CEOY.1 size=1048576 2024-04-03T03:46:18.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.773+0000 7f55269288c0 1 < completed part key=_multipart_XFCPX90N2NYC.2~1XH10O52CEOY.2 size=512775 2024-04-03T03:46:18.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.777+0000 7f55269288c0 1 < completed multipart upload key=XFCPX90N2NYC upload=1XH10O52CEOY tag=A6JSONKT3EDQ type=write size=3658503 2024-04-03T03:46:18.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.781+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=2Z0RXT4RW0V4 type=del size=994180 2024-04-03T03:46:18.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.785+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~IXK5RTNTZ6XN.0 size=1048576 2024-04-03T03:46:18.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.789+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~IXK5RTNTZ6XN.1 size=1048576 2024-04-03T03:46:18.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.789+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~IXK5RTNTZ6XN.2 size=849133 2024-04-03T03:46:18.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.797+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=IXK5RTNTZ6XN tag=QEK08J65DU40 type=write size=3994861 2024-04-03T03:46:18.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.801+0000 7f55269288c0 1 > prepared operation key=7POFUQ9CX6B1 tag=UXTVOBTQFSD4 type=del size=3806462 2024-04-03T03:46:18.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.801+0000 7f55269288c0 1 < canceled part key=_multipart_IOHMF3ADC6EU.2~WGSCTW5QJTWH.0 size=997476 2024-04-03T03:46:18.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.805+0000 7f55269288c0 1 < canceled multipart upload key=IOHMF3ADC6EU upload=WGSCTW5QJTWH tag=FWFN3M4H8H7V type=write size=2046052 2024-04-03T03:46:18.809 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.813+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~LS3OZTJLMV5C.0 size=1048576 2024-04-03T03:46:18.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.813+0000 7f55269288c0 1 > prepared part key=_multipart_D9OEPPT37WSJ.2~LS3OZTJLMV5C.1 size=1035259 2024-04-03T03:46:18.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.813+0000 7f55269288c0 1 > prepared multipart upload key=D9OEPPT37WSJ upload=LS3OZTJLMV5C tag=NG6OYUBHW0GG type=write size=3132411 2024-04-03T03:46:18.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.817+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=HMV9ZLFCTQG1 type=del 2024-04-03T03:46:18.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.821+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=VWYW1MWLEM8C type=del size=2736638 2024-04-03T03:46:18.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.821+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~QJTY0NYREDMC.0 size=1048576 2024-04-03T03:46:18.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.825+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~QJTY0NYREDMC.1 size=1048576 2024-04-03T03:46:18.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.829+0000 7f55269288c0 1 < completed part key=_multipart_KU1R0YLDP1V3.2~QJTY0NYREDMC.2 size=679655 2024-04-03T03:46:18.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.833+0000 7f55269288c0 1 < completed multipart upload key=KU1R0YLDP1V3 upload=QJTY0NYREDMC tag=SD6JEHS1LCI0 type=write size=3825383 2024-04-03T03:46:18.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.837+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~2RLSLN26VX5R.0 size=1048576 2024-04-03T03:46:18.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.837+0000 7f55269288c0 1 > prepared part key=_multipart_F6IBZ80J4SDM.2~2RLSLN26VX5R.1 size=24837 2024-04-03T03:46:18.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.837+0000 7f55269288c0 1 > prepared multipart upload key=F6IBZ80J4SDM upload=2RLSLN26VX5R tag=F6M7YDQBQ3D9 type=write size=2121989 2024-04-03T03:46:18.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.841+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~ZRYVFXV23JZ0.0 size=1048576 2024-04-03T03:46:18.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.845+0000 7f55269288c0 1 < completed part key=_multipart_D8W2ZKIZFI8H.2~ZRYVFXV23JZ0.1 size=44963 2024-04-03T03:46:18.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.849+0000 7f55269288c0 1 < completed multipart upload key=D8W2ZKIZFI8H upload=ZRYVFXV23JZ0 tag=BXTLC5QHABI0 type=write size=2142115 2024-04-03T03:46:18.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.849+0000 7f55269288c0 1 > prepared operation key=KU1R0YLDP1V3 tag=2SBJNTO3S4E3 type=del size=3645432 2024-04-03T03:46:18.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.853+0000 7f55269288c0 1 < canceled operation key=KDSE2XB4D1XI tag=RH95BKJ269SP type=del size=3644034 2024-04-03T03:46:18.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.857+0000 7f55269288c0 1 > prepared operation key=JAXVD60NI5YW tag=Y9SB49TIZV7I type=del size=1948998 2024-04-03T03:46:18.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.861+0000 7f55269288c0 1 < completed part key=_multipart_3XKXK1JXKOHU.2~8TITB3XML9YB.0 size=38745 2024-04-03T03:46:18.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.865+0000 7f55269288c0 1 < completed multipart upload key=3XKXK1JXKOHU upload=8TITB3XML9YB tag=WOQ4033KPOJ0 type=write size=1087321 2024-04-03T03:46:18.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.865+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=8O3CZDKGIZSY type=del size=3460078 2024-04-03T03:46:18.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.869+0000 7f55269288c0 1 < completed delete operation key=YCEKDT5EQD9D tag=36KIZ00YS9WY type=del 2024-04-03T03:46:18.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.873+0000 7f55269288c0 1 > prepared part key=_multipart_TXFMKXUGMEA8.2~TW65XVEW42YA.0 size=204055 2024-04-03T03:46:18.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.873+0000 7f55269288c0 1 > prepared multipart upload key=TXFMKXUGMEA8 upload=TW65XVEW42YA tag=UX2LT7YXN2M6 type=write size=1252631 2024-04-03T03:46:18.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.877+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~84Y48BWRO626.0 size=362338 2024-04-03T03:46:18.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.881+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=84Y48BWRO626 tag=UANPGSZ23WDV type=write size=1410914 2024-04-03T03:46:18.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.885+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=Z02D0K3TI991 type=del size=3296333 2024-04-03T03:46:18.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.889+0000 7f55269288c0 1 < completed delete operation key=0OSIL0R5ZJ54 tag=BA3PP643ND3C type=del 2024-04-03T03:46:18.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.889+0000 7f55269288c0 1 > prepared operation key=U62RSK21LJEF tag=AHD3DI9Q4NLT type=write size=9143 2024-04-03T03:46:18.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.893+0000 7f55269288c0 1 < completed write operation key=XFCPX90N2NYC tag=V45ZUW2LY6NG type=write size=582544 2024-04-03T03:46:18.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.897+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~23HU5SYOBO50.0 size=1048576 2024-04-03T03:46:18.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.901+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~23HU5SYOBO50.1 size=1048576 2024-04-03T03:46:18.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.901+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~23HU5SYOBO50.2 size=58064 2024-04-03T03:46:18.899 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.901+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=23HU5SYOBO50 tag=NFF3ZWAWFPGA type=write size=3203792 2024-04-03T03:46:18.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.905+0000 7f55269288c0 1 < completed delete operation key=K7A1O21ZURWQ tag=VOMQ2OZ45FO6 type=del 2024-04-03T03:46:18.904 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.905+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=LYT2CGZVR7GH type=write size=469831 2024-04-03T03:46:18.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.909+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~PTJN2SF0AWEN.0 size=1048576 2024-04-03T03:46:18.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.913+0000 7f55269288c0 1 < completed part key=_multipart_JAXVD60NI5YW.2~PTJN2SF0AWEN.1 size=182658 2024-04-03T03:46:18.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.917+0000 7f55269288c0 1 < completed multipart upload key=JAXVD60NI5YW upload=PTJN2SF0AWEN tag=YWLNHKC63LAE type=write size=2279810 2024-04-03T03:46:18.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.921+0000 7f55269288c0 1 > prepared part key=_multipart_YCEKDT5EQD9D.2~332R79AEQI71.0 size=362001 2024-04-03T03:46:18.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.921+0000 7f55269288c0 1 > prepared multipart upload key=YCEKDT5EQD9D upload=332R79AEQI71 tag=GGWKGTY2VZ02 type=write size=1410577 2024-04-03T03:46:18.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.925+0000 7f55269288c0 1 < suggested remove operation key=LZQGL2UAWOTU tag=IYN2YR9563G6 type=del 2024-04-03T03:46:18.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.929+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~E7HHOAJI9I91.0 size=1048576 2024-04-03T03:46:18.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.933+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~E7HHOAJI9I91.1 size=1048576 2024-04-03T03:46:18.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.933+0000 7f55269288c0 1 > prepared part key=_multipart_TLM1C3B9J2A3.2~E7HHOAJI9I91.2 size=83417 2024-04-03T03:46:18.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.933+0000 7f55269288c0 1 > prepared multipart upload key=TLM1C3B9J2A3 upload=E7HHOAJI9I91 tag=WYRB00NEP3UH type=write size=3229145 2024-04-03T03:46:18.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.937+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~C0CIE7DSSZOL.0 size=1048576 2024-04-03T03:46:18.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.941+0000 7f55269288c0 1 < completed part key=_multipart_6KH6TASZS3UG.2~C0CIE7DSSZOL.1 size=101403 2024-04-03T03:46:18.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.945+0000 7f55269288c0 1 < completed multipart upload key=6KH6TASZS3UG upload=C0CIE7DSSZOL tag=R4TBQKN92H2O type=write size=2198555 2024-04-03T03:46:18.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.949+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~0XE3QQLDJQOP.0 size=1048576 2024-04-03T03:46:18.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.949+0000 7f55269288c0 1 > prepared part key=_multipart_AXL5RVPSVDY5.2~0XE3QQLDJQOP.1 size=353151 2024-04-03T03:46:18.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.949+0000 7f55269288c0 1 > prepared multipart upload key=AXL5RVPSVDY5 upload=0XE3QQLDJQOP tag=EWWR1E7XZWET type=write size=2450303 2024-04-03T03:46:18.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.953+0000 7f55269288c0 1 < completed delete operation key=U62RSK21LJEF tag=2Z0RXT4RW0V4 type=del 2024-04-03T03:46:18.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.957+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=TCF5QF2Q9N2B type=del size=1370161 2024-04-03T03:46:18.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.961+0000 7f55269288c0 1 < completed delete operation key=7POFUQ9CX6B1 tag=UXTVOBTQFSD4 type=del 2024-04-03T03:46:18.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.961+0000 7f55269288c0 1 > prepared operation key=ZKSA09OSFSYN tag=1O52XW361U0U type=del size=2121718 2024-04-03T03:46:18.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.965+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~LS3OZTJLMV5C.0 size=1048576 2024-04-03T03:46:18.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.965+0000 7f55269288c0 1 < completed part key=_multipart_D9OEPPT37WSJ.2~LS3OZTJLMV5C.1 size=1035259 2024-04-03T03:46:18.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.969+0000 7f55269288c0 1 < completed multipart upload key=D9OEPPT37WSJ upload=LS3OZTJLMV5C tag=NG6OYUBHW0GG type=write size=3132411 2024-04-03T03:46:18.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.973+0000 7f55269288c0 1 > prepared operation key=TLM1C3B9J2A3 tag=NF76X286WEEK type=write size=33865 2024-04-03T03:46:18.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.977+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=VWYW1MWLEM8C type=del 2024-04-03T03:46:18.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.981+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~9R6HAH3S21F4.0 size=240379 2024-04-03T03:46:18.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.981+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=9R6HAH3S21F4 tag=7V2PJR0FMSX7 type=write size=1288955 2024-04-03T03:46:18.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.981+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~2RLSLN26VX5R.0 size=1048576 2024-04-03T03:46:18.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.985+0000 7f55269288c0 1 < completed part key=_multipart_F6IBZ80J4SDM.2~2RLSLN26VX5R.1 size=24837 2024-04-03T03:46:18.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.989+0000 7f55269288c0 1 < completed multipart upload key=F6IBZ80J4SDM upload=2RLSLN26VX5R tag=F6M7YDQBQ3D9 type=write size=2121989 2024-04-03T03:46:18.991 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.993+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~J5GU011AH3K7.0 size=1048576 2024-04-03T03:46:18.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.997+0000 7f55269288c0 1 > prepared part key=_multipart_8SBTVHL09P63.2~J5GU011AH3K7.1 size=404513 2024-04-03T03:46:18.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.997+0000 7f55269288c0 1 > prepared multipart upload key=8SBTVHL09P63 upload=J5GU011AH3K7 tag=UG1BN9CU45EE type=write size=2501665 2024-04-03T03:46:18.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:18.997+0000 7f55269288c0 1 < completed delete operation key=KU1R0YLDP1V3 tag=2SBJNTO3S4E3 type=del 2024-04-03T03:46:18.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.001+0000 7f55269288c0 1 > prepared operation key=6KH6TASZS3UG tag=OKH1SZ629XMR type=del size=390790 2024-04-03T03:46:19.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.005+0000 7f55269288c0 1 < completed delete operation key=JAXVD60NI5YW tag=Y9SB49TIZV7I type=del 2024-04-03T03:46:19.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.009+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~P48VGRXWNH7A.0 size=1048576 2024-04-03T03:46:19.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.009+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~P48VGRXWNH7A.1 size=1048576 2024-04-03T03:46:19.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.013+0000 7f55269288c0 1 > prepared part key=_multipart_ZKSA09OSFSYN.2~P48VGRXWNH7A.2 size=701136 2024-04-03T03:46:19.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.013+0000 7f55269288c0 1 > prepared multipart upload key=ZKSA09OSFSYN upload=P48VGRXWNH7A tag=MLRQC5BVWL3G type=write size=3846864 2024-04-03T03:46:19.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.017+0000 7f55269288c0 1 < completed delete operation key=SFN1M3HPGT18 tag=8O3CZDKGIZSY type=del 2024-04-03T03:46:19.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.021+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~SRB5H9XB33OJ.0 size=214822 2024-04-03T03:46:19.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.021+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=SRB5H9XB33OJ tag=03FY4AG25GPF type=write size=1263398 2024-04-03T03:46:19.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.021+0000 7f55269288c0 1 < completed part key=_multipart_TXFMKXUGMEA8.2~TW65XVEW42YA.0 size=204055 2024-04-03T03:46:19.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.025+0000 7f55269288c0 1 < completed multipart upload key=TXFMKXUGMEA8 upload=TW65XVEW42YA tag=UX2LT7YXN2M6 type=write size=1252631 2024-04-03T03:46:19.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.029+0000 7f55269288c0 1 > prepared operation key=Z42NDVEX1SOL tag=ZTQP6I53ADMP type=del size=4038091 2024-04-03T03:46:19.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.033+0000 7f55269288c0 1 < completed delete operation key=MB7HTWATXRMB tag=Z02D0K3TI991 type=del 2024-04-03T03:46:19.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.033+0000 7f55269288c0 1 > prepared operation key=SFN1M3HPGT18 tag=RGS403Z4CH80 type=del size=2783859 2024-04-03T03:46:19.033 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.037+0000 7f55269288c0 1 < completed write operation key=U62RSK21LJEF tag=AHD3DI9Q4NLT type=write size=9143 2024-04-03T03:46:19.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.037+0000 7f55269288c0 1 > prepared operation key=CPR27NMHPIPQ tag=70N4S4CNMC45 type=del size=3001416 2024-04-03T03:46:19.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.045+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~23HU5SYOBO50.0 size=1048576 2024-04-03T03:46:19.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.045+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~23HU5SYOBO50.1 size=1048576 2024-04-03T03:46:19.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.049+0000 7f55269288c0 1 < completed part key=_multipart_K7A1O21ZURWQ.2~23HU5SYOBO50.2 size=58064 2024-04-03T03:46:19.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.053+0000 7f55269288c0 1 < completed multipart upload key=K7A1O21ZURWQ upload=23HU5SYOBO50 tag=NFF3ZWAWFPGA type=write size=3203792 2024-04-03T03:46:19.052 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.057+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~YAKXVN2BID03.0 size=1048576 2024-04-03T03:46:19.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.057+0000 7f55269288c0 1 > prepared part key=_multipart_IOHMF3ADC6EU.2~YAKXVN2BID03.1 size=599341 2024-04-03T03:46:19.054 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.057+0000 7f55269288c0 1 > prepared multipart upload key=IOHMF3ADC6EU upload=YAKXVN2BID03 tag=48F069J1XSHR type=write size=2696493 2024-04-03T03:46:19.057 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.061+0000 7f55269288c0 1 < canceled operation key=Z42NDVEX1SOL tag=LYT2CGZVR7GH type=write size=469831 2024-04-03T03:46:19.060 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.065+0000 7f55269288c0 1 > prepared operation key=IOHMF3ADC6EU tag=I30E991FMVQ2 type=del size=1577060 2024-04-03T03:46:19.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.065+0000 7f55269288c0 1 < canceled part key=_multipart_YCEKDT5EQD9D.2~332R79AEQI71.0 size=362001 2024-04-03T03:46:19.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.069+0000 7f55269288c0 1 < canceled multipart upload key=YCEKDT5EQD9D upload=332R79AEQI71 tag=GGWKGTY2VZ02 type=write size=1410577 2024-04-03T03:46:19.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.069+0000 7f55269288c0 1 > prepared operation key=F6IBZ80J4SDM tag=4022PJPK7XCW type=del size=207672 2024-04-03T03:46:19.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.073+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~E7HHOAJI9I91.0 size=1048576 2024-04-03T03:46:19.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.073+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~E7HHOAJI9I91.1 size=1048576 2024-04-03T03:46:19.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.077+0000 7f55269288c0 1 < completed part key=_multipart_TLM1C3B9J2A3.2~E7HHOAJI9I91.2 size=83417 2024-04-03T03:46:19.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.081+0000 7f55269288c0 1 < completed multipart upload key=TLM1C3B9J2A3 upload=E7HHOAJI9I91 tag=WYRB00NEP3UH type=write size=3229145 2024-04-03T03:46:19.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.085+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~YIWULOA0MRQS.0 size=1048576 2024-04-03T03:46:19.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.085+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~YIWULOA0MRQS.1 size=1048576 2024-04-03T03:46:19.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.089+0000 7f55269288c0 1 > prepared part key=_multipart_JAXVD60NI5YW.2~YIWULOA0MRQS.2 size=523985 2024-04-03T03:46:19.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.089+0000 7f55269288c0 1 > prepared multipart upload key=JAXVD60NI5YW upload=YIWULOA0MRQS tag=MVR8CQIJO4KZ type=write size=3669713 2024-04-03T03:46:19.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.089+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~0XE3QQLDJQOP.0 size=1048576 2024-04-03T03:46:19.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.093+0000 7f55269288c0 1 < completed part key=_multipart_AXL5RVPSVDY5.2~0XE3QQLDJQOP.1 size=353151 2024-04-03T03:46:19.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.097+0000 7f55269288c0 1 < completed multipart upload key=AXL5RVPSVDY5 upload=0XE3QQLDJQOP tag=EWWR1E7XZWET type=write size=2450303 2024-04-03T03:46:19.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.097+0000 7f55269288c0 1 > prepared operation key=K7A1O21ZURWQ tag=8W332CJ1XJT2 type=del size=1174280 2024-04-03T03:46:19.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.101+0000 7f55269288c0 1 < suggested remove operation key=MB7HTWATXRMB tag=TCF5QF2Q9N2B type=del 2024-04-03T03:46:19.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.105+0000 7f55269288c0 1 > prepared operation key=D8W2ZKIZFI8H tag=5JYN04MS1QTU type=del size=3543735 2024-04-03T03:46:19.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.105+0000 7f55269288c0 1 < completed delete operation key=ZKSA09OSFSYN tag=1O52XW361U0U type=del 2024-04-03T03:46:19.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.109+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~U1VK5TNCWGZ5.0 size=1048576 2024-04-03T03:46:19.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.113+0000 7f55269288c0 1 > prepared part key=_multipart_Z42NDVEX1SOL.2~U1VK5TNCWGZ5.1 size=701772 2024-04-03T03:46:19.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.113+0000 7f55269288c0 1 > prepared multipart upload key=Z42NDVEX1SOL upload=U1VK5TNCWGZ5 tag=2BQGSRTJFKM5 type=write size=2798924 2024-04-03T03:46:19.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.117+0000 7f55269288c0 1 < completed write operation key=TLM1C3B9J2A3 tag=NF76X286WEEK type=write size=33865 2024-04-03T03:46:19.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.121+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~GN0G1S7UQWZ8.0 size=1048576 2024-04-03T03:46:19.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.121+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~GN0G1S7UQWZ8.1 size=1048576 2024-04-03T03:46:19.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.125+0000 7f55269288c0 1 > prepared part key=_multipart_0OSIL0R5ZJ54.2~GN0G1S7UQWZ8.2 size=559730 2024-04-03T03:46:19.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.125+0000 7f55269288c0 1 > prepared multipart upload key=0OSIL0R5ZJ54 upload=GN0G1S7UQWZ8 tag=H4Y8W9U9GRRA type=write size=3705458 2024-04-03T03:46:19.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.125+0000 7f55269288c0 1 < completed part key=_multipart_0OSIL0R5ZJ54.2~9R6HAH3S21F4.0 size=240379 2024-04-03T03:46:19.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.129+0000 7f55269288c0 1 < completed multipart upload key=0OSIL0R5ZJ54 upload=9R6HAH3S21F4 tag=7V2PJR0FMSX7 type=write size=1288955 2024-04-03T03:46:19.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.133+0000 7f55269288c0 1 > prepared operation key=B5BI0HJ5S1Y1 tag=XFCTIB72J1VN type=write size=150542 2024-04-03T03:46:19.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.133+0000 7f55269288c0 1 < canceled part key=_multipart_8SBTVHL09P63.2~J5GU011AH3K7.0 size=1048576 2024-04-03T03:46:19.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.137+0000 7f55269288c0 1 < completed part key=_multipart_8SBTVHL09P63.2~J5GU011AH3K7.1 size=404513 2024-04-03T03:46:19.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.141+0000 7f55269288c0 1 < canceled multipart upload key=8SBTVHL09P63 upload=J5GU011AH3K7 tag=UG1BN9CU45EE type=write size=2501665 2024-04-03T03:46:19.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.141+0000 7f55269288c0 1 > prepared operation key=AGTQQYXO7453 tag=AI7I8UFDZ2G9 type=del size=598580 2024-04-03T03:46:19.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.145+0000 7f55269288c0 1 < completed delete operation key=6KH6TASZS3UG tag=OKH1SZ629XMR type=del 2024-04-03T03:46:19.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.149+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~4Z1LBG4T9R1U.0 size=1048576 2024-04-03T03:46:19.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.149+0000 7f55269288c0 1 > prepared part key=_multipart_K3Z9W19WEJBM.2~4Z1LBG4T9R1U.1 size=371436 2024-04-03T03:46:19.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.149+0000 7f55269288c0 1 > prepared multipart upload key=K3Z9W19WEJBM upload=4Z1LBG4T9R1U tag=UW0YCC8D85HO type=write size=2468588 2024-04-03T03:46:19.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.153+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~P48VGRXWNH7A.0 size=1048576 2024-04-03T03:46:19.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.153+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~P48VGRXWNH7A.1 size=1048576 2024-04-03T03:46:19.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.157+0000 7f55269288c0 1 < completed part key=_multipart_ZKSA09OSFSYN.2~P48VGRXWNH7A.2 size=701136 2024-04-03T03:46:19.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.161+0000 7f55269288c0 1 < completed multipart upload key=ZKSA09OSFSYN upload=P48VGRXWNH7A tag=MLRQC5BVWL3G type=write size=3846864 2024-04-03T03:46:19.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.165+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~966FA31XEH2E.0 size=1048576 2024-04-03T03:46:19.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.165+0000 7f55269288c0 1 > prepared part key=_multipart_K7A1O21ZURWQ.2~966FA31XEH2E.1 size=835657 2024-04-03T03:46:19.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.165+0000 7f55269288c0 1 > prepared multipart upload key=K7A1O21ZURWQ upload=966FA31XEH2E tag=HE520PA3RN7H type=write size=2932809 2024-04-03T03:46:19.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.169+0000 7f55269288c0 1 < completed part key=_multipart_K3Z9W19WEJBM.2~SRB5H9XB33OJ.0 size=214822 2024-04-03T03:46:19.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.169+0000 7f55269288c0 1 < completed multipart upload key=K3Z9W19WEJBM upload=SRB5H9XB33OJ tag=03FY4AG25GPF type=write size=1263398 2024-04-03T03:46:19.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:46:19.173+0000 7f55269288c0 1 > prepared operation key=MB7HTWATXRMB tag=DEAIKZ6D5D72 type=del size=3682899 2024-04-03T03:46:19.170 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] cls_rgw_stats.simulate (20192 ms) 2024-04-03T03:46:19.170 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 1 test from cls_rgw_stats (20192 ms total) 2024-04-03T03:46:19.171 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:46:19.171 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:46:19.870 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 1 test from 1 test suite ran. (22755 ms total) 2024-04-03T03:46:19.870 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 1 test. 2024-04-03T03:46:19.876 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:46:19.877 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:46:19.933 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-04-03T03:46:19.934 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-04-03T03:46:19.934 DEBUG:teuthology.orchestra.run.smithi104:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-04-03T03:46:19.998 INFO:tasks.workunit.client.0.smithi104.stdout:Running main() from gmock_main.cc 2024-04-03T03:46:19.998 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 31 tests from 1 test suite. 2024-04-03T03:46:19.998 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:46:21.916 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 31 tests from CmpOmap 2024-04-03T03:46:21.916 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-04-03T03:46:21.922 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (6 ms) 2024-04-03T03:46:21.922 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-04-03T03:46:21.933 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (11 ms) 2024-04-03T03:46:21.933 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-04-03T03:46:21.939 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (6 ms) 2024-04-03T03:46:21.939 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-04-03T03:46:22.148 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (209 ms) 2024-04-03T03:46:22.148 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-04-03T03:46:22.171 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_str (23 ms) 2024-04-03T03:46:22.171 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-04-03T03:46:22.186 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_u64 (15 ms) 2024-04-03T03:46:22.186 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-04-03T03:46:22.194 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (8 ms) 2024-04-03T03:46:22.194 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-04-03T03:46:22.204 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (10 ms) 2024-04-03T03:46:22.204 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-04-03T03:46:22.213 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (9 ms) 2024-04-03T03:46:22.213 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-04-03T03:46:22.226 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (13 ms) 2024-04-03T03:46:22.226 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-04-03T03:46:22.228 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-04-03T03:46:22.228 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-04-03T03:46:22.230 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-04-03T03:46:22.230 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-04-03T03:46:22.247 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (17 ms) 2024-04-03T03:46:22.247 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-04-03T03:46:22.266 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (18 ms) 2024-04-03T03:46:22.266 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-04-03T03:46:22.284 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (19 ms) 2024-04-03T03:46:22.285 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-04-03T03:46:22.301 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (17 ms) 2024-04-03T03:46:22.301 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-04-03T03:46:22.322 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-04-03T03:46:22.322 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-04-03T03:46:22.345 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (23 ms) 2024-04-03T03:46:22.345 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-04-03T03:46:22.351 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (6 ms) 2024-04-03T03:46:22.351 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-04-03T03:46:22.358 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-04-03T03:46:22.358 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-04-03T03:46:22.361 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-04-03T03:46:22.361 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-04-03T03:46:22.363 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-04-03T03:46:22.364 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-04-03T03:46:22.380 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (17 ms) 2024-04-03T03:46:22.380 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-04-03T03:46:22.397 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (17 ms) 2024-04-03T03:46:22.397 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-04-03T03:46:22.417 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (20 ms) 2024-04-03T03:46:22.417 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-04-03T03:46:22.438 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (21 ms) 2024-04-03T03:46:22.438 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-04-03T03:46:22.443 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (5 ms) 2024-04-03T03:46:22.443 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-04-03T03:46:22.451 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (8 ms) 2024-04-03T03:46:22.451 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-04-03T03:46:22.454 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-04-03T03:46:22.454 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-04-03T03:46:22.456 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-04-03T03:46:22.456 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-04-03T03:46:22.474 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (19 ms) 2024-04-03T03:46:22.475 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 31 tests from CmpOmap (559 ms total) 2024-04-03T03:46:22.475 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:46:22.475 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:46:22.928 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 31 tests from 1 test suite ran. (2930 ms total) 2024-04-03T03:46:22.928 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 31 tests. 2024-04-03T03:46:22.935 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:46:22.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:46:22.992 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-04-03T03:46:22.993 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-04-03T03:46:22.993 DEBUG:teuthology.orchestra.run.smithi104:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-04-03T03:46:23.059 INFO:tasks.workunit.client.0.smithi104.stdout:Running main() from gmock_main.cc 2024-04-03T03:46:23.059 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 24 tests from 1 test suite. 2024-04-03T03:46:23.059 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:46:23.059 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 24 tests from TestCls2PCQueue 2024-04-03T03:46:23.060 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-04-03T03:46:25.936 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2877 ms) 2024-04-03T03:46:25.936 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-04-03T03:46:28.994 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3058 ms) 2024-04-03T03:46:28.994 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-04-03T03:46:32.056 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.Reserve (3063 ms) 2024-04-03T03:46:32.056 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-04-03T03:46:35.100 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3039 ms) 2024-04-03T03:46:35.100 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-04-03T03:46:39.138 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.Commit (4043 ms) 2024-04-03T03:46:39.139 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-04-03T03:46:43.185 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.Stats (4046 ms) 2024-04-03T03:46:43.185 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-04-03T03:46:47.231 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4041 ms) 2024-04-03T03:46:47.231 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-04-03T03:46:50.254 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.Abort (3029 ms) 2024-04-03T03:46:50.255 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-04-03T03:46:53.287 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.ReserveError (3029 ms) 2024-04-03T03:46:53.287 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-04-03T03:46:56.340 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.CommitError (3057 ms) 2024-04-03T03:46:56.340 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-04-03T03:46:59.381 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.AbortError (3041 ms) 2024-04-03T03:46:59.381 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-04-03T03:47:02.430 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3049 ms) 2024-04-03T03:47:02.430 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-04-03T03:47:05.440 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3010 ms) 2024-04-03T03:47:05.440 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-04-03T03:47:08.490 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3051 ms) 2024-04-03T03:47:08.491 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-04-03T03:47:11.514 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3023 ms) 2024-04-03T03:47:11.514 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-04-03T03:47:14.582 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3068 ms) 2024-04-03T03:47:14.583 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-04-03T03:47:17.586 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3005 ms) 2024-04-03T03:47:17.587 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-04-03T03:47:20.655 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.Cleanup (3069 ms) 2024-04-03T03:47:20.655 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-04-03T03:47:32.894 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12236 ms) 2024-04-03T03:47:32.894 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-04-03T03:47:37.955 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5064 ms) 2024-04-03T03:47:37.955 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-04-03T03:47:50.997 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13041 ms) 2024-04-03T03:47:50.997 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-04-03T03:47:57.899 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6902 ms) 2024-04-03T03:47:57.899 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-04-03T03:48:07.941 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10043 ms) 2024-04-03T03:48:07.942 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-04-03T03:48:18.011 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10070 ms) 2024-04-03T03:48:18.011 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 24 tests from TestCls2PCQueue (114956 ms total) 2024-04-03T03:48:18.012 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:18.012 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:18.012 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 24 tests from 1 test suite ran. (114956 ms total) 2024-04-03T03:48:18.012 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 24 tests. 2024-04-03T03:48:18.018 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:48:18.018 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:48:18.078 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-04-03T03:48:18.080 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-04-03T03:48:18.080 DEBUG:teuthology.orchestra.run.smithi104:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-04-03T03:48:18.152 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:18.153 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:18.153 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 6 tests from 1 test suite. 2024-04-03T03:48:18.153 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:20.035 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 6 tests from rgw_gc_log 2024-04-03T03:48:20.035 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-04-03T03:48:20.054 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] rgw_gc_log.init_existing_queue (20 ms) 2024-04-03T03:48:20.055 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-04-03T03:48:20.065 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] rgw_gc_log.init_existing_omap (11 ms) 2024-04-03T03:48:20.065 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-04-03T03:48:20.070 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (5 ms) 2024-04-03T03:48:20.070 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-04-03T03:48:20.073 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-04-03T03:48:20.073 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-04-03T03:48:20.079 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] rgw_gc_log.defer1_after_init (5 ms) 2024-04-03T03:48:20.079 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-04-03T03:48:20.080 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-04-03T03:48:20.080 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 6 tests from rgw_gc_log (46 ms total) 2024-04-03T03:48:20.080 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:20.080 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:21.040 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 6 tests from 1 test suite ran. (2888 ms total) 2024-04-03T03:48:21.040 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 6 tests. 2024-04-03T03:48:21.046 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:48:21.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:48:21.102 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-04-03T03:48:21.103 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-04-03T03:48:21.103 DEBUG:teuthology.orchestra.run.smithi104:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-04-03T03:48:21.173 INFO:tasks.workunit.client.0.smithi104.stdout:Running main() from gmock_main.cc 2024-04-03T03:48:21.173 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-03T03:48:21.173 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 4 tests from TestRGWObj 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestRGWObj.underscore 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns= i= 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns= i= 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns= i= 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.174 INFO:tasks.workunit.client.0.smithi104.stdout: "obj1": { 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.175 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "obj2": { 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.176 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.177 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.177 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.177 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.177 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.177 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.177 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3": { 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.178 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3-2": { 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.179 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns=ns i= 2024-04-03T03:48:21.180 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns=ns i= 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns=ns i= 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout: "obj1": { 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.181 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "obj2": { 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.182 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.183 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3": { 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.184 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3-2": { 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.185 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns= i=v1 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.186 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns= i=v1 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns= i=v1 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "obj1": { 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.187 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "obj2": { 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.188 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3": { 2024-04-03T03:48:21.189 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.190 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3-2": { 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.191 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns=ns i=v1 2024-04-03T03:48:21.192 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns=ns i=v1 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: _obj[v1] 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: _obj ns=ns i=v1 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout: "obj1": { 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.193 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: "obj2": { 2024-04-03T03:48:21.194 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.195 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3": { 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.196 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3-2": { 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.197 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_obj", 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestRGWObj.no_underscore 2024-04-03T03:48:21.198 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns= i= 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns= i= 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns= i= 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout: "obj1": { 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.199 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.200 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "obj2": { 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.201 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3": { 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.202 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3-2": { 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.203 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.204 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns=ns i= 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns=ns i= 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns=ns i= 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout: "obj1": { 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.205 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "obj2": { 2024-04-03T03:48:21.206 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.207 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3": { 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.208 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3-2": { 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.209 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns= i=v1 2024-04-03T03:48:21.210 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns= i=v1 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns= i=v1 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout: "obj1": { 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.211 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "obj2": { 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.212 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.213 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3": { 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.214 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3-2": { 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.215 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns=ns i=v1 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns=ns i=v1 2024-04-03T03:48:21.216 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout:parsed: obj[v1] 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout:stripped: obj ns=ns i=v1 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "obj1": { 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.217 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "obj2": { 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.218 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3": { 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.219 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.220 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "obj3-2": { 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.221 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "obj", 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "v1", 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.222 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.223 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.224 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker_myobj", 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.225 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.226 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.227 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.228 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker_myobj", 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.229 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.230 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.231 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.232 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns_myobj", 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.233 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.234 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.235 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.236 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.237 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns_myobj", 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.238 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.239 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.240 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.241 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst_myobj", 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.242 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.243 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.244 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.245 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst_myobj", 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.246 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.247 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.248 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.249 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.250 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst_myobj", 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.251 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.252 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.253 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.254 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst_myobj", 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.255 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.256 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.257 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.258 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker___myobj", 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj" 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.259 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.260 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.261 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.262 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.263 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker___myobj", 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj" 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.264 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.265 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.266 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.267 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns__myobj", 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.268 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.269 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.270 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.271 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns__myobj", 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.272 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.273 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.274 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.275 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst__myobj", 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj" 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.276 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.277 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.278 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.279 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst__myobj", 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj" 2024-04-03T03:48:21.280 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.281 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.282 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.283 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.284 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst__myobj", 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.285 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.286 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.287 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.288 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst__myobj", 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.289 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.290 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.291 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.292 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker___myobj_", 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj_" 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.293 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.294 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.295 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.296 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker___myobj_", 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj_" 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.297 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.298 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.299 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.300 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns__myobj_", 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.301 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.302 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.303 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.304 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns__myobj_", 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.305 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.306 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.307 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.308 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst__myobj_", 2024-04-03T03:48:21.309 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj_" 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.310 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.311 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.312 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.313 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst__myobj_", 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj_" 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.314 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.315 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.316 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.317 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": "default-placement.data", 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst__myobj_", 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "test", 2024-04-03T03:48:21.318 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": "", 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": "" 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.319 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.320 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "obj": { 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.321 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst__myobj_", 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.322 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.323 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker_myobj", 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.324 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.325 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker_myobj 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker_myobj", 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.326 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.327 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker_myobj 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns_myobj", 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.328 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.329 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker__ns_myobj 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns_myobj", 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.330 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.331 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker__ns_myobj 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst_myobj", 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.332 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.333 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker__:inst_myobj 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst_myobj", 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.334 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.335 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker__:inst_myobj 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst_myobj", 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.336 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.337 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst_myobj", 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.338 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "myobj", 2024-04-03T03:48:21.339 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker___myobj", 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj" 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.340 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.341 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker___myobj 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker___myobj", 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj" 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.342 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.343 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker___myobj 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns__myobj", 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.344 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.345 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker__ns__myobj 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns__myobj", 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.346 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.347 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker__ns__myobj 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst__myobj", 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj" 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.348 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.349 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker__:inst__myobj 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst__myobj", 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj" 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.350 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.351 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker__:inst__myobj 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst__myobj", 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.352 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.353 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst__myobj", 2024-04-03T03:48:21.354 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.355 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj", 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.356 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker___myobj_", 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj_" 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.357 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker___myobj_ 2024-04-03T03:48:21.358 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker___myobj_", 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj_" 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.359 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.360 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker___myobj_ 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns__myobj_", 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.361 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.362 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker__ns__myobj_ 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns__myobj_", 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.363 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "", 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.364 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst__myobj_", 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj_" 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.365 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-04-03T03:48:21.366 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__:inst__myobj_", 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "marker__myobj_" 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.367 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "" 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.368 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj": { 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst__myobj_", 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj": { 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.369 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: "raw_obj2": { 2024-04-03T03:48:21.370 INFO:tasks.workunit.client.0.smithi104.stdout: "pool": ".data-pool", 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "oid": "marker__ns:inst__myobj_", 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "loc": "" 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "new_obj2": { 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket": { 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "ebtest", 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "marker": "marker", 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_id": "bucket-id", 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "tenant": "", 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "explicit_placement": { 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "data_pool": ".data-pool", 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "data_extra_pool": "", 2024-04-03T03:48:21.371 INFO:tasks.workunit.client.0.smithi104.stdout: "index_pool": ".index-pool" 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout: "key": { 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout: "name": "_myobj_", 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout: "instance": "inst", 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout: "ns": "ns" 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:21.372 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:21.373 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-04-03T03:48:21.373 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 4 tests. 2024-04-03T03:48:21.374 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:48:21.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:48:21.430 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-04-03T03:48:21.431 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-04-03T03:48:21.431 DEBUG:teuthology.orchestra.run.smithi104:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-04-03T03:48:21.532 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:21.532 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:21.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.592+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.592+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.592+0000 7f956d984980 20 realm 2024-04-03T03:48:21.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.592+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.592+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.592+0000 7f956d984980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:48:21.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.592+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.592+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.592+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.596+0000 7f956d984980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:48:21.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.596+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.596+0000 7f956d984980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:48:21.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.596+0000 7f956d984980 20 searching for the correct realm 2024-04-03T03:48:21.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.612+0000 7f956bca0640 0 -- 172.21.15.104:0/2986977880 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f955c024070 msgr2=0x7f955c064920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:48:21.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.632+0000 7f956ac9e640 0 -- 172.21.15.104:0/2986977880 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f955c066560 msgr2=0x7f955c016410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:48:21.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.848+0000 7f956d984980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:48:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.848+0000 7f956d984980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:48:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.848+0000 7f956d984980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:48:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.848+0000 7f956d984980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:48:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.848+0000 7f956d984980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:48:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.848+0000 7f956d984980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:48:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.848+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.848+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.848+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:48:21.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:48:21.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 zone default found 2024-04-03T03:48:21.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 4 Realm: () 2024-04-03T03:48:21.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:48:21.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:48:21.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:48:21.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 zonegroup default 2024-04-03T03:48:21.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.852+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.856+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.856+0000 7f956d984980 20 started sync module instance, tier type = 2024-04-03T03:48:21.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.856+0000 7f956d984980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:48:21.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.880+0000 7f956d984980 20 add_watcher() i=0 2024-04-03T03:48:21.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.880+0000 7f956d984980 20 add_watcher() i=1 2024-04-03T03:48:21.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.880+0000 7f956d984980 20 add_watcher() i=2 2024-04-03T03:48:21.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.880+0000 7f956d984980 20 add_watcher() i=3 2024-04-03T03:48:21.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.880+0000 7f956d984980 20 add_watcher() i=4 2024-04-03T03:48:21.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.880+0000 7f956d984980 20 add_watcher() i=5 2024-04-03T03:48:21.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.880+0000 7f956d984980 20 add_watcher() i=6 2024-04-03T03:48:21.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.880+0000 7f956d984980 20 add_watcher() i=7 2024-04-03T03:48:21.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.880+0000 7f956d984980 2 all 8 watchers are set, enabling cache 2024-04-03T03:48:21.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f9421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:48:21.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:48:21.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:48:21.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 5 note: GC not initialized 2024-04-03T03:48:21.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f9420fe1640 20 reqs_thread_entry: start 2024-04-03T03:48:21.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 20 init_complete bucket index max shards: 11 2024-04-03T03:48:21.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 20 Filter name: none 2024-04-03T03:48:21.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f939a7fc640 20 reqs_thread_entry: start 2024-04-03T03:48:21.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-04-03T03:48:21.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-04-03T03:48:21.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-04-03T03:48:21.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-04-03T03:48:21.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.888+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-04-03T03:48:21.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-04-03T03:48:21.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 10 cache get: name=default.rgw.meta+users.keys+4DngUoUMo3J696Sic/rEOoJJQbc= : miss 2024-04-03T03:48:21.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 20 rados->read ofs=0 len=0 2024-04-03T03:48:21.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:21.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 10 cache put: name=default.rgw.meta+users.keys+4DngUoUMo3J696Sic/rEOoJJQbc= info.flags=0x0 2024-04-03T03:48:21.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 10 adding default.rgw.meta+users.keys+4DngUoUMo3J696Sic/rEOoJJQbc= to cache LRU end 2024-04-03T03:48:21.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 10 cache get: name=default.rgw.meta+users.keys+4DngUoUMo3J696Sic/rEOoJJQbc= : hit (negative entry) 2024-04-03T03:48:21.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.892+0000 7f956d984980 10 cache get: name=default.rgw.meta+users.keys+4DngUoUMo3J696Sic/rEOoJJQbc= : hit (negative entry) 2024-04-03T03:48:21.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.896+0000 7f956d984980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-04-03T03:48:21.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.896+0000 7f956d984980 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-04-03T03:48:21.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.896+0000 7f956d984980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-04-03T03:48:21.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.896+0000 7f944effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856705 cookie 94661350932944 notifier 5279 bl.length()=664 2024-04-03T03:48:21.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.896+0000 7f944effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-04-03T03:48:21.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.896+0000 7f944effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-04-03T03:48:21.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.900+0000 7f956d984980 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-04-03T03:48:21.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.900+0000 7f956d984980 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-04-03T03:48:21.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.900+0000 7f956d984980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-04-03T03:48:21.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.904+0000 7f944effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856704 cookie 94661350929344 notifier 5279 bl.length()=194 2024-04-03T03:48:21.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.904+0000 7f944effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-04-03T03:48:21.897 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.904+0000 7f944effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-04-03T03:48:21.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.908+0000 7f956d984980 10 cache put: name=default.rgw.meta+users.keys+4DngUoUMo3J696Sic/rEOoJJQbc= info.flags=0x7 2024-04-03T03:48:21.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.908+0000 7f956d984980 10 moving default.rgw.meta+users.keys+4DngUoUMo3J696Sic/rEOoJJQbc= to cache LRU end 2024-04-03T03:48:21.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.908+0000 7f956d984980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:4DngUoUMo3J696Sic/rEOoJJQbc=, ofs0, ns] 2024-04-03T03:48:21.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.908+0000 7f944effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856704 cookie 94661350940608 notifier 5279 bl.length()=203 2024-04-03T03:48:21.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.908+0000 7f944effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+4DngUoUMo3J696Sic/rEOoJJQbc= info.flags=0x7 2024-04-03T03:48:21.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.908+0000 7f944effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+4DngUoUMo3J696Sic/rEOoJJQbc= to cache LRU end 2024-04-03T03:48:21.904 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:21.904 INFO:tasks.workunit.client.0.smithi104.stdout: "user_id": "ceph-test-librgw-file", 2024-04-03T03:48:21.904 INFO:tasks.workunit.client.0.smithi104.stdout: "display_name": "librgw test user", 2024-04-03T03:48:21.904 INFO:tasks.workunit.client.0.smithi104.stdout: "email": "librgw@example.com", 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "suspended": 0, 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "max_buckets": 1000, 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "subusers": [], 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "keys": [ 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: { 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "user": "ceph-test-librgw-file", 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "access_key": "4DngUoUMo3J696Sic/rEOoJJQbc=", 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "secret_key": "bLSQFX3AJCmo1hzUJazCcWb0c6qMlQFaRSh/JVPIuBD3+Alk6zTElA==", 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "active": true 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: ], 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "swift_keys": [], 2024-04-03T03:48:21.905 INFO:tasks.workunit.client.0.smithi104.stdout: "caps": [], 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "default_placement": "", 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "default_storage_class": "", 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "placement_tags": [], 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_quota": { 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "enabled": false, 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size": -1, 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "max_objects": -1 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "user_quota": { 2024-04-03T03:48:21.906 INFO:tasks.workunit.client.0.smithi104.stdout: "enabled": false, 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size": -1, 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout: "max_objects": -1 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout: "temp_url_keys": [], 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout: "type": "rgw", 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout: "mfa_ids": [] 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:21.907 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:21.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.912+0000 7f9421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:48:21.911 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.916+0000 7f956d984980 20 remove_watcher() i=0 2024-04-03T03:48:21.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.916+0000 7f956d984980 2 removed watcher, disabling cache 2024-04-03T03:48:21.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.920+0000 7f956d984980 20 remove_watcher() i=1 2024-04-03T03:48:21.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.924+0000 7f956d984980 20 remove_watcher() i=2 2024-04-03T03:48:21.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.924+0000 7f956d984980 20 remove_watcher() i=3 2024-04-03T03:48:21.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.928+0000 7f956d984980 20 remove_watcher() i=4 2024-04-03T03:48:21.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.928+0000 7f956d984980 20 remove_watcher() i=5 2024-04-03T03:48:21.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.928+0000 7f956d984980 20 remove_watcher() i=6 2024-04-03T03:48:21.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:21.932+0000 7f956d984980 20 remove_watcher() i=7 2024-04-03T03:48:21.938 INFO:tasks.workunit.client.0.smithi104.stdout:phase 1.1 2024-04-03T03:48:21.958 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 24 tests from 1 test suite. 2024-04-03T03:48:21.958 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:21.958 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 24 tests from LibRGW 2024-04-03T03:48:21.958 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:21.971 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:21.971 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:22.346 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-04-03T03:48:22.346 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-04-03T03:48:22.349 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-04-03T03:48:22.349 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:22.349 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-04-03T03:48:22.349 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-04-03T03:48:22.372 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/baz/quux 2024-04-03T03:48:22.380 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/f1 2024-04-03T03:48:22.386 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/f2 2024-04-03T03:48:22.391 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/f1 2024-04-03T03:48:22.397 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/d1/ 2024-04-03T03:48:22.401 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-04-03T03:48:22.406 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-04-03T03:48:22.412 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/baz/momma 2024-04-03T03:48:22.418 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-04-03T03:48:22.424 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-04-03T03:48:22.429 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-04-03T03:48:22.436 INFO:tasks.workunit.client.0.smithi104.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-04-03T03:48:22.442 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SETUP_HIER1 (93 ms) 2024-04-03T03:48:22.442 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-04-03T03:48:22.745 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SETUP_DIRS1 (303 ms) 2024-04-03T03:48:22.745 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SETATTR 2024-04-03T03:48:22.746 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-04-03T03:48:22.746 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-04-03T03:48:22.794 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (49 ms) 2024-04-03T03:48:22.794 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-04-03T03:48:22.915 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (121 ms) 2024-04-03T03:48:22.915 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-04-03T03:48:22.915 INFO:tasks.workunit.client.0.smithi104.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-04-03T03:48:22.934 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (18 ms) 2024-04-03T03:48:22.934 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-04-03T03:48:22.934 INFO:tasks.workunit.client.0.smithi104.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-04-03T03:48:22.951 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (18 ms) 2024-04-03T03:48:22.951 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout:scanning objects in /bdirs1/dir_0 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout:scanning objects in /bdirs1/dir_1 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout:scanning objects in /bdirs1/dir_2 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-04-03T03:48:22.952 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:22.953 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-04-03T03:48:22.953 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-04-03T03:48:22.953 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-04-03T03:48:22.953 INFO:tasks.workunit.client.0.smithi104.stdout:read back objects in /bdirs1/dir_0 2024-04-03T03:48:22.953 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_0/sfile_0 2024-04-03T03:48:22.956 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_0 : "data for sfile_0" 2024-04-03T03:48:22.956 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_0/sfile_1 2024-04-03T03:48:22.960 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_1 : "data for sfile_1" 2024-04-03T03:48:22.960 INFO:tasks.workunit.client.0.smithi104.stdout:read back objects in /bdirs1/dir_1 2024-04-03T03:48:22.960 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_1/sfile_0 2024-04-03T03:48:22.964 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_0 : "data for sfile_0" 2024-04-03T03:48:22.964 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_1/sfile_1 2024-04-03T03:48:22.967 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_1 : "data for sfile_1" 2024-04-03T03:48:22.967 INFO:tasks.workunit.client.0.smithi104.stdout:read back objects in /bdirs1/dir_2 2024-04-03T03:48:22.967 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_2/sfile_0 2024-04-03T03:48:22.971 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_0 : "data for sfile_0" 2024-04-03T03:48:22.971 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_2/sfile_1 2024-04-03T03:48:22.974 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_1 : "data for sfile_1" 2024-04-03T03:48:22.975 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READ_DIRS1 (24 ms) 2024-04-03T03:48:22.975 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-04-03T03:48:23.201 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READF_SETUP1 (226 ms) 2024-04-03T03:48:23.201 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-04-03T03:48:23.201 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-04-03T03:48:23.201 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-04-03T03:48:23.201 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-04-03T03:48:23.201 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-04-03T03:48:23.201 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_0 type: DIR refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_0 type: FILE refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_1 type: DIR refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_1 type: FILE refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_0 type: DIR refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_0 type: FILE refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_1 type: DIR refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_1 type: FILE refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_0 type: DIR refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_0 type: FILE refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_1 type: DIR refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_1 type: FILE refs: 2 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-04-03T03:48:23.202 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.HIER1 2024-04-03T03:48:23.220 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/f2 (f2): FILE 2024-04-03T03:48:23.221 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/f1 (f1): FILE 2024-04-03T03:48:23.227 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-04-03T03:48:23.232 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-04-03T03:48:23.238 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-04-03T03:48:23.239 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-04-03T03:48:23.240 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-04-03T03:48:23.241 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-04-03T03:48:23.242 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-04-03T03:48:23.243 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-04-03T03:48:23.244 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-04-03T03:48:23.248 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar (bar): DIR 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo (foo): DIR 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot (nfsroot): DIR 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.HIER1 (47 ms) 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:23.249 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:23.250 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:23.250 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:23.250 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:23.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:23.256+0000 7f2745315a80 -1 shutting down 2024-04-03T03:48:23.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:23.256+0000 7f2620e88640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55149, si_uid : 1000, si_addr0x3e80000d76d, si_status0 2024-04-03T03:48:23.392 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (144 ms) 2024-04-03T03:48:23.392 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 24 tests from LibRGW (1434 ms total) 2024-04-03T03:48:23.392 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:23.392 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:23.392 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 24 tests from 1 test suite ran. (1434 ms total) 2024-04-03T03:48:23.392 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 24 tests. 2024-04-03T03:48:23.424 INFO:tasks.workunit.client.0.smithi104.stdout:phase 1.2 2024-04-03T03:48:23.447 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 24 tests from 1 test suite. 2024-04-03T03:48:23.447 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:23.447 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 24 tests from LibRGW 2024-04-03T03:48:23.447 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:23.457 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:23.457 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:24.004 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (557 ms) 2024-04-03T03:48:24.004 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-04-03T03:48:24.006 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-04-03T03:48:24.006 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:24.006 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SETATTR 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-04-03T03:48:24.007 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-04-03T03:48:24.008 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.HIER1 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:24.009 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:24.010 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:24.012+0000 7f26832b2a80 -1 shutting down 2024-04-03T03:48:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:24.016+0000 7f255ee25640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55792, si_uid : 1000, si_addr0x3e80000d9f0, si_status0 2024-04-03T03:48:24.159 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (153 ms) 2024-04-03T03:48:24.159 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 24 tests from LibRGW (712 ms total) 2024-04-03T03:48:24.159 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:24.160 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:24.160 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 24 tests from 1 test suite ran. (712 ms total) 2024-04-03T03:48:24.160 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 24 tests. 2024-04-03T03:48:24.174 INFO:tasks.workunit.client.0.smithi104.stdout:phase 1.3 2024-04-03T03:48:24.197 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 24 tests from 1 test suite. 2024-04-03T03:48:24.197 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:24.197 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 24 tests from LibRGW 2024-04-03T03:48:24.197 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:24.210 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:24.210 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:25.177 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (980 ms) 2024-04-03T03:48:25.177 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-04-03T03:48:25.179 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-04-03T03:48:25.179 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:25.179 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-04-03T03:48:25.180 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-04-03T03:48:25.191 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SETUP_HIER1 (13 ms) 2024-04-03T03:48:25.191 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-04-03T03:48:25.327 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SETUP_DIRS1 (135 ms) 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SETATTR 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-04-03T03:48:25.328 INFO:tasks.workunit.client.0.smithi104.stdout:scanning objects in /bdirs1/dir_0 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout:scanning objects in /bdirs1/dir_1 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout:scanning objects in /bdirs1/dir_2 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-04-03T03:48:25.329 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-04-03T03:48:25.330 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-04-03T03:48:25.330 INFO:tasks.workunit.client.0.smithi104.stdout:read back objects in /bdirs1/dir_0 2024-04-03T03:48:25.330 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_0/sfile_0 2024-04-03T03:48:25.331 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_0 : "data for sfile_0" 2024-04-03T03:48:25.331 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_0/sfile_1 2024-04-03T03:48:25.334 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_1 : "data for sfile_1" 2024-04-03T03:48:25.334 INFO:tasks.workunit.client.0.smithi104.stdout:read back objects in /bdirs1/dir_1 2024-04-03T03:48:25.334 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_1/sfile_0 2024-04-03T03:48:25.336 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_0 : "data for sfile_0" 2024-04-03T03:48:25.336 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_1/sfile_1 2024-04-03T03:48:25.339 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_1 : "data for sfile_1" 2024-04-03T03:48:25.339 INFO:tasks.workunit.client.0.smithi104.stdout:read back objects in /bdirs1/dir_2 2024-04-03T03:48:25.339 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_2/sfile_0 2024-04-03T03:48:25.341 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_0 : "data for sfile_0" 2024-04-03T03:48:25.341 INFO:tasks.workunit.client.0.smithi104.stdout:reading 0,256 dir_2/sfile_1 2024-04-03T03:48:25.344 INFO:tasks.workunit.client.0.smithi104.stdout: read back from sfile_1 : "data for sfile_1" 2024-04-03T03:48:25.344 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READ_DIRS1 (17 ms) 2024-04-03T03:48:25.344 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-04-03T03:48:25.344 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-04-03T03:48:25.344 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-04-03T03:48:25.344 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-04-03T03:48:25.344 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-04-03T03:48:25.344 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-04-03T03:48:25.344 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_0 type: DIR refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_0 type: FILE refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_1 type: DIR refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_1 type: FILE refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_0 type: DIR refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_0 type: FILE refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_1 type: DIR refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_1 type: FILE refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_0 type: DIR refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_0 type: FILE refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sdir_1 type: DIR refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:release sfile_1 type: FILE refs: 2 2024-04-03T03:48:25.345 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-04-03T03:48:25.346 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.HIER1 2024-04-03T03:48:25.360 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/f2 (f2): FILE 2024-04-03T03:48:25.361 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/f1 (f1): FILE 2024-04-03T03:48:25.367 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-04-03T03:48:25.371 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-04-03T03:48:25.378 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-04-03T03:48:25.379 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-04-03T03:48:25.379 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-04-03T03:48:25.380 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-04-03T03:48:25.382 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-04-03T03:48:25.382 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-04-03T03:48:25.383 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-04-03T03:48:25.387 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-04-03T03:48:25.387 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-04-03T03:48:25.387 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo/bar (bar): DIR 2024-04-03T03:48:25.387 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot/foo (foo): DIR 2024-04-03T03:48:25.387 INFO:tasks.workunit.client.0.smithi104.stdout:/nfsroot (nfsroot): DIR 2024-04-03T03:48:25.387 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.HIER1 (43 ms) 2024-04-03T03:48:25.387 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:25.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:25.392+0000 7f0757548a80 -1 shutting down 2024-04-03T03:48:25.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:25.396+0000 7f06330bb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56435, si_uid : 1000, si_addr0x3e80000dc73, si_status0 2024-04-03T03:48:25.542 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (155 ms) 2024-04-03T03:48:25.543 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 24 tests from LibRGW (1345 ms total) 2024-04-03T03:48:25.543 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:25.543 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:25.543 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 24 tests from 1 test suite ran. (1345 ms total) 2024-04-03T03:48:25.543 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 24 tests. 2024-04-03T03:48:25.557 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2.1 2024-04-03T03:48:25.579 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 9 tests from 1 test suite. 2024-04-03T03:48:25.580 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:25.580 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 9 tests from LibRGW 2024-04-03T03:48:25.580 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:25.591 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:25.591 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:26.132 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (552 ms) 2024-04-03T03:48:26.132 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:26.134 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-04-03T03:48:26.134 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-04-03T03:48:26.154 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CREATE_BUCKET (20 ms) 2024-04-03T03:48:26.154 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-04-03T03:48:26.154 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-04-03T03:48:26.154 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-04-03T03:48:26.171 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave0 2024-04-03T03:48:26.192 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave1 2024-04-03T03:48:26.210 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave2 2024-04-03T03:48:26.229 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave3 2024-04-03T03:48:26.249 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave4 2024-04-03T03:48:26.268 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave5 2024-04-03T03:48:26.287 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave6 2024-04-03T03:48:26.309 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave7 2024-04-03T03:48:26.330 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave8 2024-04-03T03:48:26.351 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave9 2024-04-03T03:48:26.351 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (197 ms) 2024-04-03T03:48:26.352 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-04-03T03:48:27.150 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (798 ms) 2024-04-03T03:48:27.150 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:27.150 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:27.150 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:27.150 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:27.150 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:27.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:27.156+0000 7ff76ea40a80 -1 shutting down 2024-04-03T03:48:27.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:27.156+0000 7ff64a5b3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57078, si_uid : 1000, si_addr0x3e80000def6, si_status0 2024-04-03T03:48:27.281 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (132 ms) 2024-04-03T03:48:27.281 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 9 tests from LibRGW (1701 ms total) 2024-04-03T03:48:27.281 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:27.281 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:27.281 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 9 tests from 1 test suite ran. (1701 ms total) 2024-04-03T03:48:27.281 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 9 tests. 2024-04-03T03:48:27.294 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2.2 2024-04-03T03:48:27.317 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 9 tests from 1 test suite. 2024-04-03T03:48:27.318 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:27.318 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 9 tests from LibRGW 2024-04-03T03:48:27.318 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:27.329 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:27.329 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:27.879 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (561 ms) 2024-04-03T03:48:27.879 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:27.880 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-04-03T03:48:27.880 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-04-03T03:48:27.880 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-04-03T03:48:27.881 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-04-03T03:48:27.945 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_BUCKET (64 ms) 2024-04-03T03:48:27.946 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-04-03T03:48:27.966 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave0 2024-04-03T03:48:27.984 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave1 2024-04-03T03:48:28.003 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave2 2024-04-03T03:48:28.021 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave3 2024-04-03T03:48:28.040 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave4 2024-04-03T03:48:28.056 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave5 2024-04-03T03:48:28.074 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave6 2024-04-03T03:48:28.098 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave7 2024-04-03T03:48:28.117 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave8 2024-04-03T03:48:28.139 INFO:tasks.workunit.client.0.smithi104.stdout:created: sorrydave9 2024-04-03T03:48:28.139 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (193 ms) 2024-04-03T03:48:28.139 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-04-03T03:48:28.924 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (785 ms) 2024-04-03T03:48:28.924 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:28.924 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:28.924 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:28.924 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:28.925 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:28.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:28.932+0000 7f391ffa1a80 -1 shutting down 2024-04-03T03:48:28.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:28.932+0000 7f37fbb14640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57721, si_uid : 1000, si_addr0x3e80000e179, si_status0 2024-04-03T03:48:29.003 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (79 ms) 2024-04-03T03:48:29.003 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 9 tests from LibRGW (1685 ms total) 2024-04-03T03:48:29.003 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:29.003 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:29.003 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 9 tests from 1 test suite ran. (1685 ms total) 2024-04-03T03:48:29.003 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 9 tests. 2024-04-03T03:48:29.014 INFO:tasks.workunit.client.0.smithi104.stdout:phase 3.1 2024-04-03T03:48:29.356 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 13 tests from 1 test suite. 2024-04-03T03:48:29.356 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:29.356 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 13 tests from LibRGW 2024-04-03T03:48:29.356 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:29.366 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:29.366 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:29.916 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (560 ms) 2024-04-03T03:48:30.209 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:30.210 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-04-03T03:48:30.211 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-04-03T03:48:30.211 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CREATE_BUCKET (19 ms) 2024-04-03T03:48:30.211 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-04-03T03:48:30.211 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-04-03T03:48:30.211 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-04-03T03:48:30.211 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-04-03T03:48:30.211 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LARGE1 2024-04-03T03:48:30.478 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LARGE1 (531 ms) 2024-04-03T03:48:30.478 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LARGE2 2024-04-03T03:48:30.567 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LARGE2 (89 ms) 2024-04-03T03:48:30.567 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-04-03T03:48:30.567 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-04-03T03:48:30.567 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-04-03T03:48:30.567 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-04-03T03:48:30.567 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-04-03T03:48:30.567 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-04-03T03:48:30.567 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:30.567 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:30.568 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:30.568 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:30.568 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:30.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:30.572+0000 7fb0f5737a80 -1 shutting down 2024-04-03T03:48:30.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:30.576+0000 7fafd12aa640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58364, si_uid : 1000, si_addr0x3e80000e3fc, si_status0 2024-04-03T03:48:30.658 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (92 ms) 2024-04-03T03:48:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 13 tests from LibRGW (1302 ms total) 2024-04-03T03:48:30.659 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 13 tests from 1 test suite ran. (1302 ms total) 2024-04-03T03:48:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 13 tests. 2024-04-03T03:48:30.671 INFO:tasks.workunit.client.0.smithi104.stdout:phase 3.2 2024-04-03T03:48:31.011 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 13 tests from 1 test suite. 2024-04-03T03:48:31.011 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:31.011 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 13 tests from LibRGW 2024-04-03T03:48:31.011 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:31.020 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:31.020 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:31.803 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (793 ms) 2024-04-03T03:48:31.804 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:31.805 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-04-03T03:48:31.805 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-04-03T03:48:31.805 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-04-03T03:48:31.805 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-04-03T03:48:31.813 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-04-03T03:48:31.813 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-04-03T03:48:31.821 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (6 ms) 2024-04-03T03:48:31.821 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LARGE1 2024-04-03T03:48:32.350 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LARGE1 (530 ms) 2024-04-03T03:48:32.350 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LARGE2 2024-04-03T03:48:32.350 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-04-03T03:48:32.350 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-04-03T03:48:32.350 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-04-03T03:48:32.350 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-04-03T03:48:32.361 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_OBJECT (11 ms) 2024-04-03T03:48:32.361 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-04-03T03:48:32.429 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_BUCKET (68 ms) 2024-04-03T03:48:32.429 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:32.429 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:32.429 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:32.429 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:32.429 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:32.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:32.436+0000 7f33690ada80 -1 shutting down 2024-04-03T03:48:32.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:32.440+0000 7f3244c20640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59007, si_uid : 1000, si_addr0x3e80000e67f, si_status0 2024-04-03T03:48:32.564 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (135 ms) 2024-04-03T03:48:32.564 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 13 tests from LibRGW (1553 ms total) 2024-04-03T03:48:32.564 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:32.564 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:32.564 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 13 tests from 1 test suite ran. (1553 ms total) 2024-04-03T03:48:32.564 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 13 tests. 2024-04-03T03:48:32.582 INFO:tasks.workunit.client.0.smithi104.stdout:phase 4.1 2024-04-03T03:48:32.604 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 11 tests from 1 test suite. 2024-04-03T03:48:32.605 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:32.605 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 11 tests from LibRGW 2024-04-03T03:48:32.605 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.TVAR 2024-04-03T03:48:32.605 INFO:tasks.workunit.client.0.smithi104.stdout:read i1: 64001 2024-04-03T03:48:32.605 INFO:tasks.workunit.client.0.smithi104.stdout:read s1: blunderbuss 2024-04-03T03:48:32.605 INFO:tasks.workunit.client.0.smithi104.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-04-03T03:48:32.605 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:32.617 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:33.138 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (534 ms) 2024-04-03T03:48:33.138 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:33.140 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-04-03T03:48:33.140 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-04-03T03:48:33.175 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (34 ms) 2024-04-03T03:48:33.175 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-04-03T03:48:34.452 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_0 2024-04-03T03:48:34.452 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_1 2024-04-03T03:48:34.452 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_2 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_3 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_4 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_5 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_6 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_7 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_8 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_9 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_10 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_11 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_12 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_13 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_14 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_15 2024-04-03T03:48:34.453 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_16 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_17 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_18 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_19 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_20 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_21 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_22 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_23 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_24 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_25 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_26 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_27 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_28 2024-04-03T03:48:34.454 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_29 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_30 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_31 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_32 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_33 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_34 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_35 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_36 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_37 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_38 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_39 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_40 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_41 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_42 2024-04-03T03:48:34.455 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_43 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_44 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_45 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_46 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_47 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_48 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_49 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_50 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_51 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_52 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_53 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_54 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_55 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_56 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_57 2024-04-03T03:48:34.456 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_58 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_59 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_60 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_61 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_62 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_63 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_64 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_65 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_66 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_67 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_68 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_69 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_70 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_71 2024-04-03T03:48:34.457 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_72 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_73 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_74 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_75 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_76 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_77 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_78 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_79 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_80 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_81 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_82 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_83 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_84 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_85 2024-04-03T03:48:34.458 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_86 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_87 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_88 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_89 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_90 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_91 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_92 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_93 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_94 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_95 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_96 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_97 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_98 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:created: dmarker:f_99 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1277 ms) 2024-04-03T03:48:34.459 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-04-03T03:48:34.460 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-04-03T03:48:34.460 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-04-03T03:48:34.460 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-04-03T03:48:34.460 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-04-03T03:48:34.460 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-04-03T03:48:34.461 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-04-03T03:48:34.462 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-04-03T03:48:34.463 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-04-03T03:48:34.464 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-04-03T03:48:34.465 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-04-03T03:48:34.466 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_READDIR (7 ms) 2024-04-03T03:48:34.467 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-04-03T03:48:34.468 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-04-03T03:48:34.468 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-04-03T03:48:34.468 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-04-03T03:48:34.468 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-04-03T03:48:34.469 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-04-03T03:48:34.470 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-04-03T03:48:34.471 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-04-03T03:48:34.472 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-04-03T03:48:34.473 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-04-03T03:48:34.474 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2024-04-03T03:48:34.475 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:34.476 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:34.476 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:34.476 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:34.476 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:34.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:34.468+0000 7f6ea2407a80 -1 shutting down 2024-04-03T03:48:34.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:34.472+0000 7f6d7df7a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59650, si_uid : 1000, si_addr0x3e80000e902, si_status0 2024-04-03T03:48:34.582 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (118 ms) 2024-04-03T03:48:34.582 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 11 tests from LibRGW (1977 ms total) 2024-04-03T03:48:34.582 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:34.582 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:34.582 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 11 tests from 1 test suite ran. (1977 ms total) 2024-04-03T03:48:34.582 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 11 tests. 2024-04-03T03:48:34.592 INFO:tasks.workunit.client.0.smithi104.stdout:phase 4.2 2024-04-03T03:48:34.615 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 11 tests from 1 test suite. 2024-04-03T03:48:34.615 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:34.615 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 11 tests from LibRGW 2024-04-03T03:48:34.615 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.TVAR 2024-04-03T03:48:34.616 INFO:tasks.workunit.client.0.smithi104.stdout:read i1: 64001 2024-04-03T03:48:34.616 INFO:tasks.workunit.client.0.smithi104.stdout:read s1: blunderbuss 2024-04-03T03:48:34.616 INFO:tasks.workunit.client.0.smithi104.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-04-03T03:48:34.616 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:34.625 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:34.625 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:35.378 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (762 ms) 2024-04-03T03:48:35.378 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:35.380 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-04-03T03:48:35.380 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-04-03T03:48:35.402 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (22 ms) 2024-04-03T03:48:35.402 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-04-03T03:48:35.402 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-04-03T03:48:35.402 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-04-03T03:48:35.402 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-04-03T03:48:35.402 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-04-03T03:48:35.406 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-04-03T03:48:35.407 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-04-03T03:48:35.408 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-04-03T03:48:35.409 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-04-03T03:48:35.410 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-04-03T03:48:35.411 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-04-03T03:48:35.412 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:35.413 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:35.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:35.412+0000 7f87d0a41a80 -1 shutting down 2024-04-03T03:48:35.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:35.416+0000 7f86ac5b4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60293, si_uid : 1000, si_addr0x3e80000eb85, si_status0 2024-04-03T03:48:35.533 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (127 ms) 2024-04-03T03:48:35.534 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 11 tests from LibRGW (917 ms total) 2024-04-03T03:48:35.534 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:35.534 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:35.534 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 11 tests from 1 test suite ran. (917 ms total) 2024-04-03T03:48:35.534 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 11 tests. 2024-04-03T03:48:35.547 INFO:tasks.workunit.client.0.smithi104.stdout:phase 5.1 2024-04-03T03:48:35.579 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 19 tests from 1 test suite. 2024-04-03T03:48:35.579 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:35.580 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 19 tests from LibRGW 2024-04-03T03:48:35.580 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:35.590 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:35.590 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:36.126 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (547 ms) 2024-04-03T03:48:36.127 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:36.128 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-04-03T03:48:36.128 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-04-03T03:48:36.147 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CREATE_BUCKET (19 ms) 2024-04-03T03:48:36.148 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-04-03T03:48:36.157 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (9 ms) 2024-04-03T03:48:36.157 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-04-03T03:48:36.157 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-04-03T03:48:36.157 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-04-03T03:48:36.160 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-04-03T03:48:36.161 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-04-03T03:48:36.161 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-04-03T03:48:36.161 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-04-03T03:48:36.169 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.PUT_OBJECT (8 ms) 2024-04-03T03:48:36.169 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-04-03T03:48:36.173 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.GET_OBJECT (4 ms) 2024-04-03T03:48:36.173 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-04-03T03:48:36.173 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-04-03T03:48:36.173 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-04-03T03:48:36.173 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-04-03T03:48:36.173 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.WRITEV 2024-04-03T03:48:36.173 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-04-03T03:48:36.173 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READV 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READV (0 ms) 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:36.174 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:36.175 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:36.175 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:36.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:36.180+0000 7f98b865aa80 -1 shutting down 2024-04-03T03:48:36.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:36.180+0000 7f97941cd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60936, si_uid : 1000, si_addr0x3e80000ee08, si_status0 2024-04-03T03:48:36.273 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (100 ms) 2024-04-03T03:48:36.273 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 19 tests from LibRGW (693 ms total) 2024-04-03T03:48:36.273 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:36.273 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:36.273 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 19 tests from 1 test suite ran. (693 ms total) 2024-04-03T03:48:36.273 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 19 tests. 2024-04-03T03:48:36.286 INFO:tasks.workunit.client.0.smithi104.stdout:phase 5.2 2024-04-03T03:48:36.318 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 19 tests from 1 test suite. 2024-04-03T03:48:36.319 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:36.319 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 19 tests from LibRGW 2024-04-03T03:48:36.319 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:36.327 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:36.327 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:36.606 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (288 ms) 2024-04-03T03:48:36.606 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:36.608 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-04-03T03:48:36.608 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-04-03T03:48:36.608 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-04-03T03:48:36.608 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-04-03T03:48:36.622 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (13 ms) 2024-04-03T03:48:36.622 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-04-03T03:48:36.622 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-04-03T03:48:36.622 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-04-03T03:48:36.622 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-04-03T03:48:36.622 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-04-03T03:48:36.623 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-04-03T03:48:36.623 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-04-03T03:48:36.623 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-04-03T03:48:36.623 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-04-03T03:48:36.623 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-04-03T03:48:36.623 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-04-03T03:48:36.623 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-04-03T03:48:36.623 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-04-03T03:48:36.624 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-04-03T03:48:36.624 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.WRITEV 2024-04-03T03:48:36.624 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-04-03T03:48:36.624 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READV 2024-04-03T03:48:36.624 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READV (0 ms) 2024-04-03T03:48:36.624 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-04-03T03:48:36.624 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-04-03T03:48:36.624 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-04-03T03:48:36.632 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_OBJECT (11 ms) 2024-04-03T03:48:36.632 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-04-03T03:48:36.693 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.DELETE_BUCKET (61 ms) 2024-04-03T03:48:36.694 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:36.694 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:36.694 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:36.694 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:36.694 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:36.694 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:36.700+0000 7f176fed9a80 -1 shutting down 2024-04-03T03:48:36.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:36.704+0000 7f164ba4c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61579, si_uid : 1000, si_addr0x3e80000f08b, si_status0 2024-04-03T03:48:36.857 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (163 ms) 2024-04-03T03:48:36.857 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 19 tests from LibRGW (538 ms total) 2024-04-03T03:48:36.857 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:36.857 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:36.857 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 19 tests from 1 test suite ran. (538 ms total) 2024-04-03T03:48:36.857 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 19 tests. 2024-04-03T03:48:36.870 INFO:tasks.workunit.client.0.smithi104.stdout:phase 6.1 2024-04-03T03:48:36.894 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] Running 10 tests from 1 test suite. 2024-04-03T03:48:36.894 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment set-up. 2024-04-03T03:48:36.894 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 10 tests from LibRGW 2024-04-03T03:48:36.894 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.INIT 2024-04-03T03:48:36.902 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:36.903 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:37.432 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.INIT (539 ms) 2024-04-03T03:48:37.433 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.MOUNT 2024-04-03T03:48:37.434 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-04-03T03:48:37.434 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-04-03T03:48:37.469 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CREATE_BUCKETS (35 ms) 2024-04-03T03:48:37.469 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-04-03T03:48:37.483 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (14 ms) 2024-04-03T03:48:37.484 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-04-03T03:48:37.511 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.TOPDIR_RENAME (27 ms) 2024-04-03T03:48:37.511 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-04-03T03:48:37.554 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SUBDIR_RENAME (43 ms) 2024-04-03T03:48:37.554 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-04-03T03:48:37.597 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (44 ms) 2024-04-03T03:48:37.597 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.CLEANUP 2024-04-03T03:48:37.597 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-04-03T03:48:37.598 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.UMOUNT 2024-04-03T03:48:37.598 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-04-03T03:48:37.598 INFO:tasks.workunit.client.0.smithi104.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-04-03T03:48:37.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.604+0000 7fbf8308ba80 -1 shutting down 2024-04-03T03:48:37.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.608+0000 7fbe5ebfe640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62222, si_uid : 1000, si_addr0x3e80000f30e, si_status0 2024-04-03T03:48:37.662 INFO:tasks.workunit.client.0.smithi104.stdout:[ OK ] LibRGW.SHUTDOWN (64 ms) 2024-04-03T03:48:37.662 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] 10 tests from LibRGW (768 ms total) 2024-04-03T03:48:37.662 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:37.662 INFO:tasks.workunit.client.0.smithi104.stdout:[----------] Global test environment tear-down 2024-04-03T03:48:37.662 INFO:tasks.workunit.client.0.smithi104.stdout:[==========] 10 tests from 1 test suite ran. (768 ms total) 2024-04-03T03:48:37.662 INFO:tasks.workunit.client.0.smithi104.stdout:[ PASSED ] 10 tests. 2024-04-03T03:48:37.669 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:48:37.669 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:48:37.682 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-04-03T03:48:37.683 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-04-03T03:48:37.683 DEBUG:teuthology.orchestra.run.smithi104:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-04-03T03:48:37.732 INFO:tasks.workunit.client.0.smithi104.stderr:+ [ -z ] 2024-04-03T03:48:37.732 INFO:tasks.workunit.client.0.smithi104.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-04-03T03:48:37.732 INFO:tasks.workunit.client.0.smithi104.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-04-03T03:48:37.732 INFO:tasks.workunit.client.0.smithi104.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-04-03T03:48:37.770 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:48:37.770 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:48:37.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.820+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 realm 2024-04-03T03:48:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:37.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:48:37.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:37.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:37.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:37.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:48:37.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:37.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:48:37.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.824+0000 7f7064c1f980 20 searching for the correct realm 2024-04-03T03:48:37.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.828+0000 7f7062f3b640 0 -- 172.21.15.104:0/3721846674 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f70540cf070 msgr2=0x7f70540f5800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:48:37.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:37.836+0000 7f7061f39640 0 -- 172.21.15.104:0/3721846674 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f70540f4f00 msgr2=0x7f7054115720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:48:38.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.052+0000 7f7064c1f980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:48:38.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.052+0000 7f7064c1f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:48:38.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.052+0000 7f7064c1f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:48:38.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.052+0000 7f7064c1f980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:48:38.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.052+0000 7f7064c1f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:48:38.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.052+0000 7f7064c1f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:48:38.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.052+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:38.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.052+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:38.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.052+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:38.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:48:38.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:38.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:48:38.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 zone default found 2024-04-03T03:48:38.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 4 Realm: () 2024-04-03T03:48:38.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:48:38.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:48:38.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:48:38.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 zonegroup default 2024-04-03T03:48:38.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:38.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:38.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:38.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:38.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.056+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:38.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.060+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:38.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.060+0000 7f7064c1f980 20 started sync module instance, tier type = 2024-04-03T03:48:38.052 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.060+0000 7f7064c1f980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:48:38.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.080+0000 7f7064c1f980 20 add_watcher() i=0 2024-04-03T03:48:38.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.080+0000 7f7064c1f980 20 add_watcher() i=1 2024-04-03T03:48:38.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.080+0000 7f7064c1f980 20 add_watcher() i=2 2024-04-03T03:48:38.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.080+0000 7f7064c1f980 20 add_watcher() i=3 2024-04-03T03:48:38.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.080+0000 7f7064c1f980 20 add_watcher() i=4 2024-04-03T03:48:38.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.080+0000 7f7064c1f980 20 add_watcher() i=5 2024-04-03T03:48:38.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.080+0000 7f7064c1f980 20 add_watcher() i=6 2024-04-03T03:48:38.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.084+0000 7f7064c1f980 20 add_watcher() i=7 2024-04-03T03:48:38.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.084+0000 7f7064c1f980 2 all 8 watchers are set, enabling cache 2024-04-03T03:48:38.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f6f18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:48:38.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:48:38.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:48:38.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 5 note: GC not initialized 2024-04-03T03:48:38.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f6e937fe640 20 reqs_thread_entry: start 2024-04-03T03:48:38.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 20 init_complete bucket index max shards: 11 2024-04-03T03:48:38.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 20 Filter name: none 2024-04-03T03:48:38.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f6e917fa640 20 reqs_thread_entry: start 2024-04-03T03:48:38.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-04-03T03:48:38.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:38.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:38.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-04-03T03:48:38.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-04-03T03:48:38.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-04-03T03:48:38.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.088+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:38.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:38.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-04-03T03:48:38.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-04-03T03:48:38.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-04-03T03:48:38.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 20 rados->read ofs=0 len=0 2024-04-03T03:48:38.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:48:38.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-04-03T03:48:38.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-04-03T03:48:38.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-04-03T03:48:38.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-04-03T03:48:38.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-04-03T03:48:38.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-04-03T03:48:38.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f7064c1f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-04-03T03:48:38.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f6f45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856711 cookie 94570501833136 notifier 5793 bl.length()=644 2024-04-03T03:48:38.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f6f45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-04-03T03:48:38.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.092+0000 7f6f45ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-04-03T03:48:38.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.100+0000 7f7064c1f980 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-04-03T03:48:38.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.100+0000 7f7064c1f980 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-04-03T03:48:38.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.100+0000 7f7064c1f980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-04-03T03:48:38.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.100+0000 7f6f45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856711 cookie 94570501820128 notifier 5793 bl.length()=187 2024-04-03T03:48:38.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.100+0000 7f6f45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-04-03T03:48:38.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.100+0000 7f6f45ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-04-03T03:48:38.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.104+0000 7f7064c1f980 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-04-03T03:48:38.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.104+0000 7f7064c1f980 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-04-03T03:48:38.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.104+0000 7f7064c1f980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-04-03T03:48:38.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.104+0000 7f6f45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856712 cookie 94570501820128 notifier 5793 bl.length()=197 2024-04-03T03:48:38.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.104+0000 7f6f45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-04-03T03:48:38.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.104+0000 7f6f45ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-04-03T03:48:38.102 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:48:38.102 INFO:tasks.workunit.client.0.smithi104.stdout: "user_id": "ceph-test-maven", 2024-04-03T03:48:38.102 INFO:tasks.workunit.client.0.smithi104.stdout: "display_name": "maven test user", 2024-04-03T03:48:38.102 INFO:tasks.workunit.client.0.smithi104.stdout: "email": "sigv4@example.com", 2024-04-03T03:48:38.102 INFO:tasks.workunit.client.0.smithi104.stdout: "suspended": 0, 2024-04-03T03:48:38.102 INFO:tasks.workunit.client.0.smithi104.stdout: "max_buckets": 1000, 2024-04-03T03:48:38.102 INFO:tasks.workunit.client.0.smithi104.stdout: "subusers": [], 2024-04-03T03:48:38.102 INFO:tasks.workunit.client.0.smithi104.stdout: "keys": [ 2024-04-03T03:48:38.102 INFO:tasks.workunit.client.0.smithi104.stdout: { 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: "user": "ceph-test-maven", 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: "active": true 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: ], 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: "swift_keys": [], 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: "caps": [], 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: "default_placement": "", 2024-04-03T03:48:38.103 INFO:tasks.workunit.client.0.smithi104.stdout: "default_storage_class": "", 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "placement_tags": [], 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_quota": { 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "enabled": false, 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size": -1, 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "max_objects": -1 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "user_quota": { 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "enabled": false, 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:48:38.104 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size": -1, 2024-04-03T03:48:38.105 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:48:38.105 INFO:tasks.workunit.client.0.smithi104.stdout: "max_objects": -1 2024-04-03T03:48:38.105 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:48:38.105 INFO:tasks.workunit.client.0.smithi104.stdout: "temp_url_keys": [], 2024-04-03T03:48:38.105 INFO:tasks.workunit.client.0.smithi104.stdout: "type": "rgw", 2024-04-03T03:48:38.105 INFO:tasks.workunit.client.0.smithi104.stdout: "mfa_ids": [] 2024-04-03T03:48:38.105 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:48:38.105 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:48:38.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.108+0000 7f6f18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:48:38.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.116+0000 7f7064c1f980 20 remove_watcher() i=0 2024-04-03T03:48:38.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.116+0000 7f7064c1f980 2 removed watcher, disabling cache 2024-04-03T03:48:38.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.116+0000 7f7064c1f980 20 remove_watcher() i=1 2024-04-03T03:48:38.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.120+0000 7f7064c1f980 20 remove_watcher() i=2 2024-04-03T03:48:38.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.120+0000 7f7064c1f980 20 remove_watcher() i=3 2024-04-03T03:48:38.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.124+0000 7f7064c1f980 20 remove_watcher() i=4 2024-04-03T03:48:38.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.124+0000 7f7064c1f980 20 remove_watcher() i=5 2024-04-03T03:48:38.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.128+0000 7f7064c1f980 20 remove_watcher() i=6 2024-04-03T03:48:38.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:48:38.128+0000 7f7064c1f980 20 remove_watcher() i=7 2024-04-03T03:48:38.138 INFO:tasks.workunit.client.0.smithi104.stderr:+ [ -z ] 2024-04-03T03:48:38.138 INFO:tasks.workunit.client.0.smithi104.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-04-03T03:48:38.138 INFO:tasks.workunit.client.0.smithi104.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-04-03T03:48:38.139 INFO:tasks.workunit.client.0.smithi104.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi104.front.sepia.ceph.com:443 2024-04-03T03:48:38.139 INFO:tasks.workunit.client.0.smithi104.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-04-03T03:48:38.139 INFO:tasks.workunit.client.0.smithi104.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-04-03T03:48:38.139 INFO:tasks.workunit.client.0.smithi104.stderr:+ ./mvnw clean package 2024-04-03T03:48:38.145 INFO:tasks.workunit.client.0.smithi104.stdout:Warning: JAVA_HOME environment variable is not set. 2024-04-03T03:48:41.112 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Scanning for projects... 2024-04-03T03:48:41.277 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-04-03T03:48:41.378 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 53 kB/s) 2024-04-03T03:48:41.396 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-04-03T03:48:41.443 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.8 MB/s) 2024-04-03T03:48:41.457 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-04-03T03:48:41.482 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.1 MB/s) 2024-04-03T03:48:41.520 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:41.520 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-04-03T03:48:41.520 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Building jcksum 1.0 2024-04-03T03:48:41.520 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] from pom.xml 2024-04-03T03:48:41.520 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-04-03T03:48:41.524 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-04-03T03:48:41.557 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 161 kB/s) 2024-04-03T03:48:41.565 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-04-03T03:48:41.597 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 309 kB/s) 2024-04-03T03:48:41.602 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-04-03T03:48:41.623 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.1 MB/s) 2024-04-03T03:48:41.633 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-04-03T03:48:41.654 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.0 MB/s) 2024-04-03T03:48:41.670 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-04-03T03:48:41.692 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.7 MB/s) 2024-04-03T03:48:41.703 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-04-03T03:48:41.723 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 388 kB/s) 2024-04-03T03:48:41.727 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-04-03T03:48:41.747 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 405 kB/s) 2024-04-03T03:48:41.751 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-04-03T03:48:41.771 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.3 MB/s) 2024-04-03T03:48:41.777 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-04-03T03:48:41.798 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.0 MB/s) 2024-04-03T03:48:41.811 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-04-03T03:48:41.833 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.4 MB/s) 2024-04-03T03:48:41.851 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-04-03T03:48:41.872 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 446 kB/s) 2024-04-03T03:48:41.885 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-04-03T03:48:41.910 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 2.5 MB/s) 2024-04-03T03:48:41.922 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-04-03T03:48:41.941 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 266 kB/s) 2024-04-03T03:48:41.944 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-04-03T03:48:41.965 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.0 MB/s) 2024-04-03T03:48:41.971 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-04-03T03:48:41.994 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.2 MB/s) 2024-04-03T03:48:42.001 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-04-03T03:48:42.023 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.1 MB/s) 2024-04-03T03:48:42.037 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-04-03T03:48:42.056 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 282 kB/s) 2024-04-03T03:48:42.064 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-04-03T03:48:42.086 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 1.9 MB/s) 2024-04-03T03:48:42.098 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-04-03T03:48:42.117 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 356 kB/s) 2024-04-03T03:48:42.121 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-04-03T03:48:42.141 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 495 kB/s) 2024-04-03T03:48:42.145 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-04-03T03:48:42.167 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.1 MB/s) 2024-04-03T03:48:42.172 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-04-03T03:48:42.191 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-04-03T03:48:42.199 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-04-03T03:48:42.219 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.4 MB/s) 2024-04-03T03:48:42.244 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-04-03T03:48:42.264 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 290 kB/s) 2024-04-03T03:48:42.268 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-04-03T03:48:42.289 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.0 MB/s) 2024-04-03T03:48:42.297 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-04-03T03:48:42.318 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.0 MB/s) 2024-04-03T03:48:42.332 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-04-03T03:48:42.351 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 200 kB/s) 2024-04-03T03:48:42.355 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-04-03T03:48:42.375 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 78 kB/s) 2024-04-03T03:48:42.378 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-04-03T03:48:42.398 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 117 kB/s) 2024-04-03T03:48:42.405 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-04-03T03:48:42.425 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 191 kB/s) 2024-04-03T03:48:42.432 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-04-03T03:48:42.452 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 161 kB/s) 2024-04-03T03:48:42.462 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-04-03T03:48:42.482 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 548 kB/s) 2024-04-03T03:48:42.493 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-04-03T03:48:42.514 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 77 kB/s) 2024-04-03T03:48:42.524 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-04-03T03:48:42.545 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 182 kB/s) 2024-04-03T03:48:42.554 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-04-03T03:48:42.575 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 234 kB/s) 2024-04-03T03:48:42.584 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-04-03T03:48:42.604 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 55 kB/s) 2024-04-03T03:48:42.609 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-04-03T03:48:42.630 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 192 kB/s) 2024-04-03T03:48:42.634 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-04-03T03:48:42.655 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 657 kB/s) 2024-04-03T03:48:42.662 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-04-03T03:48:42.683 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 184 kB/s) 2024-04-03T03:48:42.692 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-04-03T03:48:42.713 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 117 kB/s) 2024-04-03T03:48:42.723 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-04-03T03:48:42.744 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 139 kB/s) 2024-04-03T03:48:42.755 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-04-03T03:48:42.776 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 337 kB/s) 2024-04-03T03:48:42.786 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-04-03T03:48:42.806 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 260 kB/s) 2024-04-03T03:48:42.816 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-04-03T03:48:42.837 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 166 kB/s) 2024-04-03T03:48:42.849 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-04-03T03:48:42.870 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 200 kB/s) 2024-04-03T03:48:42.875 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-04-03T03:48:42.898 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 115 kB/s) 2024-04-03T03:48:42.905 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-04-03T03:48:42.927 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 293 kB/s) 2024-04-03T03:48:42.936 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-04-03T03:48:42.958 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 276 kB/s) 2024-04-03T03:48:42.971 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-04-03T03:48:42.994 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 124 kB/s) 2024-04-03T03:48:43.007 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-04-03T03:48:43.029 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 158 kB/s) 2024-04-03T03:48:43.044 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-04-03T03:48:43.065 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 186 kB/s) 2024-04-03T03:48:43.071 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-04-03T03:48:43.092 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 81 kB/s) 2024-04-03T03:48:43.105 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-04-03T03:48:43.127 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 315 kB/s) 2024-04-03T03:48:43.133 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-04-03T03:48:43.156 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 712 kB/s) 2024-04-03T03:48:43.164 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-04-03T03:48:43.188 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.5 MB/s) 2024-04-03T03:48:43.198 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-04-03T03:48:43.218 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 815 kB/s) 2024-04-03T03:48:43.231 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-04-03T03:48:43.252 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 226 kB/s) 2024-04-03T03:48:43.258 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-04-03T03:48:43.280 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 627 kB/s) 2024-04-03T03:48:43.292 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-04-03T03:48:43.314 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 607 kB/s) 2024-04-03T03:48:43.321 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-04-03T03:48:43.347 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 2.5 MB/s) 2024-04-03T03:48:43.375 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-04-03T03:48:43.396 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 746 kB/s) 2024-04-03T03:48:43.406 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-04-03T03:48:43.426 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 772 kB/s) 2024-04-03T03:48:43.431 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-04-03T03:48:43.455 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.3 MB/s) 2024-04-03T03:48:43.466 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-04-03T03:48:43.489 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 801 kB/s) 2024-04-03T03:48:43.498 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-04-03T03:48:43.530 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 624 kB/s) 2024-04-03T03:48:43.536 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-04-03T03:48:43.564 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 2.8 MB/s) 2024-04-03T03:48:43.578 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-04-03T03:48:43.598 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 192 kB/s) 2024-04-03T03:48:43.602 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-04-03T03:48:43.622 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 690 kB/s) 2024-04-03T03:48:43.628 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-04-03T03:48:43.648 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 160 kB/s) 2024-04-03T03:48:43.654 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-04-03T03:48:43.674 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 168 kB/s) 2024-04-03T03:48:43.679 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-04-03T03:48:43.699 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 107 kB/s) 2024-04-03T03:48:43.703 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-04-03T03:48:43.724 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 135 kB/s) 2024-04-03T03:48:43.729 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-04-03T03:48:43.751 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 73 kB/s) 2024-04-03T03:48:43.756 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-04-03T03:48:43.775 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 150 kB/s) 2024-04-03T03:48:43.781 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-04-03T03:48:43.801 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 160 kB/s) 2024-04-03T03:48:43.807 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-04-03T03:48:43.826 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 160 kB/s) 2024-04-03T03:48:43.832 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-04-03T03:48:43.852 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 54 kB/s) 2024-04-03T03:48:43.861 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-04-03T03:48:43.881 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 46 kB/s) 2024-04-03T03:48:43.887 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-04-03T03:48:43.907 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 161 kB/s) 2024-04-03T03:48:43.912 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-04-03T03:48:43.932 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 152 kB/s) 2024-04-03T03:48:43.937 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-04-03T03:48:43.957 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 164 kB/s) 2024-04-03T03:48:43.962 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-04-03T03:48:43.982 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 172 kB/s) 2024-04-03T03:48:43.987 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-04-03T03:48:44.007 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 144 kB/s) 2024-04-03T03:48:44.054 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-04-03T03:48:44.305 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 13 MB/s) 2024-04-03T03:48:44.309 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-04-03T03:48:44.309 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-04-03T03:48:44.309 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-04-03T03:48:44.309 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-04-03T03:48:44.311 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-04-03T03:48:44.336 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 1.3 MB/s) 2024-04-03T03:48:44.336 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-04-03T03:48:44.357 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 341 kB/s) 2024-04-03T03:48:44.357 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-04-03T03:48:44.374 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (2): 4.1/16 kB | 1.4/49 kB Progress (2): 5.5/16 kB | 1.4/49 kB Progress (2): 5.5/16 kB | 2.8/49 kB Progress (2): 6.9/16 kB | 2.8/49 kB Progress (2): 6.9/16 kB | 4.1/49 kB Progress (2): 8.3/16 kB | 4.1/49 kB Progress (2): 8.3/16 kB | 5.5/49 kB Progress (2): 9.7/16 kB | 5.5/49 kB Progress (2): 9.7/16 kB | 6.9/49 kB Progress (2): 11/16 kB | 6.9/49 kB Progress (2): 11/16 kB | 8.3/49 kB Progress (2): 12/16 kB | 8.3/49 kB Progress (2): 12/16 kB | 9.7/49 kB Progress (2): 14/16 kB | 9.7/49 kB Progress (2): 14/16 kB | 11/49 kB Progress (2): 15/16 kB | 11/49 kB Progress (2): 15/16 kB | 12/49 kB Progress (2): 16 kB | 12/49 kB Progress (2): 16 kB | 14/49 kB Progress (2): 16 kB | 15/49 kB Progress (3): 16 kB | 15/49 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 243 kB/s) 2024-04-03T03:48:44.374 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 17/49 kB | 16/98 kB Progress (3): 17/49 kB | 16/98 kB | 16/71 kB Progress (3): 18/49 kB | 16/98 kB | 16/71 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-04-03T03:48:44.388 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 19/49 kB | 16/98 kB | 16/71 kB Progress (3): 21/49 kB | 16/98 kB | 16/71 kB Progress (3): 22/49 kB | 16/98 kB | 16/71 kB Progress (3): 23/49 kB | 16/98 kB | 16/71 kB Progress (3): 25/49 kB | 16/98 kB | 16/71 kB Progress (3): 26/49 kB | 16/98 kB | 16/71 kB Progress (4): 26/49 kB | 16/98 kB | 16/71 kB | 16/782 kB Progress (4): 26/49 kB | 16/98 kB | 16/71 kB | 32/782 kB Progress (4): 28/49 kB | 16/98 kB | 16/71 kB | 32/782 kB Progress (4): 29/49 kB | 16/98 kB | 16/71 kB | 32/782 kB Progress (4): 29/49 kB | 16/98 kB | 16/71 kB | 49/782 kB Progress (4): 29/49 kB | 16/98 kB | 16/71 kB | 65/782 kB Progress (4): 30/49 kB | 16/98 kB | 16/71 kB | 65/782 kB Progress (4): 32/49 kB | 16/98 kB | 16/71 kB | 65/782 kB Progress (4): 32/49 kB | 16/98 kB | 16/71 kB | 81/782 kB Progress (4): 32/49 kB | 33/98 kB | 16/71 kB | 81/782 kB Progress (4): 33/49 kB | 33/98 kB | 16/71 kB | 81/782 kB Progress (4): 34/49 kB | 33/98 kB | 16/71 kB | 81/782 kB Progress (4): 34/49 kB | 33/98 kB | 33/71 kB | 81/782 kB Progress (4): 34/49 kB | 33/98 kB | 33/71 kB | 98/782 kB Progress (4): 36/49 kB | 33/98 kB | 33/71 kB | 98/782 kB Progress (4): 37/49 kB | 33/98 kB | 33/71 kB | 98/782 kB Progress (4): 37/49 kB | 33/98 kB | 33/71 kB | 114/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 114/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 130/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 147/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 163/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 180/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 196/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 212/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 219/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 236/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 252/782 kB Progress (4): 39/49 kB | 33/98 kB | 33/71 kB | 268/782 kB Progress (4): 40/49 kB | 33/98 kB | 33/71 kB | 268/782 kB Progress (4): 41/49 kB | 33/98 kB | 33/71 kB | 268/782 kB Progress (4): 43/49 kB | 33/98 kB | 33/71 kB | 268/782 kB Progress (4): 44/49 kB | 33/98 kB | 33/71 kB | 268/782 kB Progress (4): 44/49 kB | 33/98 kB | 33/71 kB | 285/782 kB Progress (4): 46/49 kB | 33/98 kB | 33/71 kB | 285/782 kB Progress (4): 46/49 kB | 33/98 kB | 33/71 kB | 301/782 kB Progress (4): 47/49 kB | 33/98 kB | 33/71 kB | 301/782 kB Progress (4): 48/49 kB | 33/98 kB | 33/71 kB | 301/782 kB Progress (4): 49 kB | 33/98 kB | 33/71 kB | 301/782 kB Progress (4): 49 kB | 49/98 kB | 33/71 kB | 301/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 623 kB/s) 2024-04-03T03:48:44.389 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-04-03T03:48:44.395 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 49/98 kB | 49/71 kB | 301/782 kB Progress (3): 49/98 kB | 49/71 kB | 318/782 kB Progress (4): 49/98 kB | 49/71 kB | 318/782 kB | 1.4/11 kB Progress (4): 49/98 kB | 49/71 kB | 334/782 kB | 1.4/11 kB Progress (4): 66/98 kB | 49/71 kB | 334/782 kB | 1.4/11 kB Progress (4): 66/98 kB | 66/71 kB | 334/782 kB | 1.4/11 kB Progress (4): 66/98 kB | 66/71 kB | 334/782 kB | 2.8/11 kB Progress (4): 66/98 kB | 71 kB | 334/782 kB | 2.8/11 kB Progress (4): 66/98 kB | 71 kB | 334/782 kB | 4.1/11 kB Progress (4): 66/98 kB | 71 kB | 350/782 kB | 4.1/11 kB Progress (4): 66/98 kB | 71 kB | 350/782 kB | 5.5/11 kB Progress (4): 66/98 kB | 71 kB | 350/782 kB | 6.9/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 830 kB/s) 2024-04-03T03:48:44.395 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-04-03T03:48:44.395 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 66/98 kB | 367/782 kB | 6.9/11 kB Progress (3): 66/98 kB | 367/782 kB | 8.3/11 kB Progress (3): 66/98 kB | 367/782 kB | 9.7/11 kB Progress (3): 66/98 kB | 383/782 kB | 9.7/11 kB Progress (3): 66/98 kB | 383/782 kB | 11/11 kB Progress (3): 66/98 kB | 399/782 kB | 11/11 kB Progress (3): 66/98 kB | 399/782 kB | 11 kB Progress (3): 82/98 kB | 399/782 kB | 11 kB Progress (3): 82/98 kB | 416/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 135 kB/s) 2024-04-03T03:48:44.395 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-04-03T03:48:44.402 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 82/98 kB | 432/782 kB Progress (2): 82/98 kB | 449/782 kB Progress (2): 82/98 kB | 465/782 kB Progress (2): 82/98 kB | 475/782 kB Progress (2): 82/98 kB | 491/782 kB Progress (2): 82/98 kB | 508/782 kB Progress (2): 82/98 kB | 524/782 kB Progress (2): 82/98 kB | 541/782 kB Progress (2): 82/98 kB | 557/782 kB Progress (2): 82/98 kB | 573/782 kB Progress (2): 82/98 kB | 590/782 kB Progress (2): 98 kB | 590/782 kB Progress (2): 98 kB | 606/782 kB Progress (2): 98 kB | 623/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.0 MB/s) 2024-04-03T03:48:44.402 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-04-03T03:48:44.414 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 639/782 kB Progress (1): 655/782 kB Progress (2): 655/782 kB | 16/205 kB Progress (2): 672/782 kB | 16/205 kB Progress (2): 672/782 kB | 33/205 kB Progress (2): 688/782 kB | 33/205 kB Progress (2): 704/782 kB | 33/205 kB Progress (2): 721/782 kB | 33/205 kB Progress (2): 737/782 kB | 33/205 kB Progress (2): 737/782 kB | 49/205 kB Progress (2): 754/782 kB | 49/205 kB Progress (3): 754/782 kB | 49/205 kB | 16/30 kB Progress (3): 754/782 kB | 66/205 kB | 16/30 kB Progress (3): 770/782 kB | 66/205 kB | 16/30 kB Progress (3): 782 kB | 66/205 kB | 16/30 kB Progress (4): 782 kB | 66/205 kB | 16/30 kB | 1.4/81 kB Progress (4): 782 kB | 66/205 kB | 16/30 kB | 2.8/81 kB Progress (4): 782 kB | 66/205 kB | 30 kB | 2.8/81 kB Progress (4): 782 kB | 66/205 kB | 30 kB | 4.1/81 kB Progress (4): 782 kB | 66/205 kB | 30 kB | 5.5/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 7.7 MB/s) 2024-04-03T03:48:44.415 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 66/205 kB | 30 kB | 6.9/81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-04-03T03:48:44.415 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 66/205 kB | 30 kB | 8.3/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 299 kB/s) 2024-04-03T03:48:44.415 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 66/205 kB | 9.7/81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-04-03T03:48:44.428 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 66/205 kB | 11/81 kB Progress (2): 66/205 kB | 12/81 kB Progress (2): 66/205 kB | 14/81 kB Progress (2): 66/205 kB | 15/81 kB Progress (2): 66/205 kB | 16/81 kB Progress (2): 66/205 kB | 32/81 kB Progress (2): 82/205 kB | 32/81 kB Progress (2): 98/205 kB | 32/81 kB Progress (3): 98/205 kB | 32/81 kB | 16/798 kB Progress (3): 115/205 kB | 32/81 kB | 16/798 kB Progress (3): 115/205 kB | 32/81 kB | 33/798 kB Progress (3): 131/205 kB | 32/81 kB | 33/798 kB Progress (3): 131/205 kB | 32/81 kB | 49/798 kB Progress (3): 147/205 kB | 32/81 kB | 49/798 kB Progress (3): 147/205 kB | 32/81 kB | 66/798 kB Progress (3): 147/205 kB | 32/81 kB | 82/798 kB Progress (3): 164/205 kB | 32/81 kB | 82/798 kB Progress (3): 180/205 kB | 32/81 kB | 82/798 kB Progress (3): 180/205 kB | 49/81 kB | 82/798 kB Progress (3): 180/205 kB | 49/81 kB | 98/798 kB Progress (3): 197/205 kB | 49/81 kB | 98/798 kB Progress (3): 205 kB | 49/81 kB | 98/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.8 MB/s) 2024-04-03T03:48:44.428 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-04-03T03:48:44.430 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 65/81 kB | 98/798 kB Progress (3): 65/81 kB | 98/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 111 kB/s) 2024-04-03T03:48:44.430 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-04-03T03:48:44.432 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 65/81 kB | 98/798 kB | 16/182 kB Progress (3): 65/81 kB | 98/798 kB | 33/182 kB Progress (3): 81 kB | 98/798 kB | 33/182 kB Progress (3): 81 kB | 98/798 kB | 37/182 kB Progress (3): 81 kB | 98/798 kB | 53/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 672 kB/s) 2024-04-03T03:48:44.432 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-04-03T03:48:44.437 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 98/798 kB | 69/182 kB Progress (2): 98/798 kB | 86/182 kB Progress (2): 98/798 kB | 102/182 kB Progress (2): 98/798 kB | 118/182 kB Progress (2): 98/798 kB | 135/182 kB Progress (2): 115/798 kB | 135/182 kB Progress (2): 115/798 kB | 151/182 kB Progress (2): 115/798 kB | 168/182 kB Progress (2): 131/798 kB | 168/182 kB Progress (2): 131/798 kB | 182 kB Progress (2): 147/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-04-03T03:48:44.437 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-04-03T03:48:44.451 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 164/798 kB Progress (1): 180/798 kB Progress (1): 197/798 kB Progress (1): 213/798 kB Progress (1): 229/798 kB Progress (1): 246/798 kB Progress (1): 262/798 kB Progress (1): 279/798 kB Progress (1): 295/798 kB Progress (1): 311/798 kB Progress (1): 328/798 kB Progress (2): 328/798 kB | 16/151 kB Progress (2): 328/798 kB | 33/151 kB Progress (2): 328/798 kB | 49/151 kB Progress (2): 328/798 kB | 66/151 kB Progress (3): 328/798 kB | 66/151 kB | 16/27 kB Progress (3): 328/798 kB | 82/151 kB | 16/27 kB Progress (3): 328/798 kB | 82/151 kB | 27 kB Progress (3): 328/798 kB | 98/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 198 kB/s) 2024-04-03T03:48:44.451 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-04-03T03:48:44.452 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 328/798 kB | 115/151 kB Progress (3): 328/798 kB | 115/151 kB | 16/30 kB Progress (3): 328/798 kB | 131/151 kB | 16/30 kB Progress (3): 328/798 kB | 131/151 kB | 30 kB Progress (3): 328/798 kB | 147/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 216 kB/s) 2024-04-03T03:48:44.452 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-04-03T03:48:44.452 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 328/798 kB | 151 kB Progress (2): 344/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.1 MB/s) 2024-04-03T03:48:44.452 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-04-03T03:48:44.475 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 360/798 kB Progress (1): 377/798 kB Progress (1): 393/798 kB Progress (1): 410/798 kB Progress (1): 426/798 kB Progress (1): 442/798 kB Progress (1): 459/798 kB Progress (1): 475/798 kB Progress (1): 492/798 kB Progress (1): 508/798 kB Progress (1): 524/798 kB Progress (1): 541/798 kB Progress (1): 557/798 kB Progress (2): 557/798 kB | 16/385 kB Progress (2): 573/798 kB | 16/385 kB Progress (2): 573/798 kB | 32/385 kB Progress (2): 585/798 kB | 32/385 kB Progress (2): 601/798 kB | 32/385 kB Progress (2): 601/798 kB | 49/385 kB Progress (2): 617/798 kB | 49/385 kB Progress (2): 617/798 kB | 65/385 kB Progress (2): 634/798 kB | 65/385 kB Progress (2): 650/798 kB | 65/385 kB Progress (2): 667/798 kB | 65/385 kB Progress (2): 683/798 kB | 65/385 kB Progress (2): 683/798 kB | 81/385 kB Progress (2): 699/798 kB | 81/385 kB Progress (2): 699/798 kB | 98/385 kB Progress (2): 716/798 kB | 98/385 kB Progress (2): 716/798 kB | 114/385 kB Progress (2): 732/798 kB | 114/385 kB Progress (2): 749/798 kB | 114/385 kB Progress (2): 765/798 kB | 114/385 kB Progress (2): 765/798 kB | 130/385 kB Progress (2): 765/798 kB | 147/385 kB Progress (2): 781/798 kB | 147/385 kB Progress (2): 781/798 kB | 163/385 kB Progress (2): 781/798 kB | 180/385 kB Progress (2): 798/798 kB | 180/385 kB Progress (2): 798 kB | 180/385 kB Progress (3): 798 kB | 180/385 kB | 16/780 kB Progress (4): 798 kB | 180/385 kB | 16/780 kB | 16/75 kB Progress (5): 798 kB | 180/385 kB | 16/780 kB | 16/75 kB | 13 kB Progress (5): 798 kB | 196/385 kB | 16/780 kB | 16/75 kB | 13 kB Progress (5): 798 kB | 196/385 kB | 32/780 kB | 16/75 kB | 13 kB Progress (5): 798 kB | 196/385 kB | 32/780 kB | 33/75 kB | 13 kB Progress (5): 798 kB | 212/385 kB | 32/780 kB | 33/75 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 4.9 MB/s) 2024-04-03T03:48:44.475 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (4): 212/385 kB | 49/780 kB | 33/75 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 80 kB/s) 2024-04-03T03:48:44.476 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 212/385 kB | 49/780 kB | 49/75 kB Progress (3): 229/385 kB | 49/780 kB | 49/75 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-04-03T03:48:44.476 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-04-03T03:48:44.479 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 229/385 kB | 65/780 kB | 49/75 kB Progress (3): 245/385 kB | 65/780 kB | 49/75 kB Progress (3): 245/385 kB | 65/780 kB | 66/75 kB Progress (3): 262/385 kB | 65/780 kB | 66/75 kB Progress (3): 262/385 kB | 65/780 kB | 75 kB Progress (3): 262/385 kB | 81/780 kB | 75 kB Progress (3): 278/385 kB | 81/780 kB | 75 kB Progress (3): 278/385 kB | 98/780 kB | 75 kB Progress (3): 294/385 kB | 98/780 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 449 kB/s) 2024-04-03T03:48:44.479 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 311/385 kB | 98/780 kB Progress (2): 311/385 kB | 114/780 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-04-03T03:48:44.479 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 327/385 kB | 114/780 kB Progress (2): 343/385 kB | 114/780 kB Progress (2): 360/385 kB | 114/780 kB Progress (2): 376/385 kB | 114/780 kB Progress (2): 385 kB | 114/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.3 MB/s) 2024-04-03T03:48:44.479 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-04-03T03:48:44.501 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 130/780 kB Progress (1): 147/780 kB Progress (1): 163/780 kB Progress (1): 180/780 kB Progress (1): 196/780 kB Progress (1): 212/780 kB Progress (1): 229/780 kB Progress (1): 245/780 kB Progress (1): 262/780 kB Progress (1): 278/780 kB Progress (1): 294/780 kB Progress (1): 311/780 kB Progress (1): 327/780 kB Progress (1): 343/780 kB Progress (2): 343/780 kB | 16/329 kB Progress (3): 343/780 kB | 16/329 kB | 16/354 kB Progress (4): 343/780 kB | 16/329 kB | 16/354 kB | 16/501 kB Progress (4): 343/780 kB | 16/329 kB | 33/354 kB | 16/501 kB Progress (4): 343/780 kB | 16/329 kB | 33/354 kB | 33/501 kB Progress (4): 343/780 kB | 16/329 kB | 49/354 kB | 33/501 kB Progress (4): 343/780 kB | 16/329 kB | 66/354 kB | 33/501 kB Progress (4): 343/780 kB | 32/329 kB | 66/354 kB | 33/501 kB Progress (4): 343/780 kB | 32/329 kB | 66/354 kB | 49/501 kB Progress (4): 343/780 kB | 32/329 kB | 82/354 kB | 49/501 kB Progress (4): 343/780 kB | 32/329 kB | 82/354 kB | 66/501 kB Progress (4): 343/780 kB | 32/329 kB | 98/354 kB | 66/501 kB Progress (4): 343/780 kB | 32/329 kB | 115/354 kB | 66/501 kB Progress (5): 343/780 kB | 32/329 kB | 115/354 kB | 66/501 kB | 16/41 kB Progress (5): 343/780 kB | 49/329 kB | 115/354 kB | 66/501 kB | 16/41 kB Progress (5): 343/780 kB | 49/329 kB | 131/354 kB | 66/501 kB | 16/41 kB Progress (5): 343/780 kB | 49/329 kB | 131/354 kB | 82/501 kB | 16/41 kB Progress (5): 343/780 kB | 49/329 kB | 131/354 kB | 98/501 kB | 16/41 kB Progress (5): 343/780 kB | 49/329 kB | 147/354 kB | 98/501 kB | 16/41 kB Progress (5): 343/780 kB | 49/329 kB | 164/354 kB | 98/501 kB | 16/41 kB Progress (5): 343/780 kB | 49/329 kB | 180/354 kB | 98/501 kB | 16/41 kB Progress (5): 343/780 kB | 49/329 kB | 197/354 kB | 98/501 kB | 16/41 kB Progress (5): 343/780 kB | 49/329 kB | 197/354 kB | 98/501 kB | 33/41 kB Progress (5): 343/780 kB | 65/329 kB | 197/354 kB | 98/501 kB | 33/41 kB Progress (5): 343/780 kB | 65/329 kB | 197/354 kB | 98/501 kB | 41 kB Progress (5): 343/780 kB | 65/329 kB | 213/354 kB | 98/501 kB | 41 kB Progress (5): 343/780 kB | 65/329 kB | 213/354 kB | 115/501 kB | 41 kB Progress (5): 343/780 kB | 65/329 kB | 213/354 kB | 131/501 kB | 41 kB Progress (5): 343/780 kB | 65/329 kB | 229/354 kB | 131/501 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 216 kB/s) 2024-04-03T03:48:44.501 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-04-03T03:48:44.506 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (4): 343/780 kB | 65/329 kB | 246/354 kB | 131/501 kB Progress (4): 343/780 kB | 81/329 kB | 246/354 kB | 131/501 kB Progress (4): 343/780 kB | 81/329 kB | 246/354 kB | 147/501 kB Progress (4): 343/780 kB | 81/329 kB | 256/354 kB | 147/501 kB Progress (4): 360/780 kB | 81/329 kB | 256/354 kB | 147/501 kB Progress (4): 360/780 kB | 81/329 kB | 256/354 kB | 164/501 kB Progress (4): 360/780 kB | 81/329 kB | 272/354 kB | 164/501 kB Progress (4): 376/780 kB | 81/329 kB | 272/354 kB | 164/501 kB Progress (4): 376/780 kB | 81/329 kB | 272/354 kB | 180/501 kB Progress (4): 376/780 kB | 98/329 kB | 272/354 kB | 180/501 kB Progress (4): 376/780 kB | 98/329 kB | 289/354 kB | 180/501 kB Progress (4): 376/780 kB | 98/329 kB | 289/354 kB | 197/501 kB Progress (4): 376/780 kB | 98/329 kB | 305/354 kB | 197/501 kB Progress (4): 376/780 kB | 98/329 kB | 305/354 kB | 213/501 kB Progress (4): 393/780 kB | 98/329 kB | 305/354 kB | 213/501 kB Progress (4): 393/780 kB | 98/329 kB | 321/354 kB | 213/501 kB Progress (4): 402/780 kB | 98/329 kB | 321/354 kB | 213/501 kB Progress (4): 402/780 kB | 98/329 kB | 321/354 kB | 229/501 kB Progress (4): 402/780 kB | 98/329 kB | 338/354 kB | 229/501 kB Progress (4): 418/780 kB | 98/329 kB | 338/354 kB | 229/501 kB Progress (4): 418/780 kB | 98/329 kB | 354 kB | 229/501 kB Progress (4): 435/780 kB | 98/329 kB | 354 kB | 229/501 kB Progress (4): 435/780 kB | 98/329 kB | 354 kB | 246/501 kB Progress (4): 435/780 kB | 98/329 kB | 354 kB | 256/501 kB Progress (4): 451/780 kB | 98/329 kB | 354 kB | 256/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.8 MB/s) 2024-04-03T03:48:44.506 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 451/780 kB | 98/329 kB | 272/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-04-03T03:48:44.517 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 468/780 kB | 98/329 kB | 272/501 kB Progress (3): 468/780 kB | 98/329 kB | 289/501 kB Progress (3): 484/780 kB | 98/329 kB | 289/501 kB Progress (3): 484/780 kB | 98/329 kB | 305/501 kB Progress (3): 500/780 kB | 98/329 kB | 305/501 kB Progress (3): 517/780 kB | 98/329 kB | 305/501 kB Progress (3): 533/780 kB | 98/329 kB | 305/501 kB Progress (3): 549/780 kB | 98/329 kB | 305/501 kB Progress (3): 566/780 kB | 98/329 kB | 305/501 kB Progress (3): 582/780 kB | 98/329 kB | 305/501 kB Progress (3): 582/780 kB | 114/329 kB | 305/501 kB Progress (3): 599/780 kB | 114/329 kB | 305/501 kB Progress (3): 615/780 kB | 114/329 kB | 305/501 kB Progress (3): 615/780 kB | 130/329 kB | 305/501 kB Progress (3): 631/780 kB | 130/329 kB | 305/501 kB Progress (3): 648/780 kB | 130/329 kB | 305/501 kB Progress (3): 648/780 kB | 147/329 kB | 305/501 kB Progress (3): 664/780 kB | 147/329 kB | 305/501 kB Progress (3): 681/780 kB | 147/329 kB | 305/501 kB Progress (3): 697/780 kB | 147/329 kB | 305/501 kB Progress (3): 713/780 kB | 147/329 kB | 305/501 kB Progress (3): 713/780 kB | 147/329 kB | 321/501 kB Progress (3): 730/780 kB | 147/329 kB | 321/501 kB Progress (3): 730/780 kB | 147/329 kB | 338/501 kB Progress (3): 730/780 kB | 147/329 kB | 354/501 kB Progress (3): 730/780 kB | 163/329 kB | 354/501 kB Progress (3): 746/780 kB | 163/329 kB | 354/501 kB Progress (3): 746/780 kB | 163/329 kB | 370/501 kB Progress (3): 762/780 kB | 163/329 kB | 370/501 kB Progress (3): 762/780 kB | 163/329 kB | 387/501 kB Progress (3): 762/780 kB | 163/329 kB | 403/501 kB Progress (3): 762/780 kB | 180/329 kB | 403/501 kB Progress (3): 762/780 kB | 180/329 kB | 420/501 kB Progress (3): 762/780 kB | 180/329 kB | 436/501 kB Progress (3): 762/780 kB | 196/329 kB | 436/501 kB Progress (3): 762/780 kB | 196/329 kB | 452/501 kB Progress (3): 762/780 kB | 196/329 kB | 469/501 kB Progress (3): 762/780 kB | 196/329 kB | 485/501 kB Progress (3): 762/780 kB | 212/329 kB | 485/501 kB Progress (3): 762/780 kB | 212/329 kB | 501 kB Progress (3): 762/780 kB | 229/329 kB | 501 kB Progress (3): 762/780 kB | 245/329 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.4 MB/s) 2024-04-03T03:48:44.517 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-04-03T03:48:44.517 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 779/780 kB | 245/329 kB Progress (2): 780 kB | 245/329 kB Progress (2): 780 kB | 262/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 3.8 MB/s) 2024-04-03T03:48:44.517 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-04-03T03:48:44.519 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 278/329 kB Progress (1): 294/329 kB Progress (1): 311/329 kB Progress (2): 311/329 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 31 kB/s) 2024-04-03T03:48:44.519 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-04-03T03:48:44.527 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 311/329 kB | 16/586 kB Progress (2): 311/329 kB | 33/586 kB Progress (2): 311/329 kB | 49/586 kB Progress (2): 311/329 kB | 66/586 kB Progress (2): 311/329 kB | 82/586 kB Progress (2): 327/329 kB | 82/586 kB Progress (2): 329 kB | 82/586 kB Progress (2): 329 kB | 98/586 kB Progress (2): 329 kB | 115/586 kB Progress (2): 329 kB | 131/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.5 MB/s) 2024-04-03T03:48:44.527 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-04-03T03:48:44.537 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 147/586 kB Progress (1): 164/586 kB Progress (1): 180/586 kB Progress (1): 197/586 kB Progress (1): 213/586 kB Progress (1): 229/586 kB Progress (1): 246/586 kB Progress (1): 262/586 kB Progress (1): 279/586 kB Progress (1): 295/586 kB Progress (1): 311/586 kB Progress (1): 328/586 kB Progress (1): 344/586 kB Progress (1): 360/586 kB Progress (1): 377/586 kB Progress (1): 393/586 kB Progress (1): 410/586 kB Progress (1): 426/586 kB Progress (1): 442/586 kB Progress (1): 459/586 kB Progress (1): 475/586 kB Progress (1): 492/586 kB Progress (1): 508/586 kB Progress (1): 524/586 kB Progress (2): 524/586 kB | 16/211 kB Progress (2): 541/586 kB | 16/211 kB Progress (2): 541/586 kB | 33/211 kB Progress (2): 557/586 kB | 33/211 kB Progress (2): 557/586 kB | 34/211 kB Progress (2): 573/586 kB | 34/211 kB Progress (2): 573/586 kB | 51/211 kB Progress (2): 585/586 kB | 51/211 kB Progress (2): 585/586 kB | 67/211 kB Progress (2): 586 kB | 67/211 kB Progress (2): 586 kB | 83/211 kB Progress (2): 586 kB | 100/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.6 MB/s) 2024-04-03T03:48:44.537 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-04-03T03:48:44.537 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 116/211 kB Progress (2): 116/211 kB | 14 kB Progress (2): 132/211 kB | 14 kB Progress (2): 149/211 kB | 14 kB Progress (2): 165/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 64 kB/s) 2024-04-03T03:48:44.537 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-04-03T03:48:44.537 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 182/211 kB Progress (1): 198/211 kB Progress (1): 211 kB Progress (2): 211 kB | 16/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 933 kB/s) 2024-04-03T03:48:44.538 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-04-03T03:48:44.540 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 32/106 kB Progress (1): 49/106 kB Progress (1): 65/106 kB Progress (1): 81/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 464 kB/s) 2024-04-03T03:48:44.540 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-04-03T03:48:44.544 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 29 kB/s) 2024-04-03T03:48:44.544 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-04-03T03:48:44.555 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/245 kB Progress (2): 16/245 kB | 16/205 kB Progress (2): 32/245 kB | 16/205 kB Progress (2): 32/245 kB | 33/205 kB Progress (2): 49/245 kB | 33/205 kB Progress (2): 65/245 kB | 33/205 kB Progress (2): 65/245 kB | 49/205 kB Progress (3): 65/245 kB | 49/205 kB | 15 kB Progress (3): 81/245 kB | 49/205 kB | 15 kB Progress (3): 98/245 kB | 49/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 62 kB/s) 2024-04-03T03:48:44.555 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-04-03T03:48:44.560 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 98/245 kB | 66/205 kB Progress (2): 114/245 kB | 66/205 kB Progress (2): 130/245 kB | 66/205 kB Progress (2): 130/245 kB | 82/205 kB Progress (2): 147/245 kB | 82/205 kB Progress (2): 147/245 kB | 98/205 kB Progress (2): 163/245 kB | 98/205 kB Progress (2): 163/245 kB | 115/205 kB Progress (2): 180/245 kB | 115/205 kB Progress (2): 180/245 kB | 131/205 kB Progress (2): 196/245 kB | 131/205 kB Progress (2): 196/245 kB | 147/205 kB Progress (2): 212/245 kB | 147/205 kB Progress (2): 212/245 kB | 164/205 kB Progress (2): 229/245 kB | 164/205 kB Progress (2): 229/245 kB | 180/205 kB Progress (2): 245 kB | 180/205 kB Progress (2): 245 kB | 197/205 kB Progress (2): 245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 987 kB/s) 2024-04-03T03:48:44.560 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-04-03T03:48:44.560 INFO:tasks.workunit.client.0.smithi104.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 826 kB/s) 2024-04-03T03:48:44.560 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-04-03T03:48:44.560 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 66 kB/s) 2024-04-03T03:48:44.560 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-04-03T03:48:44.563 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 25 kB/s) 2024-04-03T03:48:44.572 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 87 kB/s) 2024-04-03T03:48:44.577 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/24 kB Progress (2): 16/24 kB | 16/17 kB Progress (2): 24 kB | 16/17 kB Progress (2): 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 91 kB/s) 2024-04-03T03:48:44.577 INFO:tasks.workunit.client.0.smithi104.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 65 kB/s) 2024-04-03T03:48:44.581 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 683 kB/s) 2024-04-03T03:48:44.601 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:44.601 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-04-03T03:48:44.608 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-04-03T03:48:44.626 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 307 kB/s) 2024-04-03T03:48:44.628 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-04-03T03:48:44.646 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 300 kB/s) 2024-04-03T03:48:44.648 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-04-03T03:48:44.665 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.4 MB/s) 2024-04-03T03:48:44.669 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-04-03T03:48:44.686 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-04-03T03:48:44.691 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-04-03T03:48:44.710 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 64/153 kB Progress (1): 81/153 kB Progress (1): 97/153 kB Progress (1): 113/153 kB Progress (1): 130/153 kB Progress (1): 146/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.1 MB/s) 2024-04-03T03:48:44.711 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-04-03T03:48:44.734 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 8.9 MB/s) 2024-04-03T03:48:44.825 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:44.826 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-04-03T03:48:44.831 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-04-03T03:48:44.849 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 140 kB/s) 2024-04-03T03:48:44.852 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-04-03T03:48:44.870 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-04-03T03:48:44.874 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-04-03T03:48:44.893 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 461 kB/s) 2024-04-03T03:48:44.897 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-04-03T03:48:44.915 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.4 MB/s) 2024-04-03T03:48:44.920 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-04-03T03:48:44.939 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 335 kB/s) 2024-04-03T03:48:44.942 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-04-03T03:48:44.962 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 153 kB/s) 2024-04-03T03:48:44.967 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-04-03T03:48:44.985 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 34 kB/s) 2024-04-03T03:48:44.988 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-04-03T03:48:45.006 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 161 kB/s) 2024-04-03T03:48:45.008 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-04-03T03:48:45.026 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 783 kB/s) 2024-04-03T03:48:45.030 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-04-03T03:48:45.048 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 178 kB/s) 2024-04-03T03:48:45.051 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-04-03T03:48:45.069 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 464 kB/s) 2024-04-03T03:48:45.072 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-04-03T03:48:45.090 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 465 kB/s) 2024-04-03T03:48:45.095 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-04-03T03:48:45.113 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 422 kB/s) 2024-04-03T03:48:45.118 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-04-03T03:48:45.137 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.0 MB/s) 2024-04-03T03:48:45.145 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-04-03T03:48:45.164 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 283 kB/s) 2024-04-03T03:48:45.167 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-04-03T03:48:45.187 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.5 MB/s) 2024-04-03T03:48:45.195 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-04-03T03:48:45.213 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 268 kB/s) 2024-04-03T03:48:45.220 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-04-03T03:48:45.240 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 37/85 kB Progress (1): 53/85 kB Progress (1): 69/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.3 MB/s) 2024-04-03T03:48:45.241 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-04-03T03:48:45.241 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-04-03T03:48:45.241 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-04-03T03:48:45.242 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-04-03T03:48:45.242 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-04-03T03:48:45.261 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 2.5 kB Progress (3): 16/55 kB | 2.5 kB | 16/41 kB Progress (3): 32/55 kB | 2.5 kB | 16/41 kB Progress (3): 32/55 kB | 2.5 kB | 33/41 kB Progress (3): 49/55 kB | 2.5 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 139 kB/s) 2024-04-03T03:48:45.262 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 49/55 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-04-03T03:48:45.262 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 55 kB | 41 kB Progress (3): 55 kB | 41 kB | 8.5 kB Progress (4): 55 kB | 41 kB | 8.5 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.2 MB/s) 2024-04-03T03:48:45.262 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-04-03T03:48:45.262 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 55 kB | 8.5 kB | 33/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.6 MB/s) 2024-04-03T03:48:45.262 INFO:tasks.workunit.client.0.smithi104.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 446 kB/s) 2024-04-03T03:48:45.270 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 9.3 MB/s) 2024-04-03T03:48:45.290 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/327 kB Progress (1): 32/327 kB Progress (2): 32/327 kB | 16/587 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 49/327 kB | 33/587 kB Progress (2): 65/327 kB | 33/587 kB Progress (2): 65/327 kB | 49/587 kB Progress (2): 81/327 kB | 49/587 kB Progress (2): 81/327 kB | 66/587 kB Progress (2): 98/327 kB | 66/587 kB Progress (2): 98/327 kB | 82/587 kB Progress (2): 114/327 kB | 82/587 kB Progress (2): 114/327 kB | 98/587 kB Progress (2): 131/327 kB | 98/587 kB Progress (2): 131/327 kB | 115/587 kB Progress (2): 147/327 kB | 115/587 kB Progress (2): 147/327 kB | 131/587 kB Progress (2): 163/327 kB | 131/587 kB Progress (2): 163/327 kB | 147/587 kB Progress (2): 180/327 kB | 147/587 kB Progress (2): 180/327 kB | 164/587 kB Progress (2): 196/327 kB | 164/587 kB Progress (2): 196/327 kB | 180/587 kB Progress (2): 212/327 kB | 180/587 kB Progress (2): 212/327 kB | 197/587 kB Progress (2): 229/327 kB | 197/587 kB Progress (2): 229/327 kB | 213/587 kB Progress (2): 245/327 kB | 213/587 kB Progress (2): 245/327 kB | 229/587 kB Progress (2): 262/327 kB | 229/587 kB Progress (2): 262/327 kB | 246/587 kB Progress (2): 262/327 kB | 256/587 kB Progress (2): 278/327 kB | 256/587 kB Progress (2): 278/327 kB | 272/587 kB Progress (2): 294/327 kB | 272/587 kB Progress (2): 294/327 kB | 289/587 kB Progress (2): 311/327 kB | 289/587 kB Progress (2): 311/327 kB | 305/587 kB Progress (2): 327/327 kB | 305/587 kB Progress (2): 327 kB | 305/587 kB Progress (2): 327 kB | 321/587 kB Progress (2): 327 kB | 338/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 6.8 MB/s) 2024-04-03T03:48:45.297 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 354/587 kB Progress (1): 370/587 kB Progress (1): 387/587 kB Progress (1): 403/587 kB Progress (1): 420/587 kB Progress (1): 436/587 kB Progress (1): 452/587 kB Progress (1): 469/587 kB Progress (1): 485/587 kB Progress (1): 502/587 kB Progress (1): 518/587 kB Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 11 MB/s) 2024-04-03T03:48:45.345 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-04-03T03:48:45.346 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:45.346 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-04-03T03:48:45.352 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-04-03T03:48:45.369 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 263 kB/s) 2024-04-03T03:48:45.371 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-04-03T03:48:45.388 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 374 kB/s) 2024-04-03T03:48:45.390 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-04-03T03:48:45.411 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 1.8 MB/s) 2024-04-03T03:48:45.411 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-04-03T03:48:45.428 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 822 kB/s) 2024-04-03T03:48:45.433 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-04-03T03:48:45.450 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 45 kB/s) 2024-04-03T03:48:45.452 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-04-03T03:48:45.470 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 249 kB/s) 2024-04-03T03:48:45.472 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-04-03T03:48:45.491 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 961 kB/s) 2024-04-03T03:48:45.495 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-04-03T03:48:45.512 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 292 kB/s) 2024-04-03T03:48:45.514 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-04-03T03:48:45.532 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 244 kB/s) 2024-04-03T03:48:45.537 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-04-03T03:48:45.555 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 132 kB/s) 2024-04-03T03:48:45.558 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-04-03T03:48:45.575 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 627 kB/s) 2024-04-03T03:48:45.579 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-04-03T03:48:45.598 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 958 kB/s) 2024-04-03T03:48:45.601 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-04-03T03:48:45.620 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 365 kB/s) 2024-04-03T03:48:45.624 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-04-03T03:48:45.641 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 59 kB/s) 2024-04-03T03:48:45.644 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-04-03T03:48:45.662 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 466 kB/s) 2024-04-03T03:48:45.665 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-04-03T03:48:45.682 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 149 kB/s) 2024-04-03T03:48:45.686 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-04-03T03:48:45.704 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 313 kB/s) 2024-04-03T03:48:45.708 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-04-03T03:48:45.726 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-04-03T03:48:45.731 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-04-03T03:48:45.748 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 45 kB/s) 2024-04-03T03:48:45.751 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-04-03T03:48:45.768 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 355 kB/s) 2024-04-03T03:48:45.771 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-04-03T03:48:45.788 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.4 MB/s) 2024-04-03T03:48:45.793 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-04-03T03:48:45.810 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 71 kB/s) 2024-04-03T03:48:45.813 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-04-03T03:48:45.830 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 78 kB/s) 2024-04-03T03:48:45.840 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-04-03T03:48:45.857 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 796 kB/s) 2024-04-03T03:48:45.858 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-04-03T03:48:45.858 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-04-03T03:48:45.859 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-04-03T03:48:45.859 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-04-03T03:48:45.859 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-04-03T03:48:45.877 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 4.2 kB Progress (3): 16/55 kB | 4.2 kB | 16/334 kB Progress (3): 32/55 kB | 4.2 kB | 16/334 kB Progress (3): 49/55 kB | 4.2 kB | 16/334 kB Progress (3): 49/55 kB | 4.2 kB | 33/334 kB Progress (3): 55 kB | 4.2 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 211 kB/s) 2024-04-03T03:48:45.877 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-04-03T03:48:45.878 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 55 kB | 49/334 kB Progress (3): 55 kB | 49/334 kB | 16/27 kB Progress (4): 55 kB | 49/334 kB | 16/27 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.7 MB/s) 2024-04-03T03:48:45.878 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-04-03T03:48:45.880 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (3): 49/334 kB | 27 kB | 16/122 kB Progress (3): 65/334 kB | 27 kB | 16/122 kB Progress (3): 65/334 kB | 27 kB | 32/122 kB Progress (3): 65/334 kB | 27 kB | 49/122 kB Progress (3): 81/334 kB | 27 kB | 49/122 kB Progress (3): 81/334 kB | 27 kB | 65/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.3 MB/s) 2024-04-03T03:48:45.880 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-04-03T03:48:45.881 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 81/334 kB | 81/122 kB Progress (2): 98/334 kB | 81/122 kB Progress (2): 98/334 kB | 98/122 kB Progress (2): 98/334 kB | 114/122 kB Progress (2): 114/334 kB | 114/122 kB Progress (2): 114/334 kB | 122 kB Progress (2): 130/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 5.3 MB/s) 2024-04-03T03:48:45.885 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 147/334 kB Progress (1): 163/334 kB Progress (1): 179/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 261/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 12 MB/s) 2024-04-03T03:48:45.895 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 129 kB/s) 2024-04-03T03:48:45.898 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (2): 32/267 kB | 16/23 kB Progress (2): 49/267 kB | 16/23 kB Progress (2): 49/267 kB | 23 kB Progress (2): 65/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 600 kB/s) 2024-04-03T03:48:45.903 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 6.1 MB/s) 2024-04-03T03:48:46.042 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Changes detected - recompiling the module! :source 2024-04-03T03:48:46.045 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-04-03T03:48:47.211 INFO:tasks.workunit.client.0.smithi104.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-04-03T03:48:47.212 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:47.212 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-04-03T03:48:47.214 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-04-03T03:48:47.214 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:47.214 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-04-03T03:48:47.219 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-04-03T03:48:47.219 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-04-03T03:48:47.379 INFO:tasks.workunit.client.0.smithi104.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-04-03T03:48:47.379 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:47.379 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-04-03T03:48:47.383 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-04-03T03:48:47.417 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 184 kB/s) 2024-04-03T03:48:47.420 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-04-03T03:48:47.452 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 114 kB/s) 2024-04-03T03:48:47.455 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-04-03T03:48:47.491 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 93 kB/s) 2024-04-03T03:48:47.494 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-04-03T03:48:47.525 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 135 kB/s) 2024-04-03T03:48:47.528 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-04-03T03:48:47.561 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 100 kB/s) 2024-04-03T03:48:47.564 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-04-03T03:48:47.596 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 139 kB/s) 2024-04-03T03:48:47.601 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-04-03T03:48:47.634 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 53 kB/s) 2024-04-03T03:48:47.640 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-04-03T03:48:47.676 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 61 kB/s) 2024-04-03T03:48:47.679 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-04-03T03:48:47.699 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.5 MB/s) 2024-04-03T03:48:47.704 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-04-03T03:48:47.732 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 68 kB/s) 2024-04-03T03:48:47.737 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-04-03T03:48:47.773 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 161 kB/s) 2024-04-03T03:48:47.780 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-04-03T03:48:47.814 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 69 kB/s) 2024-04-03T03:48:47.818 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-04-03T03:48:47.852 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 639 kB/s) 2024-04-03T03:48:47.856 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-04-03T03:48:47.893 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 1.0 MB/s) 2024-04-03T03:48:47.898 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-04-03T03:48:47.936 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 401 kB/s) 2024-04-03T03:48:47.942 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-04-03T03:48:47.981 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 222 kB/s) 2024-04-03T03:48:47.985 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-04-03T03:48:48.024 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 702 kB/s) 2024-04-03T03:48:48.030 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-04-03T03:48:48.070 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 207 kB/s) 2024-04-03T03:48:48.076 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-04-03T03:48:48.113 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 57 kB/s) 2024-04-03T03:48:48.120 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-04-03T03:48:48.159 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 68 kB/s) 2024-04-03T03:48:48.166 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-04-03T03:48:48.203 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 41 kB/s) 2024-04-03T03:48:48.206 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-04-03T03:48:48.244 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 81 kB/s) 2024-04-03T03:48:48.248 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-04-03T03:48:48.286 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 538 kB/s) 2024-04-03T03:48:48.290 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-04-03T03:48:48.309 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 356 kB/s) 2024-04-03T03:48:48.313 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-04-03T03:48:48.332 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 714 kB/s) 2024-04-03T03:48:48.339 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-04-03T03:48:48.357 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 164 kB/s) 2024-04-03T03:48:48.361 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-04-03T03:48:48.380 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 378 kB/s) 2024-04-03T03:48:48.383 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-04-03T03:48:48.401 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 466 kB/s) 2024-04-03T03:48:48.406 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-04-03T03:48:48.425 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 115 kB/s) 2024-04-03T03:48:48.430 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-04-03T03:48:48.449 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 117 kB/s) 2024-04-03T03:48:48.456 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-04-03T03:48:48.475 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 159 kB/s) 2024-04-03T03:48:48.483 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-04-03T03:48:48.503 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 748 kB/s) 2024-04-03T03:48:48.507 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-04-03T03:48:48.527 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 763 kB/s) 2024-04-03T03:48:48.533 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-04-03T03:48:48.552 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 707 kB/s) 2024-04-03T03:48:48.557 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-04-03T03:48:48.577 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 228 kB/s) 2024-04-03T03:48:48.582 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-04-03T03:48:48.601 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 330 kB/s) 2024-04-03T03:48:48.605 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-04-03T03:48:48.625 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.6 MB/s) 2024-04-03T03:48:48.632 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-04-03T03:48:48.652 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 826 kB/s) 2024-04-03T03:48:48.656 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-04-03T03:48:48.675 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 779 kB/s) 2024-04-03T03:48:48.682 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-04-03T03:48:48.702 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 36 kB/s) 2024-04-03T03:48:48.706 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-04-03T03:48:48.725 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 253 kB/s) 2024-04-03T03:48:48.733 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-04-03T03:48:48.754 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 377 kB/s) 2024-04-03T03:48:48.761 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-04-03T03:48:48.780 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 158 kB/s) 2024-04-03T03:48:48.786 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-04-03T03:48:48.804 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 236 kB/s) 2024-04-03T03:48:48.808 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-04-03T03:48:48.827 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 108 kB/s) 2024-04-03T03:48:48.832 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-04-03T03:48:48.851 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 193 kB/s) 2024-04-03T03:48:48.856 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-04-03T03:48:48.875 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 576 kB/s) 2024-04-03T03:48:48.880 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-04-03T03:48:48.900 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 674 kB/s) 2024-04-03T03:48:48.906 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-04-03T03:48:48.925 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 986 kB/s) 2024-04-03T03:48:48.931 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-04-03T03:48:48.950 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 19 kB/s) 2024-04-03T03:48:48.956 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-04-03T03:48:48.974 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 321 kB/s) 2024-04-03T03:48:48.978 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-04-03T03:48:48.997 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 386 kB/s) 2024-04-03T03:48:49.000 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-04-03T03:48:49.018 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 268 kB/s) 2024-04-03T03:48:49.024 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-04-03T03:48:49.046 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 365 kB/s) 2024-04-03T03:48:49.049 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-04-03T03:48:49.069 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.1 MB/s) 2024-04-03T03:48:49.073 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-04-03T03:48:49.096 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 3.4 MB/s) 2024-04-03T03:48:49.104 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-04-03T03:48:49.124 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.2 MB/s) 2024-04-03T03:48:49.130 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-04-03T03:48:49.149 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 297 kB/s) 2024-04-03T03:48:49.154 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-04-03T03:48:49.173 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 225 kB/s) 2024-04-03T03:48:49.177 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-04-03T03:48:49.195 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 168 kB/s) 2024-04-03T03:48:49.198 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-04-03T03:48:49.218 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.4 MB/s) 2024-04-03T03:48:49.224 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-04-03T03:48:49.244 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 125 kB/s) 2024-04-03T03:48:49.258 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-04-03T03:48:49.291 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 262/308 kB Progress (1): 279/308 kB Progress (1): 295/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 9.1 MB/s) 2024-04-03T03:48:49.291 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-04-03T03:48:49.292 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-04-03T03:48:49.292 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-04-03T03:48:49.293 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-04-03T03:48:49.293 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-04-03T03:48:49.312 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (2): 33/171 kB | 8.2 kB Progress (3): 33/171 kB | 8.2 kB | 14 kB Progress (3): 49/171 kB | 8.2 kB | 14 kB Progress (3): 66/171 kB | 8.2 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 679 kB/s) 2024-04-03T03:48:49.312 INFO:tasks.workunit.client.0.smithi104.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 409 kB/s) 2024-04-03T03:48:49.312 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-04-03T03:48:49.312 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 82/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-04-03T03:48:49.314 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 98/171 kB Progress (2): 98/171 kB | 16/26 kB Progress (2): 115/171 kB | 16/26 kB Progress (3): 115/171 kB | 16/26 kB | 16/118 kB Progress (3): 115/171 kB | 26 kB | 16/118 kB Progress (3): 131/171 kB | 26 kB | 16/118 kB Progress (3): 131/171 kB | 26 kB | 33/118 kB Progress (3): 147/171 kB | 26 kB | 33/118 kB Progress (3): 147/171 kB | 26 kB | 49/118 kB Progress (3): 164/171 kB | 26 kB | 49/118 kB Progress (3): 164/171 kB | 26 kB | 66/118 kB Progress (3): 171 kB | 26 kB | 66/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.2 MB/s) 2024-04-03T03:48:49.315 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 171 kB | 82/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-04-03T03:48:49.315 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 171 kB | 98/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.1 MB/s) 2024-04-03T03:48:49.316 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-04-03T03:48:49.316 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 115/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 4.9 MB/s) 2024-04-03T03:48:49.316 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-04-03T03:48:49.334 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/146 kB Progress (2): 16/146 kB | 16/136 kB Progress (2): 16/146 kB | 32/136 kB Progress (2): 33/146 kB | 32/136 kB Progress (2): 33/146 kB | 49/136 kB Progress (2): 49/146 kB | 49/136 kB Progress (2): 49/146 kB | 65/136 kB Progress (2): 66/146 kB | 65/136 kB Progress (2): 66/146 kB | 81/136 kB Progress (2): 82/146 kB | 81/136 kB Progress (2): 82/146 kB | 98/136 kB Progress (3): 82/146 kB | 98/136 kB | 16/61 kB Progress (3): 82/146 kB | 114/136 kB | 16/61 kB Progress (3): 82/146 kB | 114/136 kB | 33/61 kB Progress (3): 82/146 kB | 114/136 kB | 49/61 kB Progress (3): 82/146 kB | 130/136 kB | 49/61 kB Progress (3): 98/146 kB | 130/136 kB | 49/61 kB Progress (3): 98/146 kB | 130/136 kB | 61 kB Progress (3): 98/146 kB | 136 kB | 61 kB Progress (4): 98/146 kB | 136 kB | 61 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.5 MB/s) 2024-04-03T03:48:49.334 INFO:tasks.workunit.client.0.smithi104.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.3 MB/s) 2024-04-03T03:48:49.334 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-04-03T03:48:49.335 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-04-03T03:48:49.338 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 98/146 kB | 33/501 kB Progress (2): 98/146 kB | 49/501 kB Progress (2): 98/146 kB | 66/501 kB Progress (3): 98/146 kB | 66/501 kB | 16/58 kB Progress (3): 98/146 kB | 82/501 kB | 16/58 kB Progress (3): 115/146 kB | 82/501 kB | 16/58 kB Progress (3): 115/146 kB | 98/501 kB | 16/58 kB Progress (3): 115/146 kB | 98/501 kB | 32/58 kB Progress (3): 131/146 kB | 98/501 kB | 32/58 kB Progress (3): 131/146 kB | 115/501 kB | 32/58 kB Progress (3): 131/146 kB | 115/501 kB | 49/58 kB Progress (3): 131/146 kB | 131/501 kB | 49/58 kB Progress (3): 131/146 kB | 131/501 kB | 58 kB Progress (3): 131/146 kB | 147/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.3 MB/s) 2024-04-03T03:48:49.338 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 131/146 kB | 164/501 kB Progress (2): 146 kB | 164/501 kB Progress (2): 146 kB | 180/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.2 MB/s) 2024-04-03T03:48:49.346 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 9.4 MB/s) 2024-04-03T03:48:49.354 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 63/124 kB Progress (1): 79/124 kB Progress (1): 96/124 kB Progress (1): 112/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.1 MB/s) 2024-04-03T03:48:49.413 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 20 MB/s) 2024-04-03T03:48:49.535 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:49.535 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-04-03T03:48:49.539 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-04-03T03:48:49.559 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 224 kB/s) 2024-04-03T03:48:49.561 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-04-03T03:48:49.579 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 272 kB/s) 2024-04-03T03:48:49.580 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-04-03T03:48:49.605 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 1.8 MB/s) 2024-04-03T03:48:49.608 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-04-03T03:48:49.627 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.1 MB/s) 2024-04-03T03:48:49.631 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-04-03T03:48:49.648 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 305 kB/s) 2024-04-03T03:48:49.651 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-04-03T03:48:49.669 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 218 kB/s) 2024-04-03T03:48:49.672 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-04-03T03:48:49.691 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 334 kB/s) 2024-04-03T03:48:49.694 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-04-03T03:48:49.711 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 368 kB/s) 2024-04-03T03:48:49.715 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-04-03T03:48:49.732 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-04-03T03:48:49.737 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-04-03T03:48:49.755 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 808 kB/s) 2024-04-03T03:48:49.758 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-04-03T03:48:49.776 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 114 kB/s) 2024-04-03T03:48:49.779 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-04-03T03:48:49.797 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 456 kB/s) 2024-04-03T03:48:49.800 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-04-03T03:48:49.817 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.5 MB/s) 2024-04-03T03:48:49.825 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-04-03T03:48:49.844 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 1.9 MB/s) 2024-04-03T03:48:49.844 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-04-03T03:48:49.844 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-04-03T03:48:49.845 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-04-03T03:48:49.845 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-04-03T03:48:49.845 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-04-03T03:48:49.864 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/26 kB Progress (2): 33/79 kB | 16/26 kB Progress (2): 33/79 kB | 26 kB Progress (3): 33/79 kB | 26 kB | 16/211 kB Progress (3): 49/79 kB | 26 kB | 16/211 kB Progress (3): 49/79 kB | 26 kB | 33/211 kB Progress (3): 66/79 kB | 26 kB | 33/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.4 MB/s) 2024-04-03T03:48:49.864 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-04-03T03:48:49.865 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 79 kB | 33/211 kB Progress (2): 79 kB | 49/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.0 MB/s) 2024-04-03T03:48:49.865 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-04-03T03:48:49.867 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 66/211 kB Progress (2): 66/211 kB | 16/58 kB Progress (2): 82/211 kB | 16/58 kB Progress (2): 82/211 kB | 33/58 kB Progress (3): 82/211 kB | 33/58 kB | 0/1.0 MB Progress (3): 98/211 kB | 33/58 kB | 0/1.0 MB Progress (3): 98/211 kB | 49/58 kB | 0/1.0 MB Progress (3): 98/211 kB | 58 kB | 0/1.0 MB Progress (3): 98/211 kB | 58 kB | 0/1.0 MB Progress (3): 115/211 kB | 58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 2.8 MB/s) 2024-04-03T03:48:49.871 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 115/211 kB | 0/1.0 MB Progress (2): 131/211 kB | 0/1.0 MB Progress (2): 131/211 kB | 0.1/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 164/211 kB | 0.1/1.0 MB Progress (2): 164/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 197/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 8.1 MB/s) 2024-04-03T03:48:49.884 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (2): 0.4/1.0 MB | 16/116 kB Progress (2): 0.4/1.0 MB | 33/116 kB Progress (2): 0.4/1.0 MB | 33/116 kB Progress (2): 0.4/1.0 MB | 49/116 kB Progress (2): 0.4/1.0 MB | 49/116 kB Progress (2): 0.4/1.0 MB | 66/116 kB Progress (3): 0.4/1.0 MB | 66/116 kB | 16/267 kB Progress (3): 0.4/1.0 MB | 82/116 kB | 16/267 kB Progress (3): 0.4/1.0 MB | 98/116 kB | 16/267 kB Progress (3): 0.4/1.0 MB | 98/116 kB | 33/267 kB Progress (3): 0.4/1.0 MB | 115/116 kB | 33/267 kB Progress (3): 0.4/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.4/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.4/1.0 MB | 116 kB | 49/267 kB Progress (3): 0.4/1.0 MB | 116 kB | 49/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.1 MB/s) 2024-04-03T03:48:49.892 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 0.4/1.0 MB | 65/267 kB Progress (2): 0.4/1.0 MB | 82/267 kB Progress (2): 0.5/1.0 MB | 82/267 kB Progress (2): 0.5/1.0 MB | 82/267 kB Progress (2): 0.5/1.0 MB | 98/267 kB Progress (2): 0.5/1.0 MB | 98/267 kB Progress (2): 0.5/1.0 MB | 114/267 kB Progress (2): 0.5/1.0 MB | 114/267 kB Progress (2): 0.5/1.0 MB | 114/267 kB Progress (2): 0.5/1.0 MB | 131/267 kB Progress (2): 0.5/1.0 MB | 131/267 kB Progress (2): 0.5/1.0 MB | 147/267 kB Progress (2): 0.6/1.0 MB | 147/267 kB Progress (2): 0.6/1.0 MB | 147/267 kB Progress (2): 0.6/1.0 MB | 164/267 kB Progress (2): 0.6/1.0 MB | 164/267 kB Progress (2): 0.6/1.0 MB | 180/267 kB Progress (2): 0.6/1.0 MB | 180/267 kB Progress (2): 0.6/1.0 MB | 180/267 kB Progress (2): 0.6/1.0 MB | 196/267 kB Progress (2): 0.6/1.0 MB | 196/267 kB Progress (2): 0.6/1.0 MB | 213/267 kB Progress (2): 0.6/1.0 MB | 213/267 kB Progress (2): 0.7/1.0 MB | 213/267 kB Progress (2): 0.7/1.0 MB | 229/267 kB Progress (2): 0.7/1.0 MB | 229/267 kB Progress (2): 0.7/1.0 MB | 245/267 kB Progress (2): 0.7/1.0 MB | 245/267 kB Progress (2): 0.7/1.0 MB | 262/267 kB Progress (2): 0.7/1.0 MB | 267 kB Progress (2): 0.7/1.0 MB | 267 kB Progress (2): 0.7/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 5.7 MB/s) 2024-04-03T03:48:49.906 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 16 MB/s) 2024-04-03T03:48:50.069 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-04-03T03:48:50.097 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ------------------------------------------------------------------------ 2024-04-03T03:48:50.098 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] BUILD SUCCESS 2024-04-03T03:48:50.098 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ------------------------------------------------------------------------ 2024-04-03T03:48:50.098 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Total time: 9.035 s 2024-04-03T03:48:50.098 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Finished at: 2024-04-03T03:48:50Z 2024-04-03T03:48:50.098 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ------------------------------------------------------------------------ 2024-04-03T03:48:50.128 INFO:tasks.workunit.client.0.smithi104.stderr:+ ./mvnw test -Dtest=PutObjects 2024-04-03T03:48:50.134 INFO:tasks.workunit.client.0.smithi104.stdout:Warning: JAVA_HOME environment variable is not set. 2024-04-03T03:48:51.406 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Scanning for projects... 2024-04-03T03:48:51.490 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:51.490 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-04-03T03:48:51.490 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Building jcksum 1.0 2024-04-03T03:48:51.491 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] from pom.xml 2024-04-03T03:48:51.491 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-04-03T03:48:51.754 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:51.754 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-04-03T03:48:51.875 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-04-03T03:48:51.876 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:51.876 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-04-03T03:48:51.971 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Nothing to compile - all classes are up to date 2024-04-03T03:48:51.972 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:51.972 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-04-03T03:48:51.974 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-04-03T03:48:51.974 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:51.974 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-04-03T03:48:51.979 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Nothing to compile - all classes are up to date 2024-04-03T03:48:51.979 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:51.979 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-04-03T03:48:52.177 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-04-03T03:48:52.385 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-04-03T03:48:52.696 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 15 kB/s) 2024-04-03T03:48:52.707 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-04-03T03:48:52.736 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 90 kB/s) 2024-04-03T03:48:52.747 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-04-03T03:48:52.771 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 113 kB/s) 2024-04-03T03:48:52.779 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-04-03T03:48:52.818 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 78 kB/s) 2024-04-03T03:48:52.822 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-04-03T03:48:52.872 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 64 kB/s) 2024-04-03T03:48:52.877 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-04-03T03:48:52.916 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 43 kB/s) 2024-04-03T03:48:52.920 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-04-03T03:48:52.961 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 69 kB/s) 2024-04-03T03:48:52.972 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-04-03T03:48:53.015 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 631 kB/s) 2024-04-03T03:48:53.018 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-04-03T03:48:53.019 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-04-03T03:48:53.019 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-04-03T03:48:53.020 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-04-03T03:48:53.023 INFO:tasks.workunit.client.0.smithi104.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-04-03T03:48:53.048 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 549 kB/s) 2024-04-03T03:48:53.090 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (1): 6.9/7.7 kB Progress (1): 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 108 kB/s) 2024-04-03T03:48:53.131 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 16/189 kB Progress (2): 16/189 kB | 16/103 kB Progress (3): 16/189 kB | 16/103 kB | 16/169 kB Progress (3): 33/189 kB | 16/103 kB | 16/169 kB Progress (3): 33/189 kB | 33/103 kB | 16/169 kB Progress (3): 33/189 kB | 33/103 kB | 33/169 kB Progress (3): 49/189 kB | 33/103 kB | 33/169 kB Progress (3): 49/189 kB | 33/103 kB | 49/169 kB Progress (3): 49/189 kB | 49/103 kB | 49/169 kB Progress (3): 66/189 kB | 49/103 kB | 49/169 kB Progress (3): 66/189 kB | 49/103 kB | 66/169 kB Progress (3): 66/189 kB | 66/103 kB | 66/169 kB Progress (3): 82/189 kB | 66/103 kB | 66/169 kB Progress (3): 82/189 kB | 66/103 kB | 82/169 kB Progress (3): 82/189 kB | 82/103 kB | 82/169 kB Progress (3): 98/189 kB | 82/103 kB | 82/169 kB Progress (3): 98/189 kB | 82/103 kB | 98/169 kB Progress (3): 98/189 kB | 98/103 kB | 98/169 kB Progress (3): 98/189 kB | 98/103 kB | 115/169 kB Progress (3): 98/189 kB | 103 kB | 115/169 kB Progress (3): 115/189 kB | 103 kB | 115/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 920 kB/s) 2024-04-03T03:48:53.135 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (2): 115/189 kB | 131/169 kB Progress (2): 131/189 kB | 131/169 kB Progress (2): 131/189 kB | 147/169 kB Progress (2): 147/189 kB | 147/169 kB Progress (2): 164/189 kB | 147/169 kB Progress (2): 164/189 kB | 164/169 kB Progress (2): 164/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.4 MB/s) 2024-04-03T03:48:53.140 INFO:tasks.workunit.client.0.smithi104.stdout:Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.6 MB/s) 2024-04-03T03:48:53.156 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:48:53.156 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ------------------------------------------------------- 2024-04-03T03:48:53.156 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] T E S T S 2024-04-03T03:48:53.156 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ------------------------------------------------------- 2024-04-03T03:48:53.788 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-04-03T03:48:53.843 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjects.java: starting test run: 2024-04-03T03:48:53.844 INFO:tasks.workunit.client.0.smithi104.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-04-03T03:48:53.844 INFO:tasks.workunit.client.0.smithi104.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-04-03T03:48:53.844 INFO:tasks.workunit.client.0.smithi104.stdout: EndpointUrl=https://smithi104.front.sepia.ceph.com:443 2024-04-03T03:48:53.940 INFO:tasks.workunit.client.0.smithi104.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-04-03T03:48:54.040 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: Environment Variables Read 2024-04-03T03:48:54.343 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: S3 Client Initialized 2024-04-03T03:48:54.344 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: Generating File 2024-04-03T03:48:54.344 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: File Generated 2024-04-03T03:48:54.344 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: Generating File 2024-04-03T03:48:54.344 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: File Generated 2024-04-03T03:48:54.344 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: Generating File 2024-04-03T03:48:54.442 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: File Generated 2024-04-03T03:48:54.442 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: Generating File 2024-04-03T03:48:54.442 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: File Generated 2024-04-03T03:48:54.442 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: Generating File 2024-04-03T03:48:54.443 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: File Generated 2024-04-03T03:48:54.443 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: Generating File 2024-04-03T03:48:54.443 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: File Generated 2024-04-03T03:48:54.443 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: Generated Big Files 2024-04-03T03:48:55.024 INFO:tasks.workunit.client.0.smithi104.stdout:HeadBucketResponse() 2024-04-03T03:48:55.024 INFO:tasks.workunit.client.0.smithi104.stdout:sheik is ready 2024-04-03T03:48:55.024 INFO:tasks.workunit.client.0.smithi104.stdout:DEBUG: Test Bucket Created 2024-04-03T03:48:55.146 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileNoCksum called with file-0b 2024-04-03T03:48:55.346 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileNoCksum called with file-8b 2024-04-03T03:48:55.647 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileNoCksum called with file-200b 2024-04-03T03:48:56.048 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileNoCksum called with file-21983b 2024-04-03T03:48:56.349 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileNoCksum called with file-5519b 2024-04-03T03:48:56.650 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileNoCksum called with file-204329b 2024-04-03T03:48:57.051 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileNoCksum called with file-256k 2024-04-03T03:48:57.452 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileNoCksum called with file-1m 2024-04-03T03:48:58.455 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-04-03T03:48:59.556 INFO:tasks.workunit.client.0.smithi104.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-04-03T03:49:05.670 INFO:tasks.workunit.client.0.smithi104.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-04-03T03:49:13.587 INFO:tasks.workunit.client.0.smithi104.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-04-03T03:50:20.008 INFO:tasks.workunit.client.0.smithi104.stdout:arg: file-0b 2024-04-03T03:50:20.008 INFO:tasks.workunit.client.0.smithi104.stdout:arg: file-8b 2024-04-03T03:50:20.010 INFO:tasks.workunit.client.0.smithi104.stdout:arg: file-200b 2024-04-03T03:50:20.011 INFO:tasks.workunit.client.0.smithi104.stdout:arg: file-21983b 2024-04-03T03:50:20.012 INFO:tasks.workunit.client.0.smithi104.stdout:arg: file-5519b 2024-04-03T03:50:20.013 INFO:tasks.workunit.client.0.smithi104.stdout:arg: file-204329b 2024-04-03T03:50:20.014 INFO:tasks.workunit.client.0.smithi104.stdout:arg: file-256k 2024-04-03T03:50:20.015 INFO:tasks.workunit.client.0.smithi104.stdout:arg: file-1m 2024-04-03T03:50:20.016 INFO:tasks.workunit.client.0.smithi104.stdout:arg: file-1038757b 2024-04-03T03:50:20.082 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileCksum called with file-0b 2024-04-03T03:50:20.282 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjectResponse 2024-04-03T03:50:20.386 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileCksum called with file-8b 2024-04-03T03:50:20.482 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjectResponse 2024-04-03T03:50:20.583 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileCksum called with file-200b 2024-04-03T03:50:20.783 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjectResponse 2024-04-03T03:50:20.983 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileCksum called with file-21983b 2024-04-03T03:50:21.083 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjectResponse 2024-04-03T03:50:21.184 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileCksum called with file-5519b 2024-04-03T03:50:21.384 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjectResponse 2024-04-03T03:50:21.484 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileCksum called with file-204329b 2024-04-03T03:50:21.784 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjectResponse 2024-04-03T03:50:21.885 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileCksum called with file-256k 2024-04-03T03:50:22.185 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjectResponse 2024-04-03T03:50:22.285 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileCksum called with file-1m 2024-04-03T03:50:23.086 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjectResponse 2024-04-03T03:50:23.386 INFO:tasks.workunit.client.0.smithi104.stdout:putObjectFromFileCksum called with file-1038757b 2024-04-03T03:50:24.287 INFO:tasks.workunit.client.0.smithi104.stdout:PutObjectResponse 2024-04-03T03:50:24.588 INFO:tasks.workunit.client.0.smithi104.stdout:mpuObjectFromFileCksum called with file-5m 2024-04-03T03:50:30.796 INFO:tasks.workunit.client.0.smithi104.stdout:mpuObjectFromFileCksum called with file-10m 2024-04-03T03:50:39.906 INFO:tasks.workunit.client.0.smithi104.stdout:mpuObjectFromFileCksum called with file-100m 2024-04-03T03:52:28.287 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 214.5 s -- in io.ceph.jcksum.PutObjects 2024-04-03T03:52:28.311 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:52:28.311 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Results: 2024-04-03T03:52:28.311 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:52:28.311 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-04-03T03:52:28.311 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] 2024-04-03T03:52:28.314 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ------------------------------------------------------------------------ 2024-04-03T03:52:28.314 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] BUILD SUCCESS 2024-04-03T03:52:28.314 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ------------------------------------------------------------------------ 2024-04-03T03:52:28.315 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Total time: 03:36 min 2024-04-03T03:52:28.315 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] Finished at: 2024-04-03T03:52:28Z 2024-04-03T03:52:28.315 INFO:tasks.workunit.client.0.smithi104.stdout:[INFO] ------------------------------------------------------------------------ 2024-04-03T03:52:28.335 INFO:tasks.workunit.client.0.smithi104.stderr:+ exit 2024-04-03T03:52:28.335 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:52:28.335 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:52:28.389 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-04-03T03:52:28.389 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-03T03:52:28.754 DEBUG:teuthology.parallel:result is None 2024-04-03T03:52:28.755 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T03:52:28.767 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T03:52:28.767 DEBUG:teuthology.orchestra.run.smithi104:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:52:28.814 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T03:52:28.814 INFO:teuthology.run_tasks:Running task workunit... 2024-04-03T03:52:28.824 INFO:tasks.workunit:Pulling workunits from ref 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:52:28.824 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-03T03:52:28.824 DEBUG:teuthology.orchestra.run.smithi104:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:52:28.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:52:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-03T03:52:28.863 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:52:28.910 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-03T03:52:28.910 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-03T03:52:28.958 INFO:tasks.workunit:timeout=3h 2024-04-03T03:52:28.958 INFO:tasks.workunit:cleanup=True 2024-04-03T03:52:28.959 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:52:29.008 INFO:tasks.workunit.client.0.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-03T03:53:45.399 INFO:tasks.workunit.client.0.smithi104.stderr:Note: switching to '888a4a757aa90aa5ed4fb3291576474bc07507ce'. 2024-04-03T03:53:45.399 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:53:45.399 INFO:tasks.workunit.client.0.smithi104.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-03T03:53:45.399 INFO:tasks.workunit.client.0.smithi104.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-03T03:53:45.399 INFO:tasks.workunit.client.0.smithi104.stderr:state without impacting any branches by switching back to a branch. 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr: git switch -c 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr:Or undo this operation with: 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr: git switch - 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:53:45.400 INFO:tasks.workunit.client.0.smithi104.stderr:HEAD is now at 888a4a757aa Merge branch 'pr-56562' into wip-cbodley-testing 2024-04-03T03:53:45.405 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-03T03:53:45.453 INFO:tasks.workunit.client.0.smithi104.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-03T03:53:45.457 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T03:53:45.457 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-03T03:53:45.517 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-03T03:53:45.573 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-03T03:53:45.622 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T03:53:45.624 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T03:53:45.624 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-03T03:53:45.668 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T03:53:45.672 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:53:45.673 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-03T03:53:45.720 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-04-03T03:53:45.721 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-04-03T03:53:45.722 DEBUG:teuthology.orchestra.run.smithi104:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-04-03T03:53:45.776 INFO:tasks.workunit.client.0.smithi104.stdout:INFO: fully qualified domain name: smithi104.front.sepia.ceph.com 2024-04-03T03:53:45.776 INFO:tasks.workunit.client.0.smithi104.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-04-03T03:53:45.776 INFO:tasks.workunit.client.0.smithi104.stdout:== TESTING NON-VERSIONED BUCKET == 2024-04-03T03:53:49.057 INFO:tasks.workunit.client.0.smithi104.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-04-03T03:53:49.272 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting pip 2024-04-03T03:53:49.279 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-04-03T03:53:49.316 INFO:tasks.workunit.client.0.smithi104.stdout:Installing collected packages: pip 2024-04-03T03:53:49.316 INFO:tasks.workunit.client.0.smithi104.stdout: Attempting uninstall: pip 2024-04-03T03:53:49.316 INFO:tasks.workunit.client.0.smithi104.stdout: Found existing installation: pip 22.0.2 2024-04-03T03:53:49.574 INFO:tasks.workunit.client.0.smithi104.stdout: Uninstalling pip-22.0.2: 2024-04-03T03:53:49.580 INFO:tasks.workunit.client.0.smithi104.stdout: Successfully uninstalled pip-22.0.2 2024-04-03T03:53:50.583 INFO:tasks.workunit.client.0.smithi104.stdout:Successfully installed pip-24.0 2024-04-03T03:53:51.557 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting boto3 2024-04-03T03:53:51.558 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached boto3-1.34.76-py3-none-any.whl.metadata (6.6 kB) 2024-04-03T03:53:52.050 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting botocore<1.35.0,>=1.34.76 (from boto3) 2024-04-03T03:53:52.051 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached botocore-1.34.76-py3-none-any.whl.metadata (5.7 kB) 2024-04-03T03:53:52.117 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-04-03T03:53:52.118 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-04-03T03:53:52.183 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-04-03T03:53:52.185 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached s3transfer-0.10.1-py3-none-any.whl.metadata (1.7 kB) 2024-04-03T03:53:52.255 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T03:53:52.257 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-04-03T03:53:52.364 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T03:53:52.365 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached urllib3-2.2.1-py3-none-any.whl.metadata (6.4 kB) 2024-04-03T03:53:52.537 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T03:53:52.538 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-04-03T03:53:52.550 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached boto3-1.34.76-py3-none-any.whl (139 kB) 2024-04-03T03:53:52.551 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached botocore-1.34.76-py3-none-any.whl (12.1 MB) 2024-04-03T03:53:52.572 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-04-03T03:53:52.573 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached s3transfer-0.10.1-py3-none-any.whl (82 kB) 2024-04-03T03:53:52.575 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-04-03T03:53:52.576 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached urllib3-2.2.1-py3-none-any.whl (121 kB) 2024-04-03T03:53:52.578 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-04-03T03:53:52.669 INFO:tasks.workunit.client.0.smithi104.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-04-03T03:53:53.796 INFO:tasks.workunit.client.0.smithi104.stdout:Successfully installed boto3-1.34.76 botocore-1.34.76 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.1 six-1.16.0 urllib3-2.2.1 2024-04-03T03:53:54.118 INFO:tasks.workunit.client.0.smithi104.stdout:INFO: creating user 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout:{ 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: "user_id": "testid", 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: "display_name": "M. Tester", 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: "email": "tester@ceph.com", 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: "suspended": 0, 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: "max_buckets": 1000, 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: "subusers": [], 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: "keys": [ 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: { 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: "user": "testid", 2024-04-03T03:53:54.483 INFO:tasks.workunit.client.0.smithi104.stdout: "access_key": "0555b35654ad1656d804", 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "active": true 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: } 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: ], 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "swift_keys": [], 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "caps": [], 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "default_placement": "", 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "default_storage_class": "", 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "placement_tags": [], 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "bucket_quota": { 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "enabled": false, 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:53:54.484 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size": -1, 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "max_objects": -1 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "user_quota": { 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "enabled": false, 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size": -1, 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "max_objects": -1 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: }, 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "temp_url_keys": [], 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "type": "rgw", 2024-04-03T03:53:54.485 INFO:tasks.workunit.client.0.smithi104.stdout: "mfa_ids": [] 2024-04-03T03:53:54.486 INFO:tasks.workunit.client.0.smithi104.stdout:} 2024-04-03T03:53:54.486 INFO:tasks.workunit.client.0.smithi104.stdout: 2024-04-03T03:53:59.260 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:53:59.260 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:53:59.421 INFO:tasks.workunit.client.0.smithi104.stderr:5+0 records in 2024-04-03T03:53:59.421 INFO:tasks.workunit.client.0.smithi104.stderr:5+0 records out 2024-04-03T03:53:59.422 INFO:tasks.workunit.client.0.smithi104.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0219637 s, 239 MB/s 2024-04-03T03:53:59.427 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:53:59.427 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:53:59.538 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:53:59.538 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:01.813 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:01.813 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:04.259 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:04.259 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:06.654 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:06.655 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:09.051 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:09.051 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:11.426 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:11.426 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:13.792 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:13.792 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:16.180 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:16.180 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:18.539 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:18.539 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:20.944 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:20.944 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:23.309 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:23.309 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:25.701 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:28.041 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:28.041 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:30.404 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:54:30.405 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:54:30.658 INFO:tasks.workunit.client.0.smithi104.stdout:bucket nams is reupload-bkt-105755 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:endpoint is https://smithi104.front.sepia.ceph.com:443 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:start UploadId=2~rltD6laaSIPLE9nb9hLoWEUKumm9yin 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 1 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 1 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 2} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.659 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.660 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.660 INFO:tasks.workunit.client.0.smithi104.stdout:phase 2 uploaded part {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1} 2024-04-03T03:54:30.660 INFO:tasks.workunit.client.0.smithi104.stdout:completing multipart upload, parts=[{'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 1}, {'ETag': '"771da2704c19bd95c359fe00aa0a8771"', 'PartNumber': 2}] 2024-04-03T03:54:32.452 INFO:tasks.workunit.client.0.smithi104.stdout:radosgw-admin bucket radoslist: 2024-04-03T03:54:32.452 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3_mpu_test4 2024-04-03T03:54:32.452 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3__multipart_mpu_test4.2~rltD6laaSIPLE9nb9hLoWEUKumm9yin.2 2024-04-03T03:54:32.452 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3__multipart_mpu_test4.EikpAZYV1_MEsMAa63VEDA-_-gRdvAtT.1 2024-04-03T03:54:32.452 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3__shadow_mpu_test4.2~rltD6laaSIPLE9nb9hLoWEUKumm9yin.2_1 2024-04-03T03:54:32.452 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3__shadow_mpu_test4.EikpAZYV1_MEsMAa63VEDA-_-gRdvAtT.1_1 2024-04-03T03:54:32.755 INFO:tasks.workunit.client.0.smithi104.stdout:rados ls: 2024-04-03T03:54:32.756 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3_mpu_test4 2024-04-03T03:54:32.756 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3__multipart_mpu_test4.2~rltD6laaSIPLE9nb9hLoWEUKumm9yin.2 2024-04-03T03:54:32.756 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3__multipart_mpu_test4.EikpAZYV1_MEsMAa63VEDA-_-gRdvAtT.1 2024-04-03T03:54:32.756 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3__shadow_mpu_test4.2~rltD6laaSIPLE9nb9hLoWEUKumm9yin.2_1 2024-04-03T03:54:32.756 INFO:tasks.workunit.client.0.smithi104.stdout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3__shadow_mpu_test4.EikpAZYV1_MEsMAa63VEDA-_-gRdvAtT.1_1 2024-04-03T03:54:32.826 INFO:tasks.workunit.client.0.smithi104.stdout:== PASSED == 2024-04-03T03:54:32.827 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T03:54:32.827 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T03:54:32.880 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-04-03T03:54:32.880 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-03T03:54:33.300 DEBUG:teuthology.parallel:result is None 2024-04-03T03:54:33.300 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T03:54:33.312 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T03:54:33.312 DEBUG:teuthology.orchestra.run.smithi104:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:54:33.359 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T03:54:33.359 INFO:teuthology.run_tasks:Running task ragweed... 2024-04-03T03:54:33.374 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-04-03T03:54:33.374 INFO:tasks.ragweed:Downloading ragweed... 2024-04-03T03:54:33.374 INFO:tasks.ragweed:Using branch 'wip-cbodley-testing' for ragweed 2024-04-03T03:54:33.374 DEBUG:teuthology.orchestra.run.smithi104:> git clone -b wip-cbodley-testing https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-04-03T03:54:33.407 INFO:teuthology.orchestra.run.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-04-03T03:54:33.464 INFO:teuthology.orchestra.run.smithi104.stderr:fatal: Remote branch wip-cbodley-testing not found in upstream origin 2024-04-03T03:54:33.464 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-04-03T03:54:33.466 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-04-03T03:54:33.466 DEBUG:teuthology.orchestra.run.smithi104:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-04-03T03:54:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-04-03T03:54:33.697 INFO:tasks.ragweed:Creating rgw users... 2024-04-03T03:54:33.697 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-04-03T03:54:33.697 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key YSUPYGGDMORYTKZGLNVY --secret pYUS36QFebkSxFNI8FENaoZjVmdCAvpQyPEtiDd3yhxGpvblVJ1ueQ== --email ragweed.client.0+test@test.test --system false 2024-04-03T03:54:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:54:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:54:33.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.840+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.840+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.840+0000 7f1cf9420980 20 realm 2024-04-03T03:54:33.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.840+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.840+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.840+0000 7f1cf9420980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:54:33.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.840+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.840+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.840+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.844+0000 7f1cf9420980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:54:33.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.844+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.844+0000 7f1cf9420980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:54:33.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.844+0000 7f1cf9420980 20 searching for the correct realm 2024-04-03T03:54:33.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.848+0000 7f1cf773c640 0 -- 172.21.15.104:0/195011681 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f1cf005ea40 msgr2=0x7f1cf0055260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:54:33.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.856+0000 7f1cf773c640 0 -- 172.21.15.104:0/195011681 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x7f1cf005ea40 msgr2=0x7f1bc007aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:54:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:54:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:54:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:54:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:54:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:54:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:54:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:54:33.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.864+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 zone default found 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 4 Realm: () 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 zonegroup default 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 started sync module instance, tier type = 2024-04-03T03:54:33.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.868+0000 7f1cf9420980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:54:33.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.884+0000 7f1cf9420980 20 add_watcher() i=0 2024-04-03T03:54:33.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.884+0000 7f1cf9420980 20 add_watcher() i=1 2024-04-03T03:54:33.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.884+0000 7f1cf9420980 20 add_watcher() i=2 2024-04-03T03:54:33.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.884+0000 7f1cf9420980 20 add_watcher() i=3 2024-04-03T03:54:33.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.884+0000 7f1cf9420980 20 add_watcher() i=4 2024-04-03T03:54:33.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.884+0000 7f1cf9420980 20 add_watcher() i=5 2024-04-03T03:54:33.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.884+0000 7f1cf9420980 20 add_watcher() i=6 2024-04-03T03:54:33.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.884+0000 7f1cf9420980 20 add_watcher() i=7 2024-04-03T03:54:33.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.884+0000 7f1cf9420980 2 all 8 watchers are set, enabling cache 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1badfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 5 note: GC not initialized 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1bacfe1640 20 reqs_thread_entry: start 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 20 init_complete bucket index max shards: 11 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 20 Filter name: none 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1ba5ffb640 20 reqs_thread_entry: start 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-04-03T03:54:33.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-04-03T03:54:33.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-04-03T03:54:33.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-04-03T03:54:33.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-04-03T03:54:33.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-04-03T03:54:33.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 10 cache get: name=default.rgw.meta+users.keys+YSUPYGGDMORYTKZGLNVY : miss 2024-04-03T03:54:33.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.888+0000 7f1cf9420980 20 rados->read ofs=0 len=0 2024-04-03T03:54:33.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1cf9420980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:33.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1cf9420980 10 cache put: name=default.rgw.meta+users.keys+YSUPYGGDMORYTKZGLNVY info.flags=0x0 2024-04-03T03:54:33.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1cf9420980 10 adding default.rgw.meta+users.keys+YSUPYGGDMORYTKZGLNVY to cache LRU end 2024-04-03T03:54:33.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1cf9420980 10 cache get: name=default.rgw.meta+users.keys+YSUPYGGDMORYTKZGLNVY : hit (negative entry) 2024-04-03T03:54:33.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1cf9420980 10 cache get: name=default.rgw.meta+users.keys+YSUPYGGDMORYTKZGLNVY : hit (negative entry) 2024-04-03T03:54:33.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1cf9420980 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-04-03T03:54:33.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1cf9420980 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-04-03T03:54:33.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1cf9420980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-04-03T03:54:33.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1bda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758614 cookie 93978284050480 notifier 5594 bl.length()=642 2024-04-03T03:54:33.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1bda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-04-03T03:54:33.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.892+0000 7f1bda7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-04-03T03:54:33.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.900+0000 7f1cf9420980 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-04-03T03:54:33.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.900+0000 7f1cf9420980 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-04-03T03:54:33.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.900+0000 7f1cf9420980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-04-03T03:54:33.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.900+0000 7f1bd9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758601 cookie 93978284079872 notifier 5594 bl.length()=202 2024-04-03T03:54:33.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.900+0000 7f1bd9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-04-03T03:54:33.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.900+0000 7f1bd9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-04-03T03:54:33.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.904+0000 7f1cf9420980 10 cache put: name=default.rgw.meta+users.keys+YSUPYGGDMORYTKZGLNVY info.flags=0x7 2024-04-03T03:54:33.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.904+0000 7f1cf9420980 10 moving default.rgw.meta+users.keys+YSUPYGGDMORYTKZGLNVY to cache LRU end 2024-04-03T03:54:33.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.904+0000 7f1cf9420980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:YSUPYGGDMORYTKZGLNVY, ofs0, ns] 2024-04-03T03:54:33.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.904+0000 7f1bd9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758615 cookie 93978284052688 notifier 5594 bl.length()=190 2024-04-03T03:54:33.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.904+0000 7f1bd9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YSUPYGGDMORYTKZGLNVY info.flags=0x7 2024-04-03T03:54:33.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.904+0000 7f1bd9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YSUPYGGDMORYTKZGLNVY to cache LRU end 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout: "user_id": "ragweed.client.0", 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout: "display_name": "Mr. ragweed.client.0", 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout: "email": "ragweed.client.0+test@test.test", 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout: "suspended": 0, 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout: "max_buckets": 1000, 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout: "subusers": [], 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout: "keys": [ 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T03:54:33.893 INFO:teuthology.orchestra.run.smithi104.stdout: "user": "ragweed.client.0", 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "access_key": "YSUPYGGDMORYTKZGLNVY", 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "secret_key": "pYUS36QFebkSxFNI8FENaoZjVmdCAvpQyPEtiDd3yhxGpvblVJ1ueQ==", 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "active": true 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "swift_keys": [], 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": [], 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "default_placement": "", 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "default_storage_class": "", 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "placement_tags": [], 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "bucket_quota": { 2024-04-03T03:54:33.894 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: "user_quota": { 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T03:54:33.895 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:54:33.896 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T03:54:33.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T03:54:33.896 INFO:teuthology.orchestra.run.smithi104.stdout: "temp_url_keys": [], 2024-04-03T03:54:33.896 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "rgw", 2024-04-03T03:54:33.896 INFO:teuthology.orchestra.run.smithi104.stdout: "mfa_ids": [] 2024-04-03T03:54:33.896 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T03:54:33.896 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:54:33.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.908+0000 7f1badfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:54:33.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.912+0000 7f1cf9420980 20 remove_watcher() i=0 2024-04-03T03:54:33.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.912+0000 7f1cf9420980 2 removed watcher, disabling cache 2024-04-03T03:54:33.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.916+0000 7f1cf9420980 20 remove_watcher() i=1 2024-04-03T03:54:33.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.920+0000 7f1cf9420980 20 remove_watcher() i=2 2024-04-03T03:54:33.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.920+0000 7f1cf9420980 20 remove_watcher() i=3 2024-04-03T03:54:33.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.924+0000 7f1cf9420980 20 remove_watcher() i=4 2024-04-03T03:54:33.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.924+0000 7f1cf9420980 20 remove_watcher() i=5 2024-04-03T03:54:33.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.928+0000 7f1cf9420980 20 remove_watcher() i=6 2024-04-03T03:54:33.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:33.928+0000 7f1cf9420980 20 remove_watcher() i=7 2024-04-03T03:54:33.928 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-04-03T03:54:33.928 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key EPLJSFTYVDNZPXTLFVQX --secret dcTZFwgiTxjnuVOiW1EeX7v1OMEbdR63rGN4L7ffwp5ga7NguaXJdg== --email sysuser.client.0+test@test.test --system true 2024-04-03T03:54:33.967 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:54:33.968 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:54:34.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.020+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 20 realm 2024-04-03T03:54:34.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:54:34.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:54:34.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.024+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.028+0000 7f8c7d88c980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:54:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.028+0000 7f8c7d88c980 20 searching for the correct realm 2024-04-03T03:54:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.032+0000 7f8c7b3a7640 0 -- 172.21.15.104:0/3675914533 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x5572dd79eb10 msgr2=0x5572dd7a0fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:54:34.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.040+0000 7f8c7bba8640 0 -- 172.21.15.104:0/3675914533 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f8c74112070 msgr2=0x7f8c740efc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:54:34.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:54:34.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:54:34.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:54:34.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:54:34.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:54:34.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:54:34.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:54:34.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:54:34.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 zone default found 2024-04-03T03:54:34.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 4 Realm: () 2024-04-03T03:54:34.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:54:34.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:54:34.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:54:34.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 zonegroup default 2024-04-03T03:54:34.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.048+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.052+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.052+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.052+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.052+0000 7f8c7d88c980 20 started sync module instance, tier type = 2024-04-03T03:54:34.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.052+0000 7f8c7d88c980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:54:34.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.068+0000 7f8c7d88c980 20 add_watcher() i=0 2024-04-03T03:54:34.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.068+0000 7f8c7d88c980 20 add_watcher() i=1 2024-04-03T03:54:34.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.068+0000 7f8c7d88c980 20 add_watcher() i=2 2024-04-03T03:54:34.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.068+0000 7f8c7d88c980 20 add_watcher() i=3 2024-04-03T03:54:34.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.068+0000 7f8c7d88c980 20 add_watcher() i=4 2024-04-03T03:54:34.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.068+0000 7f8c7d88c980 20 add_watcher() i=5 2024-04-03T03:54:34.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.068+0000 7f8c7d88c980 20 add_watcher() i=6 2024-04-03T03:54:34.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.068+0000 7f8c7d88c980 20 add_watcher() i=7 2024-04-03T03:54:34.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.068+0000 7f8c7d88c980 2 all 8 watchers are set, enabling cache 2024-04-03T03:54:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8b31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:54:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:54:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:54:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 5 note: GC not initialized 2024-04-03T03:54:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8b30fe1640 20 reqs_thread_entry: start 2024-04-03T03:54:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 init_complete bucket index max shards: 11 2024-04-03T03:54:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 Filter name: none 2024-04-03T03:54:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8aaa7fc640 20 reqs_thread_entry: start 2024-04-03T03:54:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-04-03T03:54:34.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-04-03T03:54:34.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-04-03T03:54:34.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-04-03T03:54:34.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-04-03T03:54:34.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-04-03T03:54:34.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 cache get: name=default.rgw.meta+users.keys+EPLJSFTYVDNZPXTLFVQX : miss 2024-04-03T03:54:34.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 rados->read ofs=0 len=0 2024-04-03T03:54:34.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:54:34.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 cache put: name=default.rgw.meta+users.keys+EPLJSFTYVDNZPXTLFVQX info.flags=0x0 2024-04-03T03:54:34.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 adding default.rgw.meta+users.keys+EPLJSFTYVDNZPXTLFVQX to cache LRU end 2024-04-03T03:54:34.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 cache get: name=default.rgw.meta+users.keys+EPLJSFTYVDNZPXTLFVQX : hit (negative entry) 2024-04-03T03:54:34.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.072+0000 7f8c7d88c980 10 cache get: name=default.rgw.meta+users.keys+EPLJSFTYVDNZPXTLFVQX : hit (negative entry) 2024-04-03T03:54:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.076+0000 7f8c7d88c980 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-04-03T03:54:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.076+0000 7f8c7d88c980 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-04-03T03:54:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.076+0000 7f8c7d88c980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-04-03T03:54:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.076+0000 7f8b5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758602 cookie 93951830393392 notifier 5934 bl.length()=642 2024-04-03T03:54:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.076+0000 7f8b5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-04-03T03:54:34.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.076+0000 7f8b5effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-04-03T03:54:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.080+0000 7f8c7d88c980 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-04-03T03:54:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.080+0000 7f8c7d88c980 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-04-03T03:54:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.080+0000 7f8c7d88c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-04-03T03:54:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.080+0000 7f8b5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758616 cookie 93951830410352 notifier 5934 bl.length()=202 2024-04-03T03:54:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.080+0000 7f8b5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-04-03T03:54:34.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.080+0000 7f8b5effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-04-03T03:54:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.084+0000 7f8c7d88c980 10 cache put: name=default.rgw.meta+users.keys+EPLJSFTYVDNZPXTLFVQX info.flags=0x7 2024-04-03T03:54:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.084+0000 7f8c7d88c980 10 moving default.rgw.meta+users.keys+EPLJSFTYVDNZPXTLFVQX to cache LRU end 2024-04-03T03:54:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.084+0000 7f8c7d88c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:EPLJSFTYVDNZPXTLFVQX, ofs0, ns] 2024-04-03T03:54:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.084+0000 7f8b5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758656 cookie 93951830414256 notifier 5934 bl.length()=190 2024-04-03T03:54:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.084+0000 7f8b5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EPLJSFTYVDNZPXTLFVQX info.flags=0x7 2024-04-03T03:54:34.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.084+0000 7f8b5effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EPLJSFTYVDNZPXTLFVQX to cache LRU end 2024-04-03T03:54:34.073 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "user_id": "sysuser.client.0", 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "display_name": "Mr. sysuser.client.0", 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "email": "sysuser.client.0+test@test.test", 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "suspended": 0, 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "max_buckets": 1000, 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "subusers": [], 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "keys": [ 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "user": "sysuser.client.0", 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "access_key": "EPLJSFTYVDNZPXTLFVQX", 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "secret_key": "dcTZFwgiTxjnuVOiW1EeX7v1OMEbdR63rGN4L7ffwp5ga7NguaXJdg==", 2024-04-03T03:54:34.074 INFO:teuthology.orchestra.run.smithi104.stdout: "active": true 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "swift_keys": [], 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": [], 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "system": true, 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "default_placement": "", 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "default_storage_class": "", 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "placement_tags": [], 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "bucket_quota": { 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T03:54:34.075 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "user_quota": { 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "temp_url_keys": [], 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "rgw", 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: "mfa_ids": [] 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T03:54:34.076 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:54:34.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.088+0000 7f8b31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:54:34.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.092+0000 7f8c7d88c980 20 remove_watcher() i=0 2024-04-03T03:54:34.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.092+0000 7f8c7d88c980 2 removed watcher, disabling cache 2024-04-03T03:54:34.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.096+0000 7f8c7d88c980 20 remove_watcher() i=1 2024-04-03T03:54:34.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.096+0000 7f8c7d88c980 20 remove_watcher() i=2 2024-04-03T03:54:34.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.100+0000 7f8c7d88c980 20 remove_watcher() i=3 2024-04-03T03:54:34.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.100+0000 7f8c7d88c980 20 remove_watcher() i=4 2024-04-03T03:54:34.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.100+0000 7f8c7d88c980 20 remove_watcher() i=5 2024-04-03T03:54:34.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.104+0000 7f8c7d88c980 20 remove_watcher() i=6 2024-04-03T03:54:34.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:54:34.104+0000 7f8c7d88c980 20 remove_watcher() i=7 2024-04-03T03:54:34.104 INFO:tasks.ragweed:Configuring ragweed... 2024-04-03T03:54:34.104 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:54:34.104 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-04-03T03:54:34.151 INFO:tasks.ragweed:Configuring boto... 2024-04-03T03:54:34.152 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:54:34.152 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-04-03T03:54:34.199 DEBUG:teuthology.orchestra.run.smithi104:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-04-03T03:54:34.381 INFO:teuthology.orchestra.run.smithi104.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-04-03T03:54:34.565 INFO:teuthology.orchestra.run.smithi104.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-04-03T03:54:35.055 INFO:teuthology.orchestra.run.smithi104.stdout:py installdeps: -rrequirements.txt 2024-04-03T03:54:38.408 INFO:teuthology.orchestra.run.smithi104.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-04-03T03:54:40.984 INFO:teuthology.orchestra.run.smithi104.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=c2cfe418c7eede3d0b2c3e30b3d08efd47d0083a06f27dd3f712c36fa35bb543,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-04-03T03:54:40.984 INFO:teuthology.orchestra.run.smithi104.stdout:py run-test-pre: PYTHONHASHSEED='3042050633' 2024-04-03T03:54:40.984 INFO:teuthology.orchestra.run.smithi104.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-04-03T03:54:41.154 INFO:teuthology.orchestra.run.smithi104.stdout:============================= test session starts ============================== 2024-04-03T03:54:41.154 INFO:teuthology.orchestra.run.smithi104.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-04-03T03:54:41.154 INFO:teuthology.orchestra.run.smithi104.stdout:cachedir: .tox/py/.pytest_cache 2024-04-03T03:54:41.154 INFO:teuthology.orchestra.run.smithi104.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-04-03T03:54:41.309 INFO:teuthology.orchestra.run.smithi104.stdout:collecting ... collected 9 items 2024-04-03T03:54:41.309 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:54:52.849 INFO:teuthology.orchestra.run.smithi104.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-04-03T03:55:05.841 INFO:teuthology.orchestra.run.smithi104.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-04-03T03:55:17.883 INFO:teuthology.orchestra.run.smithi104.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-04-03T03:55:31.242 INFO:teuthology.orchestra.run.smithi104.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-04-03T03:55:44.159 INFO:teuthology.orchestra.run.smithi104.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-04-03T03:56:09.641 INFO:teuthology.orchestra.run.smithi104.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-04-03T03:56:34.992 INFO:teuthology.orchestra.run.smithi104.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-04-03T03:56:58.565 INFO:teuthology.orchestra.run.smithi104.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-04-03T03:57:43.252 INFO:teuthology.orchestra.run.smithi104.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-04-03T03:57:43.252 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:57:43.252 INFO:teuthology.orchestra.run.smithi104.stdout:=============================== warnings summary =============================== 2024-04-03T03:57:43.252 INFO:teuthology.orchestra.run.smithi104.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-04-03T03:57:43.253 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-04-03T03:57:43.253 INFO:teuthology.orchestra.run.smithi104.stdout: import imp 2024-04-03T03:57:43.253 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T03:57:43.253 INFO:teuthology.orchestra.run.smithi104.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-04-03T03:57:43.253 INFO:teuthology.orchestra.run.smithi104.stdout:=================== 9 passed, 1 warning in 182.10s (0:03:02) =================== 2024-04-03T03:57:43.301 INFO:teuthology.orchestra.run.smithi104.stdout:___________________________________ summary ____________________________________ 2024-04-03T03:57:43.301 INFO:teuthology.orchestra.run.smithi104.stdout: py: commands succeeded 2024-04-03T03:57:43.301 INFO:teuthology.orchestra.run.smithi104.stdout: congratulations :) 2024-04-03T03:57:43.322 INFO:tasks.ragweed:Cleaning up boto... 2024-04-03T03:57:43.322 DEBUG:teuthology.orchestra.run.smithi104:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-04-03T03:57:43.328 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-04-03T03:57:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:57:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:57:43.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 realm 2024-04-03T03:57:43.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:57:43.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:57:43.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.474+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.478+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:57:43.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.478+0000 7f0ccf7e6980 20 searching for the correct realm 2024-04-03T03:57:43.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.482+0000 7f0ccdb02640 0 -- 172.21.15.104:0/3156223268 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f0cc8027040 msgr2=0x7f0cc8038a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:57:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.486+0000 7f0cccb00640 0 -- 172.21.15.104:0/3156223268 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f0cc8027040 msgr2=0x7f0b9807c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:57:43.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:57:43.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:57:43.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:57:43.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:57:43.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:57:43.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:57:43.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:57:43.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:57:43.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 zone default found 2024-04-03T03:57:43.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 4 Realm: () 2024-04-03T03:57:43.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:57:43.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:57:43.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:57:43.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 zonegroup default 2024-04-03T03:57:43.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 started sync module instance, tier type = 2024-04-03T03:57:43.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.498+0000 7f0ccf7e6980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:57:43.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.514+0000 7f0ccf7e6980 20 add_watcher() i=0 2024-04-03T03:57:43.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.514+0000 7f0ccf7e6980 20 add_watcher() i=1 2024-04-03T03:57:43.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.514+0000 7f0ccf7e6980 20 add_watcher() i=2 2024-04-03T03:57:43.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.514+0000 7f0ccf7e6980 20 add_watcher() i=3 2024-04-03T03:57:43.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.514+0000 7f0ccf7e6980 20 add_watcher() i=4 2024-04-03T03:57:43.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.514+0000 7f0ccf7e6980 20 add_watcher() i=5 2024-04-03T03:57:43.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.514+0000 7f0ccf7e6980 20 add_watcher() i=6 2024-04-03T03:57:43.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.514+0000 7f0ccf7e6980 20 add_watcher() i=7 2024-04-03T03:57:43.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.514+0000 7f0ccf7e6980 2 all 8 watchers are set, enabling cache 2024-04-03T03:57:43.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.518+0000 7f0b83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:57:43.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.518+0000 7f0ccf7e6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:57:43.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.518+0000 7f0ccf7e6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:57:43.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.598+0000 7f0b82fe5640 20 reqs_thread_entry: start 2024-04-03T03:57:43.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.598+0000 7f0ccf7e6980 20 init_complete bucket index max shards: 11 2024-04-03T03:57:43.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.598+0000 7f0ccf7e6980 20 Filter name: none 2024-04-03T03:57:43.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.598+0000 7f0b80fe1640 20 reqs_thread_entry: start 2024-04-03T03:57:43.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.598+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-04-03T03:57:43.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.598+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=453 2024-04-03T03:57:43.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-04-03T03:57:43.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-04-03T03:57:43.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:43.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4 : miss 2024-04-03T03:57:43.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:57:43.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4 info.flags=0x17 2024-04-03T03:57:43.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4 to cache LRU end 2024-04-03T03:57:43.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:43.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:43.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4 2024-04-03T03:57:43.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.602+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-04-03T03:57:43.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.606+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-04-03T03:57:43.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.606+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-04-03T03:57:43.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.606+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-04-03T03:57:43.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.606+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-04-03T03:57:43.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.606+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-04-03T03:57:43.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.606+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-04-03T03:57:43.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.610+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-04-03T03:57:43.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.610+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-04-03T03:57:43.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.614+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x560c6d5bffe8 s->prefetch_data=0 2024-04-03T03:57:43.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.614+0000 7f0ccf7e6980 10 manifest: total_size = 5026 2024-04-03T03:57:43.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.614+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4807064518723147682 2024-04-03T03:57:43.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.614+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x560c6d5bffe8 s->prefetch_data=0 2024-04-03T03:57:43.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.614+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d5bffe8 2024-04-03T03:57:43.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.614+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4.1 2024-04-03T03:57:43.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.618+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.618+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5026 stripe_ofs=5026 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.618+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4807064518723147682 2024-04-03T03:57:43.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.618+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.618+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.ibZ4JmVdTzq9swXTv1uIKIgJcKpolQK_0 2024-04-03T03:57:43.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.618+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-04-03T03:57:43.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.618+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.618+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4807064518723147682 2024-04-03T03:57:43.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.618+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-04-03T03:57:43.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.622+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.622+0000 7f0ccf7e6980 10 manifest: total_size = 12720 2024-04-03T03:57:43.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.622+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11181538900668775929 2024-04-03T03:57:43.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.622+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.622+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d549558 2024-04-03T03:57:43.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.622+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4.2 2024-04-03T03:57:43.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.626+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.626+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=12720 stripe_ofs=12720 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.626+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11181538900668775929 2024-04-03T03:57:43.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.626+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.626+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.YU7CdM05DJIxKKaPTLMRMEhH51K1COK_0 2024-04-03T03:57:43.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.626+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-04-03T03:57:43.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.626+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.626+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11181538900668775929 2024-04-03T03:57:43.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.630+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-04-03T03:57:43.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.630+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.630+0000 7f0ccf7e6980 10 manifest: total_size = 15812 2024-04-03T03:57:43.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.630+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8180822803570175848 2024-04-03T03:57:43.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.630+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.630+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d549558 2024-04-03T03:57:43.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.630+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4.2 2024-04-03T03:57:43.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.638+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.638+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=15812 stripe_ofs=15812 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.638+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8180822803570175848 2024-04-03T03:57:43.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.638+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.638+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.tFEAv59uxYCTibhsK69uv2Eg2hQy4eI_0 2024-04-03T03:57:43.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.638+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-04-03T03:57:43.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.638+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.638+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8180822803570175848 2024-04-03T03:57:43.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.642+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.642+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-04-03T03:57:43.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.642+0000 7f0ccf7e6980 10 manifest: total_size = 7643 2024-04-03T03:57:43.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.642+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16637720023288216725 2024-04-03T03:57:43.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.642+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.642+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d549558 2024-04-03T03:57:43.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.642+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4.3 2024-04-03T03:57:43.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.646+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.646+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=7643 stripe_ofs=7643 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16637720023288216725 2024-04-03T03:57:43.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.fuFTZ6gJMgS0dgdFUPwhUI9mM-3wUOg_0 2024-04-03T03:57:43.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-04-03T03:57:43.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16637720023288216725 2024-04-03T03:57:43.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.650+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.650+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-04-03T03:57:43.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.654+0000 7f0ccf7e6980 10 manifest: total_size = 4942 2024-04-03T03:57:43.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.654+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12801209278348468370 2024-04-03T03:57:43.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.654+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.654+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d549558 2024-04-03T03:57:43.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.654+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4.4 2024-04-03T03:57:43.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.658+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.658+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4942 stripe_ofs=4942 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.658+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12801209278348468370 2024-04-03T03:57:43.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.658+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.658+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.GIwEtGv0VokuzOaXNkMcF26tBd8PbTB_0 2024-04-03T03:57:43.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.658+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-04-03T03:57:43.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.658+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.658+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12801209278348468370 2024-04-03T03:57:43.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.662+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-04-03T03:57:43.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.662+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.662+0000 7f0ccf7e6980 10 manifest: total_size = 13459 2024-04-03T03:57:43.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.662+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15114030286413342291 2024-04-03T03:57:43.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.662+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.662+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d549558 2024-04-03T03:57:43.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.662+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4.4 2024-04-03T03:57:43.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=13459 stripe_ofs=13459 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15114030286413342291 2024-04-03T03:57:43.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.oJzbLwNiKVe0sWrYo__zKKZFzrbkK64_0 2024-04-03T03:57:43.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-04-03T03:57:43.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15114030286413342291 2024-04-03T03:57:43.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 10 manifest: total_size = 4844 2024-04-03T03:57:43.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7020526588595340421 2024-04-03T03:57:43.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d549558 2024-04-03T03:57:43.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.670+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4.5 2024-04-03T03:57:43.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.674+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-04-03T03:57:43.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4844 stripe_ofs=4844 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7020526588595340421 2024-04-03T03:57:43.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.-n9Xk2S-fHXFZEIlz06BeAdLF_iqz3o_0 2024-04-03T03:57:43.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-04-03T03:57:43.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7020526588595340421 2024-04-03T03:57:43.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 10 manifest: total_size = 5340 2024-04-03T03:57:43.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17186089222573891090 2024-04-03T03:57:43.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d549558 2024-04-03T03:57:43.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4.7 2024-04-03T03:57:43.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.678+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-04-03T03:57:43.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.686+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.686+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5340 stripe_ofs=5340 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.686+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17186089222573891090 2024-04-03T03:57:43.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.686+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.686+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.Ve79gqXoDQC4U_DElYHbHTzMrOoufFL_0 2024-04-03T03:57:43.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.686+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-04-03T03:57:43.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.686+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.686+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17186089222573891090 2024-04-03T03:57:43.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.686+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.690+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-04-03T03:57:43.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.690+0000 7f0ccf7e6980 10 manifest: total_size = 8666 2024-04-03T03:57:43.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.690+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.202705690236748296 2024-04-03T03:57:43.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.690+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x560c6d549558 s->prefetch_data=0 2024-04-03T03:57:43.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.690+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d549558 2024-04-03T03:57:43.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.690+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4.8 2024-04-03T03:57:43.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.694+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.694+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=8666 stripe_ofs=8666 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.694+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.202705690236748296 2024-04-03T03:57:43.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.694+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.694+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.6H57frOjMCEa0Ub2LbjtR4bWcSYYYXc_0 2024-04-03T03:57:43.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.694+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-04-03T03:57:43.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.694+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.694+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.202705690236748296 2024-04-03T03:57:43.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.698+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-04-03T03:57:43.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.698+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:43.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.698+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:43.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.702+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:43.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.702+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:43.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.702+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:43.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.702+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:43.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.702+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:43.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.702+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-04-03T03:57:43.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.702+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.706+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=204 2024-04-03T03:57:43.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.706+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-04-03T03:57:43.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.706+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-04-03T03:57:43.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.706+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-04-03T03:57:43.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.706+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-04-03T03:57:43.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.710+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94611373624752 notifier 5639 bl.length()=162 2024-04-03T03:57:43.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.714+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4 from cache 2024-04-03T03:57:43.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.714+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4, ofs0, ns] 2024-04-03T03:57:43.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.714+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 94611373639600 notifier 5639 bl.length()=219 2024-04-03T03:57:43.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.722+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4 : miss 2024-04-03T03:57:43.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.722+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.722+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.722+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4 info.flags=0x0 2024-04-03T03:57:43.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.722+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4 to cache LRU end 2024-04-03T03:57:43.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.726+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11 : miss 2024-04-03T03:57:43.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.726+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.726+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=409 2024-04-03T03:57:43.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.726+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11 info.flags=0x17 2024-04-03T03:57:43.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.726+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11 to cache LRU end 2024-04-03T03:57:43.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.726+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:43.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.726+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:43.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.726+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11 2024-04-03T03:57:43.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.738+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo 2024-04-03T03:57:43.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.738+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc01236a0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x560c6d5410c8 s->prefetch_data=0 2024-04-03T03:57:43.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.738+0000 7f0ccf7e6980 10 manifest: total_size = 886297 2024-04-03T03:57:43.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.738+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7035081513436489375 2024-04-03T03:57:43.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.738+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc01236a0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x560c6d5410c8 s->prefetch_data=0 2024-04-03T03:57:43.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.738+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d5410c8 2024-04-03T03:57:43.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.738+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11.10 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-04-03T03:57:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7035081513436489375 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11__multipart_foo.2~NSDY6iNxjM9mMaRuBJhYB_IBzfa8jTl.1 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11__multipart_foo.2~NSDY6iNxjM9mMaRuBJhYB_IBzfa8jTl.2 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11__multipart_foo.2~NSDY6iNxjM9mMaRuBJhYB_IBzfa8jTl.3 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11__multipart_foo.2~NSDY6iNxjM9mMaRuBJhYB_IBzfa8jTl.4 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7035081513436489375 2024-04-03T03:57:43.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.746+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo 2024-04-03T03:57:43.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.750+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:43.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.750+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.750+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.750+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.750+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.750+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.750+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:43.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.754+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-04-03T03:57:43.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.754+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.754+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=235 2024-04-03T03:57:43.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.754+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-04-03T03:57:43.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.754+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-04-03T03:57:43.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.758+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-04-03T03:57:43.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.758+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-04-03T03:57:43.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.758+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562423 cookie 94611373631344 notifier 5639 bl.length()=191 2024-04-03T03:57:43.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.766+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11 from cache 2024-04-03T03:57:43.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.766+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11, ofs0, ns] 2024-04-03T03:57:43.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.766+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562435 cookie 94611373640656 notifier 5639 bl.length()=249 2024-04-03T03:57:43.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.774+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11 : miss 2024-04-03T03:57:43.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.774+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.774+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.774+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11 info.flags=0x0 2024-04-03T03:57:43.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.774+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11 to cache LRU end 2024-04-03T03:57:43.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.778+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12 : miss 2024-04-03T03:57:43.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.778+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.778+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=416 2024-04-03T03:57:43.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.778+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12 info.flags=0x17 2024-04-03T03:57:43.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.778+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12 to cache LRU end 2024-04-03T03:57:43.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.778+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:43.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.778+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:43.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.778+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12 2024-04-03T03:57:43.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.786+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo 2024-04-03T03:57:43.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.786+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5415d0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x560c6d55ae58 s->prefetch_data=0 2024-04-03T03:57:43.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.786+0000 7f0ccf7e6980 10 manifest: total_size = 74198 2024-04-03T03:57:43.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.786+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10817620256925432579 2024-04-03T03:57:43.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.786+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5415d0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x560c6d55ae58 s->prefetch_data=0 2024-04-03T03:57:43.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.786+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55ae58 2024-04-03T03:57:43.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.786+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12.10 2024-04-03T03:57:43.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:43.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-04-03T03:57:43.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10817620256925432579 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12__multipart_foo.2~z8MvErCeI41qt4uu-VGRcRqxsUs2LK6.1 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-04-03T03:57:43.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12__multipart_foo.2~z8MvErCeI41qt4uu-VGRcRqxsUs2LK6.2 2024-04-03T03:57:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-04-03T03:57:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12__multipart_foo.2~z8MvErCeI41qt4uu-VGRcRqxsUs2LK6.3 2024-04-03T03:57:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-04-03T03:57:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12__multipart_foo.2~z8MvErCeI41qt4uu-VGRcRqxsUs2LK6.4 2024-04-03T03:57:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-04-03T03:57:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10817620256925432579 2024-04-03T03:57:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo 2024-04-03T03:57:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.794+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:43.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.798+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:43.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.798+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:43.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.798+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:43.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.798+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:43.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.798+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:43.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.802+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-04-03T03:57:43.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.802+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.802+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=242 2024-04-03T03:57:43.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.802+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-04-03T03:57:43.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.802+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-04-03T03:57:43.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.806+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-04-03T03:57:43.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.806+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-04-03T03:57:43.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.806+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562384 cookie 94611373635600 notifier 5639 bl.length()=198 2024-04-03T03:57:43.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.814+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12 from cache 2024-04-03T03:57:43.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.814+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12, ofs0, ns] 2024-04-03T03:57:43.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.814+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562378 cookie 94611373626960 notifier 5639 bl.length()=256 2024-04-03T03:57:43.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.822+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12 : miss 2024-04-03T03:57:43.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.822+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.822+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.822+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12 info.flags=0x0 2024-04-03T03:57:43.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.822+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12 to cache LRU end 2024-04-03T03:57:43.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.826+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10 : miss 2024-04-03T03:57:43.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.826+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.830+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=411 2024-04-03T03:57:43.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.830+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10 info.flags=0x17 2024-04-03T03:57:43.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.830+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10 to cache LRU end 2024-04-03T03:57:43.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.830+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:43.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.830+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:43.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.830+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10 2024-04-03T03:57:43.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.838+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo[I5yjJml87UTgMe39W5c-mABzC2mTHcn] 2024-04-03T03:57:43.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.838+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10.10 2024-04-03T03:57:43.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.842+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d548b30 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.842+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to flbddikwdujrq5mrf6zzevldbu8e8if7 2024-04-03T03:57:43.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.842+0000 7f0ccf7e6980 20 get_obj_state_impl: setting s->olh_tag to lfx4zmo8b1uh727hhk4fqdw0l6u7thuc 2024-04-03T03:57:43.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.842+0000 7f0ccf7e6980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lfx4zmo8b1uh727hhk4fqdw0l6u7thuc 2024-04-03T03:57:43.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.846+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10.10 2024-04-03T03:57:43.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.846+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10.10 2024-04-03T03:57:43.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.850+0000 7f0ccf7e6980 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-04-03T03:57:43.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.850+0000 7f0ccf7e6980 20 olh_log_entry: epoch=3 op=3 key=foo[I5yjJml87UTgMe39W5c-mABzC2mTHcn] 2024-04-03T03:57:43.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.850+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d548b30 obj=test-client.0-r-test-multipart-index-versioning.1:_:I5yjJml87UTgMe39W5c-mABzC2mTHcn_foo state=0x560c6d55fc18 s->prefetch_data=0 2024-04-03T03:57:43.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.850+0000 7f0ccf7e6980 10 manifest: total_size = 26080 2024-04-03T03:57:43.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.850+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6942760159716307327 2024-04-03T03:57:43.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.850+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d548b30 obj=test-client.0-r-test-multipart-index-versioning.1:_:I5yjJml87UTgMe39W5c-mABzC2mTHcn_foo state=0x560c6d55fc18 s->prefetch_data=0 2024-04-03T03:57:43.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.850+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55fc18 2024-04-03T03:57:43.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.850+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10.10 2024-04-03T03:57:43.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-04-03T03:57:43.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2024-04-03T03:57:43.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2024-04-03T03:57:43.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-04-03T03:57:43.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7670 2024-04-03T03:57:43.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7671 2024-04-03T03:57:43.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-04-03T03:57:43.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=7671 2024-04-03T03:57:43.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=23013 stripe_ofs=23013 part_ofs=23013 rule->part_size=3067 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4217317 part_ofs=23013 rule->part_size=3067 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=26080 stripe_ofs=26080 part_ofs=26080 rule->part_size=3067 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6942760159716307327 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10__multipart_foo.2~PZjGmnlImUHlTomir_qccYeou5XLQHP.1 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10__multipart_foo.2~PZjGmnlImUHlTomir_qccYeou5XLQHP.2 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10__multipart_foo.2~PZjGmnlImUHlTomir_qccYeou5XLQHP.3 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10__multipart_foo.2~PZjGmnlImUHlTomir_qccYeou5XLQHP.4 2024-04-03T03:57:43.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-04-03T03:57:43.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6942760159716307327 2024-04-03T03:57:43.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.858+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo[I5yjJml87UTgMe39W5c-mABzC2mTHcn] 2024-04-03T03:57:43.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.862+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d548b30 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.866+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10.10 2024-04-03T03:57:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.870+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10.10 2024-04-03T03:57:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.870+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.870+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.870+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.870+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.870+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.870+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.870+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.878+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-04-03T03:57:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.878+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.878+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=237 2024-04-03T03:57:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.878+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-04-03T03:57:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.878+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-04-03T03:57:43.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.882+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-04-03T03:57:43.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.882+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-04-03T03:57:43.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.882+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562385 cookie 94611373635600 notifier 5639 bl.length()=193 2024-04-03T03:57:43.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.890+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10 from cache 2024-04-03T03:57:43.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.890+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10, ofs0, ns] 2024-04-03T03:57:43.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.890+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562424 cookie 94611373631344 notifier 5639 bl.length()=251 2024-04-03T03:57:43.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.898+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10 : miss 2024-04-03T03:57:43.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.898+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.902+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.902+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10 info.flags=0x0 2024-04-03T03:57:43.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.902+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10 to cache LRU end 2024-04-03T03:57:43.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.906+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9 : miss 2024-04-03T03:57:43.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.906+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.906+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=399 2024-04-03T03:57:43.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.906+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9 info.flags=0x17 2024-04-03T03:57:43.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.906+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9 to cache LRU end 2024-04-03T03:57:43.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.906+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:43.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.906+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:43.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.906+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9 2024-04-03T03:57:43.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.918+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo 2024-04-03T03:57:43.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.918+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5c1920 obj=test-client.0-r-test-multipart-simple.1:foo state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:43.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.918+0000 7f0ccf7e6980 10 manifest: total_size = 74198 2024-04-03T03:57:43.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.918+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9767927350498353998 2024-04-03T03:57:43.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.918+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5c1920 obj=test-client.0-r-test-multipart-simple.1:foo state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:43.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.918+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d54a7f8 2024-04-03T03:57:43.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.918+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9.10 2024-04-03T03:57:43.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:43.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-04-03T03:57:43.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-04-03T03:57:43.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:43.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-04-03T03:57:43.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9767927350498353998 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9__multipart_foo.2~781vtT8wSOROcdsUMDSYc-ifwkj8f-o.1 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9__multipart_foo.2~781vtT8wSOROcdsUMDSYc-ifwkj8f-o.2 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-04-03T03:57:43.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9__multipart_foo.2~781vtT8wSOROcdsUMDSYc-ifwkj8f-o.3 2024-04-03T03:57:43.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-04-03T03:57:43.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9__multipart_foo.2~781vtT8wSOROcdsUMDSYc-ifwkj8f-o.4 2024-04-03T03:57:43.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-04-03T03:57:43.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.926+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9767927350498353998 2024-04-03T03:57:43.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.930+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo 2024-04-03T03:57:43.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.930+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:43.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.930+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:43.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.930+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:43.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.930+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:43.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.930+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:43.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.930+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:43.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.930+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:43.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.934+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-04-03T03:57:43.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.938+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.938+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=225 2024-04-03T03:57:43.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.938+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-04-03T03:57:43.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.938+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-04-03T03:57:43.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.942+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-04-03T03:57:43.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.942+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-04-03T03:57:43.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.942+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 94611373639600 notifier 5639 bl.length()=183 2024-04-03T03:57:43.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.946+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9 from cache 2024-04-03T03:57:43.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.946+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9, ofs0, ns] 2024-04-03T03:57:43.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.950+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562386 cookie 94611373635600 notifier 5639 bl.length()=240 2024-04-03T03:57:43.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.958+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9 : miss 2024-04-03T03:57:43.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.958+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.958+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:43.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.958+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9 info.flags=0x0 2024-04-03T03:57:43.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.958+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9 to cache LRU end 2024-04-03T03:57:43.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.966+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15 : miss 2024-04-03T03:57:43.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.966+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:43.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.966+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=407 2024-04-03T03:57:43.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.966+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15 info.flags=0x17 2024-04-03T03:57:43.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.966+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15 to cache LRU end 2024-04-03T03:57:43.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.966+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:43.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.966+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:43.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.966+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15 2024-04-03T03:57:43.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.966+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-04-03T03:57:43.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.970+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-04-03T03:57:43.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.970+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-04-03T03:57:43.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.974+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-04-03T03:57:43.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.974+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-04-03T03:57:43.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.974+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-04-03T03:57:43.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.974+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-04-03T03:57:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.974+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-04-03T03:57:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.974+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-04-03T03:57:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.978+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-04-03T03:57:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.978+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-04-03T03:57:43.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.978+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-04-03T03:57:43.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.978+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.978+0000 7f0ccf7e6980 10 manifest: total_size = 324647 2024-04-03T03:57:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.978+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _dZLa63QQs7sEVkvx2lFQCQCFhpkkD0W 2024-04-03T03:57:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.978+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.978+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.978+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.0 2024-04-03T03:57:43.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.986+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.986+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.986+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _dZLa63QQs7sEVkvx2lFQCQCFhpkkD0W 2024-04-03T03:57:43.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.986+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.986+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.Uawvtzv7WTPwWEBMkLlsycrNUuOwZIS_0 2024-04-03T03:57:43.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.986+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-04-03T03:57:43.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.986+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.986+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _dZLa63QQs7sEVkvx2lFQCQCFhpkkD0W 2024-04-03T03:57:43.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.990+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-04-03T03:57:43.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.990+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.990+0000 7f0ccf7e6980 10 manifest: total_size = 5242880 2024-04-03T03:57:43.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.990+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _9_nE5kidgdiCpU00dPXwEeniWH0u0xx 2024-04-03T03:57:43.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.990+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.990+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:43.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.990+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.2 2024-04-03T03:57:43.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _9_nE5kidgdiCpU00dPXwEeniWH0u0xx 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.qwgZdWZR-0HveL2mVt9YVQDbfuC0cCv_0 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.qwgZdWZR-0HveL2mVt9YVQDbfuC0cCv_1 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:43.998+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _9_nE5kidgdiCpU00dPXwEeniWH0u0xx 2024-04-03T03:57:43.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.002+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-04-03T03:57:43.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.002+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.002+0000 7f0ccf7e6980 10 manifest: total_size = 5242880 2024-04-03T03:57:43.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.002+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13341621077915098289 2024-04-03T03:57:43.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.002+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.002+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:43.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.002+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.3 2024-04-03T03:57:43.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13341621077915098289 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_0 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_1 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:43.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.010+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13341621077915098289 2024-04-03T03:57:43.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.014+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.014+0000 7f0ccf7e6980 10 manifest: total_size = 5242880 2024-04-03T03:57:43.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.014+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _y8C2gOa1rpmOZx5B56HnYCEz96ymeBn 2024-04-03T03:57:43.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.014+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:43.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.014+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:43.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.014+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.5 2024-04-03T03:57:43.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.014+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-04-03T03:57:44.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _y8C2gOa1rpmOZx5B56HnYCEz96ymeBn 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.zSjMuV8bD3vIXZn3L5sSu_yPHR3vcs2_0 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.zSjMuV8bD3vIXZn3L5sSu_yPHR3vcs2_1 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.018+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _y8C2gOa1rpmOZx5B56HnYCEz96ymeBn 2024-04-03T03:57:44.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.026+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-04-03T03:57:44.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.026+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.026+0000 7f0ccf7e6980 10 manifest: total_size = 5242880 2024-04-03T03:57:44.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.026+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _eTEERapJK7J-eLLnl_zvGstv5N5kz2f 2024-04-03T03:57:44.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.026+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.026+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:44.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.026+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.5 2024-04-03T03:57:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _eTEERapJK7J-eLLnl_zvGstv5N5kz2f 2024-04-03T03:57:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.K8CKKS8KHS7SmGnkxbPCFx_GuV2M75O_0 2024-04-03T03:57:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-04-03T03:57:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.K8CKKS8KHS7SmGnkxbPCFx_GuV2M75O_1 2024-04-03T03:57:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-04-03T03:57:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _eTEERapJK7J-eLLnl_zvGstv5N5kz2f 2024-04-03T03:57:44.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-04-03T03:57:44.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.034+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.038+0000 7f0ccf7e6980 10 manifest: total_size = 324647 2024-04-03T03:57:44.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.038+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5914675007708559068 2024-04-03T03:57:44.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.038+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.038+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:44.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.038+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.5 2024-04-03T03:57:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.042+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.042+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.042+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5914675007708559068 2024-04-03T03:57:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.042+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.042+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.xCDSMbLvTNmwDeSkKd1GyIq-caRqUsE_0 2024-04-03T03:57:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.042+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-04-03T03:57:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.042+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.042+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5914675007708559068 2024-04-03T03:57:44.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.046+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-04-03T03:57:44.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.046+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.046+0000 7f0ccf7e6980 10 manifest: total_size = 5242880 2024-04-03T03:57:44.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.046+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _zykspPtf34qVxABsZomM6rq9H7Y9aSb 2024-04-03T03:57:44.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.046+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.046+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:44.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.046+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.7 2024-04-03T03:57:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _zykspPtf34qVxABsZomM6rq9H7Y9aSb 2024-04-03T03:57:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.PVDABwzXHdKfkuWI8tQQf-QcE_ibhKp_0 2024-04-03T03:57:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-04-03T03:57:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.PVDABwzXHdKfkuWI8tQQf-QcE_ibhKp_1 2024-04-03T03:57:44.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-04-03T03:57:44.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.054+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _zykspPtf34qVxABsZomM6rq9H7Y9aSb 2024-04-03T03:57:44.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.058+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-04-03T03:57:44.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.058+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.058+0000 7f0ccf7e6980 10 manifest: total_size = 5242880 2024-04-03T03:57:44.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.058+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14896964589214078392 2024-04-03T03:57:44.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.058+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.058+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:44.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.058+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.7 2024-04-03T03:57:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14896964589214078392 2024-04-03T03:57:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_0 2024-04-03T03:57:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-04-03T03:57:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_1 2024-04-03T03:57:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-04-03T03:57:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.066+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14896964589214078392 2024-04-03T03:57:44.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-04-03T03:57:44.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0ccf7e6980 10 manifest: total_size = 324647 2024-04-03T03:57:44.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0ccf7e6980 10 generate_fake_tag new tag=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.xCDSMbLvTNmwDeSkKd1GyIq-caRqUsE_1_9fd476d092270f4ed19124bd0132afe9 2024-04-03T03:57:44.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.xCDSMbLvTNmwDeSkKd1GyIq-caRqUsE_1_9fd476d092270f4ed19124bd0132afe9 2024-04-03T03:57:44.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:44.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.070+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.7 2024-04-03T03:57:44.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.078+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.078+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.078+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.xCDSMbLvTNmwDeSkKd1GyIq-caRqUsE_1_9fd476d092270f4ed19124bd0132afe9 2024-04-03T03:57:44.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.078+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.078+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.xCDSMbLvTNmwDeSkKd1GyIq-caRqUsE_0 2024-04-03T03:57:44.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.078+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 389 2024-04-03T03:57:44.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.078+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.078+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.xCDSMbLvTNmwDeSkKd1GyIq-caRqUsE_1_9fd476d092270f4ed19124bd0132afe9 2024-04-03T03:57:44.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-04-03T03:57:44.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0ccf7e6980 10 manifest: total_size = 5242880 2024-04-03T03:57:44.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0ccf7e6980 10 generate_fake_tag new tag=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_1_29d789029cf147f0317a638612d31541 2024-04-03T03:57:44.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_1_29d789029cf147f0317a638612d31541 2024-04-03T03:57:44.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:44.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.082+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.8 2024-04-03T03:57:44.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_1_29d789029cf147f0317a638612d31541 2024-04-03T03:57:44.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_0 2024-04-03T03:57:44.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2024-04-03T03:57:44.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_1 2024-04-03T03:57:44.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 637 2024-04-03T03:57:44.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_1_29d789029cf147f0317a638612d31541 2024-04-03T03:57:44.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.090+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-04-03T03:57:44.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.094+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.094+0000 7f0ccf7e6980 10 manifest: total_size = 324647 2024-04-03T03:57:44.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.094+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _sebyoyr_bkSzp8HhufPvltG2GLFYzvo 2024-04-03T03:57:44.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.094+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5492f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.094+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:44.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.094+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.8 2024-04-03T03:57:44.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.098+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.098+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.098+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _sebyoyr_bkSzp8HhufPvltG2GLFYzvo 2024-04-03T03:57:44.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.098+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.098+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.sjXRfrLT07_i84BsJnN70ag2oRQ8pwm_0 2024-04-03T03:57:44.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.098+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-04-03T03:57:44.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.098+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.098+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _sebyoyr_bkSzp8HhufPvltG2GLFYzvo 2024-04-03T03:57:44.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-04-03T03:57:44.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0ccf7e6980 10 manifest: total_size = 5242880 2024-04-03T03:57:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0ccf7e6980 10 generate_fake_tag new tag=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_1_8c3844c3b04dd61e74306997d2c69365 2024-04-03T03:57:44.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_1_8c3844c3b04dd61e74306997d2c69365 2024-04-03T03:57:44.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x560c6d55a9c8 s->prefetch_data=0 2024-04-03T03:57:44.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55a9c8 2024-04-03T03:57:44.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.102+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15.9 2024-04-03T03:57:44.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_1_8c3844c3b04dd61e74306997d2c69365 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_0 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_1 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.110+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_1_8c3844c3b04dd61e74306997d2c69365 2024-04-03T03:57:44.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.114+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-04-03T03:57:44.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.114+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:44.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.114+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.118+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.118+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.118+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.118+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.118+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.122+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-04-03T03:57:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.122+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.122+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=233 2024-04-03T03:57:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.122+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-04-03T03:57:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.122+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-04-03T03:57:44.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.126+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-04-03T03:57:44.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.126+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-04-03T03:57:44.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.126+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 94611373635600 notifier 5639 bl.length()=189 2024-04-03T03:57:44.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.134+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15 from cache 2024-04-03T03:57:44.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.134+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15, ofs0, ns] 2024-04-03T03:57:44.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.134+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562425 cookie 94611373631344 notifier 5639 bl.length()=247 2024-04-03T03:57:44.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.142+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15 : miss 2024-04-03T03:57:44.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.142+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.146+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.146+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15 info.flags=0x0 2024-04-03T03:57:44.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.146+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15 to cache LRU end 2024-04-03T03:57:44.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.150+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16 : miss 2024-04-03T03:57:44.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.150+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.150+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=417 2024-04-03T03:57:44.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.150+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16 info.flags=0x17 2024-04-03T03:57:44.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.150+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16 to cache LRU end 2024-04-03T03:57:44.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.150+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:44.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.150+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:44.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.150+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16 2024-04-03T03:57:44.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.154+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-04-03T03:57:44.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.154+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-04-03T03:57:44.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.154+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-04-03T03:57:44.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.158+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-04-03T03:57:44.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.158+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-04-03T03:57:44.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.158+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-04-03T03:57:44.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.162+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-04-03T03:57:44.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.162+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-04-03T03:57:44.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.162+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-04-03T03:57:44.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.162+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-04-03T03:57:44.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.162+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-04-03T03:57:44.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.162+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-04-03T03:57:44.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.166+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.166+0000 7f0ccf7e6980 10 manifest: total_size = 45360 2024-04-03T03:57:44.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.166+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _yBWQvi_W0RqmrQNG8vRFZXI4eb6BoEP 2024-04-03T03:57:44.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.166+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.166+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.166+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.0 2024-04-03T03:57:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.170+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.170+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.170+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _yBWQvi_W0RqmrQNG8vRFZXI4eb6BoEP 2024-04-03T03:57:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.170+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.170+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.j04-b-tMnq12qtJYwJRMQkUFUCH0j-h_0 2024-04-03T03:57:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.170+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-04-03T03:57:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.170+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.170+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _yBWQvi_W0RqmrQNG8vRFZXI4eb6BoEP 2024-04-03T03:57:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.174+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-04-03T03:57:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.174+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d554dc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.178+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.178+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _7Bebe9jHey_gcinccmB9fIaGwQeWjEA 2024-04-03T03:57:44.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.178+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d554dc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.178+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.178+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.2 2024-04-03T03:57:44.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _7Bebe9jHey_gcinccmB9fIaGwQeWjEA 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.9gyC4_fVhJBWkeSBDwoGSRvFhF1Cnq-_0 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.9gyC4_fVhJBWkeSBDwoGSRvFhF1Cnq-_1 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.9gyC4_fVhJBWkeSBDwoGSRvFhF1Cnq-_2 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.182+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _7Bebe9jHey_gcinccmB9fIaGwQeWjEA 2024-04-03T03:57:44.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.186+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-04-03T03:57:44.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.186+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.186+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.186+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16568584420205316147 2024-04-03T03:57:44.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.186+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.186+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.186+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.3 2024-04-03T03:57:44.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16568584420205316147 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1_1 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.2 2024-04-03T03:57:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-04-03T03:57:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.2_1 2024-04-03T03:57:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-04-03T03:57:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.3 2024-04-03T03:57:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-04-03T03:57:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.194+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16568584420205316147 2024-04-03T03:57:44.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.198+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc01236a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.198+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-04-03T03:57:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.198+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.198+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _NOHDn15mSSbzDGkMwD0AmduFck3nGt3 2024-04-03T03:57:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.198+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc01236a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.198+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.198+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.5 2024-04-03T03:57:44.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _NOHDn15mSSbzDGkMwD0AmduFck3nGt3 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.gVHAd9HxzhzLyL4zYoBQ6MUHbaqGrmw_0 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.gVHAd9HxzhzLyL4zYoBQ6MUHbaqGrmw_1 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.gVHAd9HxzhzLyL4zYoBQ6MUHbaqGrmw_2 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.202+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _NOHDn15mSSbzDGkMwD0AmduFck3nGt3 2024-04-03T03:57:44.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.206+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-04-03T03:57:44.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.206+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.210+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.210+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _GG5-kf7qTUWs7EnQQxHOzaEIG-a0-LU 2024-04-03T03:57:44.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.210+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.210+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.210+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.5 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _GG5-kf7qTUWs7EnQQxHOzaEIG-a0-LU 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.kxKqp89WoS3DR3NLRuMmHgKPCDFqbQ7_0 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-04-03T03:57:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.kxKqp89WoS3DR3NLRuMmHgKPCDFqbQ7_1 2024-04-03T03:57:44.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-04-03T03:57:44.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.kxKqp89WoS3DR3NLRuMmHgKPCDFqbQ7_2 2024-04-03T03:57:44.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-04-03T03:57:44.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.214+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _GG5-kf7qTUWs7EnQQxHOzaEIG-a0-LU 2024-04-03T03:57:44.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.218+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-04-03T03:57:44.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.218+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.222+0000 7f0ccf7e6980 10 manifest: total_size = 45360 2024-04-03T03:57:44.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.222+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16209451607924295726 2024-04-03T03:57:44.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.222+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00c5f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.222+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.222+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.5 2024-04-03T03:57:44.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.230+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16209451607924295726 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.1 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.2 2024-04-03T03:57:44.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-04-03T03:57:44.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.3 2024-04-03T03:57:44.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-04-03T03:57:44.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16209451607924295726 2024-04-03T03:57:44.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5c17a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.234+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-04-03T03:57:44.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.238+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.238+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _N9X3hxf7oYIJBL6Vewt8_I1y5IPTZAX 2024-04-03T03:57:44.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.238+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5c17a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.238+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.238+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.7 2024-04-03T03:57:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _N9X3hxf7oYIJBL6Vewt8_I1y5IPTZAX 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.q62EKyhn4h23id5J3lyp5t65qHkeMjE_0 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.q62EKyhn4h23id5J3lyp5t65qHkeMjE_1 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.q62EKyhn4h23id5J3lyp5t65qHkeMjE_2 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.242+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _N9X3hxf7oYIJBL6Vewt8_I1y5IPTZAX 2024-04-03T03:57:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.246+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-04-03T03:57:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.246+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc801dd50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.246+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.246+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2750051355139788687 2024-04-03T03:57:44.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.246+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc801dd50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.246+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.246+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.7 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2750051355139788687 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1_1 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.2 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.2_1 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.3 2024-04-03T03:57:44.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-04-03T03:57:44.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.254+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2750051355139788687 2024-04-03T03:57:44.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-04-03T03:57:44.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d55c680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 10 manifest: total_size = 45360 2024-04-03T03:57:44.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:44.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-04-03T03:57:44.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-04-03T03:57:44.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 10 generate_fake_tag new tag=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.2_54bd89792803af4d44be22fee2bd9b04 2024-04-03T03:57:44.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.2_54bd89792803af4d44be22fee2bd9b04 2024-04-03T03:57:44.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d55c680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.258+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.7 2024-04-03T03:57:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-04-03T03:57:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-04-03T03:57:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-04-03T03:57:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-04-03T03:57:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-04-03T03:57:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.2_54bd89792803af4d44be22fee2bd9b04 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.1 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.2 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.3 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.262+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.2_54bd89792803af4d44be22fee2bd9b04 2024-04-03T03:57:44.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.266+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-04-03T03:57:44.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.266+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d2635c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.270+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.270+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.270+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.270+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.270+0000 7f0ccf7e6980 10 generate_fake_tag new tag=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1_1_df2c07fcb63508b201b3c60fefbb0878 2024-04-03T03:57:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.270+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1_1_df2c07fcb63508b201b3c60fefbb0878 2024-04-03T03:57:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.270+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d2635c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.270+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.270+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.8 2024-04-03T03:57:44.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-04-03T03:57:44.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-04-03T03:57:44.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1_1_df2c07fcb63508b201b3c60fefbb0878 2024-04-03T03:57:44.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1 2024-04-03T03:57:44.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 448 2024-04-03T03:57:44.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1_1 2024-04-03T03:57:44.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 719 2024-04-03T03:57:44.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.2 2024-04-03T03:57:44.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 992 2024-04-03T03:57:44.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.2_1 2024-04-03T03:57:44.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1263 2024-04-03T03:57:44.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.3 2024-04-03T03:57:44.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1536 2024-04-03T03:57:44.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.274+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1_1_df2c07fcb63508b201b3c60fefbb0878 2024-04-03T03:57:44.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.278+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-04-03T03:57:44.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.278+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc801dd50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.282+0000 7f0ccf7e6980 10 manifest: total_size = 45360 2024-04-03T03:57:44.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.282+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to _MZkcysoYj3835IrkgXkhTvjh1oqK8Oe 2024-04-03T03:57:44.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.282+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc801dd50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.282+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.282+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.8 2024-04-03T03:57:44.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.286+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.286+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.286+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: _MZkcysoYj3835IrkgXkhTvjh1oqK8Oe 2024-04-03T03:57:44.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.286+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.286+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.rKjvHE-FpAPMFY0lAZhC812uvxmxIo5_0 2024-04-03T03:57:44.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.286+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-04-03T03:57:44.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.286+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.286+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _MZkcysoYj3835IrkgXkhTvjh1oqK8Oe 2024-04-03T03:57:44.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-04-03T03:57:44.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 10 generate_fake_tag new tag=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1_1_09927ce8c749a41550406ddc3a89239b 2024-04-03T03:57:44.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1_1_09927ce8c749a41550406ddc3a89239b 2024-04-03T03:57:44.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x560c6d55bac8 s->prefetch_data=0 2024-04-03T03:57:44.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d55bac8 2024-04-03T03:57:44.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.290+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16.9 2024-04-03T03:57:44.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-04-03T03:57:44.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-04-03T03:57:44.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1_1_09927ce8c749a41550406ddc3a89239b 2024-04-03T03:57:44.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1 2024-04-03T03:57:44.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-04-03T03:57:44.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1_1 2024-04-03T03:57:44.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 705 2024-04-03T03:57:44.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.2 2024-04-03T03:57:44.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 972 2024-04-03T03:57:44.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.2_1 2024-04-03T03:57:44.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1237 2024-04-03T03:57:44.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.3 2024-04-03T03:57:44.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1504 2024-04-03T03:57:44.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.298+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1_1_09927ce8c749a41550406ddc3a89239b 2024-04-03T03:57:44.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.302+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:44.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.302+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-04-03T03:57:44.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.302+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:44.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.306+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:44.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.306+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:44.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.306+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:44.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.306+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:44.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.306+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:44.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.310+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-04-03T03:57:44.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.310+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.310+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=243 2024-04-03T03:57:44.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.310+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-04-03T03:57:44.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.310+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-04-03T03:57:44.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.314+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-04-03T03:57:44.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.314+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-04-03T03:57:44.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.314+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562379 cookie 94611373626960 notifier 5639 bl.length()=199 2024-04-03T03:57:44.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.322+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16 from cache 2024-04-03T03:57:44.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.322+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16, ofs0, ns] 2024-04-03T03:57:44.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.322+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562403 cookie 94611373639600 notifier 5639 bl.length()=257 2024-04-03T03:57:44.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.330+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16 : miss 2024-04-03T03:57:44.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.330+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.330+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.330+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16 info.flags=0x0 2024-04-03T03:57:44.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.330+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16 to cache LRU end 2024-04-03T03:57:44.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.338+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14 : miss 2024-04-03T03:57:44.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.338+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.338+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=412 2024-04-03T03:57:44.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.338+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14 info.flags=0x17 2024-04-03T03:57:44.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.338+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14 to cache LRU end 2024-04-03T03:57:44.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.338+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:44.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.338+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:44.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.338+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14 2024-04-03T03:57:44.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.342+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-04-03T03:57:44.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.346+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-04-03T03:57:44.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.346+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-04-03T03:57:44.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.350+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5c0740 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.350+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.350+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15676206524179853865 2024-04-03T03:57:44.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.350+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5c0740 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.350+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d544bf8 2024-04-03T03:57:44.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.350+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14.3 2024-04-03T03:57:44.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15676206524179853865 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.1 2024-04-03T03:57:44.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__shadow_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.1_1 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.2 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__shadow_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.2_1 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.3 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.358+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15676206524179853865 2024-04-03T03:57:44.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.362+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-04-03T03:57:44.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.362+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc01236a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.362+0000 7f0ccf7e6980 10 manifest: total_size = 1087 2024-04-03T03:57:44.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.362+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7865710561540188488 2024-04-03T03:57:44.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.362+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc01236a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.362+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d544bf8 2024-04-03T03:57:44.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.362+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14.5 2024-04-03T03:57:44.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-04-03T03:57:44.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-04-03T03:57:44.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-04-03T03:57:44.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-04-03T03:57:44.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-04-03T03:57:44.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-04-03T03:57:44.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-04-03T03:57:44.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-04-03T03:57:44.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-04-03T03:57:44.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7865710561540188488 2024-04-03T03:57:44.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-STANDARD.2~k2DyYY6X866zLnc6eIZHK5cl_RLoNfL.1 2024-04-03T03:57:44.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-04-03T03:57:44.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-STANDARD.2~k2DyYY6X866zLnc6eIZHK5cl_RLoNfL.2 2024-04-03T03:57:44.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-04-03T03:57:44.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-STANDARD.2~k2DyYY6X866zLnc6eIZHK5cl_RLoNfL.3 2024-04-03T03:57:44.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-04-03T03:57:44.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.370+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7865710561540188488 2024-04-03T03:57:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.374+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-04-03T03:57:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.374+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d569490 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.374+0000 7f0ccf7e6980 10 manifest: total_size = 11534336 2024-04-03T03:57:44.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.374+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5376031056284945021 2024-04-03T03:57:44.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.374+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d569490 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.374+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d544bf8 2024-04-03T03:57:44.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.374+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14.7 2024-04-03T03:57:44.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-04-03T03:57:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-04-03T03:57:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-04-03T03:57:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-04-03T03:57:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-04-03T03:57:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-04-03T03:57:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5376031056284945021 2024-04-03T03:57:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.1 2024-04-03T03:57:44.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-04-03T03:57:44.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__shadow_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.1_1 2024-04-03T03:57:44.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-04-03T03:57:44.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.2 2024-04-03T03:57:44.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-04-03T03:57:44.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__shadow_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.2_1 2024-04-03T03:57:44.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-04-03T03:57:44.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.3 2024-04-03T03:57:44.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-04-03T03:57:44.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.382+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5376031056284945021 2024-04-03T03:57:44.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.386+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:44.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.386+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-04-03T03:57:44.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.386+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:44.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.386+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:44.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.386+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:44.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.386+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:44.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.386+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:44.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.386+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.394+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-04-03T03:57:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.394+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.394+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=238 2024-04-03T03:57:44.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.394+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-04-03T03:57:44.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.394+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-04-03T03:57:44.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.398+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-04-03T03:57:44.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.398+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-04-03T03:57:44.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.398+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94611373643152 notifier 5639 bl.length()=194 2024-04-03T03:57:44.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.406+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14 from cache 2024-04-03T03:57:44.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.406+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14, ofs0, ns] 2024-04-03T03:57:44.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.406+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562404 cookie 94611373639600 notifier 5639 bl.length()=252 2024-04-03T03:57:44.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.414+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14 : miss 2024-04-03T03:57:44.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.414+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.414+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.414+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14 info.flags=0x0 2024-04-03T03:57:44.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.414+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14 to cache LRU end 2024-04-03T03:57:44.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.422+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13 : miss 2024-04-03T03:57:44.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.422+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.422+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=402 2024-04-03T03:57:44.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.422+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13 info.flags=0x17 2024-04-03T03:57:44.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.422+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13 to cache LRU end 2024-04-03T03:57:44.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.422+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:44.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.422+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:44.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.422+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13 2024-04-03T03:57:44.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.426+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-04-03T03:57:44.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.430+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-04-03T03:57:44.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.434+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-04-03T03:57:44.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.434+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d553e40 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.438+0000 7f0ccf7e6980 10 manifest: total_size = 10485760 2024-04-03T03:57:44.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.438+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.725420286464203017 2024-04-03T03:57:44.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.438+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d553e40 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.438+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d54a7f8 2024-04-03T03:57:44.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.438+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13.3 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.725420286464203017 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.GNNMGNbQ4mK4Gx0TkOJ8nFjtTR4wZ4Y_0 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 336 2024-04-03T03:57:44.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.GNNMGNbQ4mK4Gx0TkOJ8nFjtTR4wZ4Y_1 2024-04-03T03:57:44.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 573 2024-04-03T03:57:44.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.GNNMGNbQ4mK4Gx0TkOJ8nFjtTR4wZ4Y_2 2024-04-03T03:57:44.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 810 2024-04-03T03:57:44.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.442+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.725420286464203017 2024-04-03T03:57:44.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.446+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-04-03T03:57:44.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.446+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00039b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x560c6d555af8 s->prefetch_data=0 2024-04-03T03:57:44.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.450+0000 7f0ccf7e6980 10 manifest: total_size = 3312 2024-04-03T03:57:44.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.450+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14530197417117173309 2024-04-03T03:57:44.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.450+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc00039b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x560c6d555af8 s->prefetch_data=0 2024-04-03T03:57:44.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.450+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d555af8 2024-04-03T03:57:44.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.450+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13.5 2024-04-03T03:57:44.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.458+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.458+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=3312 stripe_ofs=3312 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.458+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14530197417117173309 2024-04-03T03:57:44.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.458+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.458+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.FzxByaZWCo9JCcbnbXCabMWQ791wHa-_0 2024-04-03T03:57:44.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.458+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-04-03T03:57:44.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.458+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.458+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14530197417117173309 2024-04-03T03:57:44.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.462+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-04-03T03:57:44.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.462+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc8035510 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x560c6d555af8 s->prefetch_data=0 2024-04-03T03:57:44.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.462+0000 7f0ccf7e6980 10 manifest: total_size = 10485760 2024-04-03T03:57:44.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.462+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7491817295739647489 2024-04-03T03:57:44.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.462+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc8035510 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x560c6d555af8 s->prefetch_data=0 2024-04-03T03:57:44.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.462+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d555af8 2024-04-03T03:57:44.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.462+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13.7 2024-04-03T03:57:44.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7491817295739647489 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.fe43YwTA3nfj2kIX74Gqgzm9_69V7zx_0 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.fe43YwTA3nfj2kIX74Gqgzm9_69V7zx_1 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.fe43YwTA3nfj2kIX74Gqgzm9_69V7zx_2 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.466+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7491817295739647489 2024-04-03T03:57:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.470+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-04-03T03:57:44.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.470+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:44.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.470+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:44.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.474+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:44.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.474+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:44.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.474+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:44.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.474+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:44.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.474+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:44.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.478+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-04-03T03:57:44.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.478+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.478+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=228 2024-04-03T03:57:44.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.478+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-04-03T03:57:44.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.478+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-04-03T03:57:44.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.482+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-04-03T03:57:44.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.482+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-04-03T03:57:44.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.482+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562388 cookie 94611373635600 notifier 5639 bl.length()=184 2024-04-03T03:57:44.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.490+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13 from cache 2024-04-03T03:57:44.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.490+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13, ofs0, ns] 2024-04-03T03:57:44.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.490+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562380 cookie 94611373626960 notifier 5639 bl.length()=242 2024-04-03T03:57:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.498+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13 : miss 2024-04-03T03:57:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.498+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.502+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.502+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13 info.flags=0x0 2024-04-03T03:57:44.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.502+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13 to cache LRU end 2024-04-03T03:57:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.506+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6 : miss 2024-04-03T03:57:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.506+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.506+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=397 2024-04-03T03:57:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.506+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6 info.flags=0x17 2024-04-03T03:57:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.506+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6 to cache LRU end 2024-04-03T03:57:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.506+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.506+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.506+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6 2024-04-03T03:57:44.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.510+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got ___ 2024-04-03T03:57:44.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.510+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got __ _ 2024-04-03T03:57:44.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.514+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got __ 2024-04-03T03:57:44.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.518+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got obj 2024-04-03T03:57:44.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.518+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d559a80 obj=test-client.0-r-test-small-obj-data.1:___ state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.522+0000 7f0ccf7e6980 10 manifest: total_size = 0 2024-04-03T03:57:44.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.522+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4193843614683466012 2024-04-03T03:57:44.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.522+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d559a80 obj=test-client.0-r-test-small-obj-data.1:___ state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.522+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d544bf8 2024-04-03T03:57:44.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.522+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6.2 2024-04-03T03:57:44.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.526+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d559a80 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.530+0000 7f0ccf7e6980 10 manifest: total_size = 0 2024-04-03T03:57:44.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.530+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13049247442568053745 2024-04-03T03:57:44.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.530+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d559a80 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.530+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d544bf8 2024-04-03T03:57:44.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.530+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6.3 2024-04-03T03:57:44.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.530+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=___ 2024-04-03T03:57:44.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.538+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d559a80 obj=test-client.0-r-test-small-obj-data.1:__ state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.538+0000 7f0ccf7e6980 10 manifest: total_size = 0 2024-04-03T03:57:44.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.538+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9616611934520179352 2024-04-03T03:57:44.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.538+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d559a80 obj=test-client.0-r-test-small-obj-data.1:__ state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.538+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d544bf8 2024-04-03T03:57:44.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.538+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6.6 2024-04-03T03:57:44.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.538+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-04-03T03:57:44.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.546+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d559a80 obj=test-client.0-r-test-small-obj-data.1:obj state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.546+0000 7f0ccf7e6980 10 manifest: total_size = 0 2024-04-03T03:57:44.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.546+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13314758211644420054 2024-04-03T03:57:44.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.546+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d559a80 obj=test-client.0-r-test-small-obj-data.1:obj state=0x560c6d544bf8 s->prefetch_data=0 2024-04-03T03:57:44.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.546+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d544bf8 2024-04-03T03:57:44.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.546+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6.8 2024-04-03T03:57:44.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.550+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=__ 2024-04-03T03:57:44.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.554+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:44.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.554+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:44.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.558+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=obj 2024-04-03T03:57:44.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.558+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:44.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.558+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:44.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.558+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:44.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.558+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:44.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.558+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:44.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.562+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-04-03T03:57:44.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.562+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.562+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=223 2024-04-03T03:57:44.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.562+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-04-03T03:57:44.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.562+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-04-03T03:57:44.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.566+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-04-03T03:57:44.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.566+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-04-03T03:57:44.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.566+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562426 cookie 94611373631344 notifier 5639 bl.length()=181 2024-04-03T03:57:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.574+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6 from cache 2024-04-03T03:57:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.574+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6, ofs0, ns] 2024-04-03T03:57:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.574+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562381 cookie 94611373645856 notifier 5639 bl.length()=238 2024-04-03T03:57:44.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.586+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6 : miss 2024-04-03T03:57:44.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.586+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.586+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.586+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6 info.flags=0x0 2024-04-03T03:57:44.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.586+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6 to cache LRU end 2024-04-03T03:57:44.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.590+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7 : miss 2024-04-03T03:57:44.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.590+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.590+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=397 2024-04-03T03:57:44.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.590+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7 info.flags=0x17 2024-04-03T03:57:44.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.590+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7 to cache LRU end 2024-04-03T03:57:44.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.590+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:44.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.590+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:44.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.590+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7 2024-04-03T03:57:44.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.594+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got ___ 2024-04-03T03:57:44.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.598+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got __ _ 2024-04-03T03:57:44.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.598+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got __ 2024-04-03T03:57:44.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.602+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got obj 2024-04-03T03:57:44.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.602+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5553e0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x560c6d555af8 s->prefetch_data=0 2024-04-03T03:57:44.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.606+0000 7f0ccf7e6980 10 manifest: total_size = 527 2024-04-03T03:57:44.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.606+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16260139883612237335 2024-04-03T03:57:44.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.606+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5553e0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x560c6d555af8 s->prefetch_data=0 2024-04-03T03:57:44.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.606+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d555af8 2024-04-03T03:57:44.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.606+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7.2 2024-04-03T03:57:44.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.614+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.614+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.614+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16260139883612237335 2024-04-03T03:57:44.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.614+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.614+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7__shadow_.DuRl3DIIGsWR1EieurhIYs1rFKBTBul_0 2024-04-03T03:57:44.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.614+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-04-03T03:57:44.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.614+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.614+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16260139883612237335 2024-04-03T03:57:44.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.614+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5553e0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x560c6d555af8 s->prefetch_data=0 2024-04-03T03:57:44.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.618+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=___ 2024-04-03T03:57:44.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.618+0000 7f0ccf7e6980 10 manifest: total_size = 24595 2024-04-03T03:57:44.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.618+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17483528783572376059 2024-04-03T03:57:44.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.618+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5553e0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x560c6d555af8 s->prefetch_data=0 2024-04-03T03:57:44.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.618+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d555af8 2024-04-03T03:57:44.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.618+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7.3 2024-04-03T03:57:44.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.622+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.622+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.622+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17483528783572376059 2024-04-03T03:57:44.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.622+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.622+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7__shadow_.pWiCZKBTi4xklWOna8ugd17JJyqiyeb_0 2024-04-03T03:57:44.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.622+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-04-03T03:57:44.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.622+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.622+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17483528783572376059 2024-04-03T03:57:44.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.626+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-04-03T03:57:44.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.626+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5553e0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.630+0000 7f0ccf7e6980 10 manifest: total_size = 24595 2024-04-03T03:57:44.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.630+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16500532093660992301 2024-04-03T03:57:44.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.630+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5553e0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.630+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d54a7f8 2024-04-03T03:57:44.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.630+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7.6 2024-04-03T03:57:44.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.634+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.634+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.634+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16500532093660992301 2024-04-03T03:57:44.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.634+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.634+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7__shadow_.QqVgHuLwK-V1rdcoVBuV8HuHlsDZ9dV_0 2024-04-03T03:57:44.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.634+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-04-03T03:57:44.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.634+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.634+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16500532093660992301 2024-04-03T03:57:44.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.638+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=__ 2024-04-03T03:57:44.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.638+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5553e0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.642+0000 7f0ccf7e6980 10 manifest: total_size = 24595 2024-04-03T03:57:44.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.642+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6622861645986387367 2024-04-03T03:57:44.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.642+0000 7f0ccf7e6980 20 get_obj_state: octx=0x560c6d5553e0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.642+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d54a7f8 2024-04-03T03:57:44.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.642+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7.8 2024-04-03T03:57:44.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.646+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.646+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6622861645986387367 2024-04-03T03:57:44.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7__shadow_.k3MZi7uD9C9wsxGMF41opP2V5WSLhXV_0 2024-04-03T03:57:44.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-04-03T03:57:44.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.646+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6622861645986387367 2024-04-03T03:57:44.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.650+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=obj 2024-04-03T03:57:44.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.654+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:44.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.654+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:44.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.658+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:44.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.658+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:44.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.658+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:44.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.658+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:44.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.658+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:44.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.662+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-04-03T03:57:44.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.662+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.662+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=223 2024-04-03T03:57:44.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.662+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-04-03T03:57:44.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.662+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-04-03T03:57:44.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.666+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-04-03T03:57:44.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.666+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-04-03T03:57:44.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.666+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562427 cookie 94611373631344 notifier 5639 bl.length()=181 2024-04-03T03:57:44.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.674+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7 from cache 2024-04-03T03:57:44.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.674+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7, ofs0, ns] 2024-04-03T03:57:44.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.674+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562382 cookie 94611373645856 notifier 5639 bl.length()=238 2024-04-03T03:57:44.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.682+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7 : miss 2024-04-03T03:57:44.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.682+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.686+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.686+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7 info.flags=0x0 2024-04-03T03:57:44.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.686+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7 to cache LRU end 2024-04-03T03:57:44.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.690+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8 : miss 2024-04-03T03:57:44.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.690+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.690+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=397 2024-04-03T03:57:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.690+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8 info.flags=0x17 2024-04-03T03:57:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.690+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8 to cache LRU end 2024-04-03T03:57:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.690+0000 7f0ccf7e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.690+0000 7f0ccf7e6980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T03:57:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.690+0000 7f0ccf7e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8 2024-04-03T03:57:44.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.694+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got ___ 2024-04-03T03:57:44.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.694+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got __ _ 2024-04-03T03:57:44.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.698+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got __ 2024-04-03T03:57:44.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.702+0000 7f0ccf7e6980 10 cls_bucket_list_unordered: got obj 2024-04-03T03:57:44.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.702+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.706+0000 7f0ccf7e6980 10 manifest: total_size = 1035 2024-04-03T03:57:44.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.706+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5951238019708502504 2024-04-03T03:57:44.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.706+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.706+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d54a7f8 2024-04-03T03:57:44.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.706+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8.2 2024-04-03T03:57:44.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.710+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.710+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.710+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5951238019708502504 2024-04-03T03:57:44.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.710+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.710+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8__shadow_.TNezj2AtlJEn22XOWWem8SFtUfDqDKB_0 2024-04-03T03:57:44.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.710+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-04-03T03:57:44.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.710+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.710+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5951238019708502504 2024-04-03T03:57:44.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.714+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=___ 2024-04-03T03:57:44.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.714+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.718+0000 7f0ccf7e6980 10 manifest: total_size = 1048576 2024-04-03T03:57:44.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.718+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3598067952049809957 2024-04-03T03:57:44.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.718+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.718+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d54a7f8 2024-04-03T03:57:44.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.718+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8.3 2024-04-03T03:57:44.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3598067952049809957 2024-04-03T03:57:44.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8__shadow_.BodMfJyoBbIpCOm1-2pZUDtI5i4HWn6_0 2024-04-03T03:57:44.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-04-03T03:57:44.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3598067952049809957 2024-04-03T03:57:44.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=__ _ 2024-04-03T03:57:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.726+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.730+0000 7f0ccf7e6980 10 manifest: total_size = 49187 2024-04-03T03:57:44.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.730+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.931163491536878405 2024-04-03T03:57:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.730+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.730+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d54a7f8 2024-04-03T03:57:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.730+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8.6 2024-04-03T03:57:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.734+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.734+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.734+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.931163491536878405 2024-04-03T03:57:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.734+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.734+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8__shadow_.hltaCS2lqk0LmzeRlyDjETOT4I_AqoH_0 2024-04-03T03:57:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.734+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-04-03T03:57:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.734+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.734+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.931163491536878405 2024-04-03T03:57:44.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.738+0000 7f0bb0ff9640 20 handle_completion(): completion ok for obj=__ 2024-04-03T03:57:44.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.738+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.742+0000 7f0ccf7e6980 10 manifest: total_size = 4134 2024-04-03T03:57:44.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.742+0000 7f0ccf7e6980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11839593790148591634 2024-04-03T03:57:44.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.742+0000 7f0ccf7e6980 20 get_obj_state: octx=0x7f0cc80356b0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x560c6d54a7f8 s->prefetch_data=0 2024-04-03T03:57:44.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.742+0000 7f0ccf7e6980 20 prepare_atomic_modification: state is not atomic. state=0x560c6d54a7f8 2024-04-03T03:57:44.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.742+0000 7f0ccf7e6980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8.8 2024-04-03T03:57:44.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T03:57:44.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.746+0000 7f0ccf7e6980 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-04-03T03:57:44.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11839593790148591634 2024-04-03T03:57:44.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-04-03T03:57:44.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8__shadow_.RAbJg2bvmjIJal7DKf0yM5diBj_lNTL_0 2024-04-03T03:57:44.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-04-03T03:57:44.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-04-03T03:57:44.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.746+0000 7f0ccf7e6980 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11839593790148591634 2024-04-03T03:57:44.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.750+0000 7f0ccf7e6980 20 list_objects_ordered: starting attempt 1 2024-04-03T03:57:44.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.750+0000 7f0ccf7e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-03T03:57:44.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.750+0000 7f0b9ffff640 20 handle_completion(): completion ok for obj=obj 2024-04-03T03:57:44.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.754+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-03T03:57:44.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.754+0000 7f0ccf7e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-03T03:57:44.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.754+0000 7f0ccf7e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-03T03:57:44.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.754+0000 7f0ccf7e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-03T03:57:44.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.754+0000 7f0ccf7e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8])"; uploads.size()=0; is_truncated=0 2024-04-03T03:57:44.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.758+0000 7f0ccf7e6980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-04-03T03:57:44.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.758+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.758+0000 7f0ccf7e6980 20 rados_obj.operate() r=0 bl.length=223 2024-04-03T03:57:44.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.758+0000 7f0ccf7e6980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-04-03T03:57:44.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.758+0000 7f0ccf7e6980 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-04-03T03:57:44.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.762+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-04-03T03:57:44.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.762+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-04-03T03:57:44.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.762+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562428 cookie 94611373631344 notifier 5639 bl.length()=181 2024-04-03T03:57:44.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.770+0000 7f0ccf7e6980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8 from cache 2024-04-03T03:57:44.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.770+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8, ofs0, ns] 2024-04-03T03:57:44.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.770+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562383 cookie 94611373645856 notifier 5639 bl.length()=238 2024-04-03T03:57:44.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.782+0000 7f0ccf7e6980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8 : miss 2024-04-03T03:57:44.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.782+0000 7f0ccf7e6980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.782+0000 7f0ccf7e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.782+0000 7f0ccf7e6980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8 info.flags=0x0 2024-04-03T03:57:44.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.782+0000 7f0ccf7e6980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8 to cache LRU end 2024-04-03T03:57:44.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.786+0000 7f0ccf7e6980 10 removing key index: YSUPYGGDMORYTKZGLNVY 2024-04-03T03:57:44.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.790+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:YSUPYGGDMORYTKZGLNVY, ofs0, ns] 2024-04-03T03:57:44.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.790+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562405 cookie 94611373624752 notifier 5639 bl.length()=170 2024-04-03T03:57:44.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.794+0000 7f0ccf7e6980 10 removing email index: ragweed.client.0+test@test.test 2024-04-03T03:57:44.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.798+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-04-03T03:57:44.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.798+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562389 cookie 94611373635600 notifier 5639 bl.length()=182 2024-04-03T03:57:44.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.802+0000 7f0ccf7e6980 10 removing user buckets index 2024-04-03T03:57:44.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.806+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-04-03T03:57:44.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.806+0000 7f0bb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 94611373643152 notifier 5639 bl.length()=173 2024-04-03T03:57:44.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.810+0000 7f0ccf7e6980 10 removing user index: ragweed.client.0 2024-04-03T03:57:44.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.814+0000 7f0ccf7e6980 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-04-03T03:57:44.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.814+0000 7f0ccf7e6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-04-03T03:57:44.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.814+0000 7f0b9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562406 cookie 94611373639600 notifier 5639 bl.length()=165 2024-04-03T03:57:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.822+0000 7f0b83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:57:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.830+0000 7f0ccf7e6980 20 remove_watcher() i=0 2024-04-03T03:57:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.830+0000 7f0ccf7e6980 2 removed watcher, disabling cache 2024-04-03T03:57:44.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.830+0000 7f0ccf7e6980 20 remove_watcher() i=1 2024-04-03T03:57:44.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.834+0000 7f0ccf7e6980 20 remove_watcher() i=2 2024-04-03T03:57:44.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.838+0000 7f0ccf7e6980 20 remove_watcher() i=3 2024-04-03T03:57:44.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.838+0000 7f0ccf7e6980 20 remove_watcher() i=4 2024-04-03T03:57:44.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.842+0000 7f0ccf7e6980 20 remove_watcher() i=5 2024-04-03T03:57:44.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.846+0000 7f0ccf7e6980 20 remove_watcher() i=6 2024-04-03T03:57:44.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.846+0000 7f0ccf7e6980 20 remove_watcher() i=7 2024-04-03T03:57:44.851 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-04-03T03:57:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:57:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:57:44.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.990+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 20 realm 2024-04-03T03:57:44.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:57:44.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:44.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:57:44.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.994+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:44.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.998+0000 7f243e938980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:57:44.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:44.998+0000 7f243e938980 20 searching for the correct realm 2024-04-03T03:57:44.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.002+0000 7f243cc54640 0 -- 172.21.15.104:0/2363351717 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f2434035040 msgr2=0x7f2434035930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:57:44.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.006+0000 7f243bc52640 0 -- 172.21.15.104:0/2363351717 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f2434008040 msgr2=0x7f243404a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:57:45.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.222+0000 7f243e938980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:57:45.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.222+0000 7f243e938980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:57:45.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.222+0000 7f243e938980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:57:45.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.222+0000 7f243e938980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:57:45.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.222+0000 7f243e938980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:57:45.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.222+0000 7f243e938980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:57:45.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.222+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:45.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.222+0000 7f243e938980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:45.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.222+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:45.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:57:45.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:45.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:57:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 zone default found 2024-04-03T03:57:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 4 Realm: () 2024-04-03T03:57:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:57:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:57:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:57:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 zonegroup default 2024-04-03T03:57:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:45.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:57:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 started sync module instance, tier type = 2024-04-03T03:57:45.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.226+0000 7f243e938980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:57:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.250+0000 7f243e938980 20 add_watcher() i=0 2024-04-03T03:57:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.250+0000 7f243e938980 20 add_watcher() i=1 2024-04-03T03:57:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.250+0000 7f243e938980 20 add_watcher() i=2 2024-04-03T03:57:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.250+0000 7f243e938980 20 add_watcher() i=3 2024-04-03T03:57:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.250+0000 7f243e938980 20 add_watcher() i=4 2024-04-03T03:57:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.250+0000 7f243e938980 20 add_watcher() i=5 2024-04-03T03:57:45.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.250+0000 7f243e938980 20 add_watcher() i=6 2024-04-03T03:57:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.250+0000 7f243e938980 20 add_watcher() i=7 2024-04-03T03:57:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.250+0000 7f243e938980 2 all 8 watchers are set, enabling cache 2024-04-03T03:57:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.254+0000 7f22f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:57:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.258+0000 7f243e938980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:57:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.258+0000 7f243e938980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:57:45.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f22f1fdb640 20 reqs_thread_entry: start 2024-04-03T03:57:45.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f243e938980 20 init_complete bucket index max shards: 11 2024-04-03T03:57:45.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f243e938980 20 Filter name: none 2024-04-03T03:57:45.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f22637fe640 20 reqs_thread_entry: start 2024-04-03T03:57:45.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f243e938980 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-04-03T03:57:45.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f243e938980 20 rados->read ofs=0 len=0 2024-04-03T03:57:45.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f243e938980 20 rados_obj.operate() r=0 bl.length=453 2024-04-03T03:57:45.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f243e938980 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-04-03T03:57:45.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f243e938980 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-04-03T03:57:45.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.346+0000 7f243e938980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:57:45.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.350+0000 7f243e938980 10 removing key index: EPLJSFTYVDNZPXTLFVQX 2024-04-03T03:57:45.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.350+0000 7f243e938980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:EPLJSFTYVDNZPXTLFVQX, ofs0, ns] 2024-04-03T03:57:45.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.350+0000 7f23137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 93896062507344 notifier 5985 bl.length()=170 2024-04-03T03:57:45.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.354+0000 7f243e938980 10 removing email index: sysuser.client.0+test@test.test 2024-04-03T03:57:45.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.354+0000 7f243e938980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-04-03T03:57:45.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.354+0000 7f23137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562407 cookie 93896062499440 notifier 5985 bl.length()=182 2024-04-03T03:57:45.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.358+0000 7f243e938980 10 removing user buckets index 2024-04-03T03:57:45.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.366+0000 7f243e938980 10 removing user index: sysuser.client.0 2024-04-03T03:57:45.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.370+0000 7f243e938980 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-04-03T03:57:45.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.370+0000 7f243e938980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-04-03T03:57:45.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.370+0000 7f2312ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562390 cookie 93896062497136 notifier 5985 bl.length()=165 2024-04-03T03:57:45.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.374+0000 7f22f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:57:45.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.378+0000 7f243e938980 20 remove_watcher() i=0 2024-04-03T03:57:45.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.378+0000 7f243e938980 2 removed watcher, disabling cache 2024-04-03T03:57:45.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.378+0000 7f243e938980 20 remove_watcher() i=1 2024-04-03T03:57:45.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.382+0000 7f243e938980 20 remove_watcher() i=2 2024-04-03T03:57:45.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.386+0000 7f243e938980 20 remove_watcher() i=3 2024-04-03T03:57:45.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.386+0000 7f243e938980 20 remove_watcher() i=4 2024-04-03T03:57:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.386+0000 7f243e938980 20 remove_watcher() i=5 2024-04-03T03:57:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.390+0000 7f243e938980 20 remove_watcher() i=6 2024-04-03T03:57:45.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T03:57:45.390+0000 7f243e938980 20 remove_watcher() i=7 2024-04-03T03:57:45.388 INFO:tasks.ragweed:Removing ragweed... 2024-04-03T03:57:45.388 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-04-03T03:57:45.479 INFO:teuthology.run_tasks:Running task workunit... 2024-04-03T03:57:45.490 INFO:tasks.workunit:Pulling workunits from ref 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:57:45.490 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-03T03:57:45.490 DEBUG:teuthology.orchestra.run.smithi104:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:57:45.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T03:57:45.495 INFO:teuthology.orchestra.run.smithi104.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-03T03:57:45.495 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T03:57:45.541 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-03T03:57:45.542 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-03T03:57:45.589 INFO:tasks.workunit:timeout=3h 2024-04-03T03:57:45.589 INFO:tasks.workunit:cleanup=True 2024-04-03T03:57:45.590 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T03:57:45.639 INFO:tasks.workunit.client.0.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-03T03:59:03.462 INFO:tasks.workunit.client.0.smithi104.stderr:Updating files: 97% (12015/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-03T03:59:04.128 INFO:tasks.workunit.client.0.smithi104.stderr:Note: switching to '888a4a757aa90aa5ed4fb3291576474bc07507ce'. 2024-04-03T03:59:04.128 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:04.128 INFO:tasks.workunit.client.0.smithi104.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr:state without impacting any branches by switching back to a branch. 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr: git switch -c 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr:Or undo this operation with: 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr: git switch - 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-03T03:59:04.129 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:04.130 INFO:tasks.workunit.client.0.smithi104.stderr:HEAD is now at 888a4a757aa Merge branch 'pr-56562' into wip-cbodley-testing 2024-04-03T03:59:04.135 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-03T03:59:04.190 INFO:tasks.workunit.client.0.smithi104.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-03T03:59:04.191 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T03:59:04.191 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-03T03:59:04.257 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-03T03:59:04.314 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-03T03:59:04.361 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T03:59:04.362 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T03:59:04.362 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-03T03:59:04.403 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T03:59:04.406 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T03:59:04.406 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-03T03:59:04.456 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-04-03T03:59:04.457 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-04-03T03:59:04.458 DEBUG:teuthology.orchestra.run.smithi104:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-04-03T03:59:04.507 INFO:tasks.workunit.client.0.smithi104.stderr:+ ulimit -c 0 2024-04-03T03:59:04.507 INFO:tasks.workunit.client.0.smithi104.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-04-03T03:59:04.507 INFO:tasks.workunit.client.0.smithi104.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-04-03T03:59:04.507 INFO:tasks.workunit.client.0.smithi104.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-04-03T03:59:07.437 INFO:tasks.workunit.client.0.smithi104.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-04-03T03:59:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:++ deactivate nondestructive 2024-04-03T03:59:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T03:59:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T03:59:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-04-03T03:59:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:++ hash -r 2024-04-03T03:59:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T03:59:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:++ unset VIRTUAL_ENV 2024-04-03T03:59:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-04-03T03:59:07.438 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ export VIRTUAL_ENV 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ export PATH 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -z '' ']' 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ _OLD_VIRTUAL_PS1= 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ PS1='(rgw) ' 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ export PS1 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-04-03T03:59:07.439 INFO:tasks.workunit.client.0.smithi104.stderr:++ export VIRTUAL_ENV_PROMPT 2024-04-03T03:59:07.440 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-04-03T03:59:07.440 INFO:tasks.workunit.client.0.smithi104.stderr:++ hash -r 2024-04-03T03:59:07.440 INFO:tasks.workunit.client.0.smithi104.stderr:+ pip install pip --upgrade 2024-04-03T03:59:07.835 INFO:tasks.workunit.client.0.smithi104.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-04-03T03:59:08.056 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting pip 2024-04-03T03:59:08.063 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-04-03T03:59:08.100 INFO:tasks.workunit.client.0.smithi104.stdout:Installing collected packages: pip 2024-04-03T03:59:08.100 INFO:tasks.workunit.client.0.smithi104.stdout: Attempting uninstall: pip 2024-04-03T03:59:08.100 INFO:tasks.workunit.client.0.smithi104.stdout: Found existing installation: pip 22.0.2 2024-04-03T03:59:08.358 INFO:tasks.workunit.client.0.smithi104.stdout: Uninstalling pip-22.0.2: 2024-04-03T03:59:08.364 INFO:tasks.workunit.client.0.smithi104.stdout: Successfully uninstalled pip-22.0.2 2024-04-03T03:59:09.460 INFO:tasks.workunit.client.0.smithi104.stdout:Successfully installed pip-24.0 2024-04-03T03:59:09.525 INFO:tasks.workunit.client.0.smithi104.stderr:+ pip install boto3 2024-04-03T03:59:10.478 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting boto3 2024-04-03T03:59:10.479 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached boto3-1.34.76-py3-none-any.whl.metadata (6.6 kB) 2024-04-03T03:59:11.040 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting botocore<1.35.0,>=1.34.76 (from boto3) 2024-04-03T03:59:11.041 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached botocore-1.34.76-py3-none-any.whl.metadata (5.7 kB) 2024-04-03T03:59:11.105 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-04-03T03:59:11.106 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-04-03T03:59:11.168 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-04-03T03:59:11.169 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached s3transfer-0.10.1-py3-none-any.whl.metadata (1.7 kB) 2024-04-03T03:59:11.244 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T03:59:11.246 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-04-03T03:59:11.358 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T03:59:11.359 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached urllib3-2.2.1-py3-none-any.whl.metadata (6.4 kB) 2024-04-03T03:59:11.518 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T03:59:11.519 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-04-03T03:59:11.532 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached boto3-1.34.76-py3-none-any.whl (139 kB) 2024-04-03T03:59:11.533 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached botocore-1.34.76-py3-none-any.whl (12.1 MB) 2024-04-03T03:59:11.557 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-04-03T03:59:11.558 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached s3transfer-0.10.1-py3-none-any.whl (82 kB) 2024-04-03T03:59:11.560 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-04-03T03:59:11.562 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached urllib3-2.2.1-py3-none-any.whl (121 kB) 2024-04-03T03:59:11.563 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-04-03T03:59:11.655 INFO:tasks.workunit.client.0.smithi104.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-04-03T03:59:12.703 INFO:tasks.workunit.client.0.smithi104.stdout:Successfully installed boto3-1.34.76 botocore-1.34.76 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.1 six-1.16.0 urllib3-2.2.1 2024-04-03T03:59:12.867 INFO:tasks.workunit.client.0.smithi104.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-04-03T03:59:13.005 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-04-03T03:59:13.042 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:13.042 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:13.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.101+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:13.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 realm 2024-04-03T03:59:13.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:13.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:13.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:13.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:13.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:13.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.105+0000 7f673d91a980 20 searching for the correct realm 2024-04-03T03:59:13.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.113+0000 7f673b435640 0 -- 172.21.15.104:0/1149132924 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x561c71d29bd0 msgr2=0x561c71d2bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:13.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.117+0000 7f673bc36640 0 -- 172.21.15.104:0/1149132924 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f67340ffa20 msgr2=0x7f67340fc810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:13.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:13.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:13.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:13.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:13.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:13.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:13.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:13.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:13.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.125+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:13.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 zone default found 2024-04-03T03:59:13.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 4 Realm: () 2024-04-03T03:59:13.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:13.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:13.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:13.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 zonegroup default 2024-04-03T03:59:13.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:13.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:13.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:13.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 started sync module instance, tier type = 2024-04-03T03:59:13.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.129+0000 7f673d91a980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:13.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f673d91a980 20 add_watcher() i=0 2024-04-03T03:59:13.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f673d91a980 20 add_watcher() i=1 2024-04-03T03:59:13.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f673d91a980 20 add_watcher() i=2 2024-04-03T03:59:13.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f673d91a980 20 add_watcher() i=3 2024-04-03T03:59:13.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f673d91a980 20 add_watcher() i=4 2024-04-03T03:59:13.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f673d91a980 20 add_watcher() i=5 2024-04-03T03:59:13.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f673d91a980 20 add_watcher() i=6 2024-04-03T03:59:13.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f673d91a980 20 add_watcher() i=7 2024-04-03T03:59:13.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f673d91a980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:13.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.145+0000 7f65f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:13.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:13.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:13.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 5 note: GC not initialized 2024-04-03T03:59:13.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f65f0fe1640 20 reqs_thread_entry: start 2024-04-03T03:59:13.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:13.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 20 Filter name: none 2024-04-03T03:59:13.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f656a7fc640 20 reqs_thread_entry: start 2024-04-03T03:59:13.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-04-03T03:59:13.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:13.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-04-03T03:59:13.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-04-03T03:59:13.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-04-03T03:59:13.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 20 rados->read ofs=0 len=0 2024-04-03T03:59:13.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:13.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-04-03T03:59:13.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-03T03:59:13.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-03T03:59:13.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-03T03:59:13.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-04-03T03:59:13.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-04-03T03:59:13.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f673d91a980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-04-03T03:59:13.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f661effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562439 cookie 94680168774800 notifier 5672 bl.length()=536 2024-04-03T03:59:13.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f661effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-04-03T03:59:13.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.149+0000 7f661effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-04-03T03:59:13.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.153+0000 7f673d91a980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-03T03:59:13.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.153+0000 7f673d91a980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-03T03:59:13.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.153+0000 7f673d91a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-03T03:59:13.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.153+0000 7f661effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562440 cookie 94680168778368 notifier 5672 bl.length()=180 2024-04-03T03:59:13.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.153+0000 7f661effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-03T03:59:13.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.153+0000 7f661effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-03T03:59:13.138 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.157+0000 7f65f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:13.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.161+0000 7f673d91a980 20 remove_watcher() i=0 2024-04-03T03:59:13.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.161+0000 7f673d91a980 2 removed watcher, disabling cache 2024-04-03T03:59:13.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.161+0000 7f673d91a980 20 remove_watcher() i=1 2024-04-03T03:59:13.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.165+0000 7f673d91a980 20 remove_watcher() i=2 2024-04-03T03:59:13.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.165+0000 7f673d91a980 20 remove_watcher() i=3 2024-04-03T03:59:13.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.169+0000 7f673d91a980 20 remove_watcher() i=4 2024-04-03T03:59:13.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.169+0000 7f673d91a980 20 remove_watcher() i=5 2024-04-03T03:59:13.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.169+0000 7f673d91a980 20 remove_watcher() i=6 2024-04-03T03:59:13.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:13.173+0000 7f673d91a980 20 remove_watcher() i=7 2024-04-03T03:59:22.792 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:22.792 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:22.866 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:22.866 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:22.990 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:22.990 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:23.102 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:23.102 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:23.157 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:23.157 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:23.248 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:23.248 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:23.325 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard add 2024-04-03T03:59:23.325 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:23.325 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-04-03T03:59:23.358 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:23.358 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:23.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.420+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:23.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 20 realm 2024-04-03T03:59:23.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:23.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:23.406 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.406 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:23.406 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:23.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.424+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.428+0000 7fa1669be980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:23.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.428+0000 7fa1669be980 20 searching for the correct realm 2024-04-03T03:59:23.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.432+0000 7fa164cda640 0 -- 172.21.15.104:0/2912622936 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fa154083c20 msgr2=0x7fa15406d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:23.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.648+0000 7fa163cd8640 0 -- 172.21.15.104:0/2912622936 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fa15405a6c0 msgr2=0x7fa15407a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:23.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:23.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:23.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:23.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:23.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:23.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:23.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:23.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:23.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.864+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:23.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 zone default found 2024-04-03T03:59:23.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 4 Realm: () 2024-04-03T03:59:23.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:23.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:23.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:23.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 zonegroup default 2024-04-03T03:59:23.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:23.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:23.849 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:23.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 started sync module instance, tier type = 2024-04-03T03:59:23.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.868+0000 7fa1669be980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:23.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.888+0000 7fa1669be980 20 add_watcher() i=0 2024-04-03T03:59:23.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.888+0000 7fa1669be980 20 add_watcher() i=1 2024-04-03T03:59:23.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.888+0000 7fa1669be980 20 add_watcher() i=2 2024-04-03T03:59:23.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.888+0000 7fa1669be980 20 add_watcher() i=3 2024-04-03T03:59:23.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.888+0000 7fa1669be980 20 add_watcher() i=4 2024-04-03T03:59:23.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.888+0000 7fa1669be980 20 add_watcher() i=5 2024-04-03T03:59:23.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.888+0000 7fa1669be980 20 add_watcher() i=6 2024-04-03T03:59:23.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.892+0000 7fa1669be980 20 add_watcher() i=7 2024-04-03T03:59:23.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.892+0000 7fa1669be980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:23.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.896+0000 7fa01afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:23.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.896+0000 7fa1669be980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:23.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.896+0000 7fa1669be980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:23.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.896+0000 7fa1669be980 5 note: GC not initialized 2024-04-03T03:59:23.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.900+0000 7fa019fdb640 20 reqs_thread_entry: start 2024-04-03T03:59:23.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.900+0000 7fa1669be980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:23.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.900+0000 7fa1669be980 20 Filter name: none 2024-04-03T03:59:23.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.900+0000 7f9f8b7fe640 20 reqs_thread_entry: start 2024-04-03T03:59:23.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.900+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.900+0000 7fa1669be980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:23.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.900+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.904+0000 7fa1669be980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:23.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.904+0000 7fa1669be980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:23.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.904+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.904+0000 7fa1669be980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:23.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.904+0000 7fa1669be980 20 rados->read ofs=0 len=0 2024-04-03T03:59:23.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.904+0000 7fa1669be980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:23.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.904+0000 7fa1669be980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:23.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.908+0000 7fa01afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:23.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.912+0000 7fa1669be980 20 remove_watcher() i=0 2024-04-03T03:59:23.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.916+0000 7fa1669be980 2 removed watcher, disabling cache 2024-04-03T03:59:23.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.916+0000 7fa1669be980 20 remove_watcher() i=1 2024-04-03T03:59:23.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.920+0000 7fa1669be980 20 remove_watcher() i=2 2024-04-03T03:59:23.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.920+0000 7fa1669be980 20 remove_watcher() i=3 2024-04-03T03:59:23.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.924+0000 7fa1669be980 20 remove_watcher() i=4 2024-04-03T03:59:23.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.924+0000 7fa1669be980 20 remove_watcher() i=5 2024-04-03T03:59:23.908 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.928+0000 7fa1669be980 20 remove_watcher() i=6 2024-04-03T03:59:23.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:23.928+0000 7fa1669be980 20 remove_watcher() i=7 2024-04-03T03:59:23.933 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:23.933 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:23.933 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: a-bucket id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-04-03T03:59:23.933 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:23.934 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-04-03T03:59:23.963 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:23.964 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:24.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.028+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.028+0000 7fb56d5a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.028+0000 7fb56d5a6980 20 realm 2024-04-03T03:59:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.028+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.028+0000 7fb56d5a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.028+0000 7fb56d5a6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.028+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.028+0000 7fb56d5a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.010 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.028+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.032+0000 7fb56d5a6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:24.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.032+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.032+0000 7fb56d5a6980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:24.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.032+0000 7fb56d5a6980 20 searching for the correct realm 2024-04-03T03:59:24.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.036+0000 7fb56a8c0640 0 -- 172.21.15.104:0/624518298 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fb55c0c1070 msgr2=0x7fb55c0effe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:24.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.044+0000 7fb56a8c0640 0 -- 172.21.15.104:0/624518298 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fb564032830 msgr2=0x7fb56404e1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:24.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:24.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:24.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:24.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:24.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:24.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:24.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:24.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.260+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:24.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 zone default found 2024-04-03T03:59:24.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 4 Realm: () 2024-04-03T03:59:24.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:24.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:24.244 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:24.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 zonegroup default 2024-04-03T03:59:24.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.245 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 started sync module instance, tier type = 2024-04-03T03:59:24.246 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.264+0000 7fb56d5a6980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:24.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.288+0000 7fb56d5a6980 20 add_watcher() i=0 2024-04-03T03:59:24.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.288+0000 7fb56d5a6980 20 add_watcher() i=1 2024-04-03T03:59:24.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.288+0000 7fb56d5a6980 20 add_watcher() i=2 2024-04-03T03:59:24.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.288+0000 7fb56d5a6980 20 add_watcher() i=3 2024-04-03T03:59:24.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.288+0000 7fb56d5a6980 20 add_watcher() i=4 2024-04-03T03:59:24.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.288+0000 7fb56d5a6980 20 add_watcher() i=5 2024-04-03T03:59:24.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.288+0000 7fb56d5a6980 20 add_watcher() i=6 2024-04-03T03:59:24.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.288+0000 7fb56d5a6980 20 add_watcher() i=7 2024-04-03T03:59:24.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.288+0000 7fb56d5a6980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:24.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.292+0000 7fb421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:24.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.292+0000 7fb56d5a6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:24.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.292+0000 7fb56d5a6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:24.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.292+0000 7fb56d5a6980 5 note: GC not initialized 2024-04-03T03:59:24.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb420fe1640 20 reqs_thread_entry: start 2024-04-03T03:59:24.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:24.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 20 Filter name: none 2024-04-03T03:59:24.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb39a7fc640 20 reqs_thread_entry: start 2024-04-03T03:59:24.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-04-03T03:59:24.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:24.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-04-03T03:59:24.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-04-03T03:59:24.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 : miss 2024-04-03T03:59:24.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:24.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:24.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:24.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:24.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:24.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.296+0000 7fb56d5a6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 2024-04-03T03:59:24.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.300+0000 7fb421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:24.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.304+0000 7fb56d5a6980 20 remove_watcher() i=0 2024-04-03T03:59:24.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.304+0000 7fb56d5a6980 2 removed watcher, disabling cache 2024-04-03T03:59:24.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.308+0000 7fb56d5a6980 20 remove_watcher() i=1 2024-04-03T03:59:24.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.308+0000 7fb56d5a6980 20 remove_watcher() i=2 2024-04-03T03:59:24.293 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.312+0000 7fb56d5a6980 20 remove_watcher() i=3 2024-04-03T03:59:24.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.312+0000 7fb56d5a6980 20 remove_watcher() i=4 2024-04-03T03:59:24.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.316+0000 7fb56d5a6980 20 remove_watcher() i=5 2024-04-03T03:59:24.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.316+0000 7fb56d5a6980 20 remove_watcher() i=6 2024-04-03T03:59:24.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.320+0000 7fb56d5a6980 20 remove_watcher() i=7 2024-04-03T03:59:24.315 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin reshard list 2024-04-03T03:59:24.342 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:24.342 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:24.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.404+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.404+0000 7f3be8e3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.404+0000 7f3be8e3c980 20 realm 2024-04-03T03:59:24.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.404+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.404+0000 7f3be8e3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.404+0000 7f3be8e3c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:24.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.404+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.404+0000 7f3be8e3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.404+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.408+0000 7f3be8e3c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:24.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.408+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.408+0000 7f3be8e3c980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:24.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.408+0000 7f3be8e3c980 20 searching for the correct realm 2024-04-03T03:59:24.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.412+0000 7f3be7158640 0 -- 172.21.15.104:0/1030981670 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f3bd803c060 msgr2=0x7f3bd8033aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:24.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.420+0000 7f3be6156640 0 -- 172.21.15.104:0/1030981670 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f3bd8009c60 msgr2=0x7f3bd80642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:24.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.636+0000 7f3be8e3c980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:24.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.636+0000 7f3be8e3c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:24.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.636+0000 7f3be8e3c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:24.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.636+0000 7f3be8e3c980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:24.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.636+0000 7f3be8e3c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:24.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.636+0000 7f3be8e3c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:24.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.636+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.636+0000 7f3be8e3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.636+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:24.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 zone default found 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 4 Realm: () 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 zonegroup default 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 started sync module instance, tier type = 2024-04-03T03:59:24.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.640+0000 7f3be8e3c980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:24.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.664+0000 7f3be8e3c980 20 add_watcher() i=0 2024-04-03T03:59:24.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.664+0000 7f3be8e3c980 20 add_watcher() i=1 2024-04-03T03:59:24.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.664+0000 7f3be8e3c980 20 add_watcher() i=2 2024-04-03T03:59:24.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.664+0000 7f3be8e3c980 20 add_watcher() i=3 2024-04-03T03:59:24.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.664+0000 7f3be8e3c980 20 add_watcher() i=4 2024-04-03T03:59:24.647 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.664+0000 7f3be8e3c980 20 add_watcher() i=5 2024-04-03T03:59:24.647 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.664+0000 7f3be8e3c980 20 add_watcher() i=6 2024-04-03T03:59:24.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.668+0000 7f3be8e3c980 20 add_watcher() i=7 2024-04-03T03:59:24.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.668+0000 7f3be8e3c980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:24.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.672+0000 7f3a9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:24.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.672+0000 7f3be8e3c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:24.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.672+0000 7f3be8e3c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:24.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.672+0000 7f3be8e3c980 5 note: GC not initialized 2024-04-03T03:59:24.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.672+0000 7f3a17fff640 20 reqs_thread_entry: start 2024-04-03T03:59:24.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.672+0000 7f3be8e3c980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:24.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.672+0000 7f3be8e3c980 20 Filter name: none 2024-04-03T03:59:24.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.672+0000 7f3a15ffb640 20 reqs_thread_entry: start 2024-04-03T03:59:24.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.688+0000 7f3a9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:24.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.692+0000 7f3be8e3c980 20 remove_watcher() i=0 2024-04-03T03:59:24.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.692+0000 7f3be8e3c980 2 removed watcher, disabling cache 2024-04-03T03:59:24.675 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.692+0000 7f3be8e3c980 20 remove_watcher() i=1 2024-04-03T03:59:24.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.696+0000 7f3be8e3c980 20 remove_watcher() i=2 2024-04-03T03:59:24.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.700+0000 7f3be8e3c980 20 remove_watcher() i=3 2024-04-03T03:59:24.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.700+0000 7f3be8e3c980 20 remove_watcher() i=4 2024-04-03T03:59:24.683 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.704+0000 7f3be8e3c980 20 remove_watcher() i=5 2024-04-03T03:59:24.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.704+0000 7f3be8e3c980 20 remove_watcher() i=6 2024-04-03T03:59:24.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.704+0000 7f3be8e3c980 20 remove_watcher() i=7 2024-04-03T03:59:24.707 INFO:tasks.workunit.client.0.smithi104.stderr:bucket name a-bucket 2024-04-03T03:59:24.709 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard process 2024-04-03T03:59:24.709 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:24.709 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin reshard process 2024-04-03T03:59:24.734 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:24.735 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:24.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.796+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 20 realm 2024-04-03T03:59:24.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:24.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:24.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:24.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.800+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:24.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.804+0000 7fa02bf1c980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:24.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.804+0000 7fa02bf1c980 20 searching for the correct realm 2024-04-03T03:59:24.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.808+0000 7fa023fff640 0 -- 172.21.15.104:0/1215315445 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fa01c0d1400 msgr2=0x7fa01c0d1880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:24.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:24.816+0000 7fa023fff640 0 -- 172.21.15.104:0/1215315445 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fa024061610 msgr2=0x7fa024061d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:25.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:25.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:25.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:25.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:25.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:25.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:25.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:25.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:25.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:25.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:25.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.032+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:25.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:25.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 zone default found 2024-04-03T03:59:25.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 4 Realm: () 2024-04-03T03:59:25.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:25.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:25.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:25.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 zonegroup default 2024-04-03T03:59:25.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:25.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:25.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:25.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:25.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:25.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:25.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 started sync module instance, tier type = 2024-04-03T03:59:25.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.036+0000 7fa02bf1c980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:25.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.060+0000 7fa02bf1c980 20 add_watcher() i=0 2024-04-03T03:59:25.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.060+0000 7fa02bf1c980 20 add_watcher() i=1 2024-04-03T03:59:25.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.060+0000 7fa02bf1c980 20 add_watcher() i=2 2024-04-03T03:59:25.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.060+0000 7fa02bf1c980 20 add_watcher() i=3 2024-04-03T03:59:25.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.060+0000 7fa02bf1c980 20 add_watcher() i=4 2024-04-03T03:59:25.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.060+0000 7fa02bf1c980 20 add_watcher() i=5 2024-04-03T03:59:25.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.060+0000 7fa02bf1c980 20 add_watcher() i=6 2024-04-03T03:59:25.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.064+0000 7fa02bf1c980 20 add_watcher() i=7 2024-04-03T03:59:25.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.064+0000 7fa02bf1c980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:25.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.068+0000 7f9edffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:25.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.068+0000 7fa02bf1c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:25.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.068+0000 7fa02bf1c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:25.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.068+0000 7fa02bf1c980 5 note: GC not initialized 2024-04-03T03:59:25.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.068+0000 7f9edefe5640 20 reqs_thread_entry: start 2024-04-03T03:59:25.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.068+0000 7fa02bf1c980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:25.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.068+0000 7fa02bf1c980 20 Filter name: none 2024-04-03T03:59:25.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.068+0000 7f9edcfe1640 20 reqs_thread_entry: start 2024-04-03T03:59:25.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.068+0000 7fa02bf1c980 20 processing logshard = reshard.0000000000 2024-04-03T03:59:25.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.076+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-04-03T03:59:25.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.076+0000 7fa02bf1c980 20 processing logshard = reshard.0000000001 2024-04-03T03:59:25.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.080+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-04-03T03:59:25.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.080+0000 7fa02bf1c980 20 processing logshard = reshard.0000000002 2024-04-03T03:59:25.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.084+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-04-03T03:59:25.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.084+0000 7fa02bf1c980 20 processing logshard = reshard.0000000003 2024-04-03T03:59:25.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.088+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-04-03T03:59:25.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.088+0000 7fa02bf1c980 20 processing logshard = reshard.0000000004 2024-04-03T03:59:25.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.096+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-04-03T03:59:25.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.096+0000 7fa02bf1c980 20 processing logshard = reshard.0000000005 2024-04-03T03:59:25.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.100+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-04-03T03:59:25.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.100+0000 7fa02bf1c980 20 processing logshard = reshard.0000000006 2024-04-03T03:59:25.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 20 process_entry resharding a-bucket 2024-04-03T03:59:25.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-04-03T03:59:25.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:25.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:25.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-04-03T03:59:25.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-04-03T03:59:25.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 : miss 2024-04-03T03:59:25.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 20 rados->read ofs=0 len=0 2024-04-03T03:59:25.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:25.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:25.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:25.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:25.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:25.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.104+0000 7fa02bf1c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 2024-04-03T03:59:25.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.120+0000 7fa02bf1c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:25.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.120+0000 7fa02bf1c980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:25.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.120+0000 7fa02bf1c980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:25.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.120+0000 7fa02bf1c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17, ofs0, ns] 2024-04-03T03:59:25.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.120+0000 7f9f0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562442 cookie 94109217435872 notifier 6075 bl.length()=789 2024-04-03T03:59:25.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.120+0000 7f9f0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:25.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.120+0000 7f9f0d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:25.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.120+0000 7f9f0d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:25.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.124+0000 7fa02bf1c980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_sources= new_sources= 2024-04-03T03:59:25.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.124+0000 7fa02bf1c980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential sources added=[] removed=[] 2024-04-03T03:59:25.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.124+0000 7fa02bf1c980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_dests= new_dests= 2024-04-03T03:59:25.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.124+0000 7fa02bf1c980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential dests added=[] removed=[] 2024-04-03T03:59:25.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.0 2024-04-03T03:59:25.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.0 2024-04-03T03:59:25.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.1 2024-04-03T03:59:25.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.1 2024-04-03T03:59:25.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.2 2024-04-03T03:59:25.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.2 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.3 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.3 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.4 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.4 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.5 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.5 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.6 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.6 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.7 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.7 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.8 2024-04-03T03:59:25.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.8 2024-04-03T03:59:25.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.9 2024-04-03T03:59:25.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.9 2024-04-03T03:59:25.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.10 2024-04-03T03:59:25.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.10 2024-04-03T03:59:25.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.11 2024-04-03T03:59:25.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.11 2024-04-03T03:59:25.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.0 2024-04-03T03:59:25.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1 2024-04-03T03:59:25.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2 2024-04-03T03:59:25.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.128+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.3 2024-04-03T03:59:25.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.132+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.4 2024-04-03T03:59:25.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.132+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.5 2024-04-03T03:59:25.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.132+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.6 2024-04-03T03:59:25.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.132+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.7 2024-04-03T03:59:25.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.136+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.8 2024-04-03T03:59:25.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.136+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.9 2024-04-03T03:59:25.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.136+0000 7fa02bf1c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.10 2024-04-03T03:59:25.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.136+0000 7fa02bf1c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 : hit (requested=0x17, cached=0x17) 2024-04-03T03:59:25.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.136+0000 7fa02bf1c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 2024-04-03T03:59:25.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.140+0000 7fa02bf1c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:25.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.140+0000 7fa02bf1c980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:25.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.140+0000 7fa02bf1c980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:25.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.140+0000 7fa02bf1c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17, ofs0, ns] 2024-04-03T03:59:25.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.140+0000 7f9f0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562443 cookie 94109217435872 notifier 6075 bl.length()=757 2024-04-03T03:59:25.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.140+0000 7f9f0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:25.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.140+0000 7f9f0d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:25.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.140+0000 7f9f0d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:25.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.144+0000 7fa02bf1c980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_sources= new_sources= 2024-04-03T03:59:25.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.144+0000 7fa02bf1c980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential sources added=[] removed=[] 2024-04-03T03:59:25.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.144+0000 7fa02bf1c980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_dests= new_dests= 2024-04-03T03:59:25.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.144+0000 7fa02bf1c980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential dests added=[] removed=[] 2024-04-03T03:59:25.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.148+0000 7fa02bf1c980 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-04-03T03:59:25.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.152+0000 7fa02bf1c980 20 process_entry removing reshard queue entry for bucket a-bucket 2024-04-03T03:59:25.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.156+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-04-03T03:59:25.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.156+0000 7fa02bf1c980 20 processing logshard = reshard.0000000007 2024-04-03T03:59:25.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.160+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-04-03T03:59:25.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.160+0000 7fa02bf1c980 20 processing logshard = reshard.0000000008 2024-04-03T03:59:25.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.164+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-04-03T03:59:25.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.164+0000 7fa02bf1c980 20 processing logshard = reshard.0000000009 2024-04-03T03:59:25.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.172+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-04-03T03:59:25.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.172+0000 7fa02bf1c980 20 processing logshard = reshard.0000000010 2024-04-03T03:59:25.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.176+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-04-03T03:59:25.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.176+0000 7fa02bf1c980 20 processing logshard = reshard.0000000011 2024-04-03T03:59:25.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.180+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-04-03T03:59:25.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.180+0000 7fa02bf1c980 20 processing logshard = reshard.0000000012 2024-04-03T03:59:25.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.188+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-04-03T03:59:25.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.188+0000 7fa02bf1c980 20 processing logshard = reshard.0000000013 2024-04-03T03:59:25.173 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.192+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-04-03T03:59:25.173 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.192+0000 7fa02bf1c980 20 processing logshard = reshard.0000000014 2024-04-03T03:59:25.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.196+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-04-03T03:59:25.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.196+0000 7fa02bf1c980 20 processing logshard = reshard.0000000015 2024-04-03T03:59:25.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.204+0000 7fa02bf1c980 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-04-03T03:59:25.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.204+0000 7f9edffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:25.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.208+0000 7fa02bf1c980 20 remove_watcher() i=0 2024-04-03T03:59:25.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.208+0000 7fa02bf1c980 2 removed watcher, disabling cache 2024-04-03T03:59:25.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.212+0000 7fa02bf1c980 20 remove_watcher() i=1 2024-04-03T03:59:25.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.216+0000 7fa02bf1c980 20 remove_watcher() i=2 2024-04-03T03:59:25.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.216+0000 7fa02bf1c980 20 remove_watcher() i=3 2024-04-03T03:59:25.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.220+0000 7fa02bf1c980 20 remove_watcher() i=4 2024-04-03T03:59:25.201 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.220+0000 7fa02bf1c980 20 remove_watcher() i=5 2024-04-03T03:59:25.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.220+0000 7fa02bf1c980 20 remove_watcher() i=6 2024-04-03T03:59:25.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:25.224+0000 7fa02bf1c980 20 remove_watcher() i=7 2024-04-03T03:59:30.231 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-04-03T03:59:30.265 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:30.265 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:30.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.328+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:30.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 realm 2024-04-03T03:59:30.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:30.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:30.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:30.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:30.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:30.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.332+0000 7fede90da980 20 searching for the correct realm 2024-04-03T03:59:30.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.336+0000 7fede73f6640 0 -- 172.21.15.104:0/3788117135 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fede0043040 msgr2=0x7fede0043420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:30.326 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.344+0000 7fede63f4640 0 -- 172.21.15.104:0/3788117135 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fede0024920 msgr2=0x7fede0032400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:30.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:30.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:30.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:30.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:30.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:30.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:30.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:30.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:30.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.560+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:30.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 zone default found 2024-04-03T03:59:30.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 4 Realm: () 2024-04-03T03:59:30.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:30.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:30.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:30.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 zonegroup default 2024-04-03T03:59:30.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:30.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:30.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:30.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 started sync module instance, tier type = 2024-04-03T03:59:30.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.564+0000 7fede90da980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:30.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.588+0000 7fede90da980 20 add_watcher() i=0 2024-04-03T03:59:30.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.588+0000 7fede90da980 20 add_watcher() i=1 2024-04-03T03:59:30.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.588+0000 7fede90da980 20 add_watcher() i=2 2024-04-03T03:59:30.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.588+0000 7fede90da980 20 add_watcher() i=3 2024-04-03T03:59:30.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.588+0000 7fede90da980 20 add_watcher() i=4 2024-04-03T03:59:30.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.588+0000 7fede90da980 20 add_watcher() i=5 2024-04-03T03:59:30.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.588+0000 7fede90da980 20 add_watcher() i=6 2024-04-03T03:59:30.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.588+0000 7fede90da980 20 add_watcher() i=7 2024-04-03T03:59:30.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.588+0000 7fede90da980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:30.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.592+0000 7fec9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:30.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.592+0000 7fede90da980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:30.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.592+0000 7fede90da980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:30.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.592+0000 7fede90da980 5 note: GC not initialized 2024-04-03T03:59:30.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.592+0000 7fec17fff640 20 reqs_thread_entry: start 2024-04-03T03:59:30.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.596+0000 7fede90da980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:30.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.596+0000 7fede90da980 20 Filter name: none 2024-04-03T03:59:30.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.596+0000 7fec15ffb640 20 reqs_thread_entry: start 2024-04-03T03:59:30.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.596+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.596+0000 7fede90da980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:30.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.596+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.596+0000 7fede90da980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:30.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.596+0000 7fede90da980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:30.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.596+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.600+0000 7fede90da980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:30.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.600+0000 7fede90da980 20 rados->read ofs=0 len=0 2024-04-03T03:59:30.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.600+0000 7fede90da980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:30.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.600+0000 7fede90da980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:30.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.604+0000 7fec9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:30.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.608+0000 7fede90da980 20 remove_watcher() i=0 2024-04-03T03:59:30.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.608+0000 7fede90da980 2 removed watcher, disabling cache 2024-04-03T03:59:30.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.612+0000 7fede90da980 20 remove_watcher() i=1 2024-04-03T03:59:30.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.612+0000 7fede90da980 20 remove_watcher() i=2 2024-04-03T03:59:30.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.616+0000 7fede90da980 20 remove_watcher() i=3 2024-04-03T03:59:30.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.616+0000 7fede90da980 20 remove_watcher() i=4 2024-04-03T03:59:30.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.620+0000 7fede90da980 20 remove_watcher() i=5 2024-04-03T03:59:30.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.620+0000 7fede90da980 20 remove_watcher() i=6 2024-04-03T03:59:30.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:30.624+0000 7fede90da980 20 remove_watcher() i=7 2024-04-03T03:59:30.619 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:30.620 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:30.620 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: a-bucket id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-04-03T03:59:30.620 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:30.620 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard add non empty bucket 2024-04-03T03:59:30.620 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:30.623 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:30.623 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:30.689 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:30.689 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:30.783 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:30.783 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:30.862 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:30.862 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:30.932 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:30.933 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:31.022 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:31.022 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:31.106 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:31.107 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:31.191 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:31.191 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:31.274 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-04-03T03:59:31.306 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:31.306 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:31.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.368+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 20 realm 2024-04-03T03:59:31.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:31.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:31.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.372+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.376+0000 7fdbe2062980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:31.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.376+0000 7fdbe2062980 20 searching for the correct realm 2024-04-03T03:59:31.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.376+0000 7fdbdf37c640 0 -- 172.21.15.104:0/1417834813 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x55d214bd28d0 msgr2=0x7fdbd002b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:31.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.384+0000 7fdbdfb7d640 0 -- 172.21.15.104:0/1417834813 >> [v2:172.21.15.130:6804/3494208016,v1:172.21.15.130:6807/3494208016] conn(0x55d214bd28d0 msgr2=0x7fdaa807c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:31.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:31.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:31.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:31.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:31.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:31.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:31.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:31.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:31.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 zone default found 2024-04-03T03:59:31.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 4 Realm: () 2024-04-03T03:59:31.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:31.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:31.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:31.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 zonegroup default 2024-04-03T03:59:31.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.608+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.612+0000 7fdbe2062980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.612+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.612+0000 7fdbe2062980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.612+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.612+0000 7fdbe2062980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.612+0000 7fdbe2062980 20 started sync module instance, tier type = 2024-04-03T03:59:31.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.612+0000 7fdbe2062980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:31.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.636+0000 7fdbe2062980 20 add_watcher() i=0 2024-04-03T03:59:31.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.636+0000 7fdbe2062980 20 add_watcher() i=1 2024-04-03T03:59:31.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.636+0000 7fdbe2062980 20 add_watcher() i=2 2024-04-03T03:59:31.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.636+0000 7fdbe2062980 20 add_watcher() i=3 2024-04-03T03:59:31.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.636+0000 7fdbe2062980 20 add_watcher() i=4 2024-04-03T03:59:31.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.636+0000 7fdbe2062980 20 add_watcher() i=5 2024-04-03T03:59:31.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.636+0000 7fdbe2062980 20 add_watcher() i=6 2024-04-03T03:59:31.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.640+0000 7fdbe2062980 20 add_watcher() i=7 2024-04-03T03:59:31.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.640+0000 7fdbe2062980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:31.624 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fda95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:31.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fdbe2062980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:31.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fdbe2062980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:31.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fdbe2062980 5 note: GC not initialized 2024-04-03T03:59:31.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fda94fe1640 20 reqs_thread_entry: start 2024-04-03T03:59:31.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fdbe2062980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:31.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fdbe2062980 20 Filter name: none 2024-04-03T03:59:31.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fda0e7fc640 20 reqs_thread_entry: start 2024-04-03T03:59:31.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fdbe2062980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:31.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.644+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.648+0000 7fdbe2062980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:31.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.648+0000 7fdbe2062980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:31.628 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.648+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.648+0000 7fdbe2062980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:31.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.648+0000 7fdbe2062980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.648+0000 7fdbe2062980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:31.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.648+0000 7fdbe2062980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:31.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.652+0000 7fda95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:31.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.656+0000 7fdbe2062980 20 remove_watcher() i=0 2024-04-03T03:59:31.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.656+0000 7fdbe2062980 2 removed watcher, disabling cache 2024-04-03T03:59:31.640 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.660+0000 7fdbe2062980 20 remove_watcher() i=1 2024-04-03T03:59:31.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.660+0000 7fdbe2062980 20 remove_watcher() i=2 2024-04-03T03:59:31.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.664+0000 7fdbe2062980 20 remove_watcher() i=3 2024-04-03T03:59:31.647 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.664+0000 7fdbe2062980 20 remove_watcher() i=4 2024-04-03T03:59:31.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.668+0000 7fdbe2062980 20 remove_watcher() i=5 2024-04-03T03:59:31.650 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.668+0000 7fdbe2062980 20 remove_watcher() i=6 2024-04-03T03:59:31.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.668+0000 7fdbe2062980 20 remove_watcher() i=7 2024-04-03T03:59:31.666 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:31.666 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:31.666 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: a-bucket id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-04-03T03:59:31.666 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:31.666 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-04-03T03:59:31.695 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:31.695 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:31.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.756+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 realm 2024-04-03T03:59:31.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:31.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.740 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:31.741 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.742 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:31.742 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.760+0000 7f38168f9980 20 searching for the correct realm 2024-04-03T03:59:31.748 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.768+0000 7f3814414640 0 -- 172.21.15.104:0/4276582516 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x557575ef0f00 msgr2=0x557575ef33c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:31.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.772+0000 7f3813c13640 0 -- 172.21.15.104:0/4276582516 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f380c061bd0 msgr2=0x7f380c084660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:31.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:31.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:31.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:31.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:31.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:31.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:31.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.780+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 zone default found 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 4 Realm: () 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 zonegroup default 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 started sync module instance, tier type = 2024-04-03T03:59:31.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.784+0000 7f38168f9980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:31.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.800+0000 7f38168f9980 20 add_watcher() i=0 2024-04-03T03:59:31.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.800+0000 7f38168f9980 20 add_watcher() i=1 2024-04-03T03:59:31.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.800+0000 7f38168f9980 20 add_watcher() i=2 2024-04-03T03:59:31.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.800+0000 7f38168f9980 20 add_watcher() i=3 2024-04-03T03:59:31.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.800+0000 7f38168f9980 20 add_watcher() i=4 2024-04-03T03:59:31.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.800+0000 7f38168f9980 20 add_watcher() i=5 2024-04-03T03:59:31.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.800+0000 7f38168f9980 20 add_watcher() i=6 2024-04-03T03:59:31.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.800+0000 7f38168f9980 20 add_watcher() i=7 2024-04-03T03:59:31.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.800+0000 7f38168f9980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:31.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f36cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:31.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:31.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:31.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 5 note: GC not initialized 2024-04-03T03:59:31.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f36c9fdb640 20 reqs_thread_entry: start 2024-04-03T03:59:31.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:31.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 20 Filter name: none 2024-04-03T03:59:31.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f363b7fe640 20 reqs_thread_entry: start 2024-04-03T03:59:31.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-04-03T03:59:31.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:31.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-04-03T03:59:31.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-04-03T03:59:31.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 : miss 2024-04-03T03:59:31.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.804+0000 7f38168f9980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.808+0000 7f38168f9980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:31.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.808+0000 7f38168f9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:31.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.808+0000 7f38168f9980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:31.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.808+0000 7f38168f9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:31.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.808+0000 7f38168f9980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:31.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.808+0000 7f38168f9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 2024-04-03T03:59:31.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.808+0000 7f36cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:31.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.812+0000 7f38168f9980 20 remove_watcher() i=0 2024-04-03T03:59:31.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.812+0000 7f38168f9980 2 removed watcher, disabling cache 2024-04-03T03:59:31.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.816+0000 7f38168f9980 20 remove_watcher() i=1 2024-04-03T03:59:31.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.820+0000 7f38168f9980 20 remove_watcher() i=2 2024-04-03T03:59:31.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.820+0000 7f38168f9980 20 remove_watcher() i=3 2024-04-03T03:59:31.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.820+0000 7f38168f9980 20 remove_watcher() i=4 2024-04-03T03:59:31.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.824+0000 7f38168f9980 20 remove_watcher() i=5 2024-04-03T03:59:31.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.824+0000 7f38168f9980 20 remove_watcher() i=6 2024-04-03T03:59:31.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.824+0000 7f38168f9980 20 remove_watcher() i=7 2024-04-03T03:59:31.821 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin reshard list 2024-04-03T03:59:31.844 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:31.844 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:31.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.904+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 20 realm 2024-04-03T03:59:31.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:31.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:31.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:31.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.908+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:31.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.912+0000 7f5ca163f980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:31.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.912+0000 7f5ca163f980 20 searching for the correct realm 2024-04-03T03:59:31.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:31.912+0000 7f5c9e959640 0 -- 172.21.15.104:0/3099832587 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f5c90008050 msgr2=0x7f5c90015930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:32.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.128+0000 7f5c9f95b640 0 -- 172.21.15.104:0/3099832587 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x564324838210 msgr2=0x56432483a600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:32.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:32.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:32.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:32.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:32.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:32.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:32.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:32.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.144+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:32.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 zone default found 2024-04-03T03:59:32.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 4 Realm: () 2024-04-03T03:59:32.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:32.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:32.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:32.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 zonegroup default 2024-04-03T03:59:32.128 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.129 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 started sync module instance, tier type = 2024-04-03T03:59:32.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.148+0000 7f5ca163f980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:32.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.172+0000 7f5ca163f980 20 add_watcher() i=0 2024-04-03T03:59:32.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.172+0000 7f5ca163f980 20 add_watcher() i=1 2024-04-03T03:59:32.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.172+0000 7f5ca163f980 20 add_watcher() i=2 2024-04-03T03:59:32.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.172+0000 7f5ca163f980 20 add_watcher() i=3 2024-04-03T03:59:32.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.172+0000 7f5ca163f980 20 add_watcher() i=4 2024-04-03T03:59:32.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.172+0000 7f5ca163f980 20 add_watcher() i=5 2024-04-03T03:59:32.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.172+0000 7f5ca163f980 20 add_watcher() i=6 2024-04-03T03:59:32.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.176+0000 7f5ca163f980 20 add_watcher() i=7 2024-04-03T03:59:32.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.176+0000 7f5ca163f980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:32.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.180+0000 7f5b55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:32.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.180+0000 7f5ca163f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:32.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.180+0000 7f5ca163f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:32.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.180+0000 7f5ca163f980 5 note: GC not initialized 2024-04-03T03:59:32.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.180+0000 7f5b54fe1640 20 reqs_thread_entry: start 2024-04-03T03:59:32.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.180+0000 7f5ca163f980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:32.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.180+0000 7f5ca163f980 20 Filter name: none 2024-04-03T03:59:32.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.180+0000 7f5ace7fc640 20 reqs_thread_entry: start 2024-04-03T03:59:32.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.196+0000 7f5b55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:32.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.200+0000 7f5ca163f980 20 remove_watcher() i=0 2024-04-03T03:59:32.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.200+0000 7f5ca163f980 2 removed watcher, disabling cache 2024-04-03T03:59:32.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.204+0000 7f5ca163f980 20 remove_watcher() i=1 2024-04-03T03:59:32.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.204+0000 7f5ca163f980 20 remove_watcher() i=2 2024-04-03T03:59:32.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.208+0000 7f5ca163f980 20 remove_watcher() i=3 2024-04-03T03:59:32.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.208+0000 7f5ca163f980 20 remove_watcher() i=4 2024-04-03T03:59:32.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.212+0000 7f5ca163f980 20 remove_watcher() i=5 2024-04-03T03:59:32.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.212+0000 7f5ca163f980 20 remove_watcher() i=6 2024-04-03T03:59:32.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.212+0000 7f5ca163f980 20 remove_watcher() i=7 2024-04-03T03:59:32.212 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard process non empty bucket 2024-04-03T03:59:32.212 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:32.213 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin reshard process 2024-04-03T03:59:32.239 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:32.239 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:32.283 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.300+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 20 realm 2024-04-03T03:59:32.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:32.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:32.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.304+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.308+0000 7f124dde7980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:32.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.308+0000 7f124dde7980 20 searching for the correct realm 2024-04-03T03:59:32.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.312+0000 7f124c103640 0 -- 172.21.15.104:0/3312023718 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f1244025070 msgr2=0x7f124403baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:32.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.316+0000 7f124b101640 0 -- 172.21.15.104:0/3312023718 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f124404d430 msgr2=0x7f124404d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:32.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:32.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:32.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:32.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:32.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:32.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:32.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:32.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.532+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:32.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 zone default found 2024-04-03T03:59:32.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 4 Realm: () 2024-04-03T03:59:32.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:32.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:32.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:32.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 zonegroup default 2024-04-03T03:59:32.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 started sync module instance, tier type = 2024-04-03T03:59:32.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.536+0000 7f124dde7980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:32.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.560+0000 7f124dde7980 20 add_watcher() i=0 2024-04-03T03:59:32.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.560+0000 7f124dde7980 20 add_watcher() i=1 2024-04-03T03:59:32.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.560+0000 7f124dde7980 20 add_watcher() i=2 2024-04-03T03:59:32.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.560+0000 7f124dde7980 20 add_watcher() i=3 2024-04-03T03:59:32.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.560+0000 7f124dde7980 20 add_watcher() i=4 2024-04-03T03:59:32.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.560+0000 7f124dde7980 20 add_watcher() i=5 2024-04-03T03:59:32.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.560+0000 7f124dde7980 20 add_watcher() i=6 2024-04-03T03:59:32.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.564+0000 7f124dde7980 20 add_watcher() i=7 2024-04-03T03:59:32.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.564+0000 7f124dde7980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:32.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.568+0000 7f1101fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:32.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.568+0000 7f124dde7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:32.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.568+0000 7f124dde7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:32.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.568+0000 7f124dde7980 5 note: GC not initialized 2024-04-03T03:59:32.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.572+0000 7f1100fe1640 20 reqs_thread_entry: start 2024-04-03T03:59:32.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.572+0000 7f124dde7980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:32.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.572+0000 7f124dde7980 20 Filter name: none 2024-04-03T03:59:32.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.572+0000 7f107a7fc640 20 reqs_thread_entry: start 2024-04-03T03:59:32.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.572+0000 7f124dde7980 20 processing logshard = reshard.0000000000 2024-04-03T03:59:32.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.576+0000 7f124dde7980 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-04-03T03:59:32.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.576+0000 7f124dde7980 20 processing logshard = reshard.0000000001 2024-04-03T03:59:32.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.584+0000 7f124dde7980 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-04-03T03:59:32.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.584+0000 7f124dde7980 20 processing logshard = reshard.0000000002 2024-04-03T03:59:32.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.588+0000 7f124dde7980 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-04-03T03:59:32.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.588+0000 7f124dde7980 20 processing logshard = reshard.0000000003 2024-04-03T03:59:32.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.592+0000 7f124dde7980 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-04-03T03:59:32.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.592+0000 7f124dde7980 20 processing logshard = reshard.0000000004 2024-04-03T03:59:32.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.600+0000 7f124dde7980 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-04-03T03:59:32.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.600+0000 7f124dde7980 20 processing logshard = reshard.0000000005 2024-04-03T03:59:32.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.604+0000 7f124dde7980 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-04-03T03:59:32.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.604+0000 7f124dde7980 20 processing logshard = reshard.0000000006 2024-04-03T03:59:32.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 20 process_entry resharding a-bucket 2024-04-03T03:59:32.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-04-03T03:59:32.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:32.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-04-03T03:59:32.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-04-03T03:59:32.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 : miss 2024-04-03T03:59:32.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:32.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:32.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:32.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:32.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:32.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.608+0000 7f124dde7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 2024-04-03T03:59:32.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.624+0000 7f124dde7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:32.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.624+0000 7f124dde7980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:32.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.624+0000 7f124dde7980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:32.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.624+0000 7f124dde7980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17, ofs0, ns] 2024-04-03T03:59:32.607 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.628+0000 7f112a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562444 cookie 94032008789328 notifier 6165 bl.length()=789 2024-04-03T03:59:32.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.628+0000 7f112a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:32.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.628+0000 7f112a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:32.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.628+0000 7f112a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:32.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.628+0000 7f124dde7980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_sources= new_sources= 2024-04-03T03:59:32.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.628+0000 7f124dde7980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential sources added=[] removed=[] 2024-04-03T03:59:32.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.628+0000 7f124dde7980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_dests= new_dests= 2024-04-03T03:59:32.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.628+0000 7f124dde7980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential dests added=[] removed=[] 2024-04-03T03:59:32.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.0 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.0 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.1 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.1 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.2 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.2 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.3 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.3 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.4 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.4 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.5 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.5 2024-04-03T03:59:32.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.6 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.6 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.7 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.7 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.8 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.8 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.9 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.9 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.10 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.10 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.11 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.11 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.12 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.12 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.0 2024-04-03T03:59:32.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.0 2024-04-03T03:59:32.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.1 2024-04-03T03:59:32.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.636+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.1 2024-04-03T03:59:32.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.640+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.2 2024-04-03T03:59:32.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.640+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.2 2024-04-03T03:59:32.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.640+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.3 2024-04-03T03:59:32.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.640+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.3 2024-04-03T03:59:32.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.640+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.4 2024-04-03T03:59:32.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.640+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.4 2024-04-03T03:59:32.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.640+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.5 2024-04-03T03:59:32.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.640+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.5 2024-04-03T03:59:32.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.644+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.6 2024-04-03T03:59:32.625 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.644+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.6 2024-04-03T03:59:32.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.644+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.7 2024-04-03T03:59:32.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.644+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.7 2024-04-03T03:59:32.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.644+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.8 2024-04-03T03:59:32.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.644+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.8 2024-04-03T03:59:32.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.648+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.9 2024-04-03T03:59:32.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.648+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.9 2024-04-03T03:59:32.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.648+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.10 2024-04-03T03:59:32.630 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.648+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.10 2024-04-03T03:59:32.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.652+0000 7f124dde7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.11 2024-04-03T03:59:32.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.652+0000 7f124dde7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.1.11 2024-04-03T03:59:32.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.656+0000 7f124dde7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 : hit (requested=0x17, cached=0x17) 2024-04-03T03:59:32.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.656+0000 7f124dde7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 2024-04-03T03:59:32.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.660+0000 7f124dde7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:32.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.660+0000 7f124dde7980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:32.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.660+0000 7f124dde7980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:32.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.660+0000 7f124dde7980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17, ofs0, ns] 2024-04-03T03:59:32.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.660+0000 7f112a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562445 cookie 94032008789328 notifier 6165 bl.length()=757 2024-04-03T03:59:32.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.660+0000 7f112a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T03:59:32.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.660+0000 7f112a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T03:59:32.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.660+0000 7f112a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T03:59:32.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.664+0000 7f124dde7980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_sources= new_sources= 2024-04-03T03:59:32.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.664+0000 7f124dde7980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential sources added=[] removed=[] 2024-04-03T03:59:32.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.664+0000 7f124dde7980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_dests= new_dests= 2024-04-03T03:59:32.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.664+0000 7f124dde7980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential dests added=[] removed=[] 2024-04-03T03:59:32.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.672+0000 7f124dde7980 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-04-03T03:59:32.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.672+0000 7f124dde7980 20 process_entry removing reshard queue entry for bucket a-bucket 2024-04-03T03:59:32.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.680+0000 7f124dde7980 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-04-03T03:59:32.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.680+0000 7f124dde7980 20 processing logshard = reshard.0000000007 2024-04-03T03:59:32.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.684+0000 7f124dde7980 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-04-03T03:59:32.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.684+0000 7f124dde7980 20 processing logshard = reshard.0000000008 2024-04-03T03:59:32.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.692+0000 7f124dde7980 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-04-03T03:59:32.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.692+0000 7f124dde7980 20 processing logshard = reshard.0000000009 2024-04-03T03:59:32.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.700+0000 7f124dde7980 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-04-03T03:59:32.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.700+0000 7f124dde7980 20 processing logshard = reshard.0000000010 2024-04-03T03:59:32.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.704+0000 7f124dde7980 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-04-03T03:59:32.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.704+0000 7f124dde7980 20 processing logshard = reshard.0000000011 2024-04-03T03:59:32.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.712+0000 7f124dde7980 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-04-03T03:59:32.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.712+0000 7f124dde7980 20 processing logshard = reshard.0000000012 2024-04-03T03:59:32.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.716+0000 7f124dde7980 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-04-03T03:59:32.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.716+0000 7f124dde7980 20 processing logshard = reshard.0000000013 2024-04-03T03:59:32.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.724+0000 7f124dde7980 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-04-03T03:59:32.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.724+0000 7f124dde7980 20 processing logshard = reshard.0000000014 2024-04-03T03:59:32.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.728+0000 7f124dde7980 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-04-03T03:59:32.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.728+0000 7f124dde7980 20 processing logshard = reshard.0000000015 2024-04-03T03:59:32.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.736+0000 7f124dde7980 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-04-03T03:59:32.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.736+0000 7f1101fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:32.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.744+0000 7f124dde7980 20 remove_watcher() i=0 2024-04-03T03:59:32.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.744+0000 7f124dde7980 2 removed watcher, disabling cache 2024-04-03T03:59:32.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.744+0000 7f124dde7980 20 remove_watcher() i=1 2024-04-03T03:59:32.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.748+0000 7f124dde7980 20 remove_watcher() i=2 2024-04-03T03:59:32.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.752+0000 7f124dde7980 20 remove_watcher() i=3 2024-04-03T03:59:32.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.752+0000 7f124dde7980 20 remove_watcher() i=4 2024-04-03T03:59:32.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.756+0000 7f124dde7980 20 remove_watcher() i=5 2024-04-03T03:59:32.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.756+0000 7f124dde7980 20 remove_watcher() i=6 2024-04-03T03:59:32.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.756+0000 7f124dde7980 20 remove_watcher() i=7 2024-04-03T03:59:32.757 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-04-03T03:59:32.787 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:32.787 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:32.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.848+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 realm 2024-04-03T03:59:32.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:32.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:32.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:32.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:32.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:32.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.852+0000 7f2c2ad74980 20 searching for the correct realm 2024-04-03T03:59:32.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.856+0000 7f2c2808e640 0 -- 172.21.15.104:0/1848305503 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f2c1802e430 msgr2=0x7f2c1802e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:32.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:32.864+0000 7f2c2808e640 0 -- 172.21.15.104:0/1848305503 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f2c20017040 msgr2=0x7f2c20075260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:33.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:33.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:33.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:33.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:33.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:33.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:33.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:33.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:33.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.080+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:33.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 zone default found 2024-04-03T03:59:33.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 4 Realm: () 2024-04-03T03:59:33.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:33.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:33.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:33.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 zonegroup default 2024-04-03T03:59:33.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:33.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:33.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:33.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 started sync module instance, tier type = 2024-04-03T03:59:33.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.084+0000 7f2c2ad74980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:33.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.108+0000 7f2c2ad74980 20 add_watcher() i=0 2024-04-03T03:59:33.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.108+0000 7f2c2ad74980 20 add_watcher() i=1 2024-04-03T03:59:33.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.108+0000 7f2c2ad74980 20 add_watcher() i=2 2024-04-03T03:59:33.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.108+0000 7f2c2ad74980 20 add_watcher() i=3 2024-04-03T03:59:33.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.108+0000 7f2c2ad74980 20 add_watcher() i=4 2024-04-03T03:59:33.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.108+0000 7f2c2ad74980 20 add_watcher() i=5 2024-04-03T03:59:33.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.108+0000 7f2c2ad74980 20 add_watcher() i=6 2024-04-03T03:59:33.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.112+0000 7f2c2ad74980 20 add_watcher() i=7 2024-04-03T03:59:33.092 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.112+0000 7f2c2ad74980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:33.096 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.116+0000 7f2adefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:33.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.116+0000 7f2c2ad74980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:33.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.116+0000 7f2c2ad74980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:33.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.116+0000 7f2c2ad74980 5 note: GC not initialized 2024-04-03T03:59:33.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.116+0000 7f2addfe3640 20 reqs_thread_entry: start 2024-04-03T03:59:33.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.116+0000 7f2c2ad74980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:33.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.116+0000 7f2c2ad74980 20 Filter name: none 2024-04-03T03:59:33.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.116+0000 7f2a4f7fe640 20 reqs_thread_entry: start 2024-04-03T03:59:33.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.116+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.120+0000 7f2c2ad74980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:33.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.120+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.120+0000 7f2c2ad74980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:33.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.120+0000 7f2c2ad74980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:33.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.120+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.120+0000 7f2c2ad74980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T03:59:33.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.120+0000 7f2c2ad74980 20 rados->read ofs=0 len=0 2024-04-03T03:59:33.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.120+0000 7f2c2ad74980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T03:59:33.103 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.120+0000 7f2c2ad74980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:33.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.124+0000 7f2adefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:33.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.132+0000 7f2c2ad74980 20 remove_watcher() i=0 2024-04-03T03:59:33.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.132+0000 7f2c2ad74980 2 removed watcher, disabling cache 2024-04-03T03:59:33.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.132+0000 7f2c2ad74980 20 remove_watcher() i=1 2024-04-03T03:59:33.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.136+0000 7f2c2ad74980 20 remove_watcher() i=2 2024-04-03T03:59:33.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.136+0000 7f2c2ad74980 20 remove_watcher() i=3 2024-04-03T03:59:33.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.140+0000 7f2c2ad74980 20 remove_watcher() i=4 2024-04-03T03:59:33.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.140+0000 7f2c2ad74980 20 remove_watcher() i=5 2024-04-03T03:59:33.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.144+0000 7f2c2ad74980 20 remove_watcher() i=6 2024-04-03T03:59:33.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:33.144+0000 7f2c2ad74980 20 remove_watcher() i=7 2024-04-03T03:59:33.143 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:33.144 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:33.144 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: a-bucket id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-04-03T03:59:33.144 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:33.144 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-04-03T03:59:33.144 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:33.146 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.146 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.242 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.242 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.332 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.332 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.418 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.419 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.499 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.500 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.565 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.565 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.631 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.631 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.722 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.722 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.784 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.784 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.862 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.862 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:33.951 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:33.951 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.037 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.037 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.127 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.128 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.214 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.214 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.300 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.301 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.389 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.389 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.477 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.478 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.571 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.571 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.659 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.659 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.763 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.763 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.858 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.858 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:34.949 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:34.949 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:35.034 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-04-03T03:59:35.065 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:35.066 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:35.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.128+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 20 realm 2024-04-03T03:59:35.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:35.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:35.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.132+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.136+0000 7fdbfac33980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:35.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.136+0000 7fdbfac33980 20 searching for the correct realm 2024-04-03T03:59:35.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.136+0000 7fdbf7f4d640 0 -- 172.21.15.104:0/1638088340 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fdbe8037930 msgr2=0x7fdbe801b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:35.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.348+0000 7fdbf8f4f640 0 -- 172.21.15.104:0/1638088340 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x562371329f40 msgr2=0x56237132c330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:35.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:35.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:35.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:35.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:35.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:35.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:35.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:35.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.368+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:35.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 zone default found 2024-04-03T03:59:35.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 4 Realm: () 2024-04-03T03:59:35.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:35.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:35.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:35.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 zonegroup default 2024-04-03T03:59:35.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 started sync module instance, tier type = 2024-04-03T03:59:35.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.372+0000 7fdbfac33980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:35.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.396+0000 7fdbfac33980 20 add_watcher() i=0 2024-04-03T03:59:35.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.396+0000 7fdbfac33980 20 add_watcher() i=1 2024-04-03T03:59:35.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.396+0000 7fdbfac33980 20 add_watcher() i=2 2024-04-03T03:59:35.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.396+0000 7fdbfac33980 20 add_watcher() i=3 2024-04-03T03:59:35.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.396+0000 7fdbfac33980 20 add_watcher() i=4 2024-04-03T03:59:35.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.396+0000 7fdbfac33980 20 add_watcher() i=5 2024-04-03T03:59:35.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.396+0000 7fdbfac33980 20 add_watcher() i=6 2024-04-03T03:59:35.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.400+0000 7fdbfac33980 20 add_watcher() i=7 2024-04-03T03:59:35.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.400+0000 7fdbfac33980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:35.384 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdaaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:35.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdbfac33980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:35.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdbfac33980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:35.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdbfac33980 5 note: GC not initialized 2024-04-03T03:59:35.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdaadfdb640 20 reqs_thread_entry: start 2024-04-03T03:59:35.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdbfac33980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:35.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdbfac33980 20 Filter name: none 2024-04-03T03:59:35.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fda1f7fe640 20 reqs_thread_entry: start 2024-04-03T03:59:35.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdbfac33980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:35.387 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.404+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.408+0000 7fdbfac33980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:35.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.408+0000 7fdbfac33980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:35.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.408+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.408+0000 7fdbfac33980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:35.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.408+0000 7fdbfac33980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.408+0000 7fdbfac33980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:35.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.408+0000 7fdbfac33980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:35.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.412+0000 7fdaaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:35.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.416+0000 7fdbfac33980 20 remove_watcher() i=0 2024-04-03T03:59:35.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.416+0000 7fdbfac33980 2 removed watcher, disabling cache 2024-04-03T03:59:35.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.420+0000 7fdbfac33980 20 remove_watcher() i=1 2024-04-03T03:59:35.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.424+0000 7fdbfac33980 20 remove_watcher() i=2 2024-04-03T03:59:35.406 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.424+0000 7fdbfac33980 20 remove_watcher() i=3 2024-04-03T03:59:35.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.428+0000 7fdbfac33980 20 remove_watcher() i=4 2024-04-03T03:59:35.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.428+0000 7fdbfac33980 20 remove_watcher() i=5 2024-04-03T03:59:35.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.432+0000 7fdbfac33980 20 remove_watcher() i=6 2024-04-03T03:59:35.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.432+0000 7fdbfac33980 20 remove_watcher() i=7 2024-04-03T03:59:35.429 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:35.429 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:35.429 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-set-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T03:59:35.429 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:35.430 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-04-03T03:59:35.463 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:35.463 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:35.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.524+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 realm 2024-04-03T03:59:35.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:35.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.510 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:35.510 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:35.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.528+0000 7fdd573ab980 20 searching for the correct realm 2024-04-03T03:59:35.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.536+0000 7fdd54ec6640 0 -- 172.21.15.104:0/1019244007 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x55b394dcc520 msgr2=0x55b394dce9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:35.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.540+0000 7fdd546c5640 0 -- 172.21.15.104:0/1019244007 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fdd4c1200b0 msgr2=0x7fdd4c0ee070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:35.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.548+0000 7fdd573ab980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:35.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.548+0000 7fdd573ab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:35.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.548+0000 7fdd573ab980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:35.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.548+0000 7fdd573ab980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:35.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.548+0000 7fdd573ab980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:35.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.548+0000 7fdd573ab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:35.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.548+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.548+0000 7fdd573ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.548+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:35.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:35.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 zone default found 2024-04-03T03:59:35.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 4 Realm: () 2024-04-03T03:59:35.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:35.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:35.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:35.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 zonegroup default 2024-04-03T03:59:35.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.533 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 started sync module instance, tier type = 2024-04-03T03:59:35.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.552+0000 7fdd573ab980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:35.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.568+0000 7fdd573ab980 20 add_watcher() i=0 2024-04-03T03:59:35.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.568+0000 7fdd573ab980 20 add_watcher() i=1 2024-04-03T03:59:35.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.568+0000 7fdd573ab980 20 add_watcher() i=2 2024-04-03T03:59:35.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.568+0000 7fdd573ab980 20 add_watcher() i=3 2024-04-03T03:59:35.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.568+0000 7fdd573ab980 20 add_watcher() i=4 2024-04-03T03:59:35.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.568+0000 7fdd573ab980 20 add_watcher() i=5 2024-04-03T03:59:35.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.568+0000 7fdd573ab980 20 add_watcher() i=6 2024-04-03T03:59:35.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.568+0000 7fdd573ab980 20 add_watcher() i=7 2024-04-03T03:59:35.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.568+0000 7fdd573ab980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:35.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdc0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:35.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdd573ab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:35.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdd573ab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:35.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdd573ab980 5 note: GC not initialized 2024-04-03T03:59:35.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdc09fe3640 20 reqs_thread_entry: start 2024-04-03T03:59:35.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdd573ab980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:35.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdd573ab980 20 Filter name: none 2024-04-03T03:59:35.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdb7b7fe640 20 reqs_thread_entry: start 2024-04-03T03:59:35.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdd573ab980 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-04-03T03:59:35.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.572+0000 7fdd573ab980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:35.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-04-03T03:59:35.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-04-03T03:59:35.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 : miss 2024-04-03T03:59:35.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:35.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 info.flags=0x17 2024-04-03T03:59:35.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 to cache LRU end 2024-04-03T03:59:35.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:35.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:35.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.576+0000 7fdd573ab980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 2024-04-03T03:59:35.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.584+0000 7fdd573ab980 -1 Injecting error=-5 at location=set_target_layout 2024-04-03T03:59:35.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.584+0000 7fdd573ab980 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-04-03T03:59:35.573 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.592+0000 7fdc0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:35.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.596+0000 7fdd573ab980 20 remove_watcher() i=0 2024-04-03T03:59:35.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.596+0000 7fdd573ab980 2 removed watcher, disabling cache 2024-04-03T03:59:35.580 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.600+0000 7fdd573ab980 20 remove_watcher() i=1 2024-04-03T03:59:35.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.600+0000 7fdd573ab980 20 remove_watcher() i=2 2024-04-03T03:59:35.584 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.604+0000 7fdd573ab980 20 remove_watcher() i=3 2024-04-03T03:59:35.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.604+0000 7fdd573ab980 20 remove_watcher() i=4 2024-04-03T03:59:35.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.608+0000 7fdd573ab980 20 remove_watcher() i=5 2024-04-03T03:59:35.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.608+0000 7fdd573ab980 20 remove_watcher() i=6 2024-04-03T03:59:35.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.608+0000 7fdd573ab980 20 remove_watcher() i=7 2024-04-03T03:59:35.604 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-04-03T03:59:35.630 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:35.630 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:35.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 realm 2024-04-03T03:59:35.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:35.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:35.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.675 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:35.675 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.692+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:35.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.900+0000 7fa26eb7f980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:35.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.900+0000 7fa26eb7f980 20 searching for the correct realm 2024-04-03T03:59:35.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:35.904+0000 7fa26be99640 0 -- 172.21.15.104:0/3365717471 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fa25c06e130 msgr2=0x7fa25c085a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:36.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.116+0000 7fa26ce9b640 0 -- 172.21.15.104:0/3365717471 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x559dc41c8ec0 msgr2=0x559dc41cb2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:36.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:36.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:36.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:36.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:36.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:36.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:36.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:36.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:36.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 zone default found 2024-04-03T03:59:36.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 4 Realm: () 2024-04-03T03:59:36.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:36.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:36.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:36.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 zonegroup default 2024-04-03T03:59:36.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.136+0000 7fa26eb7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.140+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.140+0000 7fa26eb7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.140+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.140+0000 7fa26eb7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.140+0000 7fa26eb7f980 20 started sync module instance, tier type = 2024-04-03T03:59:36.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.140+0000 7fa26eb7f980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:36.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.164+0000 7fa26eb7f980 20 add_watcher() i=0 2024-04-03T03:59:36.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.164+0000 7fa26eb7f980 20 add_watcher() i=1 2024-04-03T03:59:36.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.164+0000 7fa26eb7f980 20 add_watcher() i=2 2024-04-03T03:59:36.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.164+0000 7fa26eb7f980 20 add_watcher() i=3 2024-04-03T03:59:36.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.164+0000 7fa26eb7f980 20 add_watcher() i=4 2024-04-03T03:59:36.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.164+0000 7fa26eb7f980 20 add_watcher() i=5 2024-04-03T03:59:36.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.164+0000 7fa26eb7f980 20 add_watcher() i=6 2024-04-03T03:59:36.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.164+0000 7fa26eb7f980 20 add_watcher() i=7 2024-04-03T03:59:36.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.164+0000 7fa26eb7f980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:36.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa1237de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:36.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa26eb7f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:36.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa26eb7f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:36.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa26eb7f980 5 note: GC not initialized 2024-04-03T03:59:36.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa1227dc640 20 reqs_thread_entry: start 2024-04-03T03:59:36.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa26eb7f980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:36.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa26eb7f980 20 Filter name: none 2024-04-03T03:59:36.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa11b7fe640 20 reqs_thread_entry: start 2024-04-03T03:59:36.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa26eb7f980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:36.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.168+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.172+0000 7fa26eb7f980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:36.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.172+0000 7fa26eb7f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:36.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.172+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.172+0000 7fa26eb7f980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:36.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.172+0000 7fa26eb7f980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.172+0000 7fa26eb7f980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:36.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.172+0000 7fa26eb7f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:36.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.176+0000 7fa1237de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:36.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.180+0000 7fa26eb7f980 20 remove_watcher() i=0 2024-04-03T03:59:36.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.180+0000 7fa26eb7f980 2 removed watcher, disabling cache 2024-04-03T03:59:36.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.184+0000 7fa26eb7f980 20 remove_watcher() i=1 2024-04-03T03:59:36.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.184+0000 7fa26eb7f980 20 remove_watcher() i=2 2024-04-03T03:59:36.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.188+0000 7fa26eb7f980 20 remove_watcher() i=3 2024-04-03T03:59:36.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.188+0000 7fa26eb7f980 20 remove_watcher() i=4 2024-04-03T03:59:36.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.192+0000 7fa26eb7f980 20 remove_watcher() i=5 2024-04-03T03:59:36.173 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.192+0000 7fa26eb7f980 20 remove_watcher() i=6 2024-04-03T03:59:36.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.192+0000 7fa26eb7f980 20 remove_watcher() i=7 2024-04-03T03:59:36.192 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:36.193 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:36.193 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-set-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T03:59:36.193 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:36.194 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:36.194 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:36.234 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:36.234 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:36.289 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T03:59:36.321 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:36.322 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:36.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.384+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.384+0000 7fe29ce94980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.384+0000 7fe29ce94980 20 realm 2024-04-03T03:59:36.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.384+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.384+0000 7fe29ce94980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.384+0000 7fe29ce94980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:36.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.384+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.384+0000 7fe29ce94980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.367 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.384+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.388+0000 7fe29ce94980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:36.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.388+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.388+0000 7fe29ce94980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:36.369 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.388+0000 7fe29ce94980 20 searching for the correct realm 2024-04-03T03:59:36.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.392+0000 7fe29b1b0640 0 -- 172.21.15.104:0/797779759 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fe294001b70 msgr2=0x7fe29405a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:36.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.400+0000 7fe29a1ae640 0 -- 172.21.15.104:0/797779759 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fe29407bae0 msgr2=0x7fe294084050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:36.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.616+0000 7fe29ce94980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:36.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.616+0000 7fe29ce94980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:36.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.616+0000 7fe29ce94980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:36.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.616+0000 7fe29ce94980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:36.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.616+0000 7fe29ce94980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:36.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.616+0000 7fe29ce94980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:36.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.616+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:36.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:36.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 zone default found 2024-04-03T03:59:36.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 4 Realm: () 2024-04-03T03:59:36.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:36.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:36.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:36.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 zonegroup default 2024-04-03T03:59:36.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.602 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.603 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.603 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 started sync module instance, tier type = 2024-04-03T03:59:36.603 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.620+0000 7fe29ce94980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:36.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.644+0000 7fe29ce94980 20 add_watcher() i=0 2024-04-03T03:59:36.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.644+0000 7fe29ce94980 20 add_watcher() i=1 2024-04-03T03:59:36.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.644+0000 7fe29ce94980 20 add_watcher() i=2 2024-04-03T03:59:36.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.644+0000 7fe29ce94980 20 add_watcher() i=3 2024-04-03T03:59:36.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.644+0000 7fe29ce94980 20 add_watcher() i=4 2024-04-03T03:59:36.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.644+0000 7fe29ce94980 20 add_watcher() i=5 2024-04-03T03:59:36.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.644+0000 7fe29ce94980 20 add_watcher() i=6 2024-04-03T03:59:36.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.648+0000 7fe29ce94980 20 add_watcher() i=7 2024-04-03T03:59:36.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.648+0000 7fe29ce94980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:36.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.652+0000 7fe1517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:36.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.652+0000 7fe29ce94980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:36.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.652+0000 7fe29ce94980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:36.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.652+0000 7fe29ce94980 5 note: GC not initialized 2024-04-03T03:59:36.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.652+0000 7fe0cbfff640 20 reqs_thread_entry: start 2024-04-03T03:59:36.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.652+0000 7fe29ce94980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:36.635 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.652+0000 7fe29ce94980 20 Filter name: none 2024-04-03T03:59:36.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe0c9ffb640 20 reqs_thread_entry: start 2024-04-03T03:59:36.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-04-03T03:59:36.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:36.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-04-03T03:59:36.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-04-03T03:59:36.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 : miss 2024-04-03T03:59:36.637 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:36.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 info.flags=0x17 2024-04-03T03:59:36.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 to cache LRU end 2024-04-03T03:59:36.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:36.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:36.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.656+0000 7fe29ce94980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 2024-04-03T03:59:36.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe29ce94980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 info.flags=0x17 2024-04-03T03:59:36.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe29ce94980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 to cache LRU end 2024-04-03T03:59:36.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe29ce94980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:36.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe29ce94980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19, ofs0, ns] 2024-04-03T03:59:36.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe17dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562447 cookie 94492922887312 notifier 5906 bl.length()=887 2024-04-03T03:59:36.648 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe17dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 info.flags=0x17 2024-04-03T03:59:36.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe17dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 to cache LRU end 2024-04-03T03:59:36.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe17dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:36.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe29ce94980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19]): orig_sources= new_sources= 2024-04-03T03:59:36.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe29ce94980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19]): potential sources added=[] removed=[] 2024-04-03T03:59:36.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe29ce94980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19]): orig_dests= new_dests= 2024-04-03T03:59:36.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.668+0000 7fe29ce94980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19]): potential dests added=[] removed=[] 2024-04-03T03:59:36.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.0 2024-04-03T03:59:36.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.0 2024-04-03T03:59:36.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.1 2024-04-03T03:59:36.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.1 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.2 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.2 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.3 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.3 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.4 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.4 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.5 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.5 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.6 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.6 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.7 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.7 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.8 2024-04-03T03:59:36.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.8 2024-04-03T03:59:36.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.9 2024-04-03T03:59:36.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.9 2024-04-03T03:59:36.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.10 2024-04-03T03:59:36.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.10 2024-04-03T03:59:36.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.11 2024-04-03T03:59:36.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1.11 2024-04-03T03:59:36.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.0 2024-04-03T03:59:36.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.1 2024-04-03T03:59:36.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.2 2024-04-03T03:59:36.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.676+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.3 2024-04-03T03:59:36.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.680+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.4 2024-04-03T03:59:36.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.680+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.5 2024-04-03T03:59:36.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.680+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.6 2024-04-03T03:59:36.664 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.684+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.7 2024-04-03T03:59:36.665 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.684+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.8 2024-04-03T03:59:36.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.684+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.9 2024-04-03T03:59:36.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.684+0000 7fe29ce94980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19.10 2024-04-03T03:59:36.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe29ce94980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 : hit (requested=0x17, cached=0x17) 2024-04-03T03:59:36.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe29ce94980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 2024-04-03T03:59:36.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe29ce94980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 info.flags=0x17 2024-04-03T03:59:36.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe29ce94980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 to cache LRU end 2024-04-03T03:59:36.677 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe29ce94980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:36.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe29ce94980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19, ofs0, ns] 2024-04-03T03:59:36.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe17dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562448 cookie 94492922887312 notifier 5906 bl.length()=855 2024-04-03T03:59:36.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe17dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 info.flags=0x17 2024-04-03T03:59:36.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe17dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 to cache LRU end 2024-04-03T03:59:36.678 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.692+0000 7fe17dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:36.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.696+0000 7fe29ce94980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19]): orig_sources= new_sources= 2024-04-03T03:59:36.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.696+0000 7fe29ce94980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19]): potential sources added=[] removed=[] 2024-04-03T03:59:36.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.696+0000 7fe29ce94980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19]): orig_dests= new_dests= 2024-04-03T03:59:36.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.696+0000 7fe29ce94980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19]): potential dests added=[] removed=[] 2024-04-03T03:59:36.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.700+0000 7fe29ce94980 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-04-03T03:59:36.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.704+0000 7fe1517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:36.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.708+0000 7fe29ce94980 20 remove_watcher() i=0 2024-04-03T03:59:36.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.708+0000 7fe29ce94980 2 removed watcher, disabling cache 2024-04-03T03:59:36.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.712+0000 7fe29ce94980 20 remove_watcher() i=1 2024-04-03T03:59:36.694 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.712+0000 7fe29ce94980 20 remove_watcher() i=2 2024-04-03T03:59:36.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.716+0000 7fe29ce94980 20 remove_watcher() i=3 2024-04-03T03:59:36.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.716+0000 7fe29ce94980 20 remove_watcher() i=4 2024-04-03T03:59:36.700 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.720+0000 7fe29ce94980 20 remove_watcher() i=5 2024-04-03T03:59:36.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.720+0000 7fe29ce94980 20 remove_watcher() i=6 2024-04-03T03:59:36.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.720+0000 7fe29ce94980 20 remove_watcher() i=7 2024-04-03T03:59:36.718 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-04-03T03:59:36.749 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:36.749 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:36.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.812+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.812+0000 7f3e0fbac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.812+0000 7f3e0fbac980 20 realm 2024-04-03T03:59:36.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.812+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.812+0000 7f3e0fbac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.812+0000 7f3e0fbac980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:36.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.812+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.812+0000 7f3e0fbac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:36.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.812+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.816+0000 7f3e0fbac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:36.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.816+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:36.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.816+0000 7f3e0fbac980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:36.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.816+0000 7f3e0fbac980 20 searching for the correct realm 2024-04-03T03:59:36.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.820+0000 7f3e0dec8640 0 -- 172.21.15.104:0/1823217635 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f3e08044bb0 msgr2=0x7f3e0802da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:36.809 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:36.828+0000 7f3e0cec6640 0 -- 172.21.15.104:0/1823217635 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f3e08023920 msgr2=0x7f3e0803a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:37.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.044+0000 7f3e0fbac980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:37.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.044+0000 7f3e0fbac980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:37.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.044+0000 7f3e0fbac980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:37.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.044+0000 7f3e0fbac980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:37.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.044+0000 7f3e0fbac980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:37.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.044+0000 7f3e0fbac980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:37.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.044+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.044+0000 7f3e0fbac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:37.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.044+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:37.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:37.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 zone default found 2024-04-03T03:59:37.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 4 Realm: () 2024-04-03T03:59:37.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:37.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:37.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:37.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 zonegroup default 2024-04-03T03:59:37.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:37.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:37.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:37.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 started sync module instance, tier type = 2024-04-03T03:59:37.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.048+0000 7f3e0fbac980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:37.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.072+0000 7f3e0fbac980 20 add_watcher() i=0 2024-04-03T03:59:37.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.072+0000 7f3e0fbac980 20 add_watcher() i=1 2024-04-03T03:59:37.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.072+0000 7f3e0fbac980 20 add_watcher() i=2 2024-04-03T03:59:37.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.072+0000 7f3e0fbac980 20 add_watcher() i=3 2024-04-03T03:59:37.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.072+0000 7f3e0fbac980 20 add_watcher() i=4 2024-04-03T03:59:37.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.072+0000 7f3e0fbac980 20 add_watcher() i=5 2024-04-03T03:59:37.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.072+0000 7f3e0fbac980 20 add_watcher() i=6 2024-04-03T03:59:37.057 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.076+0000 7f3e0fbac980 20 add_watcher() i=7 2024-04-03T03:59:37.057 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.076+0000 7f3e0fbac980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:37.061 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.080+0000 7f3cc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:37.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.080+0000 7f3e0fbac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:37.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.080+0000 7f3e0fbac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:37.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.080+0000 7f3e0fbac980 5 note: GC not initialized 2024-04-03T03:59:37.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.080+0000 7f3cc27e4640 20 reqs_thread_entry: start 2024-04-03T03:59:37.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:37.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 Filter name: none 2024-04-03T03:59:37.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3c33fff640 20 reqs_thread_entry: start 2024-04-03T03:59:37.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:37.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:37.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:37.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:37.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.084+0000 7f3e0fbac980 20 rados->read ofs=0 len=0 2024-04-03T03:59:37.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.088+0000 7f3e0fbac980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:37.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.088+0000 7f3e0fbac980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:37.071 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.088+0000 7f3cc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:37.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.096+0000 7f3e0fbac980 20 remove_watcher() i=0 2024-04-03T03:59:37.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.096+0000 7f3e0fbac980 2 removed watcher, disabling cache 2024-04-03T03:59:37.078 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.096+0000 7f3e0fbac980 20 remove_watcher() i=1 2024-04-03T03:59:37.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.100+0000 7f3e0fbac980 20 remove_watcher() i=2 2024-04-03T03:59:37.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.100+0000 7f3e0fbac980 20 remove_watcher() i=3 2024-04-03T03:59:37.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.104+0000 7f3e0fbac980 20 remove_watcher() i=4 2024-04-03T03:59:37.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.104+0000 7f3e0fbac980 20 remove_watcher() i=5 2024-04-03T03:59:37.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.108+0000 7f3e0fbac980 20 remove_watcher() i=6 2024-04-03T03:59:37.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:37.108+0000 7f3e0fbac980 20 remove_watcher() i=7 2024-04-03T03:59:37.114 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:37.114 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:37.114 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-set-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-04-03T03:59:37.114 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:37.115 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:37.115 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:37.158 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:37.158 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:37.703 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:37.703 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.070 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-04-03T03:59:38.070 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:38.072 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.072 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.200 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.200 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.283 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.283 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.369 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.369 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.452 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.452 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.535 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.535 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.600 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.600 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.675 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.675 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.767 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.768 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.854 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.854 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:38.923 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:38.923 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.013 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.013 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.101 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.101 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.188 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.188 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.274 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.275 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.363 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.363 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.448 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.448 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.538 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.538 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.630 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.630 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.719 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.719 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.823 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.824 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.913 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:39.913 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:39.999 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-04-03T03:59:40.030 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:40.030 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:40.072 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.092+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.092+0000 7fcb7e20e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.092+0000 7fcb7e20e980 20 realm 2024-04-03T03:59:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.092+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.092+0000 7fcb7e20e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.092+0000 7fcb7e20e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:40.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.092+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.092+0000 7fcb7e20e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.092+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.096+0000 7fcb7e20e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:40.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.096+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.096+0000 7fcb7e20e980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:40.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.096+0000 7fcb7e20e980 20 searching for the correct realm 2024-04-03T03:59:40.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.100+0000 7fcb7c52a640 0 -- 172.21.15.104:0/1887131003 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fcb740ef350 msgr2=0x7fcb740eecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:40.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.108+0000 7fcb7b528640 0 -- 172.21.15.104:0/1887131003 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fcb740cd040 msgr2=0x7fcb740ee3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:40.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.324+0000 7fcb7e20e980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:40.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.324+0000 7fcb7e20e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:40.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.324+0000 7fcb7e20e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:40.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.324+0000 7fcb7e20e980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:40.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.324+0000 7fcb7e20e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:40.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.324+0000 7fcb7e20e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:40.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.324+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.324+0000 7fcb7e20e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.324+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:40.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:40.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 zone default found 2024-04-03T03:59:40.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 4 Realm: () 2024-04-03T03:59:40.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:40.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:40.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:40.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 zonegroup default 2024-04-03T03:59:40.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 started sync module instance, tier type = 2024-04-03T03:59:40.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.328+0000 7fcb7e20e980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:40.334 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.352+0000 7fcb7e20e980 20 add_watcher() i=0 2024-04-03T03:59:40.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.352+0000 7fcb7e20e980 20 add_watcher() i=1 2024-04-03T03:59:40.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.352+0000 7fcb7e20e980 20 add_watcher() i=2 2024-04-03T03:59:40.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.352+0000 7fcb7e20e980 20 add_watcher() i=3 2024-04-03T03:59:40.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.352+0000 7fcb7e20e980 20 add_watcher() i=4 2024-04-03T03:59:40.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.352+0000 7fcb7e20e980 20 add_watcher() i=5 2024-04-03T03:59:40.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.356+0000 7fcb7e20e980 20 add_watcher() i=6 2024-04-03T03:59:40.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.356+0000 7fcb7e20e980 20 add_watcher() i=7 2024-04-03T03:59:40.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.356+0000 7fcb7e20e980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:40.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.360+0000 7fca31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:40.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:40.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:40.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 5 note: GC not initialized 2024-04-03T03:59:40.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fca30fe1640 20 reqs_thread_entry: start 2024-04-03T03:59:40.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:40.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 Filter name: none 2024-04-03T03:59:40.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fc9aa7fc640 20 reqs_thread_entry: start 2024-04-03T03:59:40.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:40.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:40.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:40.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:40.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:40.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.364+0000 7fcb7e20e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:40.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.368+0000 7fca31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:40.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.376+0000 7fcb7e20e980 20 remove_watcher() i=0 2024-04-03T03:59:40.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.376+0000 7fcb7e20e980 2 removed watcher, disabling cache 2024-04-03T03:59:40.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.380+0000 7fcb7e20e980 20 remove_watcher() i=1 2024-04-03T03:59:40.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.380+0000 7fcb7e20e980 20 remove_watcher() i=2 2024-04-03T03:59:40.365 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.384+0000 7fcb7e20e980 20 remove_watcher() i=3 2024-04-03T03:59:40.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.388+0000 7fcb7e20e980 20 remove_watcher() i=4 2024-04-03T03:59:40.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.392+0000 7fcb7e20e980 20 remove_watcher() i=5 2024-04-03T03:59:40.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.392+0000 7fcb7e20e980 20 remove_watcher() i=6 2024-04-03T03:59:40.374 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.392+0000 7fcb7e20e980 20 remove_watcher() i=7 2024-04-03T03:59:40.389 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:40.390 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:40.390 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-set-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T03:59:40.390 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:40.390 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-04-03T03:59:40.428 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:40.428 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:40.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.492+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.492+0000 7f37fbad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.492+0000 7f37fbad7980 20 realm 2024-04-03T03:59:40.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.492+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.492+0000 7f37fbad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.492+0000 7f37fbad7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:40.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.492+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.492+0000 7f37fbad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.492+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.496+0000 7f37fbad7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:40.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.496+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.496+0000 7f37fbad7980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:40.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.496+0000 7f37fbad7980 20 searching for the correct realm 2024-04-03T03:59:40.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.500+0000 7f37f9df3640 0 -- 172.21.15.104:0/895320051 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f37f4083070 msgr2=0x7f37f4041a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:40.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.716+0000 7f37f8df1640 0 -- 172.21.15.104:0/895320051 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f37e8003cc0 msgr2=0x7f37f4053860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:40.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.932+0000 7f37fbad7980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:40.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.932+0000 7f37fbad7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:40.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.932+0000 7f37fbad7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:40.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.932+0000 7f37fbad7980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:40.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.932+0000 7f37fbad7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:40.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.932+0000 7f37fbad7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:40.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.932+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.932+0000 7f37fbad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.932+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:40.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.918 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:40.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 zone default found 2024-04-03T03:59:40.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 4 Realm: () 2024-04-03T03:59:40.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:40.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:40.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:40.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 zonegroup default 2024-04-03T03:59:40.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:40.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 started sync module instance, tier type = 2024-04-03T03:59:40.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.936+0000 7f37fbad7980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:40.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.964+0000 7f37fbad7980 20 add_watcher() i=0 2024-04-03T03:59:40.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.964+0000 7f37fbad7980 20 add_watcher() i=1 2024-04-03T03:59:40.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.964+0000 7f37fbad7980 20 add_watcher() i=2 2024-04-03T03:59:40.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.964+0000 7f37fbad7980 20 add_watcher() i=3 2024-04-03T03:59:40.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.964+0000 7f37fbad7980 20 add_watcher() i=4 2024-04-03T03:59:40.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.964+0000 7f37fbad7980 20 add_watcher() i=5 2024-04-03T03:59:40.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.964+0000 7f37fbad7980 20 add_watcher() i=6 2024-04-03T03:59:40.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.968+0000 7f37fbad7980 20 add_watcher() i=7 2024-04-03T03:59:40.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.968+0000 7f37fbad7980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:40.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f36affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:40.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:40.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:40.953 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 5 note: GC not initialized 2024-04-03T03:59:40.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f36aefe5640 20 reqs_thread_entry: start 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 20 Filter name: none 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f36acfe1640 20 reqs_thread_entry: start 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 : miss 2024-04-03T03:59:40.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:40.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:40.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 info.flags=0x17 2024-04-03T03:59:40.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 to cache LRU end 2024-04-03T03:59:40.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:40.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:40.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.972+0000 7f37fbad7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 2024-04-03T03:59:40.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.984+0000 7f37fbad7980 -1 Injecting error=-125 at location=set_target_layout 2024-04-03T03:59:40.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f37fbad7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 info.flags=0x17 2024-04-03T03:59:40.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f37fbad7980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 to cache LRU end 2024-04-03T03:59:40.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f37fbad7980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:40.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f37fbad7980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20, ofs0, ns] 2024-04-03T03:59:40.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f36cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562451 cookie 94132461369024 notifier 5957 bl.length()=887 2024-04-03T03:59:40.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f36cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 info.flags=0x17 2024-04-03T03:59:40.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f36cbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 to cache LRU end 2024-04-03T03:59:40.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f36cbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:40.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f37fbad7980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20]): orig_sources= new_sources= 2024-04-03T03:59:40.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f37fbad7980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20]): potential sources added=[] removed=[] 2024-04-03T03:59:40.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f37fbad7980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20]): orig_dests= new_dests= 2024-04-03T03:59:40.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.988+0000 7f37fbad7980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20]): potential dests added=[] removed=[] 2024-04-03T03:59:40.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.0 2024-04-03T03:59:40.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.0 2024-04-03T03:59:40.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.1 2024-04-03T03:59:40.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.1 2024-04-03T03:59:40.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.2 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.2 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.3 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.3 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.4 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.4 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.5 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.5 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.6 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.6 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.7 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.7 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.8 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.8 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.9 2024-04-03T03:59:40.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.9 2024-04-03T03:59:40.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.10 2024-04-03T03:59:40.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.10 2024-04-03T03:59:40.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.11 2024-04-03T03:59:40.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1.11 2024-04-03T03:59:40.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:40.996+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.0 2024-04-03T03:59:40.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.000+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.1 2024-04-03T03:59:40.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.000+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.2 2024-04-03T03:59:40.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.000+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.3 2024-04-03T03:59:40.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.000+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.4 2024-04-03T03:59:40.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.004+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.5 2024-04-03T03:59:40.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.004+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.6 2024-04-03T03:59:40.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.004+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.7 2024-04-03T03:59:40.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.004+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.8 2024-04-03T03:59:40.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.008+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.9 2024-04-03T03:59:40.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.008+0000 7f37fbad7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20.10 2024-04-03T03:59:40.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f37fbad7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 : hit (requested=0x17, cached=0x17) 2024-04-03T03:59:40.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f37fbad7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 2024-04-03T03:59:40.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f37fbad7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 info.flags=0x17 2024-04-03T03:59:40.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f37fbad7980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 to cache LRU end 2024-04-03T03:59:40.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f37fbad7980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:40.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f37fbad7980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20, ofs0, ns] 2024-04-03T03:59:40.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f36cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562452 cookie 94132461369024 notifier 5957 bl.length()=855 2024-04-03T03:59:40.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f36cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 info.flags=0x17 2024-04-03T03:59:40.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f36cbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 to cache LRU end 2024-04-03T03:59:40.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.016+0000 7f36cbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:41.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.020+0000 7f37fbad7980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20]): orig_sources= new_sources= 2024-04-03T03:59:41.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.020+0000 7f37fbad7980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20]): potential sources added=[] removed=[] 2024-04-03T03:59:41.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.020+0000 7f37fbad7980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20]): orig_dests= new_dests= 2024-04-03T03:59:41.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.020+0000 7f37fbad7980 20 handle_bi_update(): bucket=:error-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20]): potential dests added=[] removed=[] 2024-04-03T03:59:41.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.028+0000 7f37fbad7980 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-04-03T03:59:41.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.032+0000 7f36affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:41.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.036+0000 7f37fbad7980 20 remove_watcher() i=0 2024-04-03T03:59:41.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.036+0000 7f37fbad7980 2 removed watcher, disabling cache 2024-04-03T03:59:41.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.036+0000 7f37fbad7980 20 remove_watcher() i=1 2024-04-03T03:59:41.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.040+0000 7f37fbad7980 20 remove_watcher() i=2 2024-04-03T03:59:41.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.044+0000 7f37fbad7980 20 remove_watcher() i=3 2024-04-03T03:59:41.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.044+0000 7f37fbad7980 20 remove_watcher() i=4 2024-04-03T03:59:41.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.048+0000 7f37fbad7980 20 remove_watcher() i=5 2024-04-03T03:59:41.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.048+0000 7f37fbad7980 20 remove_watcher() i=6 2024-04-03T03:59:41.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.048+0000 7f37fbad7980 20 remove_watcher() i=7 2024-04-03T03:59:41.045 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-04-03T03:59:41.071 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:41.071 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:41.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.136+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.136+0000 7f7eb60b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:41.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.136+0000 7f7eb60b2980 20 realm 2024-04-03T03:59:41.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.136+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.136+0000 7f7eb60b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:41.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.136+0000 7f7eb60b2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:41.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.136+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.136+0000 7f7eb60b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:41.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.136+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.140+0000 7f7eb60b2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:41.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.140+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.140+0000 7f7eb60b2980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:41.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.140+0000 7f7eb60b2980 20 searching for the correct realm 2024-04-03T03:59:41.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.140+0000 7f7eb33cc640 0 -- 172.21.15.104:0/2778959585 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f7eac027030 msgr2=0x7f7eac0570a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:41.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.352+0000 7f7eb43ce640 0 -- 172.21.15.104:0/2778959585 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x559d6111eb30 msgr2=0x559d61120f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:41.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:41.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:41.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:41.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:41.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:41.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:41.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:41.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:41.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:41.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 zone default found 2024-04-03T03:59:41.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 4 Realm: () 2024-04-03T03:59:41.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:41.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:41.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:41.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 zonegroup default 2024-04-03T03:59:41.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.372+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.376+0000 7f7eb60b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:41.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.376+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.376+0000 7f7eb60b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:41.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.376+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.376+0000 7f7eb60b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:41.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.376+0000 7f7eb60b2980 20 started sync module instance, tier type = 2024-04-03T03:59:41.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.376+0000 7f7eb60b2980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:41.382 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.400+0000 7f7eb60b2980 20 add_watcher() i=0 2024-04-03T03:59:41.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.400+0000 7f7eb60b2980 20 add_watcher() i=1 2024-04-03T03:59:41.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.400+0000 7f7eb60b2980 20 add_watcher() i=2 2024-04-03T03:59:41.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.400+0000 7f7eb60b2980 20 add_watcher() i=3 2024-04-03T03:59:41.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.400+0000 7f7eb60b2980 20 add_watcher() i=4 2024-04-03T03:59:41.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.400+0000 7f7eb60b2980 20 add_watcher() i=5 2024-04-03T03:59:41.383 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.400+0000 7f7eb60b2980 20 add_watcher() i=6 2024-04-03T03:59:41.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.404+0000 7f7eb60b2980 20 add_watcher() i=7 2024-04-03T03:59:41.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.404+0000 7f7eb60b2980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:41.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.408+0000 7f7d69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:41.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.408+0000 7f7eb60b2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:41.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.408+0000 7f7eb60b2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:41.390 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.408+0000 7f7eb60b2980 5 note: GC not initialized 2024-04-03T03:59:41.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.408+0000 7f7d68fe1640 20 reqs_thread_entry: start 2024-04-03T03:59:41.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.408+0000 7f7eb60b2980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:41.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.408+0000 7f7eb60b2980 20 Filter name: none 2024-04-03T03:59:41.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7ce27fc640 20 reqs_thread_entry: start 2024-04-03T03:59:41.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 rados->read ofs=0 len=0 2024-04-03T03:59:41.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:41.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.412+0000 7f7eb60b2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:41.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.416+0000 7f7d69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:41.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.420+0000 7f7eb60b2980 20 remove_watcher() i=0 2024-04-03T03:59:41.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.420+0000 7f7eb60b2980 2 removed watcher, disabling cache 2024-04-03T03:59:41.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.424+0000 7f7eb60b2980 20 remove_watcher() i=1 2024-04-03T03:59:41.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.428+0000 7f7eb60b2980 20 remove_watcher() i=2 2024-04-03T03:59:41.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.428+0000 7f7eb60b2980 20 remove_watcher() i=3 2024-04-03T03:59:41.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.432+0000 7f7eb60b2980 20 remove_watcher() i=4 2024-04-03T03:59:41.413 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.432+0000 7f7eb60b2980 20 remove_watcher() i=5 2024-04-03T03:59:41.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.432+0000 7f7eb60b2980 20 remove_watcher() i=6 2024-04-03T03:59:41.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:41.436+0000 7f7eb60b2980 20 remove_watcher() i=7 2024-04-03T03:59:41.430 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:41.431 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:41.431 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-set-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-04-03T03:59:41.431 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:41.432 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:41.432 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:41.452 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:41.452 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:41.922 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:41.922 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:42.291 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with abort at set_target_layout 2024-04-03T03:59:42.291 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:42.294 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:42.294 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:42.424 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:42.424 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:42.504 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:42.504 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:42.590 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:42.590 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:42.686 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:42.686 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:42.945 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:42.946 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.038 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.038 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.124 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.124 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.213 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.213 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.303 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.303 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.391 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.391 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.485 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.485 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.575 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.575 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.663 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.663 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.753 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.754 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.849 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.849 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:43.938 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:43.938 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:44.029 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:44.029 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:44.111 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:44.111 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:44.200 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:44.201 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:44.288 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:44.288 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:44.375 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:44.375 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:44.458 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-04-03T03:59:44.490 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:44.490 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:44.535 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.552+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 20 realm 2024-04-03T03:59:44.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:44.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:44.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.556+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.560+0000 7fca3d8dd980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:44.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.560+0000 7fca3d8dd980 20 searching for the correct realm 2024-04-03T03:59:44.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.564+0000 7fca3abf7640 0 -- 172.21.15.104:0/1422670842 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fca2c0fb000 msgr2=0x7fca2c0f1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:44.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.568+0000 7fca3abf7640 0 -- 172.21.15.104:0/1422670842 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fca340266a0 msgr2=0x7fca34034480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:44.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:44.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:44.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:44.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:44.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:44.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:44.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:44.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:44.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 zone default found 2024-04-03T03:59:44.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 4 Realm: () 2024-04-03T03:59:44.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:44.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:44.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:44.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 zonegroup default 2024-04-03T03:59:44.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.784+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.788+0000 7fca3d8dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.788+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.788+0000 7fca3d8dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.788+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.788+0000 7fca3d8dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.788+0000 7fca3d8dd980 20 started sync module instance, tier type = 2024-04-03T03:59:44.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.788+0000 7fca3d8dd980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:44.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.808+0000 7fca3d8dd980 20 add_watcher() i=0 2024-04-03T03:59:44.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.808+0000 7fca3d8dd980 20 add_watcher() i=1 2024-04-03T03:59:44.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.808+0000 7fca3d8dd980 20 add_watcher() i=2 2024-04-03T03:59:44.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.808+0000 7fca3d8dd980 20 add_watcher() i=3 2024-04-03T03:59:44.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.808+0000 7fca3d8dd980 20 add_watcher() i=4 2024-04-03T03:59:44.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.808+0000 7fca3d8dd980 20 add_watcher() i=5 2024-04-03T03:59:44.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.808+0000 7fca3d8dd980 20 add_watcher() i=6 2024-04-03T03:59:44.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.812+0000 7fca3d8dd980 20 add_watcher() i=7 2024-04-03T03:59:44.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.812+0000 7fca3d8dd980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:44.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fc8f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:44.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fca3d8dd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:44.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fca3d8dd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:44.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fca3d8dd980 5 note: GC not initialized 2024-04-03T03:59:44.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fc8f0fe1640 20 reqs_thread_entry: start 2024-04-03T03:59:44.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fca3d8dd980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:44.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fca3d8dd980 20 Filter name: none 2024-04-03T03:59:44.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fc86a7fc640 20 reqs_thread_entry: start 2024-04-03T03:59:44.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fca3d8dd980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:44.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.816+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.820+0000 7fca3d8dd980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:44.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.820+0000 7fca3d8dd980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:44.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.820+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.820+0000 7fca3d8dd980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:44.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.820+0000 7fca3d8dd980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.820+0000 7fca3d8dd980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:44.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.820+0000 7fca3d8dd980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:44.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.824+0000 7fc8f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:44.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.828+0000 7fca3d8dd980 20 remove_watcher() i=0 2024-04-03T03:59:44.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.828+0000 7fca3d8dd980 2 removed watcher, disabling cache 2024-04-03T03:59:44.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.828+0000 7fca3d8dd980 20 remove_watcher() i=1 2024-04-03T03:59:44.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.832+0000 7fca3d8dd980 20 remove_watcher() i=2 2024-04-03T03:59:44.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.832+0000 7fca3d8dd980 20 remove_watcher() i=3 2024-04-03T03:59:44.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.836+0000 7fca3d8dd980 20 remove_watcher() i=4 2024-04-03T03:59:44.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.836+0000 7fca3d8dd980 20 remove_watcher() i=5 2024-04-03T03:59:44.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.840+0000 7fca3d8dd980 20 remove_watcher() i=6 2024-04-03T03:59:44.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.840+0000 7fca3d8dd980 20 remove_watcher() i=7 2024-04-03T03:59:44.836 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:44.836 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:44.836 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-set-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T03:59:44.836 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:44.836 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-04-03T03:59:44.868 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:44.869 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:44.913 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.932+0000 7f2a05be7980 20 realm 2024-04-03T03:59:44.914 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.932+0000 7f2a05be7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:44.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.915 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.936+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:44.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.936+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.936+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:44.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.936+0000 7f2a05be7980 20 searching for the correct realm 2024-04-03T03:59:44.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.940+0000 7f2a03f03640 0 -- 172.21.15.104:0/129464344 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x55d8280995a0 msgr2=0x55d82809b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:44.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.944+0000 7f2a03f03640 0 -- 172.21.15.104:0/129464344 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x7f28cc0774c0 msgr2=0x7f28cc0798f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:44.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:44.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 zone default found 2024-04-03T03:59:44.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 4 Realm: () 2024-04-03T03:59:44.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:44.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:44.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:44.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 zonegroup default 2024-04-03T03:59:44.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.960+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:44.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.960+0000 7f2a05be7980 20 started sync module instance, tier type = 2024-04-03T03:59:44.940 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.960+0000 7f2a05be7980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:44.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=0 2024-04-03T03:59:44.955 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=1 2024-04-03T03:59:44.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=2 2024-04-03T03:59:44.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=3 2024-04-03T03:59:44.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=4 2024-04-03T03:59:44.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=5 2024-04-03T03:59:44.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=6 2024-04-03T03:59:44.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=7 2024-04-03T03:59:44.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:44.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f28ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.976+0000 7f2a05be7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 5 note: GC not initialized 2024-04-03T03:59:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f28b97e2640 20 reqs_thread_entry: start 2024-04-03T03:59:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 20 Filter name: none 2024-04-03T03:59:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f28b27fc640 20 reqs_thread_entry: start 2024-04-03T03:59:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-04-03T03:59:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-04-03T03:59:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-04-03T03:59:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 : miss 2024-04-03T03:59:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:44.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 info.flags=0x17 2024-04-03T03:59:44.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to cache LRU end 2024-04-03T03:59:44.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:44.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:44.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.980+0000 7f2a05be7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 2024-04-03T03:59:44.969 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2a05be7980 time 2024-04-03T03:59:44.991353+0000 2024-04-03T03:59:44.969 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T03:59:44.969 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2a094bde1f] 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f2a094bdfd3] 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d826e535b1] 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 4: radosgw-admin(+0x8d807a) [0x55d826e5c07a] 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55d826e61203] 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 6: main() 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2a08327d90] 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 8: __libc_start_main() 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 9: _start() 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.988+0000 7f2a05be7980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2a05be7980 time 2024-04-03T03:59:44.991353+0000 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:44.970 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2a094bde1f] 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f2a094bdfd3] 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d826e535b1] 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 4: radosgw-admin(+0x8d807a) [0x55d826e5c07a] 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55d826e61203] 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 6: main() 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2a08327d90] 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 8: __libc_start_main() 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 9: _start() 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr:*** Caught signal (Aborted) ** 2024-04-03T03:59:44.971 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7f2a05be7980 thread_name:radosgw-admin 2024-04-03T03:59:44.989 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T03:59:44.989 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2a08340520] 2024-04-03T03:59:44.989 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2a094bde79] 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f2a094bdfd3] 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d826e535b1] 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 8: radosgw-admin(+0x8d807a) [0x55d826e5c07a] 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55d826e61203] 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 10: main() 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2a08327d90] 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 12: __libc_start_main() 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: 13: _start() 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:44.988+0000 7f2a05be7980 -1 *** Caught signal (Aborted) ** 2024-04-03T03:59:44.990 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7f2a05be7980 thread_name:radosgw-admin 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2a08340520] 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2a094bde79] 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f2a094bdfd3] 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d826e535b1] 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 8: radosgw-admin(+0x8d807a) [0x55d826e5c07a] 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55d826e61203] 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 10: main() 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2a08327d90] 2024-04-03T03:59:44.991 INFO:tasks.workunit.client.0.smithi104.stderr: 12: __libc_start_main() 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: 13: _start() 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr:--- begin dump of recent events --- 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -499> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -498> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -497> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): get_auth_request con 0x55d827fd4fd0 auth_method 0 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -496> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -495> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -494> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -493> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -492> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -491> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:44.992 INFO:tasks.workunit.client.0.smithi104.stderr: -490> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr: -489> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr: -488> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr: -487> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): handle_auth_done global_id 6348 payload 274 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr: -486> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient: _finish_hunting 0 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr: -485> 2024-04-03T03:59:44.908+0000 7f2a02f01640 1 monclient: found mon.noname-a 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr: -484> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr: -483> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr: -482> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr: -481> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: dump: 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:44.993 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: -480> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: _finish_auth 0 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: -479> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: _check_auth_tickets 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: -478> 2024-04-03T03:59:44.908+0000 7f2a05be7980 5 monclient: authenticate success, global_id 6348 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: -477> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: -476> 2024-04-03T03:59:44.908+0000 7f2a05be7980 10 monclient: get_monmap_and_config success 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: -475> 2024-04-03T03:59:44.908+0000 7f2a05be7980 4 set_mon_vals no callback set 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: -474> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: -473> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T03:59:44.994 INFO:tasks.workunit.client.0.smithi104.stderr: -472> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: dump: 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr: -471> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: shutdown 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr: -470> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 asok(0x55d827d9d210) unregister_commands rotate-key 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr: -469> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: build_initial_monmap 2024-04-03T03:59:44.995 INFO:tasks.workunit.client.0.smithi104.stderr: -468> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 build_initial for_mkfs: 0 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr: -467> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: monmap: 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr: -466> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding auth protocol: cephx 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr: -465> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding auth protocol: cephx 2024-04-03T03:59:44.996 INFO:tasks.workunit.client.0.smithi104.stderr: -464> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding auth protocol: cephx 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -463> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -462> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -461> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -460> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -459> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -458> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -457> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -456> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -455> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:44.997 INFO:tasks.workunit.client.0.smithi104.stderr: -454> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -453> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -452> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -451> 2024-04-03T03:59:44.912+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -450> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: starting msgr at 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -449> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: starting objecter 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -448> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command objecter_requests hook 0x55d827d4a860 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -447> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: setting wanted keys 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -446> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: calling monclient init 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -445> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: init 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -444> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding auth protocol: cephx 2024-04-03T03:59:44.998 INFO:tasks.workunit.client.0.smithi104.stderr: -443> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding auth protocol: cephx 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -442> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding auth protocol: cephx 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -441> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -440> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -439> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -438> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -437> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -436> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -435> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -434> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -433> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:44.999 INFO:tasks.workunit.client.0.smithi104.stderr: -432> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:45.000 INFO:tasks.workunit.client.0.smithi104.stderr: -431> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:45.000 INFO:tasks.workunit.client.0.smithi104.stderr: -430> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:45.000 INFO:tasks.workunit.client.0.smithi104.stderr: -429> 2024-04-03T03:59:44.912+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.000 INFO:tasks.workunit.client.0.smithi104.stderr: -428> 2024-04-03T03:59:44.912+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.000 INFO:tasks.workunit.client.0.smithi104.stderr: -427> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command rotate-key hook 0x55d827fa5d18 2024-04-03T03:59:45.000 INFO:tasks.workunit.client.0.smithi104.stderr: -426> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _reopen_session rank -1 2024-04-03T03:59:45.000 INFO:tasks.workunit.client.0.smithi104.stderr: -425> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _add_conns ranks=[0,2,1] 2024-04-03T03:59:45.000 INFO:tasks.workunit.client.0.smithi104.stderr: -424> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-a con 0x55d827e570f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T03:59:45.000 INFO:tasks.workunit.client.0.smithi104.stderr: -423> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-c con 0x55d827e63a90 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -422> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-b con 0x55d827fd4fd0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -421> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -420> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -419> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -418> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): _renew_subs 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -417> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): authenticate will time out at 2240.653968s 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -416> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): get_auth_request con 0x55d827e63a90 auth_method 0 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -415> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -414> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -413> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -412> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): get_auth_request con 0x55d827e570f0 auth_method 0 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -411> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -410> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.001 INFO:tasks.workunit.client.0.smithi104.stderr: -409> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -408> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -407> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -406> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -405> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -404> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -403> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -402> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): handle_auth_done global_id 5999 payload 824 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -401> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient: _finish_hunting 0 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -400> 2024-04-03T03:59:44.912+0000 7f2a02f01640 1 monclient: found mon.noname-c 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -399> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -398> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -397> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr: -396> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: dump: 2024-04-03T03:59:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr: -395> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: _finish_auth 0 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr: -394> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: _check_auth_tickets 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr: -393> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr: -392> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr: -391> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T03:59:45.003 INFO:tasks.workunit.client.0.smithi104.stderr: -390> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: dump: 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr: -389> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 monclient: authenticate success, global_id 5999 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr: -388> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.004 INFO:tasks.workunit.client.0.smithi104.stderr: -387> 2024-04-03T03:59:44.912+0000 7f28f160a640 4 set_mon_vals no callback set 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -386> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -385> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -384> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -383> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: init done 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -382> 2024-04-03T03:59:44.916+0000 7f28efe07640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -381> 2024-04-03T03:59:44.916+0000 7f28efe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -380> 2024-04-03T03:59:44.916+0000 7f28efe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -379> 2024-04-03T03:59:44.916+0000 7f2a03702640 10 monclient: get_auth_request con 0x7f28e8066d60 auth_method 0 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -378> 2024-04-03T03:59:44.916+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d827fd3a40 auth_method 0 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -377> 2024-04-03T03:59:44.916+0000 7f2a03702640 10 monclient: get_auth_request con 0x55d827ff1480 auth_method 0 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -376> 2024-04-03T03:59:44.920+0000 7f2a02f01640 10 monclient: get_auth_request con 0x55d827ff5670 auth_method 0 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -375> 2024-04-03T03:59:44.920+0000 7f28efe07640 1 client.5999.objecter ms_handle_reset 0x55d827ff5670 session 0x55d827fe7ef0 osd.2 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -374> 2024-04-03T03:59:44.920+0000 7f28efe07640 10 monclient: _renew_subs 2024-04-03T03:59:45.005 INFO:tasks.workunit.client.0.smithi104.stderr: -373> 2024-04-03T03:59:44.920+0000 7f28efe07640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr: -372> 2024-04-03T03:59:44.920+0000 7f2a02f01640 10 monclient: get_auth_request con 0x7f28e8077490 auth_method 0 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr: -371> 2024-04-03T03:59:44.920+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d827ff6a60 auth_method 0 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr: -370> 2024-04-03T03:59:44.920+0000 7f2a05be7980 10 monclient: build_initial_monmap 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr: -369> 2024-04-03T03:59:44.920+0000 7f2a05be7980 1 build_initial for_mkfs: 0 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr: -368> 2024-04-03T03:59:44.920+0000 7f2a05be7980 10 monclient: monmap: 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T03:59:45.006 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -367> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding auth protocol: cephx 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -366> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding auth protocol: cephx 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -365> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding auth protocol: cephx 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -364> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -363> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -362> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -361> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -360> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -359> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -358> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -357> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -356> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.007 INFO:tasks.workunit.client.0.smithi104.stderr: -355> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -354> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -353> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -352> 2024-04-03T03:59:44.920+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -351> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command objecter_requests cmddesc objecter_requests hook 0x55d828000360 EEXIST 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -350> 2024-04-03T03:59:44.920+0000 7f2a05be7980 10 monclient: init 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -349> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding auth protocol: cephx 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -348> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding auth protocol: cephx 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -347> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding auth protocol: cephx 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -346> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -345> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -344> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -343> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -342> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.008 INFO:tasks.workunit.client.0.smithi104.stderr: -341> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -340> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -339> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -338> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -337> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -336> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -335> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -334> 2024-04-03T03:59:44.924+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -333> 2024-04-03T03:59:44.924+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -332> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command rotate-key cmddesc rotate-key hook 0x55d827ff5c10 EEXIST 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -331> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _reopen_session rank -1 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -330> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _add_conns ranks=[2,1,0] 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -329> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-c con 0x55d828024fc0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -328> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-b con 0x55d8280253a0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -327> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-a con 0x55d828020560 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T03:59:45.009 INFO:tasks.workunit.client.0.smithi104.stderr: -326> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -325> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -324> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -323> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): _renew_subs 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -322> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): authenticate will time out at 2240.664465s 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -321> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): get_auth_request con 0x55d828024fc0 auth_method 0 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -320> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -319> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -318> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -317> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): get_auth_request con 0x55d828020560 auth_method 0 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -316> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -315> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.010 INFO:tasks.workunit.client.0.smithi104.stderr: -314> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -313> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -312> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -311> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -310> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -309> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -308> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -307> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): handle_auth_done global_id 6354 payload 824 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -306> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient: _finish_hunting 0 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -305> 2024-04-03T03:59:44.924+0000 7f2a03702640 1 monclient: found mon.noname-a 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -304> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -303> 2024-04-03T03:59:44.924+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d8280253a0 auth_method 0 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -302> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -301> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T03:59:45.011 INFO:tasks.workunit.client.0.smithi104.stderr: -300> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: dump: 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr: -299> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: _finish_auth 0 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr: -298> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: _check_auth_tickets 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr: -297> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:45.012 INFO:tasks.workunit.client.0.smithi104.stderr: -296> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr: -295> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr: -294> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: dump: 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr: -293> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 monclient: authenticate success, global_id 6354 2024-04-03T03:59:45.013 INFO:tasks.workunit.client.0.smithi104.stderr: -292> 2024-04-03T03:59:44.924+0000 7f2a04704640 4 set_mon_vals no callback set 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -291> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -290> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -289> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -288> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -287> 2024-04-03T03:59:44.924+0000 7f28ed602640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -286> 2024-04-03T03:59:44.924+0000 7f28ed602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -285> 2024-04-03T03:59:44.924+0000 7f28ed602640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -284> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient: get_auth_request con 0x7f28dc066ca0 auth_method 0 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -283> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: get_monmap_and_config 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -282> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: build_initial_monmap 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -281> 2024-04-03T03:59:44.924+0000 7f2a05be7980 1 build_initial for_mkfs: 0 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr: -280> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: monmap: 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T03:59:45.014 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr: -279> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr: -278> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr: -277> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr: -276> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr: -275> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr: -274> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.015 INFO:tasks.workunit.client.0.smithi104.stderr: -273> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -272> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -271> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -270> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -269> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -268> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -267> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -266> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -265> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -264> 2024-04-03T03:59:44.924+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -263> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: init 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -262> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding auth protocol: cephx 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -261> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding auth protocol: cephx 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -260> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding auth protocol: cephx 2024-04-03T03:59:45.016 INFO:tasks.workunit.client.0.smithi104.stderr: -259> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -258> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -257> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -256> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -255> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -254> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -253> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -252> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -251> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -250> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -249> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -248> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -247> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -246> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.017 INFO:tasks.workunit.client.0.smithi104.stderr: -245> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command rotate-key cmddesc rotate-key hook 0x7ffff31cfee8 EEXIST 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -244> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _reopen_session rank -1 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -243> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _add_conns ranks=[2,0,1] 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -242> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-c con 0x55d828072580 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -241> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-a con 0x55d828072960 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -240> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-b con 0x55d8280495a0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -239> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -238> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -237> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -236> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): _renew_subs 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -235> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): authenticate will time out at 2240.668480s 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -234> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): get_auth_request con 0x55d828072580 auth_method 0 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -233> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -232> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.018 INFO:tasks.workunit.client.0.smithi104.stderr: -231> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -230> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): get_auth_request con 0x55d828072960 auth_method 0 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -229> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -228> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -227> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -226> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -225> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -224> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -223> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -222> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -221> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -220> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_done global_id 6005 payload 274 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -219> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient: _finish_hunting 0 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -218> 2024-04-03T03:59:44.928+0000 7f2a02f01640 1 monclient: found mon.noname-c 2024-04-03T03:59:45.019 INFO:tasks.workunit.client.0.smithi104.stderr: -217> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr: -216> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr: -215> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr: -214> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: dump: 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.020 INFO:tasks.workunit.client.0.smithi104.stderr: -213> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: _finish_auth 0 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr: -212> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: _check_auth_tickets 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr: -211> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr: -210> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr: -209> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr: -208> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: dump: 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.021 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr: -207> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 monclient: authenticate success, global_id 6005 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr: -206> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: get_monmap_and_config success 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr: -205> 2024-04-03T03:59:44.928+0000 7f2a05be7980 4 set_mon_vals no callback set 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr: -204> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: shutdown 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr: -203> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: build_initial_monmap 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr: -202> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 build_initial for_mkfs: 0 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr: -201> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: monmap: 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.022 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -200> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -199> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -198> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -197> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -196> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -195> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -194> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -193> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -192> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -191> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.023 INFO:tasks.workunit.client.0.smithi104.stderr: -190> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -189> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -188> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -187> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -186> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -185> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -184> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: starting msgr at 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -183> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: starting objecter 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -182> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command objecter_requests cmddesc objecter_requests hook 0x55d8280248a0 EEXIST 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -181> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: setting wanted keys 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -180> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: calling monclient init 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -179> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: init 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -178> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding auth protocol: cephx 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -177> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding auth protocol: cephx 2024-04-03T03:59:45.024 INFO:tasks.workunit.client.0.smithi104.stderr: -176> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding auth protocol: cephx 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -175> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -174> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -173> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -172> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -171> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -170> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -169> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -168> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -167> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -166> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -165> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -164> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -163> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.025 INFO:tasks.workunit.client.0.smithi104.stderr: -162> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -161> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command rotate-key cmddesc rotate-key hook 0x55d828041e28 EEXIST 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -160> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _reopen_session rank -1 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -159> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -158> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-a con 0x55d8280495a0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -157> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-b con 0x55d828072580 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -156> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-c con 0x55d828075a00 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -155> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -154> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -153> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -152> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): _renew_subs 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -151> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): authenticate will time out at 2240.671082s 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -150> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): get_auth_request con 0x55d8280495a0 auth_method 0 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -149> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.026 INFO:tasks.workunit.client.0.smithi104.stderr: -148> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -147> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -146> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): get_auth_request con 0x55d828075a00 auth_method 0 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -145> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -144> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -143> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -142> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -141> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -140> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -139> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -138> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -137> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -136> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_done global_id 6360 payload 824 2024-04-03T03:59:45.027 INFO:tasks.workunit.client.0.smithi104.stderr: -135> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient: _finish_hunting 0 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr: -134> 2024-04-03T03:59:44.928+0000 7f2a02f01640 1 monclient: found mon.noname-a 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr: -133> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr: -132> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d828072580 auth_method 0 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr: -131> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr: -130> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr: -129> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: dump: 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.028 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr: -128> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: _finish_auth 0 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr: -127> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: _check_auth_tickets 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr: -126> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr: -125> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr: -124> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr: -123> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: dump: 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.029 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -122> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 4 set_mon_vals no callback set 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -121> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 monclient: authenticate success, global_id 6360 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -120> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -119> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -118> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -117> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -116> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: init done 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -115> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cr dump hook 0x55d8280777e8 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -114> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.030 INFO:tasks.workunit.client.0.smithi104.stderr: -113> 2024-04-03T03:59:44.932+0000 7f28e57fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -112> 2024-04-03T03:59:44.932+0000 7f28e57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -111> 2024-04-03T03:59:44.932+0000 7f28e57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -110> 2024-04-03T03:59:44.932+0000 7f2a03f03640 10 monclient: get_auth_request con 0x7f28cc066d90 auth_method 0 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -109> 2024-04-03T03:59:44.932+0000 7f2a03702640 10 monclient: get_auth_request con 0x55d828091c50 auth_method 0 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -108> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -107> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 realm 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -106> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -105> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -104> 2024-04-03T03:59:44.932+0000 7f2a05be7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -103> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -102> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -101> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.031 INFO:tasks.workunit.client.0.smithi104.stderr: -100> 2024-04-03T03:59:44.932+0000 7f2a02f01640 10 monclient: get_auth_request con 0x55d828095d60 auth_method 0 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -99> 2024-04-03T03:59:44.936+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -98> 2024-04-03T03:59:44.936+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -97> 2024-04-03T03:59:44.936+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d8280995a0 auth_method 0 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -96> 2024-04-03T03:59:44.936+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -95> 2024-04-03T03:59:44.936+0000 7f2a05be7980 20 searching for the correct realm 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -94> 2024-04-03T03:59:44.936+0000 7f2a03702640 10 monclient: get_auth_request con 0x55d82809e310 auth_method 0 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -93> 2024-04-03T03:59:44.936+0000 7f2a02f01640 10 monclient: get_auth_request con 0x7f29f4064990 auth_method 0 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -92> 2024-04-03T03:59:44.940+0000 7f2a03f03640 0 -- 172.21.15.104:0/129464344 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x55d8280995a0 msgr2=0x55d82809b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -91> 2024-04-03T03:59:44.940+0000 7f28e57fa640 1 client.6360.objecter ms_handle_reset 0x55d8280995a0 session 0x55d8280950f0 osd.2 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -90> 2024-04-03T03:59:44.940+0000 7f28e57fa640 10 monclient: _renew_subs 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -89> 2024-04-03T03:59:44.940+0000 7f28e57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -88> 2024-04-03T03:59:44.940+0000 7f2a03f03640 10 monclient: get_auth_request con 0x7f28cc0774c0 auth_method 0 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -87> 2024-04-03T03:59:44.940+0000 7f2a03f03640 10 monclient: get_auth_request con 0x7f29fc0d7b10 auth_method 0 2024-04-03T03:59:45.032 INFO:tasks.workunit.client.0.smithi104.stderr: -86> 2024-04-03T03:59:44.944+0000 7f2a03702640 10 monclient: get_auth_request con 0x7f29fc0e7040 auth_method 0 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -85> 2024-04-03T03:59:44.944+0000 7f2a03f03640 0 -- 172.21.15.104:0/129464344 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x7f28cc0774c0 msgr2=0x7f28cc0798f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -84> 2024-04-03T03:59:44.944+0000 7f28e57fa640 1 client.6360.objecter ms_handle_reset 0x7f28cc0774c0 session 0x55d8280950f0 osd.2 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -83> 2024-04-03T03:59:44.944+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d8280995a0 auth_method 0 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -82> 2024-04-03T03:59:44.948+0000 7f2a02f01640 10 monclient: get_auth_request con 0x7f29fc0b8900 auth_method 0 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -81> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -80> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -79> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -78> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -77> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:45.033 INFO:tasks.workunit.client.0.smithi104.stderr: -76> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -75> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -74> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -73> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -72> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -71> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -70> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -69> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 zone default found 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -68> 2024-04-03T03:59:44.956+0000 7f2a05be7980 4 Realm: () 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -67> 2024-04-03T03:59:44.956+0000 7f2a05be7980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -66> 2024-04-03T03:59:44.956+0000 7f2a05be7980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -65> 2024-04-03T03:59:44.956+0000 7f2a05be7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -64> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 zonegroup default 2024-04-03T03:59:45.034 INFO:tasks.workunit.client.0.smithi104.stderr: -63> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -62> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -61> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -60> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -59> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -58> 2024-04-03T03:59:44.960+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -57> 2024-04-03T03:59:44.960+0000 7f2a05be7980 20 started sync module instance, tier type = 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -56> 2024-04-03T03:59:44.960+0000 7f2a05be7980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -55> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=0 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -54> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=1 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -53> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=2 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -52> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=3 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -51> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=4 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -50> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=5 2024-04-03T03:59:45.035 INFO:tasks.workunit.client.0.smithi104.stderr: -49> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=6 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -48> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=7 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -47> 2024-04-03T03:59:44.976+0000 7f2a05be7980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -46> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding auth protocol: cephx 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -45> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding auth protocol: cephx 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -44> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding auth protocol: cephx 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -43> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -42> 2024-04-03T03:59:44.976+0000 7f28ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -41> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -40> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -39> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -38> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -37> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -36> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.036 INFO:tasks.workunit.client.0.smithi104.stderr: -35> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -34> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -33> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -32> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -31> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -30> 2024-04-03T03:59:44.976+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -29> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -28> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -27> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cache list hook 0x55d828075e60 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -26> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cache inspect hook 0x55d828075e60 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -25> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cache erase hook 0x55d828075e60 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -24> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cache zap hook 0x55d828075e60 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -23> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 note: GC not initialized 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -22> 2024-04-03T03:59:44.980+0000 7f28b97e2640 20 reqs_thread_entry: start 2024-04-03T03:59:45.037 INFO:tasks.workunit.client.0.smithi104.stderr: -21> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command sync trace show hook 0x7f29fc004730 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -20> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command sync trace history hook 0x7f29fc004730 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -19> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command sync trace active hook 0x7f29fc004730 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -18> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command sync trace active_short hook 0x7f29fc004730 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -17> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -16> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 Filter name: none 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -15> 2024-04-03T03:59:44.980+0000 7f28b27fc640 20 reqs_thread_entry: start 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -14> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -13> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -12> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -11> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -10> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -9> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 : miss 2024-04-03T03:59:45.038 INFO:tasks.workunit.client.0.smithi104.stderr: -8> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: -7> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: -6> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 info.flags=0x17 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: -5> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to cache LRU end 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: -4> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: -3> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: -2> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: -1> 2024-04-03T03:59:44.988+0000 7f2a05be7980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2a05be7980 time 2024-04-03T03:59:44.991353+0000 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2a094bde1f] 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f2a094bdfd3] 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d826e535b1] 2024-04-03T03:59:45.039 INFO:tasks.workunit.client.0.smithi104.stderr: 4: radosgw-admin(+0x8d807a) [0x55d826e5c07a] 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55d826e61203] 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 6: main() 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2a08327d90] 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 8: __libc_start_main() 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 9: _start() 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 0> 2024-04-03T03:59:44.988+0000 7f2a05be7980 -1 *** Caught signal (Aborted) ** 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7f2a05be7980 thread_name:radosgw-admin 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2a08340520] 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T03:59:45.040 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2a094bde79] 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f2a094bdfd3] 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d826e535b1] 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 8: radosgw-admin(+0x8d807a) [0x55d826e5c07a] 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55d826e61203] 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 10: main() 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2a08327d90] 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 12: __libc_start_main() 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 13: _start() 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr:--- logging levels --- 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 none 2024-04-03T03:59:45.041 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 lockdep 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 context 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 crush 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_balancer 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_locker 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log_expire 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_migrator 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 3/ 5 mds_quiesce 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 buffer 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 timer 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 filer 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 striper 2024-04-03T03:59:45.042 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 objecter 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rados 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_mirror 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_replay 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_pwl 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 journaler 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objectcacher 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 immutable_obj_cache 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 client 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 osd 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 optracker 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objclass 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 filestore 2024-04-03T03:59:45.043 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 journal 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 ms 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mon 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 0/10 monc 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 paxos 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 tp 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 auth 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 crypto 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 finisher 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 reserver 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 heartbeatmap 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 perfcounter 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 20/20 rgw 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_sync 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_datacache 2024-04-03T03:59:45.044 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_access 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_dbstore 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_flight 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_lifecycle 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_notification 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 javaclient 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 asok 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 throttle 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 refs 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 compressor 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluestore 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluefs 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 bdev 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 kstore 2024-04-03T03:59:45.045 INFO:tasks.workunit.client.0.smithi104.stderr: 4/ 5 rocksdb 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 fuse 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 2/ 5 mgr 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mgrc 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 dpdk 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 eventtrace 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 prioritycache 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 test 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephfs_mirror 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephsqlite 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 crimson_interrupt 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_onode 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_odata 2024-04-03T03:59:45.046 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_omap 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_tm 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_t 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cleaner 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_epm 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_lba 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cache 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_journal 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_device 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_backref 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 alienstore 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mclock 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cyanstore 2024-04-03T03:59:45.047 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 ceph_exporter 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 memstore 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 trace 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: -2/-2 (syslog threshold) 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 99/99 (stderr threshold) 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28b27fc640 / http_manager 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28b97e2640 / http_manager 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28ba7e4640 / rgw_dt_lg_renew 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28e57fa640 / ms_dispatch 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28e6ffd640 / io_context_pool 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28ed602640 / ms_dispatch 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28efe07640 / ms_dispatch 2024-04-03T03:59:45.048 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28f160a640 / io_context_pool 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a02f01640 / msgr-worker-2 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a03702640 / msgr-worker-1 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a03f03640 / msgr-worker-0 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a04704640 / io_context_pool 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a05be7980 / radosgw-admin 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: max_recent 500 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: max_new 1000 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: log_file /var/log/ceph/ceph-client.admin.81110.log 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr:--- end dump of recent events --- 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr:--- begin dump of recent events --- 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: -499> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: -498> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: -497> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): get_auth_request con 0x55d827fd4fd0 auth_method 0 2024-04-03T03:59:45.049 INFO:tasks.workunit.client.0.smithi104.stderr: -496> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -495> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -494> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -493> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -492> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -491> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -490> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -489> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -488> 2024-04-03T03:59:44.908+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -487> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient(hunting): handle_auth_done global_id 6348 payload 274 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -486> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient: _finish_hunting 0 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -485> 2024-04-03T03:59:44.908+0000 7f2a02f01640 1 monclient: found mon.noname-a 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -484> 2024-04-03T03:59:44.908+0000 7f2a02f01640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -483> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.050 INFO:tasks.workunit.client.0.smithi104.stderr: -482> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr: -481> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: dump: 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr: -480> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: _finish_auth 0 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr: -479> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: _check_auth_tickets 2024-04-03T03:59:45.051 INFO:tasks.workunit.client.0.smithi104.stderr: -478> 2024-04-03T03:59:44.908+0000 7f2a05be7980 5 monclient: authenticate success, global_id 6348 2024-04-03T03:59:45.052 INFO:tasks.workunit.client.0.smithi104.stderr: -477> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:45.052 INFO:tasks.workunit.client.0.smithi104.stderr: -476> 2024-04-03T03:59:44.908+0000 7f2a05be7980 10 monclient: get_monmap_and_config success 2024-04-03T03:59:45.052 INFO:tasks.workunit.client.0.smithi104.stderr: -475> 2024-04-03T03:59:44.908+0000 7f2a05be7980 4 set_mon_vals no callback set 2024-04-03T03:59:45.052 INFO:tasks.workunit.client.0.smithi104.stderr: -474> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.052 INFO:tasks.workunit.client.0.smithi104.stderr: -473> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T03:59:45.052 INFO:tasks.workunit.client.0.smithi104.stderr: -472> 2024-04-03T03:59:44.908+0000 7f28f160a640 10 monclient: dump: 2024-04-03T03:59:45.053 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.053 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.053 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr: -471> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: shutdown 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr: -470> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 asok(0x55d827d9d210) unregister_commands rotate-key 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr: -469> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: build_initial_monmap 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr: -468> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 build_initial for_mkfs: 0 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr: -467> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: monmap: 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T03:59:45.054 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr: -466> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding auth protocol: cephx 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr: -465> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding auth protocol: cephx 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr: -464> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding auth protocol: cephx 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr: -463> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:45.055 INFO:tasks.workunit.client.0.smithi104.stderr: -462> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -461> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -460> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -459> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -458> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -457> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -456> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -455> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -454> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -453> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: crc 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -452> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fd54f0) adding con mode: secure 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -451> 2024-04-03T03:59:44.912+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -450> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: starting msgr at 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -449> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: starting objecter 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -448> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command objecter_requests hook 0x55d827d4a860 2024-04-03T03:59:45.056 INFO:tasks.workunit.client.0.smithi104.stderr: -447> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: setting wanted keys 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -446> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: calling monclient init 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -445> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: init 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -444> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding auth protocol: cephx 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -443> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding auth protocol: cephx 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -442> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding auth protocol: cephx 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -441> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -440> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -439> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -438> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -437> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -436> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -435> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:45.057 INFO:tasks.workunit.client.0.smithi104.stderr: -434> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -433> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -432> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -431> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: crc 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -430> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 AuthRegistry(0x55d827fa5bd0) adding con mode: secure 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -429> 2024-04-03T03:59:44.912+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -428> 2024-04-03T03:59:44.912+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -427> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command rotate-key hook 0x55d827fa5d18 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -426> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _reopen_session rank -1 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -425> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _add_conns ranks=[0,2,1] 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -424> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-a con 0x55d827e570f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -423> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-c con 0x55d827e63a90 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T03:59:45.058 INFO:tasks.workunit.client.0.smithi104.stderr: -422> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-b con 0x55d827fd4fd0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -421> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -420> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -419> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -418> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): _renew_subs 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -417> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient(hunting): authenticate will time out at 2240.653968s 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -416> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): get_auth_request con 0x55d827e63a90 auth_method 0 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -415> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -414> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -413> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -412> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): get_auth_request con 0x55d827e570f0 auth_method 0 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -411> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -410> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.059 INFO:tasks.workunit.client.0.smithi104.stderr: -409> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -408> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -407> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -406> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -405> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -404> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -403> 2024-04-03T03:59:44.912+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -402> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient(hunting): handle_auth_done global_id 5999 payload 824 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -401> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient: _finish_hunting 0 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -400> 2024-04-03T03:59:44.912+0000 7f2a02f01640 1 monclient: found mon.noname-c 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -399> 2024-04-03T03:59:44.912+0000 7f2a02f01640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -398> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -397> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr: -396> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: dump: 2024-04-03T03:59:45.060 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr: -395> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: _finish_auth 0 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr: -394> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: _check_auth_tickets 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr: -393> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr: -392> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr: -391> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T03:59:45.061 INFO:tasks.workunit.client.0.smithi104.stderr: -390> 2024-04-03T03:59:44.912+0000 7f28efe07640 10 monclient: dump: 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr: -389> 2024-04-03T03:59:44.912+0000 7f2a05be7980 5 monclient: authenticate success, global_id 5999 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr: -388> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr: -387> 2024-04-03T03:59:44.912+0000 7f28f160a640 4 set_mon_vals no callback set 2024-04-03T03:59:45.062 INFO:tasks.workunit.client.0.smithi104.stderr: -386> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -385> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -384> 2024-04-03T03:59:44.912+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -383> 2024-04-03T03:59:44.912+0000 7f2a05be7980 1 librados: init done 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -382> 2024-04-03T03:59:44.916+0000 7f28efe07640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -381> 2024-04-03T03:59:44.916+0000 7f28efe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -380> 2024-04-03T03:59:44.916+0000 7f28efe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -379> 2024-04-03T03:59:44.916+0000 7f2a03702640 10 monclient: get_auth_request con 0x7f28e8066d60 auth_method 0 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -378> 2024-04-03T03:59:44.916+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d827fd3a40 auth_method 0 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -377> 2024-04-03T03:59:44.916+0000 7f2a03702640 10 monclient: get_auth_request con 0x55d827ff1480 auth_method 0 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -376> 2024-04-03T03:59:44.920+0000 7f2a02f01640 10 monclient: get_auth_request con 0x55d827ff5670 auth_method 0 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -375> 2024-04-03T03:59:44.920+0000 7f28efe07640 1 client.5999.objecter ms_handle_reset 0x55d827ff5670 session 0x55d827fe7ef0 osd.2 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -374> 2024-04-03T03:59:44.920+0000 7f28efe07640 10 monclient: _renew_subs 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -373> 2024-04-03T03:59:44.920+0000 7f28efe07640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.063 INFO:tasks.workunit.client.0.smithi104.stderr: -372> 2024-04-03T03:59:44.920+0000 7f2a02f01640 10 monclient: get_auth_request con 0x7f28e8077490 auth_method 0 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr: -371> 2024-04-03T03:59:44.920+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d827ff6a60 auth_method 0 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr: -370> 2024-04-03T03:59:44.920+0000 7f2a05be7980 10 monclient: build_initial_monmap 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr: -369> 2024-04-03T03:59:44.920+0000 7f2a05be7980 1 build_initial for_mkfs: 0 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr: -368> 2024-04-03T03:59:44.920+0000 7f2a05be7980 10 monclient: monmap: 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T03:59:45.064 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -367> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding auth protocol: cephx 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -366> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding auth protocol: cephx 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -365> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding auth protocol: cephx 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -364> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -363> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -362> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -361> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -360> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -359> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -358> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -357> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -356> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -355> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.065 INFO:tasks.workunit.client.0.smithi104.stderr: -354> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: crc 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -353> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ffae30) adding con mode: secure 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -352> 2024-04-03T03:59:44.920+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -351> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command objecter_requests cmddesc objecter_requests hook 0x55d828000360 EEXIST 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -350> 2024-04-03T03:59:44.920+0000 7f2a05be7980 10 monclient: init 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -349> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding auth protocol: cephx 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -348> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding auth protocol: cephx 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -347> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding auth protocol: cephx 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -346> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -345> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -344> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -343> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -342> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -341> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.066 INFO:tasks.workunit.client.0.smithi104.stderr: -340> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -339> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -338> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -337> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -336> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: crc 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -335> 2024-04-03T03:59:44.920+0000 7f2a05be7980 5 AuthRegistry(0x55d827ff5ac8) adding con mode: secure 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -334> 2024-04-03T03:59:44.924+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -333> 2024-04-03T03:59:44.924+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -332> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command rotate-key cmddesc rotate-key hook 0x55d827ff5c10 EEXIST 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -331> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _reopen_session rank -1 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -330> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _add_conns ranks=[2,1,0] 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -329> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-c con 0x55d828024fc0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -328> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-b con 0x55d8280253a0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -327> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-a con 0x55d828020560 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T03:59:45.067 INFO:tasks.workunit.client.0.smithi104.stderr: -326> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -325> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -324> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -323> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): _renew_subs 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -322> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient(hunting): authenticate will time out at 2240.664465s 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -321> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): get_auth_request con 0x55d828024fc0 auth_method 0 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -320> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -319> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -318> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -317> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): get_auth_request con 0x55d828020560 auth_method 0 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -316> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -315> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -314> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -313> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.068 INFO:tasks.workunit.client.0.smithi104.stderr: -312> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -311> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -310> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -309> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -308> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -307> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient(hunting): handle_auth_done global_id 6354 payload 824 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -306> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient: _finish_hunting 0 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -305> 2024-04-03T03:59:44.924+0000 7f2a03702640 1 monclient: found mon.noname-a 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -304> 2024-04-03T03:59:44.924+0000 7f2a03702640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -303> 2024-04-03T03:59:44.924+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d8280253a0 auth_method 0 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -302> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -301> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr: -300> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: dump: 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.069 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr: -299> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: _finish_auth 0 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr: -298> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: _check_auth_tickets 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr: -297> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr: -296> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr: -295> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T03:59:45.070 INFO:tasks.workunit.client.0.smithi104.stderr: -294> 2024-04-03T03:59:44.924+0000 7f28ed602640 10 monclient: dump: 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr: -293> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 monclient: authenticate success, global_id 6354 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr: -292> 2024-04-03T03:59:44.924+0000 7f2a04704640 4 set_mon_vals no callback set 2024-04-03T03:59:45.071 INFO:tasks.workunit.client.0.smithi104.stderr: -291> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -290> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -289> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -288> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -287> 2024-04-03T03:59:44.924+0000 7f28ed602640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -286> 2024-04-03T03:59:44.924+0000 7f28ed602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -285> 2024-04-03T03:59:44.924+0000 7f28ed602640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -284> 2024-04-03T03:59:44.924+0000 7f2a02f01640 10 monclient: get_auth_request con 0x7f28dc066ca0 auth_method 0 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -283> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: get_monmap_and_config 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -282> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: build_initial_monmap 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -281> 2024-04-03T03:59:44.924+0000 7f2a05be7980 1 build_initial for_mkfs: 0 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr: -280> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: monmap: 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T03:59:45.072 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr: -279> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr: -278> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr: -277> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr: -276> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr: -275> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr: -274> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.073 INFO:tasks.workunit.client.0.smithi104.stderr: -273> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -272> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -271> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -270> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -269> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -268> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -267> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -266> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -265> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -264> 2024-04-03T03:59:44.924+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -263> 2024-04-03T03:59:44.924+0000 7f2a05be7980 10 monclient: init 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -262> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding auth protocol: cephx 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -261> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding auth protocol: cephx 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -260> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding auth protocol: cephx 2024-04-03T03:59:45.074 INFO:tasks.workunit.client.0.smithi104.stderr: -259> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -258> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -257> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -256> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -255> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -254> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -253> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -252> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -251> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -250> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -249> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: crc 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -248> 2024-04-03T03:59:44.924+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31cfda0) adding con mode: secure 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -247> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -246> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.075 INFO:tasks.workunit.client.0.smithi104.stderr: -245> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command rotate-key cmddesc rotate-key hook 0x7ffff31cfee8 EEXIST 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -244> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _reopen_session rank -1 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -243> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _add_conns ranks=[2,0,1] 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -242> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-c con 0x55d828072580 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -241> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-a con 0x55d828072960 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -240> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-b con 0x55d8280495a0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -239> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -238> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -237> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -236> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): _renew_subs 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -235> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): authenticate will time out at 2240.668480s 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -234> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): get_auth_request con 0x55d828072580 auth_method 0 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -233> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -232> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -231> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.076 INFO:tasks.workunit.client.0.smithi104.stderr: -230> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): get_auth_request con 0x55d828072960 auth_method 0 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -229> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -228> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -227> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -226> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -225> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -224> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -223> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -222> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -221> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -220> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_done global_id 6005 payload 274 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -219> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient: _finish_hunting 0 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -218> 2024-04-03T03:59:44.928+0000 7f2a02f01640 1 monclient: found mon.noname-c 2024-04-03T03:59:45.077 INFO:tasks.workunit.client.0.smithi104.stderr: -217> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr: -216> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr: -215> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr: -214> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: dump: 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.078 INFO:tasks.workunit.client.0.smithi104.stderr: -213> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: _finish_auth 0 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr: -212> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: _check_auth_tickets 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr: -211> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr: -210> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr: -209> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr: -208> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 10 monclient: dump: 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.079 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr: -207> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 monclient: authenticate success, global_id 6005 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr: -206> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: get_monmap_and_config success 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr: -205> 2024-04-03T03:59:44.928+0000 7f2a05be7980 4 set_mon_vals no callback set 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr: -204> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: shutdown 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr: -203> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: build_initial_monmap 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr: -202> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 build_initial for_mkfs: 0 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr: -201> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: monmap: 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T03:59:45.080 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: -200> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: -199> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: -198> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding auth protocol: cephx 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: -197> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: -196> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: -195> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: -194> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: -193> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.081 INFO:tasks.workunit.client.0.smithi104.stderr: -192> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -191> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -190> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -189> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -188> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -187> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: crc 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -186> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828042b10) adding con mode: secure 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -185> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -184> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: starting msgr at 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -183> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: starting objecter 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -182> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command objecter_requests cmddesc objecter_requests hook 0x55d8280248a0 EEXIST 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -181> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: setting wanted keys 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -180> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: calling monclient init 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -179> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: init 2024-04-03T03:59:45.082 INFO:tasks.workunit.client.0.smithi104.stderr: -178> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding auth protocol: cephx 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -177> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding auth protocol: cephx 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -176> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding auth protocol: cephx 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -175> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -174> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -173> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -172> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -171> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -170> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -169> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -168> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -167> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -166> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -165> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: crc 2024-04-03T03:59:45.083 INFO:tasks.workunit.client.0.smithi104.stderr: -164> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 AuthRegistry(0x55d828041ce0) adding con mode: secure 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -163> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -162> 2024-04-03T03:59:44.928+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -161> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command rotate-key cmddesc rotate-key hook 0x55d828041e28 EEXIST 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -160> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _reopen_session rank -1 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -159> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -158> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-a con 0x55d8280495a0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -157> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-b con 0x55d828072580 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -156> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): picked mon.noname-c con 0x55d828075a00 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -155> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -154> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -153> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): start opening mon connection 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -152> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): _renew_subs 2024-04-03T03:59:45.084 INFO:tasks.workunit.client.0.smithi104.stderr: -151> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient(hunting): authenticate will time out at 2240.671082s 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -150> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): get_auth_request con 0x55d8280495a0 auth_method 0 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -149> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -148> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -147> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -146> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): get_auth_request con 0x55d828075a00 auth_method 0 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -145> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -144> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): _init_auth method 2 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -143> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -142> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -141> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -140> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -139> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -138> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -137> 2024-04-03T03:59:44.928+0000 7f2a03702640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T03:59:45.085 INFO:tasks.workunit.client.0.smithi104.stderr: -136> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient(hunting): handle_auth_done global_id 6360 payload 824 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr: -135> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient: _finish_hunting 0 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr: -134> 2024-04-03T03:59:44.928+0000 7f2a02f01640 1 monclient: found mon.noname-a 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr: -133> 2024-04-03T03:59:44.928+0000 7f2a02f01640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr: -132> 2024-04-03T03:59:44.928+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d828072580 auth_method 0 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr: -131> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr: -130> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr: -129> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: dump: 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.086 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr: -128> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: _finish_auth 0 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr: -127> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: _check_auth_tickets 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr: -126> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: handle_config config(0 keys) 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr: -125> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr: -124> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr: -123> 2024-04-03T03:59:44.928+0000 7f28e57fa640 10 monclient: dump: 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T03:59:45.087 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr: -122> 2024-04-03T03:59:44.928+0000 7f28e6ffd640 4 set_mon_vals no callback set 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr: -121> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 monclient: authenticate success, global_id 6360 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr: -120> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr: -119> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr: -118> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _renew_subs 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr: -117> 2024-04-03T03:59:44.928+0000 7f2a05be7980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.088 INFO:tasks.workunit.client.0.smithi104.stderr: -116> 2024-04-03T03:59:44.928+0000 7f2a05be7980 1 librados: init done 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -115> 2024-04-03T03:59:44.928+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cr dump hook 0x55d8280777e8 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -114> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -113> 2024-04-03T03:59:44.932+0000 7f28e57fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -112> 2024-04-03T03:59:44.932+0000 7f28e57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -111> 2024-04-03T03:59:44.932+0000 7f28e57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -110> 2024-04-03T03:59:44.932+0000 7f2a03f03640 10 monclient: get_auth_request con 0x7f28cc066d90 auth_method 0 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -109> 2024-04-03T03:59:44.932+0000 7f2a03702640 10 monclient: get_auth_request con 0x55d828091c50 auth_method 0 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -108> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -107> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 realm 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -106> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -105> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -104> 2024-04-03T03:59:44.932+0000 7f2a05be7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:45.089 INFO:tasks.workunit.client.0.smithi104.stderr: -103> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -102> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -101> 2024-04-03T03:59:44.932+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -100> 2024-04-03T03:59:44.932+0000 7f2a02f01640 10 monclient: get_auth_request con 0x55d828095d60 auth_method 0 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -99> 2024-04-03T03:59:44.936+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -98> 2024-04-03T03:59:44.936+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -97> 2024-04-03T03:59:44.936+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d8280995a0 auth_method 0 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -96> 2024-04-03T03:59:44.936+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -95> 2024-04-03T03:59:44.936+0000 7f2a05be7980 20 searching for the correct realm 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -94> 2024-04-03T03:59:44.936+0000 7f2a03702640 10 monclient: get_auth_request con 0x55d82809e310 auth_method 0 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -93> 2024-04-03T03:59:44.936+0000 7f2a02f01640 10 monclient: get_auth_request con 0x7f29f4064990 auth_method 0 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -92> 2024-04-03T03:59:44.940+0000 7f2a03f03640 0 -- 172.21.15.104:0/129464344 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x55d8280995a0 msgr2=0x55d82809b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -91> 2024-04-03T03:59:44.940+0000 7f28e57fa640 1 client.6360.objecter ms_handle_reset 0x55d8280995a0 session 0x55d8280950f0 osd.2 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -90> 2024-04-03T03:59:44.940+0000 7f28e57fa640 10 monclient: _renew_subs 2024-04-03T03:59:45.090 INFO:tasks.workunit.client.0.smithi104.stderr: -89> 2024-04-03T03:59:44.940+0000 7f28e57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -88> 2024-04-03T03:59:44.940+0000 7f2a03f03640 10 monclient: get_auth_request con 0x7f28cc0774c0 auth_method 0 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -87> 2024-04-03T03:59:44.940+0000 7f2a03f03640 10 monclient: get_auth_request con 0x7f29fc0d7b10 auth_method 0 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -86> 2024-04-03T03:59:44.944+0000 7f2a03702640 10 monclient: get_auth_request con 0x7f29fc0e7040 auth_method 0 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -85> 2024-04-03T03:59:44.944+0000 7f2a03f03640 0 -- 172.21.15.104:0/129464344 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x7f28cc0774c0 msgr2=0x7f28cc0798f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -84> 2024-04-03T03:59:44.944+0000 7f28e57fa640 1 client.6360.objecter ms_handle_reset 0x7f28cc0774c0 session 0x55d8280950f0 osd.2 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -83> 2024-04-03T03:59:44.944+0000 7f2a03f03640 10 monclient: get_auth_request con 0x55d8280995a0 auth_method 0 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -82> 2024-04-03T03:59:44.948+0000 7f2a02f01640 10 monclient: get_auth_request con 0x7f29fc0b8900 auth_method 0 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -81> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -80> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -79> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -78> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:45.091 INFO:tasks.workunit.client.0.smithi104.stderr: -77> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -76> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -75> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -74> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -73> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -72> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -71> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -70> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -69> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 zone default found 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -68> 2024-04-03T03:59:44.956+0000 7f2a05be7980 4 Realm: () 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -67> 2024-04-03T03:59:44.956+0000 7f2a05be7980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -66> 2024-04-03T03:59:44.956+0000 7f2a05be7980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -65> 2024-04-03T03:59:44.956+0000 7f2a05be7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:45.092 INFO:tasks.workunit.client.0.smithi104.stderr: -64> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 zonegroup default 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -63> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -62> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -61> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -60> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -59> 2024-04-03T03:59:44.956+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -58> 2024-04-03T03:59:44.960+0000 7f2a05be7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -57> 2024-04-03T03:59:44.960+0000 7f2a05be7980 20 started sync module instance, tier type = 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -56> 2024-04-03T03:59:44.960+0000 7f2a05be7980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -55> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=0 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -54> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=1 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -53> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=2 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -52> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=3 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -51> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=4 2024-04-03T03:59:45.093 INFO:tasks.workunit.client.0.smithi104.stderr: -50> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=5 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -49> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=6 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -48> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 add_watcher() i=7 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -47> 2024-04-03T03:59:44.976+0000 7f2a05be7980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -46> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding auth protocol: cephx 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -45> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding auth protocol: cephx 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -44> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding auth protocol: cephx 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -43> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -42> 2024-04-03T03:59:44.976+0000 7f28ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -41> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -40> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -39> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -38> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.094 INFO:tasks.workunit.client.0.smithi104.stderr: -37> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -36> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -35> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -34> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -33> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -32> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: crc 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -31> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 AuthRegistry(0x7ffff31d0230) adding con mode: secure 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -30> 2024-04-03T03:59:44.976+0000 7f2a05be7980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -29> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -28> 2024-04-03T03:59:44.976+0000 7f2a05be7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -27> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cache list hook 0x55d828075e60 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -26> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cache inspect hook 0x55d828075e60 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -25> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cache erase hook 0x55d828075e60 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -24> 2024-04-03T03:59:44.976+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command cache zap hook 0x55d828075e60 2024-04-03T03:59:45.095 INFO:tasks.workunit.client.0.smithi104.stderr: -23> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 note: GC not initialized 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -22> 2024-04-03T03:59:44.980+0000 7f28b97e2640 20 reqs_thread_entry: start 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -21> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command sync trace show hook 0x7f29fc004730 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -20> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command sync trace history hook 0x7f29fc004730 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -19> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command sync trace active hook 0x7f29fc004730 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -18> 2024-04-03T03:59:44.980+0000 7f2a05be7980 5 asok(0x55d827d9d210) register_command sync trace active_short hook 0x7f29fc004730 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -17> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -16> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 Filter name: none 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -15> 2024-04-03T03:59:44.980+0000 7f28b27fc640 20 reqs_thread_entry: start 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -14> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -13> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -12> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -11> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-04-03T03:59:45.096 INFO:tasks.workunit.client.0.smithi104.stderr: -10> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: -9> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 : miss 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: -8> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: -7> 2024-04-03T03:59:44.980+0000 7f2a05be7980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: -6> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 info.flags=0x17 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: -5> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to cache LRU end 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: -4> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: -3> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: -2> 2024-04-03T03:59:44.980+0000 7f2a05be7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: -1> 2024-04-03T03:59:44.988+0000 7f2a05be7980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2a05be7980 time 2024-04-03T03:59:44.991353+0000 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T03:59:45.097 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2a094bde1f] 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f2a094bdfd3] 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d826e535b1] 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 4: radosgw-admin(+0x8d807a) [0x55d826e5c07a] 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55d826e61203] 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 6: main() 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2a08327d90] 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 8: __libc_start_main() 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 9: _start() 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 0> 2024-04-03T03:59:44.988+0000 7f2a05be7980 -1 *** Caught signal (Aborted) ** 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7f2a05be7980 thread_name:radosgw-admin 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.098 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2a08340520] 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2a094bde79] 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f2a094bdfd3] 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d826e535b1] 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 8: radosgw-admin(+0x8d807a) [0x55d826e5c07a] 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x253) [0x55d826e61203] 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 10: main() 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2a08327d90] 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 12: __libc_start_main() 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: 13: _start() 2024-04-03T03:59:45.099 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr:--- logging levels --- 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 none 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 lockdep 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 context 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 crush 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_balancer 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_locker 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log_expire 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_migrator 2024-04-03T03:59:45.100 INFO:tasks.workunit.client.0.smithi104.stderr: 3/ 5 mds_quiesce 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 buffer 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 timer 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 filer 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 striper 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 objecter 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rados 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_mirror 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_replay 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_pwl 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 journaler 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objectcacher 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 immutable_obj_cache 2024-04-03T03:59:45.101 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 client 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 osd 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 optracker 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objclass 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 filestore 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 journal 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 ms 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mon 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 0/10 monc 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 paxos 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 tp 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 auth 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 crypto 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 finisher 2024-04-03T03:59:45.102 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 reserver 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 heartbeatmap 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 perfcounter 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 20/20 rgw 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_sync 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_datacache 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_access 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_dbstore 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_flight 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_lifecycle 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_notification 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 javaclient 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 asok 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 throttle 2024-04-03T03:59:45.103 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 refs 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 compressor 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluestore 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluefs 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 bdev 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 kstore 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 4/ 5 rocksdb 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 fuse 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 2/ 5 mgr 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mgrc 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 dpdk 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 eventtrace 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 prioritycache 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 test 2024-04-03T03:59:45.104 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephfs_mirror 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephsqlite 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 crimson_interrupt 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_onode 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_odata 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_omap 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_tm 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_t 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cleaner 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_epm 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_lba 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cache 2024-04-03T03:59:45.105 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_journal 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_device 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_backref 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 alienstore 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mclock 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cyanstore 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 ceph_exporter 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 memstore 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 trace 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: -2/-2 (syslog threshold) 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 99/99 (stderr threshold) 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28b27fc640 / http_manager 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28b97e2640 / http_manager 2024-04-03T03:59:45.106 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28ba7e4640 / rgw_dt_lg_renew 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28e57fa640 / ms_dispatch 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28e6ffd640 / io_context_pool 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28ed602640 / ms_dispatch 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28efe07640 / ms_dispatch 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f28f160a640 / io_context_pool 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a02f01640 / msgr-worker-2 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a03702640 / msgr-worker-1 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a03f03640 / msgr-worker-0 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a04704640 / io_context_pool 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: 7f2a05be7980 / radosgw-admin 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: max_recent 500 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: max_new 1000 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr: log_file /var/lib/ceph/crash/2024-04-03T03:59:44.993562Z_ae45f054-a1e3-4d2d-8327-46f92cc1283c/log 2024-04-03T03:59:45.107 INFO:tasks.workunit.client.0.smithi104.stderr:--- end dump of recent events --- 2024-04-03T03:59:45.108 INFO:tasks.workunit.client.0.smithi104.stderr:Aborted 2024-04-03T03:59:45.108 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.068+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.068+0000 7f5df2398980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.068+0000 7f5df2398980 20 realm 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.068+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.068+0000 7f5df2398980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.068+0000 7f5df2398980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.068+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.072+0000 7f5df2398980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.072+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.113 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.072+0000 7f5df2398980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.072+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.072+0000 7f5df2398980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.072+0000 7f5df2398980 20 searching for the correct realm 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.080+0000 7f5defeb3640 0 -- 172.21.15.104:0/4212562140 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x5638372f8480 msgr2=0x5638372fa940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.084+0000 7f5de7fff640 0 -- 172.21.15.104:0/4212562140 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f5de801a040 msgr2=0x7f5de8070130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 zone default found 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 4 Realm: () 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 zonegroup default 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.092+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.096+0000 7f5df2398980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.096+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.115 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.096+0000 7f5df2398980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.096+0000 7f5df2398980 20 started sync module instance, tier type = 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.096+0000 7f5df2398980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.108+0000 7f5df2398980 20 add_watcher() i=0 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.108+0000 7f5df2398980 20 add_watcher() i=1 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.108+0000 7f5df2398980 20 add_watcher() i=2 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.108+0000 7f5df2398980 20 add_watcher() i=3 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.108+0000 7f5df2398980 20 add_watcher() i=4 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.108+0000 7f5df2398980 20 add_watcher() i=5 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.108+0000 7f5df2398980 20 add_watcher() i=6 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5df2398980 20 add_watcher() i=7 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5df2398980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5df2398980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:45.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5df2398980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5df2398980 5 note: GC not initialized 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5ca4fe1640 20 reqs_thread_entry: start 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5df2398980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5df2398980 20 Filter name: none 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5c1e7fc640 20 reqs_thread_entry: start 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.112+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.116+0000 7f5df2398980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.116+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.116+0000 7f5df2398980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.116+0000 7f5df2398980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.116+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.116+0000 7f5df2398980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.116+0000 7f5df2398980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.116+0000 7f5df2398980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:45.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.116+0000 7f5df2398980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T03:59:45.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.120+0000 7f5ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:45.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.124+0000 7f5df2398980 20 remove_watcher() i=0 2024-04-03T03:59:45.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.124+0000 7f5df2398980 2 removed watcher, disabling cache 2024-04-03T03:59:45.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.128+0000 7f5df2398980 20 remove_watcher() i=1 2024-04-03T03:59:45.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.128+0000 7f5df2398980 20 remove_watcher() i=2 2024-04-03T03:59:45.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.132+0000 7f5df2398980 20 remove_watcher() i=3 2024-04-03T03:59:45.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.132+0000 7f5df2398980 20 remove_watcher() i=4 2024-04-03T03:59:45.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.132+0000 7f5df2398980 20 remove_watcher() i=5 2024-04-03T03:59:45.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.136+0000 7f5df2398980 20 remove_watcher() i=6 2024-04-03T03:59:45.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.136+0000 7f5df2398980 20 remove_watcher() i=7 2024-04-03T03:59:45.131 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.131 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T03:59:45.131 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-set-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T03:59:45.131 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T03:59:45.132 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:45.132 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:45.168 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T03:59:45.168 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T03:59:45.228 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T03:59:45.264 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T03:59:45.264 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T03:59:45.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 realm 2024-04-03T03:59:45.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T03:59:45.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:45.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.328+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.332+0000 7f266ad4e980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T03:59:45.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.332+0000 7f266ad4e980 20 searching for the correct realm 2024-04-03T03:59:45.316 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.336+0000 7f266906a640 0 -- 172.21.15.104:0/4203969942 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f266001a050 msgr2=0x7f26600309b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:45.324 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.344+0000 7f2668068640 0 -- 172.21.15.104:0/4203969942 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f2660030280 msgr2=0x7f2660062600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T03:59:45.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.560+0000 7f266ad4e980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T03:59:45.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.560+0000 7f266ad4e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T03:59:45.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.560+0000 7f266ad4e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T03:59:45.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.560+0000 7f266ad4e980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T03:59:45.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.560+0000 7f266ad4e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T03:59:45.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.560+0000 7f266ad4e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T03:59:45.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.560+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.560+0000 7f266ad4e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.560+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T03:59:45.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T03:59:45.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 zone default found 2024-04-03T03:59:45.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 4 Realm: () 2024-04-03T03:59:45.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T03:59:45.544 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T03:59:45.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T03:59:45.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 zonegroup default 2024-04-03T03:59:45.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.545 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T03:59:45.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 started sync module instance, tier type = 2024-04-03T03:59:45.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.564+0000 7f266ad4e980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T03:59:45.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.588+0000 7f266ad4e980 20 add_watcher() i=0 2024-04-03T03:59:45.568 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.588+0000 7f266ad4e980 20 add_watcher() i=1 2024-04-03T03:59:45.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.588+0000 7f266ad4e980 20 add_watcher() i=2 2024-04-03T03:59:45.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.588+0000 7f266ad4e980 20 add_watcher() i=3 2024-04-03T03:59:45.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.588+0000 7f266ad4e980 20 add_watcher() i=4 2024-04-03T03:59:45.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.588+0000 7f266ad4e980 20 add_watcher() i=5 2024-04-03T03:59:45.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.588+0000 7f266ad4e980 20 add_watcher() i=6 2024-04-03T03:59:45.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.588+0000 7f266ad4e980 20 add_watcher() i=7 2024-04-03T03:59:45.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.588+0000 7f266ad4e980 2 all 8 watchers are set, enabling cache 2024-04-03T03:59:45.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.592+0000 7f251efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:45.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.592+0000 7f266ad4e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T03:59:45.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.592+0000 7f266ad4e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T03:59:45.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 5 note: GC not initialized 2024-04-03T03:59:45.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f251dfdb640 20 reqs_thread_entry: start 2024-04-03T03:59:45.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 20 init_complete bucket index max shards: 11 2024-04-03T03:59:45.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 20 Filter name: none 2024-04-03T03:59:45.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f248f7fe640 20 reqs_thread_entry: start 2024-04-03T03:59:45.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-04-03T03:59:45.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T03:59:45.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-04-03T03:59:45.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-04-03T03:59:45.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 : miss 2024-04-03T03:59:45.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 20 rados->read ofs=0 len=0 2024-04-03T03:59:45.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T03:59:45.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 info.flags=0x17 2024-04-03T03:59:45.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to cache LRU end 2024-04-03T03:59:45.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T03:59:45.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T03:59:45.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.596+0000 7f266ad4e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 2024-04-03T03:59:45.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.600+0000 7f266ad4e980 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to be held by another RGW process; skipping for now 2024-04-03T03:59:45.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.600+0000 7f251efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T03:59:45.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.604+0000 7f266ad4e980 20 remove_watcher() i=0 2024-04-03T03:59:45.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.608+0000 7f266ad4e980 2 removed watcher, disabling cache 2024-04-03T03:59:45.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.608+0000 7f266ad4e980 20 remove_watcher() i=1 2024-04-03T03:59:45.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.612+0000 7f266ad4e980 20 remove_watcher() i=2 2024-04-03T03:59:45.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.612+0000 7f266ad4e980 20 remove_watcher() i=3 2024-04-03T03:59:45.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.612+0000 7f266ad4e980 20 remove_watcher() i=4 2024-04-03T03:59:45.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.616+0000 7f266ad4e980 20 remove_watcher() i=5 2024-04-03T03:59:45.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.616+0000 7f266ad4e980 20 remove_watcher() i=6 2024-04-03T03:59:45.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T03:59:45.620+0000 7f266ad4e980 20 remove_watcher() i=7 2024-04-03T03:59:45.618 INFO:tasks.workunit.client.0.smithi104.stderr:waiting 30 seconds for reshard lock to expire... 2024-04-03T04:00:15.648 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T04:00:15.684 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:15.685 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:15.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.748+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.748+0000 7efdfed75980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:15.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.748+0000 7efdfed75980 20 realm 2024-04-03T04:00:15.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.748+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.752+0000 7efdfed75980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:15.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.752+0000 7efdfed75980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:15.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.752+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.752+0000 7efdfed75980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:15.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.752+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.752+0000 7efdfed75980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:15.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.752+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.752+0000 7efdfed75980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:15.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.752+0000 7efdfed75980 20 searching for the correct realm 2024-04-03T04:00:15.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.756+0000 7efdfc08f640 0 -- 172.21.15.104:0/2701534931 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7efdf40c5040 msgr2=0x7efdf40f5950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:15.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.968+0000 7efdfd091640 0 -- 172.21.15.104:0/2701534931 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x5577868ce7a0 msgr2=0x5577868d0b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:15.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:15.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:15.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:15.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:15.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:15.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:15.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:15.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:15.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.988+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:15.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 zone default found 2024-04-03T04:00:15.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 4 Realm: () 2024-04-03T04:00:15.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:15.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:15.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:15.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 zonegroup default 2024-04-03T04:00:15.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:15.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:15.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:15.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:15.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 started sync module instance, tier type = 2024-04-03T04:00:15.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:15.992+0000 7efdfed75980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:15.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.016+0000 7efdfed75980 20 add_watcher() i=0 2024-04-03T04:00:15.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.016+0000 7efdfed75980 20 add_watcher() i=1 2024-04-03T04:00:15.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.016+0000 7efdfed75980 20 add_watcher() i=2 2024-04-03T04:00:15.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.016+0000 7efdfed75980 20 add_watcher() i=3 2024-04-03T04:00:15.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.016+0000 7efdfed75980 20 add_watcher() i=4 2024-04-03T04:00:15.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.016+0000 7efdfed75980 20 add_watcher() i=5 2024-04-03T04:00:15.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.016+0000 7efdfed75980 20 add_watcher() i=6 2024-04-03T04:00:15.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.016+0000 7efdfed75980 20 add_watcher() i=7 2024-04-03T04:00:15.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.016+0000 7efdfed75980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:16.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.020+0000 7efcb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:16.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.020+0000 7efdfed75980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:16.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.020+0000 7efdfed75980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:16.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.020+0000 7efdfed75980 5 note: GC not initialized 2024-04-03T04:00:16.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.020+0000 7efcb27e4640 20 reqs_thread_entry: start 2024-04-03T04:00:16.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.020+0000 7efdfed75980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:16.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 20 Filter name: none 2024-04-03T04:00:16.005 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efcab7fe640 20 reqs_thread_entry: start 2024-04-03T04:00:16.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-04-03T04:00:16.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T04:00:16.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-04-03T04:00:16.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-04-03T04:00:16.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 : miss 2024-04-03T04:00:16.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T04:00:16.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 info.flags=0x17 2024-04-03T04:00:16.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to cache LRU end 2024-04-03T04:00:16.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:00:16.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:16.008 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.024+0000 7efdfed75980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 2024-04-03T04:00:16.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.032+0000 7efdfed75980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 info.flags=0x17 2024-04-03T04:00:16.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.032+0000 7efdfed75980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to cache LRU end 2024-04-03T04:00:16.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.032+0000 7efdfed75980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:16.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.032+0000 7efdfed75980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21, ofs0, ns] 2024-04-03T04:00:16.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.032+0000 7efcd37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 93971846882256 notifier 6417 bl.length()=887 2024-04-03T04:00:16.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.032+0000 7efcd37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 info.flags=0x17 2024-04-03T04:00:16.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.032+0000 7efcd37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to cache LRU end 2024-04-03T04:00:16.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.032+0000 7efcd37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:16.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.036+0000 7efdfed75980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21]): orig_sources= new_sources= 2024-04-03T04:00:16.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.036+0000 7efdfed75980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21]): potential sources added=[] removed=[] 2024-04-03T04:00:16.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.036+0000 7efdfed75980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21]): orig_dests= new_dests= 2024-04-03T04:00:16.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.036+0000 7efdfed75980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21]): potential dests added=[] removed=[] 2024-04-03T04:00:16.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.0 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.0 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.1 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.1 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.2 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.2 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.3 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.3 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.4 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.4 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.5 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.5 2024-04-03T04:00:16.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.6 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.6 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.7 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.7 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.8 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.8 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.9 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.9 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.10 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.10 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.11 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1.11 2024-04-03T04:00:16.023 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.0 2024-04-03T04:00:16.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.1 2024-04-03T04:00:16.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.040+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.2 2024-04-03T04:00:16.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.044+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.3 2024-04-03T04:00:16.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.044+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.4 2024-04-03T04:00:16.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.044+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.5 2024-04-03T04:00:16.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.044+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.6 2024-04-03T04:00:16.026 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.044+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.7 2024-04-03T04:00:16.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.044+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.8 2024-04-03T04:00:16.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.048+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.9 2024-04-03T04:00:16.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.048+0000 7efdfed75980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21.10 2024-04-03T04:00:16.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.052+0000 7efdfed75980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 : hit (requested=0x17, cached=0x17) 2024-04-03T04:00:16.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.052+0000 7efdfed75980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 2024-04-03T04:00:16.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efdfed75980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 info.flags=0x17 2024-04-03T04:00:16.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efdfed75980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to cache LRU end 2024-04-03T04:00:16.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efdfed75980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:16.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efdfed75980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21, ofs0, ns] 2024-04-03T04:00:16.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efcd37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562388 cookie 93971846882256 notifier 6417 bl.length()=855 2024-04-03T04:00:16.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efcd37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 info.flags=0x17 2024-04-03T04:00:16.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efcd37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 to cache LRU end 2024-04-03T04:00:16.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efcd37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:16.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efdfed75980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21]): orig_sources= new_sources= 2024-04-03T04:00:16.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efdfed75980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21]): potential sources added=[] removed=[] 2024-04-03T04:00:16.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efdfed75980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21]): orig_dests= new_dests= 2024-04-03T04:00:16.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.056+0000 7efdfed75980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21]): potential dests added=[] removed=[] 2024-04-03T04:00:16.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.064+0000 7efdfed75980 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2024-04-03T04:00:16.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.068+0000 7efcb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:16.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.072+0000 7efdfed75980 20 remove_watcher() i=0 2024-04-03T04:00:16.053 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.072+0000 7efdfed75980 2 removed watcher, disabling cache 2024-04-03T04:00:16.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.076+0000 7efdfed75980 20 remove_watcher() i=1 2024-04-03T04:00:16.058 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.076+0000 7efdfed75980 20 remove_watcher() i=2 2024-04-03T04:00:16.060 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.080+0000 7efdfed75980 20 remove_watcher() i=3 2024-04-03T04:00:16.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.080+0000 7efdfed75980 20 remove_watcher() i=4 2024-04-03T04:00:16.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.084+0000 7efdfed75980 20 remove_watcher() i=5 2024-04-03T04:00:16.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.084+0000 7efdfed75980 20 remove_watcher() i=6 2024-04-03T04:00:16.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.084+0000 7efdfed75980 20 remove_watcher() i=7 2024-04-03T04:00:16.083 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-04-03T04:00:16.112 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:16.112 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:16.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.176+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.176+0000 7f34e462e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:16.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.176+0000 7f34e462e980 20 realm 2024-04-03T04:00:16.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.176+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.176+0000 7f34e462e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:16.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.176+0000 7f34e462e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:16.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.176+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.176+0000 7f34e462e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:16.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.176+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.161 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.180+0000 7f34e462e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:16.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.180+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.180+0000 7f34e462e980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:16.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.180+0000 7f34e462e980 20 searching for the correct realm 2024-04-03T04:00:16.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.180+0000 7f34e1948640 0 -- 172.21.15.104:0/2162340717 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f34d40c5040 msgr2=0x7f34d40d6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:16.375 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.392+0000 7f34e294a640 0 -- 172.21.15.104:0/2162340717 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x55ca0a078230 msgr2=0x55ca0a07a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:16.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:16.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:16.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:16.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:16.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:16.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:16.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:16.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:16.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.412+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:16.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 zone default found 2024-04-03T04:00:16.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 4 Realm: () 2024-04-03T04:00:16.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:16.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:16.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:16.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 zonegroup default 2024-04-03T04:00:16.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:16.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:16.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:16.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 started sync module instance, tier type = 2024-04-03T04:00:16.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.416+0000 7f34e462e980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:16.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.440+0000 7f34e462e980 20 add_watcher() i=0 2024-04-03T04:00:16.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.440+0000 7f34e462e980 20 add_watcher() i=1 2024-04-03T04:00:16.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.440+0000 7f34e462e980 20 add_watcher() i=2 2024-04-03T04:00:16.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.440+0000 7f34e462e980 20 add_watcher() i=3 2024-04-03T04:00:16.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.440+0000 7f34e462e980 20 add_watcher() i=4 2024-04-03T04:00:16.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.440+0000 7f34e462e980 20 add_watcher() i=5 2024-04-03T04:00:16.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.440+0000 7f34e462e980 20 add_watcher() i=6 2024-04-03T04:00:16.422 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.440+0000 7f34e462e980 20 add_watcher() i=7 2024-04-03T04:00:16.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.440+0000 7f34e462e980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:16.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.444+0000 7f33997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:16.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:16.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:16.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 5 note: GC not initialized 2024-04-03T04:00:16.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f33937fe640 20 reqs_thread_entry: start 2024-04-03T04:00:16.428 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:16.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 Filter name: none 2024-04-03T04:00:16.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f33917fa640 20 reqs_thread_entry: start 2024-04-03T04:00:16.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T04:00:16.430 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T04:00:16.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:16.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.448+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.452+0000 7f34e462e980 20 rados_obj.operate() r=0 bl.length=194 2024-04-03T04:00:16.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.452+0000 7f34e462e980 20 rados->read ofs=0 len=0 2024-04-03T04:00:16.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.452+0000 7f34e462e980 20 rados_obj.operate() r=0 bl.length=378 2024-04-03T04:00:16.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.452+0000 7f34e462e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:16.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.456+0000 7f33997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:16.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.460+0000 7f34e462e980 20 remove_watcher() i=0 2024-04-03T04:00:16.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.460+0000 7f34e462e980 2 removed watcher, disabling cache 2024-04-03T04:00:16.442 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.460+0000 7f34e462e980 20 remove_watcher() i=1 2024-04-03T04:00:16.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.464+0000 7f34e462e980 20 remove_watcher() i=2 2024-04-03T04:00:16.447 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.464+0000 7f34e462e980 20 remove_watcher() i=3 2024-04-03T04:00:16.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.468+0000 7f34e462e980 20 remove_watcher() i=4 2024-04-03T04:00:16.450 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.468+0000 7f34e462e980 20 remove_watcher() i=5 2024-04-03T04:00:16.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.472+0000 7f34e462e980 20 remove_watcher() i=6 2024-04-03T04:00:16.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:16.472+0000 7f34e462e980 20 remove_watcher() i=7 2024-04-03T04:00:16.467 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:16.467 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:00:16.467 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-set-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-04-03T04:00:16.467 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:16.468 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:16.469 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:16.489 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:16.489 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:17.040 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:17.041 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:17.412 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-04-03T04:00:17.412 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:17.415 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:17.415 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:17.541 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:17.542 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:17.623 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:17.623 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:17.711 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:17.711 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:17.800 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:17.800 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:17.898 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:17.898 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:17.987 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:17.987 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.073 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.073 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.161 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.162 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.251 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.251 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.343 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.343 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.437 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.437 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.528 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.528 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.617 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.617 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.703 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.703 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.796 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.796 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.885 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.885 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:18.976 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:18.976 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:19.066 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:19.066 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:19.159 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:19.159 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:19.248 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:19.248 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:19.335 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:19.335 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:19.423 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-04-03T04:00:19.455 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:19.455 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:19.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.520+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.520+0000 7f40e7a53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.501 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.520+0000 7f40e7a53980 20 realm 2024-04-03T04:00:19.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.520+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.520+0000 7f40e7a53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.520+0000 7f40e7a53980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:19.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.520+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.520+0000 7f40e7a53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.520+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.524+0000 7f40e7a53980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:19.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.524+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.524+0000 7f40e7a53980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:19.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.524+0000 7f40e7a53980 20 searching for the correct realm 2024-04-03T04:00:19.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.528+0000 7f40e5d6f640 0 -- 172.21.15.104:0/160074850 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f40e00e4450 msgr2=0x7f40e00e4890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:19.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.536+0000 7f40e4d6d640 0 -- 172.21.15.104:0/160074850 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f40e00f9a90 msgr2=0x7f40e00d73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:19.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:19.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:19.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:19.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:19.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:19.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:19.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:19.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.752+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:19.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 zone default found 2024-04-03T04:00:19.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 4 Realm: () 2024-04-03T04:00:19.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:19.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:19.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:19.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 zonegroup default 2024-04-03T04:00:19.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.736 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.737 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 started sync module instance, tier type = 2024-04-03T04:00:19.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.756+0000 7f40e7a53980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:19.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.780+0000 7f40e7a53980 20 add_watcher() i=0 2024-04-03T04:00:19.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.780+0000 7f40e7a53980 20 add_watcher() i=1 2024-04-03T04:00:19.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.780+0000 7f40e7a53980 20 add_watcher() i=2 2024-04-03T04:00:19.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.780+0000 7f40e7a53980 20 add_watcher() i=3 2024-04-03T04:00:19.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.780+0000 7f40e7a53980 20 add_watcher() i=4 2024-04-03T04:00:19.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.780+0000 7f40e7a53980 20 add_watcher() i=5 2024-04-03T04:00:19.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.780+0000 7f40e7a53980 20 add_watcher() i=6 2024-04-03T04:00:19.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.780+0000 7f40e7a53980 20 add_watcher() i=7 2024-04-03T04:00:19.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.780+0000 7f40e7a53980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:19.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.784+0000 7f3f9bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:19.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.784+0000 7f40e7a53980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:19.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.784+0000 7f40e7a53980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:19.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f40e7a53980 5 note: GC not initialized 2024-04-03T04:00:19.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f3f9afe5640 20 reqs_thread_entry: start 2024-04-03T04:00:19.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f40e7a53980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:19.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f40e7a53980 20 Filter name: none 2024-04-03T04:00:19.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f3f98fe1640 20 reqs_thread_entry: start 2024-04-03T04:00:19.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f40e7a53980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:19.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f40e7a53980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f40e7a53980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.788+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.792+0000 7f40e7a53980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:19.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.792+0000 7f40e7a53980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.792+0000 7f40e7a53980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:19.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.792+0000 7f40e7a53980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:19.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.792+0000 7f3f9bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:19.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.800+0000 7f40e7a53980 20 remove_watcher() i=0 2024-04-03T04:00:19.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.800+0000 7f40e7a53980 2 removed watcher, disabling cache 2024-04-03T04:00:19.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.800+0000 7f40e7a53980 20 remove_watcher() i=1 2024-04-03T04:00:19.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.804+0000 7f40e7a53980 20 remove_watcher() i=2 2024-04-03T04:00:19.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.804+0000 7f40e7a53980 20 remove_watcher() i=3 2024-04-03T04:00:19.788 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.808+0000 7f40e7a53980 20 remove_watcher() i=4 2024-04-03T04:00:19.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.808+0000 7f40e7a53980 20 remove_watcher() i=5 2024-04-03T04:00:19.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.808+0000 7f40e7a53980 20 remove_watcher() i=6 2024-04-03T04:00:19.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.812+0000 7f40e7a53980 20 remove_watcher() i=7 2024-04-03T04:00:19.806 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:19.806 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:00:19.806 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-block-writes id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:00:19.806 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:19.806 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-04-03T04:00:19.843 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:19.843 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:19.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.904+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 realm 2024-04-03T04:00:19.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:19.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:19.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:19.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:19.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:19.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.908+0000 7efcdee20980 20 searching for the correct realm 2024-04-03T04:00:19.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.912+0000 7efcdd13c640 0 -- 172.21.15.104:0/1512002156 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7efcd403d040 msgr2=0x7efcd403d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:00:19.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:19.920+0000 7efcdc13a640 0 -- 172.21.15.104:0/1512002156 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7efcd404e040 msgr2=0x7efcd404e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:20.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.136+0000 7efcdee20980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:20.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.136+0000 7efcdee20980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:20.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.136+0000 7efcdee20980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:20.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.136+0000 7efcdee20980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:20.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.136+0000 7efcdee20980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:20.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.136+0000 7efcdee20980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:20.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.136+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:20.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:20.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 zone default found 2024-04-03T04:00:20.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 4 Realm: () 2024-04-03T04:00:20.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:20.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:20.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:20.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 zonegroup default 2024-04-03T04:00:20.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.140+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.144+0000 7efcdee20980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.144+0000 7efcdee20980 20 started sync module instance, tier type = 2024-04-03T04:00:20.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.144+0000 7efcdee20980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:20.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.164+0000 7efcdee20980 20 add_watcher() i=0 2024-04-03T04:00:20.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.164+0000 7efcdee20980 20 add_watcher() i=1 2024-04-03T04:00:20.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.164+0000 7efcdee20980 20 add_watcher() i=2 2024-04-03T04:00:20.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.164+0000 7efcdee20980 20 add_watcher() i=3 2024-04-03T04:00:20.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.164+0000 7efcdee20980 20 add_watcher() i=4 2024-04-03T04:00:20.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.164+0000 7efcdee20980 20 add_watcher() i=5 2024-04-03T04:00:20.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.164+0000 7efcdee20980 20 add_watcher() i=6 2024-04-03T04:00:20.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.168+0000 7efcdee20980 20 add_watcher() i=7 2024-04-03T04:00:20.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.168+0000 7efcdee20980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:20.150 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.168+0000 7efb92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:20.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.168+0000 7efcdee20980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:20.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.168+0000 7efcdee20980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:20.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 5 note: GC not initialized 2024-04-03T04:00:20.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efb91fe3640 20 reqs_thread_entry: start 2024-04-03T04:00:20.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:20.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 20 Filter name: none 2024-04-03T04:00:20.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efb037fe640 20 reqs_thread_entry: start 2024-04-03T04:00:20.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-04-03T04:00:20.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:20.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-04-03T04:00:20.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-04-03T04:00:20.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 : miss 2024-04-03T04:00:20.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:20.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:20.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:20.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:00:20.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:20.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.172+0000 7efcdee20980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 2024-04-03T04:00:20.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:20.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:20.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:20.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22, ofs0, ns] 2024-04-03T04:00:20.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efbb3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562410 cookie 94528981688080 notifier 6474 bl.length()=877 2024-04-03T04:00:20.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efbb3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:20.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efbb3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:20.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efbb3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:20.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): orig_sources= new_sources= 2024-04-03T04:00:20.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): potential sources added=[] removed=[] 2024-04-03T04:00:20.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): orig_dests= new_dests= 2024-04-03T04:00:20.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): potential dests added=[] removed=[] 2024-04-03T04:00:20.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 -1 Injecting error=-5 at location=block_writes 2024-04-03T04:00:20.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.184+0000 7efcdee20980 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-04-03T04:00:20.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.192+0000 7efcdee20980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 : hit (requested=0x17, cached=0x17) 2024-04-03T04:00:20.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.192+0000 7efcdee20980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 2024-04-03T04:00:20.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.192+0000 7efcdee20980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:20.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.192+0000 7efcdee20980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:20.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.192+0000 7efcdee20980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:20.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.192+0000 7efcdee20980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22, ofs0, ns] 2024-04-03T04:00:20.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.196+0000 7efbb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562411 cookie 94528981688080 notifier 6474 bl.length()=845 2024-04-03T04:00:20.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.196+0000 7efbb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:20.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.196+0000 7efbb37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:20.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.196+0000 7efbb37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:20.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.196+0000 7efcdee20980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): orig_sources= new_sources= 2024-04-03T04:00:20.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.196+0000 7efcdee20980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): potential sources added=[] removed=[] 2024-04-03T04:00:20.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.196+0000 7efcdee20980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): orig_dests= new_dests= 2024-04-03T04:00:20.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.196+0000 7efcdee20980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): potential dests added=[] removed=[] 2024-04-03T04:00:20.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.200+0000 7efb92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:20.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.204+0000 7efcdee20980 20 remove_watcher() i=0 2024-04-03T04:00:20.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.204+0000 7efcdee20980 2 removed watcher, disabling cache 2024-04-03T04:00:20.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.208+0000 7efcdee20980 20 remove_watcher() i=1 2024-04-03T04:00:20.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.208+0000 7efcdee20980 20 remove_watcher() i=2 2024-04-03T04:00:20.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.212+0000 7efcdee20980 20 remove_watcher() i=3 2024-04-03T04:00:20.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.212+0000 7efcdee20980 20 remove_watcher() i=4 2024-04-03T04:00:20.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.216+0000 7efcdee20980 20 remove_watcher() i=5 2024-04-03T04:00:20.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.216+0000 7efcdee20980 20 remove_watcher() i=6 2024-04-03T04:00:20.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.216+0000 7efcdee20980 20 remove_watcher() i=7 2024-04-03T04:00:20.214 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-04-03T04:00:20.244 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:20.244 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:20.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.304+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 20 realm 2024-04-03T04:00:20.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:20.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:20.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.308+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.312+0000 7f69ca5b7980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:20.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.312+0000 7f69ca5b7980 20 searching for the correct realm 2024-04-03T04:00:20.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.520+0000 7f69c88d3640 0 -- 172.21.15.104:0/157755668 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f69c0037b70 msgr2=0x7f69c0022960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:20.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.532+0000 7f69c78d1640 0 -- 172.21.15.104:0/157755668 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f69c0053460 msgr2=0x7f69c00538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:20.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.748+0000 7f69ca5b7980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:20.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.748+0000 7f69ca5b7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:20.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.748+0000 7f69ca5b7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:20.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.748+0000 7f69ca5b7980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:20.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.748+0000 7f69ca5b7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:20.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.748+0000 7f69ca5b7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:20.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.748+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.748+0000 7f69ca5b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.748+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:20.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:20.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 zone default found 2024-04-03T04:00:20.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 4 Realm: () 2024-04-03T04:00:20.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:20.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:20.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:20.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 zonegroup default 2024-04-03T04:00:20.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.733 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:20.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 started sync module instance, tier type = 2024-04-03T04:00:20.734 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.752+0000 7f69ca5b7980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:20.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.772+0000 7f69ca5b7980 20 add_watcher() i=0 2024-04-03T04:00:20.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.772+0000 7f69ca5b7980 20 add_watcher() i=1 2024-04-03T04:00:20.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.772+0000 7f69ca5b7980 20 add_watcher() i=2 2024-04-03T04:00:20.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.772+0000 7f69ca5b7980 20 add_watcher() i=3 2024-04-03T04:00:20.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.772+0000 7f69ca5b7980 20 add_watcher() i=4 2024-04-03T04:00:20.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.772+0000 7f69ca5b7980 20 add_watcher() i=5 2024-04-03T04:00:20.755 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.772+0000 7f69ca5b7980 20 add_watcher() i=6 2024-04-03T04:00:20.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.776+0000 7f69ca5b7980 20 add_watcher() i=7 2024-04-03T04:00:20.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.776+0000 7f69ca5b7980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:20.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.780+0000 7f687efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:20.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.780+0000 7f69ca5b7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:20.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.780+0000 7f69ca5b7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:20.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.780+0000 7f69ca5b7980 5 note: GC not initialized 2024-04-03T04:00:20.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f687dfdb640 20 reqs_thread_entry: start 2024-04-03T04:00:20.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:20.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 Filter name: none 2024-04-03T04:00:20.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f67ef7fe640 20 reqs_thread_entry: start 2024-04-03T04:00:20.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:20.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:20.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:20.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:20.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.784+0000 7f69ca5b7980 20 rados->read ofs=0 len=0 2024-04-03T04:00:20.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.788+0000 7f69ca5b7980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:20.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.788+0000 7f69ca5b7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:20.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.788+0000 7f687efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:20.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.796+0000 7f69ca5b7980 20 remove_watcher() i=0 2024-04-03T04:00:20.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.796+0000 7f69ca5b7980 2 removed watcher, disabling cache 2024-04-03T04:00:20.778 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.796+0000 7f69ca5b7980 20 remove_watcher() i=1 2024-04-03T04:00:20.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.800+0000 7f69ca5b7980 20 remove_watcher() i=2 2024-04-03T04:00:20.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.800+0000 7f69ca5b7980 20 remove_watcher() i=3 2024-04-03T04:00:20.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.804+0000 7f69ca5b7980 20 remove_watcher() i=4 2024-04-03T04:00:20.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.804+0000 7f69ca5b7980 20 remove_watcher() i=5 2024-04-03T04:00:20.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.808+0000 7f69ca5b7980 20 remove_watcher() i=6 2024-04-03T04:00:20.789 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:20.808+0000 7f69ca5b7980 20 remove_watcher() i=7 2024-04-03T04:00:20.812 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:20.812 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:00:20.812 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-block-writes id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:00:20.812 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:20.813 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:20.814 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:20.859 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:20.859 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:20.937 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T04:00:20.972 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:20.972 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:21.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.036+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.036+0000 7fe09d716980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.036+0000 7fe09d716980 20 realm 2024-04-03T04:00:21.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.036+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.036+0000 7fe09d716980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.036+0000 7fe09d716980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:21.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.036+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.036+0000 7fe09d716980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.036+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.040+0000 7fe09d716980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:21.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.040+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.040+0000 7fe09d716980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:21.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.040+0000 7fe09d716980 20 searching for the correct realm 2024-04-03T04:00:21.024 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.044+0000 7fe09ba32640 0 -- 172.21.15.104:0/3857584644 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fe094008050 msgr2=0x7fe094056300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:21.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.260+0000 7fe09aa30640 0 -- 172.21.15.104:0/3857584644 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fe094036040 msgr2=0x7fe094018000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:21.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.476+0000 7fe09d716980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:21.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.476+0000 7fe09d716980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:21.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.476+0000 7fe09d716980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:21.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.476+0000 7fe09d716980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:21.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.476+0000 7fe09d716980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:21.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.476+0000 7fe09d716980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:21.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.476+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.476+0000 7fe09d716980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.476+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:21.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:21.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 zone default found 2024-04-03T04:00:21.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 4 Realm: () 2024-04-03T04:00:21.460 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:21.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:21.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:21.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 zonegroup default 2024-04-03T04:00:21.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.461 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 started sync module instance, tier type = 2024-04-03T04:00:21.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.480+0000 7fe09d716980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:21.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.504+0000 7fe09d716980 20 add_watcher() i=0 2024-04-03T04:00:21.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.504+0000 7fe09d716980 20 add_watcher() i=1 2024-04-03T04:00:21.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.504+0000 7fe09d716980 20 add_watcher() i=2 2024-04-03T04:00:21.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.504+0000 7fe09d716980 20 add_watcher() i=3 2024-04-03T04:00:21.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.504+0000 7fe09d716980 20 add_watcher() i=4 2024-04-03T04:00:21.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.504+0000 7fe09d716980 20 add_watcher() i=5 2024-04-03T04:00:21.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.504+0000 7fe09d716980 20 add_watcher() i=6 2024-04-03T04:00:21.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.508+0000 7fe09d716980 20 add_watcher() i=7 2024-04-03T04:00:21.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.508+0000 7fe09d716980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:21.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.512+0000 7fdf51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:21.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.512+0000 7fe09d716980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:21.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.512+0000 7fe09d716980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:21.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.512+0000 7fe09d716980 5 note: GC not initialized 2024-04-03T04:00:21.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.512+0000 7fdf50fe1640 20 reqs_thread_entry: start 2024-04-03T04:00:21.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.512+0000 7fe09d716980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:21.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 20 Filter name: none 2024-04-03T04:00:21.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fdeca7fc640 20 reqs_thread_entry: start 2024-04-03T04:00:21.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-04-03T04:00:21.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:21.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-04-03T04:00:21.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-04-03T04:00:21.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 : miss 2024-04-03T04:00:21.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.497 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:21.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:21.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:21.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:00:21.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:21.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.516+0000 7fe09d716980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 2024-04-03T04:00:21.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.528+0000 7fe09d716980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:21.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.528+0000 7fe09d716980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:21.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.528+0000 7fe09d716980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:21.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.528+0000 7fe09d716980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22, ofs0, ns] 2024-04-03T04:00:21.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.528+0000 7fdf7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562412 cookie 94637832512992 notifier 6137 bl.length()=877 2024-04-03T04:00:21.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.528+0000 7fdf7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:21.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.528+0000 7fdf7effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:21.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.528+0000 7fdf7effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:21.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.532+0000 7fe09d716980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): orig_sources= new_sources= 2024-04-03T04:00:21.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.532+0000 7fe09d716980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): potential sources added=[] removed=[] 2024-04-03T04:00:21.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.532+0000 7fe09d716980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): orig_dests= new_dests= 2024-04-03T04:00:21.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.532+0000 7fe09d716980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): potential dests added=[] removed=[] 2024-04-03T04:00:21.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.0 2024-04-03T04:00:21.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.0 2024-04-03T04:00:21.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.1 2024-04-03T04:00:21.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.1 2024-04-03T04:00:21.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.2 2024-04-03T04:00:21.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.2 2024-04-03T04:00:21.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.3 2024-04-03T04:00:21.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.3 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.4 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.4 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.5 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.5 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.6 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.6 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.7 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.7 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.8 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.8 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.9 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.9 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.10 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.10 2024-04-03T04:00:21.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.11 2024-04-03T04:00:21.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1.11 2024-04-03T04:00:21.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.536+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.0 2024-04-03T04:00:21.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.540+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.1 2024-04-03T04:00:21.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.540+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.2 2024-04-03T04:00:21.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.540+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.3 2024-04-03T04:00:21.523 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.540+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.4 2024-04-03T04:00:21.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.544+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.5 2024-04-03T04:00:21.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.544+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.6 2024-04-03T04:00:21.527 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.548+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.7 2024-04-03T04:00:21.527 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.548+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.8 2024-04-03T04:00:21.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.548+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.9 2024-04-03T04:00:21.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.548+0000 7fe09d716980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22.10 2024-04-03T04:00:21.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.556+0000 7fe09d716980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 : hit (requested=0x17, cached=0x17) 2024-04-03T04:00:21.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.556+0000 7fe09d716980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 2024-04-03T04:00:21.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fe09d716980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:21.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fe09d716980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:21.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fe09d716980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:21.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fe09d716980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22, ofs0, ns] 2024-04-03T04:00:21.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fdf7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562413 cookie 94637832512992 notifier 6137 bl.length()=845 2024-04-03T04:00:21.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fdf7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 info.flags=0x17 2024-04-03T04:00:21.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fdf7effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 to cache LRU end 2024-04-03T04:00:21.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fdf7effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:21.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fe09d716980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): orig_sources= new_sources= 2024-04-03T04:00:21.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fe09d716980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): potential sources added=[] removed=[] 2024-04-03T04:00:21.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fe09d716980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): orig_dests= new_dests= 2024-04-03T04:00:21.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.560+0000 7fe09d716980 20 handle_bi_update(): bucket=:error-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22]): potential dests added=[] removed=[] 2024-04-03T04:00:21.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.568+0000 7fe09d716980 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2024-04-03T04:00:21.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.568+0000 7fdf51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:21.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.572+0000 7fe09d716980 20 remove_watcher() i=0 2024-04-03T04:00:21.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.572+0000 7fe09d716980 2 removed watcher, disabling cache 2024-04-03T04:00:21.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.576+0000 7fe09d716980 20 remove_watcher() i=1 2024-04-03T04:00:21.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.576+0000 7fe09d716980 20 remove_watcher() i=2 2024-04-03T04:00:21.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.580+0000 7fe09d716980 20 remove_watcher() i=3 2024-04-03T04:00:21.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.580+0000 7fe09d716980 20 remove_watcher() i=4 2024-04-03T04:00:21.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.584+0000 7fe09d716980 20 remove_watcher() i=5 2024-04-03T04:00:21.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.584+0000 7fe09d716980 20 remove_watcher() i=6 2024-04-03T04:00:21.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.588+0000 7fe09d716980 20 remove_watcher() i=7 2024-04-03T04:00:21.582 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-04-03T04:00:21.612 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:21.612 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:21.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.676+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.676+0000 7f17c627a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.676+0000 7f17c627a980 20 realm 2024-04-03T04:00:21.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.676+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.676+0000 7f17c627a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.676+0000 7f17c627a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:21.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.676+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.676+0000 7f17c627a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.676+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.680+0000 7f17c627a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:21.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.680+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.680+0000 7f17c627a980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:21.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.680+0000 7f17c627a980 20 searching for the correct realm 2024-04-03T04:00:21.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.684+0000 7f17c3d95640 0 -- 172.21.15.104:0/939610348 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x558a28836640 msgr2=0x558a28838b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:21.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.692+0000 7f17c3594640 0 -- 172.21.15.104:0/939610348 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f17bc069930 msgr2=0x7f17bc03e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:21.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:21.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:21.679 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:21.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:21.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:21.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:21.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.680 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 zone default found 2024-04-03T04:00:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 4 Realm: () 2024-04-03T04:00:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 zonegroup default 2024-04-03T04:00:21.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:21.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 started sync module instance, tier type = 2024-04-03T04:00:21.682 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.700+0000 7f17c627a980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:21.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.716+0000 7f17c627a980 20 add_watcher() i=0 2024-04-03T04:00:21.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.716+0000 7f17c627a980 20 add_watcher() i=1 2024-04-03T04:00:21.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.716+0000 7f17c627a980 20 add_watcher() i=2 2024-04-03T04:00:21.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.716+0000 7f17c627a980 20 add_watcher() i=3 2024-04-03T04:00:21.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.716+0000 7f17c627a980 20 add_watcher() i=4 2024-04-03T04:00:21.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.716+0000 7f17c627a980 20 add_watcher() i=5 2024-04-03T04:00:21.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.716+0000 7f17c627a980 20 add_watcher() i=6 2024-04-03T04:00:21.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f17c627a980 20 add_watcher() i=7 2024-04-03T04:00:21.699 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f17c627a980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:21.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f1679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:21.702 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f17c627a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:21.702 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f17c627a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:21.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f17c627a980 5 note: GC not initialized 2024-04-03T04:00:21.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f1678fe1640 20 reqs_thread_entry: start 2024-04-03T04:00:21.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f17c627a980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:21.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f17c627a980 20 Filter name: none 2024-04-03T04:00:21.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f15f27fc640 20 reqs_thread_entry: start 2024-04-03T04:00:21.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.720+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.724+0000 7f17c627a980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:21.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.724+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.724+0000 7f17c627a980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:21.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.724+0000 7f17c627a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:21.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.724+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.724+0000 7f17c627a980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:21.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.724+0000 7f17c627a980 20 rados->read ofs=0 len=0 2024-04-03T04:00:21.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.724+0000 7f17c627a980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:21.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.724+0000 7f17c627a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:21.707 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.728+0000 7f1679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:21.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.732+0000 7f17c627a980 20 remove_watcher() i=0 2024-04-03T04:00:21.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.732+0000 7f17c627a980 2 removed watcher, disabling cache 2024-04-03T04:00:21.714 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.732+0000 7f17c627a980 20 remove_watcher() i=1 2024-04-03T04:00:21.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.736+0000 7f17c627a980 20 remove_watcher() i=2 2024-04-03T04:00:21.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.736+0000 7f17c627a980 20 remove_watcher() i=3 2024-04-03T04:00:21.720 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.740+0000 7f17c627a980 20 remove_watcher() i=4 2024-04-03T04:00:21.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.740+0000 7f17c627a980 20 remove_watcher() i=5 2024-04-03T04:00:21.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.740+0000 7f17c627a980 20 remove_watcher() i=6 2024-04-03T04:00:21.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:21.744+0000 7f17c627a980 20 remove_watcher() i=7 2024-04-03T04:00:21.737 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:21.737 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:00:21.737 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-block-writes id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-04-03T04:00:21.737 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:21.738 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:21.738 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:21.757 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:21.757 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:22.219 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:22.219 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:22.590 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with abort at block_writes 2024-04-03T04:00:22.590 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:22.593 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:22.593 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:22.721 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:22.722 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:22.803 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:22.803 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:22.889 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:22.889 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:22.987 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:22.988 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.074 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.074 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.163 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.163 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.255 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.256 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.346 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.346 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.435 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.435 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.523 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.524 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.611 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.611 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.702 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.702 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.800 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.800 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.891 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.891 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:23.979 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:23.980 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:24.072 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:24.072 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:24.161 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:24.161 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:24.250 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:24.250 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:24.340 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:24.340 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:24.428 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:24.428 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:24.518 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:24.518 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:24.609 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-04-03T04:00:24.642 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:24.642 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:24.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.708+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.708+0000 7ff89da96980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:24.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.708+0000 7ff89da96980 20 realm 2024-04-03T04:00:24.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.708+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.708+0000 7ff89da96980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:24.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.708+0000 7ff89da96980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:24.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.708+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.708+0000 7ff89da96980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:24.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.708+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.712+0000 7ff89da96980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:24.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.712+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.712+0000 7ff89da96980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:24.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.712+0000 7ff89da96980 20 searching for the correct realm 2024-04-03T04:00:24.697 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.716+0000 7ff89bdb2640 0 -- 172.21.15.104:0/1943930880 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7ff89405e010 msgr2=0x7ff89408c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:24.704 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.724+0000 7ff892db0640 0 -- 172.21.15.104:0/1943930880 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7ff89407cb90 msgr2=0x7ff894072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:24.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:24.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:24.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:24.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:24.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:24.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:24.924 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:24.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:24.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:24.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 zone default found 2024-04-03T04:00:24.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 4 Realm: () 2024-04-03T04:00:24.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:24.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:24.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:24.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 zonegroup default 2024-04-03T04:00:24.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:24.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.944+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.948+0000 7ff89da96980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:24.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.948+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.948+0000 7ff89da96980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:24.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.948+0000 7ff89da96980 20 started sync module instance, tier type = 2024-04-03T04:00:24.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.948+0000 7ff89da96980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:24.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.972+0000 7ff89da96980 20 add_watcher() i=0 2024-04-03T04:00:24.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.972+0000 7ff89da96980 20 add_watcher() i=1 2024-04-03T04:00:24.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.972+0000 7ff89da96980 20 add_watcher() i=2 2024-04-03T04:00:24.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.972+0000 7ff89da96980 20 add_watcher() i=3 2024-04-03T04:00:24.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.972+0000 7ff89da96980 20 add_watcher() i=4 2024-04-03T04:00:24.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.972+0000 7ff89da96980 20 add_watcher() i=5 2024-04-03T04:00:24.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.972+0000 7ff89da96980 20 add_watcher() i=6 2024-04-03T04:00:24.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.972+0000 7ff89da96980 20 add_watcher() i=7 2024-04-03T04:00:24.954 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.972+0000 7ff89da96980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:24.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.976+0000 7ff751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:24.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.976+0000 7ff89da96980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:24.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.976+0000 7ff89da96980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:24.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.976+0000 7ff89da96980 5 note: GC not initialized 2024-04-03T04:00:24.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff750fe1640 20 reqs_thread_entry: start 2024-04-03T04:00:24.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:24.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 Filter name: none 2024-04-03T04:00:24.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff6ca7fc640 20 reqs_thread_entry: start 2024-04-03T04:00:24.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:24.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:24.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:24.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:24.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.980+0000 7ff89da96980 20 rados->read ofs=0 len=0 2024-04-03T04:00:24.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.984+0000 7ff89da96980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:24.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.984+0000 7ff89da96980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:24.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.984+0000 7ff751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:24.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.992+0000 7ff89da96980 20 remove_watcher() i=0 2024-04-03T04:00:24.971 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.992+0000 7ff89da96980 2 removed watcher, disabling cache 2024-04-03T04:00:24.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.992+0000 7ff89da96980 20 remove_watcher() i=1 2024-04-03T04:00:24.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.996+0000 7ff89da96980 20 remove_watcher() i=2 2024-04-03T04:00:24.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:24.996+0000 7ff89da96980 20 remove_watcher() i=3 2024-04-03T04:00:24.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.000+0000 7ff89da96980 20 remove_watcher() i=4 2024-04-03T04:00:24.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.000+0000 7ff89da96980 20 remove_watcher() i=5 2024-04-03T04:00:24.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.000+0000 7ff89da96980 20 remove_watcher() i=6 2024-04-03T04:00:24.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.004+0000 7ff89da96980 20 remove_watcher() i=7 2024-04-03T04:00:24.999 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:24.999 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:00:24.999 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-block-writes id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:00:24.999 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:24.999 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-04-03T04:00:25.035 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:25.036 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:25.077 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.096+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.079 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.079 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 realm 2024-04-03T04:00:25.079 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.079 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:25.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:25.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:25.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 searching for the correct realm 2024-04-03T04:00:25.293 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.312+0000 7fd9b3e96640 0 -- 172.21.15.104:0/9978940 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fd9a4007f10 msgr2=0x7fd9a40b8af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:25.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.320+0000 7fd9b3e96640 0 -- 172.21.15.104:0/9978940 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fd9ac088040 msgr2=0x7fd9ac05c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:25.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:25.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:25.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:25.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:25.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:25.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:25.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:25.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:25.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 zone default found 2024-04-03T04:00:25.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 4 Realm: () 2024-04-03T04:00:25.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:25.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:25.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:25.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 zonegroup default 2024-04-03T04:00:25.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.523 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.544+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.523 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.544+0000 7fd9b6b7c980 20 started sync module instance, tier type = 2024-04-03T04:00:25.523 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.544+0000 7fd9b6b7c980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:25.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=0 2024-04-03T04:00:25.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=1 2024-04-03T04:00:25.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=2 2024-04-03T04:00:25.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=3 2024-04-03T04:00:25.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=4 2024-04-03T04:00:25.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=5 2024-04-03T04:00:25.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=6 2024-04-03T04:00:25.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.568+0000 7fd9b6b7c980 20 add_watcher() i=7 2024-04-03T04:00:25.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.568+0000 7fd9b6b7c980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:25.553 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.572+0000 7fd86afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:25.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.572+0000 7fd9b6b7c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:25.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.572+0000 7fd9b6b7c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:25.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 note: GC not initialized 2024-04-03T04:00:25.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd869fdb640 20 reqs_thread_entry: start 2024-04-03T04:00:25.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:25.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 Filter name: none 2024-04-03T04:00:25.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd7db7fe640 20 reqs_thread_entry: start 2024-04-03T04:00:25.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-04-03T04:00:25.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:25.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-04-03T04:00:25.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-04-03T04:00:25.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 : miss 2024-04-03T04:00:25.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:00:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 2024-04-03T04:00:25.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:25.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:25.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:25.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23, ofs0, ns] 2024-04-03T04:00:25.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94268630065904 notifier 6188 bl.length()=877 2024-04-03T04:00:25.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:25.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:25.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:25.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_sources= new_sources= 2024-04-03T04:00:25.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential sources added=[] removed=[] 2024-04-03T04:00:25.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_dests= new_dests= 2024-04-03T04:00:25.572 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9b6b7c980 time 2024-04-03T04:00:25.595377+0000 2024-04-03T04:00:25.572 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:00:25.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential dests added=[] removed=[] 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd9ba452e1f] 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fd9ba452fd3] 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc9ebd85b1] 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x55bc9ebe625d] 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9b92bcd90] 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.592+0000 7fd9b6b7c980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9b6b7c980 time 2024-04-03T04:00:25.595377+0000 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:00:25.573 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd9ba452e1f] 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fd9ba452fd3] 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc9ebd85b1] 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x55bc9ebe625d] 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9b92bcd90] 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr:*** Caught signal (Aborted) ** 2024-04-03T04:00:25.574 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7fd9b6b7c980 thread_name:radosgw-admin 2024-04-03T04:00:25.594 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:00:25.594 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9b92d5520] 2024-04-03T04:00:25.594 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:00:25.594 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd9ba452e79] 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fd9ba452fd3] 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc9ebd85b1] 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x55bc9ebe625d] 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9b92bcd90] 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.592+0000 7fd9b6b7c980 -1 *** Caught signal (Aborted) ** 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7fd9b6b7c980 thread_name:radosgw-admin 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.595 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9b92d5520] 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd9ba452e79] 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fd9ba452fd3] 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc9ebd85b1] 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x55bc9ebe625d] 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9b92bcd90] 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:00:25.596 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr:--- begin dump of recent events --- 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: -499> 2024-04-03T04:00:25.076+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: -498> 2024-04-03T04:00:25.076+0000 7fd9b4697640 10 monclient(hunting): handle_auth_done global_id 6176 payload 274 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: -497> 2024-04-03T04:00:25.076+0000 7fd9b4697640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: -496> 2024-04-03T04:00:25.076+0000 7fd9b4697640 1 monclient: found mon.noname-c 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: -495> 2024-04-03T04:00:25.076+0000 7fd9b4697640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: -494> 2024-04-03T04:00:25.076+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x55bca0112a90 auth_method 0 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: -493> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: -492> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr: -491> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: dump: 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.597 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr: -490> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr: -489> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr: -488> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr: -487> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.598 INFO:tasks.workunit.client.0.smithi104.stderr: -486> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr: -485> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: dump: 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr: -484> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6176 2024-04-03T04:00:25.599 INFO:tasks.workunit.client.0.smithi104.stderr: -483> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: get_monmap_and_config success 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr: -482> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 4 set_mon_vals no callback set 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr: -481> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: shutdown 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr: -480> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 asok(0x55bca004c210) unregister_commands rotate-key 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr: -479> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: build_initial_monmap 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr: -478> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 build_initial for_mkfs: 0 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr: -477> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: monmap: 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:00:25.600 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr: -476> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding auth protocol: cephx 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr: -475> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding auth protocol: cephx 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr: -474> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding auth protocol: cephx 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr: -473> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr: -472> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr: -471> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.601 INFO:tasks.workunit.client.0.smithi104.stderr: -470> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -469> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -468> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -467> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -466> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -465> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -464> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -463> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -462> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -461> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -460> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 librados: starting msgr at 2024-04-03T04:00:25.602 INFO:tasks.workunit.client.0.smithi104.stderr: -459> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 librados: starting objecter 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -458> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command objecter_requests hook 0x55bca0080110 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -457> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 librados: setting wanted keys 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -456> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 librados: calling monclient init 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -455> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: init 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -454> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding auth protocol: cephx 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -453> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding auth protocol: cephx 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -452> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding auth protocol: cephx 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -451> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -450> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -449> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -448> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.603 INFO:tasks.workunit.client.0.smithi104.stderr: -447> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -446> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -445> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -444> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -443> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -442> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -441> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -440> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -439> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -438> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -437> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command rotate-key hook 0x55bca0253e98 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -436> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _reopen_session rank -1 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -435> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -434> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-a con 0x55bca01060f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:00:25.604 INFO:tasks.workunit.client.0.smithi104.stderr: -433> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-b con 0x55bca0112a90 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -432> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-c con 0x55bca0283270 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -431> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -430> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -429> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -428> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): _renew_subs 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -427> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): authenticate will time out at 2280.820479s 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -426> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): get_auth_request con 0x55bca01060f0 auth_method 0 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -425> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -424> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -423> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -422> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request con 0x55bca0283270 auth_method 0 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -421> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.605 INFO:tasks.workunit.client.0.smithi104.stderr: -420> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -419> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -418> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -417> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -416> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -415> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -414> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -413> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -412> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_done global_id 6179 payload 824 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -411> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -410> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 1 monclient: found mon.noname-c 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -409> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -408> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.606 INFO:tasks.workunit.client.0.smithi104.stderr: -407> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr: -406> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: dump: 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.607 INFO:tasks.workunit.client.0.smithi104.stderr: -405> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr: -404> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr: -403> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr: -402> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr: -401> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr: -400> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: dump: 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.608 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -399> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6179 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -398> 2024-04-03T04:00:25.080+0000 7fd8a260c640 4 set_mon_vals no callback set 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -397> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -396> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -395> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -394> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -393> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 1 librados: init done 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -392> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -391> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -390> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -389> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient: get_auth_request con 0x7fd89c066d90 auth_method 0 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -388> 2024-04-03T04:00:25.080+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x55bca025d920 auth_method 0 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -387> 2024-04-03T04:00:25.084+0000 7fd9b4697640 10 monclient: get_auth_request con 0x55bca029ec80 auth_method 0 2024-04-03T04:00:25.609 INFO:tasks.workunit.client.0.smithi104.stderr: -386> 2024-04-03T04:00:25.084+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x55bca02a2f00 auth_method 0 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr: -385> 2024-04-03T04:00:25.084+0000 7fd9b4e98640 10 monclient: get_auth_request con 0x55bca02a24b0 auth_method 0 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr: -384> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: build_initial_monmap 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr: -383> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 1 build_initial for_mkfs: 0 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr: -382> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: monmap: 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:00:25.610 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -381> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding auth protocol: cephx 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -380> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding auth protocol: cephx 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -379> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding auth protocol: cephx 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -378> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -377> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -376> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -375> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -374> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -373> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -372> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -371> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.611 INFO:tasks.workunit.client.0.smithi104.stderr: -370> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -369> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -368> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -367> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -366> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -365> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command objecter_requests cmddesc objecter_requests hook 0x55bca02b04b0 EEXIST 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -364> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: init 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -363> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding auth protocol: cephx 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -362> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding auth protocol: cephx 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -361> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding auth protocol: cephx 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -360> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -359> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -358> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -357> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.612 INFO:tasks.workunit.client.0.smithi104.stderr: -356> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -355> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -354> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -353> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -352> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -351> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -350> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -349> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -348> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -347> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -346> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command rotate-key cmddesc rotate-key hook 0x55bca02aa040 EEXIST 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -345> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _reopen_session rank -1 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -344> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _add_conns ranks=[1,0,2] 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -343> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-b con 0x55bca02d5110 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:00:25.613 INFO:tasks.workunit.client.0.smithi104.stderr: -342> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-a con 0x55bca02d54f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -341> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-c con 0x55bca02d06b0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -340> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -339> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -338> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -337> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): _renew_subs 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -336> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): authenticate will time out at 2280.829571s 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -335> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request con 0x55bca02d54f0 auth_method 0 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -334> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -333> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -332> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -331> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): get_auth_request con 0x55bca02d06b0 auth_method 0 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -330> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -329> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.614 INFO:tasks.workunit.client.0.smithi104.stderr: -328> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -327> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -326> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -325> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -324> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -323> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -322> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -321> 2024-04-03T04:00:25.088+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request con 0x55bca02d5110 auth_method 0 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -320> 2024-04-03T04:00:25.088+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -319> 2024-04-03T04:00:25.088+0000 7fd9b3e96640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -318> 2024-04-03T04:00:25.088+0000 7fd9b3e96640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -317> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_done global_id 6555 payload 824 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -316> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -315> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 1 monclient: found mon.noname-a 2024-04-03T04:00:25.615 INFO:tasks.workunit.client.0.smithi104.stderr: -314> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr: -313> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr: -312> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr: -311> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: dump: 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.616 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr: -310> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr: -309> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr: -308> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr: -307> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr: -306> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr: -305> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: dump: 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.617 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -304> 2024-04-03T04:00:25.088+0000 7fd9b5699640 4 set_mon_vals no callback set 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -303> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6555 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -302> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -301> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -300> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -299> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -298> 2024-04-03T04:00:25.092+0000 7fd899ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -297> 2024-04-03T04:00:25.092+0000 7fd899ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -296> 2024-04-03T04:00:25.092+0000 7fd899ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.618 INFO:tasks.workunit.client.0.smithi104.stderr: -295> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd88c066ca0 auth_method 0 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr: -294> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: get_monmap_and_config 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr: -293> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: build_initial_monmap 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr: -292> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 build_initial for_mkfs: 0 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr: -291> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: monmap: 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:00:25.619 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -290> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -289> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -288> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -287> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -286> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -285> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -284> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -283> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -282> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -281> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -280> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -279> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -278> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.620 INFO:tasks.workunit.client.0.smithi104.stderr: -277> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -276> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -275> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -274> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: init 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -273> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding auth protocol: cephx 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -272> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding auth protocol: cephx 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -271> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding auth protocol: cephx 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -270> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -269> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -268> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -267> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -266> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -265> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.621 INFO:tasks.workunit.client.0.smithi104.stderr: -264> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -263> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -262> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -261> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -260> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -259> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -258> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -257> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -256> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command rotate-key cmddesc rotate-key hook 0x7fffd8209188 EEXIST 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -255> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: _reopen_session rank -1 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -254> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: _add_conns ranks=[2,0,1] 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -253> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-c con 0x55bca03275a0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -252> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-a con 0x55bca0321630 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -251> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-b con 0x55bca032cc10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:00:25.622 INFO:tasks.workunit.client.0.smithi104.stderr: -250> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -249> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -248> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -247> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): _renew_subs 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -246> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): authenticate will time out at 2280.833560s 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -245> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request con 0x55bca03275a0 auth_method 0 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -244> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -243> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -242> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -241> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request con 0x55bca0321630 auth_method 0 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -240> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -239> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -238> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.623 INFO:tasks.workunit.client.0.smithi104.stderr: -237> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -236> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -235> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -234> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -233> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -232> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -231> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_done global_id 6185 payload 274 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -230> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -229> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 1 monclient: found mon.noname-c 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -228> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -227> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -226> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr: -225> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: dump: 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.624 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr: -224> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr: -223> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr: -222> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr: -221> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6185 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr: -220> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: get_monmap_and_config success 2024-04-03T04:00:25.625 INFO:tasks.workunit.client.0.smithi104.stderr: -219> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 4 set_mon_vals no callback set 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr: -218> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr: -217> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr: -216> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: dump: 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr: -215> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: shutdown 2024-04-03T04:00:25.626 INFO:tasks.workunit.client.0.smithi104.stderr: -214> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: build_initial_monmap 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr: -213> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 build_initial for_mkfs: 0 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr: -212> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: monmap: 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr: -211> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr: -210> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.627 INFO:tasks.workunit.client.0.smithi104.stderr: -209> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -208> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -207> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -206> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -205> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -204> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -203> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -202> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -201> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -200> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -199> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -198> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -197> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -196> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -195> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 librados: starting msgr at 2024-04-03T04:00:25.628 INFO:tasks.workunit.client.0.smithi104.stderr: -194> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 librados: starting objecter 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -193> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command objecter_requests cmddesc objecter_requests hook 0x55bca02e75e0 EEXIST 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -192> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 librados: setting wanted keys 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -191> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 librados: calling monclient init 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -190> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: init 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -189> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding auth protocol: cephx 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -188> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding auth protocol: cephx 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -187> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding auth protocol: cephx 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -186> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -185> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -184> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -183> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -182> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -181> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -180> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.629 INFO:tasks.workunit.client.0.smithi104.stderr: -179> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -178> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -177> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -176> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -175> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -174> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -173> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -172> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command rotate-key cmddesc rotate-key hook 0x55bca02f1f78 EEXIST 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -171> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: _reopen_session rank -1 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -170> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -169> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-a con 0x55bca03275a0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -168> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-b con 0x55bca032cc10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -167> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-c con 0x55bca03261d0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:00:25.630 INFO:tasks.workunit.client.0.smithi104.stderr: -166> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -165> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -164> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -163> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): _renew_subs 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -162> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): authenticate will time out at 2280.836067s 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -161> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): get_auth_request con 0x55bca03261d0 auth_method 0 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -160> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -159> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -158> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -157> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request con 0x55bca03275a0 auth_method 0 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -156> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -155> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -154> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -153> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.631 INFO:tasks.workunit.client.0.smithi104.stderr: -152> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -151> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -150> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -149> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -148> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -147> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): handle_auth_done global_id 6188 payload 824 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -146> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -145> 2024-04-03T04:00:25.096+0000 7fd9b4697640 1 monclient: found mon.noname-c 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -144> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -143> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -142> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr: -141> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: dump: 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.632 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr: -140> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr: -139> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr: -138> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr: -137> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr: -136> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr: -135> 2024-04-03T04:00:25.096+0000 7fd88b7fe640 4 set_mon_vals no callback set 2024-04-03T04:00:25.633 INFO:tasks.workunit.client.0.smithi104.stderr: -134> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: dump: 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr: -133> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6188 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr: -132> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr: -131> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.634 INFO:tasks.workunit.client.0.smithi104.stderr: -130> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -129> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -128> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 1 librados: init done 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -127> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cr dump hook 0x55bca0323188 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -126> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -125> 2024-04-03T04:00:25.096+0000 7fd889ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -124> 2024-04-03T04:00:25.096+0000 7fd889ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -123> 2024-04-03T04:00:25.096+0000 7fd889ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -122> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd87c066d60 auth_method 0 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -121> 2024-04-03T04:00:25.096+0000 7fd9b4e98640 10 monclient: get_auth_request con 0x55bca0341950 auth_method 0 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -120> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -119> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 realm 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -118> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -117> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.635 INFO:tasks.workunit.client.0.smithi104.stderr: -116> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -115> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -114> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -113> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -112> 2024-04-03T04:00:25.100+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x55bca0345b70 auth_method 0 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -111> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -110> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -109> 2024-04-03T04:00:25.100+0000 7fd9b4e98640 10 monclient: get_auth_request con 0x55bca03493d0 auth_method 0 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -108> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -107> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 searching for the correct realm 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -106> 2024-04-03T04:00:25.100+0000 7fd9b4697640 10 monclient: get_auth_request con 0x55bca034e0a0 auth_method 0 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -105> 2024-04-03T04:00:25.104+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd9a4007f10 auth_method 0 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -104> 2024-04-03T04:00:25.308+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd9a4007f10 auth_method 0 2024-04-03T04:00:25.636 INFO:tasks.workunit.client.0.smithi104.stderr: -103> 2024-04-03T04:00:25.308+0000 7fd9b4e98640 10 monclient: get_auth_request con 0x7fd9ac0671e0 auth_method 0 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -102> 2024-04-03T04:00:25.312+0000 7fd9b3e96640 0 -- 172.21.15.104:0/9978940 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fd9a4007f10 msgr2=0x7fd9a40b8af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -101> 2024-04-03T04:00:25.312+0000 7fd889ffb640 1 client.6188.objecter ms_handle_reset 0x7fd9a4007f10 session 0x7fd9a40c6070 osd.7 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -100> 2024-04-03T04:00:25.312+0000 7fd889ffb640 10 monclient: _renew_subs 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -99> 2024-04-03T04:00:25.312+0000 7fd889ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -98> 2024-04-03T04:00:25.312+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd87c077490 auth_method 0 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -97> 2024-04-03T04:00:25.316+0000 7fd9b4697640 10 monclient: get_auth_request con 0x7fd9ac0650b0 auth_method 0 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -96> 2024-04-03T04:00:25.320+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd9ac088040 auth_method 0 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -95> 2024-04-03T04:00:25.320+0000 7fd9b3e96640 0 -- 172.21.15.104:0/9978940 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fd9ac088040 msgr2=0x7fd9ac05c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -94> 2024-04-03T04:00:25.524+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd9ac088040 auth_method 0 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -93> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -92> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -91> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -90> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:25.637 INFO:tasks.workunit.client.0.smithi104.stderr: -89> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -88> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -87> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -86> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -85> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -84> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -83> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -82> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -81> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 zone default found 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -80> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 4 Realm: () 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -79> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -78> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -77> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:25.638 INFO:tasks.workunit.client.0.smithi104.stderr: -76> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 zonegroup default 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -75> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -74> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -73> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -72> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -71> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -70> 2024-04-03T04:00:25.544+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -69> 2024-04-03T04:00:25.544+0000 7fd9b6b7c980 20 started sync module instance, tier type = 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -68> 2024-04-03T04:00:25.544+0000 7fd9b6b7c980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -67> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=0 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -66> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=1 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -65> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=2 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -64> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=3 2024-04-03T04:00:25.639 INFO:tasks.workunit.client.0.smithi104.stderr: -63> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=4 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -62> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=5 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -61> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=6 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -60> 2024-04-03T04:00:25.568+0000 7fd9b6b7c980 20 add_watcher() i=7 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -59> 2024-04-03T04:00:25.568+0000 7fd9b6b7c980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -58> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding auth protocol: cephx 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -57> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding auth protocol: cephx 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -56> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding auth protocol: cephx 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -55> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -54> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -53> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -52> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -51> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -50> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.640 INFO:tasks.workunit.client.0.smithi104.stderr: -49> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -48> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -47> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -46> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -45> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -44> 2024-04-03T04:00:25.572+0000 7fd86afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -43> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -42> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -41> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -40> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -39> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cache list hook 0x55bca03260b0 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -38> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cache inspect hook 0x55bca03260b0 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -37> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cache erase hook 0x55bca03260b0 2024-04-03T04:00:25.641 INFO:tasks.workunit.client.0.smithi104.stderr: -36> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cache zap hook 0x55bca03260b0 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -35> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 note: GC not initialized 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -34> 2024-04-03T04:00:25.576+0000 7fd869fdb640 20 reqs_thread_entry: start 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -33> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command sync trace show hook 0x7fd9a4004470 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -32> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command sync trace history hook 0x7fd9a4004470 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -31> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command sync trace active hook 0x7fd9a4004470 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -30> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command sync trace active_short hook 0x7fd9a4004470 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -29> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -28> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 Filter name: none 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -27> 2024-04-03T04:00:25.576+0000 7fd7db7fe640 20 reqs_thread_entry: start 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -26> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -25> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -24> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:25.642 INFO:tasks.workunit.client.0.smithi104.stderr: -23> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -22> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -21> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 : miss 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -20> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -19> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -18> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -17> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -16> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -15> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -14> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -13> 2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -12> 2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:25.643 INFO:tasks.workunit.client.0.smithi104.stderr: -11> 2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -10> 2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23, ofs0, ns] 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -9> 2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94268630065904 notifier 6188 bl.length()=877 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -8> 2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -7> 2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -6> 2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -5> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_sources= new_sources= 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -4> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential sources added=[] removed=[] 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -3> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_dests= new_dests= 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -2> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential dests added=[] removed=[] 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: -1> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9b6b7c980 time 2024-04-03T04:00:25.595377+0000 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:00:25.644 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd9ba452e1f] 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fd9ba452fd3] 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc9ebd85b1] 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x55bc9ebe625d] 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9b92bcd90] 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 0> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 -1 *** Caught signal (Aborted) ** 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7fd9b6b7c980 thread_name:radosgw-admin 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:00:25.645 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9b92d5520] 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd9ba452e79] 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fd9ba452fd3] 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc9ebd85b1] 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x55bc9ebe625d] 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9b92bcd90] 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T04:00:25.646 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr:--- logging levels --- 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 none 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 lockdep 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 context 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 crush 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_balancer 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_locker 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log_expire 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_migrator 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 3/ 5 mds_quiesce 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 buffer 2024-04-03T04:00:25.647 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 timer 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 filer 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 striper 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 objecter 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rados 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_mirror 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_replay 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_pwl 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 journaler 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objectcacher 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 immutable_obj_cache 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 client 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 osd 2024-04-03T04:00:25.648 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 optracker 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objclass 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 filestore 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 journal 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 ms 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mon 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 0/10 monc 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 paxos 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 tp 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 auth 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 crypto 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 finisher 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 reserver 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 heartbeatmap 2024-04-03T04:00:25.649 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 perfcounter 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 20/20 rgw 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_sync 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_datacache 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_access 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_dbstore 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_flight 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_lifecycle 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_notification 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 javaclient 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 asok 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 throttle 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 refs 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 compressor 2024-04-03T04:00:25.650 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluestore 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluefs 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 bdev 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 kstore 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 4/ 5 rocksdb 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 fuse 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 2/ 5 mgr 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mgrc 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 dpdk 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 eventtrace 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 prioritycache 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 test 2024-04-03T04:00:25.651 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephfs_mirror 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephsqlite 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 crimson_interrupt 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_onode 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_odata 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_omap 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_tm 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_t 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cleaner 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_epm 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_lba 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-03T04:00:25.652 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cache 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_journal 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_device 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_backref 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 alienstore 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mclock 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cyanstore 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 ceph_exporter 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 memstore 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 trace 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: -2/-2 (syslog threshold) 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 99/99 (stderr threshold) 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-03T04:00:25.653 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd7db7fe640 / http_manager 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd869fdb640 / http_manager 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd86afdd640 / rgw_dt_lg_renew 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd889ffb640 / ms_dispatch 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd88b7fe640 / io_context_pool 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd899ffb640 / ms_dispatch 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd8a0e09640 / ms_dispatch 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd8a260c640 / io_context_pool 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b3e96640 / msgr-worker-2 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b4697640 / msgr-worker-1 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b4e98640 / msgr-worker-0 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b5699640 / io_context_pool 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b6b7c980 / radosgw-admin 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: max_recent 500 2024-04-03T04:00:25.654 INFO:tasks.workunit.client.0.smithi104.stderr: max_new 1000 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: log_file /var/log/ceph/ceph-client.admin.87600.log 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr:--- end dump of recent events --- 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr:--- begin dump of recent events --- 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: -499> 2024-04-03T04:00:25.076+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: -498> 2024-04-03T04:00:25.076+0000 7fd9b4697640 10 monclient(hunting): handle_auth_done global_id 6176 payload 274 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: -497> 2024-04-03T04:00:25.076+0000 7fd9b4697640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: -496> 2024-04-03T04:00:25.076+0000 7fd9b4697640 1 monclient: found mon.noname-c 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: -495> 2024-04-03T04:00:25.076+0000 7fd9b4697640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: -494> 2024-04-03T04:00:25.076+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x55bca0112a90 auth_method 0 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: -493> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: -492> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr: -491> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: dump: 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.655 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr: -490> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr: -489> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr: -488> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr: -487> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr: -486> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr: -485> 2024-04-03T04:00:25.076+0000 7fd8a260c640 10 monclient: dump: 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.656 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr: -484> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6176 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr: -483> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: get_monmap_and_config success 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr: -482> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 4 set_mon_vals no callback set 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr: -481> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: shutdown 2024-04-03T04:00:25.657 INFO:tasks.workunit.client.0.smithi104.stderr: -480> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 asok(0x55bca004c210) unregister_commands rotate-key 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr: -479> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: build_initial_monmap 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr: -478> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 build_initial for_mkfs: 0 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr: -477> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: monmap: 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.658 INFO:tasks.workunit.client.0.smithi104.stderr: -476> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding auth protocol: cephx 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -475> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding auth protocol: cephx 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -474> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding auth protocol: cephx 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -473> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -472> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -471> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -470> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -469> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -468> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -467> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -466> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -465> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -464> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -463> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: crc 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -462> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02560c0) adding con mode: secure 2024-04-03T04:00:25.659 INFO:tasks.workunit.client.0.smithi104.stderr: -461> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -460> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 librados: starting msgr at 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -459> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 librados: starting objecter 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -458> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command objecter_requests hook 0x55bca0080110 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -457> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 librados: setting wanted keys 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -456> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 1 librados: calling monclient init 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -455> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 10 monclient: init 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -454> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding auth protocol: cephx 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -453> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding auth protocol: cephx 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -452> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding auth protocol: cephx 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -451> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -450> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -449> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.660 INFO:tasks.workunit.client.0.smithi104.stderr: -448> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -447> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -446> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -445> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -444> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -443> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -442> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -441> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: crc 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -440> 2024-04-03T04:00:25.076+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca0253d50) adding con mode: secure 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -439> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -438> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -437> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command rotate-key hook 0x55bca0253e98 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -436> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _reopen_session rank -1 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -435> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T04:00:25.661 INFO:tasks.workunit.client.0.smithi104.stderr: -434> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-a con 0x55bca01060f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -433> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-b con 0x55bca0112a90 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -432> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-c con 0x55bca0283270 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -431> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -430> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -429> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -428> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): _renew_subs 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -427> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient(hunting): authenticate will time out at 2280.820479s 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -426> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): get_auth_request con 0x55bca01060f0 auth_method 0 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -425> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -424> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -423> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -422> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request con 0x55bca0283270 auth_method 0 2024-04-03T04:00:25.662 INFO:tasks.workunit.client.0.smithi104.stderr: -421> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -420> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -419> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -418> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -417> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -416> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -415> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -414> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -413> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -412> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_done global_id 6179 payload 824 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -411> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -410> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 1 monclient: found mon.noname-c 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -409> 2024-04-03T04:00:25.080+0000 7fd9b4e98640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.663 INFO:tasks.workunit.client.0.smithi104.stderr: -408> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr: -407> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr: -406> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: dump: 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr: -405> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.664 INFO:tasks.workunit.client.0.smithi104.stderr: -404> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr: -403> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr: -402> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr: -401> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr: -400> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 10 monclient: dump: 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.665 INFO:tasks.workunit.client.0.smithi104.stderr: -399> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6179 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -398> 2024-04-03T04:00:25.080+0000 7fd8a260c640 4 set_mon_vals no callback set 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -397> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -396> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -395> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -394> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -393> 2024-04-03T04:00:25.080+0000 7fd9b6b7c980 1 librados: init done 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -392> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -391> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -390> 2024-04-03T04:00:25.080+0000 7fd8a0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.666 INFO:tasks.workunit.client.0.smithi104.stderr: -389> 2024-04-03T04:00:25.080+0000 7fd9b4697640 10 monclient: get_auth_request con 0x7fd89c066d90 auth_method 0 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr: -388> 2024-04-03T04:00:25.080+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x55bca025d920 auth_method 0 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr: -387> 2024-04-03T04:00:25.084+0000 7fd9b4697640 10 monclient: get_auth_request con 0x55bca029ec80 auth_method 0 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr: -386> 2024-04-03T04:00:25.084+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x55bca02a2f00 auth_method 0 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr: -385> 2024-04-03T04:00:25.084+0000 7fd9b4e98640 10 monclient: get_auth_request con 0x55bca02a24b0 auth_method 0 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr: -384> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: build_initial_monmap 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr: -383> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 1 build_initial for_mkfs: 0 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr: -382> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: monmap: 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:00:25.667 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -381> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding auth protocol: cephx 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -380> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding auth protocol: cephx 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -379> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding auth protocol: cephx 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -378> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -377> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -376> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -375> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -374> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -373> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -372> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -371> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.668 INFO:tasks.workunit.client.0.smithi104.stderr: -370> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -369> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -368> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: crc 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -367> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02aafb0) adding con mode: secure 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -366> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -365> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command objecter_requests cmddesc objecter_requests hook 0x55bca02b04b0 EEXIST 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -364> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: init 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -363> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding auth protocol: cephx 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -362> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding auth protocol: cephx 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -361> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding auth protocol: cephx 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -360> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -359> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -358> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -357> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.669 INFO:tasks.workunit.client.0.smithi104.stderr: -356> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -355> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -354> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -353> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -352> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -351> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -350> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: crc 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -349> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02a9ef8) adding con mode: secure 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -348> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -347> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -346> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command rotate-key cmddesc rotate-key hook 0x55bca02aa040 EEXIST 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -345> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _reopen_session rank -1 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -344> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _add_conns ranks=[1,0,2] 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -343> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-b con 0x55bca02d5110 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:00:25.670 INFO:tasks.workunit.client.0.smithi104.stderr: -342> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-a con 0x55bca02d54f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -341> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-c con 0x55bca02d06b0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -340> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -339> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -338> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -337> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): _renew_subs 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -336> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient(hunting): authenticate will time out at 2280.829571s 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -335> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request con 0x55bca02d54f0 auth_method 0 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -334> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -333> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -332> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -331> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): get_auth_request con 0x55bca02d06b0 auth_method 0 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -330> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -329> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -328> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.671 INFO:tasks.workunit.client.0.smithi104.stderr: -327> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -326> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -325> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -324> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -323> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -322> 2024-04-03T04:00:25.088+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -321> 2024-04-03T04:00:25.088+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request con 0x55bca02d5110 auth_method 0 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -320> 2024-04-03T04:00:25.088+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -319> 2024-04-03T04:00:25.088+0000 7fd9b3e96640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -318> 2024-04-03T04:00:25.088+0000 7fd9b3e96640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -317> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_done global_id 6555 payload 824 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -316> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -315> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 1 monclient: found mon.noname-a 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -314> 2024-04-03T04:00:25.088+0000 7fd9b4e98640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -313> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.672 INFO:tasks.workunit.client.0.smithi104.stderr: -312> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr: -311> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: dump: 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr: -310> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr: -309> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.673 INFO:tasks.workunit.client.0.smithi104.stderr: -308> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr: -307> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr: -306> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr: -305> 2024-04-03T04:00:25.088+0000 7fd899ffb640 10 monclient: dump: 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.674 INFO:tasks.workunit.client.0.smithi104.stderr: -304> 2024-04-03T04:00:25.088+0000 7fd9b5699640 4 set_mon_vals no callback set 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -303> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6555 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -302> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -301> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -300> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -299> 2024-04-03T04:00:25.088+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -298> 2024-04-03T04:00:25.092+0000 7fd899ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -297> 2024-04-03T04:00:25.092+0000 7fd899ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -296> 2024-04-03T04:00:25.092+0000 7fd899ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -295> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd88c066ca0 auth_method 0 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -294> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: get_monmap_and_config 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -293> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: build_initial_monmap 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -292> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 build_initial for_mkfs: 0 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr: -291> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: monmap: 2024-04-03T04:00:25.675 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr: -290> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr: -289> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr: -288> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr: -287> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr: -286> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.676 INFO:tasks.workunit.client.0.smithi104.stderr: -285> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -284> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -283> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -282> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -281> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -280> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -279> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -278> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -277> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -276> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -275> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -274> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: init 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -273> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding auth protocol: cephx 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -272> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding auth protocol: cephx 2024-04-03T04:00:25.677 INFO:tasks.workunit.client.0.smithi104.stderr: -271> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding auth protocol: cephx 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -270> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -269> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -268> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -267> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -266> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -265> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -264> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -263> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -262> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -261> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -260> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: crc 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -259> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd8209040) adding con mode: secure 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -258> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.678 INFO:tasks.workunit.client.0.smithi104.stderr: -257> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -256> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command rotate-key cmddesc rotate-key hook 0x7fffd8209188 EEXIST 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -255> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: _reopen_session rank -1 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -254> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: _add_conns ranks=[2,0,1] 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -253> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-c con 0x55bca03275a0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -252> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-a con 0x55bca0321630 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -251> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-b con 0x55bca032cc10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -250> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -249> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -248> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -247> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): _renew_subs 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -246> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient(hunting): authenticate will time out at 2280.833560s 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -245> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request con 0x55bca03275a0 auth_method 0 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -244> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.679 INFO:tasks.workunit.client.0.smithi104.stderr: -243> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -242> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -241> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request con 0x55bca0321630 auth_method 0 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -240> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -239> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -238> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -237> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -236> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -235> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -234> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -233> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -232> 2024-04-03T04:00:25.092+0000 7fd9b4e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -231> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_done global_id 6185 payload 274 2024-04-03T04:00:25.680 INFO:tasks.workunit.client.0.smithi104.stderr: -230> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr: -229> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 1 monclient: found mon.noname-c 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr: -228> 2024-04-03T04:00:25.092+0000 7fd9b3e96640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr: -227> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr: -226> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr: -225> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: dump: 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.681 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: -224> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: -223> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: -222> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: -221> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6185 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: -220> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: get_monmap_and_config success 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: -219> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 4 set_mon_vals no callback set 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: -218> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: -217> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr: -216> 2024-04-03T04:00:25.092+0000 7fd88b7fe640 10 monclient: dump: 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.682 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr: -215> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: shutdown 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr: -214> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: build_initial_monmap 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr: -213> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 build_initial for_mkfs: 0 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr: -212> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: monmap: 2024-04-03T04:00:25.683 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr: -211> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr: -210> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr: -209> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding auth protocol: cephx 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr: -208> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.684 INFO:tasks.workunit.client.0.smithi104.stderr: -207> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -206> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -205> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -204> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -203> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -202> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -201> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -200> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -199> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -198> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: crc 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -197> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f2c60) adding con mode: secure 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -196> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -195> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 librados: starting msgr at 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -194> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 librados: starting objecter 2024-04-03T04:00:25.685 INFO:tasks.workunit.client.0.smithi104.stderr: -193> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command objecter_requests cmddesc objecter_requests hook 0x55bca02e75e0 EEXIST 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -192> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 librados: setting wanted keys 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -191> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 1 librados: calling monclient init 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -190> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: init 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -189> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding auth protocol: cephx 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -188> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding auth protocol: cephx 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -187> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding auth protocol: cephx 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -186> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -185> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -184> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -183> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -182> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -181> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -180> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.686 INFO:tasks.workunit.client.0.smithi104.stderr: -179> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -178> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -177> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -176> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: crc 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -175> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 AuthRegistry(0x55bca02f1e30) adding con mode: secure 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -174> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -173> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -172> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command rotate-key cmddesc rotate-key hook 0x55bca02f1f78 EEXIST 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -171> 2024-04-03T04:00:25.092+0000 7fd9b6b7c980 10 monclient: _reopen_session rank -1 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -170> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -169> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-a con 0x55bca03275a0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -168> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-b con 0x55bca032cc10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -167> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): picked mon.noname-c con 0x55bca03261d0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -166> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.687 INFO:tasks.workunit.client.0.smithi104.stderr: -165> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -164> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): start opening mon connection 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -163> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): _renew_subs 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -162> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient(hunting): authenticate will time out at 2280.836067s 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -161> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): get_auth_request con 0x55bca03261d0 auth_method 0 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -160> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -159> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -158> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -157> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request con 0x55bca03275a0 auth_method 0 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -156> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -155> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -154> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -153> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -152> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.688 INFO:tasks.workunit.client.0.smithi104.stderr: -151> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -150> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -149> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -148> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -147> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient(hunting): handle_auth_done global_id 6188 payload 824 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -146> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient: _finish_hunting 0 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -145> 2024-04-03T04:00:25.096+0000 7fd9b4697640 1 monclient: found mon.noname-c 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -144> 2024-04-03T04:00:25.096+0000 7fd9b4697640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -143> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -142> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr: -141> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: dump: 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.689 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr: -140> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: _finish_auth 0 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr: -139> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: _check_auth_tickets 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr: -138> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: handle_config config(0 keys) 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr: -137> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr: -136> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr: -135> 2024-04-03T04:00:25.096+0000 7fd88b7fe640 4 set_mon_vals no callback set 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr: -134> 2024-04-03T04:00:25.096+0000 7fd889ffb640 10 monclient: dump: 2024-04-03T04:00:25.690 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr: -133> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 5 monclient: authenticate success, global_id 6188 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr: -132> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr: -131> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr: -130> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _renew_subs 2024-04-03T04:00:25.691 INFO:tasks.workunit.client.0.smithi104.stderr: -129> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -128> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 1 librados: init done 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -127> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cr dump hook 0x55bca0323188 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -126> 2024-04-03T04:00:25.096+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -125> 2024-04-03T04:00:25.096+0000 7fd889ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -124> 2024-04-03T04:00:25.096+0000 7fd889ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -123> 2024-04-03T04:00:25.096+0000 7fd889ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -122> 2024-04-03T04:00:25.096+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd87c066d60 auth_method 0 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -121> 2024-04-03T04:00:25.096+0000 7fd9b4e98640 10 monclient: get_auth_request con 0x55bca0341950 auth_method 0 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -120> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -119> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 realm 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -118> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -117> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -116> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -115> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.692 INFO:tasks.workunit.client.0.smithi104.stderr: -114> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -113> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -112> 2024-04-03T04:00:25.100+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x55bca0345b70 auth_method 0 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -111> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -110> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -109> 2024-04-03T04:00:25.100+0000 7fd9b4e98640 10 monclient: get_auth_request con 0x55bca03493d0 auth_method 0 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -108> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -107> 2024-04-03T04:00:25.100+0000 7fd9b6b7c980 20 searching for the correct realm 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -106> 2024-04-03T04:00:25.100+0000 7fd9b4697640 10 monclient: get_auth_request con 0x55bca034e0a0 auth_method 0 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -105> 2024-04-03T04:00:25.104+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd9a4007f10 auth_method 0 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -104> 2024-04-03T04:00:25.308+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd9a4007f10 auth_method 0 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -103> 2024-04-03T04:00:25.308+0000 7fd9b4e98640 10 monclient: get_auth_request con 0x7fd9ac0671e0 auth_method 0 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -102> 2024-04-03T04:00:25.312+0000 7fd9b3e96640 0 -- 172.21.15.104:0/9978940 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fd9a4007f10 msgr2=0x7fd9a40b8af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:25.693 INFO:tasks.workunit.client.0.smithi104.stderr: -101> 2024-04-03T04:00:25.312+0000 7fd889ffb640 1 client.6188.objecter ms_handle_reset 0x7fd9a4007f10 session 0x7fd9a40c6070 osd.7 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -100> 2024-04-03T04:00:25.312+0000 7fd889ffb640 10 monclient: _renew_subs 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -99> 2024-04-03T04:00:25.312+0000 7fd889ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -98> 2024-04-03T04:00:25.312+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd87c077490 auth_method 0 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -97> 2024-04-03T04:00:25.316+0000 7fd9b4697640 10 monclient: get_auth_request con 0x7fd9ac0650b0 auth_method 0 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -96> 2024-04-03T04:00:25.320+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd9ac088040 auth_method 0 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -95> 2024-04-03T04:00:25.320+0000 7fd9b3e96640 0 -- 172.21.15.104:0/9978940 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fd9ac088040 msgr2=0x7fd9ac05c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -94> 2024-04-03T04:00:25.524+0000 7fd9b3e96640 10 monclient: get_auth_request con 0x7fd9ac088040 auth_method 0 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -93> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -92> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -91> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -90> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -89> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -88> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:25.694 INFO:tasks.workunit.client.0.smithi104.stderr: -87> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -86> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -85> 2024-04-03T04:00:25.536+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -84> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -83> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -82> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -81> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 zone default found 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -80> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 4 Realm: () 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -79> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -78> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -77> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -76> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 zonegroup default 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -75> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.695 INFO:tasks.workunit.client.0.smithi104.stderr: -74> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -73> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -72> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -71> 2024-04-03T04:00:25.540+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -70> 2024-04-03T04:00:25.544+0000 7fd9b6b7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -69> 2024-04-03T04:00:25.544+0000 7fd9b6b7c980 20 started sync module instance, tier type = 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -68> 2024-04-03T04:00:25.544+0000 7fd9b6b7c980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -67> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=0 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -66> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=1 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -65> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=2 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -64> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=3 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -63> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=4 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -62> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=5 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -61> 2024-04-03T04:00:25.564+0000 7fd9b6b7c980 20 add_watcher() i=6 2024-04-03T04:00:25.696 INFO:tasks.workunit.client.0.smithi104.stderr: -60> 2024-04-03T04:00:25.568+0000 7fd9b6b7c980 20 add_watcher() i=7 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -59> 2024-04-03T04:00:25.568+0000 7fd9b6b7c980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -58> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding auth protocol: cephx 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -57> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding auth protocol: cephx 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -56> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding auth protocol: cephx 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -55> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -54> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -53> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -52> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -51> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -50> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -49> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -48> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -47> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.697 INFO:tasks.workunit.client.0.smithi104.stderr: -46> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -45> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: crc 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -44> 2024-04-03T04:00:25.572+0000 7fd86afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -43> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 AuthRegistry(0x7fffd82094d0) adding con mode: secure 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -42> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -41> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -40> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -39> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cache list hook 0x55bca03260b0 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -38> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cache inspect hook 0x55bca03260b0 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -37> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cache erase hook 0x55bca03260b0 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -36> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command cache zap hook 0x55bca03260b0 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -35> 2024-04-03T04:00:25.572+0000 7fd9b6b7c980 5 note: GC not initialized 2024-04-03T04:00:25.698 INFO:tasks.workunit.client.0.smithi104.stderr: -34> 2024-04-03T04:00:25.576+0000 7fd869fdb640 20 reqs_thread_entry: start 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -33> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command sync trace show hook 0x7fd9a4004470 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -32> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command sync trace history hook 0x7fd9a4004470 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -31> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command sync trace active hook 0x7fd9a4004470 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -30> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 5 asok(0x55bca004c210) register_command sync trace active_short hook 0x7fd9a4004470 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -29> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -28> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 Filter name: none 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -27> 2024-04-03T04:00:25.576+0000 7fd7db7fe640 20 reqs_thread_entry: start 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -26> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -25> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -24> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -23> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -22> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -21> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 : miss 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -20> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.699 INFO:tasks.workunit.client.0.smithi104.stderr: -19> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -18> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -17> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -16> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -15> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -14> 2024-04-03T04:00:25.576+0000 7fd9b6b7c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -13> 2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -12> 2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -11> 2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -10> 2024-04-03T04:00:25.588+0000 7fd9b6b7c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23, ofs0, ns] 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -9> 2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94268630065904 notifier 6188 bl.length()=877 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -8> 2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -7> 2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -6> 2024-04-03T04:00:25.588+0000 7fd88b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:25.700 INFO:tasks.workunit.client.0.smithi104.stderr: -5> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_sources= new_sources= 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: -4> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential sources added=[] removed=[] 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: -3> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_dests= new_dests= 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: -2> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential dests added=[] removed=[] 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: -1> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9b6b7c980 time 2024-04-03T04:00:25.595377+0000 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd9ba452e1f] 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fd9ba452fd3] 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc9ebd85b1] 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x55bc9ebe625d] 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9b92bcd90] 2024-04-03T04:00:25.701 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 0> 2024-04-03T04:00:25.592+0000 7fd9b6b7c980 -1 *** Caught signal (Aborted) ** 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7fd9b6b7c980 thread_name:radosgw-admin 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9b92d5520] 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd9ba452e79] 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fd9ba452fd3] 2024-04-03T04:00:25.702 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc9ebd85b1] 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2ad) [0x55bc9ebe625d] 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9b92bcd90] 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr:--- logging levels --- 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 none 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 lockdep 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 context 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 crush 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_balancer 2024-04-03T04:00:25.703 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_locker 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log_expire 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_migrator 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 3/ 5 mds_quiesce 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 buffer 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 timer 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 filer 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 striper 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 objecter 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rados 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_mirror 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_replay 2024-04-03T04:00:25.704 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_pwl 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 journaler 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objectcacher 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 immutable_obj_cache 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 client 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 osd 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 optracker 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objclass 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 filestore 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 journal 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 ms 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mon 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 0/10 monc 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 paxos 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 tp 2024-04-03T04:00:25.705 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 auth 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 crypto 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 finisher 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 reserver 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 heartbeatmap 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 perfcounter 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 20/20 rgw 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_sync 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_datacache 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_access 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_dbstore 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_flight 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_lifecycle 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_notification 2024-04-03T04:00:25.706 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 javaclient 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 asok 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 throttle 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 refs 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 compressor 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluestore 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluefs 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 bdev 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 kstore 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 4/ 5 rocksdb 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 fuse 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 2/ 5 mgr 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mgrc 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 dpdk 2024-04-03T04:00:25.707 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 eventtrace 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 prioritycache 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 test 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephfs_mirror 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephsqlite 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 crimson_interrupt 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_onode 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_odata 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_omap 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_tm 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_t 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cleaner 2024-04-03T04:00:25.708 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_epm 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_lba 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cache 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_journal 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_device 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_backref 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 alienstore 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mclock 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cyanstore 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 ceph_exporter 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 memstore 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 trace 2024-04-03T04:00:25.709 INFO:tasks.workunit.client.0.smithi104.stderr: -2/-2 (syslog threshold) 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 99/99 (stderr threshold) 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd7db7fe640 / http_manager 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd869fdb640 / http_manager 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd86afdd640 / rgw_dt_lg_renew 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd889ffb640 / ms_dispatch 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd88b7fe640 / io_context_pool 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd899ffb640 / ms_dispatch 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd8a0e09640 / ms_dispatch 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd8a260c640 / io_context_pool 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b3e96640 / msgr-worker-2 2024-04-03T04:00:25.710 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b4697640 / msgr-worker-1 2024-04-03T04:00:25.711 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b4e98640 / msgr-worker-0 2024-04-03T04:00:25.711 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b5699640 / io_context_pool 2024-04-03T04:00:25.711 INFO:tasks.workunit.client.0.smithi104.stderr: 7fd9b6b7c980 / radosgw-admin 2024-04-03T04:00:25.711 INFO:tasks.workunit.client.0.smithi104.stderr: max_recent 500 2024-04-03T04:00:25.711 INFO:tasks.workunit.client.0.smithi104.stderr: max_new 1000 2024-04-03T04:00:25.711 INFO:tasks.workunit.client.0.smithi104.stderr: log_file /var/lib/ceph/crash/2024-04-03T04:00:25.597304Z_22127645-9207-4362-aa67-d0af3cb021c7/log 2024-04-03T04:00:25.711 INFO:tasks.workunit.client.0.smithi104.stderr:--- end dump of recent events --- 2024-04-03T04:00:25.711 INFO:tasks.workunit.client.0.smithi104.stderr:Aborted 2024-04-03T04:00:25.711 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-04-03T04:00:25.712 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:25.712 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:25.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.880+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 realm 2024-04-03T04:00:25.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:25.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:25.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:25.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:25.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:25.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.884+0000 7f18302e2980 20 searching for the correct realm 2024-04-03T04:00:25.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:25.888+0000 7f182e5fe640 0 -- 172.21.15.104:0/3284200864 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f182806dc20 msgr2=0x7f182803f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:26.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.104+0000 7f182d5fc640 0 -- 172.21.15.104:0/3284200864 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f1828036e10 msgr2=0x7f1828056770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:26.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.320+0000 7f18302e2980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:26.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.320+0000 7f18302e2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:26.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.320+0000 7f18302e2980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:26.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.320+0000 7f18302e2980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:26.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.320+0000 7f18302e2980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:26.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.320+0000 7f18302e2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:26.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.320+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:26.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:26.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 zone default found 2024-04-03T04:00:26.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 4 Realm: () 2024-04-03T04:00:26.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:26.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:26.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:26.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 zonegroup default 2024-04-03T04:00:26.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.324+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.328+0000 7f18302e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.328+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.328+0000 7f18302e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.328+0000 7f18302e2980 20 started sync module instance, tier type = 2024-04-03T04:00:26.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.328+0000 7f18302e2980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:26.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.348+0000 7f18302e2980 20 add_watcher() i=0 2024-04-03T04:00:26.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.348+0000 7f18302e2980 20 add_watcher() i=1 2024-04-03T04:00:26.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.348+0000 7f18302e2980 20 add_watcher() i=2 2024-04-03T04:00:26.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.348+0000 7f18302e2980 20 add_watcher() i=3 2024-04-03T04:00:26.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.348+0000 7f18302e2980 20 add_watcher() i=4 2024-04-03T04:00:26.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.348+0000 7f18302e2980 20 add_watcher() i=5 2024-04-03T04:00:26.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.348+0000 7f18302e2980 20 add_watcher() i=6 2024-04-03T04:00:26.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.352+0000 7f18302e2980 20 add_watcher() i=7 2024-04-03T04:00:26.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.352+0000 7f18302e2980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:26.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.356+0000 7f16df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:26.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.356+0000 7f18302e2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:26.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.356+0000 7f18302e2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:26.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.356+0000 7f18302e2980 5 note: GC not initialized 2024-04-03T04:00:26.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.356+0000 7f16de7fc640 20 reqs_thread_entry: start 2024-04-03T04:00:26.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.356+0000 7f18302e2980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:26.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 Filter name: none 2024-04-03T04:00:26.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f164ffff640 20 reqs_thread_entry: start 2024-04-03T04:00:26.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:26.340 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 rados_obj.operate() r=0 bl.length=405 2024-04-03T04:00:26.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:26.341 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:26.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 rados_obj.operate() r=0 bl.length=405 2024-04-03T04:00:26.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.360+0000 7f18302e2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:26.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.368+0000 7f16df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:26.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.372+0000 7f18302e2980 20 remove_watcher() i=0 2024-04-03T04:00:26.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.372+0000 7f18302e2980 2 removed watcher, disabling cache 2024-04-03T04:00:26.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.372+0000 7f18302e2980 20 remove_watcher() i=1 2024-04-03T04:00:26.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.376+0000 7f18302e2980 20 remove_watcher() i=2 2024-04-03T04:00:26.359 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.380+0000 7f18302e2980 20 remove_watcher() i=3 2024-04-03T04:00:26.361 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.380+0000 7f18302e2980 20 remove_watcher() i=4 2024-04-03T04:00:26.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.384+0000 7f18302e2980 20 remove_watcher() i=5 2024-04-03T04:00:26.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.384+0000 7f18302e2980 20 remove_watcher() i=6 2024-04-03T04:00:26.366 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.384+0000 7f18302e2980 20 remove_watcher() i=7 2024-04-03T04:00:26.388 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:26.388 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:00:26.389 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-block-writes id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:00:26.389 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:26.390 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:26.390 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:26.436 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:26.436 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:26.517 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T04:00:26.552 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:26.552 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:26.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.615+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.615+0000 7f6e16913980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.615+0000 7f6e16913980 20 realm 2024-04-03T04:00:26.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.615+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.615+0000 7f6e16913980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.615+0000 7f6e16913980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:26.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.615+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.615+0000 7f6e16913980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.615+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.619+0000 7f6e16913980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:26.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.619+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.619+0000 7f6e16913980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:26.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.619+0000 7f6e16913980 20 searching for the correct realm 2024-04-03T04:00:26.604 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.623+0000 7f6e13c2d640 0 -- 172.21.15.104:0/3868152837 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f6e040c2920 msgr2=0x7f6e040db3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:00:26.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.631+0000 7f6e13c2d640 0 -- 172.21.15.104:0/3868152837 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f6e0c0790c0 msgr2=0x7f6e0c082280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:26.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.847+0000 7f6e16913980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:26.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.847+0000 7f6e16913980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:26.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.847+0000 7f6e16913980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:26.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.847+0000 7f6e16913980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:26.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.847+0000 7f6e16913980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:26.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.847+0000 7f6e16913980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:26.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.847+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.847+0000 7f6e16913980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.847+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:26.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:26.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 zone default found 2024-04-03T04:00:26.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 4 Realm: () 2024-04-03T04:00:26.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:26.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:26.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:26.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 zonegroup default 2024-04-03T04:00:26.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.833 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:26.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 started sync module instance, tier type = 2024-04-03T04:00:26.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.851+0000 7f6e16913980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:26.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.875+0000 7f6e16913980 20 add_watcher() i=0 2024-04-03T04:00:26.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.875+0000 7f6e16913980 20 add_watcher() i=1 2024-04-03T04:00:26.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.875+0000 7f6e16913980 20 add_watcher() i=2 2024-04-03T04:00:26.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.875+0000 7f6e16913980 20 add_watcher() i=3 2024-04-03T04:00:26.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.875+0000 7f6e16913980 20 add_watcher() i=4 2024-04-03T04:00:26.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.875+0000 7f6e16913980 20 add_watcher() i=5 2024-04-03T04:00:26.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.875+0000 7f6e16913980 20 add_watcher() i=6 2024-04-03T04:00:26.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.879+0000 7f6e16913980 20 add_watcher() i=7 2024-04-03T04:00:26.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.879+0000 7f6e16913980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:26.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.883+0000 7f6ccafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:26.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.883+0000 7f6e16913980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:26.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.883+0000 7f6e16913980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:26.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.883+0000 7f6e16913980 5 note: GC not initialized 2024-04-03T04:00:26.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.883+0000 7f6cc9fdb640 20 reqs_thread_entry: start 2024-04-03T04:00:26.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:26.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 20 Filter name: none 2024-04-03T04:00:26.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6c3b7fe640 20 reqs_thread_entry: start 2024-04-03T04:00:26.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-04-03T04:00:26.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:26.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-04-03T04:00:26.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-04-03T04:00:26.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 : miss 2024-04-03T04:00:26.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 20 rados->read ofs=0 len=0 2024-04-03T04:00:26.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 20 rados_obj.operate() r=0 bl.length=405 2024-04-03T04:00:26.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:26.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:26.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:00:26.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:26.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.887+0000 7f6e16913980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 2024-04-03T04:00:26.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.891+0000 7f6e16913980 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to be held by another RGW process; skipping for now 2024-04-03T04:00:26.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.891+0000 7f6ccafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:26.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.895+0000 7f6e16913980 20 remove_watcher() i=0 2024-04-03T04:00:26.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.895+0000 7f6e16913980 2 removed watcher, disabling cache 2024-04-03T04:00:26.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.899+0000 7f6e16913980 20 remove_watcher() i=1 2024-04-03T04:00:26.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.899+0000 7f6e16913980 20 remove_watcher() i=2 2024-04-03T04:00:26.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.903+0000 7f6e16913980 20 remove_watcher() i=3 2024-04-03T04:00:26.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.903+0000 7f6e16913980 20 remove_watcher() i=4 2024-04-03T04:00:26.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.907+0000 7f6e16913980 20 remove_watcher() i=5 2024-04-03T04:00:26.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.907+0000 7f6e16913980 20 remove_watcher() i=6 2024-04-03T04:00:26.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:26.907+0000 7f6e16913980 20 remove_watcher() i=7 2024-04-03T04:00:26.906 INFO:tasks.workunit.client.0.smithi104.stderr:waiting 30 seconds for reshard lock to expire... 2024-04-03T04:00:56.934 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T04:00:56.966 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:56.967 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:57.011 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.031+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.031+0000 7f1b08ce2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.031+0000 7f1b08ce2980 20 realm 2024-04-03T04:00:57.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.031+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.031+0000 7f1b08ce2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.031+0000 7f1b08ce2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:57.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.031+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.013 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.031+0000 7f1b08ce2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.031+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.035+0000 7f1b08ce2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:57.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.035+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.035+0000 7f1b08ce2980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:57.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.035+0000 7f1b08ce2980 20 searching for the correct realm 2024-04-03T04:00:57.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.243+0000 7f1b06ffe640 0 -- 172.21.15.104:0/3557824527 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f1af8038070 msgr2=0x7f1af805b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:57.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.459+0000 7f1b05ffc640 0 -- 172.21.15.104:0/3557824527 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f1af808e620 msgr2=0x7f1af8066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:57.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.675+0000 7f1b08ce2980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:57.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.675+0000 7f1b08ce2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:57.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.675+0000 7f1b08ce2980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:57.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.675+0000 7f1b08ce2980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:57.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.675+0000 7f1b08ce2980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:57.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.675+0000 7f1b08ce2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:57.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.675+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.659 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:57.660 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:57.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 zone default found 2024-04-03T04:00:57.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 4 Realm: () 2024-04-03T04:00:57.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:57.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:57.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:57.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 zonegroup default 2024-04-03T04:00:57.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.663 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.663 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 started sync module instance, tier type = 2024-04-03T04:00:57.663 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.679+0000 7f1b08ce2980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:57.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.703+0000 7f1b08ce2980 20 add_watcher() i=0 2024-04-03T04:00:57.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.703+0000 7f1b08ce2980 20 add_watcher() i=1 2024-04-03T04:00:57.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.703+0000 7f1b08ce2980 20 add_watcher() i=2 2024-04-03T04:00:57.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.703+0000 7f1b08ce2980 20 add_watcher() i=3 2024-04-03T04:00:57.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.703+0000 7f1b08ce2980 20 add_watcher() i=4 2024-04-03T04:00:57.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.703+0000 7f1b08ce2980 20 add_watcher() i=5 2024-04-03T04:00:57.686 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.703+0000 7f1b08ce2980 20 add_watcher() i=6 2024-04-03T04:00:57.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.707+0000 7f1b08ce2980 20 add_watcher() i=7 2024-04-03T04:00:57.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.707+0000 7f1b08ce2980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:57.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f19bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:57.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f1b08ce2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:57.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f1b08ce2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:57.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f1b08ce2980 5 note: GC not initialized 2024-04-03T04:00:57.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f19377fe640 20 reqs_thread_entry: start 2024-04-03T04:00:57.693 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f1b08ce2980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:57.694 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f1b08ce2980 20 Filter name: none 2024-04-03T04:00:57.694 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f19357fa640 20 reqs_thread_entry: start 2024-04-03T04:00:57.694 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f1b08ce2980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-04-03T04:00:57.694 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.711+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:57.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-04-03T04:00:57.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-04-03T04:00:57.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 : miss 2024-04-03T04:00:57.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 20 rados_obj.operate() r=0 bl.length=405 2024-04-03T04:00:57.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:57.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:57.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:00:57.696 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:57.697 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 2024-04-03T04:00:57.698 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.715+0000 7f1b08ce2980 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-04-03T04:00:57.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.731+0000 7f1b08ce2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:57.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.731+0000 7f1b08ce2980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:57.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.731+0000 7f1b08ce2980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:57.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.731+0000 7f1b08ce2980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23, ofs0, ns] 2024-04-03T04:00:57.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.731+0000 7f19e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94808948830064 notifier 6242 bl.length()=877 2024-04-03T04:00:57.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.731+0000 7f19e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:57.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.731+0000 7f19e9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:57.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.731+0000 7f19e9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:57.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.735+0000 7f1b08ce2980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_sources= new_sources= 2024-04-03T04:00:57.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.735+0000 7f1b08ce2980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential sources added=[] removed=[] 2024-04-03T04:00:57.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.735+0000 7f1b08ce2980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_dests= new_dests= 2024-04-03T04:00:57.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.735+0000 7f1b08ce2980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential dests added=[] removed=[] 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.0 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.0 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.1 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.1 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.2 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.2 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.3 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.3 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.4 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.4 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.5 2024-04-03T04:00:57.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.5 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.6 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.6 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.7 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.7 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.8 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.8 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.9 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.9 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.10 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.10 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.11 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2.11 2024-04-03T04:00:57.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.0 2024-04-03T04:00:57.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.1 2024-04-03T04:00:57.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.2 2024-04-03T04:00:57.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.739+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.3 2024-04-03T04:00:57.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.743+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.4 2024-04-03T04:00:57.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.743+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.5 2024-04-03T04:00:57.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.743+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.6 2024-04-03T04:00:57.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.743+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.7 2024-04-03T04:00:57.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.743+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.8 2024-04-03T04:00:57.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.747+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.9 2024-04-03T04:00:57.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.747+0000 7f1b08ce2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23.10 2024-04-03T04:00:57.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.755+0000 7f1b08ce2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 : hit (requested=0x17, cached=0x17) 2024-04-03T04:00:57.735 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.755+0000 7f1b08ce2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 2024-04-03T04:00:57.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.755+0000 7f1b08ce2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:57.738 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.755+0000 7f1b08ce2980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:57.739 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.755+0000 7f1b08ce2980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:57.739 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.755+0000 7f1b08ce2980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23, ofs0, ns] 2024-04-03T04:00:57.739 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.759+0000 7f19e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94808948830064 notifier 6242 bl.length()=845 2024-04-03T04:00:57.739 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.759+0000 7f19e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 info.flags=0x17 2024-04-03T04:00:57.739 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.759+0000 7f19e9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 to cache LRU end 2024-04-03T04:00:57.739 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.759+0000 7f19e9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:00:57.742 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.759+0000 7f1b08ce2980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_sources= new_sources= 2024-04-03T04:00:57.742 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.759+0000 7f1b08ce2980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential sources added=[] removed=[] 2024-04-03T04:00:57.742 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.759+0000 7f1b08ce2980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): orig_dests= new_dests= 2024-04-03T04:00:57.742 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.759+0000 7f1b08ce2980 20 handle_bi_update(): bucket=:abort-at-block-writes[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23]): potential dests added=[] removed=[] 2024-04-03T04:00:57.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.763+0000 7f1b08ce2980 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2024-04-03T04:00:57.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.767+0000 7f19bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:57.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.771+0000 7f1b08ce2980 20 remove_watcher() i=0 2024-04-03T04:00:57.754 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.771+0000 7f1b08ce2980 2 removed watcher, disabling cache 2024-04-03T04:00:57.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.775+0000 7f1b08ce2980 20 remove_watcher() i=1 2024-04-03T04:00:57.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.779+0000 7f1b08ce2980 20 remove_watcher() i=2 2024-04-03T04:00:57.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.779+0000 7f1b08ce2980 20 remove_watcher() i=3 2024-04-03T04:00:57.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.783+0000 7f1b08ce2980 20 remove_watcher() i=4 2024-04-03T04:00:57.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.783+0000 7f1b08ce2980 20 remove_watcher() i=5 2024-04-03T04:00:57.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.787+0000 7f1b08ce2980 20 remove_watcher() i=6 2024-04-03T04:00:57.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.787+0000 7f1b08ce2980 20 remove_watcher() i=7 2024-04-03T04:00:57.787 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-04-03T04:00:57.816 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:00:57.816 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:00:57.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.879+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 realm 2024-04-03T04:00:57.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:00:57.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:57.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:57.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:57.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:00:57.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.883+0000 7fcff61ed980 20 searching for the correct realm 2024-04-03T04:00:57.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:57.887+0000 7fcff3507640 0 -- 172.21.15.104:0/3412885239 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fcfe4055ed0 msgr2=0x7fcfe4054b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:58.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.099+0000 7fcff4509640 0 -- 172.21.15.104:0/3412885239 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x563b36b11c10 msgr2=0x563b36b14000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:00:58.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.115+0000 7fcff61ed980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:00:58.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.115+0000 7fcff61ed980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:00:58.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.115+0000 7fcff61ed980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:00:58.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.115+0000 7fcff61ed980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:00:58.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.115+0000 7fcff61ed980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:00:58.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.115+0000 7fcff61ed980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:00:58.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.115+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.115+0000 7fcff61ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:58.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.115+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:00:58.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:00:58.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 zone default found 2024-04-03T04:00:58.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 4 Realm: () 2024-04-03T04:00:58.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:00:58.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:00:58.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:00:58.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 zonegroup default 2024-04-03T04:00:58.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:58.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:58.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:00:58.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 started sync module instance, tier type = 2024-04-03T04:00:58.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.119+0000 7fcff61ed980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:00:58.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.143+0000 7fcff61ed980 20 add_watcher() i=0 2024-04-03T04:00:58.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.143+0000 7fcff61ed980 20 add_watcher() i=1 2024-04-03T04:00:58.124 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.143+0000 7fcff61ed980 20 add_watcher() i=2 2024-04-03T04:00:58.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.143+0000 7fcff61ed980 20 add_watcher() i=3 2024-04-03T04:00:58.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.143+0000 7fcff61ed980 20 add_watcher() i=4 2024-04-03T04:00:58.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.143+0000 7fcff61ed980 20 add_watcher() i=5 2024-04-03T04:00:58.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.143+0000 7fcff61ed980 20 add_watcher() i=6 2024-04-03T04:00:58.126 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.143+0000 7fcff61ed980 20 add_watcher() i=7 2024-04-03T04:00:58.127 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.143+0000 7fcff61ed980 2 all 8 watchers are set, enabling cache 2024-04-03T04:00:58.130 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.147+0000 7fcea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:58.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:00:58.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:00:58.131 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 5 note: GC not initialized 2024-04-03T04:00:58.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcea8fe1640 20 reqs_thread_entry: start 2024-04-03T04:00:58.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 init_complete bucket index max shards: 11 2024-04-03T04:00:58.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 Filter name: none 2024-04-03T04:00:58.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fce227fc640 20 reqs_thread_entry: start 2024-04-03T04:00:58.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:58.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:58.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:58.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.151+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.155+0000 7fcff61ed980 20 rados_obj.operate() r=0 bl.length=189 2024-04-03T04:00:58.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.155+0000 7fcff61ed980 20 rados->read ofs=0 len=0 2024-04-03T04:00:58.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.155+0000 7fcff61ed980 20 rados_obj.operate() r=0 bl.length=373 2024-04-03T04:00:58.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.155+0000 7fcff61ed980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:00:58.139 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.159+0000 7fcea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:00:58.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.163+0000 7fcff61ed980 20 remove_watcher() i=0 2024-04-03T04:00:58.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.163+0000 7fcff61ed980 2 removed watcher, disabling cache 2024-04-03T04:00:58.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.167+0000 7fcff61ed980 20 remove_watcher() i=1 2024-04-03T04:00:58.149 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.167+0000 7fcff61ed980 20 remove_watcher() i=2 2024-04-03T04:00:58.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.171+0000 7fcff61ed980 20 remove_watcher() i=3 2024-04-03T04:00:58.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.171+0000 7fcff61ed980 20 remove_watcher() i=4 2024-04-03T04:00:58.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.175+0000 7fcff61ed980 20 remove_watcher() i=5 2024-04-03T04:00:58.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.175+0000 7fcff61ed980 20 remove_watcher() i=6 2024-04-03T04:00:58.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:00:58.175+0000 7fcff61ed980 20 remove_watcher() i=7 2024-04-03T04:00:58.179 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:58.179 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:00:58.179 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-block-writes id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-04-03T04:00:58.179 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:58.180 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:58.181 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:58.219 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:58.219 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:58.724 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:58.724 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.087 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-04-03T04:00:59.087 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:00:59.090 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.090 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.219 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.220 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.299 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.299 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.386 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.387 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.476 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.476 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.569 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.570 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.666 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.667 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.756 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.756 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.846 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.847 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:00:59.952 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:00:59.952 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.033 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.033 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.121 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.122 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.212 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.212 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.295 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.295 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.387 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.387 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.481 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.481 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.573 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.573 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.667 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.667 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.756 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.756 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.847 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.847 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:00.937 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:00.938 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:01.031 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:01.031 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:01.113 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-04-03T04:01:01.144 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:01.144 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:01.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.207+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 realm 2024-04-03T04:01:01.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:01.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:01.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:01.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.211+0000 7f24957fb980 20 searching for the correct realm 2024-04-03T04:01:01.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.219+0000 7f2493316640 0 -- 172.21.15.104:0/869950976 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x55a98e6d0f70 msgr2=0x55a98e6d3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:01.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.223+0000 7f2492b15640 0 -- 172.21.15.104:0/869950976 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f248c0c1960 msgr2=0x7f248c1117a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:01.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.231+0000 7f24957fb980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:01.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.231+0000 7f24957fb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:01.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.231+0000 7f24957fb980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:01.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.231+0000 7f24957fb980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:01.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.231+0000 7f24957fb980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:01.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.231+0000 7f24957fb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:01.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.231+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.231+0000 7f24957fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.231+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 zone default found 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 4 Realm: () 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 zonegroup default 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 started sync module instance, tier type = 2024-04-03T04:01:01.218 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.235+0000 7f24957fb980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:01.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.251+0000 7f24957fb980 20 add_watcher() i=0 2024-04-03T04:01:01.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.251+0000 7f24957fb980 20 add_watcher() i=1 2024-04-03T04:01:01.234 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.251+0000 7f24957fb980 20 add_watcher() i=2 2024-04-03T04:01:01.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.251+0000 7f24957fb980 20 add_watcher() i=3 2024-04-03T04:01:01.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.251+0000 7f24957fb980 20 add_watcher() i=4 2024-04-03T04:01:01.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.251+0000 7f24957fb980 20 add_watcher() i=5 2024-04-03T04:01:01.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.251+0000 7f24957fb980 20 add_watcher() i=6 2024-04-03T04:01:01.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.251+0000 7f24957fb980 20 add_watcher() i=7 2024-04-03T04:01:01.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.251+0000 7f24957fb980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:01.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f2349fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:01.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f24957fb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:01.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f24957fb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:01.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f24957fb980 5 note: GC not initialized 2024-04-03T04:01:01.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f2348fe1640 20 reqs_thread_entry: start 2024-04-03T04:01:01.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f24957fb980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:01.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f24957fb980 20 Filter name: none 2024-04-03T04:01:01.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f22c27fc640 20 reqs_thread_entry: start 2024-04-03T04:01:01.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f24957fb980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:01.238 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.255+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.259+0000 7f24957fb980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:01.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.259+0000 7f24957fb980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:01.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.259+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.259+0000 7f24957fb980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:01.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.259+0000 7f24957fb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.259+0000 7f24957fb980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:01.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.259+0000 7f24957fb980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:01.243 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.263+0000 7f2349fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:01.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.267+0000 7f24957fb980 20 remove_watcher() i=0 2024-04-03T04:01:01.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.267+0000 7f24957fb980 2 removed watcher, disabling cache 2024-04-03T04:01:01.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.267+0000 7f24957fb980 20 remove_watcher() i=1 2024-04-03T04:01:01.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.271+0000 7f24957fb980 20 remove_watcher() i=2 2024-04-03T04:01:01.255 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.271+0000 7f24957fb980 20 remove_watcher() i=3 2024-04-03T04:01:01.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.275+0000 7f24957fb980 20 remove_watcher() i=4 2024-04-03T04:01:01.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.275+0000 7f24957fb980 20 remove_watcher() i=5 2024-04-03T04:01:01.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.279+0000 7f24957fb980 20 remove_watcher() i=6 2024-04-03T04:01:01.260 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.279+0000 7f24957fb980 20 remove_watcher() i=7 2024-04-03T04:01:01.274 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:01.275 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:01.275 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-commit-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:01:01.275 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:01.275 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-04-03T04:01:01.305 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:01.305 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:01.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.367+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.367+0000 7f562f2b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.367+0000 7f562f2b4980 20 realm 2024-04-03T04:01:01.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.367+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.367+0000 7f562f2b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.367+0000 7f562f2b4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:01.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.371+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.371+0000 7f562f2b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.371+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.371+0000 7f562f2b4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:01.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.371+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.371+0000 7f562f2b4980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:01.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.371+0000 7f562f2b4980 20 searching for the correct realm 2024-04-03T04:01:01.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.375+0000 7f562c5ce640 0 -- 172.21.15.104:0/586645764 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f561c0ad440 msgr2=0x7f561c0f1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:01.570 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.587+0000 7f562d5d0640 0 -- 172.21.15.104:0/586645764 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x55b1449d9540 msgr2=0x55b1449db950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:01.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:01.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:01.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:01.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:01.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:01.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:01.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:01.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:01.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 zone default found 2024-04-03T04:01:01.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 4 Realm: () 2024-04-03T04:01:01.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:01.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:01.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:01.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 zonegroup default 2024-04-03T04:01:01.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.607+0000 7f562f2b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.611+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.611+0000 7f562f2b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.611+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.611+0000 7f562f2b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.611+0000 7f562f2b4980 20 started sync module instance, tier type = 2024-04-03T04:01:01.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.611+0000 7f562f2b4980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:01.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.631+0000 7f562f2b4980 20 add_watcher() i=0 2024-04-03T04:01:01.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.631+0000 7f562f2b4980 20 add_watcher() i=1 2024-04-03T04:01:01.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.631+0000 7f562f2b4980 20 add_watcher() i=2 2024-04-03T04:01:01.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.631+0000 7f562f2b4980 20 add_watcher() i=3 2024-04-03T04:01:01.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.631+0000 7f562f2b4980 20 add_watcher() i=4 2024-04-03T04:01:01.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.631+0000 7f562f2b4980 20 add_watcher() i=5 2024-04-03T04:01:01.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.631+0000 7f562f2b4980 20 add_watcher() i=6 2024-04-03T04:01:01.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.631+0000 7f562f2b4980 20 add_watcher() i=7 2024-04-03T04:01:01.614 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.631+0000 7f562f2b4980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:01.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f54e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:01.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f562f2b4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:01.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f562f2b4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:01.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f562f2b4980 5 note: GC not initialized 2024-04-03T04:01:01.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f54e1fe3640 20 reqs_thread_entry: start 2024-04-03T04:01:01.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f562f2b4980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:01.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f562f2b4980 20 Filter name: none 2024-04-03T04:01:01.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f54537fe640 20 reqs_thread_entry: start 2024-04-03T04:01:01.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f562f2b4980 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-04-03T04:01:01.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.635+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:01.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-04-03T04:01:01.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-04-03T04:01:01.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 : miss 2024-04-03T04:01:01.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:01.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 info.flags=0x17 2024-04-03T04:01:01.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 to cache LRU end 2024-04-03T04:01:01.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:01.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:01.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.639+0000 7f562f2b4980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 2024-04-03T04:01:01.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f562f2b4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 info.flags=0x17 2024-04-03T04:01:01.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f562f2b4980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 to cache LRU end 2024-04-03T04:01:01.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f562f2b4980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:01.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f562f2b4980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24, ofs0, ns] 2024-04-03T04:01:01.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f55037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 94219848802672 notifier 6290 bl.length()=893 2024-04-03T04:01:01.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f55037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 info.flags=0x17 2024-04-03T04:01:01.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f55037fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 to cache LRU end 2024-04-03T04:01:01.631 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f55037fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:01.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f562f2b4980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): orig_sources= new_sources= 2024-04-03T04:01:01.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f562f2b4980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): potential sources added=[] removed=[] 2024-04-03T04:01:01.633 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f562f2b4980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): orig_dests= new_dests= 2024-04-03T04:01:01.634 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.651+0000 7f562f2b4980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): potential dests added=[] removed=[] 2024-04-03T04:01:01.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.0 2024-04-03T04:01:01.638 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.0 2024-04-03T04:01:01.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.1 2024-04-03T04:01:01.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.1 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.2 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.2 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.3 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.3 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.4 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.4 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.5 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.5 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.6 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.6 2024-04-03T04:01:01.641 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.7 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.7 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.8 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.8 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.9 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.9 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.10 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.10 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.11 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1.11 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.0 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1 2024-04-03T04:01:01.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.655+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2 2024-04-03T04:01:01.643 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.659+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.3 2024-04-03T04:01:01.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.659+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.4 2024-04-03T04:01:01.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.659+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.5 2024-04-03T04:01:01.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.659+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.6 2024-04-03T04:01:01.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.663+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.7 2024-04-03T04:01:01.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.663+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.8 2024-04-03T04:01:01.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.663+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.9 2024-04-03T04:01:01.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.663+0000 7f562f2b4980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.10 2024-04-03T04:01:01.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.671+0000 7f562f2b4980 -1 Injecting error=-5 at location=commit_target_layout 2024-04-03T04:01:01.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.671+0000 7f562f2b4980 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-04-03T04:01:01.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.675+0000 7f54e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:01.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.679+0000 7f562f2b4980 20 remove_watcher() i=0 2024-04-03T04:01:01.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.679+0000 7f562f2b4980 2 removed watcher, disabling cache 2024-04-03T04:01:01.664 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.683+0000 7f562f2b4980 20 remove_watcher() i=1 2024-04-03T04:01:01.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.683+0000 7f562f2b4980 20 remove_watcher() i=2 2024-04-03T04:01:01.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.687+0000 7f562f2b4980 20 remove_watcher() i=3 2024-04-03T04:01:01.670 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.687+0000 7f562f2b4980 20 remove_watcher() i=4 2024-04-03T04:01:01.672 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.691+0000 7f562f2b4980 20 remove_watcher() i=5 2024-04-03T04:01:01.673 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.691+0000 7f562f2b4980 20 remove_watcher() i=6 2024-04-03T04:01:01.674 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.691+0000 7f562f2b4980 20 remove_watcher() i=7 2024-04-03T04:01:01.690 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-04-03T04:01:01.716 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:01.716 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:01.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.779+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 realm 2024-04-03T04:01:01.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:01.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:01.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:01.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:01.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:01.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.783+0000 7fdd041ff980 20 searching for the correct realm 2024-04-03T04:01:01.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.787+0000 7fdd01519640 0 -- 172.21.15.104:0/1429866568 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fdcf40bcbb0 msgr2=0x7fdcf40c9940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:01.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:01.999+0000 7fdd01d1a640 0 -- 172.21.15.104:0/1429866568 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x555c7468d620 msgr2=0x555c7468fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:02.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:02.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:02.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:02.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:02.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:02.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:02.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:02.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:02.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 zone default found 2024-04-03T04:01:02.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 4 Realm: () 2024-04-03T04:01:02.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:02.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:02.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:02.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 zonegroup default 2024-04-03T04:01:02.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.019+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.023+0000 7fdd041ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.023+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.023+0000 7fdd041ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.023+0000 7fdd041ff980 20 started sync module instance, tier type = 2024-04-03T04:01:02.004 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.023+0000 7fdd041ff980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:02.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.047+0000 7fdd041ff980 20 add_watcher() i=0 2024-04-03T04:01:02.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.047+0000 7fdd041ff980 20 add_watcher() i=1 2024-04-03T04:01:02.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.047+0000 7fdd041ff980 20 add_watcher() i=2 2024-04-03T04:01:02.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.047+0000 7fdd041ff980 20 add_watcher() i=3 2024-04-03T04:01:02.028 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.047+0000 7fdd041ff980 20 add_watcher() i=4 2024-04-03T04:01:02.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.047+0000 7fdd041ff980 20 add_watcher() i=5 2024-04-03T04:01:02.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.047+0000 7fdd041ff980 20 add_watcher() i=6 2024-04-03T04:01:02.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.047+0000 7fdd041ff980 20 add_watcher() i=7 2024-04-03T04:01:02.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.047+0000 7fdd041ff980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:02.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.051+0000 7fdbb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:02.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdd041ff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:02.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdd041ff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:02.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdd041ff980 5 note: GC not initialized 2024-04-03T04:01:02.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdbb27fc640 20 reqs_thread_entry: start 2024-04-03T04:01:02.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdd041ff980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:02.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdd041ff980 20 Filter name: none 2024-04-03T04:01:02.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdb23fff640 20 reqs_thread_entry: start 2024-04-03T04:01:02.037 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdd041ff980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:02.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.055+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.059+0000 7fdd041ff980 20 rados_obj.operate() r=0 bl.length=413 2024-04-03T04:01:02.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.059+0000 7fdd041ff980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:02.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.059+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.059+0000 7fdd041ff980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:02.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.059+0000 7fdd041ff980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.059+0000 7fdd041ff980 20 rados_obj.operate() r=0 bl.length=413 2024-04-03T04:01:02.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.059+0000 7fdd041ff980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:02.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.063+0000 7fdbb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:02.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.067+0000 7fdd041ff980 20 remove_watcher() i=0 2024-04-03T04:01:02.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.067+0000 7fdd041ff980 2 removed watcher, disabling cache 2024-04-03T04:01:02.052 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.071+0000 7fdd041ff980 20 remove_watcher() i=1 2024-04-03T04:01:02.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.075+0000 7fdd041ff980 20 remove_watcher() i=2 2024-04-03T04:01:02.057 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.075+0000 7fdd041ff980 20 remove_watcher() i=3 2024-04-03T04:01:02.059 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.079+0000 7fdd041ff980 20 remove_watcher() i=4 2024-04-03T04:01:02.060 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.079+0000 7fdd041ff980 20 remove_watcher() i=5 2024-04-03T04:01:02.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.079+0000 7fdd041ff980 20 remove_watcher() i=6 2024-04-03T04:01:02.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.083+0000 7fdd041ff980 20 remove_watcher() i=7 2024-04-03T04:01:02.079 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:02.079 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:02.079 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-commit-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:01:02.079 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:02.080 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:02.080 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:02.135 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:02.135 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:02.204 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T04:01:02.240 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:02.240 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:02.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.303+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.303+0000 7fa993695980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.303+0000 7fa993695980 20 realm 2024-04-03T04:01:02.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.303+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.303+0000 7fa993695980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.303+0000 7fa993695980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:02.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.303+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.303+0000 7fa993695980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.303+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.307+0000 7fa993695980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:02.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.307+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.307+0000 7fa993695980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:02.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.307+0000 7fa993695980 20 searching for the correct realm 2024-04-03T04:01:02.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.311+0000 7fa9919b1640 0 -- 172.21.15.104:0/144648524 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fa98c066770 msgr2=0x7fa98c029980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:02.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.527+0000 7fa9909af640 0 -- 172.21.15.104:0/144648524 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fa98c029ec0 msgr2=0x7fa98c07c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:02.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.743+0000 7fa993695980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:02.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.743+0000 7fa993695980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:02.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.743+0000 7fa993695980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:02.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.743+0000 7fa993695980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:02.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.743+0000 7fa993695980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:02.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.743+0000 7fa993695980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:02.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.743+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.728 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:02.729 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:02.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 zone default found 2024-04-03T04:01:02.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 4 Realm: () 2024-04-03T04:01:02.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:02.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:02.730 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:02.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 zonegroup default 2024-04-03T04:01:02.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.747+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.751+0000 7fa993695980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.751+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.751+0000 7fa993695980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.751+0000 7fa993695980 20 started sync module instance, tier type = 2024-04-03T04:01:02.732 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.751+0000 7fa993695980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:02.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.775+0000 7fa993695980 20 add_watcher() i=0 2024-04-03T04:01:02.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.775+0000 7fa993695980 20 add_watcher() i=1 2024-04-03T04:01:02.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.775+0000 7fa993695980 20 add_watcher() i=2 2024-04-03T04:01:02.756 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.775+0000 7fa993695980 20 add_watcher() i=3 2024-04-03T04:01:02.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.775+0000 7fa993695980 20 add_watcher() i=4 2024-04-03T04:01:02.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.775+0000 7fa993695980 20 add_watcher() i=5 2024-04-03T04:01:02.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.775+0000 7fa993695980 20 add_watcher() i=6 2024-04-03T04:01:02.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.775+0000 7fa993695980 20 add_watcher() i=7 2024-04-03T04:01:02.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.775+0000 7fa993695980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:02.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa847fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:02.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:02.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:02.764 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 5 note: GC not initialized 2024-04-03T04:01:02.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa846fe5640 20 reqs_thread_entry: start 2024-04-03T04:01:02.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:02.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 20 Filter name: none 2024-04-03T04:01:02.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa844fe1640 20 reqs_thread_entry: start 2024-04-03T04:01:02.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-04-03T04:01:02.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:02.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-04-03T04:01:02.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-04-03T04:01:02.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 : miss 2024-04-03T04:01:02.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.783+0000 7fa993695980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.787+0000 7fa993695980 20 rados_obj.operate() r=0 bl.length=413 2024-04-03T04:01:02.767 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.787+0000 7fa993695980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 info.flags=0x17 2024-04-03T04:01:02.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.787+0000 7fa993695980 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 to cache LRU end 2024-04-03T04:01:02.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.787+0000 7fa993695980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:02.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.787+0000 7fa993695980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:02.768 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.787+0000 7fa993695980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 2024-04-03T04:01:02.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.787+0000 7fa993695980 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-04-03T04:01:02.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.803+0000 7fa993695980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 info.flags=0x17 2024-04-03T04:01:02.786 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.803+0000 7fa993695980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 to cache LRU end 2024-04-03T04:01:02.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.803+0000 7fa993695980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:02.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.803+0000 7fa993695980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24, ofs0, ns] 2024-04-03T04:01:02.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.807+0000 7fa863fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562388 cookie 94013616264720 notifier 6323 bl.length()=893 2024-04-03T04:01:02.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.807+0000 7fa863fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 info.flags=0x17 2024-04-03T04:01:02.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.807+0000 7fa863fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 to cache LRU end 2024-04-03T04:01:02.787 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.807+0000 7fa863fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:02.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.807+0000 7fa993695980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): orig_sources= new_sources= 2024-04-03T04:01:02.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.807+0000 7fa993695980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): potential sources added=[] removed=[] 2024-04-03T04:01:02.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.807+0000 7fa993695980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): orig_dests= new_dests= 2024-04-03T04:01:02.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.807+0000 7fa993695980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): potential dests added=[] removed=[] 2024-04-03T04:01:02.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.0 2024-04-03T04:01:02.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.0 2024-04-03T04:01:02.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.1 2024-04-03T04:01:02.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.1 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.2 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.2 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.3 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.3 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.4 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.4 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.5 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.5 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.6 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.6 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.7 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.7 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.8 2024-04-03T04:01:02.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.8 2024-04-03T04:01:02.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.9 2024-04-03T04:01:02.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.9 2024-04-03T04:01:02.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.10 2024-04-03T04:01:02.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.10 2024-04-03T04:01:02.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.11 2024-04-03T04:01:02.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2.11 2024-04-03T04:01:02.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.0 2024-04-03T04:01:02.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.1 2024-04-03T04:01:02.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.2 2024-04-03T04:01:02.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.815+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.3 2024-04-03T04:01:02.800 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.819+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.4 2024-04-03T04:01:02.801 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.819+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.5 2024-04-03T04:01:02.802 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.819+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.6 2024-04-03T04:01:02.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.823+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.7 2024-04-03T04:01:02.803 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.823+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.8 2024-04-03T04:01:02.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.823+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.9 2024-04-03T04:01:02.805 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.823+0000 7fa993695980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24.10 2024-04-03T04:01:02.812 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.831+0000 7fa993695980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 : hit (requested=0x17, cached=0x17) 2024-04-03T04:01:02.812 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.831+0000 7fa993695980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 2024-04-03T04:01:02.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa993695980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 info.flags=0x17 2024-04-03T04:01:02.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa993695980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 to cache LRU end 2024-04-03T04:01:02.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa993695980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:02.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa993695980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24, ofs0, ns] 2024-04-03T04:01:02.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa874ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562389 cookie 94013616264720 notifier 6323 bl.length()=861 2024-04-03T04:01:02.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa874ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 info.flags=0x17 2024-04-03T04:01:02.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa874ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 to cache LRU end 2024-04-03T04:01:02.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa874ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:02.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa993695980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): orig_sources= new_sources= 2024-04-03T04:01:02.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa993695980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): potential sources added=[] removed=[] 2024-04-03T04:01:02.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa993695980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): orig_dests= new_dests= 2024-04-03T04:01:02.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.835+0000 7fa993695980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24]): potential dests added=[] removed=[] 2024-04-03T04:01:02.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.843+0000 7fa993695980 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-04-03T04:01:02.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.843+0000 7fa847fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:02.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.851+0000 7fa993695980 20 remove_watcher() i=0 2024-04-03T04:01:02.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.851+0000 7fa993695980 2 removed watcher, disabling cache 2024-04-03T04:01:02.834 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.851+0000 7fa993695980 20 remove_watcher() i=1 2024-04-03T04:01:02.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.855+0000 7fa993695980 20 remove_watcher() i=2 2024-04-03T04:01:02.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.859+0000 7fa993695980 20 remove_watcher() i=3 2024-04-03T04:01:02.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.859+0000 7fa993695980 20 remove_watcher() i=4 2024-04-03T04:01:02.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.863+0000 7fa993695980 20 remove_watcher() i=5 2024-04-03T04:01:02.845 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.863+0000 7fa993695980 20 remove_watcher() i=6 2024-04-03T04:01:02.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.863+0000 7fa993695980 20 remove_watcher() i=7 2024-04-03T04:01:02.863 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-04-03T04:01:02.892 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:02.892 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:02.934 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.951+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.936 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 20 realm 2024-04-03T04:01:02.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:02.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:02.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:02.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.955+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:02.938 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.959+0000 7f10f20a5980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:02.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.959+0000 7f10f20a5980 20 searching for the correct realm 2024-04-03T04:01:02.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.963+0000 7f10f03c1640 0 -- 172.21.15.104:0/99109397 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f10e80d7070 msgr2=0x7f10e80f4c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:02.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:02.967+0000 7f10ef3bf640 0 -- 172.21.15.104:0/99109397 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f10e811e790 msgr2=0x7f10e81248e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:03.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.183+0000 7f10f20a5980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:03.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.183+0000 7f10f20a5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:03.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.183+0000 7f10f20a5980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:03.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.183+0000 7f10f20a5980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:03.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.183+0000 7f10f20a5980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:03.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.183+0000 7f10f20a5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:03.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.183+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.183+0000 7f10f20a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:03.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.183+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:03.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:03.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 zone default found 2024-04-03T04:01:03.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 4 Realm: () 2024-04-03T04:01:03.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:03.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:03.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:03.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 zonegroup default 2024-04-03T04:01:03.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:03.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:03.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:03.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 started sync module instance, tier type = 2024-04-03T04:01:03.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.187+0000 7f10f20a5980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:03.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.215+0000 7f10f20a5980 20 add_watcher() i=0 2024-04-03T04:01:03.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.215+0000 7f10f20a5980 20 add_watcher() i=1 2024-04-03T04:01:03.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.215+0000 7f10f20a5980 20 add_watcher() i=2 2024-04-03T04:01:03.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.215+0000 7f10f20a5980 20 add_watcher() i=3 2024-04-03T04:01:03.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.215+0000 7f10f20a5980 20 add_watcher() i=4 2024-04-03T04:01:03.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.215+0000 7f10f20a5980 20 add_watcher() i=5 2024-04-03T04:01:03.196 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.215+0000 7f10f20a5980 20 add_watcher() i=6 2024-04-03T04:01:03.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.215+0000 7f10f20a5980 20 add_watcher() i=7 2024-04-03T04:01:03.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.215+0000 7f10f20a5980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:03.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.223+0000 7f0fa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:03.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.223+0000 7f10f20a5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:03.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.223+0000 7f10f20a5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:03.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.223+0000 7f10f20a5980 5 note: GC not initialized 2024-04-03T04:01:03.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.223+0000 7f0fa4fe1640 20 reqs_thread_entry: start 2024-04-03T04:01:03.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.223+0000 7f10f20a5980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:03.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.223+0000 7f10f20a5980 20 Filter name: none 2024-04-03T04:01:03.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.223+0000 7f0f1e7fc640 20 reqs_thread_entry: start 2024-04-03T04:01:03.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.223+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.227+0000 7f10f20a5980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:03.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.227+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.227+0000 7f10f20a5980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:03.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.227+0000 7f10f20a5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:03.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.227+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.227+0000 7f10f20a5980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:03.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.227+0000 7f10f20a5980 20 rados->read ofs=0 len=0 2024-04-03T04:01:03.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.231+0000 7f10f20a5980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:03.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.231+0000 7f10f20a5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:03.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.231+0000 7f0fa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:03.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.239+0000 7f10f20a5980 20 remove_watcher() i=0 2024-04-03T04:01:03.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.239+0000 7f10f20a5980 2 removed watcher, disabling cache 2024-04-03T04:01:03.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.239+0000 7f10f20a5980 20 remove_watcher() i=1 2024-04-03T04:01:03.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.243+0000 7f10f20a5980 20 remove_watcher() i=2 2024-04-03T04:01:03.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.243+0000 7f10f20a5980 20 remove_watcher() i=3 2024-04-03T04:01:03.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.247+0000 7f10f20a5980 20 remove_watcher() i=4 2024-04-03T04:01:03.230 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.251+0000 7f10f20a5980 20 remove_watcher() i=5 2024-04-03T04:01:03.232 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.251+0000 7f10f20a5980 20 remove_watcher() i=6 2024-04-03T04:01:03.233 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:03.251+0000 7f10f20a5980 20 remove_watcher() i=7 2024-04-03T04:01:03.248 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:03.248 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:03.248 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-commit-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-04-03T04:01:03.248 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:03.249 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:03.249 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:03.278 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:03.278 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:03.766 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:03.767 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.131 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-04-03T04:01:04.131 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:04.133 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.133 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.259 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.259 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.342 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.343 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.427 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.427 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.517 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.517 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.606 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.606 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.708 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.708 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.802 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.802 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.890 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.890 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:04.994 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:04.994 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.084 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.084 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.175 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.175 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.267 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.267 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.353 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.353 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.443 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.443 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.534 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.534 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.623 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.624 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.714 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.714 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.803 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.804 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.894 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.894 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:05.982 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:05.982 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:06.071 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:06.071 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:06.208 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-04-03T04:01:06.240 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:06.240 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:06.284 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.303+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.303+0000 7fd8e635e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.303+0000 7fd8e635e980 20 realm 2024-04-03T04:01:06.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.303+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.303+0000 7fd8e635e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.303+0000 7fd8e635e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:06.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.303+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.303+0000 7fd8e635e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.303+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.307+0000 7fd8e635e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:06.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.307+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.307+0000 7fd8e635e980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:06.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.307+0000 7fd8e635e980 20 searching for the correct realm 2024-04-03T04:01:06.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.315+0000 7fd8e3e79640 0 -- 172.21.15.104:0/3791594726 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x55dc669125e0 msgr2=0x55dc66914aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:06.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.319+0000 7fd8e3678640 0 -- 172.21.15.104:0/3791594726 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fd8dc123020 msgr2=0x7fd8dc104850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:06.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:06.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:06.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:06.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:06.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:06.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:06.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:06.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.311 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 zone default found 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 4 Realm: () 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.327+0000 7fd8e635e980 20 zonegroup default 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.331+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.331+0000 7fd8e635e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.331+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.331+0000 7fd8e635e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.331+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.331+0000 7fd8e635e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.331+0000 7fd8e635e980 20 started sync module instance, tier type = 2024-04-03T04:01:06.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.331+0000 7fd8e635e980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:06.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.347+0000 7fd8e635e980 20 add_watcher() i=0 2024-04-03T04:01:06.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.347+0000 7fd8e635e980 20 add_watcher() i=1 2024-04-03T04:01:06.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.347+0000 7fd8e635e980 20 add_watcher() i=2 2024-04-03T04:01:06.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.347+0000 7fd8e635e980 20 add_watcher() i=3 2024-04-03T04:01:06.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.347+0000 7fd8e635e980 20 add_watcher() i=4 2024-04-03T04:01:06.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.347+0000 7fd8e635e980 20 add_watcher() i=5 2024-04-03T04:01:06.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.347+0000 7fd8e635e980 20 add_watcher() i=6 2024-04-03T04:01:06.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.347+0000 7fd8e635e980 20 add_watcher() i=7 2024-04-03T04:01:06.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.347+0000 7fd8e635e980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:06.331 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd799fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:06.332 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd8e635e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:06.332 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd8e635e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:06.332 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd8e635e980 5 note: GC not initialized 2024-04-03T04:01:06.332 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd798fe1640 20 reqs_thread_entry: start 2024-04-03T04:01:06.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd8e635e980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:06.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd8e635e980 20 Filter name: none 2024-04-03T04:01:06.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd7127fc640 20 reqs_thread_entry: start 2024-04-03T04:01:06.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd8e635e980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:06.333 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.351+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.355+0000 7fd8e635e980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:06.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.355+0000 7fd8e635e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:06.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.355+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.335 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.355+0000 7fd8e635e980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:06.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.355+0000 7fd8e635e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.355+0000 7fd8e635e980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:06.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.355+0000 7fd8e635e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:06.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.359+0000 7fd799fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:06.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.363+0000 7fd8e635e980 20 remove_watcher() i=0 2024-04-03T04:01:06.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.363+0000 7fd8e635e980 2 removed watcher, disabling cache 2024-04-03T04:01:06.346 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.367+0000 7fd8e635e980 20 remove_watcher() i=1 2024-04-03T04:01:06.349 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.367+0000 7fd8e635e980 20 remove_watcher() i=2 2024-04-03T04:01:06.350 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.371+0000 7fd8e635e980 20 remove_watcher() i=3 2024-04-03T04:01:06.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.371+0000 7fd8e635e980 20 remove_watcher() i=4 2024-04-03T04:01:06.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.371+0000 7fd8e635e980 20 remove_watcher() i=5 2024-04-03T04:01:06.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.375+0000 7fd8e635e980 20 remove_watcher() i=6 2024-04-03T04:01:06.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.375+0000 7fd8e635e980 20 remove_watcher() i=7 2024-04-03T04:01:06.372 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:06.372 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:06.372 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-commit-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:01:06.372 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:06.372 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-04-03T04:01:06.405 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:06.405 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:06.447 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 realm 2024-04-03T04:01:06.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:06.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.449 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.450 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:06.450 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.467+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.471+0000 7fe9693ac980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:06.451 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.471+0000 7fe9693ac980 20 searching for the correct realm 2024-04-03T04:01:06.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.475+0000 7fe966ec7640 0 -- 172.21.15.104:0/2634478253 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x55cd85034d10 msgr2=0x55cd850371b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:06.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.483+0000 7fe9676c8640 0 -- 172.21.15.104:0/2634478253 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fe96002c060 msgr2=0x7fe960055db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:06.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.487+0000 7fe9693ac980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:06.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.487+0000 7fe9693ac980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:06.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.487+0000 7fe9693ac980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:06.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.487+0000 7fe9693ac980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:06.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.487+0000 7fe9693ac980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:06.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.487+0000 7fe9693ac980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:06.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.487+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.487+0000 7fe9693ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.487+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 zone default found 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 4 Realm: () 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 zonegroup default 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 started sync module instance, tier type = 2024-04-03T04:01:06.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.491+0000 7fe9693ac980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:06.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.507+0000 7fe9693ac980 20 add_watcher() i=0 2024-04-03T04:01:06.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.507+0000 7fe9693ac980 20 add_watcher() i=1 2024-04-03T04:01:06.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.507+0000 7fe9693ac980 20 add_watcher() i=2 2024-04-03T04:01:06.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.507+0000 7fe9693ac980 20 add_watcher() i=3 2024-04-03T04:01:06.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.507+0000 7fe9693ac980 20 add_watcher() i=4 2024-04-03T04:01:06.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.507+0000 7fe9693ac980 20 add_watcher() i=5 2024-04-03T04:01:06.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.507+0000 7fe9693ac980 20 add_watcher() i=6 2024-04-03T04:01:06.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.507+0000 7fe9693ac980 20 add_watcher() i=7 2024-04-03T04:01:06.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.507+0000 7fe9693ac980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:06.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe81d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:06.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:06.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:06.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 5 note: GC not initialized 2024-04-03T04:01:06.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe797fff640 20 reqs_thread_entry: start 2024-04-03T04:01:06.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:06.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 20 Filter name: none 2024-04-03T04:01:06.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe795ffb640 20 reqs_thread_entry: start 2024-04-03T04:01:06.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-04-03T04:01:06.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:06.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-04-03T04:01:06.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-04-03T04:01:06.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 : miss 2024-04-03T04:01:06.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:06.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 info.flags=0x17 2024-04-03T04:01:06.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 to cache LRU end 2024-04-03T04:01:06.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:06.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:06.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.511+0000 7fe9693ac980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 2024-04-03T04:01:06.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.523+0000 7fe9693ac980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 info.flags=0x17 2024-04-03T04:01:06.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.523+0000 7fe9693ac980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 to cache LRU end 2024-04-03T04:01:06.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.523+0000 7fe9693ac980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:06.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.523+0000 7fe9693ac980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25, ofs0, ns] 2024-04-03T04:01:06.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.523+0000 7fe849ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562392 cookie 94341188317008 notifier 6371 bl.length()=893 2024-04-03T04:01:06.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.523+0000 7fe849ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 info.flags=0x17 2024-04-03T04:01:06.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.523+0000 7fe849ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 to cache LRU end 2024-04-03T04:01:06.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.523+0000 7fe849ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:06.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.527+0000 7fe9693ac980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25]): orig_sources= new_sources= 2024-04-03T04:01:06.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.527+0000 7fe9693ac980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25]): potential sources added=[] removed=[] 2024-04-03T04:01:06.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.527+0000 7fe9693ac980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25]): orig_dests= new_dests= 2024-04-03T04:01:06.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.527+0000 7fe9693ac980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25]): potential dests added=[] removed=[] 2024-04-03T04:01:06.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.0 2024-04-03T04:01:06.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.0 2024-04-03T04:01:06.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.1 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.1 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.2 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.2 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.3 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.3 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.4 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.4 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.5 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.5 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.6 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.6 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.7 2024-04-03T04:01:06.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.7 2024-04-03T04:01:06.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.8 2024-04-03T04:01:06.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.8 2024-04-03T04:01:06.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.9 2024-04-03T04:01:06.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.9 2024-04-03T04:01:06.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.10 2024-04-03T04:01:06.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.10 2024-04-03T04:01:06.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.11 2024-04-03T04:01:06.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1.11 2024-04-03T04:01:06.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.0 2024-04-03T04:01:06.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.531+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.1 2024-04-03T04:01:06.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.535+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.2 2024-04-03T04:01:06.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.535+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.3 2024-04-03T04:01:06.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.535+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.4 2024-04-03T04:01:06.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.539+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.5 2024-04-03T04:01:06.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.539+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.6 2024-04-03T04:01:06.520 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.539+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.7 2024-04-03T04:01:06.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.539+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.8 2024-04-03T04:01:06.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.539+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.9 2024-04-03T04:01:06.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.543+0000 7fe9693ac980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25.10 2024-04-03T04:01:06.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.547+0000 7fe9693ac980 -1 Injecting error=-125 at location=commit_target_layout 2024-04-03T04:01:06.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.547+0000 7fe9693ac980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 : hit (requested=0x17, cached=0x17) 2024-04-03T04:01:06.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.547+0000 7fe9693ac980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 2024-04-03T04:01:06.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.551+0000 7fe9693ac980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 info.flags=0x17 2024-04-03T04:01:06.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.551+0000 7fe9693ac980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 to cache LRU end 2024-04-03T04:01:06.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.551+0000 7fe9693ac980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:06.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.551+0000 7fe9693ac980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25, ofs0, ns] 2024-04-03T04:01:06.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.551+0000 7fe84a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94341188317008 notifier 6371 bl.length()=861 2024-04-03T04:01:06.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.551+0000 7fe84a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 info.flags=0x17 2024-04-03T04:01:06.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.551+0000 7fe84a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 to cache LRU end 2024-04-03T04:01:06.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.551+0000 7fe84a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:06.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.555+0000 7fe9693ac980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25]): orig_sources= new_sources= 2024-04-03T04:01:06.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.555+0000 7fe9693ac980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25]): potential sources added=[] removed=[] 2024-04-03T04:01:06.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.555+0000 7fe9693ac980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25]): orig_dests= new_dests= 2024-04-03T04:01:06.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.555+0000 7fe9693ac980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25]): potential dests added=[] removed=[] 2024-04-03T04:01:06.543 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.563+0000 7fe9693ac980 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-04-03T04:01:06.546 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.563+0000 7fe81d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:06.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.571+0000 7fe9693ac980 20 remove_watcher() i=0 2024-04-03T04:01:06.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.571+0000 7fe9693ac980 2 removed watcher, disabling cache 2024-04-03T04:01:06.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.571+0000 7fe9693ac980 20 remove_watcher() i=1 2024-04-03T04:01:06.554 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.575+0000 7fe9693ac980 20 remove_watcher() i=2 2024-04-03T04:01:06.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.575+0000 7fe9693ac980 20 remove_watcher() i=3 2024-04-03T04:01:06.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.575+0000 7fe9693ac980 20 remove_watcher() i=4 2024-04-03T04:01:06.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.579+0000 7fe9693ac980 20 remove_watcher() i=5 2024-04-03T04:01:06.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.579+0000 7fe9693ac980 20 remove_watcher() i=6 2024-04-03T04:01:06.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.579+0000 7fe9693ac980 20 remove_watcher() i=7 2024-04-03T04:01:06.575 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-04-03T04:01:06.600 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:06.600 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:06.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.659+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 20 realm 2024-04-03T04:01:06.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:06.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:06.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.663+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.647 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.667+0000 7fa0344bb980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:06.647 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.667+0000 7fa0344bb980 20 searching for the correct realm 2024-04-03T04:01:06.652 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.671+0000 7fa031fd6640 0 -- 172.21.15.104:0/2575434383 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x55a246b5c650 msgr2=0x55a246b5ea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:06.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.675+0000 7fa0327d7640 0 -- 172.21.15.104:0/2575434383 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fa02c0ff240 msgr2=0x7fa02c0c17e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:06.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.683+0000 7fa0344bb980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:06.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.683+0000 7fa0344bb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:06.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.683+0000 7fa0344bb980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:06.666 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.683+0000 7fa0344bb980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:06.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.683+0000 7fa0344bb980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:06.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.683+0000 7fa0344bb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:06.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.683+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.683+0000 7fa0344bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.667 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.683+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 zone default found 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 4 Realm: () 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 zonegroup default 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.668 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:06.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 started sync module instance, tier type = 2024-04-03T04:01:06.669 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.687+0000 7fa0344bb980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:06.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.703+0000 7fa0344bb980 20 add_watcher() i=0 2024-04-03T04:01:06.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.703+0000 7fa0344bb980 20 add_watcher() i=1 2024-04-03T04:01:06.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.703+0000 7fa0344bb980 20 add_watcher() i=2 2024-04-03T04:01:06.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.703+0000 7fa0344bb980 20 add_watcher() i=3 2024-04-03T04:01:06.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.703+0000 7fa0344bb980 20 add_watcher() i=4 2024-04-03T04:01:06.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.703+0000 7fa0344bb980 20 add_watcher() i=5 2024-04-03T04:01:06.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.703+0000 7fa0344bb980 20 add_watcher() i=6 2024-04-03T04:01:06.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.703+0000 7fa0344bb980 20 add_watcher() i=7 2024-04-03T04:01:06.685 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.703+0000 7fa0344bb980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:06.687 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7f9ee37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:06.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:06.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:06.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 5 note: GC not initialized 2024-04-03T04:01:06.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7f9ee27fc640 20 reqs_thread_entry: start 2024-04-03T04:01:06.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:06.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 Filter name: none 2024-04-03T04:01:06.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7f9e53fff640 20 reqs_thread_entry: start 2024-04-03T04:01:06.688 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:06.689 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:06.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:06.690 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.707+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.711+0000 7fa0344bb980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:06.691 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.711+0000 7fa0344bb980 20 rados->read ofs=0 len=0 2024-04-03T04:01:06.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.711+0000 7fa0344bb980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:06.692 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.711+0000 7fa0344bb980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:06.695 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.715+0000 7f9ee37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:06.700 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.719+0000 7fa0344bb980 20 remove_watcher() i=0 2024-04-03T04:01:06.700 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.719+0000 7fa0344bb980 2 removed watcher, disabling cache 2024-04-03T04:01:06.701 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.719+0000 7fa0344bb980 20 remove_watcher() i=1 2024-04-03T04:01:06.703 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.723+0000 7fa0344bb980 20 remove_watcher() i=2 2024-04-03T04:01:06.705 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.723+0000 7fa0344bb980 20 remove_watcher() i=3 2024-04-03T04:01:06.708 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.727+0000 7fa0344bb980 20 remove_watcher() i=4 2024-04-03T04:01:06.709 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.727+0000 7fa0344bb980 20 remove_watcher() i=5 2024-04-03T04:01:06.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.731+0000 7fa0344bb980 20 remove_watcher() i=6 2024-04-03T04:01:06.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:06.731+0000 7fa0344bb980 20 remove_watcher() i=7 2024-04-03T04:01:06.728 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:06.728 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:06.728 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-commit-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25 num_objects: 20 size_kb: 1 num_shards: 12 2024-04-03T04:01:06.728 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:06.728 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:06.728 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:06.750 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:06.750 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:07.193 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:07.193 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:07.563 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-04-03T04:01:07.563 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:07.566 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:07.566 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:07.699 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:07.699 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:07.781 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:07.781 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:07.868 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:07.868 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:07.956 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:07.956 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.043 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.043 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.132 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.132 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.222 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.222 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.314 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.314 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.408 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.409 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.500 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.501 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.583 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.583 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.671 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.671 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.760 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.760 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.850 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.850 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:08.938 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:08.938 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:09.034 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:09.034 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:09.124 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:09.124 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:09.217 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:09.217 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:09.308 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:09.308 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:09.400 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:09.400 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:09.489 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:09.489 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:09.576 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-04-03T04:01:09.608 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:09.608 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:09.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.671+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:09.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 realm 2024-04-03T04:01:09.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:09.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:09.655 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:09.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:09.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:09.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.675+0000 7f4a58fc4980 20 searching for the correct realm 2024-04-03T04:01:09.662 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.679+0000 7f4a572e0640 0 -- 172.21.15.104:0/679927751 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f4a5003f060 msgr2=0x7f4a50065170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:09.670 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.691+0000 7f4a562de640 0 -- 172.21.15.104:0/679927751 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f4a5001fae0 msgr2=0x7f4a50061490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:09.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.907+0000 7f4a58fc4980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:09.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.907+0000 7f4a58fc4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:09.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.907+0000 7f4a58fc4980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:09.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.907+0000 7f4a58fc4980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:09.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.907+0000 7f4a58fc4980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:09.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.907+0000 7f4a58fc4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:09.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.907+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:09.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:09.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:09.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 zone default found 2024-04-03T04:01:09.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 4 Realm: () 2024-04-03T04:01:09.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:09.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:09.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:09.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 zonegroup default 2024-04-03T04:01:09.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:09.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:09.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.911+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.915+0000 7f4a58fc4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:09.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.915+0000 7f4a58fc4980 20 started sync module instance, tier type = 2024-04-03T04:01:09.895 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.915+0000 7f4a58fc4980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:09.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.939+0000 7f4a58fc4980 20 add_watcher() i=0 2024-04-03T04:01:09.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.939+0000 7f4a58fc4980 20 add_watcher() i=1 2024-04-03T04:01:09.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.939+0000 7f4a58fc4980 20 add_watcher() i=2 2024-04-03T04:01:09.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.939+0000 7f4a58fc4980 20 add_watcher() i=3 2024-04-03T04:01:09.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.939+0000 7f4a58fc4980 20 add_watcher() i=4 2024-04-03T04:01:09.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.939+0000 7f4a58fc4980 20 add_watcher() i=5 2024-04-03T04:01:09.920 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.939+0000 7f4a58fc4980 20 add_watcher() i=6 2024-04-03T04:01:09.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.939+0000 7f4a58fc4980 20 add_watcher() i=7 2024-04-03T04:01:09.922 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.939+0000 7f4a58fc4980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:09.926 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.943+0000 7f490d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:09.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:09.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:09.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 5 note: GC not initialized 2024-04-03T04:01:09.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4887fff640 20 reqs_thread_entry: start 2024-04-03T04:01:09.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:09.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 Filter name: none 2024-04-03T04:01:09.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4885ffb640 20 reqs_thread_entry: start 2024-04-03T04:01:09.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:09.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:09.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:09.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.947+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.951+0000 7f4a58fc4980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:09.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.951+0000 7f4a58fc4980 20 rados->read ofs=0 len=0 2024-04-03T04:01:09.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.951+0000 7f4a58fc4980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:09.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.951+0000 7f4a58fc4980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:09.935 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.955+0000 7f490d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:09.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.959+0000 7f4a58fc4980 20 remove_watcher() i=0 2024-04-03T04:01:09.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.959+0000 7f4a58fc4980 2 removed watcher, disabling cache 2024-04-03T04:01:09.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.959+0000 7f4a58fc4980 20 remove_watcher() i=1 2024-04-03T04:01:09.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.963+0000 7f4a58fc4980 20 remove_watcher() i=2 2024-04-03T04:01:09.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.963+0000 7f4a58fc4980 20 remove_watcher() i=3 2024-04-03T04:01:09.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.967+0000 7f4a58fc4980 20 remove_watcher() i=4 2024-04-03T04:01:09.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.967+0000 7f4a58fc4980 20 remove_watcher() i=5 2024-04-03T04:01:09.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.967+0000 7f4a58fc4980 20 remove_watcher() i=6 2024-04-03T04:01:09.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:09.971+0000 7f4a58fc4980 20 remove_watcher() i=7 2024-04-03T04:01:09.967 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:09.967 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:09.968 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-commit-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:01:09.968 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:09.968 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-04-03T04:01:09.999 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:09.999 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.059+0000 7f6190f06980 20 realm 2024-04-03T04:01:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.059+0000 7f6190f06980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.043 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.063+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:10.043 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.063+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.063+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:10.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.063+0000 7f6190f06980 20 searching for the correct realm 2024-04-03T04:01:10.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.067+0000 7f618ea21640 0 -- 172.21.15.104:0/2414169662 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x56275fdc6820 msgr2=0x56275fdc8ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:10.055 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.075+0000 7f618e220640 0 -- 172.21.15.104:0/2414169662 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f61881179c0 msgr2=0x7f618810e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:10.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:10.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:10.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:10.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:10.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 zone default found 2024-04-03T04:01:10.066 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 4 Realm: () 2024-04-03T04:01:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 zonegroup default 2024-04-03T04:01:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.067 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.087+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.087+0000 7f6190f06980 20 started sync module instance, tier type = 2024-04-03T04:01:10.068 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.087+0000 7f6190f06980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:10.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=0 2024-04-03T04:01:10.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=1 2024-04-03T04:01:10.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=2 2024-04-03T04:01:10.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=3 2024-04-03T04:01:10.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=4 2024-04-03T04:01:10.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=5 2024-04-03T04:01:10.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=6 2024-04-03T04:01:10.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6190f06980 20 add_watcher() i=7 2024-04-03T04:01:10.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6190f06980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:10.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6045fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:10.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6190f06980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:10.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6190f06980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:10.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6190f06980 5 note: GC not initialized 2024-04-03T04:01:10.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6044fe1640 20 reqs_thread_entry: start 2024-04-03T04:01:10.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6190f06980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:10.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6190f06980 20 Filter name: none 2024-04-03T04:01:10.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f603dffb640 20 reqs_thread_entry: start 2024-04-03T04:01:10.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6190f06980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-04-03T04:01:10.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.103+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:10.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-04-03T04:01:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-04-03T04:01:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 : miss 2024-04-03T04:01:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:10.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.107+0000 7f6190f06980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 2024-04-03T04:01:10.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.115+0000 7f6190f06980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:10.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.115+0000 7f6190f06980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:10.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.115+0000 7f6190f06980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:10.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.115+0000 7f6190f06980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26, ofs0, ns] 2024-04-03T04:01:10.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562455 cookie 94727112014224 notifier 6425 bl.length()=893 2024-04-03T04:01:10.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:10.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:10.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:10.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_sources= new_sources= 2024-04-03T04:01:10.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential sources added=[] removed=[] 2024-04-03T04:01:10.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_dests= new_dests= 2024-04-03T04:01:10.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential dests added=[] removed=[] 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.0 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.0 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.1 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.1 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.2 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.2 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.3 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.3 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.4 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.4 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.5 2024-04-03T04:01:10.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.5 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.6 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.6 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.7 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.7 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.8 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.8 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.9 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.9 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.10 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.10 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.11 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.11 2024-04-03T04:01:10.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.0 2024-04-03T04:01:10.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1 2024-04-03T04:01:10.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.2 2024-04-03T04:01:10.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.3 2024-04-03T04:01:10.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.4 2024-04-03T04:01:10.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.5 2024-04-03T04:01:10.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.6 2024-04-03T04:01:10.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.7 2024-04-03T04:01:10.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.8 2024-04-03T04:01:10.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.131+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.9 2024-04-03T04:01:10.111 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.131+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.10 2024-04-03T04:01:10.116 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6190f06980 time 2024-04-03T04:01:10.140287+0000 2024-04-03T04:01:10.117 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:01:10.117 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:10.117 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f61947dce1f] 2024-04-03T04:01:10.118 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f61947dcfd3] 2024-04-03T04:01:10.118 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56275dd3d5b1] 2024-04-03T04:01:10.118 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x56275dd4b52f] 2024-04-03T04:01:10.118 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:01:10.118 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6193646d90] 2024-04-03T04:01:10.118 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:01:10.118 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:01:10.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.135+0000 7f6190f06980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6190f06980 time 2024-04-03T04:01:10.140287+0000 2024-04-03T04:01:10.119 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:01:10.119 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.119 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:10.119 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f61947dce1f] 2024-04-03T04:01:10.119 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f61947dcfd3] 2024-04-03T04:01:10.119 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56275dd3d5b1] 2024-04-03T04:01:10.119 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x56275dd4b52f] 2024-04-03T04:01:10.119 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:01:10.119 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6193646d90] 2024-04-03T04:01:10.120 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:01:10.120 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:01:10.120 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.120 INFO:tasks.workunit.client.0.smithi104.stderr:*** Caught signal (Aborted) ** 2024-04-03T04:01:10.120 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7f6190f06980 thread_name:radosgw-admin 2024-04-03T04:01:10.143 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:10.143 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f619365f520] 2024-04-03T04:01:10.143 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:01:10.143 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:01:10.143 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:01:10.143 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f61947dce79] 2024-04-03T04:01:10.143 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f61947dcfd3] 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56275dd3d5b1] 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x56275dd4b52f] 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6193646d90] 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.135+0000 7f6190f06980 -1 *** Caught signal (Aborted) ** 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7f6190f06980 thread_name:radosgw-admin 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f619365f520] 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:01:10.144 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f61947dce79] 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f61947dcfd3] 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56275dd3d5b1] 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x56275dd4b52f] 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6193646d90] 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T04:01:10.145 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.146 INFO:tasks.workunit.client.0.smithi104.stderr:--- begin dump of recent events --- 2024-04-03T04:01:10.146 INFO:tasks.workunit.client.0.smithi104.stderr: -499> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: crc 2024-04-03T04:01:10.146 INFO:tasks.workunit.client.0.smithi104.stderr: -498> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: crc 2024-04-03T04:01:10.146 INFO:tasks.workunit.client.0.smithi104.stderr: -497> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: secure 2024-04-03T04:01:10.146 INFO:tasks.workunit.client.0.smithi104.stderr: -496> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: crc 2024-04-03T04:01:10.146 INFO:tasks.workunit.client.0.smithi104.stderr: -495> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: secure 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -494> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: crc 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -493> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: secure 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -492> 2024-04-03T04:01:10.039+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -491> 2024-04-03T04:01:10.039+0000 7f6190f06980 1 librados: starting msgr at 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -490> 2024-04-03T04:01:10.039+0000 7f6190f06980 1 librados: starting objecter 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -489> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 asok(0x56275fac5210) register_command objecter_requests hook 0x56275fabdbf0 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -488> 2024-04-03T04:01:10.039+0000 7f6190f06980 1 librados: setting wanted keys 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -487> 2024-04-03T04:01:10.039+0000 7f6190f06980 1 librados: calling monclient init 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -486> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient: init 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -485> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding auth protocol: cephx 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -484> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding auth protocol: cephx 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -483> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding auth protocol: cephx 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -482> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.147 INFO:tasks.workunit.client.0.smithi104.stderr: -481> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -480> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -479> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -478> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -477> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -476> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -475> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -474> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -473> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -472> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -471> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -470> 2024-04-03T04:01:10.039+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -469> 2024-04-03T04:01:10.039+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -468> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 asok(0x56275fac5210) register_command rotate-key hook 0x56275fcccbc8 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -467> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:10.148 INFO:tasks.workunit.client.0.smithi104.stderr: -466> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient: _add_conns ranks=[1,0,2] 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -465> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-b con 0x56275fb7f0f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -464> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-a con 0x56275fb8ba90 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -463> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-c con 0x56275fcd2cb0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -462> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -461> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -460> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -459> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -458> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): authenticate will time out at 2325.783751s 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -457> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): get_auth_request con 0x56275fb8ba90 auth_method 0 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -456> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -455> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -454> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -453> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): get_auth_request con 0x56275fcd2cb0 auth_method 0 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -452> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.149 INFO:tasks.workunit.client.0.smithi104.stderr: -451> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -450> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -449> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -448> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -447> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -446> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -445> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -444> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -443> 2024-04-03T04:01:10.043+0000 7f618f222640 10 monclient(hunting): handle_auth_done global_id 6416 payload 824 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -442> 2024-04-03T04:01:10.043+0000 7f618f222640 10 monclient: _finish_hunting 0 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -441> 2024-04-03T04:01:10.043+0000 7f618f222640 1 monclient: found mon.noname-c 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -440> 2024-04-03T04:01:10.043+0000 7f618f222640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -439> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -438> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:10.150 INFO:tasks.workunit.client.0.smithi104.stderr: -437> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: dump: 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr: -436> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: _finish_auth 0 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr: -435> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: _check_auth_tickets 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr: -434> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:10.151 INFO:tasks.workunit.client.0.smithi104.stderr: -433> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr: -432> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr: -431> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: dump: 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.152 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -430> 2024-04-03T04:01:10.043+0000 7f6190f06980 5 monclient: authenticate success, global_id 6416 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -429> 2024-04-03T04:01:10.043+0000 7f607ce09640 4 set_mon_vals no callback set 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -428> 2024-04-03T04:01:10.043+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -427> 2024-04-03T04:01:10.043+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -426> 2024-04-03T04:01:10.043+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -425> 2024-04-03T04:01:10.043+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -424> 2024-04-03T04:01:10.043+0000 7f6190f06980 1 librados: init done 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -423> 2024-04-03T04:01:10.043+0000 7f607b606640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -422> 2024-04-03T04:01:10.043+0000 7f607b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -421> 2024-04-03T04:01:10.043+0000 7f607b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -420> 2024-04-03T04:01:10.043+0000 7f618ea21640 10 monclient: get_auth_request con 0x7f6074066d60 auth_method 0 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -419> 2024-04-03T04:01:10.043+0000 7f618e220640 10 monclient: get_auth_request con 0x56275fcfa7d0 auth_method 0 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -418> 2024-04-03T04:01:10.043+0000 7f618ea21640 10 monclient: get_auth_request con 0x56275fd17ff0 auth_method 0 2024-04-03T04:01:10.153 INFO:tasks.workunit.client.0.smithi104.stderr: -417> 2024-04-03T04:01:10.047+0000 7f618e220640 10 monclient: get_auth_request con 0x56275fd1c1e0 auth_method 0 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr: -416> 2024-04-03T04:01:10.047+0000 7f618f222640 10 monclient: get_auth_request con 0x56275fd1ffc0 auth_method 0 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr: -415> 2024-04-03T04:01:10.047+0000 7f6190f06980 10 monclient: build_initial_monmap 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr: -414> 2024-04-03T04:01:10.047+0000 7f6190f06980 1 build_initial for_mkfs: 0 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr: -413> 2024-04-03T04:01:10.047+0000 7f6190f06980 10 monclient: monmap: 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:10.154 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -412> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding auth protocol: cephx 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -411> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding auth protocol: cephx 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -410> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding auth protocol: cephx 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -409> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -408> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -407> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -406> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -405> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -404> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -403> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -402> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -401> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -400> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.155 INFO:tasks.workunit.client.0.smithi104.stderr: -399> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -398> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -397> 2024-04-03T04:01:10.047+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -396> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 asok(0x56275fac5210) register_command objecter_requests cmddesc objecter_requests hook 0x56275fd295f0 EEXIST 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -395> 2024-04-03T04:01:10.047+0000 7f6190f06980 10 monclient: init 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -394> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding auth protocol: cephx 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -393> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding auth protocol: cephx 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -392> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding auth protocol: cephx 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -391> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -390> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -389> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -388> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -387> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -386> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -385> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.156 INFO:tasks.workunit.client.0.smithi104.stderr: -384> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -383> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -382> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -381> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -380> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -379> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -378> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -377> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 asok(0x56275fac5210) register_command rotate-key cmddesc rotate-key hook 0x56275fd23110 EEXIST 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -376> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -375> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _add_conns ranks=[0,2,1] 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -374> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-a con 0x56275fd4e250 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -373> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-c con 0x56275fd4e630 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -372> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-b con 0x56275fd497f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -371> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.157 INFO:tasks.workunit.client.0.smithi104.stderr: -370> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -369> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -368> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -367> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): authenticate will time out at 2325.792389s 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -366> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): get_auth_request con 0x56275fd4e630 auth_method 0 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -365> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -364> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -363> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -362> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): get_auth_request con 0x56275fd4e250 auth_method 0 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -361> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -360> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -359> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -358> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -357> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.158 INFO:tasks.workunit.client.0.smithi104.stderr: -356> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -355> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -354> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -353> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -352> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): handle_auth_done global_id 6419 payload 824 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -351> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient: _finish_hunting 0 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -350> 2024-04-03T04:01:10.051+0000 7f618f222640 1 monclient: found mon.noname-c 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -349> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -348> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -347> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr: -346> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: dump: 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.159 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr: -345> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: _finish_auth 0 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr: -344> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: _check_auth_tickets 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr: -343> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr: -342> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr: -341> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr: -340> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: dump: 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.160 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr: -339> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 monclient: authenticate success, global_id 6419 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr: -338> 2024-04-03T04:01:10.051+0000 7f618fa23640 4 set_mon_vals no callback set 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr: -337> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr: -336> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr: -335> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr: -334> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.161 INFO:tasks.workunit.client.0.smithi104.stderr: -333> 2024-04-03T04:01:10.051+0000 7f6078e01640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr: -332> 2024-04-03T04:01:10.051+0000 7f6078e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr: -331> 2024-04-03T04:01:10.051+0000 7f6078e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr: -330> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient: get_auth_request con 0x7f6068066ca0 auth_method 0 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr: -329> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: get_monmap_and_config 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr: -328> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: build_initial_monmap 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr: -327> 2024-04-03T04:01:10.051+0000 7f6190f06980 1 build_initial for_mkfs: 0 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr: -326> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: monmap: 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:10.162 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -325> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding auth protocol: cephx 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -324> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding auth protocol: cephx 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -323> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding auth protocol: cephx 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -322> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -321> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -320> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -319> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -318> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -317> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -316> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -315> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.163 INFO:tasks.workunit.client.0.smithi104.stderr: -314> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -313> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -312> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -311> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -310> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -309> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: init 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -308> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding auth protocol: cephx 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -307> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding auth protocol: cephx 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -306> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding auth protocol: cephx 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -305> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -304> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -303> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -302> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -301> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.164 INFO:tasks.workunit.client.0.smithi104.stderr: -300> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -299> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -298> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -297> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -296> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -295> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -294> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -293> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -292> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -291> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 asok(0x56275fac5210) register_command rotate-key cmddesc rotate-key hook 0x7ffde7b021e8 EEXIST 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -290> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -289> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _add_conns ranks=[2,0,1] 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -288> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-c con 0x56275fda0090 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -287> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-a con 0x56275fda0470 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -286> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-b con 0x56275fd6e130 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:10.165 INFO:tasks.workunit.client.0.smithi104.stderr: -285> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -284> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -283> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -282> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -281> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): authenticate will time out at 2325.795936s 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -280> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): get_auth_request con 0x56275fda0090 auth_method 0 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -279> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -278> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -277> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -276> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): get_auth_request con 0x56275fda0470 auth_method 0 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -275> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -274> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -273> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -272> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.166 INFO:tasks.workunit.client.0.smithi104.stderr: -271> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -270> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -269> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -268> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -267> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -266> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_done global_id 6422 payload 274 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -265> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient: _finish_hunting 0 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -264> 2024-04-03T04:01:10.055+0000 7f618e220640 1 monclient: found mon.noname-c 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -263> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -262> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -261> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr: -260> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: dump: 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.167 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr: -259> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: _finish_auth 0 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr: -258> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: _check_auth_tickets 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr: -257> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr: -256> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr: -255> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr: -254> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: dump: 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.168 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr: -253> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 monclient: authenticate success, global_id 6422 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr: -252> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: get_monmap_and_config success 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr: -251> 2024-04-03T04:01:10.055+0000 7f6190f06980 4 set_mon_vals no callback set 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr: -250> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: shutdown 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr: -249> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: build_initial_monmap 2024-04-03T04:01:10.169 INFO:tasks.workunit.client.0.smithi104.stderr: -248> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 build_initial for_mkfs: 0 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr: -247> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: monmap: 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr: -246> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding auth protocol: cephx 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr: -245> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding auth protocol: cephx 2024-04-03T04:01:10.170 INFO:tasks.workunit.client.0.smithi104.stderr: -244> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding auth protocol: cephx 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -243> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -242> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -241> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -240> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -239> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -238> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -237> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -236> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -235> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -234> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -233> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -232> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -231> 2024-04-03T04:01:10.055+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.171 INFO:tasks.workunit.client.0.smithi104.stderr: -230> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: starting msgr at 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -229> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: starting objecter 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -228> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 asok(0x56275fac5210) register_command objecter_requests cmddesc objecter_requests hook 0x56275fd4e030 EEXIST 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -227> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: setting wanted keys 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -226> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: calling monclient init 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -225> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: init 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -224> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding auth protocol: cephx 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -223> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding auth protocol: cephx 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -222> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding auth protocol: cephx 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -221> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -220> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -219> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -218> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -217> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.172 INFO:tasks.workunit.client.0.smithi104.stderr: -216> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -215> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -214> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -213> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -212> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -211> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -210> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -209> 2024-04-03T04:01:10.055+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -208> 2024-04-03T04:01:10.055+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -207> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 asok(0x56275fac5210) register_command rotate-key cmddesc rotate-key hook 0x56275fd6b0b8 EEXIST 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -206> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:10.173 INFO:tasks.workunit.client.0.smithi104.stderr: -205> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -204> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-a con 0x56275fd6e130 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -203> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-b con 0x56275fda0090 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -202> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-c con 0x56275fda0470 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -201> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -200> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -199> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -198> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -197> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): authenticate will time out at 2325.798535s 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -196> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): get_auth_request con 0x56275fda0470 auth_method 0 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -195> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -194> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -193> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -192> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): get_auth_request con 0x56275fd6e130 auth_method 0 2024-04-03T04:01:10.174 INFO:tasks.workunit.client.0.smithi104.stderr: -191> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -190> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -189> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -188> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -187> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -186> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -185> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -184> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -183> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -182> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): handle_auth_done global_id 6425 payload 824 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -181> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient: _finish_hunting 0 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -180> 2024-04-03T04:01:10.055+0000 7f618ea21640 1 monclient: found mon.noname-c 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -179> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -178> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.175 INFO:tasks.workunit.client.0.smithi104.stderr: -177> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr: -176> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: dump: 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr: -175> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: _finish_auth 0 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr: -174> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: _check_auth_tickets 2024-04-03T04:01:10.176 INFO:tasks.workunit.client.0.smithi104.stderr: -173> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr: -172> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr: -171> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr: -170> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: dump: 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr: -169> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 monclient: authenticate success, global_id 6425 2024-04-03T04:01:10.177 INFO:tasks.workunit.client.0.smithi104.stderr: -168> 2024-04-03T04:01:10.055+0000 7f60727fc640 4 set_mon_vals no callback set 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -167> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -166> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -165> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -164> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -163> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: init done 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -162> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cr dump hook 0x56275fda4ca8 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -161> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -160> 2024-04-03T04:01:10.059+0000 7f6070ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -159> 2024-04-03T04:01:10.059+0000 7f6070ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -158> 2024-04-03T04:01:10.059+0000 7f6070ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -157> 2024-04-03T04:01:10.059+0000 7f618e220640 10 monclient: get_auth_request con 0x7f6058066d60 auth_method 0 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -156> 2024-04-03T04:01:10.059+0000 7f618f222640 10 monclient: get_auth_request con 0x56275fdba170 auth_method 0 2024-04-03T04:01:10.178 INFO:tasks.workunit.client.0.smithi104.stderr: -155> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -154> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 realm 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -153> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -152> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -151> 2024-04-03T04:01:10.059+0000 7f6190f06980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -150> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -149> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -148> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -147> 2024-04-03T04:01:10.059+0000 7f618e220640 10 monclient: get_auth_request con 0x56275fdbe310 auth_method 0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -146> 2024-04-03T04:01:10.063+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -145> 2024-04-03T04:01:10.063+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -144> 2024-04-03T04:01:10.063+0000 7f618f222640 10 monclient: get_auth_request con 0x56275fdc1b70 auth_method 0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -143> 2024-04-03T04:01:10.063+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -142> 2024-04-03T04:01:10.063+0000 7f6190f06980 20 searching for the correct realm 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -141> 2024-04-03T04:01:10.063+0000 7f618ea21640 10 monclient: get_auth_request con 0x56275fdc6820 auth_method 0 2024-04-03T04:01:10.179 INFO:tasks.workunit.client.0.smithi104.stderr: -140> 2024-04-03T04:01:10.063+0000 7f618e220640 10 monclient: get_auth_request con 0x7f618005c610 auth_method 0 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -139> 2024-04-03T04:01:10.067+0000 7f618f222640 10 monclient: get_auth_request con 0x7f61880bf030 auth_method 0 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -138> 2024-04-03T04:01:10.067+0000 7f618ea21640 0 -- 172.21.15.104:0/2414169662 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x56275fdc6820 msgr2=0x56275fdc8ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -137> 2024-04-03T04:01:10.067+0000 7f6070ff9640 1 client.6425.objecter ms_handle_reset 0x56275fdc6820 session 0x56275fdc61a0 osd.3 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -136> 2024-04-03T04:01:10.067+0000 7f6070ff9640 10 monclient: _renew_subs 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -135> 2024-04-03T04:01:10.067+0000 7f6070ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -134> 2024-04-03T04:01:10.067+0000 7f618ea21640 10 monclient: get_auth_request con 0x7f6058077490 auth_method 0 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -133> 2024-04-03T04:01:10.071+0000 7f618ea21640 10 monclient: get_auth_request con 0x7f61881137e0 auth_method 0 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -132> 2024-04-03T04:01:10.075+0000 7f618e220640 10 monclient: get_auth_request con 0x7f61881179c0 auth_method 0 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -131> 2024-04-03T04:01:10.075+0000 7f618e220640 0 -- 172.21.15.104:0/2414169662 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f61881179c0 msgr2=0x7f618810e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -130> 2024-04-03T04:01:10.075+0000 7f6070ff9640 1 client.6425.objecter ms_handle_reset 0x7f61881179c0 session 0x7f6188113c50 osd.0 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -129> 2024-04-03T04:01:10.075+0000 7f618e220640 10 monclient: get_auth_request con 0x56275fdc6820 auth_method 0 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -128> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -127> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -126> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:10.180 INFO:tasks.workunit.client.0.smithi104.stderr: -125> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -124> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -123> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -122> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -121> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -120> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -119> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -118> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -117> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -116> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 zone default found 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -115> 2024-04-03T04:01:10.083+0000 7f6190f06980 4 Realm: () 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -114> 2024-04-03T04:01:10.083+0000 7f6190f06980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -113> 2024-04-03T04:01:10.083+0000 7f6190f06980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -112> 2024-04-03T04:01:10.083+0000 7f6190f06980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -111> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 zonegroup default 2024-04-03T04:01:10.181 INFO:tasks.workunit.client.0.smithi104.stderr: -110> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -109> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -108> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -107> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -106> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -105> 2024-04-03T04:01:10.087+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -104> 2024-04-03T04:01:10.087+0000 7f6190f06980 20 started sync module instance, tier type = 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -103> 2024-04-03T04:01:10.087+0000 7f6190f06980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -102> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=0 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -101> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=1 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -100> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=2 2024-04-03T04:01:10.182 INFO:tasks.workunit.client.0.smithi104.stderr: -99> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=3 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -98> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=4 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -97> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=5 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -96> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=6 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -95> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 add_watcher() i=7 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -94> 2024-04-03T04:01:10.103+0000 7f6190f06980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -93> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding auth protocol: cephx 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -92> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding auth protocol: cephx 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -91> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding auth protocol: cephx 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -90> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -89> 2024-04-03T04:01:10.103+0000 7f6045fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -88> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -87> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -86> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.183 INFO:tasks.workunit.client.0.smithi104.stderr: -85> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -84> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -83> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -82> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -81> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -80> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -79> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -78> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -77> 2024-04-03T04:01:10.103+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -76> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -75> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -74> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cache list hook 0x56275fd99af0 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -73> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cache inspect hook 0x56275fd99af0 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -72> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cache erase hook 0x56275fd99af0 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -71> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cache zap hook 0x56275fd99af0 2024-04-03T04:01:10.184 INFO:tasks.workunit.client.0.smithi104.stderr: -70> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 note: GC not initialized 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -69> 2024-04-03T04:01:10.103+0000 7f6044fe1640 20 reqs_thread_entry: start 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -68> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command sync trace show hook 0x7f6188004730 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -67> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command sync trace history hook 0x7f6188004730 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -66> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command sync trace active hook 0x7f6188004730 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -65> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command sync trace active_short hook 0x7f6188004730 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -64> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -63> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 Filter name: none 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -62> 2024-04-03T04:01:10.103+0000 7f603dffb640 20 reqs_thread_entry: start 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -61> 2024-04-03T04:01:10.103+0000 7f6190f06980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -60> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -59> 2024-04-03T04:01:10.107+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -58> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -57> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-04-03T04:01:10.185 INFO:tasks.workunit.client.0.smithi104.stderr: -56> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 : miss 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -55> 2024-04-03T04:01:10.107+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -54> 2024-04-03T04:01:10.107+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -53> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -52> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -51> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -50> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -49> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -48> 2024-04-03T04:01:10.115+0000 7f6190f06980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -47> 2024-04-03T04:01:10.115+0000 7f6190f06980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -46> 2024-04-03T04:01:10.115+0000 7f6190f06980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -45> 2024-04-03T04:01:10.115+0000 7f6190f06980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26, ofs0, ns] 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -44> 2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562455 cookie 94727112014224 notifier 6425 bl.length()=893 2024-04-03T04:01:10.186 INFO:tasks.workunit.client.0.smithi104.stderr: -43> 2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -42> 2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -41> 2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -40> 2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_sources= new_sources= 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -39> 2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential sources added=[] removed=[] 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -38> 2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_dests= new_dests= 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -37> 2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential dests added=[] removed=[] 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -36> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.0 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -35> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.0 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -34> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.1 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -33> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.1 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -32> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.2 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -31> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.2 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -30> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.3 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -29> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.3 2024-04-03T04:01:10.187 INFO:tasks.workunit.client.0.smithi104.stderr: -28> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.4 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -27> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.4 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -26> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.5 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -25> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.5 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -24> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.6 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -23> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.6 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -22> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.7 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -21> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.7 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -20> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.8 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -19> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.8 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -18> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.9 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -17> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.9 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -16> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.10 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -15> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.10 2024-04-03T04:01:10.188 INFO:tasks.workunit.client.0.smithi104.stderr: -14> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.11 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -13> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.11 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -12> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.0 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -11> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -10> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.2 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -9> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.3 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -8> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.4 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -7> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.5 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -6> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.6 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -5> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.7 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -4> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.8 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -3> 2024-04-03T04:01:10.131+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.9 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -2> 2024-04-03T04:01:10.131+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.10 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: -1> 2024-04-03T04:01:10.135+0000 7f6190f06980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6190f06980 time 2024-04-03T04:01:10.140287+0000 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:01:10.189 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f61947dce1f] 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f61947dcfd3] 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56275dd3d5b1] 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x56275dd4b52f] 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6193646d90] 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 0> 2024-04-03T04:01:10.135+0000 7f6190f06980 -1 *** Caught signal (Aborted) ** 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7f6190f06980 thread_name:radosgw-admin 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.190 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f619365f520] 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f61947dce79] 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f61947dcfd3] 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56275dd3d5b1] 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x56275dd4b52f] 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6193646d90] 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.191 INFO:tasks.workunit.client.0.smithi104.stderr:--- logging levels --- 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 none 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 lockdep 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 context 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 crush 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_balancer 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_locker 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log_expire 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_migrator 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 3/ 5 mds_quiesce 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 buffer 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 timer 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 filer 2024-04-03T04:01:10.192 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 striper 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 objecter 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rados 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_mirror 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_replay 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_pwl 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 journaler 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objectcacher 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 immutable_obj_cache 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 client 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 osd 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 optracker 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objclass 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 filestore 2024-04-03T04:01:10.193 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 journal 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 ms 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mon 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 0/10 monc 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 paxos 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 tp 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 auth 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 crypto 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 finisher 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 reserver 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 heartbeatmap 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 perfcounter 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 20/20 rgw 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_sync 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_datacache 2024-04-03T04:01:10.194 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_access 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_dbstore 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_flight 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_lifecycle 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_notification 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 javaclient 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 asok 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 throttle 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 refs 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 compressor 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluestore 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluefs 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 bdev 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 kstore 2024-04-03T04:01:10.195 INFO:tasks.workunit.client.0.smithi104.stderr: 4/ 5 rocksdb 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 fuse 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 2/ 5 mgr 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mgrc 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 dpdk 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 eventtrace 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 prioritycache 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 test 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephfs_mirror 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephsqlite 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 crimson_interrupt 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_onode 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_odata 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_omap 2024-04-03T04:01:10.196 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_tm 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_t 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cleaner 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_epm 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_lba 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cache 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_journal 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_device 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_backref 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 alienstore 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mclock 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cyanstore 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 ceph_exporter 2024-04-03T04:01:10.197 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 memstore 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 trace 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: -2/-2 (syslog threshold) 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 99/99 (stderr threshold) 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f603dffb640 / http_manager 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6044fe1640 / http_manager 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6045fe3640 / rgw_dt_lg_renew 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6070ff9640 / ms_dispatch 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6071ffb640 / io_context_pool 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f60727fc640 / io_context_pool 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6078e01640 / ms_dispatch 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f607b606640 / ms_dispatch 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f607ce09640 / io_context_pool 2024-04-03T04:01:10.198 INFO:tasks.workunit.client.0.smithi104.stderr: 7f618e220640 / msgr-worker-2 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: 7f618ea21640 / msgr-worker-1 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: 7f618f222640 / msgr-worker-0 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: 7f618fa23640 / io_context_pool 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6190f06980 / radosgw-admin 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: max_recent 500 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: max_new 1000 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: log_file /var/log/ceph/ceph-client.admin.95860.log 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr:--- end dump of recent events --- 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr:--- begin dump of recent events --- 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: -499> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: crc 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: -498> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: crc 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: -497> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: secure 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: -496> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: crc 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: -495> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: secure 2024-04-03T04:01:10.199 INFO:tasks.workunit.client.0.smithi104.stderr: -494> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: crc 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -493> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fcfcdb0) adding con mode: secure 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -492> 2024-04-03T04:01:10.039+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -491> 2024-04-03T04:01:10.039+0000 7f6190f06980 1 librados: starting msgr at 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -490> 2024-04-03T04:01:10.039+0000 7f6190f06980 1 librados: starting objecter 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -489> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 asok(0x56275fac5210) register_command objecter_requests hook 0x56275fabdbf0 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -488> 2024-04-03T04:01:10.039+0000 7f6190f06980 1 librados: setting wanted keys 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -487> 2024-04-03T04:01:10.039+0000 7f6190f06980 1 librados: calling monclient init 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -486> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient: init 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -485> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding auth protocol: cephx 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -484> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding auth protocol: cephx 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -483> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding auth protocol: cephx 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -482> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -481> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.200 INFO:tasks.workunit.client.0.smithi104.stderr: -480> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -479> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -478> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -477> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -476> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -475> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -474> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -473> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -472> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: crc 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -471> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 AuthRegistry(0x56275fccca80) adding con mode: secure 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -470> 2024-04-03T04:01:10.039+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -469> 2024-04-03T04:01:10.039+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -468> 2024-04-03T04:01:10.039+0000 7f6190f06980 5 asok(0x56275fac5210) register_command rotate-key hook 0x56275fcccbc8 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -467> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -466> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient: _add_conns ranks=[1,0,2] 2024-04-03T04:01:10.201 INFO:tasks.workunit.client.0.smithi104.stderr: -465> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-b con 0x56275fb7f0f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -464> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-a con 0x56275fb8ba90 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -463> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-c con 0x56275fcd2cb0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -462> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -461> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -460> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -459> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -458> 2024-04-03T04:01:10.039+0000 7f6190f06980 10 monclient(hunting): authenticate will time out at 2325.783751s 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -457> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): get_auth_request con 0x56275fb8ba90 auth_method 0 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -456> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -455> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -454> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -453> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): get_auth_request con 0x56275fcd2cb0 auth_method 0 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -452> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -451> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.202 INFO:tasks.workunit.client.0.smithi104.stderr: -450> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -449> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -448> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -447> 2024-04-03T04:01:10.039+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -446> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -445> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -444> 2024-04-03T04:01:10.039+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -443> 2024-04-03T04:01:10.043+0000 7f618f222640 10 monclient(hunting): handle_auth_done global_id 6416 payload 824 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -442> 2024-04-03T04:01:10.043+0000 7f618f222640 10 monclient: _finish_hunting 0 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -441> 2024-04-03T04:01:10.043+0000 7f618f222640 1 monclient: found mon.noname-c 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -440> 2024-04-03T04:01:10.043+0000 7f618f222640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -439> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -438> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr: -437> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: dump: 2024-04-03T04:01:10.203 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr: -436> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: _finish_auth 0 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr: -435> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: _check_auth_tickets 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr: -434> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr: -433> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.204 INFO:tasks.workunit.client.0.smithi104.stderr: -432> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr: -431> 2024-04-03T04:01:10.043+0000 7f607b606640 10 monclient: dump: 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr: -430> 2024-04-03T04:01:10.043+0000 7f6190f06980 5 monclient: authenticate success, global_id 6416 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr: -429> 2024-04-03T04:01:10.043+0000 7f607ce09640 4 set_mon_vals no callback set 2024-04-03T04:01:10.205 INFO:tasks.workunit.client.0.smithi104.stderr: -428> 2024-04-03T04:01:10.043+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -427> 2024-04-03T04:01:10.043+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -426> 2024-04-03T04:01:10.043+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -425> 2024-04-03T04:01:10.043+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -424> 2024-04-03T04:01:10.043+0000 7f6190f06980 1 librados: init done 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -423> 2024-04-03T04:01:10.043+0000 7f607b606640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -422> 2024-04-03T04:01:10.043+0000 7f607b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -421> 2024-04-03T04:01:10.043+0000 7f607b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -420> 2024-04-03T04:01:10.043+0000 7f618ea21640 10 monclient: get_auth_request con 0x7f6074066d60 auth_method 0 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -419> 2024-04-03T04:01:10.043+0000 7f618e220640 10 monclient: get_auth_request con 0x56275fcfa7d0 auth_method 0 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -418> 2024-04-03T04:01:10.043+0000 7f618ea21640 10 monclient: get_auth_request con 0x56275fd17ff0 auth_method 0 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -417> 2024-04-03T04:01:10.047+0000 7f618e220640 10 monclient: get_auth_request con 0x56275fd1c1e0 auth_method 0 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -416> 2024-04-03T04:01:10.047+0000 7f618f222640 10 monclient: get_auth_request con 0x56275fd1ffc0 auth_method 0 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -415> 2024-04-03T04:01:10.047+0000 7f6190f06980 10 monclient: build_initial_monmap 2024-04-03T04:01:10.206 INFO:tasks.workunit.client.0.smithi104.stderr: -414> 2024-04-03T04:01:10.047+0000 7f6190f06980 1 build_initial for_mkfs: 0 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr: -413> 2024-04-03T04:01:10.047+0000 7f6190f06980 10 monclient: monmap: 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr: -412> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding auth protocol: cephx 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr: -411> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding auth protocol: cephx 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr: -410> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding auth protocol: cephx 2024-04-03T04:01:10.207 INFO:tasks.workunit.client.0.smithi104.stderr: -409> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -408> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -407> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -406> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -405> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -404> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -403> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -402> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -401> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -400> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -399> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: crc 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -398> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd24080) adding con mode: secure 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -397> 2024-04-03T04:01:10.047+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -396> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 asok(0x56275fac5210) register_command objecter_requests cmddesc objecter_requests hook 0x56275fd295f0 EEXIST 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -395> 2024-04-03T04:01:10.047+0000 7f6190f06980 10 monclient: init 2024-04-03T04:01:10.208 INFO:tasks.workunit.client.0.smithi104.stderr: -394> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding auth protocol: cephx 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -393> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding auth protocol: cephx 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -392> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding auth protocol: cephx 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -391> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -390> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -389> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -388> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -387> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -386> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -385> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -384> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -383> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -382> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -381> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: crc 2024-04-03T04:01:10.209 INFO:tasks.workunit.client.0.smithi104.stderr: -380> 2024-04-03T04:01:10.047+0000 7f6190f06980 5 AuthRegistry(0x56275fd22fc8) adding con mode: secure 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -379> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -378> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -377> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 asok(0x56275fac5210) register_command rotate-key cmddesc rotate-key hook 0x56275fd23110 EEXIST 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -376> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -375> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _add_conns ranks=[0,2,1] 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -374> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-a con 0x56275fd4e250 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -373> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-c con 0x56275fd4e630 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -372> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-b con 0x56275fd497f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -371> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -370> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -369> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -368> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:10.210 INFO:tasks.workunit.client.0.smithi104.stderr: -367> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): authenticate will time out at 2325.792389s 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -366> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): get_auth_request con 0x56275fd4e630 auth_method 0 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -365> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -364> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -363> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -362> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): get_auth_request con 0x56275fd4e250 auth_method 0 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -361> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -360> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -359> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -358> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -357> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -356> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -355> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -354> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.211 INFO:tasks.workunit.client.0.smithi104.stderr: -353> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr: -352> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient(hunting): handle_auth_done global_id 6419 payload 824 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr: -351> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient: _finish_hunting 0 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr: -350> 2024-04-03T04:01:10.051+0000 7f618f222640 1 monclient: found mon.noname-c 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr: -349> 2024-04-03T04:01:10.051+0000 7f618f222640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr: -348> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr: -347> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr: -346> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: dump: 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.212 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr: -345> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: _finish_auth 0 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr: -344> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: _check_auth_tickets 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr: -343> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr: -342> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr: -341> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr: -340> 2024-04-03T04:01:10.051+0000 7f6078e01640 10 monclient: dump: 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.213 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -339> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 monclient: authenticate success, global_id 6419 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -338> 2024-04-03T04:01:10.051+0000 7f618fa23640 4 set_mon_vals no callback set 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -337> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -336> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -335> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -334> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -333> 2024-04-03T04:01:10.051+0000 7f6078e01640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -332> 2024-04-03T04:01:10.051+0000 7f6078e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -331> 2024-04-03T04:01:10.051+0000 7f6078e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -330> 2024-04-03T04:01:10.051+0000 7f618e220640 10 monclient: get_auth_request con 0x7f6068066ca0 auth_method 0 2024-04-03T04:01:10.214 INFO:tasks.workunit.client.0.smithi104.stderr: -329> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: get_monmap_and_config 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr: -328> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: build_initial_monmap 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr: -327> 2024-04-03T04:01:10.051+0000 7f6190f06980 1 build_initial for_mkfs: 0 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr: -326> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: monmap: 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.215 INFO:tasks.workunit.client.0.smithi104.stderr: -325> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding auth protocol: cephx 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -324> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding auth protocol: cephx 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -323> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding auth protocol: cephx 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -322> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -321> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -320> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -319> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -318> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -317> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -316> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -315> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -314> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -313> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -312> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: crc 2024-04-03T04:01:10.216 INFO:tasks.workunit.client.0.smithi104.stderr: -311> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x56275fd6bda0) adding con mode: secure 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -310> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -309> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: init 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -308> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding auth protocol: cephx 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -307> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding auth protocol: cephx 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -306> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding auth protocol: cephx 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -305> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -304> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -303> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -302> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -301> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -300> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -299> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -298> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.217 INFO:tasks.workunit.client.0.smithi104.stderr: -297> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -296> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -295> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: crc 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -294> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b020a0) adding con mode: secure 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -293> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -292> 2024-04-03T04:01:10.051+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -291> 2024-04-03T04:01:10.051+0000 7f6190f06980 5 asok(0x56275fac5210) register_command rotate-key cmddesc rotate-key hook 0x7ffde7b021e8 EEXIST 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -290> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -289> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient: _add_conns ranks=[2,0,1] 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -288> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-c con 0x56275fda0090 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -287> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-a con 0x56275fda0470 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -286> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-b con 0x56275fd6e130 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -285> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -284> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.218 INFO:tasks.workunit.client.0.smithi104.stderr: -283> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -282> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -281> 2024-04-03T04:01:10.051+0000 7f6190f06980 10 monclient(hunting): authenticate will time out at 2325.795936s 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -280> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): get_auth_request con 0x56275fda0090 auth_method 0 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -279> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -278> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -277> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -276> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): get_auth_request con 0x56275fda0470 auth_method 0 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -275> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -274> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -273> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -272> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -271> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -270> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.219 INFO:tasks.workunit.client.0.smithi104.stderr: -269> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr: -268> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr: -267> 2024-04-03T04:01:10.055+0000 7f618f222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr: -266> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_done global_id 6422 payload 274 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr: -265> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient: _finish_hunting 0 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr: -264> 2024-04-03T04:01:10.055+0000 7f618e220640 1 monclient: found mon.noname-c 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr: -263> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr: -262> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr: -261> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr: -260> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: dump: 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.220 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr: -259> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: _finish_auth 0 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr: -258> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: _check_auth_tickets 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr: -257> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr: -256> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr: -255> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr: -254> 2024-04-03T04:01:10.055+0000 7f60727fc640 10 monclient: dump: 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.221 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr: -253> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 monclient: authenticate success, global_id 6422 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr: -252> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: get_monmap_and_config success 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr: -251> 2024-04-03T04:01:10.055+0000 7f6190f06980 4 set_mon_vals no callback set 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr: -250> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: shutdown 2024-04-03T04:01:10.222 INFO:tasks.workunit.client.0.smithi104.stderr: -249> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: build_initial_monmap 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr: -248> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 build_initial for_mkfs: 0 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr: -247> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: monmap: 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr: -246> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding auth protocol: cephx 2024-04-03T04:01:10.223 INFO:tasks.workunit.client.0.smithi104.stderr: -245> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding auth protocol: cephx 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -244> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding auth protocol: cephx 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -243> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -242> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -241> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -240> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -239> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -238> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -237> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -236> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -235> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -234> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -233> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: crc 2024-04-03T04:01:10.224 INFO:tasks.workunit.client.0.smithi104.stderr: -232> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd9b830) adding con mode: secure 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -231> 2024-04-03T04:01:10.055+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -230> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: starting msgr at 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -229> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: starting objecter 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -228> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 asok(0x56275fac5210) register_command objecter_requests cmddesc objecter_requests hook 0x56275fd4e030 EEXIST 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -227> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: setting wanted keys 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -226> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: calling monclient init 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -225> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: init 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -224> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding auth protocol: cephx 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -223> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding auth protocol: cephx 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -222> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding auth protocol: cephx 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -221> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -220> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -219> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.225 INFO:tasks.workunit.client.0.smithi104.stderr: -218> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -217> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -216> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -215> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -214> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -213> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -212> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -211> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: crc 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -210> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 AuthRegistry(0x56275fd6af70) adding con mode: secure 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -209> 2024-04-03T04:01:10.055+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -208> 2024-04-03T04:01:10.055+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -207> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 asok(0x56275fac5210) register_command rotate-key cmddesc rotate-key hook 0x56275fd6b0b8 EEXIST 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -206> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:10.226 INFO:tasks.workunit.client.0.smithi104.stderr: -205> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -204> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-a con 0x56275fd6e130 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -203> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-b con 0x56275fda0090 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -202> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): picked mon.noname-c con 0x56275fda0470 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -201> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -200> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -199> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -198> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -197> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient(hunting): authenticate will time out at 2325.798535s 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -196> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): get_auth_request con 0x56275fda0470 auth_method 0 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -195> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -194> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.227 INFO:tasks.workunit.client.0.smithi104.stderr: -193> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -192> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): get_auth_request con 0x56275fd6e130 auth_method 0 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -191> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -190> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -189> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -188> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -187> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -186> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -185> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -184> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -183> 2024-04-03T04:01:10.055+0000 7f618e220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -182> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient(hunting): handle_auth_done global_id 6425 payload 824 2024-04-03T04:01:10.228 INFO:tasks.workunit.client.0.smithi104.stderr: -181> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient: _finish_hunting 0 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr: -180> 2024-04-03T04:01:10.055+0000 7f618ea21640 1 monclient: found mon.noname-c 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr: -179> 2024-04-03T04:01:10.055+0000 7f618ea21640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr: -178> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr: -177> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr: -176> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: dump: 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.229 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr: -175> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: _finish_auth 0 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr: -174> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: _check_auth_tickets 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr: -173> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr: -172> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr: -171> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr: -170> 2024-04-03T04:01:10.055+0000 7f6070ff9640 10 monclient: dump: 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:10.230 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr: -169> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 monclient: authenticate success, global_id 6425 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr: -168> 2024-04-03T04:01:10.055+0000 7f60727fc640 4 set_mon_vals no callback set 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr: -167> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr: -166> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr: -165> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _renew_subs 2024-04-03T04:01:10.231 INFO:tasks.workunit.client.0.smithi104.stderr: -164> 2024-04-03T04:01:10.055+0000 7f6190f06980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -163> 2024-04-03T04:01:10.055+0000 7f6190f06980 1 librados: init done 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -162> 2024-04-03T04:01:10.055+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cr dump hook 0x56275fda4ca8 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -161> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -160> 2024-04-03T04:01:10.059+0000 7f6070ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -159> 2024-04-03T04:01:10.059+0000 7f6070ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -158> 2024-04-03T04:01:10.059+0000 7f6070ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -157> 2024-04-03T04:01:10.059+0000 7f618e220640 10 monclient: get_auth_request con 0x7f6058066d60 auth_method 0 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -156> 2024-04-03T04:01:10.059+0000 7f618f222640 10 monclient: get_auth_request con 0x56275fdba170 auth_method 0 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -155> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.232 INFO:tasks.workunit.client.0.smithi104.stderr: -154> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 realm 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -153> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -152> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -151> 2024-04-03T04:01:10.059+0000 7f6190f06980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -150> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -149> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -148> 2024-04-03T04:01:10.059+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -147> 2024-04-03T04:01:10.059+0000 7f618e220640 10 monclient: get_auth_request con 0x56275fdbe310 auth_method 0 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -146> 2024-04-03T04:01:10.063+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -145> 2024-04-03T04:01:10.063+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -144> 2024-04-03T04:01:10.063+0000 7f618f222640 10 monclient: get_auth_request con 0x56275fdc1b70 auth_method 0 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -143> 2024-04-03T04:01:10.063+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -142> 2024-04-03T04:01:10.063+0000 7f6190f06980 20 searching for the correct realm 2024-04-03T04:01:10.233 INFO:tasks.workunit.client.0.smithi104.stderr: -141> 2024-04-03T04:01:10.063+0000 7f618ea21640 10 monclient: get_auth_request con 0x56275fdc6820 auth_method 0 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -140> 2024-04-03T04:01:10.063+0000 7f618e220640 10 monclient: get_auth_request con 0x7f618005c610 auth_method 0 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -139> 2024-04-03T04:01:10.067+0000 7f618f222640 10 monclient: get_auth_request con 0x7f61880bf030 auth_method 0 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -138> 2024-04-03T04:01:10.067+0000 7f618ea21640 0 -- 172.21.15.104:0/2414169662 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x56275fdc6820 msgr2=0x56275fdc8ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -137> 2024-04-03T04:01:10.067+0000 7f6070ff9640 1 client.6425.objecter ms_handle_reset 0x56275fdc6820 session 0x56275fdc61a0 osd.3 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -136> 2024-04-03T04:01:10.067+0000 7f6070ff9640 10 monclient: _renew_subs 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -135> 2024-04-03T04:01:10.067+0000 7f6070ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -134> 2024-04-03T04:01:10.067+0000 7f618ea21640 10 monclient: get_auth_request con 0x7f6058077490 auth_method 0 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -133> 2024-04-03T04:01:10.071+0000 7f618ea21640 10 monclient: get_auth_request con 0x7f61881137e0 auth_method 0 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -132> 2024-04-03T04:01:10.075+0000 7f618e220640 10 monclient: get_auth_request con 0x7f61881179c0 auth_method 0 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -131> 2024-04-03T04:01:10.075+0000 7f618e220640 0 -- 172.21.15.104:0/2414169662 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f61881179c0 msgr2=0x7f618810e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -130> 2024-04-03T04:01:10.075+0000 7f6070ff9640 1 client.6425.objecter ms_handle_reset 0x7f61881179c0 session 0x7f6188113c50 osd.0 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -129> 2024-04-03T04:01:10.075+0000 7f618e220640 10 monclient: get_auth_request con 0x56275fdc6820 auth_method 0 2024-04-03T04:01:10.234 INFO:tasks.workunit.client.0.smithi104.stderr: -128> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -127> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -126> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -125> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -124> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -123> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -122> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -121> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -120> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -119> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -118> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -117> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -116> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 zone default found 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -115> 2024-04-03T04:01:10.083+0000 7f6190f06980 4 Realm: () 2024-04-03T04:01:10.235 INFO:tasks.workunit.client.0.smithi104.stderr: -114> 2024-04-03T04:01:10.083+0000 7f6190f06980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -113> 2024-04-03T04:01:10.083+0000 7f6190f06980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -112> 2024-04-03T04:01:10.083+0000 7f6190f06980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -111> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 zonegroup default 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -110> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -109> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -108> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -107> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -106> 2024-04-03T04:01:10.083+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -105> 2024-04-03T04:01:10.087+0000 7f6190f06980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -104> 2024-04-03T04:01:10.087+0000 7f6190f06980 20 started sync module instance, tier type = 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -103> 2024-04-03T04:01:10.087+0000 7f6190f06980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -102> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=0 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -101> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=1 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -100> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=2 2024-04-03T04:01:10.236 INFO:tasks.workunit.client.0.smithi104.stderr: -99> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=3 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -98> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=4 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -97> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=5 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -96> 2024-04-03T04:01:10.099+0000 7f6190f06980 20 add_watcher() i=6 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -95> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 add_watcher() i=7 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -94> 2024-04-03T04:01:10.103+0000 7f6190f06980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -93> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding auth protocol: cephx 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -92> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding auth protocol: cephx 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -91> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding auth protocol: cephx 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -90> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -89> 2024-04-03T04:01:10.103+0000 7f6045fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -88> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -87> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -86> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -85> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.237 INFO:tasks.workunit.client.0.smithi104.stderr: -84> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -83> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -82> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -81> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -80> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -79> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: crc 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -78> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 AuthRegistry(0x7ffde7b02530) adding con mode: secure 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -77> 2024-04-03T04:01:10.103+0000 7f6190f06980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -76> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -75> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -74> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cache list hook 0x56275fd99af0 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -73> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cache inspect hook 0x56275fd99af0 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -72> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cache erase hook 0x56275fd99af0 2024-04-03T04:01:10.238 INFO:tasks.workunit.client.0.smithi104.stderr: -71> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command cache zap hook 0x56275fd99af0 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -70> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 note: GC not initialized 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -69> 2024-04-03T04:01:10.103+0000 7f6044fe1640 20 reqs_thread_entry: start 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -68> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command sync trace show hook 0x7f6188004730 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -67> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command sync trace history hook 0x7f6188004730 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -66> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command sync trace active hook 0x7f6188004730 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -65> 2024-04-03T04:01:10.103+0000 7f6190f06980 5 asok(0x56275fac5210) register_command sync trace active_short hook 0x7f6188004730 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -64> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -63> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 Filter name: none 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -62> 2024-04-03T04:01:10.103+0000 7f603dffb640 20 reqs_thread_entry: start 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -61> 2024-04-03T04:01:10.103+0000 7f6190f06980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -60> 2024-04-03T04:01:10.103+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -59> 2024-04-03T04:01:10.107+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -58> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -57> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-04-03T04:01:10.239 INFO:tasks.workunit.client.0.smithi104.stderr: -56> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 : miss 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -55> 2024-04-03T04:01:10.107+0000 7f6190f06980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -54> 2024-04-03T04:01:10.107+0000 7f6190f06980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -53> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -52> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -51> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -50> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -49> 2024-04-03T04:01:10.107+0000 7f6190f06980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -48> 2024-04-03T04:01:10.115+0000 7f6190f06980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -47> 2024-04-03T04:01:10.115+0000 7f6190f06980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -46> 2024-04-03T04:01:10.115+0000 7f6190f06980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -45> 2024-04-03T04:01:10.115+0000 7f6190f06980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26, ofs0, ns] 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -44> 2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562455 cookie 94727112014224 notifier 6425 bl.length()=893 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -43> 2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:10.240 INFO:tasks.workunit.client.0.smithi104.stderr: -42> 2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -41> 2024-04-03T04:01:10.115+0000 7f6071ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -40> 2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_sources= new_sources= 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -39> 2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential sources added=[] removed=[] 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -38> 2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_dests= new_dests= 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -37> 2024-04-03T04:01:10.119+0000 7f6190f06980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential dests added=[] removed=[] 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -36> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.0 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -35> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.0 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -34> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.1 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -33> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.1 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -32> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.2 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -31> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.2 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -30> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.3 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -29> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.3 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -28> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.4 2024-04-03T04:01:10.241 INFO:tasks.workunit.client.0.smithi104.stderr: -27> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.4 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -26> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.5 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -25> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.5 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -24> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.6 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -23> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.6 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -22> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.7 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -21> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.7 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -20> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.8 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -19> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.8 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -18> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.9 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -17> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.9 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -16> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.10 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -15> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.10 2024-04-03T04:01:10.242 INFO:tasks.workunit.client.0.smithi104.stderr: -14> 2024-04-03T04:01:10.123+0000 7f6190f06980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.11 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -13> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.11 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -12> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.0 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -11> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -10> 2024-04-03T04:01:10.123+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.2 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -9> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.3 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -8> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.4 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -7> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.5 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -6> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.6 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -5> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.7 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -4> 2024-04-03T04:01:10.127+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.8 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -3> 2024-04-03T04:01:10.131+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.9 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -2> 2024-04-03T04:01:10.131+0000 7f6190f06980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.10 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: -1> 2024-04-03T04:01:10.135+0000 7f6190f06980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6190f06980 time 2024-04-03T04:01:10.140287+0000 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:01:10.243 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.244 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:10.244 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f61947dce1f] 2024-04-03T04:01:10.245 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f61947dcfd3] 2024-04-03T04:01:10.245 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56275dd3d5b1] 2024-04-03T04:01:10.245 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x56275dd4b52f] 2024-04-03T04:01:10.245 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:01:10.245 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6193646d90] 2024-04-03T04:01:10.245 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:01:10.245 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: 0> 2024-04-03T04:01:10.135+0000 7f6190f06980 -1 *** Caught signal (Aborted) ** 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7f6190f06980 thread_name:radosgw-admin 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f619365f520] 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f61947dce79] 2024-04-03T04:01:10.246 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7f61947dcfd3] 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56275dd3d5b1] 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x57f) [0x56275dd4b52f] 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6193646d90] 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr:--- logging levels --- 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 none 2024-04-03T04:01:10.247 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 lockdep 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 context 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 crush 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_balancer 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_locker 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log_expire 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_migrator 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 3/ 5 mds_quiesce 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 buffer 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 timer 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 filer 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 striper 2024-04-03T04:01:10.248 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 objecter 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rados 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_mirror 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_replay 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_pwl 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 journaler 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objectcacher 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 immutable_obj_cache 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 client 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 osd 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 optracker 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objclass 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 filestore 2024-04-03T04:01:10.249 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 journal 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 ms 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mon 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 0/10 monc 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 paxos 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 tp 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 auth 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 crypto 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 finisher 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 reserver 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 heartbeatmap 2024-04-03T04:01:10.250 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 perfcounter 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 20/20 rgw 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_sync 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_datacache 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_access 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_dbstore 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_flight 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_lifecycle 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_notification 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 javaclient 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 asok 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 throttle 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 refs 2024-04-03T04:01:10.251 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 compressor 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluestore 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluefs 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 bdev 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 kstore 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 4/ 5 rocksdb 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 fuse 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 2/ 5 mgr 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mgrc 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 dpdk 2024-04-03T04:01:10.252 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 eventtrace 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 prioritycache 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 test 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephfs_mirror 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephsqlite 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 crimson_interrupt 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_onode 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_odata 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_omap 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_tm 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_t 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cleaner 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_epm 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_lba 2024-04-03T04:01:10.253 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cache 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_journal 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_device 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_backref 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 alienstore 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mclock 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cyanstore 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 ceph_exporter 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 memstore 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 trace 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: -2/-2 (syslog threshold) 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 99/99 (stderr threshold) 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-03T04:01:10.254 INFO:tasks.workunit.client.0.smithi104.stderr: 7f603dffb640 / http_manager 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6044fe1640 / http_manager 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6045fe3640 / rgw_dt_lg_renew 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6070ff9640 / ms_dispatch 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6071ffb640 / io_context_pool 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f60727fc640 / io_context_pool 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6078e01640 / ms_dispatch 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f607b606640 / ms_dispatch 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f607ce09640 / io_context_pool 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f618e220640 / msgr-worker-2 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f618ea21640 / msgr-worker-1 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f618f222640 / msgr-worker-0 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f618fa23640 / io_context_pool 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: 7f6190f06980 / radosgw-admin 2024-04-03T04:01:10.255 INFO:tasks.workunit.client.0.smithi104.stderr: max_recent 500 2024-04-03T04:01:10.256 INFO:tasks.workunit.client.0.smithi104.stderr: max_new 1000 2024-04-03T04:01:10.256 INFO:tasks.workunit.client.0.smithi104.stderr: log_file /var/lib/ceph/crash/2024-04-03T04:01:10.142223Z_4d143484-8f78-4121-a228-ff2ae67ee6c9/log 2024-04-03T04:01:10.256 INFO:tasks.workunit.client.0.smithi104.stderr:--- end dump of recent events --- 2024-04-03T04:01:10.256 INFO:tasks.workunit.client.0.smithi104.stderr:Aborted 2024-04-03T04:01:10.256 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-04-03T04:01:10.257 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:10.257 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.215+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.215+0000 7f7cbb39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.215+0000 7f7cbb39e980 20 realm 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.215+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.219+0000 7f7cbb39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.219+0000 7f7cbb39e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.219+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.219+0000 7f7cbb39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.219+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.219+0000 7f7cbb39e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.219+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.219+0000 7f7cbb39e980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.219+0000 7f7cbb39e980 20 searching for the correct realm 2024-04-03T04:01:10.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.223+0000 7f7cb86b8640 0 -- 172.21.15.104:0/1416313249 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f7ca8027040 msgr2=0x7f7ca8014910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:10.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.231+0000 7f7cb86b8640 0 -- 172.21.15.104:0/1416313249 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f7cb007e820 msgr2=0x7f7cb0058020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:10.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.447+0000 7f7cbb39e980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:10.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.447+0000 7f7cbb39e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:10.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.447+0000 7f7cbb39e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:10.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.447+0000 7f7cbb39e980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:10.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.447+0000 7f7cbb39e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:10.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.447+0000 7f7cbb39e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:10.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.447+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:10.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:10.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 zone default found 2024-04-03T04:01:10.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 4 Realm: () 2024-04-03T04:01:10.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:10.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:10.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:10.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 zonegroup default 2024-04-03T04:01:10.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.451+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.455+0000 7f7cbb39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.455+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.455+0000 7f7cbb39e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:10.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.455+0000 7f7cbb39e980 20 started sync module instance, tier type = 2024-04-03T04:01:10.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.455+0000 7f7cbb39e980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:10.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.475+0000 7f7cbb39e980 20 add_watcher() i=0 2024-04-03T04:01:10.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.475+0000 7f7cbb39e980 20 add_watcher() i=1 2024-04-03T04:01:10.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.475+0000 7f7cbb39e980 20 add_watcher() i=2 2024-04-03T04:01:10.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.475+0000 7f7cbb39e980 20 add_watcher() i=3 2024-04-03T04:01:10.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.475+0000 7f7cbb39e980 20 add_watcher() i=4 2024-04-03T04:01:10.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.475+0000 7f7cbb39e980 20 add_watcher() i=5 2024-04-03T04:01:10.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.475+0000 7f7cbb39e980 20 add_watcher() i=6 2024-04-03T04:01:10.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.475+0000 7f7cbb39e980 20 add_watcher() i=7 2024-04-03T04:01:10.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.475+0000 7f7cbb39e980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:10.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.479+0000 7f7b6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:10.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:10.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:10.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 5 note: GC not initialized 2024-04-03T04:01:10.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7b6dfe3640 20 reqs_thread_entry: start 2024-04-03T04:01:10.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:10.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 Filter name: none 2024-04-03T04:01:10.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7adf7fe640 20 reqs_thread_entry: start 2024-04-03T04:01:10.465 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:10.465 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 rados_obj.operate() r=0 bl.length=413 2024-04-03T04:01:10.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:10.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:10.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.483+0000 7f7cbb39e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:10.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.487+0000 7f7cbb39e980 20 rados_obj.operate() r=0 bl.length=413 2024-04-03T04:01:10.467 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.487+0000 7f7cbb39e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:10.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.487+0000 7f7b6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:10.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.495+0000 7f7cbb39e980 20 remove_watcher() i=0 2024-04-03T04:01:10.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.495+0000 7f7cbb39e980 2 removed watcher, disabling cache 2024-04-03T04:01:10.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.495+0000 7f7cbb39e980 20 remove_watcher() i=1 2024-04-03T04:01:10.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.499+0000 7f7cbb39e980 20 remove_watcher() i=2 2024-04-03T04:01:10.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.499+0000 7f7cbb39e980 20 remove_watcher() i=3 2024-04-03T04:01:10.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.503+0000 7f7cbb39e980 20 remove_watcher() i=4 2024-04-03T04:01:10.484 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.503+0000 7f7cbb39e980 20 remove_watcher() i=5 2024-04-03T04:01:10.486 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.503+0000 7f7cbb39e980 20 remove_watcher() i=6 2024-04-03T04:01:10.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:10.507+0000 7f7cbb39e980 20 remove_watcher() i=7 2024-04-03T04:01:10.503 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.503 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:10.503 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-commit-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:01:10.503 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:10.504 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:10.504 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:40.780 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:40.781 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:40.860 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T04:01:40.895 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:40.895 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:40.939 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.959+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:40.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.959+0000 7ff004414980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:40.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.959+0000 7ff004414980 20 realm 2024-04-03T04:01:40.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.959+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:40.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.959+0000 7ff004414980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:40.941 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.959+0000 7ff004414980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:40.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.959+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:40.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.959+0000 7ff004414980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:40.942 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.959+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:40.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.963+0000 7ff004414980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:40.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.963+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:40.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.963+0000 7ff004414980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:40.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.963+0000 7ff004414980 20 searching for the correct realm 2024-04-03T04:01:40.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.967+0000 7ff002730640 0 -- 172.21.15.104:0/1469626140 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7feffc101060 msgr2=0x7feffc0aaac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:40.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:40.975+0000 7ff00172e640 0 -- 172.21.15.104:0/1469626140 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7feffc109810 msgr2=0x7feffc10b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:41.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.191+0000 7ff004414980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:41.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.191+0000 7ff004414980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:41.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.191+0000 7ff004414980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:41.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.191+0000 7ff004414980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:41.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.191+0000 7ff004414980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:41.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.191+0000 7ff004414980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:41.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.191+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.191+0000 7ff004414980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:41.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:41.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 zone default found 2024-04-03T04:01:41.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 4 Realm: () 2024-04-03T04:01:41.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:41.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:41.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:41.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 zonegroup default 2024-04-03T04:01:41.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.195+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.199+0000 7ff004414980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.199+0000 7ff004414980 20 started sync module instance, tier type = 2024-04-03T04:01:41.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.199+0000 7ff004414980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:41.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.222+0000 7ff004414980 20 add_watcher() i=0 2024-04-03T04:01:41.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.222+0000 7ff004414980 20 add_watcher() i=1 2024-04-03T04:01:41.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.222+0000 7ff004414980 20 add_watcher() i=2 2024-04-03T04:01:41.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.222+0000 7ff004414980 20 add_watcher() i=3 2024-04-03T04:01:41.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.222+0000 7ff004414980 20 add_watcher() i=4 2024-04-03T04:01:41.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.222+0000 7ff004414980 20 add_watcher() i=5 2024-04-03T04:01:41.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.222+0000 7ff004414980 20 add_watcher() i=6 2024-04-03T04:01:41.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.222+0000 7ff004414980 20 add_watcher() i=7 2024-04-03T04:01:41.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.222+0000 7ff004414980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:41.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7feeb7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:41.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:41.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:41.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 5 note: GC not initialized 2024-04-03T04:01:41.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7feeb6fe5640 20 reqs_thread_entry: start 2024-04-03T04:01:41.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:41.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 20 Filter name: none 2024-04-03T04:01:41.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7feeb4fe1640 20 reqs_thread_entry: start 2024-04-03T04:01:41.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-04-03T04:01:41.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:41.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-04-03T04:01:41.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-04-03T04:01:41.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 : miss 2024-04-03T04:01:41.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.230+0000 7ff004414980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.234+0000 7ff004414980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:41.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.234+0000 7ff004414980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:41.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.234+0000 7ff004414980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:41.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.234+0000 7ff004414980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:41.216 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.234+0000 7ff004414980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:41.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.234+0000 7ff004414980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 2024-04-03T04:01:41.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7ff004414980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:41.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7ff004414980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:41.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7ff004414980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:41.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7ff004414980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26, ofs0, ns] 2024-04-03T04:01:41.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7feee57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562457 cookie 94261987916576 notifier 6855 bl.length()=893 2024-04-03T04:01:41.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7feee57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:41.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7feee57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:41.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7feee57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:41.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7ff004414980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_sources= new_sources= 2024-04-03T04:01:41.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7ff004414980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential sources added=[] removed=[] 2024-04-03T04:01:41.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7ff004414980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_dests= new_dests= 2024-04-03T04:01:41.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.246+0000 7ff004414980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential dests added=[] removed=[] 2024-04-03T04:01:41.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.0 2024-04-03T04:01:41.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.0 2024-04-03T04:01:41.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.1 2024-04-03T04:01:41.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.1 2024-04-03T04:01:41.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.2 2024-04-03T04:01:41.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.2 2024-04-03T04:01:41.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.3 2024-04-03T04:01:41.235 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.3 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.4 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.4 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.5 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.5 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.6 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.6 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.7 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.7 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.8 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.8 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.9 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.9 2024-04-03T04:01:41.236 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.10 2024-04-03T04:01:41.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.10 2024-04-03T04:01:41.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.11 2024-04-03T04:01:41.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1.11 2024-04-03T04:01:41.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.250+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.0 2024-04-03T04:01:41.237 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.254+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.1 2024-04-03T04:01:41.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.254+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.2 2024-04-03T04:01:41.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.254+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.3 2024-04-03T04:01:41.239 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.254+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.4 2024-04-03T04:01:41.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.258+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.5 2024-04-03T04:01:41.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.258+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.6 2024-04-03T04:01:41.240 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.258+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.7 2024-04-03T04:01:41.241 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.258+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.8 2024-04-03T04:01:41.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.258+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.9 2024-04-03T04:01:41.242 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.262+0000 7ff004414980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26.10 2024-04-03T04:01:41.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.266+0000 7ff004414980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 : hit (requested=0x17, cached=0x17) 2024-04-03T04:01:41.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.266+0000 7ff004414980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 2024-04-03T04:01:41.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.270+0000 7ff004414980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:41.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.270+0000 7ff004414980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:41.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.270+0000 7ff004414980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:41.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.270+0000 7ff004414980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26, ofs0, ns] 2024-04-03T04:01:41.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.270+0000 7feee4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562458 cookie 94261987916576 notifier 6855 bl.length()=861 2024-04-03T04:01:41.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.270+0000 7feee4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 info.flags=0x17 2024-04-03T04:01:41.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.270+0000 7feee4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 to cache LRU end 2024-04-03T04:01:41.253 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.270+0000 7feee4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:41.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.274+0000 7ff004414980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_sources= new_sources= 2024-04-03T04:01:41.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.274+0000 7ff004414980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential sources added=[] removed=[] 2024-04-03T04:01:41.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.274+0000 7ff004414980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): orig_dests= new_dests= 2024-04-03T04:01:41.256 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.274+0000 7ff004414980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26]): potential dests added=[] removed=[] 2024-04-03T04:01:41.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.278+0000 7ff004414980 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2024-04-03T04:01:41.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.282+0000 7feeb7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:41.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.286+0000 7ff004414980 20 remove_watcher() i=0 2024-04-03T04:01:41.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.286+0000 7ff004414980 2 removed watcher, disabling cache 2024-04-03T04:01:41.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.290+0000 7ff004414980 20 remove_watcher() i=1 2024-04-03T04:01:41.273 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.290+0000 7ff004414980 20 remove_watcher() i=2 2024-04-03T04:01:41.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.294+0000 7ff004414980 20 remove_watcher() i=3 2024-04-03T04:01:41.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.294+0000 7ff004414980 20 remove_watcher() i=4 2024-04-03T04:01:41.279 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.298+0000 7ff004414980 20 remove_watcher() i=5 2024-04-03T04:01:41.280 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.298+0000 7ff004414980 20 remove_watcher() i=6 2024-04-03T04:01:41.282 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.298+0000 7ff004414980 20 remove_watcher() i=7 2024-04-03T04:01:41.296 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-04-03T04:01:41.325 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:41.326 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:41.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.386+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.386+0000 7fdc4667e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.386+0000 7fdc4667e980 20 realm 2024-04-03T04:01:41.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.386+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.386+0000 7fdc4667e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.386+0000 7fdc4667e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:41.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.386+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.390+0000 7fdc4667e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.390+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.390+0000 7fdc4667e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:41.372 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.390+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.390+0000 7fdc4667e980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:41.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.390+0000 7fdc4667e980 20 searching for the correct realm 2024-04-03T04:01:41.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.398+0000 7fdc4499a640 0 -- 172.21.15.104:0/2177231043 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fdc3c0bd420 msgr2=0x7fdc3c0bd860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:41.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.402+0000 7fdc4499a640 0 -- 172.21.15.104:0/2177231043 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fdb0c077490 msgr2=0x7fdb0c0798c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:41.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:41.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:41.392 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 zone default found 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 4 Realm: () 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 zonegroup default 2024-04-03T04:01:41.394 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.410+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.414+0000 7fdc4667e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.414+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.414+0000 7fdc4667e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:41.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.414+0000 7fdc4667e980 20 started sync module instance, tier type = 2024-04-03T04:01:41.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.414+0000 7fdc4667e980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:41.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.426+0000 7fdc4667e980 20 add_watcher() i=0 2024-04-03T04:01:41.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.426+0000 7fdc4667e980 20 add_watcher() i=1 2024-04-03T04:01:41.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.426+0000 7fdc4667e980 20 add_watcher() i=2 2024-04-03T04:01:41.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.426+0000 7fdc4667e980 20 add_watcher() i=3 2024-04-03T04:01:41.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.426+0000 7fdc4667e980 20 add_watcher() i=4 2024-04-03T04:01:41.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.426+0000 7fdc4667e980 20 add_watcher() i=5 2024-04-03T04:01:41.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.426+0000 7fdc4667e980 20 add_watcher() i=6 2024-04-03T04:01:41.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.430+0000 7fdc4667e980 20 add_watcher() i=7 2024-04-03T04:01:41.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.430+0000 7fdc4667e980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:41.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.430+0000 7fdafafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:41.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:41.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:41.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 5 note: GC not initialized 2024-04-03T04:01:41.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdaf9fdb640 20 reqs_thread_entry: start 2024-04-03T04:01:41.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:41.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 Filter name: none 2024-04-03T04:01:41.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fda6b7fe640 20 reqs_thread_entry: start 2024-04-03T04:01:41.415 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:41.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:41.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:41.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rados_obj.operate() r=0 bl.length=197 2024-04-03T04:01:41.417 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rados->read ofs=0 len=0 2024-04-03T04:01:41.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 rados_obj.operate() r=0 bl.length=381 2024-04-03T04:01:41.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.434+0000 7fdc4667e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:41.421 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.438+0000 7fdafafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:41.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.442+0000 7fdc4667e980 20 remove_watcher() i=0 2024-04-03T04:01:41.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.442+0000 7fdc4667e980 2 removed watcher, disabling cache 2024-04-03T04:01:41.427 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.446+0000 7fdc4667e980 20 remove_watcher() i=1 2024-04-03T04:01:41.429 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.446+0000 7fdc4667e980 20 remove_watcher() i=2 2024-04-03T04:01:41.431 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.450+0000 7fdc4667e980 20 remove_watcher() i=3 2024-04-03T04:01:41.432 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.450+0000 7fdc4667e980 20 remove_watcher() i=4 2024-04-03T04:01:41.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.450+0000 7fdc4667e980 20 remove_watcher() i=5 2024-04-03T04:01:41.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.454+0000 7fdc4667e980 20 remove_watcher() i=6 2024-04-03T04:01:41.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:41.454+0000 7fdc4667e980 20 remove_watcher() i=7 2024-04-03T04:01:41.451 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:41.451 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:41.451 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-commit-target-layout id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-04-03T04:01:41.451 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:41.452 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:41.452 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:41.473 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:41.473 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:41.896 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:41.896 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:42.268 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-04-03T04:01:42.268 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:42.271 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:42.272 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:42.398 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:42.398 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:42.479 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:42.479 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:42.565 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:42.566 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:42.659 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:42.659 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:42.749 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:42.749 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:42.840 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:42.840 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:42.933 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:42.933 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.018 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.019 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.109 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.109 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.197 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.197 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.287 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.288 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.377 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.377 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.466 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.466 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.558 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.558 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.645 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.645 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.737 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.738 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.822 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.822 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:43.917 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:43.917 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:44.007 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:44.007 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:44.098 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:44.098 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:44.186 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:44.187 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:44.275 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-04-03T04:01:44.308 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:44.308 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:44.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.370+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 realm 2024-04-03T04:01:44.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:44.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.356 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:44.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:44.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.374+0000 7f1781b13980 20 searching for the correct realm 2024-04-03T04:01:44.364 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.382+0000 7f177f62e640 0 -- 172.21.15.104:0/1154885232 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x560f327f53f0 msgr2=0x560f327f77e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:44.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.386+0000 7f177ee2d640 0 -- 172.21.15.104:0/1154885232 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f17700d03f0 msgr2=0x7f17700d0870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:44.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.394+0000 7f1781b13980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:44.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.394+0000 7f1781b13980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:44.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.394+0000 7f1781b13980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:44.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.394+0000 7f1781b13980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:44.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.394+0000 7f1781b13980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:44.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.394+0000 7f1781b13980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:44.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.394+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.394+0000 7f1781b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.379 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.394+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 zone default found 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 4 Realm: () 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 zonegroup default 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 started sync module instance, tier type = 2024-04-03T04:01:44.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.398+0000 7f1781b13980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:44.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.414+0000 7f1781b13980 20 add_watcher() i=0 2024-04-03T04:01:44.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.414+0000 7f1781b13980 20 add_watcher() i=1 2024-04-03T04:01:44.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.414+0000 7f1781b13980 20 add_watcher() i=2 2024-04-03T04:01:44.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.414+0000 7f1781b13980 20 add_watcher() i=3 2024-04-03T04:01:44.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.414+0000 7f1781b13980 20 add_watcher() i=4 2024-04-03T04:01:44.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.414+0000 7f1781b13980 20 add_watcher() i=5 2024-04-03T04:01:44.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.414+0000 7f1781b13980 20 add_watcher() i=6 2024-04-03T04:01:44.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.414+0000 7f1781b13980 20 add_watcher() i=7 2024-04-03T04:01:44.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.414+0000 7f1781b13980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:44.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.418+0000 7f1634fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:44.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.418+0000 7f1781b13980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:44.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.418+0000 7f1781b13980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:44.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.418+0000 7f1781b13980 5 note: GC not initialized 2024-04-03T04:01:44.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.418+0000 7f15af7fe640 20 reqs_thread_entry: start 2024-04-03T04:01:44.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.418+0000 7f1781b13980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:44.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.418+0000 7f1781b13980 20 Filter name: none 2024-04-03T04:01:44.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.418+0000 7f15ad7fa640 20 reqs_thread_entry: start 2024-04-03T04:01:44.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.418+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.422+0000 7f1781b13980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:44.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.422+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.403 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.422+0000 7f1781b13980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:44.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.422+0000 7f1781b13980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:44.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.422+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.422+0000 7f1781b13980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:44.404 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.422+0000 7f1781b13980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.422+0000 7f1781b13980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:44.405 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.422+0000 7f1781b13980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:44.407 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.426+0000 7f1634fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:44.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.430+0000 7f1781b13980 20 remove_watcher() i=0 2024-04-03T04:01:44.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.430+0000 7f1781b13980 2 removed watcher, disabling cache 2024-04-03T04:01:44.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.430+0000 7f1781b13980 20 remove_watcher() i=1 2024-04-03T04:01:44.416 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.434+0000 7f1781b13980 20 remove_watcher() i=2 2024-04-03T04:01:44.418 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.434+0000 7f1781b13980 20 remove_watcher() i=3 2024-04-03T04:01:44.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.438+0000 7f1781b13980 20 remove_watcher() i=4 2024-04-03T04:01:44.423 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.442+0000 7f1781b13980 20 remove_watcher() i=5 2024-04-03T04:01:44.424 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.442+0000 7f1781b13980 20 remove_watcher() i=6 2024-04-03T04:01:44.425 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.442+0000 7f1781b13980 20 remove_watcher() i=7 2024-04-03T04:01:44.438 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:44.438 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:44.439 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-do-reshard id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:01:44.439 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:44.439 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-04-03T04:01:44.470 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:44.470 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:44.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.530+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 realm 2024-04-03T04:01:44.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:44.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:44.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:44.518 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.534+0000 7f89fa55b980 20 searching for the correct realm 2024-04-03T04:01:44.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.538+0000 7f89f7875640 0 -- 172.21.15.104:0/4201626472 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f89e80c6450 msgr2=0x7f89e80c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:44.937 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.954+0000 7f89f8076640 0 -- 172.21.15.104:0/4201626472 >> [v2:172.21.15.130:6804/3494208016,v1:172.21.15.130:6807/3494208016] conn(0x55af8c58ba60 msgr2=0x7f89f0060410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:44.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.974+0000 7f89fa55b980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:44.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.974+0000 7f89fa55b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:44.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.974+0000 7f89fa55b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:44.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.974+0000 7f89fa55b980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:44.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.974+0000 7f89fa55b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:44.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.974+0000 7f89fa55b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:44.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.974+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:44.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.960 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 zone default found 2024-04-03T04:01:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 4 Realm: () 2024-04-03T04:01:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 zonegroup default 2024-04-03T04:01:44.961 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.978+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.982+0000 7f89fa55b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.982+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:44.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.982+0000 7f89fa55b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:44.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.982+0000 7f89fa55b980 20 started sync module instance, tier type = 2024-04-03T04:01:44.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:44.982+0000 7f89fa55b980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:44.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.010+0000 7f89fa55b980 20 add_watcher() i=0 2024-04-03T04:01:44.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.010+0000 7f89fa55b980 20 add_watcher() i=1 2024-04-03T04:01:44.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.010+0000 7f89fa55b980 20 add_watcher() i=2 2024-04-03T04:01:44.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.010+0000 7f89fa55b980 20 add_watcher() i=3 2024-04-03T04:01:44.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.010+0000 7f89fa55b980 20 add_watcher() i=4 2024-04-03T04:01:44.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.010+0000 7f89fa55b980 20 add_watcher() i=5 2024-04-03T04:01:44.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.010+0000 7f89fa55b980 20 add_watcher() i=6 2024-04-03T04:01:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.014+0000 7f89fa55b980 20 add_watcher() i=7 2024-04-03T04:01:44.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.014+0000 7f89fa55b980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:44.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f88aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:44.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:44.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:44.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 5 note: GC not initialized 2024-04-03T04:01:45.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f88adfdb640 20 reqs_thread_entry: start 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 20 Filter name: none 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f881f7fe640 20 reqs_thread_entry: start 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 : miss 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.003 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.018+0000 7f89fa55b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 2024-04-03T04:01:45.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.030+0000 7f89fa55b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.030+0000 7f89fa55b980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.030+0000 7f89fa55b980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.030+0000 7f89fa55b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27, ofs0, ns] 2024-04-03T04:01:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.034+0000 7f88cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94212464622992 notifier 6906 bl.length()=873 2024-04-03T04:01:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.034+0000 7f88cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.034+0000 7f88cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.015 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.034+0000 7f88cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.034+0000 7f89fa55b980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): orig_sources= new_sources= 2024-04-03T04:01:45.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.034+0000 7f89fa55b980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): potential sources added=[] removed=[] 2024-04-03T04:01:45.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.034+0000 7f89fa55b980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): orig_dests= new_dests= 2024-04-03T04:01:45.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.034+0000 7f89fa55b980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): potential dests added=[] removed=[] 2024-04-03T04:01:45.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.042+0000 7f89fa55b980 -1 Injecting error=-5 at location=do_reshard 2024-04-03T04:01:45.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.054+0000 7f89fa55b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 : hit (requested=0x17, cached=0x17) 2024-04-03T04:01:45.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.054+0000 7f89fa55b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 2024-04-03T04:01:45.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f89fa55b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f89fa55b980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f89fa55b980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f89fa55b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27, ofs0, ns] 2024-04-03T04:01:45.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f88cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 94212464622992 notifier 6906 bl.length()=841 2024-04-03T04:01:45.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f88cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f88cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.040 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f88cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f89fa55b980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): orig_sources= new_sources= 2024-04-03T04:01:45.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f89fa55b980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): potential sources added=[] removed=[] 2024-04-03T04:01:45.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f89fa55b980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): orig_dests= new_dests= 2024-04-03T04:01:45.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f89fa55b980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): potential dests added=[] removed=[] 2024-04-03T04:01:45.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.058+0000 7f89fa55b980 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-04-03T04:01:45.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.062+0000 7f88aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:45.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.070+0000 7f89fa55b980 20 remove_watcher() i=0 2024-04-03T04:01:45.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.070+0000 7f89fa55b980 2 removed watcher, disabling cache 2024-04-03T04:01:45.052 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.070+0000 7f89fa55b980 20 remove_watcher() i=1 2024-04-03T04:01:45.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.074+0000 7f89fa55b980 20 remove_watcher() i=2 2024-04-03T04:01:45.058 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.078+0000 7f89fa55b980 20 remove_watcher() i=3 2024-04-03T04:01:45.060 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.078+0000 7f89fa55b980 20 remove_watcher() i=4 2024-04-03T04:01:45.062 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.082+0000 7f89fa55b980 20 remove_watcher() i=5 2024-04-03T04:01:45.064 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.082+0000 7f89fa55b980 20 remove_watcher() i=6 2024-04-03T04:01:45.065 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.082+0000 7f89fa55b980 20 remove_watcher() i=7 2024-04-03T04:01:45.081 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-04-03T04:01:45.111 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:45.111 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:45.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.174+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.174+0000 7fb2a4428980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.174+0000 7fb2a4428980 20 realm 2024-04-03T04:01:45.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.174+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.174+0000 7fb2a4428980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.174+0000 7fb2a4428980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:45.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.174+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.174+0000 7fb2a4428980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.174+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.178+0000 7fb2a4428980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:45.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.178+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.178+0000 7fb2a4428980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:45.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.178+0000 7fb2a4428980 20 searching for the correct realm 2024-04-03T04:01:45.165 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.182+0000 7fb2a1f43640 0 -- 172.21.15.104:0/84373826 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x556029cec960 msgr2=0x556029ceee20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:45.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.190+0000 7fb2a1742640 0 -- 172.21.15.104:0/84373826 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fb29c08b350 msgr2=0x7fb29c062750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:45.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:45.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:45.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:45.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:45.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:45.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:45.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:45.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:45.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 zone default found 2024-04-03T04:01:45.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 4 Realm: () 2024-04-03T04:01:45.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:45.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:45.182 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:45.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 zonegroup default 2024-04-03T04:01:45.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.198+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.202+0000 7fb2a4428980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.202+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.202+0000 7fb2a4428980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.202+0000 7fb2a4428980 20 started sync module instance, tier type = 2024-04-03T04:01:45.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.202+0000 7fb2a4428980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:45.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.218+0000 7fb2a4428980 20 add_watcher() i=0 2024-04-03T04:01:45.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.218+0000 7fb2a4428980 20 add_watcher() i=1 2024-04-03T04:01:45.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.218+0000 7fb2a4428980 20 add_watcher() i=2 2024-04-03T04:01:45.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.218+0000 7fb2a4428980 20 add_watcher() i=3 2024-04-03T04:01:45.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.218+0000 7fb2a4428980 20 add_watcher() i=4 2024-04-03T04:01:45.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.218+0000 7fb2a4428980 20 add_watcher() i=5 2024-04-03T04:01:45.199 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.218+0000 7fb2a4428980 20 add_watcher() i=6 2024-04-03T04:01:45.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.218+0000 7fb2a4428980 20 add_watcher() i=7 2024-04-03T04:01:45.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.218+0000 7fb2a4428980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:45.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb1537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:45.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:45.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:45.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 5 note: GC not initialized 2024-04-03T04:01:45.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb1527fc640 20 reqs_thread_entry: start 2024-04-03T04:01:45.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:45.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 Filter name: none 2024-04-03T04:01:45.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb0c3fff640 20 reqs_thread_entry: start 2024-04-03T04:01:45.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:45.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:45.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:45.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:45.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.222+0000 7fb2a4428980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.226+0000 7fb2a4428980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:45.206 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.226+0000 7fb2a4428980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:45.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.226+0000 7fb1537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:45.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.230+0000 7fb2a4428980 20 remove_watcher() i=0 2024-04-03T04:01:45.213 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.230+0000 7fb2a4428980 2 removed watcher, disabling cache 2024-04-03T04:01:45.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.234+0000 7fb2a4428980 20 remove_watcher() i=1 2024-04-03T04:01:45.217 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.234+0000 7fb2a4428980 20 remove_watcher() i=2 2024-04-03T04:01:45.219 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.238+0000 7fb2a4428980 20 remove_watcher() i=3 2024-04-03T04:01:45.221 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.238+0000 7fb2a4428980 20 remove_watcher() i=4 2024-04-03T04:01:45.222 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.242+0000 7fb2a4428980 20 remove_watcher() i=5 2024-04-03T04:01:45.224 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.242+0000 7fb2a4428980 20 remove_watcher() i=6 2024-04-03T04:01:45.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.242+0000 7fb2a4428980 20 remove_watcher() i=7 2024-04-03T04:01:45.238 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:45.239 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:45.239 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-do-reshard id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:01:45.239 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:45.240 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:45.240 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:45.275 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:45.275 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:45.332 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T04:01:45.366 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:45.366 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:45.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.426+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 20 realm 2024-04-03T04:01:45.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:45.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.412 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:45.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.430+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.434+0000 7feaccc66980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:45.414 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.434+0000 7feaccc66980 20 searching for the correct realm 2024-04-03T04:01:45.420 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.438+0000 7feaca781640 0 -- 172.21.15.104:0/3568739969 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x560850299130 msgr2=0x56085029b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:45.426 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.442+0000 7feac9f80640 0 -- 172.21.15.104:0/3568739969 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7feac403f410 msgr2=0x7feac403f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:45.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.450+0000 7feaccc66980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:45.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.450+0000 7feaccc66980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:45.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.450+0000 7feaccc66980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:45.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.450+0000 7feaccc66980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:45.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.450+0000 7feaccc66980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:45.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.450+0000 7feaccc66980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:45.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.450+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.450+0000 7feaccc66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.450+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:45.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:45.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 zone default found 2024-04-03T04:01:45.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 4 Realm: () 2024-04-03T04:01:45.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:45.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:45.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:45.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 zonegroup default 2024-04-03T04:01:45.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 started sync module instance, tier type = 2024-04-03T04:01:45.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.454+0000 7feaccc66980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:45.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.470+0000 7feaccc66980 20 add_watcher() i=0 2024-04-03T04:01:45.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.470+0000 7feaccc66980 20 add_watcher() i=1 2024-04-03T04:01:45.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.470+0000 7feaccc66980 20 add_watcher() i=2 2024-04-03T04:01:45.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.470+0000 7feaccc66980 20 add_watcher() i=3 2024-04-03T04:01:45.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.470+0000 7feaccc66980 20 add_watcher() i=4 2024-04-03T04:01:45.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.470+0000 7feaccc66980 20 add_watcher() i=5 2024-04-03T04:01:45.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.470+0000 7feaccc66980 20 add_watcher() i=6 2024-04-03T04:01:45.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.470+0000 7feaccc66980 20 add_watcher() i=7 2024-04-03T04:01:45.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.470+0000 7feaccc66980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:45.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7fe980fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:45.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:45.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:45.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 5 note: GC not initialized 2024-04-03T04:01:45.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7fe8fb7fe640 20 reqs_thread_entry: start 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 20 Filter name: none 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7fe8f97fa640 20 reqs_thread_entry: start 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 : miss 2024-04-03T04:01:45.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:45.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:45.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.458 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.474+0000 7feaccc66980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 2024-04-03T04:01:45.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.486+0000 7feaccc66980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.486+0000 7feaccc66980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.486+0000 7feaccc66980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.486+0000 7feaccc66980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27, ofs0, ns] 2024-04-03T04:01:45.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.490+0000 7fe9ad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94593704636560 notifier 6945 bl.length()=873 2024-04-03T04:01:45.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.490+0000 7fe9ad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.490+0000 7fe9ad7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.490+0000 7fe9ad7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.490+0000 7feaccc66980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): orig_sources= new_sources= 2024-04-03T04:01:45.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.490+0000 7feaccc66980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): potential sources added=[] removed=[] 2024-04-03T04:01:45.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.490+0000 7feaccc66980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): orig_dests= new_dests= 2024-04-03T04:01:45.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.490+0000 7feaccc66980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): potential dests added=[] removed=[] 2024-04-03T04:01:45.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.0 2024-04-03T04:01:45.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.0 2024-04-03T04:01:45.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.1 2024-04-03T04:01:45.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.1 2024-04-03T04:01:45.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.2 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.2 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.3 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.3 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.4 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.4 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.5 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.5 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.6 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.6 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.7 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.7 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.8 2024-04-03T04:01:45.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.8 2024-04-03T04:01:45.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.9 2024-04-03T04:01:45.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.9 2024-04-03T04:01:45.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.10 2024-04-03T04:01:45.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.10 2024-04-03T04:01:45.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.11 2024-04-03T04:01:45.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1.11 2024-04-03T04:01:45.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.494+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.0 2024-04-03T04:01:45.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.498+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.1 2024-04-03T04:01:45.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.498+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.2 2024-04-03T04:01:45.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.498+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.3 2024-04-03T04:01:45.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.502+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.4 2024-04-03T04:01:45.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.502+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.5 2024-04-03T04:01:45.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.502+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.6 2024-04-03T04:01:45.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.502+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.7 2024-04-03T04:01:45.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.506+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.8 2024-04-03T04:01:45.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.506+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.9 2024-04-03T04:01:45.488 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.506+0000 7feaccc66980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27.10 2024-04-03T04:01:45.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.514+0000 7feaccc66980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 : hit (requested=0x17, cached=0x17) 2024-04-03T04:01:45.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.514+0000 7feaccc66980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 2024-04-03T04:01:45.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.514+0000 7feaccc66980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.514+0000 7feaccc66980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.514+0000 7feaccc66980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.514+0000 7feaccc66980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27, ofs0, ns] 2024-04-03T04:01:45.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.518+0000 7fe9adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 94593704636560 notifier 6945 bl.length()=841 2024-04-03T04:01:45.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.518+0000 7fe9adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 info.flags=0x17 2024-04-03T04:01:45.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.518+0000 7fe9adffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 to cache LRU end 2024-04-03T04:01:45.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.518+0000 7fe9adffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:45.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.518+0000 7feaccc66980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): orig_sources= new_sources= 2024-04-03T04:01:45.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.518+0000 7feaccc66980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): potential sources added=[] removed=[] 2024-04-03T04:01:45.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.518+0000 7feaccc66980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): orig_dests= new_dests= 2024-04-03T04:01:45.500 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.518+0000 7feaccc66980 20 handle_bi_update(): bucket=:error-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27]): potential dests added=[] removed=[] 2024-04-03T04:01:45.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.522+0000 7feaccc66980 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2024-04-03T04:01:45.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.526+0000 7fe980fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:45.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.530+0000 7feaccc66980 20 remove_watcher() i=0 2024-04-03T04:01:45.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.530+0000 7feaccc66980 2 removed watcher, disabling cache 2024-04-03T04:01:45.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.534+0000 7feaccc66980 20 remove_watcher() i=1 2024-04-03T04:01:45.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.534+0000 7feaccc66980 20 remove_watcher() i=2 2024-04-03T04:01:45.519 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.538+0000 7feaccc66980 20 remove_watcher() i=3 2024-04-03T04:01:45.521 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.538+0000 7feaccc66980 20 remove_watcher() i=4 2024-04-03T04:01:45.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.542+0000 7feaccc66980 20 remove_watcher() i=5 2024-04-03T04:01:45.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.542+0000 7feaccc66980 20 remove_watcher() i=6 2024-04-03T04:01:45.525 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.542+0000 7feaccc66980 20 remove_watcher() i=7 2024-04-03T04:01:45.539 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-04-03T04:01:45.565 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:45.565 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:45.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.622+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 20 realm 2024-04-03T04:01:45.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:45.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:45.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.626+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.610 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.630+0000 7f612d963980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:45.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.630+0000 7f612d963980 20 searching for the correct realm 2024-04-03T04:01:45.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.634+0000 7f612ac7d640 0 -- 172.21.15.104:0/2618832034 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f611c020040 msgr2=0x7f611c05bd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:45.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.638+0000 7f612ac7d640 0 -- 172.21.15.104:0/2618832034 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f61240e8420 msgr2=0x7f61240e88a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:45.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:45.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:45.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:45.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:45.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:45.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:45.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:45.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.854+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:45.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 zone default found 2024-04-03T04:01:45.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 4 Realm: () 2024-04-03T04:01:45.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:45.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:45.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:45.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 zonegroup default 2024-04-03T04:01:45.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:45.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 started sync module instance, tier type = 2024-04-03T04:01:45.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.858+0000 7f612d963980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:45.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.878+0000 7f612d963980 20 add_watcher() i=0 2024-04-03T04:01:45.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.878+0000 7f612d963980 20 add_watcher() i=1 2024-04-03T04:01:45.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.878+0000 7f612d963980 20 add_watcher() i=2 2024-04-03T04:01:45.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.878+0000 7f612d963980 20 add_watcher() i=3 2024-04-03T04:01:45.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.878+0000 7f612d963980 20 add_watcher() i=4 2024-04-03T04:01:45.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.878+0000 7f612d963980 20 add_watcher() i=5 2024-04-03T04:01:45.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.878+0000 7f612d963980 20 add_watcher() i=6 2024-04-03T04:01:45.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.882+0000 7f612d963980 20 add_watcher() i=7 2024-04-03T04:01:45.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.882+0000 7f612d963980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:45.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f5fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:45.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f612d963980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:45.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f612d963980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:45.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f612d963980 5 note: GC not initialized 2024-04-03T04:01:45.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f5fe0fe1640 20 reqs_thread_entry: start 2024-04-03T04:01:45.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f612d963980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:45.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f612d963980 20 Filter name: none 2024-04-03T04:01:45.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f5f5a7fc640 20 reqs_thread_entry: start 2024-04-03T04:01:45.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f612d963980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:45.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.886+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.890+0000 7f612d963980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:45.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.890+0000 7f612d963980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:45.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.890+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.890+0000 7f612d963980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:45.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.890+0000 7f612d963980 20 rados->read ofs=0 len=0 2024-04-03T04:01:45.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.890+0000 7f612d963980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:45.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.890+0000 7f612d963980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:45.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.894+0000 7f5fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:45.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.898+0000 7f612d963980 20 remove_watcher() i=0 2024-04-03T04:01:45.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.898+0000 7f612d963980 2 removed watcher, disabling cache 2024-04-03T04:01:45.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.902+0000 7f612d963980 20 remove_watcher() i=1 2024-04-03T04:01:45.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.902+0000 7f612d963980 20 remove_watcher() i=2 2024-04-03T04:01:45.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.906+0000 7f612d963980 20 remove_watcher() i=3 2024-04-03T04:01:45.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.906+0000 7f612d963980 20 remove_watcher() i=4 2024-04-03T04:01:45.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.910+0000 7f612d963980 20 remove_watcher() i=5 2024-04-03T04:01:45.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.910+0000 7f612d963980 20 remove_watcher() i=6 2024-04-03T04:01:45.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:45.910+0000 7f612d963980 20 remove_watcher() i=7 2024-04-03T04:01:45.908 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:45.908 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:45.909 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: error-at-do-reshard id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-04-03T04:01:45.909 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:45.909 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:45.909 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:45.937 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:45.937 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:46.468 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:46.468 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:46.829 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: reshard bucket with abort at do_reshard 2024-04-03T04:01:46.829 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:46.832 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:46.832 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:46.960 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:46.960 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.042 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.043 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.127 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.127 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.222 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.222 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.311 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.311 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.402 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.402 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.492 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.493 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.576 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.577 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.672 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.672 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.761 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.761 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.848 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.848 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:47.936 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:47.936 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.029 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:48.029 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.119 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:48.119 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.210 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:48.210 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.296 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:48.297 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.383 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:48.383 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.474 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:48.474 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.566 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:48.566 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.659 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:48.659 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.747 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:48.747 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:01:48.833 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-04-03T04:01:48.865 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:48.865 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:49.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.134+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 realm 2024-04-03T04:01:49.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:49.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:49.121 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:49.122 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.138+0000 7f4699787980 20 searching for the correct realm 2024-04-03T04:01:49.125 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.142+0000 7f4697aa3640 0 -- 172.21.15.104:0/133925703 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f469002a030 msgr2=0x7f4690020440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:49.339 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.358+0000 7f4696aa1640 0 -- 172.21.15.104:0/133925703 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f4690048410 msgr2=0x7f4690048890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:01:49.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:49.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:49.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:49.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:49.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:49.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:49.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:49.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.574+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:49.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 zone default found 2024-04-03T04:01:49.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 4 Realm: () 2024-04-03T04:01:49.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:49.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:49.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:49.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 zonegroup default 2024-04-03T04:01:49.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 started sync module instance, tier type = 2024-04-03T04:01:49.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.578+0000 7f4699787980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:49.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.602+0000 7f4699787980 20 add_watcher() i=0 2024-04-03T04:01:49.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.602+0000 7f4699787980 20 add_watcher() i=1 2024-04-03T04:01:49.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.602+0000 7f4699787980 20 add_watcher() i=2 2024-04-03T04:01:49.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.602+0000 7f4699787980 20 add_watcher() i=3 2024-04-03T04:01:49.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.602+0000 7f4699787980 20 add_watcher() i=4 2024-04-03T04:01:49.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.602+0000 7f4699787980 20 add_watcher() i=5 2024-04-03T04:01:49.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.602+0000 7f4699787980 20 add_watcher() i=6 2024-04-03T04:01:49.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.606+0000 7f4699787980 20 add_watcher() i=7 2024-04-03T04:01:49.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.606+0000 7f4699787980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:49.592 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.610+0000 7f454dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:49.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.610+0000 7f4699787980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:49.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.610+0000 7f4699787980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:49.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.610+0000 7f4699787980 5 note: GC not initialized 2024-04-03T04:01:49.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.610+0000 7f454cfe1640 20 reqs_thread_entry: start 2024-04-03T04:01:49.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.610+0000 7f4699787980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:49.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.610+0000 7f4699787980 20 Filter name: none 2024-04-03T04:01:49.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f44c67fc640 20 reqs_thread_entry: start 2024-04-03T04:01:49.594 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:49.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:49.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:49.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:49.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:49.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.614+0000 7f4699787980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:49.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.618+0000 7f454dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:49.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.622+0000 7f4699787980 20 remove_watcher() i=0 2024-04-03T04:01:49.606 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.622+0000 7f4699787980 2 removed watcher, disabling cache 2024-04-03T04:01:49.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.626+0000 7f4699787980 20 remove_watcher() i=1 2024-04-03T04:01:49.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.630+0000 7f4699787980 20 remove_watcher() i=2 2024-04-03T04:01:49.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.630+0000 7f4699787980 20 remove_watcher() i=3 2024-04-03T04:01:49.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.634+0000 7f4699787980 20 remove_watcher() i=4 2024-04-03T04:01:49.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.634+0000 7f4699787980 20 remove_watcher() i=5 2024-04-03T04:01:49.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.634+0000 7f4699787980 20 remove_watcher() i=6 2024-04-03T04:01:49.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.638+0000 7f4699787980 20 remove_watcher() i=7 2024-04-03T04:01:49.634 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:49.635 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:49.635 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-do-reshard id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:01:49.635 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:49.635 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-04-03T04:01:49.668 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:49.669 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:49.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.730+0000 7fa2e8549980 20 realm 2024-04-03T04:01:49.712 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.730+0000 7fa2e8549980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:49.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.713 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.715 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.734+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:49.715 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.734+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.734+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:49.716 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.734+0000 7fa2e8549980 20 searching for the correct realm 2024-04-03T04:01:49.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.738+0000 7fa2e5863640 0 -- 172.21.15.104:0/916861445 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fa2d800e070 msgr2=0x7fa2d805aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:49.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.746+0000 7fa2e5863640 0 -- 172.21.15.104:0/916861445 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fa2e0069060 msgr2=0x7fa2e006b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:49.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:49.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:49.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:49.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:49.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:49.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:49.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.962+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.962+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.962+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:49.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:49.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 zone default found 2024-04-03T04:01:49.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 4 Realm: () 2024-04-03T04:01:49.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:49.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:49.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:49.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 zonegroup default 2024-04-03T04:01:49.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:49.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 started sync module instance, tier type = 2024-04-03T04:01:49.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.966+0000 7fa2e8549980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:49.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=0 2024-04-03T04:01:49.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=1 2024-04-03T04:01:49.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=2 2024-04-03T04:01:49.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=3 2024-04-03T04:01:49.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=4 2024-04-03T04:01:49.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=5 2024-04-03T04:01:49.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=6 2024-04-03T04:01:49.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.994+0000 7fa2e8549980 20 add_watcher() i=7 2024-04-03T04:01:49.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.994+0000 7fa2e8549980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:49.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa19d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:49.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa2e8549980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:49.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa2e8549980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:49.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa2e8549980 5 note: GC not initialized 2024-04-03T04:01:49.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa1977fe640 20 reqs_thread_entry: start 2024-04-03T04:01:49.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa2e8549980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:49.981 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa2e8549980 20 Filter name: none 2024-04-03T04:01:49.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa1957fa640 20 reqs_thread_entry: start 2024-04-03T04:01:49.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa2e8549980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-04-03T04:01:49.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:49.998+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:49.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-04-03T04:01:49.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-04-03T04:01:49.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 : miss 2024-04-03T04:01:49.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:49.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:49.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:01:49.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:01:49.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:49.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:49.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.002+0000 7fa2e8549980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 2024-04-03T04:01:49.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.014+0000 7fa2e8549980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:01:49.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.014+0000 7fa2e8549980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:01:49.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.014+0000 7fa2e8549980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:49.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.014+0000 7fa2e8549980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28, ofs0, ns] 2024-04-03T04:01:49.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94349237095200 notifier 6590 bl.length()=873 2024-04-03T04:01:49.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:01:49.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:01:49.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:50.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_sources= new_sources= 2024-04-03T04:01:50.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential sources added=[] removed=[] 2024-04-03T04:01:50.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_dests= new_dests= 2024-04-03T04:01:50.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential dests added=[] removed=[] 2024-04-03T04:01:50.011 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa2e8549980 time 2024-04-03T04:01:50.035593+0000 2024-04-03T04:01:50.011 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:01:50.024 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa2ebe1fe1f] 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fa2ebe1ffd3] 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cf62e4c5b1] 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x55cf62e5a2cd] 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa2eac89d90] 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr:*** Caught signal (Aborted) ** 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7fa2e8549980 thread_name:radosgw-admin 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.030+0000 7fa2e8549980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa2e8549980 time 2024-04-03T04:01:50.035593+0000 2024-04-03T04:01:50.025 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa2ebe1fe1f] 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fa2ebe1ffd3] 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cf62e4c5b1] 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x55cf62e5a2cd] 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa2eac89d90] 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.026 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa2eaca2520] 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa2ebe1fe79] 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fa2ebe1ffd3] 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cf62e4c5b1] 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x55cf62e5a2cd] 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa2eac89d90] 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.030+0000 7fa2e8549980 -1 *** Caught signal (Aborted) ** 2024-04-03T04:01:50.027 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7fa2e8549980 thread_name:radosgw-admin 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa2eaca2520] 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa2ebe1fe79] 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fa2ebe1ffd3] 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cf62e4c5b1] 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x55cf62e5a2cd] 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa2eac89d90] 2024-04-03T04:01:50.028 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr:--- begin dump of recent events --- 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: -499> 2024-04-03T04:01:49.706+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: -498> 2024-04-03T04:01:49.706+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: -497> 2024-04-03T04:01:49.706+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: -496> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: -495> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: -494> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: -493> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient(hunting): handle_auth_done global_id 6578 payload 274 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: -492> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.029 INFO:tasks.workunit.client.0.smithi104.stderr: -491> 2024-04-03T04:01:49.706+0000 7fa2e6865640 1 monclient: found mon.noname-c 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr: -490> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr: -489> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr: -488> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr: -487> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: dump: 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.030 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr: -486> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr: -485> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr: -484> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr: -483> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr: -482> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr: -481> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: dump: 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.031 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr: -480> 2024-04-03T04:01:49.706+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6578 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr: -479> 2024-04-03T04:01:49.706+0000 7fa2e8549980 10 monclient: get_monmap_and_config success 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr: -478> 2024-04-03T04:01:49.706+0000 7fa2e8549980 4 set_mon_vals no callback set 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr: -477> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: shutdown 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr: -476> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 asok(0x55cf64926210) unregister_commands rotate-key 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr: -475> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: build_initial_monmap 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr: -474> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 build_initial for_mkfs: 0 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr: -473> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: monmap: 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:50.032 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: -472> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding auth protocol: cephx 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: -471> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding auth protocol: cephx 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: -470> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding auth protocol: cephx 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: -469> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: -468> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: -467> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: -466> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: -465> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.033 INFO:tasks.workunit.client.0.smithi104.stderr: -464> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -463> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -462> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -461> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -460> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -459> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -458> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -457> 2024-04-03T04:01:49.710+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -456> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: starting msgr at 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -455> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: starting objecter 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -454> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command objecter_requests hook 0x55cf648b1d50 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -453> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: setting wanted keys 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -452> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: calling monclient init 2024-04-03T04:01:50.034 INFO:tasks.workunit.client.0.smithi104.stderr: -451> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: init 2024-04-03T04:01:50.035 INFO:tasks.workunit.client.0.smithi104.stderr: -450> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding auth protocol: cephx 2024-04-03T04:01:50.035 INFO:tasks.workunit.client.0.smithi104.stderr: -449> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding auth protocol: cephx 2024-04-03T04:01:50.035 INFO:tasks.workunit.client.0.smithi104.stderr: -448> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding auth protocol: cephx 2024-04-03T04:01:50.035 INFO:tasks.workunit.client.0.smithi104.stderr: -447> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.035 INFO:tasks.workunit.client.0.smithi104.stderr: -446> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.035 INFO:tasks.workunit.client.0.smithi104.stderr: -445> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.035 INFO:tasks.workunit.client.0.smithi104.stderr: -444> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.035 INFO:tasks.workunit.client.0.smithi104.stderr: -443> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.035 INFO:tasks.workunit.client.0.smithi104.stderr: -442> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -441> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -440> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -439> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -438> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -437> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -436> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -435> 2024-04-03T04:01:49.710+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -434> 2024-04-03T04:01:49.710+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -433> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command rotate-key hook 0x55cf64b32138 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -432> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -431> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _add_conns ranks=[2,1,0] 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -430> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-c con 0x55cf64a7fb30 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -429> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-b con 0x55cf64a80790 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:50.036 INFO:tasks.workunit.client.0.smithi104.stderr: -428> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-a con 0x55cf64b613f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -427> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -426> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -425> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -424> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -423> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): authenticate will time out at 2365.453612s 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -422> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): get_auth_request con 0x55cf64a7fb30 auth_method 0 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -421> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -420> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -419> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -418> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): get_auth_request con 0x55cf64b613f0 auth_method 0 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -417> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -416> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.037 INFO:tasks.workunit.client.0.smithi104.stderr: -415> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -414> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -413> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -412> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -411> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -410> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -409> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -408> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): handle_auth_done global_id 6581 payload 824 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -407> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -406> 2024-04-03T04:01:49.710+0000 7fa2e6064640 1 monclient: found mon.noname-c 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -405> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.038 INFO:tasks.workunit.client.0.smithi104.stderr: -404> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr: -403> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr: -402> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: dump: 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.039 INFO:tasks.workunit.client.0.smithi104.stderr: -401> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr: -400> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr: -399> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr: -398> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr: -397> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr: -396> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: dump: 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.040 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -395> 2024-04-03T04:01:49.710+0000 7fa1d4608640 4 set_mon_vals no callback set 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -394> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6581 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -393> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -392> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -391> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -390> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -389> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: init done 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -388> 2024-04-03T04:01:49.714+0000 7fa1d2e05640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -387> 2024-04-03T04:01:49.714+0000 7fa1d2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -386> 2024-04-03T04:01:49.714+0000 7fa1d2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -385> 2024-04-03T04:01:49.714+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa1cc066d90 auth_method 0 2024-04-03T04:01:50.041 INFO:tasks.workunit.client.0.smithi104.stderr: -384> 2024-04-03T04:01:49.714+0000 7fa2e6865640 10 monclient: get_auth_request con 0x55cf64b5ac80 auth_method 0 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr: -383> 2024-04-03T04:01:49.714+0000 7fa2e6064640 10 monclient: get_auth_request con 0x55cf64b7d580 auth_method 0 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr: -382> 2024-04-03T04:01:49.714+0000 7fa2e5863640 10 monclient: get_auth_request con 0x55cf64b81770 auth_method 0 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr: -381> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient: get_auth_request con 0x55cf64b80dd0 auth_method 0 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr: -380> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: build_initial_monmap 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr: -379> 2024-04-03T04:01:49.718+0000 7fa2e8549980 1 build_initial for_mkfs: 0 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr: -378> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: monmap: 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:50.042 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: -377> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding auth protocol: cephx 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: -376> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding auth protocol: cephx 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: -375> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding auth protocol: cephx 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: -374> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: -373> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: -372> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: -371> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: -370> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.043 INFO:tasks.workunit.client.0.smithi104.stderr: -369> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.044 INFO:tasks.workunit.client.0.smithi104.stderr: -368> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.044 INFO:tasks.workunit.client.0.smithi104.stderr: -367> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.044 INFO:tasks.workunit.client.0.smithi104.stderr: -366> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.044 INFO:tasks.workunit.client.0.smithi104.stderr: -365> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.044 INFO:tasks.workunit.client.0.smithi104.stderr: -364> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.044 INFO:tasks.workunit.client.0.smithi104.stderr: -363> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.044 INFO:tasks.workunit.client.0.smithi104.stderr: -362> 2024-04-03T04:01:49.718+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.044 INFO:tasks.workunit.client.0.smithi104.stderr: -361> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command objecter_requests cmddesc objecter_requests hook 0x55cf64b8ed90 EEXIST 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -360> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: init 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -359> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding auth protocol: cephx 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -358> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding auth protocol: cephx 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -357> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding auth protocol: cephx 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -356> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -355> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -354> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -353> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -352> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -351> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -350> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -349> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -348> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.045 INFO:tasks.workunit.client.0.smithi104.stderr: -347> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -346> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -345> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -344> 2024-04-03T04:01:49.718+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -343> 2024-04-03T04:01:49.718+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -342> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command rotate-key cmddesc rotate-key hook 0x55cf64b888b0 EEXIST 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -341> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -340> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: _add_conns ranks=[0,2,1] 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -339> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-a con 0x55cf64bb39f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -338> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-c con 0x55cf64bb3dd0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -337> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-b con 0x55cf64baef90 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -336> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -335> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.046 INFO:tasks.workunit.client.0.smithi104.stderr: -334> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -333> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -332> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): authenticate will time out at 2365.463203s 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -331> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): get_auth_request con 0x55cf64bb39f0 auth_method 0 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -330> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -329> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -328> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -327> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): get_auth_request con 0x55cf64bb3dd0 auth_method 0 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -326> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -325> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -324> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -323> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -322> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -321> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -320> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.047 INFO:tasks.workunit.client.0.smithi104.stderr: -319> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr: -318> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr: -317> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): handle_auth_done global_id 6996 payload 824 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr: -316> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr: -315> 2024-04-03T04:01:49.718+0000 7fa2e5863640 1 monclient: found mon.noname-a 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr: -314> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr: -313> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr: -312> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr: -311> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: dump: 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.048 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: -310> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: -309> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: -308> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6996 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: -307> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: -306> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: -305> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: -304> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: -303> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr: -302> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 10 monclient: dump: 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.049 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr: -301> 2024-04-03T04:01:49.722+0000 7fa2e7066640 4 set_mon_vals no callback set 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr: -300> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr: -299> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr: -298> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr: -297> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.050 INFO:tasks.workunit.client.0.smithi104.stderr: -296> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr: -295> 2024-04-03T04:01:49.722+0000 7fa2e6865640 10 monclient: get_auth_request con 0x7fa1c0066ca0 auth_method 0 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr: -294> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: get_monmap_and_config 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr: -293> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: build_initial_monmap 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr: -292> 2024-04-03T04:01:49.722+0000 7fa2e8549980 1 build_initial for_mkfs: 0 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr: -291> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: monmap: 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:50.051 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -290> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -289> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -288> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -287> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -286> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -285> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -284> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -283> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -282> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -281> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -280> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -279> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.052 INFO:tasks.workunit.client.0.smithi104.stderr: -278> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -277> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -276> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -275> 2024-04-03T04:01:49.722+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -274> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: init 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -273> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding auth protocol: cephx 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -272> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding auth protocol: cephx 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -271> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding auth protocol: cephx 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -270> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -269> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -268> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -267> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -266> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -265> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.053 INFO:tasks.workunit.client.0.smithi104.stderr: -264> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -263> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -262> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -261> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -260> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -259> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -258> 2024-04-03T04:01:49.722+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -257> 2024-04-03T04:01:49.722+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -256> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command rotate-key cmddesc rotate-key hook 0x7ffd1dad91d8 EEXIST 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -255> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -254> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -253> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-a con 0x55cf64c05f30 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -252> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-b con 0x55cf64c013d0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:50.054 INFO:tasks.workunit.client.0.smithi104.stderr: -251> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-c con 0x55cf64bf6c90 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -250> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -249> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -248> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -247> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -246> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): authenticate will time out at 2365.467077s 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -245> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): get_auth_request con 0x55cf64c05f30 auth_method 0 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -244> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -243> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -242> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -241> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): get_auth_request con 0x55cf64bf6c90 auth_method 0 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -240> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -239> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -238> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.055 INFO:tasks.workunit.client.0.smithi104.stderr: -237> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -236> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -235> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -234> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -233> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -232> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -231> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): handle_auth_done global_id 6587 payload 274 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -230> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -229> 2024-04-03T04:01:49.722+0000 7fa2e6064640 1 monclient: found mon.noname-c 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -228> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -227> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -226> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr: -225> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: dump: 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.056 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr: -224> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr: -223> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr: -222> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr: -221> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr: -220> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr: -219> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: dump: 2024-04-03T04:01:50.057 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr: -218> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6587 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr: -217> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: get_monmap_and_config success 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr: -216> 2024-04-03T04:01:49.722+0000 7fa2e8549980 4 set_mon_vals no callback set 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr: -215> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: shutdown 2024-04-03T04:01:50.058 INFO:tasks.workunit.client.0.smithi104.stderr: -214> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: build_initial_monmap 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr: -213> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 build_initial for_mkfs: 0 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr: -212> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: monmap: 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr: -211> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr: -210> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.059 INFO:tasks.workunit.client.0.smithi104.stderr: -209> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.060 INFO:tasks.workunit.client.0.smithi104.stderr: -208> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.060 INFO:tasks.workunit.client.0.smithi104.stderr: -207> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.060 INFO:tasks.workunit.client.0.smithi104.stderr: -206> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.060 INFO:tasks.workunit.client.0.smithi104.stderr: -205> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.060 INFO:tasks.workunit.client.0.smithi104.stderr: -204> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.060 INFO:tasks.workunit.client.0.smithi104.stderr: -203> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.060 INFO:tasks.workunit.client.0.smithi104.stderr: -202> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.060 INFO:tasks.workunit.client.0.smithi104.stderr: -201> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.060 INFO:tasks.workunit.client.0.smithi104.stderr: -200> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.061 INFO:tasks.workunit.client.0.smithi104.stderr: -199> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.061 INFO:tasks.workunit.client.0.smithi104.stderr: -198> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.061 INFO:tasks.workunit.client.0.smithi104.stderr: -197> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.061 INFO:tasks.workunit.client.0.smithi104.stderr: -196> 2024-04-03T04:01:49.726+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.061 INFO:tasks.workunit.client.0.smithi104.stderr: -195> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: starting msgr at 2024-04-03T04:01:50.061 INFO:tasks.workunit.client.0.smithi104.stderr: -194> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: starting objecter 2024-04-03T04:01:50.061 INFO:tasks.workunit.client.0.smithi104.stderr: -193> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command objecter_requests cmddesc objecter_requests hook 0x55cf64bc5e50 EEXIST 2024-04-03T04:01:50.061 INFO:tasks.workunit.client.0.smithi104.stderr: -192> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: setting wanted keys 2024-04-03T04:01:50.061 INFO:tasks.workunit.client.0.smithi104.stderr: -191> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: calling monclient init 2024-04-03T04:01:50.062 INFO:tasks.workunit.client.0.smithi104.stderr: -190> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: init 2024-04-03T04:01:50.062 INFO:tasks.workunit.client.0.smithi104.stderr: -189> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding auth protocol: cephx 2024-04-03T04:01:50.062 INFO:tasks.workunit.client.0.smithi104.stderr: -188> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding auth protocol: cephx 2024-04-03T04:01:50.062 INFO:tasks.workunit.client.0.smithi104.stderr: -187> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding auth protocol: cephx 2024-04-03T04:01:50.062 INFO:tasks.workunit.client.0.smithi104.stderr: -186> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -185> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -184> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -183> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -182> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -181> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -180> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -179> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -178> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -177> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.063 INFO:tasks.workunit.client.0.smithi104.stderr: -176> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -175> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -174> 2024-04-03T04:01:49.726+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -173> 2024-04-03T04:01:49.726+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -172> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command rotate-key cmddesc rotate-key hook 0x55cf64bd0858 EEXIST 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -171> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -170> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _add_conns ranks=[1,2,0] 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -169> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-b con 0x55cf64bf6c90 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -168> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-c con 0x55cf64c013d0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -167> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-a con 0x55cf64c05f30 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -166> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -165> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -164> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -163> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:50.064 INFO:tasks.workunit.client.0.smithi104.stderr: -162> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): authenticate will time out at 2365.469847s 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -161> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): get_auth_request con 0x55cf64c013d0 auth_method 0 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -160> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -159> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -158> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -157> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): get_auth_request con 0x55cf64c05f30 auth_method 0 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -156> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -155> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -154> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -153> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -152> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -151> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -150> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -149> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.065 INFO:tasks.workunit.client.0.smithi104.stderr: -148> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr: -147> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): handle_auth_done global_id 6590 payload 824 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr: -146> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr: -145> 2024-04-03T04:01:49.726+0000 7fa2e6865640 1 monclient: found mon.noname-c 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr: -144> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr: -143> 2024-04-03T04:01:49.726+0000 7fa2e5863640 10 monclient: get_auth_request con 0x55cf64bf6c90 auth_method 0 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr: -142> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr: -141> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr: -140> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: dump: 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.066 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr: -139> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr: -138> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr: -137> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr: -136> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr: -135> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr: -134> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: dump: 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.067 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr: -133> 2024-04-03T04:01:49.726+0000 7fa1c9ffb640 4 set_mon_vals no callback set 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr: -132> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6590 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr: -131> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr: -130> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr: -129> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr: -128> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.068 INFO:tasks.workunit.client.0.smithi104.stderr: -127> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: init done 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -126> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cr dump hook 0x7fa2d8001b28 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -125> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -124> 2024-04-03T04:01:49.730+0000 7fa1b7fff640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -123> 2024-04-03T04:01:49.730+0000 7fa1b7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -122> 2024-04-03T04:01:49.730+0000 7fa1b7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -121> 2024-04-03T04:01:49.730+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa1b0066d90 auth_method 0 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -120> 2024-04-03T04:01:49.730+0000 7fa2e6064640 10 monclient: get_auth_request con 0x55cf64c1ffb0 auth_method 0 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -119> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -118> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 realm 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -117> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -116> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -115> 2024-04-03T04:01:49.730+0000 7fa2e8549980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -114> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -113> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.069 INFO:tasks.workunit.client.0.smithi104.stderr: -112> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.070 INFO:tasks.workunit.client.0.smithi104.stderr: -111> 2024-04-03T04:01:49.730+0000 7fa2e5863640 10 monclient: get_auth_request con 0x55cf64c240d0 auth_method 0 2024-04-03T04:01:50.070 INFO:tasks.workunit.client.0.smithi104.stderr: -110> 2024-04-03T04:01:49.734+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:50.070 INFO:tasks.workunit.client.0.smithi104.stderr: -109> 2024-04-03T04:01:49.734+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.070 INFO:tasks.workunit.client.0.smithi104.stderr: -108> 2024-04-03T04:01:49.734+0000 7fa2e6865640 10 monclient: get_auth_request con 0x55cf64c27910 auth_method 0 2024-04-03T04:01:50.070 INFO:tasks.workunit.client.0.smithi104.stderr: -107> 2024-04-03T04:01:49.734+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:50.070 INFO:tasks.workunit.client.0.smithi104.stderr: -106> 2024-04-03T04:01:49.734+0000 7fa2e8549980 20 searching for the correct realm 2024-04-03T04:01:50.070 INFO:tasks.workunit.client.0.smithi104.stderr: -105> 2024-04-03T04:01:49.734+0000 7fa2e6064640 10 monclient: get_auth_request con 0x55cf64c2c640 auth_method 0 2024-04-03T04:01:50.070 INFO:tasks.workunit.client.0.smithi104.stderr: -104> 2024-04-03T04:01:49.734+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa2d800e070 auth_method 0 2024-04-03T04:01:50.070 INFO:tasks.workunit.client.0.smithi104.stderr: -103> 2024-04-03T04:01:49.738+0000 7fa2e6865640 10 monclient: get_auth_request con 0x7fa2e006b200 auth_method 0 2024-04-03T04:01:50.071 INFO:tasks.workunit.client.0.smithi104.stderr: -102> 2024-04-03T04:01:49.738+0000 7fa2e5863640 0 -- 172.21.15.104:0/916861445 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fa2d800e070 msgr2=0x7fa2d805aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:50.071 INFO:tasks.workunit.client.0.smithi104.stderr: -101> 2024-04-03T04:01:49.738+0000 7fa1b7fff640 1 client.6590.objecter ms_handle_reset 0x7fa2d800e070 session 0x7fa2d807d040 osd.7 2024-04-03T04:01:50.071 INFO:tasks.workunit.client.0.smithi104.stderr: -100> 2024-04-03T04:01:49.738+0000 7fa1b7fff640 10 monclient: _renew_subs 2024-04-03T04:01:50.071 INFO:tasks.workunit.client.0.smithi104.stderr: -99> 2024-04-03T04:01:49.738+0000 7fa1b7fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.071 INFO:tasks.workunit.client.0.smithi104.stderr: -98> 2024-04-03T04:01:49.738+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa1b00774c0 auth_method 0 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -97> 2024-04-03T04:01:49.742+0000 7fa2e6064640 10 monclient: get_auth_request con 0x7fa2e00935f0 auth_method 0 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -96> 2024-04-03T04:01:49.746+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa2e0069060 auth_method 0 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -95> 2024-04-03T04:01:49.746+0000 7fa2e5863640 0 -- 172.21.15.104:0/916861445 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fa2e0069060 msgr2=0x7fa2e006b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -94> 2024-04-03T04:01:49.950+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa2e0069060 auth_method 0 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -93> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -92> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -91> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -90> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -89> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:50.072 INFO:tasks.workunit.client.0.smithi104.stderr: -88> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:50.073 INFO:tasks.workunit.client.0.smithi104.stderr: -87> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.073 INFO:tasks.workunit.client.0.smithi104.stderr: -86> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.073 INFO:tasks.workunit.client.0.smithi104.stderr: -85> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.073 INFO:tasks.workunit.client.0.smithi104.stderr: -84> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:50.073 INFO:tasks.workunit.client.0.smithi104.stderr: -83> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.073 INFO:tasks.workunit.client.0.smithi104.stderr: -82> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:50.073 INFO:tasks.workunit.client.0.smithi104.stderr: -81> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 zone default found 2024-04-03T04:01:50.073 INFO:tasks.workunit.client.0.smithi104.stderr: -80> 2024-04-03T04:01:49.966+0000 7fa2e8549980 4 Realm: () 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -79> 2024-04-03T04:01:49.966+0000 7fa2e8549980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -78> 2024-04-03T04:01:49.966+0000 7fa2e8549980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -77> 2024-04-03T04:01:49.966+0000 7fa2e8549980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -76> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 zonegroup default 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -75> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -74> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -73> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -72> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -71> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -70> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -69> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 started sync module instance, tier type = 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -68> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:50.074 INFO:tasks.workunit.client.0.smithi104.stderr: -67> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=0 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -66> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=1 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -65> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=2 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -64> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=3 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -63> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=4 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -62> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=5 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -61> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=6 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -60> 2024-04-03T04:01:49.994+0000 7fa2e8549980 20 add_watcher() i=7 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -59> 2024-04-03T04:01:49.994+0000 7fa2e8549980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -58> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding auth protocol: cephx 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -57> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding auth protocol: cephx 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -56> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding auth protocol: cephx 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -55> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.075 INFO:tasks.workunit.client.0.smithi104.stderr: -54> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -53> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -52> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -51> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -50> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -49> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -48> 2024-04-03T04:01:49.998+0000 7fa19d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -47> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -46> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -45> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -44> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -43> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -42> 2024-04-03T04:01:49.998+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -41> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:50.076 INFO:tasks.workunit.client.0.smithi104.stderr: -40> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -39> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cache list hook 0x55cf64c03fb0 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -38> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cache inspect hook 0x55cf64c03fb0 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -37> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cache erase hook 0x55cf64c03fb0 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -36> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cache zap hook 0x55cf64c03fb0 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -35> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 note: GC not initialized 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -34> 2024-04-03T04:01:49.998+0000 7fa1977fe640 20 reqs_thread_entry: start 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -33> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command sync trace show hook 0x7fa2dc004470 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -32> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command sync trace history hook 0x7fa2dc004470 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -31> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command sync trace active hook 0x7fa2dc004470 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -30> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command sync trace active_short hook 0x7fa2dc004470 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -29> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -28> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 Filter name: none 2024-04-03T04:01:50.077 INFO:tasks.workunit.client.0.smithi104.stderr: -27> 2024-04-03T04:01:49.998+0000 7fa1957fa640 20 reqs_thread_entry: start 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -26> 2024-04-03T04:01:49.998+0000 7fa2e8549980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -25> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -24> 2024-04-03T04:01:50.002+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -23> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -22> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -21> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 : miss 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -20> 2024-04-03T04:01:50.002+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -19> 2024-04-03T04:01:50.002+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -18> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -17> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -16> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -15> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -14> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 2024-04-03T04:01:50.078 INFO:tasks.workunit.client.0.smithi104.stderr: -13> 2024-04-03T04:01:50.014+0000 7fa2e8549980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -12> 2024-04-03T04:01:50.014+0000 7fa2e8549980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -11> 2024-04-03T04:01:50.014+0000 7fa2e8549980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -10> 2024-04-03T04:01:50.014+0000 7fa2e8549980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28, ofs0, ns] 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -9> 2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94349237095200 notifier 6590 bl.length()=873 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -8> 2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -7> 2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -6> 2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -5> 2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_sources= new_sources= 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -4> 2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential sources added=[] removed=[] 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -3> 2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_dests= new_dests= 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -2> 2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential dests added=[] removed=[] 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: -1> 2024-04-03T04:01:50.030+0000 7fa2e8549980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa2e8549980 time 2024-04-03T04:01:50.035593+0000 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:01:50.079 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa2ebe1fe1f] 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fa2ebe1ffd3] 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cf62e4c5b1] 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x55cf62e5a2cd] 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa2eac89d90] 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 0> 2024-04-03T04:01:50.030+0000 7fa2e8549980 -1 *** Caught signal (Aborted) ** 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7fa2e8549980 thread_name:radosgw-admin 2024-04-03T04:01:50.080 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa2eaca2520] 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa2ebe1fe79] 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fa2ebe1ffd3] 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cf62e4c5b1] 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x55cf62e5a2cd] 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa2eac89d90] 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:01:50.081 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr:--- logging levels --- 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 none 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 lockdep 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 context 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 crush 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_balancer 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_locker 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log_expire 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_migrator 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 3/ 5 mds_quiesce 2024-04-03T04:01:50.082 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 buffer 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 timer 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 filer 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 striper 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 objecter 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rados 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_mirror 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_replay 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_pwl 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 journaler 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objectcacher 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 immutable_obj_cache 2024-04-03T04:01:50.083 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 client 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 osd 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 optracker 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objclass 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 filestore 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 journal 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 ms 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mon 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 0/10 monc 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 paxos 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 tp 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 auth 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 crypto 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 finisher 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 reserver 2024-04-03T04:01:50.084 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 heartbeatmap 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 perfcounter 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 20/20 rgw 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_sync 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_datacache 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_access 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_dbstore 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_flight 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_lifecycle 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_notification 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 javaclient 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 asok 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 throttle 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 refs 2024-04-03T04:01:50.085 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 compressor 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluestore 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluefs 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 bdev 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 kstore 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 4/ 5 rocksdb 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 fuse 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 2/ 5 mgr 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mgrc 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 dpdk 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 eventtrace 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 prioritycache 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 test 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephfs_mirror 2024-04-03T04:01:50.086 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephsqlite 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 crimson_interrupt 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_onode 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_odata 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_omap 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_tm 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_t 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cleaner 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_epm 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_lba 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cache 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_journal 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_device 2024-04-03T04:01:50.087 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_backref 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 alienstore 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mclock 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cyanstore 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 ceph_exporter 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 memstore 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 trace 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: -2/-2 (syslog threshold) 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 99/99 (stderr threshold) 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1957fa640 / http_manager 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1977fe640 / http_manager 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa19d7e2640 / rgw_dt_lg_renew 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1b7fff640 / ms_dispatch 2024-04-03T04:01:50.088 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1c9ffb640 / io_context_pool 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1cbfff640 / ms_dispatch 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1d2e05640 / ms_dispatch 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1d4608640 / io_context_pool 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e5863640 / msgr-worker-2 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e6064640 / msgr-worker-1 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e6865640 / msgr-worker-0 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e7066640 / io_context_pool 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e8549980 / radosgw-admin 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: max_recent 500 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: max_new 1000 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: log_file /var/log/ceph/ceph-client.admin.101760.log 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr:--- end dump of recent events --- 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr:--- begin dump of recent events --- 2024-04-03T04:01:50.089 INFO:tasks.workunit.client.0.smithi104.stderr: -499> 2024-04-03T04:01:49.706+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -498> 2024-04-03T04:01:49.706+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -497> 2024-04-03T04:01:49.706+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -496> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -495> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -494> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -493> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient(hunting): handle_auth_done global_id 6578 payload 274 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -492> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -491> 2024-04-03T04:01:49.706+0000 7fa2e6865640 1 monclient: found mon.noname-c 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -490> 2024-04-03T04:01:49.706+0000 7fa2e6865640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -489> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -488> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr: -487> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: dump: 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.090 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr: -486> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr: -485> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr: -484> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr: -483> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr: -482> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr: -481> 2024-04-03T04:01:49.706+0000 7fa1d4608640 10 monclient: dump: 2024-04-03T04:01:50.091 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr: -480> 2024-04-03T04:01:49.706+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6578 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr: -479> 2024-04-03T04:01:49.706+0000 7fa2e8549980 10 monclient: get_monmap_and_config success 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr: -478> 2024-04-03T04:01:49.706+0000 7fa2e8549980 4 set_mon_vals no callback set 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr: -477> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: shutdown 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr: -476> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 asok(0x55cf64926210) unregister_commands rotate-key 2024-04-03T04:01:50.092 INFO:tasks.workunit.client.0.smithi104.stderr: -475> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: build_initial_monmap 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr: -474> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 build_initial for_mkfs: 0 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr: -473> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: monmap: 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr: -472> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding auth protocol: cephx 2024-04-03T04:01:50.093 INFO:tasks.workunit.client.0.smithi104.stderr: -471> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding auth protocol: cephx 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -470> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding auth protocol: cephx 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -469> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -468> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -467> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -466> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -465> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -464> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -463> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -462> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -461> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -460> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -459> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: crc 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -458> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b62210) adding con mode: secure 2024-04-03T04:01:50.094 INFO:tasks.workunit.client.0.smithi104.stderr: -457> 2024-04-03T04:01:49.710+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -456> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: starting msgr at 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -455> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: starting objecter 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -454> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command objecter_requests hook 0x55cf648b1d50 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -453> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: setting wanted keys 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -452> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: calling monclient init 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -451> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: init 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -450> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding auth protocol: cephx 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -449> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding auth protocol: cephx 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -448> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding auth protocol: cephx 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -447> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -446> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -445> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -444> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -443> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.095 INFO:tasks.workunit.client.0.smithi104.stderr: -442> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -441> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -440> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -439> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -438> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -437> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: crc 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -436> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b31ff0) adding con mode: secure 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -435> 2024-04-03T04:01:49.710+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -434> 2024-04-03T04:01:49.710+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -433> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command rotate-key hook 0x55cf64b32138 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -432> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -431> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _add_conns ranks=[2,1,0] 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -430> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-c con 0x55cf64a7fb30 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:50.096 INFO:tasks.workunit.client.0.smithi104.stderr: -429> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-b con 0x55cf64a80790 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -428> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-a con 0x55cf64b613f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -427> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -426> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -425> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -424> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -423> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient(hunting): authenticate will time out at 2365.453612s 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -422> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): get_auth_request con 0x55cf64a7fb30 auth_method 0 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -421> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -420> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -419> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -418> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): get_auth_request con 0x55cf64b613f0 auth_method 0 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -417> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -416> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.097 INFO:tasks.workunit.client.0.smithi104.stderr: -415> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -414> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -413> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -412> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -411> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -410> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -409> 2024-04-03T04:01:49.710+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -408> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient(hunting): handle_auth_done global_id 6581 payload 824 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -407> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -406> 2024-04-03T04:01:49.710+0000 7fa2e6064640 1 monclient: found mon.noname-c 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -405> 2024-04-03T04:01:49.710+0000 7fa2e6064640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -404> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -403> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr: -402> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: dump: 2024-04-03T04:01:50.098 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr: -401> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr: -400> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr: -399> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr: -398> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.099 INFO:tasks.workunit.client.0.smithi104.stderr: -397> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr: -396> 2024-04-03T04:01:49.710+0000 7fa1d2e05640 10 monclient: dump: 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr: -395> 2024-04-03T04:01:49.710+0000 7fa1d4608640 4 set_mon_vals no callback set 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr: -394> 2024-04-03T04:01:49.710+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6581 2024-04-03T04:01:50.100 INFO:tasks.workunit.client.0.smithi104.stderr: -393> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -392> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -391> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -390> 2024-04-03T04:01:49.710+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -389> 2024-04-03T04:01:49.710+0000 7fa2e8549980 1 librados: init done 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -388> 2024-04-03T04:01:49.714+0000 7fa1d2e05640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -387> 2024-04-03T04:01:49.714+0000 7fa1d2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -386> 2024-04-03T04:01:49.714+0000 7fa1d2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -385> 2024-04-03T04:01:49.714+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa1cc066d90 auth_method 0 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -384> 2024-04-03T04:01:49.714+0000 7fa2e6865640 10 monclient: get_auth_request con 0x55cf64b5ac80 auth_method 0 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -383> 2024-04-03T04:01:49.714+0000 7fa2e6064640 10 monclient: get_auth_request con 0x55cf64b7d580 auth_method 0 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -382> 2024-04-03T04:01:49.714+0000 7fa2e5863640 10 monclient: get_auth_request con 0x55cf64b81770 auth_method 0 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -381> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient: get_auth_request con 0x55cf64b80dd0 auth_method 0 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -380> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: build_initial_monmap 2024-04-03T04:01:50.101 INFO:tasks.workunit.client.0.smithi104.stderr: -379> 2024-04-03T04:01:49.718+0000 7fa2e8549980 1 build_initial for_mkfs: 0 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr: -378> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: monmap: 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr: -377> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding auth protocol: cephx 2024-04-03T04:01:50.102 INFO:tasks.workunit.client.0.smithi104.stderr: -376> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding auth protocol: cephx 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -375> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding auth protocol: cephx 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -374> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -373> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -372> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -371> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -370> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -369> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -368> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -367> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -366> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -365> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.103 INFO:tasks.workunit.client.0.smithi104.stderr: -364> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: crc 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -363> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b89820) adding con mode: secure 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -362> 2024-04-03T04:01:49.718+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -361> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command objecter_requests cmddesc objecter_requests hook 0x55cf64b8ed90 EEXIST 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -360> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: init 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -359> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding auth protocol: cephx 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -358> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding auth protocol: cephx 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -357> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding auth protocol: cephx 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -356> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -355> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -354> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -353> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -352> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -351> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -350> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.104 INFO:tasks.workunit.client.0.smithi104.stderr: -349> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -348> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -347> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -346> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: crc 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -345> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 AuthRegistry(0x55cf64b88768) adding con mode: secure 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -344> 2024-04-03T04:01:49.718+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -343> 2024-04-03T04:01:49.718+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -342> 2024-04-03T04:01:49.718+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command rotate-key cmddesc rotate-key hook 0x55cf64b888b0 EEXIST 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -341> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -340> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient: _add_conns ranks=[0,2,1] 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -339> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-a con 0x55cf64bb39f0 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -338> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-c con 0x55cf64bb3dd0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -337> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-b con 0x55cf64baef90 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:50.105 INFO:tasks.workunit.client.0.smithi104.stderr: -336> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -335> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -334> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -333> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -332> 2024-04-03T04:01:49.718+0000 7fa2e8549980 10 monclient(hunting): authenticate will time out at 2365.463203s 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -331> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): get_auth_request con 0x55cf64bb39f0 auth_method 0 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -330> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -329> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -328> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -327> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): get_auth_request con 0x55cf64bb3dd0 auth_method 0 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -326> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -325> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.106 INFO:tasks.workunit.client.0.smithi104.stderr: -324> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -323> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -322> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -321> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -320> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -319> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -318> 2024-04-03T04:01:49.718+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -317> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient(hunting): handle_auth_done global_id 6996 payload 824 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -316> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -315> 2024-04-03T04:01:49.718+0000 7fa2e5863640 1 monclient: found mon.noname-a 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -314> 2024-04-03T04:01:49.718+0000 7fa2e5863640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.104:3300/0 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -313> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -312> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-03T04:01:50.107 INFO:tasks.workunit.client.0.smithi104.stderr: -311> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: dump: 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr: -310> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr: -309> 2024-04-03T04:01:49.718+0000 7fa1cbfff640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr: -308> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6996 2024-04-03T04:01:50.108 INFO:tasks.workunit.client.0.smithi104.stderr: -307> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr: -306> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr: -305> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr: -304> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr: -303> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr: -302> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 10 monclient: dump: 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.109 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -301> 2024-04-03T04:01:49.722+0000 7fa2e7066640 4 set_mon_vals no callback set 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -300> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -299> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.104:3300/0 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -298> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -297> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -296> 2024-04-03T04:01:49.722+0000 7fa1cbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -295> 2024-04-03T04:01:49.722+0000 7fa2e6865640 10 monclient: get_auth_request con 0x7fa1c0066ca0 auth_method 0 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -294> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: get_monmap_and_config 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -293> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: build_initial_monmap 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -292> 2024-04-03T04:01:49.722+0000 7fa2e8549980 1 build_initial for_mkfs: 0 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr: -291> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: monmap: 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:50.110 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr: -290> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr: -289> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr: -288> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr: -287> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.111 INFO:tasks.workunit.client.0.smithi104.stderr: -286> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -285> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -284> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -283> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -282> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -281> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -280> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -279> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -278> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -277> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -276> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -275> 2024-04-03T04:01:49.722+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -274> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: init 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -273> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding auth protocol: cephx 2024-04-03T04:01:50.112 INFO:tasks.workunit.client.0.smithi104.stderr: -272> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding auth protocol: cephx 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -271> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding auth protocol: cephx 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -270> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -269> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -268> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -267> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -266> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -265> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -264> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -263> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -262> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -261> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.113 INFO:tasks.workunit.client.0.smithi104.stderr: -260> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: crc 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -259> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9090) adding con mode: secure 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -258> 2024-04-03T04:01:49.722+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -257> 2024-04-03T04:01:49.722+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -256> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command rotate-key cmddesc rotate-key hook 0x7ffd1dad91d8 EEXIST 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -255> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -254> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: _add_conns ranks=[0,1,2] 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -253> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-a con 0x55cf64c05f30 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -252> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-b con 0x55cf64c013d0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -251> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-c con 0x55cf64bf6c90 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -250> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -249> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -248> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.114 INFO:tasks.workunit.client.0.smithi104.stderr: -247> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -246> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient(hunting): authenticate will time out at 2365.467077s 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -245> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): get_auth_request con 0x55cf64c05f30 auth_method 0 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -244> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -243> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -242> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -241> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): get_auth_request con 0x55cf64bf6c90 auth_method 0 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -240> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -239> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -238> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -237> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -236> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -235> 2024-04-03T04:01:49.722+0000 7fa2e5863640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -234> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.115 INFO:tasks.workunit.client.0.smithi104.stderr: -233> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr: -232> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr: -231> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient(hunting): handle_auth_done global_id 6587 payload 274 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr: -230> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr: -229> 2024-04-03T04:01:49.722+0000 7fa2e6064640 1 monclient: found mon.noname-c 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr: -228> 2024-04-03T04:01:49.722+0000 7fa2e6064640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr: -227> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr: -226> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr: -225> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: dump: 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.116 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr: -224> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr: -223> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr: -222> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr: -221> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr: -220> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr: -219> 2024-04-03T04:01:49.722+0000 7fa1c9ffb640 10 monclient: dump: 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.117 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr: -218> 2024-04-03T04:01:49.722+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6587 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr: -217> 2024-04-03T04:01:49.722+0000 7fa2e8549980 10 monclient: get_monmap_and_config success 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr: -216> 2024-04-03T04:01:49.722+0000 7fa2e8549980 4 set_mon_vals no callback set 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr: -215> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: shutdown 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr: -214> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: build_initial_monmap 2024-04-03T04:01:50.118 INFO:tasks.workunit.client.0.smithi104.stderr: -213> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 build_initial for_mkfs: 0 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr: -212> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: monmap: 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 0 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 0.000000 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr:created 0.000000 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 0 (unknown) 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.noname-a 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-b 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.noname-c 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr: -211> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr: -210> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.119 INFO:tasks.workunit.client.0.smithi104.stderr: -209> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding auth protocol: cephx 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -208> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -207> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -206> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -205> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -204> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -203> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -202> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -201> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -200> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -199> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -198> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: crc 2024-04-03T04:01:50.120 INFO:tasks.workunit.client.0.smithi104.stderr: -197> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd1540) adding con mode: secure 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -196> 2024-04-03T04:01:49.726+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -195> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: starting msgr at 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -194> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: starting objecter 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -193> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command objecter_requests cmddesc objecter_requests hook 0x55cf64bc5e50 EEXIST 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -192> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: setting wanted keys 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -191> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: calling monclient init 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -190> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: init 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -189> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding auth protocol: cephx 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -188> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding auth protocol: cephx 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -187> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding auth protocol: cephx 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -186> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -185> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -184> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.121 INFO:tasks.workunit.client.0.smithi104.stderr: -183> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -182> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -181> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -180> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -179> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -178> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -177> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -176> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: crc 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -175> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 AuthRegistry(0x55cf64bd0710) adding con mode: secure 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -174> 2024-04-03T04:01:49.726+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -173> 2024-04-03T04:01:49.726+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -172> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command rotate-key cmddesc rotate-key hook 0x55cf64bd0858 EEXIST 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -171> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _reopen_session rank -1 2024-04-03T04:01:50.122 INFO:tasks.workunit.client.0.smithi104.stderr: -170> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _add_conns ranks=[1,2,0] 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -169> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-b con 0x55cf64bf6c90 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -168> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-c con 0x55cf64c013d0 addr [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -167> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): picked mon.noname-a con 0x55cf64c05f30 addr [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -166> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -165> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -164> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): start opening mon connection 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -163> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): _renew_subs 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -162> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient(hunting): authenticate will time out at 2365.469847s 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -161> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): get_auth_request con 0x55cf64c013d0 auth_method 0 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -160> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -159> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -158> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -157> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): get_auth_request con 0x55cf64c05f30 auth_method 0 2024-04-03T04:01:50.123 INFO:tasks.workunit.client.0.smithi104.stderr: -156> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -155> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): _init_auth method 2 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -154> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): _init_auth creating new auth 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -153> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -152> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -151> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -150> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -149> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -148> 2024-04-03T04:01:49.726+0000 7fa2e6064640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -147> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient(hunting): handle_auth_done global_id 6590 payload 824 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -146> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient: _finish_hunting 0 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -145> 2024-04-03T04:01:49.726+0000 7fa2e6865640 1 monclient: found mon.noname-c 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -144> 2024-04-03T04:01:49.726+0000 7fa2e6865640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -143> 2024-04-03T04:01:49.726+0000 7fa2e5863640 10 monclient: get_auth_request con 0x55cf64bf6c90 auth_method 0 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -142> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.124 INFO:tasks.workunit.client.0.smithi104.stderr: -141> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr: -140> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: dump: 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr: -139> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: _finish_auth 0 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr: -138> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: _check_auth_tickets 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr: -137> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: handle_config config(0 keys) 2024-04-03T04:01:50.125 INFO:tasks.workunit.client.0.smithi104.stderr: -136> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr: -135> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr: -134> 2024-04-03T04:01:49.726+0000 7fa1b7fff640 10 monclient: dump: 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr:epoch 1 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr:fsid a081b84a-44ad-4905-81c6-ab13dbb94769 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr:last_changed 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr:created 2024-04-03T03:37:13.289189+0000 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr:min_mon_release 19 (squid) 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr:election_strategy: 1 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr:2: [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] mon.c 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr: -133> 2024-04-03T04:01:49.726+0000 7fa1c9ffb640 4 set_mon_vals no callback set 2024-04-03T04:01:50.126 INFO:tasks.workunit.client.0.smithi104.stderr: -132> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 monclient: authenticate success, global_id 6590 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -131> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -130> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -129> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _renew_subs 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -128> 2024-04-03T04:01:49.726+0000 7fa2e8549980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -127> 2024-04-03T04:01:49.726+0000 7fa2e8549980 1 librados: init done 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -126> 2024-04-03T04:01:49.726+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cr dump hook 0x7fa2d8001b28 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -125> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -124> 2024-04-03T04:01:49.730+0000 7fa1b7fff640 4 mgrc handle_mgr_map Got map version 5 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -123> 2024-04-03T04:01:49.730+0000 7fa1b7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -122> 2024-04-03T04:01:49.730+0000 7fa1b7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.104:6832/666075964,v1:172.21.15.104:6833/666075964] 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -121> 2024-04-03T04:01:49.730+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa1b0066d90 auth_method 0 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -120> 2024-04-03T04:01:49.730+0000 7fa2e6064640 10 monclient: get_auth_request con 0x55cf64c1ffb0 auth_method 0 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -119> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.127 INFO:tasks.workunit.client.0.smithi104.stderr: -118> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 realm 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -117> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -116> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -115> 2024-04-03T04:01:49.730+0000 7fa2e8549980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -114> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -113> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -112> 2024-04-03T04:01:49.730+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -111> 2024-04-03T04:01:49.730+0000 7fa2e5863640 10 monclient: get_auth_request con 0x55cf64c240d0 auth_method 0 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -110> 2024-04-03T04:01:49.734+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -109> 2024-04-03T04:01:49.734+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -108> 2024-04-03T04:01:49.734+0000 7fa2e6865640 10 monclient: get_auth_request con 0x55cf64c27910 auth_method 0 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -107> 2024-04-03T04:01:49.734+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -106> 2024-04-03T04:01:49.734+0000 7fa2e8549980 20 searching for the correct realm 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -105> 2024-04-03T04:01:49.734+0000 7fa2e6064640 10 monclient: get_auth_request con 0x55cf64c2c640 auth_method 0 2024-04-03T04:01:50.128 INFO:tasks.workunit.client.0.smithi104.stderr: -104> 2024-04-03T04:01:49.734+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa2d800e070 auth_method 0 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -103> 2024-04-03T04:01:49.738+0000 7fa2e6865640 10 monclient: get_auth_request con 0x7fa2e006b200 auth_method 0 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -102> 2024-04-03T04:01:49.738+0000 7fa2e5863640 0 -- 172.21.15.104:0/916861445 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fa2d800e070 msgr2=0x7fa2d805aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -101> 2024-04-03T04:01:49.738+0000 7fa1b7fff640 1 client.6590.objecter ms_handle_reset 0x7fa2d800e070 session 0x7fa2d807d040 osd.7 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -100> 2024-04-03T04:01:49.738+0000 7fa1b7fff640 10 monclient: _renew_subs 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -99> 2024-04-03T04:01:49.738+0000 7fa1b7fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.104:3301/0 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -98> 2024-04-03T04:01:49.738+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa1b00774c0 auth_method 0 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -97> 2024-04-03T04:01:49.742+0000 7fa2e6064640 10 monclient: get_auth_request con 0x7fa2e00935f0 auth_method 0 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -96> 2024-04-03T04:01:49.746+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa2e0069060 auth_method 0 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -95> 2024-04-03T04:01:49.746+0000 7fa2e5863640 0 -- 172.21.15.104:0/916861445 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fa2e0069060 msgr2=0x7fa2e006b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -94> 2024-04-03T04:01:49.950+0000 7fa2e5863640 10 monclient: get_auth_request con 0x7fa2e0069060 auth_method 0 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -93> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -92> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -91> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:50.129 INFO:tasks.workunit.client.0.smithi104.stderr: -90> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -89> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -88> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -87> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -86> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -85> 2024-04-03T04:01:49.962+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -84> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -83> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -82> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -81> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 zone default found 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -80> 2024-04-03T04:01:49.966+0000 7fa2e8549980 4 Realm: () 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -79> 2024-04-03T04:01:49.966+0000 7fa2e8549980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -78> 2024-04-03T04:01:49.966+0000 7fa2e8549980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -77> 2024-04-03T04:01:49.966+0000 7fa2e8549980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:50.130 INFO:tasks.workunit.client.0.smithi104.stderr: -76> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 zonegroup default 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -75> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -74> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -73> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -72> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -71> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -70> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -69> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 started sync module instance, tier type = 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -68> 2024-04-03T04:01:49.966+0000 7fa2e8549980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -67> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=0 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -66> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=1 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -65> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=2 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -64> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=3 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -63> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=4 2024-04-03T04:01:50.131 INFO:tasks.workunit.client.0.smithi104.stderr: -62> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=5 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -61> 2024-04-03T04:01:49.990+0000 7fa2e8549980 20 add_watcher() i=6 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -60> 2024-04-03T04:01:49.994+0000 7fa2e8549980 20 add_watcher() i=7 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -59> 2024-04-03T04:01:49.994+0000 7fa2e8549980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -58> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding auth protocol: cephx 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -57> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding auth protocol: cephx 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -56> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding auth protocol: cephx 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -55> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -54> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -53> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -52> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -51> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -50> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -49> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.132 INFO:tasks.workunit.client.0.smithi104.stderr: -48> 2024-04-03T04:01:49.998+0000 7fa19d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -47> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -46> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -45> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -44> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: crc 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -43> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 AuthRegistry(0x7ffd1dad9520) adding con mode: secure 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -42> 2024-04-03T04:01:49.998+0000 7fa2e8549980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -41> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -40> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -39> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cache list hook 0x55cf64c03fb0 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -38> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cache inspect hook 0x55cf64c03fb0 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -37> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cache erase hook 0x55cf64c03fb0 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -36> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command cache zap hook 0x55cf64c03fb0 2024-04-03T04:01:50.133 INFO:tasks.workunit.client.0.smithi104.stderr: -35> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 note: GC not initialized 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -34> 2024-04-03T04:01:49.998+0000 7fa1977fe640 20 reqs_thread_entry: start 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -33> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command sync trace show hook 0x7fa2dc004470 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -32> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command sync trace history hook 0x7fa2dc004470 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -31> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command sync trace active hook 0x7fa2dc004470 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -30> 2024-04-03T04:01:49.998+0000 7fa2e8549980 5 asok(0x55cf64926210) register_command sync trace active_short hook 0x7fa2dc004470 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -29> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -28> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 Filter name: none 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -27> 2024-04-03T04:01:49.998+0000 7fa1957fa640 20 reqs_thread_entry: start 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -26> 2024-04-03T04:01:49.998+0000 7fa2e8549980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -25> 2024-04-03T04:01:49.998+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -24> 2024-04-03T04:01:50.002+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -23> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -22> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -21> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 : miss 2024-04-03T04:01:50.134 INFO:tasks.workunit.client.0.smithi104.stderr: -20> 2024-04-03T04:01:50.002+0000 7fa2e8549980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -19> 2024-04-03T04:01:50.002+0000 7fa2e8549980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -18> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -17> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -16> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -15> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -14> 2024-04-03T04:01:50.002+0000 7fa2e8549980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -13> 2024-04-03T04:01:50.014+0000 7fa2e8549980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -12> 2024-04-03T04:01:50.014+0000 7fa2e8549980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -11> 2024-04-03T04:01:50.014+0000 7fa2e8549980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -10> 2024-04-03T04:01:50.014+0000 7fa2e8549980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28, ofs0, ns] 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -9> 2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94349237095200 notifier 6590 bl.length()=873 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -8> 2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:01:50.135 INFO:tasks.workunit.client.0.smithi104.stderr: -7> 2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: -6> 2024-04-03T04:01:50.014+0000 7fa1c9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: -5> 2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_sources= new_sources= 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: -4> 2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential sources added=[] removed=[] 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: -3> 2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_dests= new_dests= 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: -2> 2024-04-03T04:01:50.022+0000 7fa2e8549980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential dests added=[] removed=[] 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: -1> 2024-04-03T04:01:50.030+0000 7fa2e8549980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa2e8549980 time 2024-04-03T04:01:50.035593+0000 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa2ebe1fe1f] 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fa2ebe1ffd3] 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cf62e4c5b1] 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x55cf62e5a2cd] 2024-04-03T04:01:50.136 INFO:tasks.workunit.client.0.smithi104.stderr: 5: main() 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa2eac89d90] 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 7: __libc_start_main() 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 8: _start() 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 0> 2024-04-03T04:01:50.030+0000 7fa2e8549980 -1 *** Caught signal (Aborted) ** 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: in thread 7fa2e8549980 thread_name:radosgw-admin 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: ceph version 19.0.0-2594-g888a4a75 (888a4a757aa90aa5ed4fb3291576474bc07507ce) squid (dev) 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa2eaca2520] 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 2: pthread_kill() 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 3: raise() 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 4: abort() 2024-04-03T04:01:50.137 INFO:tasks.workunit.client.0.smithi104.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa2ebe1fe79] 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x181fd3) [0x7fa2ebe1ffd3] 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cf62e4c5b1] 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x31d) [0x55cf62e5a2cd] 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 9: main() 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa2eac89d90] 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 11: __libc_start_main() 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 12: _start() 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr:--- logging levels --- 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 none 2024-04-03T04:01:50.138 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 lockdep 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 context 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 crush 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_balancer 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_locker 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_log_expire 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mds_migrator 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 3/ 5 mds_quiesce 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 buffer 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 timer 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 filer 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 striper 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 1 objecter 2024-04-03T04:01:50.139 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rados 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_mirror 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_replay 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 rbd_pwl 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 journaler 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objectcacher 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 immutable_obj_cache 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 client 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 osd 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 optracker 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 objclass 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 filestore 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 journal 2024-04-03T04:01:50.140 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 ms 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mon 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 0/10 monc 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 paxos 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 tp 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 auth 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 crypto 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 finisher 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 reserver 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 heartbeatmap 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 perfcounter 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 20/20 rgw 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_sync 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_datacache 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_access 2024-04-03T04:01:50.141 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_dbstore 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_flight 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_lifecycle 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 rgw_notification 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 javaclient 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 asok 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 1 throttle 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 0 refs 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 compressor 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluestore 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 bluefs 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 3 bdev 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 kstore 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 4/ 5 rocksdb 2024-04-03T04:01:50.142 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 fuse 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 2/ 5 mgr 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mgrc 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 dpdk 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 eventtrace 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 prioritycache 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 test 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephfs_mirror 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cephsqlite 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 crimson_interrupt 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_onode 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_odata 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_omap 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_tm 2024-04-03T04:01:50.143 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_t 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cleaner 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_epm 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_lba 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_fixedkv_tree 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_cache 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_journal 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_device 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 seastore_backref 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 alienstore 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 mclock 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 0/ 5 cyanstore 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 ceph_exporter 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 memstore 2024-04-03T04:01:50.144 INFO:tasks.workunit.client.0.smithi104.stderr: 1/ 5 trace 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: -2/-2 (syslog threshold) 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 99/99 (stderr threshold) 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr:--- pthread ID / name mapping for recent threads --- 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1957fa640 / http_manager 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1977fe640 / http_manager 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa19d7e2640 / rgw_dt_lg_renew 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1b7fff640 / ms_dispatch 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1c9ffb640 / io_context_pool 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1cbfff640 / ms_dispatch 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1d2e05640 / ms_dispatch 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa1d4608640 / io_context_pool 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e5863640 / msgr-worker-2 2024-04-03T04:01:50.145 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e6064640 / msgr-worker-1 2024-04-03T04:01:50.146 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e6865640 / msgr-worker-0 2024-04-03T04:01:50.146 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e7066640 / io_context_pool 2024-04-03T04:01:50.146 INFO:tasks.workunit.client.0.smithi104.stderr: 7fa2e8549980 / radosgw-admin 2024-04-03T04:01:50.146 INFO:tasks.workunit.client.0.smithi104.stderr: max_recent 500 2024-04-03T04:01:50.146 INFO:tasks.workunit.client.0.smithi104.stderr: max_new 1000 2024-04-03T04:01:50.146 INFO:tasks.workunit.client.0.smithi104.stderr: log_file /var/lib/ceph/crash/2024-04-03T04:01:50.037574Z_fcc78530-22ec-4a91-9633-3f9445ab9238/log 2024-04-03T04:01:50.146 INFO:tasks.workunit.client.0.smithi104.stderr:--- end dump of recent events --- 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:Aborted 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.122+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.122+0000 7f443955b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.122+0000 7f443955b980 20 realm 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.122+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.122+0000 7f443955b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.122+0000 7f443955b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.122+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.122+0000 7f443955b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.151 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.122+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.126+0000 7f443955b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.126+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.126+0000 7f443955b980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.126+0000 7f443955b980 20 searching for the correct realm 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.130+0000 7f4437076640 0 -- 172.21.15.104:0/546989791 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x55699de5a820 msgr2=0x55699de5cce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.138+0000 7f4436875640 0 -- 172.21.15.104:0/546989791 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f44300cf770 msgr2=0x7f443010b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.152 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 zone default found 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 4 Realm: () 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 zonegroup default 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 started sync module instance, tier type = 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.146+0000 7f443955b980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.162+0000 7f443955b980 20 add_watcher() i=0 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.162+0000 7f443955b980 20 add_watcher() i=1 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.162+0000 7f443955b980 20 add_watcher() i=2 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.162+0000 7f443955b980 20 add_watcher() i=3 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.162+0000 7f443955b980 20 add_watcher() i=4 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.162+0000 7f443955b980 20 add_watcher() i=5 2024-04-03T04:01:50.154 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.162+0000 7f443955b980 20 add_watcher() i=6 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.162+0000 7f443955b980 20 add_watcher() i=7 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.162+0000 7f443955b980 2 all 8 watchers are set, enabling cache 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f42edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 5 note: GC not initialized 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f42ecfe1640 20 reqs_thread_entry: start 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 init_complete bucket index max shards: 11 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 Filter name: none 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f42667fc640 20 reqs_thread_entry: start 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 rados_obj.operate() r=0 bl.length=403 2024-04-03T04:01:50.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:50.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.166+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.170+0000 7f443955b980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:01:50.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.170+0000 7f443955b980 20 rados->read ofs=0 len=0 2024-04-03T04:01:50.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.170+0000 7f443955b980 20 rados_obj.operate() r=0 bl.length=403 2024-04-03T04:01:50.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.170+0000 7f443955b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:01:50.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.170+0000 7f42edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:01:50.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.174+0000 7f443955b980 20 remove_watcher() i=0 2024-04-03T04:01:50.157 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.174+0000 7f443955b980 2 removed watcher, disabling cache 2024-04-03T04:01:50.160 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.178+0000 7f443955b980 20 remove_watcher() i=1 2024-04-03T04:01:50.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.178+0000 7f443955b980 20 remove_watcher() i=2 2024-04-03T04:01:50.164 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.182+0000 7f443955b980 20 remove_watcher() i=3 2024-04-03T04:01:50.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.182+0000 7f443955b980 20 remove_watcher() i=4 2024-04-03T04:01:50.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.186+0000 7f443955b980 20 remove_watcher() i=5 2024-04-03T04:01:50.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.186+0000 7f443955b980 20 remove_watcher() i=6 2024-04-03T04:01:50.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:01:50.186+0000 7f443955b980 20 remove_watcher() i=7 2024-04-03T04:01:50.182 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.182 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:01:50.182 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-do-reshard id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-04-03T04:01:50.182 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:01:50.183 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:01:50.183 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:20.403 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:20.403 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:20.484 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-04-03T04:02:20.519 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:20.519 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:20.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 realm 2024-04-03T04:02:20.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:20.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:20.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.582+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.586+0000 7fbcd5a8b980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:20.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.586+0000 7fbcd5a8b980 20 searching for the correct realm 2024-04-03T04:02:20.571 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.590+0000 7fbcd3da7640 0 -- 172.21.15.104:0/619167888 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fbccc03eb10 msgr2=0x7fbccc022450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:20.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.594+0000 7fbcd2da5640 0 -- 172.21.15.104:0/619167888 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fbccc04f080 msgr2=0x7fbccc04f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:20.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.810+0000 7fbcd5a8b980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:20.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.810+0000 7fbcd5a8b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:20.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.810+0000 7fbcd5a8b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:20.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.810+0000 7fbcd5a8b980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:20.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.810+0000 7fbcd5a8b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:20.793 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.810+0000 7fbcd5a8b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:20.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.810+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.810+0000 7fbcd5a8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.810+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:20.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:20.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 zone default found 2024-04-03T04:02:20.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 4 Realm: () 2024-04-03T04:02:20.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:20.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:20.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:20.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 zonegroup default 2024-04-03T04:02:20.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 started sync module instance, tier type = 2024-04-03T04:02:20.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.814+0000 7fbcd5a8b980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:20.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.838+0000 7fbcd5a8b980 20 add_watcher() i=0 2024-04-03T04:02:20.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.838+0000 7fbcd5a8b980 20 add_watcher() i=1 2024-04-03T04:02:20.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.838+0000 7fbcd5a8b980 20 add_watcher() i=2 2024-04-03T04:02:20.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.838+0000 7fbcd5a8b980 20 add_watcher() i=3 2024-04-03T04:02:20.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.838+0000 7fbcd5a8b980 20 add_watcher() i=4 2024-04-03T04:02:20.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.838+0000 7fbcd5a8b980 20 add_watcher() i=5 2024-04-03T04:02:20.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.838+0000 7fbcd5a8b980 20 add_watcher() i=6 2024-04-03T04:02:20.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.838+0000 7fbcd5a8b980 20 add_watcher() i=7 2024-04-03T04:02:20.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.838+0000 7fbcd5a8b980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:20.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.842+0000 7fbb89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:20.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.842+0000 7fbcd5a8b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:20.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.842+0000 7fbcd5a8b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:20.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.842+0000 7fbcd5a8b980 5 note: GC not initialized 2024-04-03T04:02:20.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.842+0000 7fbb88fe1640 20 reqs_thread_entry: start 2024-04-03T04:02:20.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.842+0000 7fbcd5a8b980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:20.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.842+0000 7fbcd5a8b980 20 Filter name: none 2024-04-03T04:02:20.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.842+0000 7fbb027fc640 20 reqs_thread_entry: start 2024-04-03T04:02:20.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-04-03T04:02:20.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:02:20.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-04-03T04:02:20.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-04-03T04:02:20.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 : miss 2024-04-03T04:02:20.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:02:20.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:02:20.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:02:20.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:02:20.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:02:20.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.846+0000 7fbcd5a8b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 2024-04-03T04:02:20.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.862+0000 7fbcd5a8b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:02:20.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.862+0000 7fbcd5a8b980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:02:20.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.862+0000 7fbcd5a8b980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:02:20.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.862+0000 7fbcd5a8b980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28, ofs0, ns] 2024-04-03T04:02:20.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.862+0000 7fbbb6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562396 cookie 94903001785776 notifier 6626 bl.length()=873 2024-04-03T04:02:20.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.862+0000 7fbbb6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:02:20.843 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.862+0000 7fbbb6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:02:20.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.862+0000 7fbbb6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:02:20.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.866+0000 7fbcd5a8b980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_sources= new_sources= 2024-04-03T04:02:20.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.866+0000 7fbcd5a8b980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential sources added=[] removed=[] 2024-04-03T04:02:20.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.866+0000 7fbcd5a8b980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_dests= new_dests= 2024-04-03T04:02:20.846 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.866+0000 7fbcd5a8b980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential dests added=[] removed=[] 2024-04-03T04:02:20.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.0 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.0 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.1 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.1 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.2 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.2 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.3 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.3 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.4 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.4 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.5 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.5 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.6 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.6 2024-04-03T04:02:20.852 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.7 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.7 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.8 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.8 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.9 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.9 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.10 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.10 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.11 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1.11 2024-04-03T04:02:20.853 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.0 2024-04-03T04:02:20.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.1 2024-04-03T04:02:20.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.2 2024-04-03T04:02:20.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.870+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.3 2024-04-03T04:02:20.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.874+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.4 2024-04-03T04:02:20.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.874+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.5 2024-04-03T04:02:20.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.874+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.6 2024-04-03T04:02:20.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.874+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.7 2024-04-03T04:02:20.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.874+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.8 2024-04-03T04:02:20.858 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.878+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.9 2024-04-03T04:02:20.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.878+0000 7fbcd5a8b980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28.10 2024-04-03T04:02:20.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.886+0000 7fbcd5a8b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 : hit (requested=0x17, cached=0x17) 2024-04-03T04:02:20.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.886+0000 7fbcd5a8b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 2024-04-03T04:02:20.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.886+0000 7fbcd5a8b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:02:20.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.886+0000 7fbcd5a8b980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:02:20.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.886+0000 7fbcd5a8b980 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:02:20.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.886+0000 7fbcd5a8b980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28, ofs0, ns] 2024-04-03T04:02:20.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.890+0000 7fbbb67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 94903001785776 notifier 6626 bl.length()=841 2024-04-03T04:02:20.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.890+0000 7fbbb67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 info.flags=0x17 2024-04-03T04:02:20.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.890+0000 7fbbb67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 to cache LRU end 2024-04-03T04:02:20.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.890+0000 7fbbb67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-04-03T04:02:20.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.894+0000 7fbcd5a8b980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_sources= new_sources= 2024-04-03T04:02:20.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.894+0000 7fbcd5a8b980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential sources added=[] removed=[] 2024-04-03T04:02:20.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.894+0000 7fbcd5a8b980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): orig_dests= new_dests= 2024-04-03T04:02:20.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.894+0000 7fbcd5a8b980 20 handle_bi_update(): bucket=:abort-at-do-reshard[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28]): potential dests added=[] removed=[] 2024-04-03T04:02:20.878 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.898+0000 7fbcd5a8b980 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2024-04-03T04:02:20.882 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.902+0000 7fbb89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:20.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.906+0000 7fbcd5a8b980 20 remove_watcher() i=0 2024-04-03T04:02:20.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.906+0000 7fbcd5a8b980 2 removed watcher, disabling cache 2024-04-03T04:02:20.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.906+0000 7fbcd5a8b980 20 remove_watcher() i=1 2024-04-03T04:02:20.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.910+0000 7fbcd5a8b980 20 remove_watcher() i=2 2024-04-03T04:02:20.896 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.914+0000 7fbcd5a8b980 20 remove_watcher() i=3 2024-04-03T04:02:20.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.918+0000 7fbcd5a8b980 20 remove_watcher() i=4 2024-04-03T04:02:20.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.918+0000 7fbcd5a8b980 20 remove_watcher() i=5 2024-04-03T04:02:20.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.918+0000 7fbcd5a8b980 20 remove_watcher() i=6 2024-04-03T04:02:20.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:20.922+0000 7fbcd5a8b980 20 remove_watcher() i=7 2024-04-03T04:02:20.919 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-04-03T04:02:20.945 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:20.946 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:20.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.006+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 20 realm 2024-04-03T04:02:20.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:20.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:20.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:20.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.010+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:20.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.014+0000 7ff59efb1980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:20.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.014+0000 7ff59efb1980 20 searching for the correct realm 2024-04-03T04:02:20.998 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.014+0000 7ff59d2cd640 0 -- 172.21.15.104:0/807104033 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7ff594066f80 msgr2=0x7ff594065340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:21.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.234+0000 7ff59c2cb640 0 -- 172.21.15.104:0/807104033 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7ff594086290 msgr2=0x7ff59407f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:21.433 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.450+0000 7ff59efb1980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:21.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.450+0000 7ff59efb1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:21.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.450+0000 7ff59efb1980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:21.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.450+0000 7ff59efb1980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:21.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.450+0000 7ff59efb1980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:21.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.450+0000 7ff59efb1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:21.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.450+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.450+0000 7ff59efb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:21.434 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.450+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:21.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:21.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 20 zone default found 2024-04-03T04:02:21.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 4 Realm: () 2024-04-03T04:02:21.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:21.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:21.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:21.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 20 zonegroup default 2024-04-03T04:02:21.436 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:21.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.454+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.438 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.458+0000 7ff59efb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:21.438 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.458+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.439 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.458+0000 7ff59efb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:21.439 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.458+0000 7ff59efb1980 20 started sync module instance, tier type = 2024-04-03T04:02:21.439 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.458+0000 7ff59efb1980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:21.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.482+0000 7ff59efb1980 20 add_watcher() i=0 2024-04-03T04:02:21.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.482+0000 7ff59efb1980 20 add_watcher() i=1 2024-04-03T04:02:21.463 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.482+0000 7ff59efb1980 20 add_watcher() i=2 2024-04-03T04:02:21.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.482+0000 7ff59efb1980 20 add_watcher() i=3 2024-04-03T04:02:21.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.482+0000 7ff59efb1980 20 add_watcher() i=4 2024-04-03T04:02:21.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.482+0000 7ff59efb1980 20 add_watcher() i=5 2024-04-03T04:02:21.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.482+0000 7ff59efb1980 20 add_watcher() i=6 2024-04-03T04:02:21.465 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.482+0000 7ff59efb1980 20 add_watcher() i=7 2024-04-03T04:02:21.465 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.482+0000 7ff59efb1980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:21.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.486+0000 7ff452fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:21.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:21.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:21.470 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 5 note: GC not initialized 2024-04-03T04:02:21.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff451fe3640 20 reqs_thread_entry: start 2024-04-03T04:02:21.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:21.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 Filter name: none 2024-04-03T04:02:21.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff3c37fe640 20 reqs_thread_entry: start 2024-04-03T04:02:21.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:02:21.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:02:21.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:21.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.490+0000 7ff59efb1980 20 rados_obj.operate() r=0 bl.length=187 2024-04-03T04:02:21.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.494+0000 7ff59efb1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:21.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.494+0000 7ff59efb1980 20 rados_obj.operate() r=0 bl.length=371 2024-04-03T04:02:21.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.494+0000 7ff59efb1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:21.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.494+0000 7ff452fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:21.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.502+0000 7ff59efb1980 20 remove_watcher() i=0 2024-04-03T04:02:21.483 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.502+0000 7ff59efb1980 2 removed watcher, disabling cache 2024-04-03T04:02:21.485 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.502+0000 7ff59efb1980 20 remove_watcher() i=1 2024-04-03T04:02:21.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.506+0000 7ff59efb1980 20 remove_watcher() i=2 2024-04-03T04:02:21.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.506+0000 7ff59efb1980 20 remove_watcher() i=3 2024-04-03T04:02:21.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.510+0000 7ff59efb1980 20 remove_watcher() i=4 2024-04-03T04:02:21.493 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.510+0000 7ff59efb1980 20 remove_watcher() i=5 2024-04-03T04:02:21.494 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.514+0000 7ff59efb1980 20 remove_watcher() i=6 2024-04-03T04:02:21.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:21.514+0000 7ff59efb1980 20 remove_watcher() i=7 2024-04-03T04:02:21.510 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:21.510 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:02:21.510 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: abort-at-do-reshard id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-04-03T04:02:21.510 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:21.512 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:21.512 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:21.537 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:21.538 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:22.045 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:22.046 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:22.412 INFO:tasks.workunit.client.0.smithi104.stderr: test: reshard versioned bucket 2024-04-03T04:02:22.412 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket myver 2024-04-03T04:02:22.444 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:22.444 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:22.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.506+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.506+0000 7ffab6b47980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.506+0000 7ffab6b47980 20 realm 2024-04-03T04:02:22.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.506+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.506+0000 7ffab6b47980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.506+0000 7ffab6b47980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:22.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.506+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.506+0000 7ffab6b47980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.506+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.510+0000 7ffab6b47980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:22.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.510+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.510+0000 7ffab6b47980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:22.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.510+0000 7ffab6b47980 20 searching for the correct realm 2024-04-03T04:02:22.496 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.514+0000 7ffab4e63640 0 -- 172.21.15.104:0/123056037 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7ffaac041b10 msgr2=0x7ffaac03a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:22.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.522+0000 7ffab3e61640 0 -- 172.21.15.104:0/123056037 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7ffaac01a910 msgr2=0x7ffaac02c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:22.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.738+0000 7ffab6b47980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:22.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.738+0000 7ffab6b47980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:22.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.738+0000 7ffab6b47980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:22.721 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.738+0000 7ffab6b47980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:22.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.738+0000 7ffab6b47980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:22.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.738+0000 7ffab6b47980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:22.722 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.738+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.738+0000 7ffab6b47980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.738+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:22.723 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:22.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 zone default found 2024-04-03T04:02:22.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 4 Realm: () 2024-04-03T04:02:22.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:22.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:22.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:22.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 zonegroup default 2024-04-03T04:02:22.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.725 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.726 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 started sync module instance, tier type = 2024-04-03T04:02:22.727 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.742+0000 7ffab6b47980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:22.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.770+0000 7ffab6b47980 20 add_watcher() i=0 2024-04-03T04:02:22.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.770+0000 7ffab6b47980 20 add_watcher() i=1 2024-04-03T04:02:22.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.770+0000 7ffab6b47980 20 add_watcher() i=2 2024-04-03T04:02:22.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.770+0000 7ffab6b47980 20 add_watcher() i=3 2024-04-03T04:02:22.750 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.770+0000 7ffab6b47980 20 add_watcher() i=4 2024-04-03T04:02:22.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.770+0000 7ffab6b47980 20 add_watcher() i=5 2024-04-03T04:02:22.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.770+0000 7ffab6b47980 20 add_watcher() i=6 2024-04-03T04:02:22.752 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.770+0000 7ffab6b47980 20 add_watcher() i=7 2024-04-03T04:02:22.753 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.770+0000 7ffab6b47980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:22.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.774+0000 7ff96afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:22.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.774+0000 7ffab6b47980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:22.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.774+0000 7ffab6b47980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:22.758 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.774+0000 7ffab6b47980 5 note: GC not initialized 2024-04-03T04:02:22.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ff969fdb640 20 reqs_thread_entry: start 2024-04-03T04:02:22.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:22.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 Filter name: none 2024-04-03T04:02:22.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ff8db7fe640 20 reqs_thread_entry: start 2024-04-03T04:02:22.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.759 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:22.760 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:22.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:22.761 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:22.762 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.778+0000 7ffab6b47980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.782+0000 7ffab6b47980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:22.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.782+0000 7ffab6b47980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:22.766 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.786+0000 7ff96afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:22.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.790+0000 7ffab6b47980 20 remove_watcher() i=0 2024-04-03T04:02:22.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.790+0000 7ffab6b47980 2 removed watcher, disabling cache 2024-04-03T04:02:22.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.790+0000 7ffab6b47980 20 remove_watcher() i=1 2024-04-03T04:02:22.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.794+0000 7ffab6b47980 20 remove_watcher() i=2 2024-04-03T04:02:22.777 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.794+0000 7ffab6b47980 20 remove_watcher() i=3 2024-04-03T04:02:22.779 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.798+0000 7ffab6b47980 20 remove_watcher() i=4 2024-04-03T04:02:22.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.798+0000 7ffab6b47980 20 remove_watcher() i=5 2024-04-03T04:02:22.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.802+0000 7ffab6b47980 20 remove_watcher() i=6 2024-04-03T04:02:22.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.802+0000 7ffab6b47980 20 remove_watcher() i=7 2024-04-03T04:02:22.798 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:22.798 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:02:22.798 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: myver id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-04-03T04:02:22.798 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:22.799 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-04-03T04:02:22.827 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:22.827 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:22.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.890+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.873 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.890+0000 7fa2e829e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.890+0000 7fa2e829e980 20 realm 2024-04-03T04:02:22.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.890+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.890+0000 7fa2e829e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.890+0000 7fa2e829e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:22.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.890+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.890+0000 7fa2e829e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:22.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.890+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.894+0000 7fa2e829e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:22.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.894+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:22.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.894+0000 7fa2e829e980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:22.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.894+0000 7fa2e829e980 20 searching for the correct realm 2024-04-03T04:02:22.880 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.898+0000 7fa2e55b8640 0 -- 172.21.15.104:0/1445581719 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fa2d802a060 msgr2=0x7fa2d8075ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:22.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:22.906+0000 7fa2e55b8640 0 -- 172.21.15.104:0/1445581719 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fa2e002bbc0 msgr2=0x7fa2e0064560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:23.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.122+0000 7fa2e829e980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:23.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.122+0000 7fa2e829e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:23.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.122+0000 7fa2e829e980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:23.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.122+0000 7fa2e829e980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:23.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.122+0000 7fa2e829e980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:23.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.122+0000 7fa2e829e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:23.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.122+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:23.107 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:23.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 zone default found 2024-04-03T04:02:23.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 4 Realm: () 2024-04-03T04:02:23.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:23.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:23.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:23.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 zonegroup default 2024-04-03T04:02:23.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.109 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 started sync module instance, tier type = 2024-04-03T04:02:23.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.126+0000 7fa2e829e980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:23.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.150+0000 7fa2e829e980 20 add_watcher() i=0 2024-04-03T04:02:23.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.150+0000 7fa2e829e980 20 add_watcher() i=1 2024-04-03T04:02:23.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.150+0000 7fa2e829e980 20 add_watcher() i=2 2024-04-03T04:02:23.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.150+0000 7fa2e829e980 20 add_watcher() i=3 2024-04-03T04:02:23.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.150+0000 7fa2e829e980 20 add_watcher() i=4 2024-04-03T04:02:23.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.150+0000 7fa2e829e980 20 add_watcher() i=5 2024-04-03T04:02:23.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.150+0000 7fa2e829e980 20 add_watcher() i=6 2024-04-03T04:02:23.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.154+0000 7fa2e829e980 20 add_watcher() i=7 2024-04-03T04:02:23.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.154+0000 7fa2e829e980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:23.140 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.158+0000 7fa19bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:23.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.158+0000 7fa2e829e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:23.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.158+0000 7fa2e829e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:23.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.158+0000 7fa2e829e980 5 note: GC not initialized 2024-04-03T04:02:23.141 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.158+0000 7fa19afe5640 20 reqs_thread_entry: start 2024-04-03T04:02:23.142 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.158+0000 7fa2e829e980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:23.142 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.158+0000 7fa2e829e980 20 Filter name: none 2024-04-03T04:02:23.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa198fe1640 20 reqs_thread_entry: start 2024-04-03T04:02:23.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-04-03T04:02:23.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:23.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-04-03T04:02:23.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-04-03T04:02:23.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 : miss 2024-04-03T04:02:23.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:23.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:23.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 10 adding default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:23.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:02:23.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:23.144 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.162+0000 7fa2e829e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 2024-04-03T04:02:23.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.174+0000 7fa2e829e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:23.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.174+0000 7fa2e829e980 10 moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:23.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.174+0000 7fa2e829e980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:23.155 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.174+0000 7fa2e829e980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18, ofs0, ns] 2024-04-03T04:02:23.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.174+0000 7fa1c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94738197963808 notifier 7098 bl.length()=783 2024-04-03T04:02:23.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.174+0000 7fa1c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:23.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.174+0000 7fa1c8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:23.156 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.174+0000 7fa1c8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:23.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.178+0000 7fa2e829e980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_sources= new_sources= 2024-04-03T04:02:23.158 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.178+0000 7fa2e829e980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential sources added=[] removed=[] 2024-04-03T04:02:23.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.178+0000 7fa2e829e980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_dests= new_dests= 2024-04-03T04:02:23.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.178+0000 7fa2e829e980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential dests added=[] removed=[] 2024-04-03T04:02:23.165 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.0 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.0 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.1 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.1 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.2 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.2 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.3 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.3 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.4 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.4 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.5 2024-04-03T04:02:23.166 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.5 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.6 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.6 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.7 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.7 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.8 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.8 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.9 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.9 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.10 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.10 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.11 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.11 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.0 2024-04-03T04:02:23.167 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.182+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1 2024-04-03T04:02:23.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.186+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2 2024-04-03T04:02:23.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.186+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3 2024-04-03T04:02:23.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.186+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.4 2024-04-03T04:02:23.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.190+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.5 2024-04-03T04:02:23.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.190+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.6 2024-04-03T04:02:23.173 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.190+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.7 2024-04-03T04:02:23.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.194+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.8 2024-04-03T04:02:23.174 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.194+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.9 2024-04-03T04:02:23.175 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.194+0000 7fa2e829e980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.10 2024-04-03T04:02:23.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.194+0000 7fa2e829e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 : hit (requested=0x17, cached=0x17) 2024-04-03T04:02:23.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.194+0000 7fa2e829e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 2024-04-03T04:02:23.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.198+0000 7fa2e829e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:23.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.198+0000 7fa2e829e980 10 moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:23.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.198+0000 7fa2e829e980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:23.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.198+0000 7fa2e829e980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18, ofs0, ns] 2024-04-03T04:02:23.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.198+0000 7fa1c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562396 cookie 94738197963808 notifier 7098 bl.length()=751 2024-04-03T04:02:23.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.198+0000 7fa1c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:23.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.198+0000 7fa1c8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:23.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.198+0000 7fa1c8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:23.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.202+0000 7fa2e829e980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_sources= new_sources= 2024-04-03T04:02:23.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.202+0000 7fa2e829e980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential sources added=[] removed=[] 2024-04-03T04:02:23.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.202+0000 7fa2e829e980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_dests= new_dests= 2024-04-03T04:02:23.183 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.202+0000 7fa2e829e980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential dests added=[] removed=[] 2024-04-03T04:02:23.189 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.206+0000 7fa2e829e980 1 execute INFO: reshard of bucket "myver" completed successfully 2024-04-03T04:02:23.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.210+0000 7fa19bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:23.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.214+0000 7fa2e829e980 20 remove_watcher() i=0 2024-04-03T04:02:23.198 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.214+0000 7fa2e829e980 2 removed watcher, disabling cache 2024-04-03T04:02:23.200 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.218+0000 7fa2e829e980 20 remove_watcher() i=1 2024-04-03T04:02:23.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.222+0000 7fa2e829e980 20 remove_watcher() i=2 2024-04-03T04:02:23.204 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.222+0000 7fa2e829e980 20 remove_watcher() i=3 2024-04-03T04:02:23.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.226+0000 7fa2e829e980 20 remove_watcher() i=4 2024-04-03T04:02:23.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.226+0000 7fa2e829e980 20 remove_watcher() i=5 2024-04-03T04:02:23.210 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.230+0000 7fa2e829e980 20 remove_watcher() i=6 2024-04-03T04:02:23.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.230+0000 7fa2e829e980 20 remove_watcher() i=7 2024-04-03T04:02:23.230 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket myver 2024-04-03T04:02:23.260 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:23.261 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:23.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.322+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.322+0000 7f1c77765980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.322+0000 7f1c77765980 20 realm 2024-04-03T04:02:23.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.322+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.322+0000 7f1c77765980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.322+0000 7f1c77765980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:23.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.322+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.326+0000 7f1c77765980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.326+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.326+0000 7f1c77765980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:23.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.326+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.326+0000 7f1c77765980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:23.309 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.326+0000 7f1c77765980 20 searching for the correct realm 2024-04-03T04:02:23.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.330+0000 7f1c75a81640 0 -- 172.21.15.104:0/2545161394 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f1c70050d50 msgr2=0x7f1c70069840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:23.320 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.338+0000 7f1c74a7f640 0 -- 172.21.15.104:0/2545161394 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f1c7007c930 msgr2=0x7f1c7006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:23.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.554+0000 7f1c77765980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:23.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.554+0000 7f1c77765980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:23.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.554+0000 7f1c77765980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:23.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.554+0000 7f1c77765980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:23.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.554+0000 7f1c77765980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:23.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.554+0000 7f1c77765980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:23.537 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.554+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.554+0000 7f1c77765980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.554+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:23.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:23.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 zone default found 2024-04-03T04:02:23.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 4 Realm: () 2024-04-03T04:02:23.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:23.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:23.539 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:23.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 zonegroup default 2024-04-03T04:02:23.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.540 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.541 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.541 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:23.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 started sync module instance, tier type = 2024-04-03T04:02:23.542 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.558+0000 7f1c77765980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:23.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.586+0000 7f1c77765980 20 add_watcher() i=0 2024-04-03T04:02:23.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.586+0000 7f1c77765980 20 add_watcher() i=1 2024-04-03T04:02:23.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.586+0000 7f1c77765980 20 add_watcher() i=2 2024-04-03T04:02:23.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.586+0000 7f1c77765980 20 add_watcher() i=3 2024-04-03T04:02:23.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.586+0000 7f1c77765980 20 add_watcher() i=4 2024-04-03T04:02:23.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.586+0000 7f1c77765980 20 add_watcher() i=5 2024-04-03T04:02:23.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.586+0000 7f1c77765980 20 add_watcher() i=6 2024-04-03T04:02:23.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.586+0000 7f1c77765980 20 add_watcher() i=7 2024-04-03T04:02:23.569 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.586+0000 7f1c77765980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:23.573 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.590+0000 7f1b2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:23.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.590+0000 7f1c77765980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:23.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.590+0000 7f1c77765980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:23.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.590+0000 7f1c77765980 5 note: GC not initialized 2024-04-03T04:02:23.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1b2a7e4640 20 reqs_thread_entry: start 2024-04-03T04:02:23.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:23.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 Filter name: none 2024-04-03T04:02:23.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1a9bfff640 20 reqs_thread_entry: start 2024-04-03T04:02:23.575 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:23.576 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:23.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:23.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:23.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.594+0000 7f1c77765980 20 rados->read ofs=0 len=0 2024-04-03T04:02:23.578 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.598+0000 7f1c77765980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:23.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.598+0000 7f1c77765980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:23.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.598+0000 7f1b2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:23.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.606+0000 7f1c77765980 20 remove_watcher() i=0 2024-04-03T04:02:23.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.606+0000 7f1c77765980 2 removed watcher, disabling cache 2024-04-03T04:02:23.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.606+0000 7f1c77765980 20 remove_watcher() i=1 2024-04-03T04:02:23.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.610+0000 7f1c77765980 20 remove_watcher() i=2 2024-04-03T04:02:23.593 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.610+0000 7f1c77765980 20 remove_watcher() i=3 2024-04-03T04:02:23.596 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.614+0000 7f1c77765980 20 remove_watcher() i=4 2024-04-03T04:02:23.597 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.614+0000 7f1c77765980 20 remove_watcher() i=5 2024-04-03T04:02:23.599 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.618+0000 7f1c77765980 20 remove_watcher() i=6 2024-04-03T04:02:23.601 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:23.618+0000 7f1c77765980 20 remove_watcher() i=7 2024-04-03T04:02:23.617 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:23.617 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:02:23.617 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: myver id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-04-03T04:02:23.618 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:23.619 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:23.619 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:23.640 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:23.640 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:23.694 INFO:tasks.workunit.client.0.smithi104.stderr: test: reshard removes olh entries with empty name 2024-04-03T04:02:23.697 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:23.697 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:23.800 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:23.800 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:24.067 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-04-03T04:02:24.099 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:24.099 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:24.143 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.162+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.162+0000 7fcadc78f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.162+0000 7fcadc78f980 20 realm 2024-04-03T04:02:24.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.162+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.162+0000 7fcadc78f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.162+0000 7fcadc78f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:24.145 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.162+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.162+0000 7fcadc78f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.146 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.162+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.166+0000 7fcadc78f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:24.147 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.166+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.166+0000 7fcadc78f980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:24.148 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.166+0000 7fcadc78f980 20 searching for the correct realm 2024-04-03T04:02:24.153 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.170+0000 7fcada2aa640 0 -- 172.21.15.104:0/2698655245 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x556016c75040 msgr2=0x556016c77500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:24.159 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.178+0000 7fcad9aa9640 0 -- 172.21.15.104:0/2698655245 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fcad4048bc0 msgr2=0x7fcad4058410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:02:24.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:24.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:24.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:24.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:24.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:24.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:24.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:24.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:24.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 zone default found 2024-04-03T04:02:24.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 4 Realm: () 2024-04-03T04:02:24.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:24.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:24.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:24.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 zonegroup default 2024-04-03T04:02:24.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.186+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.190+0000 7fcadc78f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.190+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.190+0000 7fcadc78f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.190+0000 7fcadc78f980 20 started sync module instance, tier type = 2024-04-03T04:02:24.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.190+0000 7fcadc78f980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:24.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.202+0000 7fcadc78f980 20 add_watcher() i=0 2024-04-03T04:02:24.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.202+0000 7fcadc78f980 20 add_watcher() i=1 2024-04-03T04:02:24.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.202+0000 7fcadc78f980 20 add_watcher() i=2 2024-04-03T04:02:24.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.202+0000 7fcadc78f980 20 add_watcher() i=3 2024-04-03T04:02:24.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.202+0000 7fcadc78f980 20 add_watcher() i=4 2024-04-03T04:02:24.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.202+0000 7fcadc78f980 20 add_watcher() i=5 2024-04-03T04:02:24.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.202+0000 7fcadc78f980 20 add_watcher() i=6 2024-04-03T04:02:24.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.206+0000 7fcadc78f980 20 add_watcher() i=7 2024-04-03T04:02:24.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.206+0000 7fcadc78f980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:24.189 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.206+0000 7fc990fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:24.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.206+0000 7fcadc78f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:24.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.206+0000 7fcadc78f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:24.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.206+0000 7fcadc78f980 5 note: GC not initialized 2024-04-03T04:02:24.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fc90b7fe640 20 reqs_thread_entry: start 2024-04-03T04:02:24.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:24.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 Filter name: none 2024-04-03T04:02:24.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fc9097fa640 20 reqs_thread_entry: start 2024-04-03T04:02:24.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T04:02:24.191 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T04:02:24.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:24.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T04:02:24.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.210+0000 7fcadc78f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.214+0000 7fcadc78f980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T04:02:24.194 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.214+0000 7fcadc78f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:24.197 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.214+0000 7fc990fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:24.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.222+0000 7fcadc78f980 20 remove_watcher() i=0 2024-04-03T04:02:24.202 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.222+0000 7fcadc78f980 2 removed watcher, disabling cache 2024-04-03T04:02:24.205 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.222+0000 7fcadc78f980 20 remove_watcher() i=1 2024-04-03T04:02:24.207 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.226+0000 7fcadc78f980 20 remove_watcher() i=2 2024-04-03T04:02:24.209 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.226+0000 7fcadc78f980 20 remove_watcher() i=3 2024-04-03T04:02:24.211 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.230+0000 7fcadc78f980 20 remove_watcher() i=4 2024-04-03T04:02:24.212 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.230+0000 7fcadc78f980 20 remove_watcher() i=5 2024-04-03T04:02:24.214 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.230+0000 7fcadc78f980 20 remove_watcher() i=6 2024-04-03T04:02:24.215 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.234+0000 7fcadc78f980 20 remove_watcher() i=7 2024-04-03T04:02:24.228 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:24.228 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:02:24.229 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: a-bucket id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-04-03T04:02:24.229 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:24.229 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-04-03T04:02:24.255 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:24.255 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:24.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.314+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 realm 2024-04-03T04:02:24.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:24.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:24.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.318+0000 7f6b87369980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:24.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.322+0000 7f6b87369980 20 searching for the correct realm 2024-04-03T04:02:24.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.326+0000 7f6b85685640 0 -- 172.21.15.104:0/870131879 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f6b80018070 msgr2=0x7f6b80081030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:24.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.330+0000 7f6b7ffff640 0 -- 172.21.15.104:0/870131879 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f6b80024760 msgr2=0x7f6b8002d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:24.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:24.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:24.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:24.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:24.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:24.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:24.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:24.529 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:24.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 zone default found 2024-04-03T04:02:24.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 4 Realm: () 2024-04-03T04:02:24.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:24.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:24.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:24.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 zonegroup default 2024-04-03T04:02:24.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.546+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.550+0000 7f6b87369980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.550+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.550+0000 7f6b87369980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.550+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.550+0000 7f6b87369980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.550+0000 7f6b87369980 20 started sync module instance, tier type = 2024-04-03T04:02:24.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.550+0000 7f6b87369980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:24.555 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.574+0000 7f6b87369980 20 add_watcher() i=0 2024-04-03T04:02:24.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.574+0000 7f6b87369980 20 add_watcher() i=1 2024-04-03T04:02:24.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.574+0000 7f6b87369980 20 add_watcher() i=2 2024-04-03T04:02:24.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.574+0000 7f6b87369980 20 add_watcher() i=3 2024-04-03T04:02:24.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.574+0000 7f6b87369980 20 add_watcher() i=4 2024-04-03T04:02:24.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.574+0000 7f6b87369980 20 add_watcher() i=5 2024-04-03T04:02:24.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.574+0000 7f6b87369980 20 add_watcher() i=6 2024-04-03T04:02:24.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.574+0000 7f6b87369980 20 add_watcher() i=7 2024-04-03T04:02:24.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.574+0000 7f6b87369980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:24.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.578+0000 7f6a3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:24.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f6b87369980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:24.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f6b87369980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:24.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f6b87369980 5 note: GC not initialized 2024-04-03T04:02:24.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f6a39fe3640 20 reqs_thread_entry: start 2024-04-03T04:02:24.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f6b87369980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:24.563 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f6b87369980 20 Filter name: none 2024-04-03T04:02:24.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f69ab7fe640 20 reqs_thread_entry: start 2024-04-03T04:02:24.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f6b87369980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T04:02:24.565 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.582+0000 7f6b87369980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.586+0000 7f6b87369980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T04:02:24.566 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.586+0000 7f6b87369980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:24.567 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.586+0000 7f6a3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:24.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.590+0000 7f6b87369980 20 remove_watcher() i=0 2024-04-03T04:02:24.572 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.590+0000 7f6b87369980 2 removed watcher, disabling cache 2024-04-03T04:02:24.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.594+0000 7f6b87369980 20 remove_watcher() i=1 2024-04-03T04:02:24.577 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.594+0000 7f6b87369980 20 remove_watcher() i=2 2024-04-03T04:02:24.579 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.598+0000 7f6b87369980 20 remove_watcher() i=3 2024-04-03T04:02:24.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.598+0000 7f6b87369980 20 remove_watcher() i=4 2024-04-03T04:02:24.583 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.602+0000 7f6b87369980 20 remove_watcher() i=5 2024-04-03T04:02:24.585 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.602+0000 7f6b87369980 20 remove_watcher() i=6 2024-04-03T04:02:24.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.606+0000 7f6b87369980 20 remove_watcher() i=7 2024-04-03T04:02:24.601 INFO:tasks.workunit.client.0.smithi104.stderr:rados -p default.rgw.buckets.index setomapval .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-04-03T04:02:24.630 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:24.630 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:24.648 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket a-bucket 2024-04-03T04:02:24.673 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:24.673 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:24.715 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.734+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.734+0000 7f5e4b34c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.734+0000 7f5e4b34c980 20 realm 2024-04-03T04:02:24.717 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.734+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.734+0000 7f5e4b34c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.734+0000 7f5e4b34c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:24.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.734+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.738+0000 7f5e4b34c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.718 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.738+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.738+0000 7f5e4b34c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:24.719 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.738+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.720 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.738+0000 7f5e4b34c980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:24.720 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.738+0000 7f5e4b34c980 20 searching for the correct realm 2024-04-03T04:02:24.724 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.742+0000 7f5e49668640 0 -- 172.21.15.104:0/3376438623 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f5e44018040 msgr2=0x7f5e4405a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:24.731 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.750+0000 7f5e43fff640 0 -- 172.21.15.104:0/3376438623 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f5e44060610 msgr2=0x7f5e44060a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:24.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:24.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:24.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:24.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:24.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:24.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:24.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:24.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.949 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:24.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 zone default found 2024-04-03T04:02:24.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 4 Realm: () 2024-04-03T04:02:24.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:24.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:24.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:24.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 zonegroup default 2024-04-03T04:02:24.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.950 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.966+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.970+0000 7f5e4b34c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.970+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.970+0000 7f5e4b34c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:24.951 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.970+0000 7f5e4b34c980 20 started sync module instance, tier type = 2024-04-03T04:02:24.952 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.970+0000 7f5e4b34c980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:24.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.994+0000 7f5e4b34c980 20 add_watcher() i=0 2024-04-03T04:02:24.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.994+0000 7f5e4b34c980 20 add_watcher() i=1 2024-04-03T04:02:24.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.994+0000 7f5e4b34c980 20 add_watcher() i=2 2024-04-03T04:02:24.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.994+0000 7f5e4b34c980 20 add_watcher() i=3 2024-04-03T04:02:24.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.994+0000 7f5e4b34c980 20 add_watcher() i=4 2024-04-03T04:02:24.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.994+0000 7f5e4b34c980 20 add_watcher() i=5 2024-04-03T04:02:24.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.994+0000 7f5e4b34c980 20 add_watcher() i=6 2024-04-03T04:02:24.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.998+0000 7f5e4b34c980 20 add_watcher() i=7 2024-04-03T04:02:24.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:24.998+0000 7f5e4b34c980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:24.982 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5cff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:24.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5e4b34c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:24.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5e4b34c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:24.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5e4b34c980 5 note: GC not initialized 2024-04-03T04:02:24.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5cfe7e4640 20 reqs_thread_entry: start 2024-04-03T04:02:24.984 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5e4b34c980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:24.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5e4b34c980 20 Filter name: none 2024-04-03T04:02:24.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5cf77fe640 20 reqs_thread_entry: start 2024-04-03T04:02:24.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5e4b34c980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T04:02:24.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.002+0000 7f5e4b34c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:24.986 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T04:02:24.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:24.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-04-03T04:02:24.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 INFO: main: starting shard=0 2024-04-03T04:02:24.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.0 2024-04-03T04:02:24.987 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.0 2024-04-03T04:02:24.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-04-03T04:02:24.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 INFO: main: starting shard=1 2024-04-03T04:02:24.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.1 2024-04-03T04:02:24.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.1 2024-04-03T04:02:24.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 INFO: main: starting shard=2 2024-04-03T04:02:24.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.2 2024-04-03T04:02:24.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.2 2024-04-03T04:02:24.989 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.989 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 INFO: main: starting shard=3 2024-04-03T04:02:24.989 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.3 2024-04-03T04:02:24.989 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.006+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.3 2024-04-03T04:02:24.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 INFO: main: starting shard=4 2024-04-03T04:02:24.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.4 2024-04-03T04:02:24.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.4 2024-04-03T04:02:24.991 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 INFO: main: starting shard=5 2024-04-03T04:02:24.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.5 2024-04-03T04:02:24.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.5 2024-04-03T04:02:24.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 INFO: main: starting shard=6 2024-04-03T04:02:24.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.6 2024-04-03T04:02:24.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.6 2024-04-03T04:02:24.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 INFO: main: starting shard=7 2024-04-03T04:02:24.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.7 2024-04-03T04:02:24.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.010+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.7 2024-04-03T04:02:24.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 20 INFO: main: starting shard=8 2024-04-03T04:02:24.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.8 2024-04-03T04:02:24.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.8 2024-04-03T04:02:24.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 20 INFO: main: starting shard=9 2024-04-03T04:02:24.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.9 2024-04-03T04:02:24.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.9 2024-04-03T04:02:24.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 20 INFO: main: starting shard=10 2024-04-03T04:02:24.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.10 2024-04-03T04:02:24.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.014+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.10 2024-04-03T04:02:24.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:24.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 20 INFO: main: starting shard=11 2024-04-03T04:02:24.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.11 2024-04-03T04:02:24.999 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.11 2024-04-03T04:02:25.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:25.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 20 INFO: main: starting shard=12 2024-04-03T04:02:25.000 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.12 2024-04-03T04:02:25.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.12 2024-04-03T04:02:25.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:25.001 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.018+0000 7f5e4b34c980 20 INFO: main: done 2024-04-03T04:02:25.002 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.022+0000 7f5cff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:25.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.026+0000 7f5e4b34c980 20 remove_watcher() i=0 2024-04-03T04:02:25.007 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.026+0000 7f5e4b34c980 2 removed watcher, disabling cache 2024-04-03T04:02:25.009 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.026+0000 7f5e4b34c980 20 remove_watcher() i=1 2024-04-03T04:02:25.012 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.030+0000 7f5e4b34c980 20 remove_watcher() i=2 2024-04-03T04:02:25.014 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.034+0000 7f5e4b34c980 20 remove_watcher() i=3 2024-04-03T04:02:25.016 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.034+0000 7f5e4b34c980 20 remove_watcher() i=4 2024-04-03T04:02:25.018 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.034+0000 7f5e4b34c980 20 remove_watcher() i=5 2024-04-03T04:02:25.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.038+0000 7f5e4b34c980 20 remove_watcher() i=6 2024-04-03T04:02:25.021 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.038+0000 7f5e4b34c980 20 remove_watcher() i=7 2024-04-03T04:02:25.038 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-04-03T04:02:25.072 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:25.072 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:25.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.134+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.134+0000 7fd3c5016980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.134+0000 7fd3c5016980 20 realm 2024-04-03T04:02:25.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.134+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.134+0000 7fd3c5016980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.134+0000 7fd3c5016980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:25.117 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.134+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.134+0000 7fd3c5016980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.134+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.138+0000 7fd3c5016980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:25.119 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.138+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.138+0000 7fd3c5016980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:25.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.138+0000 7fd3c5016980 20 searching for the correct realm 2024-04-03T04:02:25.123 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.142+0000 7fd3c3332640 0 -- 172.21.15.104:0/3468997993 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fd3bc0e0040 msgr2=0x7fd3bc0e3a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:02:25.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.358+0000 7fd3c2330640 0 -- 172.21.15.104:0/3468997993 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fd3bc0c2040 msgr2=0x7fd3bc0e0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:25.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.574+0000 7fd3c5016980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:25.557 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.574+0000 7fd3c5016980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.574+0000 7fd3c5016980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.574+0000 7fd3c5016980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.574+0000 7fd3c5016980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.574+0000 7fd3c5016980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.574+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.574+0000 7fd3c5016980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.558 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.574+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:25.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:25.559 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 zone default found 2024-04-03T04:02:25.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 4 Realm: () 2024-04-03T04:02:25.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:25.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:25.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:25.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 zonegroup default 2024-04-03T04:02:25.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.560 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.561 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 started sync module instance, tier type = 2024-04-03T04:02:25.562 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.578+0000 7fd3c5016980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:25.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.598+0000 7fd3c5016980 20 add_watcher() i=0 2024-04-03T04:02:25.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.598+0000 7fd3c5016980 20 add_watcher() i=1 2024-04-03T04:02:25.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.598+0000 7fd3c5016980 20 add_watcher() i=2 2024-04-03T04:02:25.581 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.598+0000 7fd3c5016980 20 add_watcher() i=3 2024-04-03T04:02:25.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.598+0000 7fd3c5016980 20 add_watcher() i=4 2024-04-03T04:02:25.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.598+0000 7fd3c5016980 20 add_watcher() i=5 2024-04-03T04:02:25.582 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.602+0000 7fd3c5016980 20 add_watcher() i=6 2024-04-03T04:02:25.583 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.602+0000 7fd3c5016980 20 add_watcher() i=7 2024-04-03T04:02:25.583 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.602+0000 7fd3c5016980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:25.586 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd2797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:25.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:25.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:25.587 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 5 note: GC not initialized 2024-04-03T04:02:25.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd1f3fff640 20 reqs_thread_entry: start 2024-04-03T04:02:25.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:25.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 20 Filter name: none 2024-04-03T04:02:25.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd1f1ffb640 20 reqs_thread_entry: start 2024-04-03T04:02:25.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-04-03T04:02:25.588 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T04:02:25.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-04-03T04:02:25.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-04-03T04:02:25.589 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 : miss 2024-04-03T04:02:25.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.606+0000 7fd3c5016980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.590 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.610+0000 7fd3c5016980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T04:02:25.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.610+0000 7fd3c5016980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T04:02:25.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.610+0000 7fd3c5016980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T04:02:25.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.610+0000 7fd3c5016980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:02:25.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.610+0000 7fd3c5016980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:25.591 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.610+0000 7fd3c5016980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 2024-04-03T04:02:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.614+0000 7fd3c5016980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T04:02:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.614+0000 7fd3c5016980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T04:02:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.614+0000 7fd3c5016980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.614+0000 7fd3c5016980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17, ofs0, ns] 2024-04-03T04:02:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.618+0000 7fd2a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562462 cookie 94344177085312 notifier 7206 bl.length()=789 2024-04-03T04:02:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.618+0000 7fd2a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T04:02:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.618+0000 7fd2a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T04:02:25.598 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.618+0000 7fd2a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:25.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.618+0000 7fd3c5016980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_sources= new_sources= 2024-04-03T04:02:25.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.618+0000 7fd3c5016980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential sources added=[] removed=[] 2024-04-03T04:02:25.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.618+0000 7fd3c5016980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_dests= new_dests= 2024-04-03T04:02:25.600 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.618+0000 7fd3c5016980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential dests added=[] removed=[] 2024-04-03T04:02:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.626+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.3.0 2024-04-03T04:02:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.626+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.3.0 2024-04-03T04:02:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.626+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.0 2024-04-03T04:02:25.608 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.626+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.0 2024-04-03T04:02:25.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.626+0000 7fd3c5016980 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-04-03T04:02:25.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.626+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.1 2024-04-03T04:02:25.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.626+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.1 2024-04-03T04:02:25.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.626+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.2 2024-04-03T04:02:25.609 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.626+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.2 2024-04-03T04:02:25.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.630+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.3 2024-04-03T04:02:25.611 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.630+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.3 2024-04-03T04:02:25.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.630+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.4 2024-04-03T04:02:25.612 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.630+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.4 2024-04-03T04:02:25.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.630+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.5 2024-04-03T04:02:25.613 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.630+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.5 2024-04-03T04:02:25.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.634+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.6 2024-04-03T04:02:25.615 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.634+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.6 2024-04-03T04:02:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.634+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.7 2024-04-03T04:02:25.616 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.634+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.7 2024-04-03T04:02:25.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.634+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.8 2024-04-03T04:02:25.617 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.634+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.8 2024-04-03T04:02:25.618 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.638+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.9 2024-04-03T04:02:25.619 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.638+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.9 2024-04-03T04:02:25.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.638+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.10 2024-04-03T04:02:25.620 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.638+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.10 2024-04-03T04:02:25.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.638+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.11 2024-04-03T04:02:25.621 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.638+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.11 2024-04-03T04:02:25.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.642+0000 7fd3c5016980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.12 2024-04-03T04:02:25.622 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.642+0000 7fd3c5016980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.2.12 2024-04-03T04:02:25.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.642+0000 7fd3c5016980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 : hit (requested=0x17, cached=0x17) 2024-04-03T04:02:25.623 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.642+0000 7fd3c5016980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 2024-04-03T04:02:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd3c5016980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T04:02:25.626 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd3c5016980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T04:02:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd3c5016980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd3c5016980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17, ofs0, ns] 2024-04-03T04:02:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd2a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562463 cookie 94344177085312 notifier 7206 bl.length()=757 2024-04-03T04:02:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd2a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 info.flags=0x17 2024-04-03T04:02:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd2a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17 to cache LRU end 2024-04-03T04:02:25.627 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd2a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:25.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd3c5016980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_sources= new_sources= 2024-04-03T04:02:25.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd3c5016980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential sources added=[] removed=[] 2024-04-03T04:02:25.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd3c5016980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): orig_dests= new_dests= 2024-04-03T04:02:25.629 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.646+0000 7fd3c5016980 20 handle_bi_update(): bucket=:a-bucket[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17]): potential dests added=[] removed=[] 2024-04-03T04:02:25.636 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.654+0000 7fd3c5016980 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-04-03T04:02:25.639 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.658+0000 7fd2797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:25.644 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.662+0000 7fd3c5016980 20 remove_watcher() i=0 2024-04-03T04:02:25.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.662+0000 7fd3c5016980 2 removed watcher, disabling cache 2024-04-03T04:02:25.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.666+0000 7fd3c5016980 20 remove_watcher() i=1 2024-04-03T04:02:25.649 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.666+0000 7fd3c5016980 20 remove_watcher() i=2 2024-04-03T04:02:25.651 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.670+0000 7fd3c5016980 20 remove_watcher() i=3 2024-04-03T04:02:25.653 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.670+0000 7fd3c5016980 20 remove_watcher() i=4 2024-04-03T04:02:25.654 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.674+0000 7fd3c5016980 20 remove_watcher() i=5 2024-04-03T04:02:25.656 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.674+0000 7fd3c5016980 20 remove_watcher() i=6 2024-04-03T04:02:25.657 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.674+0000 7fd3c5016980 20 remove_watcher() i=7 2024-04-03T04:02:25.674 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket a-bucket 2024-04-03T04:02:25.704 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:25.704 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:25.746 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.766+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.766+0000 7fc2bd8f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.766+0000 7fc2bd8f8980 20 realm 2024-04-03T04:02:25.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.766+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.766+0000 7fc2bd8f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.766+0000 7fc2bd8f8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:25.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.766+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.766+0000 7fc2bd8f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.766+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.770+0000 7fc2bd8f8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:25.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.770+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.770+0000 7fc2bd8f8980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:25.751 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.770+0000 7fc2bd8f8980 20 searching for the correct realm 2024-04-03T04:02:25.757 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.774+0000 7fc2bb413640 0 -- 172.21.15.104:0/2153028181 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x561165ca7470 msgr2=0x561165ca9930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:25.763 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.782+0000 7fc2bac12640 0 -- 172.21.15.104:0/2153028181 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fc2b40d8730 msgr2=0x7fc2b40c0980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:25.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:25.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:25.772 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:25.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:25.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:25.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:25.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.773 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:25.774 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.790+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 zone default found 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 4 Realm: () 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 zonegroup default 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.775 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 started sync module instance, tier type = 2024-04-03T04:02:25.776 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.794+0000 7fc2bd8f8980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:25.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.810+0000 7fc2bd8f8980 20 add_watcher() i=0 2024-04-03T04:02:25.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.810+0000 7fc2bd8f8980 20 add_watcher() i=1 2024-04-03T04:02:25.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.810+0000 7fc2bd8f8980 20 add_watcher() i=2 2024-04-03T04:02:25.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.810+0000 7fc2bd8f8980 20 add_watcher() i=3 2024-04-03T04:02:25.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.810+0000 7fc2bd8f8980 20 add_watcher() i=4 2024-04-03T04:02:25.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.810+0000 7fc2bd8f8980 20 add_watcher() i=5 2024-04-03T04:02:25.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.810+0000 7fc2bd8f8980 20 add_watcher() i=6 2024-04-03T04:02:25.791 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.810+0000 7fc2bd8f8980 20 add_watcher() i=7 2024-04-03T04:02:25.792 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.810+0000 7fc2bd8f8980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:25.794 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc171fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:25.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:25.795 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:25.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 5 note: GC not initialized 2024-04-03T04:02:25.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc170fe1640 20 reqs_thread_entry: start 2024-04-03T04:02:25.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:25.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 Filter name: none 2024-04-03T04:02:25.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc0ea7fc640 20 reqs_thread_entry: start 2024-04-03T04:02:25.796 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 rados_obj.operate() r=0 bl.length=176 2024-04-03T04:02:25.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 rados_obj.operate() r=0 bl.length=360 2024-04-03T04:02:25.797 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:25.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-04-03T04:02:25.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 INFO: main: starting shard=0 2024-04-03T04:02:25.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.3.0 2024-04-03T04:02:25.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.814+0000 7fc2bd8f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17.3.0 2024-04-03T04:02:25.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.818+0000 7fc2bd8f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:25.798 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.818+0000 7fc2bd8f8980 20 INFO: main: done 2024-04-03T04:02:25.799 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.818+0000 7fc171fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:25.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.822+0000 7fc2bd8f8980 20 remove_watcher() i=0 2024-04-03T04:02:25.804 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.822+0000 7fc2bd8f8980 2 removed watcher, disabling cache 2024-04-03T04:02:25.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.826+0000 7fc2bd8f8980 20 remove_watcher() i=1 2024-04-03T04:02:25.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.826+0000 7fc2bd8f8980 20 remove_watcher() i=2 2024-04-03T04:02:25.810 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.830+0000 7fc2bd8f8980 20 remove_watcher() i=3 2024-04-03T04:02:25.812 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.830+0000 7fc2bd8f8980 20 remove_watcher() i=4 2024-04-03T04:02:25.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.830+0000 7fc2bd8f8980 20 remove_watcher() i=5 2024-04-03T04:02:25.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.834+0000 7fc2bd8f8980 20 remove_watcher() i=6 2024-04-03T04:02:25.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.834+0000 7fc2bd8f8980 20 remove_watcher() i=7 2024-04-03T04:02:25.830 INFO:tasks.workunit.client.0.smithi104.stderr: test: PUT succeeds during reshard 2024-04-03T04:02:25.830 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket myver 2024-04-03T04:02:25.856 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:25.856 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:25.900 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.918+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 realm 2024-04-03T04:02:25.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:25.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:25.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:25.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:25.905 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:25.906 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.922+0000 7f976b950980 20 searching for the correct realm 2024-04-03T04:02:25.910 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.930+0000 7f9768c6a640 0 -- 172.21.15.104:0/3044561407 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f975c0cf3f0 msgr2=0x7f975c0cf870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:25.916 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:25.934+0000 7f9768c6a640 0 -- 172.21.15.104:0/3044561407 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f976407b770 msgr2=0x7f9764067760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:26.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:26.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:26.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:26.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:26.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:26.132 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:26.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.133 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:26.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.150+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:26.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 zone default found 2024-04-03T04:02:26.134 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 4 Realm: () 2024-04-03T04:02:26.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:26.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:26.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:26.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 zonegroup default 2024-04-03T04:02:26.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.135 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.136 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 started sync module instance, tier type = 2024-04-03T04:02:26.137 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.154+0000 7f976b950980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:26.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.178+0000 7f976b950980 20 add_watcher() i=0 2024-04-03T04:02:26.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.178+0000 7f976b950980 20 add_watcher() i=1 2024-04-03T04:02:26.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.178+0000 7f976b950980 20 add_watcher() i=2 2024-04-03T04:02:26.162 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.178+0000 7f976b950980 20 add_watcher() i=3 2024-04-03T04:02:26.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.178+0000 7f976b950980 20 add_watcher() i=4 2024-04-03T04:02:26.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.178+0000 7f976b950980 20 add_watcher() i=5 2024-04-03T04:02:26.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.178+0000 7f976b950980 20 add_watcher() i=6 2024-04-03T04:02:26.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.182+0000 7f976b950980 20 add_watcher() i=7 2024-04-03T04:02:26.163 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.182+0000 7f976b950980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:26.168 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.186+0000 7f961f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:26.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.186+0000 7f976b950980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:26.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.186+0000 7f976b950980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:26.169 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.186+0000 7f976b950980 5 note: GC not initialized 2024-04-03T04:02:26.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.186+0000 7f961e7e4640 20 reqs_thread_entry: start 2024-04-03T04:02:26.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.186+0000 7f976b950980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:26.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.186+0000 7f976b950980 20 Filter name: none 2024-04-03T04:02:26.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.186+0000 7f958ffff640 20 reqs_thread_entry: start 2024-04-03T04:02:26.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.170 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:26.171 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:26.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:26.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:26.172 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.173 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:26.173 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.190+0000 7f976b950980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:26.176 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.194+0000 7f961f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:26.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.198+0000 7f976b950980 20 remove_watcher() i=0 2024-04-03T04:02:26.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.198+0000 7f976b950980 2 removed watcher, disabling cache 2024-04-03T04:02:26.184 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.202+0000 7f976b950980 20 remove_watcher() i=1 2024-04-03T04:02:26.186 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.206+0000 7f976b950980 20 remove_watcher() i=2 2024-04-03T04:02:26.188 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.206+0000 7f976b950980 20 remove_watcher() i=3 2024-04-03T04:02:26.190 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.210+0000 7f976b950980 20 remove_watcher() i=4 2024-04-03T04:02:26.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.210+0000 7f976b950980 20 remove_watcher() i=5 2024-04-03T04:02:26.193 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.210+0000 7f976b950980 20 remove_watcher() i=6 2024-04-03T04:02:26.195 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.214+0000 7f976b950980 20 remove_watcher() i=7 2024-04-03T04:02:26.216 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:26.217 INFO:tasks.workunit.client.0.smithi104.stderr:BUCKET_STATS: 2024-04-03T04:02:26.217 INFO:tasks.workunit.client.0.smithi104.stderr:bucket: myver id: 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-04-03T04:02:26.217 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:26.217 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-04-03T04:02:26.252 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:26.252 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:26.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.522+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.522+0000 7f12c0b9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.522+0000 7f12c0b9f980 20 realm 2024-04-03T04:02:26.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.522+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.522+0000 7f12c0b9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.522+0000 7f12c0b9f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:26.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.522+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.522+0000 7f12c0b9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.522+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.526+0000 7f12c0b9f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:26.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.526+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.526+0000 7f12c0b9f980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:26.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.526+0000 7f12c0b9f980 20 searching for the correct realm 2024-04-03T04:02:26.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.530+0000 7f12beebb640 0 -- 172.21.15.104:0/1880847516 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f12b8029040 msgr2=0x7f12b8039510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:02:26.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.946+0000 7f12b7fff640 0 -- 172.21.15.104:0/1880847516 >> [v2:172.21.15.130:6805/2542797043,v1:172.21.15.130:6808/2542797043] conn(0x55f02b1083a0 msgr2=0x55f02b10a7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:26.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:26.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:26.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:26.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:26.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:26.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:26.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.943 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:26.944 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:26.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 zone default found 2024-04-03T04:02:26.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 4 Realm: () 2024-04-03T04:02:26.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:26.945 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:26.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:26.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 zonegroup default 2024-04-03T04:02:26.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.946 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.962+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.966+0000 7f12c0b9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.966+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.947 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.966+0000 7f12c0b9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:26.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.966+0000 7f12c0b9f980 20 started sync module instance, tier type = 2024-04-03T04:02:26.948 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.966+0000 7f12c0b9f980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:26.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.986+0000 7f12c0b9f980 20 add_watcher() i=0 2024-04-03T04:02:26.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.986+0000 7f12c0b9f980 20 add_watcher() i=1 2024-04-03T04:02:26.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.986+0000 7f12c0b9f980 20 add_watcher() i=2 2024-04-03T04:02:26.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.986+0000 7f12c0b9f980 20 add_watcher() i=3 2024-04-03T04:02:26.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.986+0000 7f12c0b9f980 20 add_watcher() i=4 2024-04-03T04:02:26.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.986+0000 7f12c0b9f980 20 add_watcher() i=5 2024-04-03T04:02:26.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.986+0000 7f12c0b9f980 20 add_watcher() i=6 2024-04-03T04:02:26.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.990+0000 7f12c0b9f980 20 add_watcher() i=7 2024-04-03T04:02:26.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.990+0000 7f12c0b9f980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:26.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.994+0000 7f1174fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:26.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.994+0000 7f12c0b9f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:26.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.994+0000 7f12c0b9f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:26.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.994+0000 7f12c0b9f980 5 note: GC not initialized 2024-04-03T04:02:26.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.994+0000 7f10ef7fe640 20 reqs_thread_entry: start 2024-04-03T04:02:26.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.994+0000 7f12c0b9f980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:26.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.994+0000 7f12c0b9f980 20 Filter name: none 2024-04-03T04:02:26.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f10ed7fa640 20 reqs_thread_entry: start 2024-04-03T04:02:26.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-04-03T04:02:26.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:26.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-04-03T04:02:26.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-04-03T04:02:26.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 : miss 2024-04-03T04:02:26.979 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 20 rados->read ofs=0 len=0 2024-04-03T04:02:26.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:26.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:26.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 10 adding default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:26.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:02:26.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:26.980 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:26.998+0000 7f12c0b9f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 2024-04-03T04:02:26.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.010+0000 7f12c0b9f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:26.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.010+0000 7f12c0b9f980 10 moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:26.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.010+0000 7f12c0b9f980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:26.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.010+0000 7f12c0b9f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18, ofs0, ns] 2024-04-03T04:02:26.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.010+0000 7f11a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 94490003074224 notifier 6821 bl.length()=783 2024-04-03T04:02:26.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.010+0000 7f11a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:26.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.010+0000 7f11a1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:26.993 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.010+0000 7f11a1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:26.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.014+0000 7f12c0b9f980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_sources= new_sources= 2024-04-03T04:02:26.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.014+0000 7f12c0b9f980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential sources added=[] removed=[] 2024-04-03T04:02:26.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.014+0000 7f12c0b9f980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_dests= new_dests= 2024-04-03T04:02:26.996 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.014+0000 7f12c0b9f980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential dests added=[] removed=[] 2024-04-03T04:02:27.029 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:27.050+0000 7f12c0b9f980 -1 Injecting delay=5.000000000s at location=do_reshard 2024-04-03T04:02:27.222 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:27.222 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:32.030 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:32.031 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:32.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:32.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:32.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.0 2024-04-03T04:02:32.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.050+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.0 2024-04-03T04:02:32.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.054+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.1 2024-04-03T04:02:32.032 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.054+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.1 2024-04-03T04:02:32.033 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.054+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.2 2024-04-03T04:02:32.033 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.054+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.2 2024-04-03T04:02:32.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.058+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.3 2024-04-03T04:02:32.034 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.058+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.3 2024-04-03T04:02:32.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.058+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.4 2024-04-03T04:02:32.035 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.058+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.4 2024-04-03T04:02:32.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.058+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.5 2024-04-03T04:02:32.036 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.058+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.5 2024-04-03T04:02:32.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.062+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.6 2024-04-03T04:02:32.038 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.062+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.6 2024-04-03T04:02:32.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.062+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.7 2024-04-03T04:02:32.039 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.062+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.7 2024-04-03T04:02:32.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.062+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.8 2024-04-03T04:02:32.041 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.062+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.8 2024-04-03T04:02:32.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.066+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.9 2024-04-03T04:02:32.042 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.066+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.9 2024-04-03T04:02:32.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.066+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.10 2024-04-03T04:02:32.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.066+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.10 2024-04-03T04:02:32.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.066+0000 7f12c0b9f980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.11 2024-04-03T04:02:32.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.066+0000 7f12c0b9f980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.1.11 2024-04-03T04:02:32.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.070+0000 7f12c0b9f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 : hit (requested=0x17, cached=0x17) 2024-04-03T04:02:32.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.070+0000 7f12c0b9f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 2024-04-03T04:02:32.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.074+0000 7f12c0b9f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:32.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.074+0000 7f12c0b9f980 10 moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:32.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.074+0000 7f12c0b9f980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:32.050 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.074+0000 7f12c0b9f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18, ofs0, ns] 2024-04-03T04:02:32.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.074+0000 7f11a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94490003074224 notifier 6821 bl.length()=751 2024-04-03T04:02:32.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.074+0000 7f11a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:32.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.074+0000 7f11a1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:32.051 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.074+0000 7f11a1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:32.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.078+0000 7f12c0b9f980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_sources= new_sources= 2024-04-03T04:02:32.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.078+0000 7f12c0b9f980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential sources added=[] removed=[] 2024-04-03T04:02:32.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.078+0000 7f12c0b9f980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_dests= new_dests= 2024-04-03T04:02:32.056 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.078+0000 7f12c0b9f980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential dests added=[] removed=[] 2024-04-03T04:02:32.063 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.086+0000 7f12c0b9f980 1 execute INFO: reshard of bucket "myver" completed successfully 2024-04-03T04:02:32.070 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.094+0000 7f1174fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:32.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.098+0000 7f12c0b9f980 20 remove_watcher() i=0 2024-04-03T04:02:32.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.098+0000 7f12c0b9f980 2 removed watcher, disabling cache 2024-04-03T04:02:32.079 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.102+0000 7f12c0b9f980 20 remove_watcher() i=1 2024-04-03T04:02:32.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.102+0000 7f12c0b9f980 20 remove_watcher() i=2 2024-04-03T04:02:32.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.106+0000 7f12c0b9f980 20 remove_watcher() i=3 2024-04-03T04:02:32.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.110+0000 7f12c0b9f980 20 remove_watcher() i=4 2024-04-03T04:02:32.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.110+0000 7f12c0b9f980 20 remove_watcher() i=5 2024-04-03T04:02:32.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.114+0000 7f12c0b9f980 20 remove_watcher() i=6 2024-04-03T04:02:32.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:32.114+0000 7f12c0b9f980 20 remove_watcher() i=7 2024-04-03T04:02:32.432 INFO:tasks.workunit.client.0.smithi104.stderr:put object successful 2024-04-03T04:02:32.432 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-04-03T04:02:32.432 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T04:02:32.437 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:32.437 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:32.556 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:32.556 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:32.711 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:32.711 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:32.854 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:32.854 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:32.917 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:32.917 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:33.050 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:33.050 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:33.114 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:33.114 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:33.250 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:33.250 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:33.312 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-04-03T04:02:33.741 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-04-03T04:02:35.159 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:35.159 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:35.316 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T04:02:35.316 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket myver --object x 2024-04-03T04:02:35.350 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:35.351 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:35.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.418+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:35.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:35.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 realm 2024-04-03T04:02:35.398 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:35.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:35.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:35.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:35.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:35.399 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:35.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:35.400 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:35.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:35.401 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.422+0000 7f6ba97d0980 20 searching for the correct realm 2024-04-03T04:02:35.402 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.426+0000 7f6ba6aea640 0 -- 172.21.15.104:0/3474397233 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f6b98108b60 msgr2=0x7f6b981060c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:35.821 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:35.842+0000 7f6ba72eb640 0 -- 172.21.15.104:0/3474397233 >> [v2:172.21.15.130:6804/3494208016,v1:172.21.15.130:6807/3494208016] conn(0x7f6ba0008050 msgr2=0x7f6ba0054440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:02:36.043 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:36.043 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:36.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:36.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:36.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:36.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:36.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:36.044 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:36.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:36.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 zone default found 2024-04-03T04:02:36.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 4 Realm: () 2024-04-03T04:02:36.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:36.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:36.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:36.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 zonegroup default 2024-04-03T04:02:36.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.066+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.070+0000 7f6ba97d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:36.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.070+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.070+0000 7f6ba97d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:36.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.070+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.070+0000 7f6ba97d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:36.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.070+0000 7f6ba97d0980 20 started sync module instance, tier type = 2024-04-03T04:02:36.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.070+0000 7f6ba97d0980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:36.072 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.094+0000 7f6ba97d0980 20 add_watcher() i=0 2024-04-03T04:02:36.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.094+0000 7f6ba97d0980 20 add_watcher() i=1 2024-04-03T04:02:36.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.094+0000 7f6ba97d0980 20 add_watcher() i=2 2024-04-03T04:02:36.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.094+0000 7f6ba97d0980 20 add_watcher() i=3 2024-04-03T04:02:36.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.094+0000 7f6ba97d0980 20 add_watcher() i=4 2024-04-03T04:02:36.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.094+0000 7f6ba97d0980 20 add_watcher() i=5 2024-04-03T04:02:36.073 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.094+0000 7f6ba97d0980 20 add_watcher() i=6 2024-04-03T04:02:36.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.098+0000 7f6ba97d0980 20 add_watcher() i=7 2024-04-03T04:02:36.075 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.098+0000 7f6ba97d0980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:36.079 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.102+0000 7f6a59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:36.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.102+0000 7f6ba97d0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:36.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.102+0000 7f6ba97d0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:36.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.102+0000 7f6ba97d0980 5 note: GC not initialized 2024-04-03T04:02:36.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.102+0000 7f6a58fe1640 20 reqs_thread_entry: start 2024-04-03T04:02:36.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.102+0000 7f6ba97d0980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:36.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.102+0000 7f6ba97d0980 20 Filter name: none 2024-04-03T04:02:36.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.102+0000 7f69d27fc640 20 reqs_thread_entry: start 2024-04-03T04:02:36.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.102+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:36.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:36.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:36.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-04-03T04:02:36.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 INFO: main: starting shard=0 2024-04-03T04:02:36.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:36.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:36.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 INFO: main: starting shard=1 2024-04-03T04:02:36.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:36.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.106+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:36.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 20 INFO: main: starting shard=2 2024-04-03T04:02:36.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:36.087 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:36.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 20 INFO: main: starting shard=3 2024-04-03T04:02:36.088 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:36.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:36.089 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 20 INFO: main: starting shard=4 2024-04-03T04:02:36.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:36.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.110+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:36.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 20 INFO: main: starting shard=5 2024-04-03T04:02:36.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:36.091 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:36.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-04-03T04:02:36.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 20 INFO: main: starting shard=6 2024-04-03T04:02:36.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:36.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:36.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 20 INFO: main: starting shard=7 2024-04-03T04:02:36.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:36.093 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.114+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:36.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 20 INFO: main: starting shard=8 2024-04-03T04:02:36.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:36.094 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:36.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 20 INFO: main: starting shard=9 2024-04-03T04:02:36.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:36.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:36.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 20 INFO: main: starting shard=10 2024-04-03T04:02:36.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:36.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.118+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:36.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 20 INFO: main: starting shard=11 2024-04-03T04:02:36.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:36.098 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:36.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 20 INFO: main: starting shard=12 2024-04-03T04:02:36.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:36.099 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:36.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:36.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6ba97d0980 20 INFO: main: done 2024-04-03T04:02:36.101 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.122+0000 7f6a59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:36.105 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.126+0000 7f6ba97d0980 20 remove_watcher() i=0 2024-04-03T04:02:36.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.126+0000 7f6ba97d0980 2 removed watcher, disabling cache 2024-04-03T04:02:36.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.130+0000 7f6ba97d0980 20 remove_watcher() i=1 2024-04-03T04:02:36.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.134+0000 7f6ba97d0980 20 remove_watcher() i=2 2024-04-03T04:02:36.112 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.134+0000 7f6ba97d0980 20 remove_watcher() i=3 2024-04-03T04:02:36.114 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.138+0000 7f6ba97d0980 20 remove_watcher() i=4 2024-04-03T04:02:36.116 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.138+0000 7f6ba97d0980 20 remove_watcher() i=5 2024-04-03T04:02:36.118 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.142+0000 7f6ba97d0980 20 remove_watcher() i=6 2024-04-03T04:02:36.120 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.142+0000 7f6ba97d0980 20 remove_watcher() i=7 2024-04-03T04:02:36.141 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:36.141 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:36.174 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:36.174 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:36.287 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T04:02:36.287 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket myver --object y 2024-04-03T04:02:36.322 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:36.322 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:36.574 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.594+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.802+0000 7f460a812980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:36.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.802+0000 7f460a812980 20 realm 2024-04-03T04:02:36.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.802+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.802+0000 7f460a812980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:36.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.802+0000 7f460a812980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:36.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.802+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.802+0000 7f460a812980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:36.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.802+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.806+0000 7f460a812980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:36.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.806+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:36.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.806+0000 7f460a812980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:36.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.806+0000 7f460a812980 20 searching for the correct realm 2024-04-03T04:02:36.790 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:36.814+0000 7f4608b2e640 0 -- 172.21.15.104:0/244451028 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f4600038040 msgr2=0x7f4600045930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:37.006 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.030+0000 7f45ffb2c640 0 -- 172.21.15.104:0/244451028 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f4600026040 msgr2=0x7f4600050400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:37.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.246+0000 7f460a812980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:37.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.246+0000 7f460a812980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:37.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.246+0000 7f460a812980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:37.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.246+0000 7f460a812980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:37.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.246+0000 7f460a812980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:37.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.246+0000 7f460a812980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:37.225 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.246+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.246+0000 7f460a812980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.246+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:37.226 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:37.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 zone default found 2024-04-03T04:02:37.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 4 Realm: () 2024-04-03T04:02:37.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:37.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:37.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:37.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 zonegroup default 2024-04-03T04:02:37.227 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.228 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 started sync module instance, tier type = 2024-04-03T04:02:37.229 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.250+0000 7f460a812980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:37.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.274+0000 7f460a812980 20 add_watcher() i=0 2024-04-03T04:02:37.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.274+0000 7f460a812980 20 add_watcher() i=1 2024-04-03T04:02:37.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.274+0000 7f460a812980 20 add_watcher() i=2 2024-04-03T04:02:37.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.274+0000 7f460a812980 20 add_watcher() i=3 2024-04-03T04:02:37.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.274+0000 7f460a812980 20 add_watcher() i=4 2024-04-03T04:02:37.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.274+0000 7f460a812980 20 add_watcher() i=5 2024-04-03T04:02:37.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.274+0000 7f460a812980 20 add_watcher() i=6 2024-04-03T04:02:37.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.278+0000 7f460a812980 20 add_watcher() i=7 2024-04-03T04:02:37.254 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.278+0000 7f460a812980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:37.258 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f44befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:37.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f460a812980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:37.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f460a812980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:37.259 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f460a812980 5 note: GC not initialized 2024-04-03T04:02:37.260 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f44bdfdb640 20 reqs_thread_entry: start 2024-04-03T04:02:37.260 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f460a812980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:37.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f460a812980 20 Filter name: none 2024-04-03T04:02:37.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f442f7fe640 20 reqs_thread_entry: start 2024-04-03T04:02:37.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f460a812980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:37.261 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.282+0000 7f460a812980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:37.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:37.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-04-03T04:02:37.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 INFO: main: starting shard=0 2024-04-03T04:02:37.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:37.263 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:37.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 INFO: main: starting shard=1 2024-04-03T04:02:37.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:37.264 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:37.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 INFO: main: starting shard=2 2024-04-03T04:02:37.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:37.265 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.286+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:37.266 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.266 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 20 INFO: main: starting shard=3 2024-04-03T04:02:37.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:37.267 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:37.268 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.268 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 20 INFO: main: starting shard=4 2024-04-03T04:02:37.268 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:37.268 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:37.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 20 INFO: main: starting shard=5 2024-04-03T04:02:37.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:37.269 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.290+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:37.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 20 INFO: main: starting shard=6 2024-04-03T04:02:37.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:37.270 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:37.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.271 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 20 INFO: main: starting shard=7 2024-04-03T04:02:37.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:37.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:37.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 20 INFO: main: starting shard=8 2024-04-03T04:02:37.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:37.272 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.294+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:37.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 INFO: main: starting shard=9 2024-04-03T04:02:37.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:37.274 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:37.275 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-04-03T04:02:37.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 INFO: main: starting shard=10 2024-04-03T04:02:37.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:37.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:37.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 INFO: main: starting shard=11 2024-04-03T04:02:37.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:37.276 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:37.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 INFO: main: starting shard=12 2024-04-03T04:02:37.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:37.277 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.298+0000 7f460a812980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:37.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.302+0000 7f460a812980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.302+0000 7f460a812980 20 INFO: main: done 2024-04-03T04:02:37.280 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.302+0000 7f44befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:37.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.306+0000 7f460a812980 20 remove_watcher() i=0 2024-04-03T04:02:37.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.306+0000 7f460a812980 2 removed watcher, disabling cache 2024-04-03T04:02:37.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.310+0000 7f460a812980 20 remove_watcher() i=1 2024-04-03T04:02:37.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.314+0000 7f460a812980 20 remove_watcher() i=2 2024-04-03T04:02:37.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.314+0000 7f460a812980 20 remove_watcher() i=3 2024-04-03T04:02:37.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.318+0000 7f460a812980 20 remove_watcher() i=4 2024-04-03T04:02:37.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.318+0000 7f460a812980 20 remove_watcher() i=5 2024-04-03T04:02:37.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.318+0000 7f460a812980 20 remove_watcher() i=6 2024-04-03T04:02:37.299 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.322+0000 7f460a812980 20 remove_watcher() i=7 2024-04-03T04:02:37.318 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:37.318 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:37.346 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:37.347 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:37.467 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T04:02:37.467 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket myver --object z 2024-04-03T04:02:37.503 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:37.503 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:37.547 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.570+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.570+0000 7faff22f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.549 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.570+0000 7faff22f8980 20 realm 2024-04-03T04:02:37.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.570+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.570+0000 7faff22f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.570+0000 7faff22f8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:37.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.570+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.570+0000 7faff22f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.550 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.570+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.574+0000 7faff22f8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:37.551 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.574+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.574+0000 7faff22f8980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:37.552 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.574+0000 7faff22f8980 20 searching for the correct realm 2024-04-03T04:02:37.556 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.578+0000 7faff0614640 0 -- 172.21.15.104:0/3647111747 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fafe8035440 msgr2=0x7fafe80358a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:02:37.564 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.586+0000 7fafef612640 0 -- 172.21.15.104:0/3647111747 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fafe804e920 msgr2=0x7fafe80343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:37.780 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.802+0000 7faff22f8980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:37.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.802+0000 7faff22f8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:37.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.802+0000 7faff22f8980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:37.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.802+0000 7faff22f8980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:37.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.802+0000 7faff22f8980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:37.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.802+0000 7faff22f8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:37.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.802+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.802+0000 7faff22f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.781 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.802+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:37.782 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:37.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 zone default found 2024-04-03T04:02:37.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 4 Realm: () 2024-04-03T04:02:37.783 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:37.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:37.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:37.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 zonegroup default 2024-04-03T04:02:37.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.784 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:37.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 started sync module instance, tier type = 2024-04-03T04:02:37.785 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.806+0000 7faff22f8980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:37.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.830+0000 7faff22f8980 20 add_watcher() i=0 2024-04-03T04:02:37.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.830+0000 7faff22f8980 20 add_watcher() i=1 2024-04-03T04:02:37.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.830+0000 7faff22f8980 20 add_watcher() i=2 2024-04-03T04:02:37.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.830+0000 7faff22f8980 20 add_watcher() i=3 2024-04-03T04:02:37.806 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.830+0000 7faff22f8980 20 add_watcher() i=4 2024-04-03T04:02:37.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.830+0000 7faff22f8980 20 add_watcher() i=5 2024-04-03T04:02:37.807 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.830+0000 7faff22f8980 20 add_watcher() i=6 2024-04-03T04:02:37.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.830+0000 7faff22f8980 20 add_watcher() i=7 2024-04-03T04:02:37.808 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.830+0000 7faff22f8980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:37.812 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.834+0000 7faea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:37.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.834+0000 7faff22f8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:37.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.834+0000 7faff22f8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:37.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.834+0000 7faff22f8980 5 note: GC not initialized 2024-04-03T04:02:37.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.834+0000 7faea4fe1640 20 reqs_thread_entry: start 2024-04-03T04:02:37.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.834+0000 7faff22f8980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:37.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 Filter name: none 2024-04-03T04:02:37.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7fae1e7fc640 20 reqs_thread_entry: start 2024-04-03T04:02:37.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:37.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 rados->read ofs=0 len=0 2024-04-03T04:02:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-04-03T04:02:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 INFO: main: starting shard=0 2024-04-03T04:02:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:37.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:37.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-04-03T04:02:37.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 INFO: main: starting shard=1 2024-04-03T04:02:37.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:37.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.838+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:37.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 20 INFO: main: starting shard=2 2024-04-03T04:02:37.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:37.819 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:37.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 20 INFO: main: starting shard=3 2024-04-03T04:02:37.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:37.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:37.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 20 INFO: main: starting shard=4 2024-04-03T04:02:37.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:37.822 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.842+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:37.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 20 INFO: main: starting shard=5 2024-04-03T04:02:37.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:37.823 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:37.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 20 INFO: main: starting shard=6 2024-04-03T04:02:37.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:37.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:37.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 20 INFO: main: starting shard=7 2024-04-03T04:02:37.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:37.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.846+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:37.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 INFO: main: starting shard=8 2024-04-03T04:02:37.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:37.826 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:37.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 INFO: main: starting shard=9 2024-04-03T04:02:37.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:37.827 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:37.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 INFO: main: starting shard=10 2024-04-03T04:02:37.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:37.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:37.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.829 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 INFO: main: starting shard=11 2024-04-03T04:02:37.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:37.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.850+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:37.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.854+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.854+0000 7faff22f8980 20 INFO: main: starting shard=12 2024-04-03T04:02:37.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.854+0000 7faff22f8980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:37.830 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.854+0000 7faff22f8980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:37.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.854+0000 7faff22f8980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T04:02:37.831 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.854+0000 7faff22f8980 20 INFO: main: done 2024-04-03T04:02:37.832 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.854+0000 7faea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:37.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.858+0000 7faff22f8980 20 remove_watcher() i=0 2024-04-03T04:02:37.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.858+0000 7faff22f8980 2 removed watcher, disabling cache 2024-04-03T04:02:37.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.862+0000 7faff22f8980 20 remove_watcher() i=1 2024-04-03T04:02:37.842 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.866+0000 7faff22f8980 20 remove_watcher() i=2 2024-04-03T04:02:37.844 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.866+0000 7faff22f8980 20 remove_watcher() i=3 2024-04-03T04:02:37.847 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.870+0000 7faff22f8980 20 remove_watcher() i=4 2024-04-03T04:02:37.848 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.870+0000 7faff22f8980 20 remove_watcher() i=5 2024-04-03T04:02:37.850 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.874+0000 7faff22f8980 20 remove_watcher() i=6 2024-04-03T04:02:37.851 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:37.874+0000 7faff22f8980 20 remove_watcher() i=7 2024-04-03T04:02:37.868 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:37.868 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:37.890 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-04-03T04:02:38.319 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-04-03T04:02:38.740 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-04-03T04:02:38.772 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:38.772 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:38.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.834+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:38.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 20 realm 2024-04-03T04:02:38.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:38.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:38.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:38.816 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:38.817 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.838+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.842+0000 7f520c666980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:38.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.842+0000 7f520c666980 20 searching for the correct realm 2024-04-03T04:02:38.824 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.846+0000 7f520a982640 0 -- 172.21.15.104:0/1317782502 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f52040c6c20 msgr2=0x7f52040f5820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:38.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.850+0000 7f5209980640 0 -- 172.21.15.104:0/1317782502 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f51fc01c040 msgr2=0x7f51fc05cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:38.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.858+0000 7f520c666980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:38.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.858+0000 7f520c666980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:38.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.858+0000 7f520c666980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:38.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.858+0000 7f520c666980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:38.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.858+0000 7f520c666980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:38.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.858+0000 7f520c666980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:38.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.858+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.858+0000 7f520c666980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:38.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.858+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:38.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:38.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 zone default found 2024-04-03T04:02:38.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 4 Realm: () 2024-04-03T04:02:38.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:38.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:38.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:38.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 zonegroup default 2024-04-03T04:02:38.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:38.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.840 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:38.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:38.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 started sync module instance, tier type = 2024-04-03T04:02:38.841 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.862+0000 7f520c666980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:38.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.878+0000 7f520c666980 20 add_watcher() i=0 2024-04-03T04:02:38.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.878+0000 7f520c666980 20 add_watcher() i=1 2024-04-03T04:02:38.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.878+0000 7f520c666980 20 add_watcher() i=2 2024-04-03T04:02:38.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.878+0000 7f520c666980 20 add_watcher() i=3 2024-04-03T04:02:38.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.878+0000 7f520c666980 20 add_watcher() i=4 2024-04-03T04:02:38.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.878+0000 7f520c666980 20 add_watcher() i=5 2024-04-03T04:02:38.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.878+0000 7f520c666980 20 add_watcher() i=6 2024-04-03T04:02:38.856 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.878+0000 7f520c666980 20 add_watcher() i=7 2024-04-03T04:02:38.857 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.878+0000 7f520c666980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:38.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f50c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:38.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:38.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:38.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 5 note: GC not initialized 2024-04-03T04:02:38.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f503b7fe640 20 reqs_thread_entry: start 2024-04-03T04:02:38.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:38.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 20 Filter name: none 2024-04-03T04:02:38.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f50397fa640 20 reqs_thread_entry: start 2024-04-03T04:02:38.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-04-03T04:02:38.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 : miss 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 20 rados->read ofs=0 len=0 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 10 adding default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.882+0000 7f520c666980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:38.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.886+0000 7f520c666980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 2024-04-03T04:02:38.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f520c666980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:38.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f520c666980 10 moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:38.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f520c666980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:38.874 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f520c666980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18, ofs0, ns] 2024-04-03T04:02:38.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f50edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 93941292053056 notifier 7368 bl.length()=783 2024-04-03T04:02:38.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f50edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:38.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f50edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:38.875 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f50edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:38.876 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f520c666980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_sources= new_sources= 2024-04-03T04:02:38.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f520c666980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential sources added=[] removed=[] 2024-04-03T04:02:38.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f520c666980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_dests= new_dests= 2024-04-03T04:02:38.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.898+0000 7f520c666980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential dests added=[] removed=[] 2024-04-03T04:02:38.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.0 2024-04-03T04:02:38.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.0 2024-04-03T04:02:38.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.1 2024-04-03T04:02:38.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.1 2024-04-03T04:02:38.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.2 2024-04-03T04:02:38.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.2 2024-04-03T04:02:38.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.3 2024-04-03T04:02:38.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.3 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.4 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.4 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.5 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.5 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.6 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.6 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.7 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.7 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.8 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.8 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:38.884 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.10 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.10 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.11 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.11 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.12 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.12 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.13 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.13 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.14 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.14 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.15 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.15 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.16 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.16 2024-04-03T04:02:38.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:38.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.0 2024-04-03T04:02:38.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:38.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.1 2024-04-03T04:02:38.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:38.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.906+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.2 2024-04-03T04:02:38.886 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:38.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.3 2024-04-03T04:02:38.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:38.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.4 2024-04-03T04:02:38.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:38.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.5 2024-04-03T04:02:38.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:38.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.6 2024-04-03T04:02:38.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:38.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.910+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.7 2024-04-03T04:02:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.914+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.914+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.8 2024-04-03T04:02:38.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.914+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:38.891 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.914+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.9 2024-04-03T04:02:38.892 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.914+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:38.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.914+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.10 2024-04-03T04:02:38.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.914+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:38.893 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.914+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.11 2024-04-03T04:02:38.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.918+0000 7f520c666980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:38.894 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.918+0000 7f520c666980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.2.12 2024-04-03T04:02:38.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.922+0000 7f520c666980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 : hit (requested=0x17, cached=0x17) 2024-04-03T04:02:38.898 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.922+0000 7f520c666980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 2024-04-03T04:02:38.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.922+0000 7f520c666980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:38.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.922+0000 7f520c666980 10 moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:38.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.922+0000 7f520c666980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:38.901 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.922+0000 7f520c666980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18, ofs0, ns] 2024-04-03T04:02:38.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.926+0000 7f50ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 93941292053056 notifier 7368 bl.length()=751 2024-04-03T04:02:38.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.926+0000 7f50ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:38.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.926+0000 7f50ed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:38.902 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.926+0000 7f50ed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:38.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.926+0000 7f520c666980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_sources= new_sources= 2024-04-03T04:02:38.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.926+0000 7f520c666980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential sources added=[] removed=[] 2024-04-03T04:02:38.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.926+0000 7f520c666980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): orig_dests= new_dests= 2024-04-03T04:02:38.903 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.926+0000 7f520c666980 20 handle_bi_update(): bucket=:myver[87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18]): potential dests added=[] removed=[] 2024-04-03T04:02:38.909 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.930+0000 7f520c666980 1 execute INFO: reshard of bucket "myver" completed successfully 2024-04-03T04:02:38.912 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.934+0000 7f50c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:38.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.938+0000 7f520c666980 20 remove_watcher() i=0 2024-04-03T04:02:38.917 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.938+0000 7f520c666980 2 removed watcher, disabling cache 2024-04-03T04:02:38.919 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.942+0000 7f520c666980 20 remove_watcher() i=1 2024-04-03T04:02:38.921 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.942+0000 7f520c666980 20 remove_watcher() i=2 2024-04-03T04:02:38.923 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.946+0000 7f520c666980 20 remove_watcher() i=3 2024-04-03T04:02:38.925 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.946+0000 7f520c666980 20 remove_watcher() i=4 2024-04-03T04:02:38.927 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.950+0000 7f520c666980 20 remove_watcher() i=5 2024-04-03T04:02:38.928 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.950+0000 7f520c666980 20 remove_watcher() i=6 2024-04-03T04:02:38.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:38.950+0000 7f520c666980 20 remove_watcher() i=7 2024-04-03T04:02:38.943 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-04-03T04:02:38.976 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:38.976 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:39.017 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.038+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 realm 2024-04-03T04:02:39.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:39.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.019 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:39.020 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:39.022 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.042+0000 7f8585c9c980 20 searching for the correct realm 2024-04-03T04:02:39.025 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.046+0000 7f8583fb8640 0 -- 172.21.15.104:0/1410491315 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f857c034070 msgr2=0x7f857c019940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:39.033 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.054+0000 7f8582fb6640 0 -- 172.21.15.104:0/1410491315 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f857c058ac0 msgr2=0x7f857c026400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:02:39.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:39.248 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:39.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:39.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:39.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:39.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:39.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.249 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:39.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.270+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:39.250 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 zone default found 2024-04-03T04:02:39.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 4 Realm: () 2024-04-03T04:02:39.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:39.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:39.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:39.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 zonegroup default 2024-04-03T04:02:39.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.251 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 started sync module instance, tier type = 2024-04-03T04:02:39.252 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.274+0000 7f8585c9c980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:39.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.302+0000 7f8585c9c980 20 add_watcher() i=0 2024-04-03T04:02:39.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.302+0000 7f8585c9c980 20 add_watcher() i=1 2024-04-03T04:02:39.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.302+0000 7f8585c9c980 20 add_watcher() i=2 2024-04-03T04:02:39.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.302+0000 7f8585c9c980 20 add_watcher() i=3 2024-04-03T04:02:39.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.302+0000 7f8585c9c980 20 add_watcher() i=4 2024-04-03T04:02:39.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.302+0000 7f8585c9c980 20 add_watcher() i=5 2024-04-03T04:02:39.278 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.302+0000 7f8585c9c980 20 add_watcher() i=6 2024-04-03T04:02:39.280 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.302+0000 7f8585c9c980 20 add_watcher() i=7 2024-04-03T04:02:39.281 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.302+0000 7f8585c9c980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:39.285 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.306+0000 7f8439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:39.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:39.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:39.286 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 5 note: GC not initialized 2024-04-03T04:02:39.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8438fe1640 20 reqs_thread_entry: start 2024-04-03T04:02:39.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:39.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 20 Filter name: none 2024-04-03T04:02:39.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f83b27fc640 20 reqs_thread_entry: start 2024-04-03T04:02:39.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-04-03T04:02:39.287 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:39.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-04-03T04:02:39.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-04-03T04:02:39.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 : miss 2024-04-03T04:02:39.288 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.289 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:39.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 info.flags=0x17 2024-04-03T04:02:39.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 adding default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 to cache LRU end 2024-04-03T04:02:39.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:02:39.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-04-03T04:02:39.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18 2024-04-03T04:02:39.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.0 2024-04-03T04:02:39.290 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.310+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.0 2024-04-03T04:02:39.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.314+0000 7f8585c9c980 1 NOTICE: finished shard 0 (0 entries removed) 2024-04-03T04:02:39.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.314+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.1 2024-04-03T04:02:39.291 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.314+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.1 2024-04-03T04:02:39.292 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.314+0000 7f8585c9c980 1 NOTICE: finished shard 1 (0 entries removed) 2024-04-03T04:02:39.293 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.314+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.2 2024-04-03T04:02:39.293 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.314+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.2 2024-04-03T04:02:39.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 1 NOTICE: finished shard 2 (0 entries removed) 2024-04-03T04:02:39.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.3 2024-04-03T04:02:39.294 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.3 2024-04-03T04:02:39.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 1 NOTICE: finished shard 3 (0 entries removed) 2024-04-03T04:02:39.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.4 2024-04-03T04:02:39.295 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.4 2024-04-03T04:02:39.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 1 NOTICE: finished shard 4 (0 entries removed) 2024-04-03T04:02:39.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.5 2024-04-03T04:02:39.296 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.5 2024-04-03T04:02:39.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 1 NOTICE: finished shard 5 (0 entries removed) 2024-04-03T04:02:39.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.6 2024-04-03T04:02:39.297 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.318+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.6 2024-04-03T04:02:39.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 1 NOTICE: finished shard 6 (0 entries removed) 2024-04-03T04:02:39.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.7 2024-04-03T04:02:39.298 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.7 2024-04-03T04:02:39.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 1 NOTICE: finished shard 7 (0 entries removed) 2024-04-03T04:02:39.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.8 2024-04-03T04:02:39.300 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.8 2024-04-03T04:02:39.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 1 NOTICE: finished shard 8 (0 entries removed) 2024-04-03T04:02:39.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.301 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.10 2024-04-03T04:02:39.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.322+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.10 2024-04-03T04:02:39.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 1 NOTICE: finished shard 10 (0 entries removed) 2024-04-03T04:02:39.302 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.11 2024-04-03T04:02:39.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.11 2024-04-03T04:02:39.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 1 NOTICE: finished shard 11 (0 entries removed) 2024-04-03T04:02:39.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.12 2024-04-03T04:02:39.303 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.12 2024-04-03T04:02:39.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 1 NOTICE: finished shard 12 (0 entries removed) 2024-04-03T04:02:39.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.13 2024-04-03T04:02:39.304 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.13 2024-04-03T04:02:39.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 1 NOTICE: finished shard 13 (0 entries removed) 2024-04-03T04:02:39.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.14 2024-04-03T04:02:39.305 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.326+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.14 2024-04-03T04:02:39.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 1 NOTICE: finished shard 14 (0 entries removed) 2024-04-03T04:02:39.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.15 2024-04-03T04:02:39.306 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.15 2024-04-03T04:02:39.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 1 NOTICE: finished shard 15 (0 entries removed) 2024-04-03T04:02:39.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 10 bucket_obj is .dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.16 2024-04-03T04:02:39.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.16 2024-04-03T04:02:39.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 1 NOTICE: finished shard 16 (0 entries removed) 2024-04-03T04:02:39.307 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:x state=0x561fc890c238 s->prefetch_data=0 2024-04-03T04:02:39.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 20 get_obj_state: setting s->obj_tag to f63mg13nbzi112dhlluh3gl34v7qt0v2 2024-04-03T04:02:39.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 20 get_obj_state_impl: setting s->olh_tag to ke61vhstbxkbn10o352otsjww9ktwrab 2024-04-03T04:02:39.308 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.330+0000 7f8585c9c980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ke61vhstbxkbn10o352otsjww9ktwrab 2024-04-03T04:02:39.310 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.334+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.312 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.334+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.334+0000 7f8585c9c980 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-04-03T04:02:39.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.334+0000 7f8585c9c980 20 olh_log_entry: epoch=2 op=3 key=x[raKnbHcMPe9gqmeTOMaJwgiVSMVYMd.] 2024-04-03T04:02:39.313 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.334+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:_:raKnbHcMPe9gqmeTOMaJwgiVSMVYMd._x state=0x561fc8943948 s->prefetch_data=0 2024-04-03T04:02:39.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.334+0000 7f8585c9c980 10 manifest: total_size = 22 2024-04-03T04:02:39.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.334+0000 7f8585c9c980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16152477888322597734 2024-04-03T04:02:39.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.334+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:_:raKnbHcMPe9gqmeTOMaJwgiVSMVYMd._x state=0x561fc8943948 s->prefetch_data=0 2024-04-03T04:02:39.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.334+0000 7f8585c9c980 20 prepare_atomic_modification: state is not atomic. state=0x561fc8943948 2024-04-03T04:02:39.314 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.338+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.342+0000 7f8585c9c980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T04:02:39.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.342+0000 7f8585c9c980 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-04-03T04:02:39.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.342+0000 7f8585c9c980 0 deleting objects inline since gc isn't initialized 2024-04-03T04:02:39.318 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.342+0000 7f8585c9c980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18__shadow:raKnbHcMPe9gqmeTOMaJwgiVSMVYMd._.DtPe21_cifaQLwfaL4cTg3aTKOakRH4_0 2024-04-03T04:02:39.320 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.342+0000 7f8466ffd640 20 handle_completion(): completion ok for obj=x[raKnbHcMPe9gqmeTOMaJwgiVSMVYMd.] 2024-04-03T04:02:39.320 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.342+0000 7f8585c9c980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T04:02:39.322 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.346+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:x state=0x561fc890c238 s->prefetch_data=0 2024-04-03T04:02:39.322 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.346+0000 7f8585c9c980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ke61vhstbxkbn10o352otsjww9ktwrab 2024-04-03T04:02:39.327 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.350+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.328 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.350+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.350+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.329 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.350+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:y state=0x561fc890d4c8 s->prefetch_data=0 2024-04-03T04:02:39.330 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.354+0000 7f8585c9c980 20 get_obj_state: setting s->obj_tag to ufrxsllyw5pvk04ywuhe2kzc84fplshy 2024-04-03T04:02:39.330 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.354+0000 7f8585c9c980 20 get_obj_state_impl: setting s->olh_tag to o51rvui9q524j9xc38bbve4z35sj86qc 2024-04-03T04:02:39.330 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.354+0000 7f8585c9c980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o51rvui9q524j9xc38bbve4z35sj86qc 2024-04-03T04:02:39.334 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-04-03T04:02:39.336 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 20 olh_log_entry: epoch=2 op=3 key=y[RCP3aOddhr9fvYkJiQ4P4Ue2dzYkqvN] 2024-04-03T04:02:39.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:_:RCP3aOddhr9fvYkJiQ4P4Ue2dzYkqvN_y state=0x561fc8944958 s->prefetch_data=0 2024-04-03T04:02:39.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 10 manifest: total_size = 22 2024-04-03T04:02:39.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16299163267553830048 2024-04-03T04:02:39.337 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:_:RCP3aOddhr9fvYkJiQ4P4Ue2dzYkqvN_y state=0x561fc8944958 s->prefetch_data=0 2024-04-03T04:02:39.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 20 prepare_atomic_modification: state is not atomic. state=0x561fc8944958 2024-04-03T04:02:39.338 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.358+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.366+0000 7f8585c9c980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T04:02:39.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.366+0000 7f8585c9c980 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-04-03T04:02:39.342 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.366+0000 7f8585c9c980 0 deleting objects inline since gc isn't initialized 2024-04-03T04:02:39.343 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.366+0000 7f8585c9c980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18__shadow:RCP3aOddhr9fvYkJiQ4P4Ue2dzYkqvN_.LInhtTgC0k5-p_fmbz7k80nPQJFCbNx_0 2024-04-03T04:02:39.344 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.366+0000 7f84667fc640 20 handle_completion(): completion ok for obj=y[RCP3aOddhr9fvYkJiQ4P4Ue2dzYkqvN] 2024-04-03T04:02:39.345 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.366+0000 7f8585c9c980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T04:02:39.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.370+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:y state=0x561fc890d4c8 s->prefetch_data=0 2024-04-03T04:02:39.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.370+0000 7f8585c9c980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o51rvui9q524j9xc38bbve4z35sj86qc 2024-04-03T04:02:39.355 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.378+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.378+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.378+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.378+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:z state=0x561fc890f8c8 s->prefetch_data=0 2024-04-03T04:02:39.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.382+0000 7f8585c9c980 20 get_obj_state: setting s->obj_tag to ankrv47y03utwiyyllx39j4r7b62ef67 2024-04-03T04:02:39.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.382+0000 7f8585c9c980 20 get_obj_state_impl: setting s->olh_tag to x0qsuq5gvagv1i8h02u8cw2xs3ed268g 2024-04-03T04:02:39.358 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.382+0000 7f8585c9c980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x0qsuq5gvagv1i8h02u8cw2xs3ed268g 2024-04-03T04:02:39.360 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.382+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.386+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.386+0000 7f8585c9c980 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-04-03T04:02:39.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.386+0000 7f8585c9c980 20 olh_log_entry: epoch=2 op=3 key=z[vBV3sVa208jEHukT2mK1IySE812Ow4w] 2024-04-03T04:02:39.362 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.386+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:_:vBV3sVa208jEHukT2mK1IySE812Ow4w_z state=0x561fc8910428 s->prefetch_data=0 2024-04-03T04:02:39.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.386+0000 7f8585c9c980 10 manifest: total_size = 12 2024-04-03T04:02:39.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.386+0000 7f8585c9c980 20 get_obj_state: setting s->obj_tag to 87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8427957892309213433 2024-04-03T04:02:39.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.386+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:_:vBV3sVa208jEHukT2mK1IySE812Ow4w_z state=0x561fc8910428 s->prefetch_data=0 2024-04-03T04:02:39.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.386+0000 7f8585c9c980 20 prepare_atomic_modification: state is not atomic. state=0x561fc8910428 2024-04-03T04:02:39.363 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.386+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.390+0000 7f8585c9c980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-04-03T04:02:39.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.390+0000 7f8585c9c980 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-04-03T04:02:39.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.390+0000 7f8585c9c980 0 deleting objects inline since gc isn't initialized 2024-04-03T04:02:39.368 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.390+0000 7f8585c9c980 5 delete_objs_inline: removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18__shadow:vBV3sVa208jEHukT2mK1IySE812Ow4w_.3FWlKYgJHbPBFHOek4zKym-KIPxykAE_0 2024-04-03T04:02:39.370 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.390+0000 7f8466ffd640 20 handle_completion(): completion ok for obj=z[vBV3sVa208jEHukT2mK1IySE812Ow4w] 2024-04-03T04:02:39.371 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.394+0000 7f8585c9c980 5 delete_objs_inline: refcount put returned error -2 2024-04-03T04:02:39.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.394+0000 7f8585c9c980 20 get_obj_state: octx=0x561fc865d550 obj=myver:z state=0x561fc890f8c8 s->prefetch_data=0 2024-04-03T04:02:39.373 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.394+0000 7f8585c9c980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x0qsuq5gvagv1i8h02u8cw2xs3ed268g 2024-04-03T04:02:39.378 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.402+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.402+0000 7f8585c9c980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18.3.9 2024-04-03T04:02:39.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.402+0000 7f8585c9c980 1 NOTICE: finished shard 9 (3 entries removed) 2024-04-03T04:02:39.380 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.402+0000 7f8585c9c980 1 NOTICE: finished all shards (3 entries removed) 2024-04-03T04:02:39.381 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.402+0000 7f8439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:39.385 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.406+0000 7f8585c9c980 20 remove_watcher() i=0 2024-04-03T04:02:39.386 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.406+0000 7f8585c9c980 2 removed watcher, disabling cache 2024-04-03T04:02:39.388 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.410+0000 7f8585c9c980 20 remove_watcher() i=1 2024-04-03T04:02:39.389 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.410+0000 7f8585c9c980 20 remove_watcher() i=2 2024-04-03T04:02:39.391 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.414+0000 7f8585c9c980 20 remove_watcher() i=3 2024-04-03T04:02:39.393 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.414+0000 7f8585c9c980 20 remove_watcher() i=4 2024-04-03T04:02:39.395 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.418+0000 7f8585c9c980 20 remove_watcher() i=5 2024-04-03T04:02:39.396 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.418+0000 7f8585c9c980 20 remove_watcher() i=6 2024-04-03T04:02:39.397 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.418+0000 7f8585c9c980 20 remove_watcher() i=7 2024-04-03T04:02:39.414 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:39.414 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:39.470 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:39.470 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:39.734 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket stats --bucket myver 2024-04-03T04:02:39.766 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:02:39.766 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:02:39.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.834+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.834+0000 7f7b477e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.834+0000 7f7b477e1980 20 realm 2024-04-03T04:02:39.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.834+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.834+0000 7f7b477e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.834+0000 7f7b477e1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:02:39.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.834+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.834+0000 7f7b477e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:39.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.834+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.838+0000 7f7b477e1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:39.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.838+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:39.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.838+0000 7f7b477e1980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:02:39.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.838+0000 7f7b477e1980 20 searching for the correct realm 2024-04-03T04:02:39.820 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.842+0000 7f7b45afd640 0 -- 172.21.15.104:0/1181162291 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f7b40031060 msgr2=0x7f7b4005b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:02:39.828 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:39.850+0000 7f7b44afb640 0 -- 172.21.15.104:0/1181162291 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f7b40075bd0 msgr2=0x7f7b40013040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:02:40.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.066+0000 7f7b477e1980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:02:40.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.066+0000 7f7b477e1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:02:40.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.066+0000 7f7b477e1980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:02:40.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.066+0000 7f7b477e1980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:02:40.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.066+0000 7f7b477e1980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:02:40.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.066+0000 7f7b477e1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:02:40.045 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.066+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.066+0000 7f7b477e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:40.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.066+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:02:40.046 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:02:40.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 zone default found 2024-04-03T04:02:40.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 4 Realm: () 2024-04-03T04:02:40.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:02:40.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:02:40.047 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:02:40.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 zonegroup default 2024-04-03T04:02:40.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:40.048 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:40.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:02:40.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 started sync module instance, tier type = 2024-04-03T04:02:40.049 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.070+0000 7f7b477e1980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:02:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.094+0000 7f7b477e1980 20 add_watcher() i=0 2024-04-03T04:02:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.094+0000 7f7b477e1980 20 add_watcher() i=1 2024-04-03T04:02:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.098+0000 7f7b477e1980 20 add_watcher() i=2 2024-04-03T04:02:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.098+0000 7f7b477e1980 20 add_watcher() i=3 2024-04-03T04:02:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.098+0000 7f7b477e1980 20 add_watcher() i=4 2024-04-03T04:02:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.098+0000 7f7b477e1980 20 add_watcher() i=5 2024-04-03T04:02:40.074 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.098+0000 7f7b477e1980 20 add_watcher() i=6 2024-04-03T04:02:40.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.098+0000 7f7b477e1980 20 add_watcher() i=7 2024-04-03T04:02:40.076 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.098+0000 7f7b477e1980 2 all 8 watchers are set, enabling cache 2024-04-03T04:02:40.080 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.102+0000 7f79fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:40.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.102+0000 7f7b477e1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:02:40.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.102+0000 7f7b477e1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:02:40.081 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.102+0000 7f7b477e1980 5 note: GC not initialized 2024-04-03T04:02:40.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f79fafe5640 20 reqs_thread_entry: start 2024-04-03T04:02:40.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 init_complete bucket index max shards: 11 2024-04-03T04:02:40.082 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 Filter name: none 2024-04-03T04:02:40.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f79f8fe1640 20 reqs_thread_entry: start 2024-04-03T04:02:40.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:40.083 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.084 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:40.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:40.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 rados_obj.operate() r=0 bl.length=173 2024-04-03T04:02:40.085 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.106+0000 7f7b477e1980 20 rados->read ofs=0 len=0 2024-04-03T04:02:40.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.110+0000 7f7b477e1980 20 rados_obj.operate() r=0 bl.length=357 2024-04-03T04:02:40.086 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.110+0000 7f7b477e1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T04:02:40.090 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.114+0000 7f79fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:02:40.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.118+0000 7f7b477e1980 20 remove_watcher() i=0 2024-04-03T04:02:40.095 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.118+0000 7f7b477e1980 2 removed watcher, disabling cache 2024-04-03T04:02:40.097 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.118+0000 7f7b477e1980 20 remove_watcher() i=1 2024-04-03T04:02:40.100 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.122+0000 7f7b477e1980 20 remove_watcher() i=2 2024-04-03T04:02:40.102 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.126+0000 7f7b477e1980 20 remove_watcher() i=3 2024-04-03T04:02:40.104 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.126+0000 7f7b477e1980 20 remove_watcher() i=4 2024-04-03T04:02:40.106 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.130+0000 7f7b477e1980 20 remove_watcher() i=5 2024-04-03T04:02:40.108 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.130+0000 7f7b477e1980 20 remove_watcher() i=6 2024-04-03T04:02:40.110 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T04:02:40.134+0000 7f7b477e1980 20 remove_watcher() i=7 2024-04-03T04:02:40.125 INFO:tasks.workunit.client.0.smithi104.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-04-03T04:02:40.125 INFO:tasks.workunit.client.0.smithi104.stderr:Deleting bucket a-bucket 2024-04-03T04:02:40.126 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:40.126 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:40.152 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:40.152 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:40.258 INFO:tasks.workunit.client.0.smithi104.stderr:Deleting bucket myver 2024-04-03T04:02:40.259 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:40.259 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:40.386 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T04:02:40.386 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T04:02:40.849 INFO:tasks.workunit.client.0.smithi104.stderr:Completed resharding tests 2024-04-03T04:02:40.849 INFO:tasks.workunit.client.0.smithi104.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-04-03T04:02:40.849 INFO:tasks.workunit.client.0.smithi104.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-04-03T04:02:40.850 INFO:tasks.workunit.client.0.smithi104.stdout:connected to https://localhost:443 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ deactivate 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ export PATH 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset _OLD_VIRTUAL_PATH 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n '' ']' 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ hash -r 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n '' ']' 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset VIRTUAL_ENV 2024-04-03T04:02:40.959 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-04-03T04:02:40.960 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' '!' '' = nondestructive ']' 2024-04-03T04:02:40.960 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset -f deactivate 2024-04-03T04:02:40.960 INFO:tasks.workunit.client.0.smithi104.stderr:+ echo OK. 2024-04-03T04:02:40.960 INFO:tasks.workunit.client.0.smithi104.stdout:OK. 2024-04-03T04:02:40.961 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T04:02:40.961 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T04:02:41.014 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-04-03T04:02:41.015 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-03T04:02:41.434 DEBUG:teuthology.parallel:result is None 2024-04-03T04:02:41.435 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T04:02:41.447 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T04:02:41.447 DEBUG:teuthology.orchestra.run.smithi104:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T04:02:41.495 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T04:02:41.495 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-04-03T04:02:41.510 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-04-03T04:02:41.510 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-04-03T04:02:41.511 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-04-03T04:02:41.511 DEBUG:teuthology.orchestra.run.smithi104:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-04-03T04:02:41.542 INFO:teuthology.orchestra.run.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-04-03T04:02:47.848 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-04-03T04:02:47.849 DEBUG:teuthology.orchestra.run.smithi104:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-04-03T04:02:47.933 INFO:teuthology.orchestra.run.smithi104.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-04-03T04:02:47.989 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-04-03T04:02:48.190 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-04-03T04:02:48.191 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-04-03T04:02:48.379 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages were automatically installed and are no longer required: 2024-04-03T04:02:48.379 INFO:teuthology.orchestra.run.smithi104.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-03T04:02:48.379 INFO:teuthology.orchestra.run.smithi104.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-03T04:02:48.380 INFO:teuthology.orchestra.run.smithi104.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-03T04:02:48.380 INFO:teuthology.orchestra.run.smithi104.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-03T04:02:48.380 INFO:teuthology.orchestra.run.smithi104.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-03T04:02:48.380 INFO:teuthology.orchestra.run.smithi104.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-03T04:02:48.381 INFO:teuthology.orchestra.run.smithi104.stdout:The following additional packages will be installed: 2024-04-03T04:02:48.381 INFO:teuthology.orchestra.run.smithi104.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-04-03T04:02:48.382 INFO:teuthology.orchestra.run.smithi104.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-04-03T04:02:48.383 INFO:teuthology.orchestra.run.smithi104.stdout:Suggested packages: 2024-04-03T04:02:48.383 INFO:teuthology.orchestra.run.smithi104.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-04-03T04:02:48.383 INFO:teuthology.orchestra.run.smithi104.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-04-03T04:02:48.383 INFO:teuthology.orchestra.run.smithi104.stdout: fonts-wqy-zenhei fonts-indic 2024-04-03T04:02:48.413 INFO:teuthology.orchestra.run.smithi104.stdout:The following NEW packages will be installed: 2024-04-03T04:02:48.413 INFO:teuthology.orchestra.run.smithi104.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-04-03T04:02:48.414 INFO:teuthology.orchestra.run.smithi104.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-04-03T04:02:48.594 INFO:teuthology.orchestra.run.smithi104.stdout:0 upgraded, 9 newly installed, 0 to remove and 299 not upgraded. 2024-04-03T04:02:48.594 INFO:teuthology.orchestra.run.smithi104.stdout:Need to get 46.1 MB of archives. 2024-04-03T04:02:48.594 INFO:teuthology.orchestra.run.smithi104.stdout:After this operation, 155 MB of additional disk space will be used. 2024-04-03T04:02:48.594 INFO:teuthology.orchestra.run.smithi104.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2 [125 kB] 2024-04-03T04:02:48.958 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2 [2,037 kB] 2024-04-03T04:02:49.321 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgail18 amd64 2.24.33-2ubuntu2 [15.9 kB] 2024-04-03T04:02:49.321 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgail-common amd64 2.24.33-2ubuntu2 [132 kB] 2024-04-03T04:02:49.328 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2 [7,932 B] 2024-04-03T04:02:49.329 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u402-ga-2ubuntu1~22.04 [30.8 MB] 2024-04-03T04:02:50.423 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u402-ga-2ubuntu1~22.04 [75.5 kB] 2024-04-03T04:02:50.424 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u402-ga-2ubuntu1~22.04 [8,873 kB] 2024-04-03T04:02:50.655 INFO:teuthology.orchestra.run.smithi104.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u402-ga-2ubuntu1~22.04 [4,068 kB] 2024-04-03T04:02:51.060 INFO:teuthology.orchestra.run.smithi104.stderr:debconf: unable to initialize frontend: Dialog 2024-04-03T04:02:51.060 INFO:teuthology.orchestra.run.smithi104.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-04-03T04:02:51.060 INFO:teuthology.orchestra.run.smithi104.stderr:debconf: falling back to frontend: Readline 2024-04-03T04:02:51.073 INFO:teuthology.orchestra.run.smithi104.stderr:debconf: unable to initialize frontend: Readline 2024-04-03T04:02:51.073 INFO:teuthology.orchestra.run.smithi104.stderr:debconf: (This frontend requires a controlling tty.) 2024-04-03T04:02:51.073 INFO:teuthology.orchestra.run.smithi104.stderr:debconf: falling back to frontend: Teletype 2024-04-03T04:02:51.076 INFO:teuthology.orchestra.run.smithi104.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-04-03T04:02:51.109 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 46.1 MB in 2s (19.7 MB/s) 2024-04-03T04:02:51.222 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libgtk2.0-common. 2024-04-03T04:02:51.309 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174890 files and directories currently installed.) 2024-04-03T04:02:51.314 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2_all.deb ... 2024-04-03T04:02:51.362 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2) ... 2024-04-03T04:02:51.716 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-04-03T04:02:51.744 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2_amd64.deb ... 2024-04-03T04:02:51.824 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2) ... 2024-04-03T04:02:52.295 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libgail18:amd64. 2024-04-03T04:02:52.323 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2_amd64.deb ... 2024-04-03T04:02:52.362 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2) ... 2024-04-03T04:02:52.773 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libgail-common:amd64. 2024-04-03T04:02:52.801 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2_amd64.deb ... 2024-04-03T04:02:52.831 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2) ... 2024-04-03T04:02:53.146 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-04-03T04:02:53.174 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2_amd64.deb ... 2024-04-03T04:02:53.216 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2) ... 2024-04-03T04:02:53.670 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-04-03T04:02:53.699 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u402-ga-2ubuntu1~22.04_amd64.deb ... 2024-04-03T04:02:53.740 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u402-ga-2ubuntu1~22.04) ... 2024-04-03T04:02:55.309 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-04-03T04:02:55.337 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../6-openjdk-8-jre_8u402-ga-2ubuntu1~22.04_amd64.deb ... 2024-04-03T04:02:55.379 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking openjdk-8-jre:amd64 (8u402-ga-2ubuntu1~22.04) ... 2024-04-03T04:02:55.822 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-04-03T04:02:55.850 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u402-ga-2ubuntu1~22.04_amd64.deb ... 2024-04-03T04:02:55.891 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u402-ga-2ubuntu1~22.04) ... 2024-04-03T04:02:56.650 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-04-03T04:02:56.680 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u402-ga-2ubuntu1~22.04_amd64.deb ... 2024-04-03T04:02:56.729 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking openjdk-8-jdk:amd64 (8u402-ga-2ubuntu1~22.04) ... 2024-04-03T04:02:57.087 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up openjdk-8-jre-headless:amd64 (8u402-ga-2ubuntu1~22.04) ... 2024-04-03T04:02:58.291 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-04-03T04:02:58.308 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-04-03T04:02:58.334 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-04-03T04:02:58.683 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2) ... 2024-04-03T04:02:58.852 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2) ... 2024-04-03T04:02:59.228 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up openjdk-8-jre:amd64 (8u402-ga-2ubuntu1~22.04) ... 2024-04-03T04:02:59.327 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-04-03T04:02:59.388 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u402-ga-2ubuntu1~22.04) ... 2024-04-03T04:02:59.480 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-04-03T04:02:59.509 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-04-03T04:02:59.535 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-04-03T04:02:59.560 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-04-03T04:02:59.686 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-04-03T04:02:59.856 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-04-03T04:02:59.975 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-04-03T04:03:00.068 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-04-03T04:03:00.109 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-04-03T04:03:00.160 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-04-03T04:03:00.186 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-04-03T04:03:00.212 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-04-03T04:03:00.276 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2) ... 2024-04-03T04:03:00.385 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2) ... 2024-04-03T04:03:00.503 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up openjdk-8-jdk:amd64 (8u402-ga-2ubuntu1~22.04) ... 2024-04-03T04:03:00.596 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-04-03T04:03:00.680 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2) ... 2024-04-03T04:03:00.807 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-03T04:03:01.916 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-03T04:03:02.016 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-03T04:03:02.302 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-03T04:03:02.726 INFO:teuthology.orchestra.run.smithi104.stdout: Gradle will be installed under /opt/gradle 2024-04-03T04:03:02.752 INFO:teuthology.orchestra.run.smithi104.stderr:--2024-04-03 04:03:02-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-04-03T04:03:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-04-03T04:03:02.765 INFO:teuthology.orchestra.run.smithi104.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-04-03T04:03:02.809 INFO:teuthology.orchestra.run.smithi104.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-04-03T04:03:02.809 INFO:teuthology.orchestra.run.smithi104.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-04-03T04:03:02.809 INFO:teuthology.orchestra.run.smithi104.stderr:--2024-04-03 04:03:02-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-04-03T04:03:02.810 INFO:teuthology.orchestra.run.smithi104.stderr:Resolving github.com (github.com)... 140.82.112.3 2024-04-03T04:03:02.844 INFO:teuthology.orchestra.run.smithi104.stderr:Connecting to github.com (github.com)|140.82.112.3|:443... connected. 2024-04-03T04:03:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:HTTP request sent, awaiting response... 302 Found 2024-04-03T04:03:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240403%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240403T040236Z&X-Amz-Expires=300&X-Amz-Signature=1e455cdbdb19b1c6b28f6a2e493ea0676eb6b35dcba0bbec0e893c85fec8ac99&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-04-03T04:03:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:--2024-04-03 04:03:02-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240403%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240403T040236Z&X-Amz-Expires=300&X-Amz-Signature=1e455cdbdb19b1c6b28f6a2e493ea0676eb6b35dcba0bbec0e893c85fec8ac99&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-04-03T04:03:02.949 INFO:teuthology.orchestra.run.smithi104.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.109.133, 185.199.111.133, ... 2024-04-03T04:03:02.964 INFO:teuthology.orchestra.run.smithi104.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-04-03T04:03:03.048 INFO:teuthology.orchestra.run.smithi104.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-03T04:03:03.048 INFO:teuthology.orchestra.run.smithi104.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-04-03T04:03:03.048 INFO:teuthology.orchestra.run.smithi104.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-04-03T04:03:03.048 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-03T04:03:03.065 INFO:teuthology.orchestra.run.smithi104.stderr: 0K .......... .......... .......... .......... .......... 0% 2.84M 32s 2024-04-03T04:03:03.078 INFO:teuthology.orchestra.run.smithi104.stderr: 50K .......... .......... .......... .......... .......... 0% 3.73M 28s 2024-04-03T04:03:03.081 INFO:teuthology.orchestra.run.smithi104.stderr: 100K .......... .......... .......... .......... .......... 0% 16.4M 21s 2024-04-03T04:03:03.084 INFO:teuthology.orchestra.run.smithi104.stderr: 150K .......... .......... .......... .......... .......... 0% 12.4M 17s 2024-04-03T04:03:03.092 INFO:teuthology.orchestra.run.smithi104.stderr: 200K .......... .......... .......... .......... .......... 0% 6.59M 17s 2024-04-03T04:03:03.094 INFO:teuthology.orchestra.run.smithi104.stderr: 250K .......... .......... .......... .......... .......... 0% 20.7M 14s 2024-04-03T04:03:03.096 INFO:teuthology.orchestra.run.smithi104.stderr: 300K .......... .......... .......... .......... .......... 0% 25.9M 13s 2024-04-03T04:03:03.102 INFO:teuthology.orchestra.run.smithi104.stderr: 350K .......... .......... .......... .......... .......... 0% 10.9M 12s 2024-04-03T04:03:03.102 INFO:teuthology.orchestra.run.smithi104.stderr: 400K .......... .......... .......... .......... .......... 0% 59.6M 11s 2024-04-03T04:03:03.111 INFO:teuthology.orchestra.run.smithi104.stderr: 450K .......... .......... .......... .......... .......... 0% 9.42M 11s 2024-04-03T04:03:03.111 INFO:teuthology.orchestra.run.smithi104.stderr: 500K .......... .......... .......... .......... .......... 0% 54.9M 10s 2024-04-03T04:03:03.111 INFO:teuthology.orchestra.run.smithi104.stderr: 550K .......... .......... .......... .......... .......... 0% 87.0M 9s 2024-04-03T04:03:03.114 INFO:teuthology.orchestra.run.smithi104.stderr: 600K .......... .......... .......... .......... .......... 0% 33.0M 9s 2024-04-03T04:03:03.114 INFO:teuthology.orchestra.run.smithi104.stderr: 650K .......... .......... .......... .......... .......... 0% 58.0M 8s 2024-04-03T04:03:03.114 INFO:teuthology.orchestra.run.smithi104.stderr: 700K .......... .......... .......... .......... .......... 0% 62.9M 8s 2024-04-03T04:03:03.114 INFO:teuthology.orchestra.run.smithi104.stderr: 750K .......... .......... .......... .......... .......... 0% 41.0M 7s 2024-04-03T04:03:03.116 INFO:teuthology.orchestra.run.smithi104.stderr: 800K .......... .......... .......... .......... .......... 0% 18.0M 7s 2024-04-03T04:03:03.116 INFO:teuthology.orchestra.run.smithi104.stderr: 850K .......... .......... .......... .......... .......... 0% 87.0M 7s 2024-04-03T04:03:03.120 INFO:teuthology.orchestra.run.smithi104.stderr: 900K .......... .......... .......... .......... .......... 1% 12.3M 7s 2024-04-03T04:03:03.120 INFO:teuthology.orchestra.run.smithi104.stderr: 950K .......... .......... .......... .......... .......... 1% 92.5M 7s 2024-04-03T04:03:03.130 INFO:teuthology.orchestra.run.smithi104.stderr: 1000K .......... .......... .......... .......... .......... 1% 44.9M 6s 2024-04-03T04:03:03.130 INFO:teuthology.orchestra.run.smithi104.stderr: 1050K .......... .......... .......... .......... .......... 1% 98.7M 6s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1100K .......... .......... .......... .......... .......... 1% 87.6M 6s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1150K .......... .......... .......... .......... .......... 1% 75.7M 6s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1200K .......... .......... .......... .......... .......... 1% 113M 6s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1250K .......... .......... .......... .......... .......... 1% 59.8M 5s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1300K .......... .......... .......... .......... .......... 1% 100M 5s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1350K .......... .......... .......... .......... .......... 1% 99.0M 5s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1400K .......... .......... .......... .......... .......... 1% 105M 5s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1450K .......... .......... .......... .......... .......... 1% 70.5M 5s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1500K .......... .......... .......... .......... .......... 1% 79.2M 5s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1550K .......... .......... .......... .......... .......... 1% 84.2M 5s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1600K .......... .......... .......... .......... .......... 1% 25.2M 5s 2024-04-03T04:03:03.131 INFO:teuthology.orchestra.run.smithi104.stderr: 1650K .......... .......... .......... .......... .......... 1% 54.4M 4s 2024-04-03T04:03:04.400 INFO:teuthology.orchestra.run.smithi104.stderr: 1700K .......... .......... .......... .......... .......... 1% 47.9M 4s 2024-04-03T04:03:04.400 INFO:teuthology.orchestra.run.smithi104.stderr: 1750K .......... .......... .......... .......... .......... 1% 34.8M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 1800K .......... .......... .......... .......... .......... 1% 74.3M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 1850K .......... .......... .......... .......... .......... 2% 95.5M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 1900K .......... .......... .......... .......... .......... 2% 36.1M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 1950K .......... .......... .......... .......... .......... 2% 69.2M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 2000K .......... .......... .......... .......... .......... 2% 57.7M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 2050K .......... .......... .......... .......... .......... 2% 105M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 2100K .......... .......... .......... .......... .......... 2% 102M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 2150K .......... .......... .......... .......... .......... 2% 72.0M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 2200K .......... .......... .......... .......... .......... 2% 94.2M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 2250K .......... .......... .......... .......... .......... 2% 97.5M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 2300K .......... .......... .......... .......... .......... 2% 87.4M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 2350K .......... .......... .......... .......... .......... 2% 36.9M 4s 2024-04-03T04:03:04.401 INFO:teuthology.orchestra.run.smithi104.stderr: 2400K .......... .......... .......... .......... .......... 2% 105M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2450K .......... .......... .......... .......... .......... 2% 88.8M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2500K .......... .......... .......... .......... .......... 2% 98.2M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2550K .......... .......... .......... .......... .......... 2% 82.6M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2600K .......... .......... .......... .......... .......... 2% 80.6M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2650K .......... .......... .......... .......... .......... 2% 93.8M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2700K .......... .......... .......... .......... .......... 2% 90.2M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2750K .......... .......... .......... .......... .......... 3% 78.4M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2800K .......... .......... .......... .......... .......... 3% 71.7M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2850K .......... .......... .......... .......... .......... 3% 94.9M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2900K .......... .......... .......... .......... .......... 3% 47.3M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 2950K .......... .......... .......... .......... .......... 3% 88.1M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 3000K .......... .......... .......... .......... .......... 3% 71.1M 3s 2024-04-03T04:03:04.402 INFO:teuthology.orchestra.run.smithi104.stderr: 3050K .......... .......... .......... .......... .......... 3% 94.2M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3100K .......... .......... .......... .......... .......... 3% 95.0M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3150K .......... .......... .......... .......... .......... 3% 81.7M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3200K .......... .......... .......... .......... .......... 3% 93.1M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3250K .......... .......... .......... .......... .......... 3% 18.6M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3300K .......... .......... .......... .......... .......... 3% 63.2M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3350K .......... .......... .......... .......... .......... 3% 96.0M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3400K .......... .......... .......... .......... .......... 3% 87.9M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3450K .......... .......... .......... .......... .......... 3% 71.0M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3500K .......... .......... .......... .......... .......... 3% 137M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3550K .......... .......... .......... .......... .......... 3% 30.5M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3600K .......... .......... .......... .......... .......... 3% 107M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3650K .......... .......... .......... .......... .......... 3% 65.3M 3s 2024-04-03T04:03:04.403 INFO:teuthology.orchestra.run.smithi104.stderr: 3700K .......... .......... .......... .......... .......... 4% 93.2M 3s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 3750K .......... .......... .......... .......... .......... 4% 103M 3s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 3800K .......... .......... .......... .......... .......... 4% 59.9M 3s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 3850K .......... .......... .......... .......... .......... 4% 91.6M 3s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 3900K .......... .......... .......... .......... .......... 4% 77.7M 3s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 3950K .......... .......... .......... .......... .......... 4% 78.5M 3s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 4000K .......... .......... .......... .......... .......... 4% 103M 3s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 4050K .......... .......... .......... .......... .......... 4% 83.5M 3s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 4100K .......... .......... .......... .......... .......... 4% 101M 3s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 4150K .......... .......... .......... .......... .......... 4% 88.3M 2s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 4200K .......... .......... .......... .......... .......... 4% 91.9M 2s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 4250K .......... .......... .......... .......... .......... 4% 125M 2s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 4300K .......... .......... .......... .......... .......... 4% 131M 2s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 4350K .......... .......... .......... .......... .......... 4% 85.0M 2s 2024-04-03T04:03:04.404 INFO:teuthology.orchestra.run.smithi104.stderr: 4400K .......... .......... .......... .......... .......... 4% 93.2M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4450K .......... .......... .......... .......... .......... 4% 103M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4500K .......... .......... .......... .......... .......... 4% 92.7M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4550K .......... .......... .......... .......... .......... 4% 87.5M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4600K .......... .......... .......... .......... .......... 5% 88.0M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4650K .......... .......... .......... .......... .......... 5% 144M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4700K .......... .......... .......... .......... .......... 5% 68.3M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4750K .......... .......... .......... .......... .......... 5% 53.1M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4800K .......... .......... .......... .......... .......... 5% 65.6M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4850K .......... .......... .......... .......... .......... 5% 112M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4900K .......... .......... .......... .......... .......... 5% 136M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 4950K .......... .......... .......... .......... .......... 5% 110M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 5000K .......... .......... .......... .......... .......... 5% 127M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 5050K .......... .......... .......... .......... .......... 5% 123M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 5100K .......... .......... .......... .......... .......... 5% 105M 2s 2024-04-03T04:03:04.405 INFO:teuthology.orchestra.run.smithi104.stderr: 5150K .......... .......... .......... .......... .......... 5% 82.5M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5200K .......... .......... .......... .......... .......... 5% 91.8M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5250K .......... .......... .......... .......... .......... 5% 98.0M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5300K .......... .......... .......... .......... .......... 5% 93.8M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5350K .......... .......... .......... .......... .......... 5% 75.5M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5400K .......... .......... .......... .......... .......... 5% 82.5M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5450K .......... .......... .......... .......... .......... 5% 79.8M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5500K .......... .......... .......... .......... .......... 5% 85.9M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5550K .......... .......... .......... .......... .......... 6% 67.6M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5600K .......... .......... .......... .......... .......... 6% 88.5M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5650K .......... .......... .......... .......... .......... 6% 96.1M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5700K .......... .......... .......... .......... .......... 6% 116M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5750K .......... .......... .......... .......... .......... 6% 138M 2s 2024-04-03T04:03:04.406 INFO:teuthology.orchestra.run.smithi104.stderr: 5800K .......... .......... .......... .......... .......... 6% 61.4M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 5850K .......... .......... .......... .......... .......... 6% 60.6M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 5900K .......... .......... .......... .......... .......... 6% 67.6M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 5950K .......... .......... .......... .......... .......... 6% 53.7M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 6000K .......... .......... .......... .......... .......... 6% 57.1M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 6050K .......... .......... .......... .......... .......... 6% 29.0M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 6100K .......... .......... .......... .......... .......... 6% 73.3M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 6150K .......... .......... .......... .......... .......... 6% 55.2M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 6200K .......... .......... .......... .......... .......... 6% 70.8M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 6250K .......... .......... .......... .......... .......... 6% 41.4M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 6300K .......... .......... .......... .......... .......... 6% 60.0M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 6350K .......... .......... .......... .......... .......... 6% 39.8M 2s 2024-04-03T04:03:04.407 INFO:teuthology.orchestra.run.smithi104.stderr: 6400K .......... .......... .......... .......... .......... 6% 87.0M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6450K .......... .......... .......... .......... .......... 6% 99.6M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6500K .......... .......... .......... .......... .......... 7% 54.9M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6550K .......... .......... .......... .......... .......... 7% 75.1M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6600K .......... .......... .......... .......... .......... 7% 93.9M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6650K .......... .......... .......... .......... .......... 7% 103M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6700K .......... .......... .......... .......... .......... 7% 88.7M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6750K .......... .......... .......... .......... .......... 7% 92.8M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6800K .......... .......... .......... .......... .......... 7% 94.6M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6850K .......... .......... .......... .......... .......... 7% 74.5M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6900K .......... .......... .......... .......... .......... 7% 102M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 6950K .......... .......... .......... .......... .......... 7% 89.4M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 7000K .......... .......... .......... .......... .......... 7% 125M 2s 2024-04-03T04:03:04.408 INFO:teuthology.orchestra.run.smithi104.stderr: 7050K .......... .......... .......... .......... .......... 7% 78.6M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7100K .......... .......... .......... .......... .......... 7% 87.3M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7150K .......... .......... .......... .......... .......... 7% 84.6M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7200K .......... .......... .......... .......... .......... 7% 103M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7250K .......... .......... .......... .......... .......... 7% 102M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7300K .......... .......... .......... .......... .......... 7% 91.7M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7350K .......... .......... .......... .......... .......... 7% 91.2M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7400K .......... .......... .......... .......... .......... 8% 77.2M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7450K .......... .......... .......... .......... .......... 8% 97.7M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7500K .......... .......... .......... .......... .......... 8% 24.1M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7550K .......... .......... .......... .......... .......... 8% 78.9M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7600K .......... .......... .......... .......... .......... 8% 65.2M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7650K .......... .......... .......... .......... .......... 8% 74.9M 2s 2024-04-03T04:03:04.409 INFO:teuthology.orchestra.run.smithi104.stderr: 7700K .......... .......... .......... .......... .......... 8% 97.0M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 7750K .......... .......... .......... .......... .......... 8% 34.3M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 7800K .......... .......... .......... .......... .......... 8% 37.1M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 7850K .......... .......... .......... .......... .......... 8% 56.6M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 7900K .......... .......... .......... .......... .......... 8% 93.6M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 7950K .......... .......... .......... .......... .......... 8% 80.7M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 8000K .......... .......... .......... .......... .......... 8% 84.9M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 8050K .......... .......... .......... .......... .......... 8% 92.3M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 8100K .......... .......... .......... .......... .......... 8% 98.6M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 8150K .......... .......... .......... .......... .......... 8% 93.6M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 8200K .......... .......... .......... .......... .......... 8% 117M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 8250K .......... .......... .......... .......... .......... 8% 87.9M 2s 2024-04-03T04:03:04.410 INFO:teuthology.orchestra.run.smithi104.stderr: 8300K .......... .......... .......... .......... .......... 8% 87.5M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8350K .......... .......... .......... .......... .......... 9% 56.9M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8400K .......... .......... .......... .......... .......... 9% 108M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8450K .......... .......... .......... .......... .......... 9% 104M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8500K .......... .......... .......... .......... .......... 9% 87.4M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8550K .......... .......... .......... .......... .......... 9% 88.6M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8600K .......... .......... .......... .......... .......... 9% 104M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8650K .......... .......... .......... .......... .......... 9% 107M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8700K .......... .......... .......... .......... .......... 9% 93.4M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8750K .......... .......... .......... .......... .......... 9% 88.8M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8800K .......... .......... .......... .......... .......... 9% 88.7M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8850K .......... .......... .......... .......... .......... 9% 31.5M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8900K .......... .......... .......... .......... .......... 9% 10.7M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 8950K .......... .......... .......... .......... .......... 9% 73.5M 2s 2024-04-03T04:03:04.411 INFO:teuthology.orchestra.run.smithi104.stderr: 9000K .......... .......... .......... .......... .......... 9% 113M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9050K .......... .......... .......... .......... .......... 9% 106M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9100K .......... .......... .......... .......... .......... 9% 120M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9150K .......... .......... .......... .......... .......... 9% 127M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9200K .......... .......... .......... .......... .......... 9% 147M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9250K .......... .......... .......... .......... .......... 10% 131M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9300K .......... .......... .......... .......... .......... 10% 117M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9350K .......... .......... .......... .......... .......... 10% 130M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9400K .......... .......... .......... .......... .......... 10% 165M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9450K .......... .......... .......... .......... .......... 10% 145M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9500K .......... .......... .......... .......... .......... 10% 101M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9550K .......... .......... .......... .......... .......... 10% 86.4M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9600K .......... .......... .......... .......... .......... 10% 107M 2s 2024-04-03T04:03:04.412 INFO:teuthology.orchestra.run.smithi104.stderr: 9650K .......... .......... .......... .......... .......... 10% 105M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 9700K .......... .......... .......... .......... .......... 10% 106M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 9750K .......... .......... .......... .......... .......... 10% 91.9M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 9800K .......... .......... .......... .......... .......... 10% 106M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 9850K .......... .......... .......... .......... .......... 10% 110M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 9900K .......... .......... .......... .......... .......... 10% 106M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 9950K .......... .......... .......... .......... .......... 10% 93.3M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 10000K .......... .......... .......... .......... .......... 10% 87.0M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 10050K .......... .......... .......... .......... .......... 10% 110M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 10100K .......... .......... .......... .......... .......... 10% 113M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 10150K .......... .......... .......... .......... .......... 10% 69.1M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 10200K .......... .......... .......... .......... .......... 11% 82.6M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 10250K .......... .......... .......... .......... .......... 11% 111M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 10300K .......... .......... .......... .......... .......... 11% 49.5M 2s 2024-04-03T04:03:04.413 INFO:teuthology.orchestra.run.smithi104.stderr: 10350K .......... .......... .......... .......... .......... 11% 73.6M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10400K .......... .......... .......... .......... .......... 11% 84.9M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10450K .......... .......... .......... .......... .......... 11% 56.9M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10500K .......... .......... .......... .......... .......... 11% 109M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10550K .......... .......... .......... .......... .......... 11% 93.3M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10600K .......... .......... .......... .......... .......... 11% 99.5M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10650K .......... .......... .......... .......... .......... 11% 84.1M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10700K .......... .......... .......... .......... .......... 11% 66.0M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10750K .......... .......... .......... .......... .......... 11% 29.9M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10800K .......... .......... .......... .......... .......... 11% 90.4M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10850K .......... .......... .......... .......... .......... 11% 75.1M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10900K .......... .......... .......... .......... .......... 11% 46.5M 2s 2024-04-03T04:03:04.414 INFO:teuthology.orchestra.run.smithi104.stderr: 10950K .......... .......... .......... .......... .......... 11% 48.4M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11000K .......... .......... .......... .......... .......... 11% 119M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11050K .......... .......... .......... .......... .......... 11% 74.6M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11100K .......... .......... .......... .......... .......... 12% 53.1M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11150K .......... .......... .......... .......... .......... 12% 50.8M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11200K .......... .......... .......... .......... .......... 12% 93.8M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11250K .......... .......... .......... .......... .......... 12% 93.2M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11300K .......... .......... .......... .......... .......... 12% 51.4M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11350K .......... .......... .......... .......... .......... 12% 59.0M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11400K .......... .......... .......... .......... .......... 12% 87.9M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11450K .......... .......... .......... .......... .......... 12% 104M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11500K .......... .......... .......... .......... .......... 12% 73.6M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11550K .......... .......... .......... .......... .......... 12% 50.0M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11600K .......... .......... .......... .......... .......... 12% 44.2M 2s 2024-04-03T04:03:04.415 INFO:teuthology.orchestra.run.smithi104.stderr: 11650K .......... .......... .......... .......... .......... 12% 64.2M 2s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 11700K .......... .......... .......... .......... .......... 12% 95.4M 1s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 11750K .......... .......... .......... .......... .......... 12% 76.8M 1s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 11800K .......... .......... .......... .......... .......... 12% 98.5M 1s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 11850K .......... .......... .......... .......... .......... 12% 62.7M 1s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 11900K .......... .......... .......... .......... .......... 12% 103M 1s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 11950K .......... .......... .......... .......... .......... 12% 9.58M 2s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 12000K .......... .......... .......... .......... .......... 12% 88.9M 2s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 12050K .......... .......... .......... .......... .......... 13% 95.2M 2s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 12100K .......... .......... .......... .......... .......... 13% 99.8M 2s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 12150K .......... .......... .......... .......... .......... 13% 81.6M 1s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 12200K .......... .......... .......... .......... .......... 13% 93.1M 1s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 12250K .......... .......... .......... .......... .......... 13% 93.1M 1s 2024-04-03T04:03:04.416 INFO:teuthology.orchestra.run.smithi104.stderr: 12300K .......... .......... .......... .......... .......... 13% 93.3M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12350K .......... .......... .......... .......... .......... 13% 86.4M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12400K .......... .......... .......... .......... .......... 13% 88.3M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12450K .......... .......... .......... .......... .......... 13% 104M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12500K .......... .......... .......... .......... .......... 13% 98.4M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12550K .......... .......... .......... .......... .......... 13% 80.4M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12600K .......... .......... .......... .......... .......... 13% 106M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12650K .......... .......... .......... .......... .......... 13% 95.1M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12700K .......... .......... .......... .......... .......... 13% 99.7M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12750K .......... .......... .......... .......... .......... 13% 60.0M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12800K .......... .......... .......... .......... .......... 13% 99.4M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12850K .......... .......... .......... .......... .......... 13% 101M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12900K .......... .......... .......... .......... .......... 13% 98.1M 1s 2024-04-03T04:03:04.417 INFO:teuthology.orchestra.run.smithi104.stderr: 12950K .......... .......... .......... .......... .......... 13% 88.3M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13000K .......... .......... .......... .......... .......... 14% 99.0M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13050K .......... .......... .......... .......... .......... 14% 100M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13100K .......... .......... .......... .......... .......... 14% 108M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13150K .......... .......... .......... .......... .......... 14% 86.4M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13200K .......... .......... .......... .......... .......... 14% 104M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13250K .......... .......... .......... .......... .......... 14% 109M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13300K .......... .......... .......... .......... .......... 14% 98.3M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13350K .......... .......... .......... .......... .......... 14% 98.0M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13400K .......... .......... .......... .......... .......... 14% 106M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13450K .......... .......... .......... .......... .......... 14% 107M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13500K .......... .......... .......... .......... .......... 14% 136M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13550K .......... .......... .......... .......... .......... 14% 111M 1s 2024-04-03T04:03:04.418 INFO:teuthology.orchestra.run.smithi104.stderr: 13600K .......... .......... .......... .......... .......... 14% 130M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 13650K .......... .......... .......... .......... .......... 14% 121M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 13700K .......... .......... .......... .......... .......... 14% 105M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 13750K .......... .......... .......... .......... .......... 14% 96.5M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 13800K .......... .......... .......... .......... .......... 14% 118M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 13850K .......... .......... .......... .......... .......... 14% 107M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 13900K .......... .......... .......... .......... .......... 15% 111M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 13950K .......... .......... .......... .......... .......... 15% 54.6M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 14000K .......... .......... .......... .......... .......... 15% 73.6M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 14050K .......... .......... .......... .......... .......... 15% 115M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 14100K .......... .......... .......... .......... .......... 15% 80.2M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 14150K .......... .......... .......... .......... .......... 15% 76.2M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 14200K .......... .......... .......... .......... .......... 15% 91.3M 1s 2024-04-03T04:03:04.419 INFO:teuthology.orchestra.run.smithi104.stderr: 14250K .......... .......... .......... .......... .......... 15% 119M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14300K .......... .......... .......... .......... .......... 15% 51.9M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14350K .......... .......... .......... .......... .......... 15% 69.5M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14400K .......... .......... .......... .......... .......... 15% 39.4M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14450K .......... .......... .......... .......... .......... 15% 73.1M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14500K .......... .......... .......... .......... .......... 15% 113M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14550K .......... .......... .......... .......... .......... 15% 67.2M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14600K .......... .......... .......... .......... .......... 15% 86.5M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14650K .......... .......... .......... .......... .......... 15% 29.9M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14700K .......... .......... .......... .......... .......... 15% 85.3M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14750K .......... .......... .......... .......... .......... 15% 90.2M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14800K .......... .......... .......... .......... .......... 15% 120M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14850K .......... .......... .......... .......... .......... 16% 49.4M 1s 2024-04-03T04:03:04.420 INFO:teuthology.orchestra.run.smithi104.stderr: 14900K .......... .......... .......... .......... .......... 16% 21.4M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 14950K .......... .......... .......... .......... .......... 16% 99.3M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15000K .......... .......... .......... .......... .......... 16% 83.9M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15050K .......... .......... .......... .......... .......... 16% 78.3M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15100K .......... .......... .......... .......... .......... 16% 67.2M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15150K .......... .......... .......... .......... .......... 16% 85.0M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15200K .......... .......... .......... .......... .......... 16% 115M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15250K .......... .......... .......... .......... .......... 16% 43.0M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15300K .......... .......... .......... .......... .......... 16% 52.6M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15350K .......... .......... .......... .......... .......... 16% 64.5M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15400K .......... .......... .......... .......... .......... 16% 106M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15450K .......... .......... .......... .......... .......... 16% 47.5M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15500K .......... .......... .......... .......... .......... 16% 88.2M 1s 2024-04-03T04:03:04.421 INFO:teuthology.orchestra.run.smithi104.stderr: 15550K .......... .......... .......... .......... .......... 16% 58.4M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 15600K .......... .......... .......... .......... .......... 16% 84.8M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 15650K .......... .......... .......... .......... .......... 16% 109M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 15700K .......... .......... .......... .......... .......... 16% 61.1M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 15750K .......... .......... .......... .......... .......... 17% 59.3M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 15800K .......... .......... .......... .......... .......... 17% 75.1M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 15850K .......... .......... .......... .......... .......... 17% 91.4M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 15900K .......... .......... .......... .......... .......... 17% 119M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 15950K .......... .......... .......... .......... .......... 17% 55.8M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 16000K .......... .......... .......... .......... .......... 17% 125M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 16050K .......... .......... .......... .......... .......... 17% 74.8M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 16100K .......... .......... .......... .......... .......... 17% 93.9M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 16150K .......... .......... .......... .......... .......... 17% 101M 1s 2024-04-03T04:03:04.422 INFO:teuthology.orchestra.run.smithi104.stderr: 16200K .......... .......... .......... .......... .......... 17% 78.4M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16250K .......... .......... .......... .......... .......... 17% 100M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16300K .......... .......... .......... .......... .......... 17% 93.0M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16350K .......... .......... .......... .......... .......... 17% 67.0M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16400K .......... .......... .......... .......... .......... 17% 101M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16450K .......... .......... .......... .......... .......... 17% 91.2M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16500K .......... .......... .......... .......... .......... 17% 83.3M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16550K .......... .......... .......... .......... .......... 17% 106M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16600K .......... .......... .......... .......... .......... 17% 113M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16650K .......... .......... .......... .......... .......... 17% 82.7M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16700K .......... .......... .......... .......... .......... 18% 79.6M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16750K .......... .......... .......... .......... .......... 18% 80.6M 1s 2024-04-03T04:03:04.423 INFO:teuthology.orchestra.run.smithi104.stderr: 16800K .......... .......... .......... .......... .......... 18% 119M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 16850K .......... .......... .......... .......... .......... 18% 88.8M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 16900K .......... .......... .......... .......... .......... 18% 80.5M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 16950K .......... .......... .......... .......... .......... 18% 60.8M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17000K .......... .......... .......... .......... .......... 18% 95.8M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17050K .......... .......... .......... .......... .......... 18% 115M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17100K .......... .......... .......... .......... .......... 18% 89.9M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17150K .......... .......... .......... .......... .......... 18% 54.2M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17200K .......... .......... .......... .......... .......... 18% 73.9M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17250K .......... .......... .......... .......... .......... 18% 78.5M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17300K .......... .......... .......... .......... .......... 18% 109M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17350K .......... .......... .......... .......... .......... 18% 105M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17400K .......... .......... .......... .......... .......... 18% 56.1M 1s 2024-04-03T04:03:04.424 INFO:teuthology.orchestra.run.smithi104.stderr: 17450K .......... .......... .......... .......... .......... 18% 81.5M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17500K .......... .......... .......... .......... .......... 18% 113M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17550K .......... .......... .......... .......... .......... 18% 52.1M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17600K .......... .......... .......... .......... .......... 18% 47.3M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17650K .......... .......... .......... .......... .......... 19% 54.4M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17700K .......... .......... .......... .......... .......... 19% 36.2M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17750K .......... .......... .......... .......... .......... 19% 40.3M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17800K .......... .......... .......... .......... .......... 19% 88.1M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17850K .......... .......... .......... .......... .......... 19% 39.7M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17900K .......... .......... .......... .......... .......... 19% 93.5M 1s 2024-04-03T04:03:04.425 INFO:teuthology.orchestra.run.smithi104.stderr: 17950K .......... .......... .......... .......... .......... 19% 38.9M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18000K .......... .......... .......... .......... .......... 19% 49.2M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18050K .......... .......... .......... .......... .......... 19% 92.6M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18100K .......... .......... .......... .......... .......... 19% 101M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18150K .......... .......... .......... .......... .......... 19% 90.9M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18200K .......... .......... .......... .......... .......... 19% 109M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18250K .......... .......... .......... .......... .......... 19% 81.0M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18300K .......... .......... .......... .......... .......... 19% 62.5M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18350K .......... .......... .......... .......... .......... 19% 74.8M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18400K .......... .......... .......... .......... .......... 19% 151M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18450K .......... .......... .......... .......... .......... 19% 134M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18500K .......... .......... .......... .......... .......... 19% 95.1M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18550K .......... .......... .......... .......... .......... 20% 96.5M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18600K .......... .......... .......... .......... .......... 20% 102M 1s 2024-04-03T04:03:04.426 INFO:teuthology.orchestra.run.smithi104.stderr: 18650K .......... .......... .......... .......... .......... 20% 114M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 18700K .......... .......... .......... .......... .......... 20% 124M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 18750K .......... .......... .......... .......... .......... 20% 85.8M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 18800K .......... .......... .......... .......... .......... 20% 101M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 18850K .......... .......... .......... .......... .......... 20% 114M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 18900K .......... .......... .......... .......... .......... 20% 111M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 18950K .......... .......... .......... .......... .......... 20% 110M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 19000K .......... .......... .......... .......... .......... 20% 120M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 19050K .......... .......... .......... .......... .......... 20% 80.9M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 19100K .......... .......... .......... .......... .......... 20% 79.4M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 19150K .......... .......... .......... .......... .......... 20% 54.8M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 19200K .......... .......... .......... .......... .......... 20% 79.7M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 19250K .......... .......... .......... .......... .......... 20% 118M 1s 2024-04-03T04:03:04.427 INFO:teuthology.orchestra.run.smithi104.stderr: 19300K .......... .......... .......... .......... .......... 20% 159M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19350K .......... .......... .......... .......... .......... 20% 104M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19400K .......... .......... .......... .......... .......... 20% 117M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19450K .......... .......... .......... .......... .......... 20% 88.2M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19500K .......... .......... .......... .......... .......... 21% 125M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19550K .......... .......... .......... .......... .......... 21% 89.0M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19600K .......... .......... .......... .......... .......... 21% 107M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19650K .......... .......... .......... .......... .......... 21% 117M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19700K .......... .......... .......... .......... .......... 21% 99.0M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19750K .......... .......... .......... .......... .......... 21% 74.4M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19800K .......... .......... .......... .......... .......... 21% 73.9M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19850K .......... .......... .......... .......... .......... 21% 98.5M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19900K .......... .......... .......... .......... .......... 21% 62.7M 1s 2024-04-03T04:03:04.428 INFO:teuthology.orchestra.run.smithi104.stderr: 19950K .......... .......... .......... .......... .......... 21% 75.7M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20000K .......... .......... .......... .......... .......... 21% 79.0M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20050K .......... .......... .......... .......... .......... 21% 52.0M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20100K .......... .......... .......... .......... .......... 21% 129M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20150K .......... .......... .......... .......... .......... 21% 112M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20200K .......... .......... .......... .......... .......... 21% 92.9M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20250K .......... .......... .......... .......... .......... 21% 120M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20300K .......... .......... .......... .......... .......... 21% 114M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20350K .......... .......... .......... .......... .......... 21% 57.9M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20400K .......... .......... .......... .......... .......... 22% 105M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20450K .......... .......... .......... .......... .......... 22% 64.9M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20500K .......... .......... .......... .......... .......... 22% 46.2M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20550K .......... .......... .......... .......... .......... 22% 108M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20600K .......... .......... .......... .......... .......... 22% 49.6M 1s 2024-04-03T04:03:04.429 INFO:teuthology.orchestra.run.smithi104.stderr: 20650K .......... .......... .......... .......... .......... 22% 29.4M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 20700K .......... .......... .......... .......... .......... 22% 43.3M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 20750K .......... .......... .......... .......... .......... 22% 23.0M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 20800K .......... .......... .......... .......... .......... 22% 105M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 20850K .......... .......... .......... .......... .......... 22% 57.5M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 20900K .......... .......... .......... .......... .......... 22% 67.4M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 20950K .......... .......... .......... .......... .......... 22% 94.7M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 21000K .......... .......... .......... .......... .......... 22% 115M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 21050K .......... .......... .......... .......... .......... 22% 36.5M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 21100K .......... .......... .......... .......... .......... 22% 83.7M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 21150K .......... .......... .......... .......... .......... 22% 72.8M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 21200K .......... .......... .......... .......... .......... 22% 80.1M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 21250K .......... .......... .......... .......... .......... 22% 101M 1s 2024-04-03T04:03:04.430 INFO:teuthology.orchestra.run.smithi104.stderr: 21300K .......... .......... .......... .......... .......... 22% 120M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21350K .......... .......... .......... .......... .......... 23% 53.0M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21400K .......... .......... .......... .......... .......... 23% 118M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21450K .......... .......... .......... .......... .......... 23% 101M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21500K .......... .......... .......... .......... .......... 23% 116M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21550K .......... .......... .......... .......... .......... 23% 95.9M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21600K .......... .......... .......... .......... .......... 23% 117M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21650K .......... .......... .......... .......... .......... 23% 119M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21700K .......... .......... .......... .......... .......... 23% 119M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21750K .......... .......... .......... .......... .......... 23% 107M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21800K .......... .......... .......... .......... .......... 23% 90.4M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21850K .......... .......... .......... .......... .......... 23% 65.4M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21900K .......... .......... .......... .......... .......... 23% 59.1M 1s 2024-04-03T04:03:04.431 INFO:teuthology.orchestra.run.smithi104.stderr: 21950K .......... .......... .......... .......... .......... 23% 98.9M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22000K .......... .......... .......... .......... .......... 23% 114M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22050K .......... .......... .......... .......... .......... 23% 114M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22100K .......... .......... .......... .......... .......... 23% 108M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22150K .......... .......... .......... .......... .......... 23% 71.0M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22200K .......... .......... .......... .......... .......... 23% 123M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22250K .......... .......... .......... .......... .......... 24% 110M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22300K .......... .......... .......... .......... .......... 24% 101M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22350K .......... .......... .......... .......... .......... 24% 98.5M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22400K .......... .......... .......... .......... .......... 24% 93.6M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22450K .......... .......... .......... .......... .......... 24% 100M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22500K .......... .......... .......... .......... .......... 24% 93.4M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22550K .......... .......... .......... .......... .......... 24% 89.1M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22600K .......... .......... .......... .......... .......... 24% 125M 1s 2024-04-03T04:03:04.432 INFO:teuthology.orchestra.run.smithi104.stderr: 22650K .......... .......... .......... .......... .......... 24% 172M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 22700K .......... .......... .......... .......... .......... 24% 75.9M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 22750K .......... .......... .......... .......... .......... 24% 88.4M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 22800K .......... .......... .......... .......... .......... 24% 69.7M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 22850K .......... .......... .......... .......... .......... 24% 64.2M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 22900K .......... .......... .......... .......... .......... 24% 104M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 22950K .......... .......... .......... .......... .......... 24% 72.3M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 23000K .......... .......... .......... .......... .......... 24% 67.8M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 23050K .......... .......... .......... .......... .......... 24% 56.3M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 23100K .......... .......... .......... .......... .......... 24% 97.9M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 23150K .......... .......... .......... .......... .......... 24% 67.2M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 23200K .......... .......... .......... .......... .......... 25% 61.6M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 23250K .......... .......... .......... .......... .......... 25% 79.4M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 23300K .......... .......... .......... .......... .......... 25% 58.8M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 23350K .......... .......... .......... .......... .......... 25% 109M 1s 2024-04-03T04:03:04.433 INFO:teuthology.orchestra.run.smithi104.stderr: 23400K .......... .......... .......... .......... .......... 25% 43.5M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23450K .......... .......... .......... .......... .......... 25% 48.1M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23500K .......... .......... .......... .......... .......... 25% 53.4M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23550K .......... .......... .......... .......... .......... 25% 30.2M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23600K .......... .......... .......... .......... .......... 25% 116M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23650K .......... .......... .......... .......... .......... 25% 59.4M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23700K .......... .......... .......... .......... .......... 25% 40.7M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23750K .......... .......... .......... .......... .......... 25% 72.2M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23800K .......... .......... .......... .......... .......... 25% 88.6M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23850K .......... .......... .......... .......... .......... 25% 42.6M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23900K .......... .......... .......... .......... .......... 25% 98.3M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 23950K .......... .......... .......... .......... .......... 25% 46.1M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 24000K .......... .......... .......... .......... .......... 25% 112M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 24050K .......... .......... .......... .......... .......... 25% 61.5M 1s 2024-04-03T04:03:04.434 INFO:teuthology.orchestra.run.smithi104.stderr: 24100K .......... .......... .......... .......... .......... 25% 101M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24150K .......... .......... .......... .......... .......... 26% 84.4M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24200K .......... .......... .......... .......... .......... 26% 73.5M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24250K .......... .......... .......... .......... .......... 26% 82.0M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24300K .......... .......... .......... .......... .......... 26% 106M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24350K .......... .......... .......... .......... .......... 26% 60.9M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24400K .......... .......... .......... .......... .......... 26% 63.4M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24450K .......... .......... .......... .......... .......... 26% 87.1M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24500K .......... .......... .......... .......... .......... 26% 91.3M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24550K .......... .......... .......... .......... .......... 26% 94.8M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24600K .......... .......... .......... .......... .......... 26% 86.5M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24650K .......... .......... .......... .......... .......... 26% 110M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24700K .......... .......... .......... .......... .......... 26% 101M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24750K .......... .......... .......... .......... .......... 26% 75.2M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24800K .......... .......... .......... .......... .......... 26% 107M 1s 2024-04-03T04:03:04.435 INFO:teuthology.orchestra.run.smithi104.stderr: 24850K .......... .......... .......... .......... .......... 26% 67.8M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 24900K .......... .......... .......... .......... .......... 26% 93.0M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 24950K .......... .......... .......... .......... .......... 26% 86.0M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25000K .......... .......... .......... .......... .......... 26% 105M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25050K .......... .......... .......... .......... .......... 27% 106M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25100K .......... .......... .......... .......... .......... 27% 99.6M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25150K .......... .......... .......... .......... .......... 27% 83.1M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25200K .......... .......... .......... .......... .......... 27% 106M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25250K .......... .......... .......... .......... .......... 27% 105M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25300K .......... .......... .......... .......... .......... 27% 108M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25350K .......... .......... .......... .......... .......... 27% 72.4M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25400K .......... .......... .......... .......... .......... 27% 108M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25450K .......... .......... .......... .......... .......... 27% 112M 1s 2024-04-03T04:03:04.436 INFO:teuthology.orchestra.run.smithi104.stderr: 25500K .......... .......... .......... .......... .......... 27% 64.8M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 25550K .......... .......... .......... .......... .......... 27% 91.9M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 25600K .......... .......... .......... .......... .......... 27% 78.9M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 25650K .......... .......... .......... .......... .......... 27% 98.7M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 25700K .......... .......... .......... .......... .......... 27% 101M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 25750K .......... .......... .......... .......... .......... 27% 95.0M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 25800K .......... .......... .......... .......... .......... 27% 109M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 25850K .......... .......... .......... .......... .......... 27% 68.4M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 25900K .......... .......... .......... .......... .......... 27% 97.6M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 25950K .......... .......... .......... .......... .......... 27% 73.6M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 26000K .......... .......... .......... .......... .......... 28% 66.2M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 26050K .......... .......... .......... .......... .......... 28% 67.1M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 26100K .......... .......... .......... .......... .......... 28% 89.0M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 26150K .......... .......... .......... .......... .......... 28% 107M 1s 2024-04-03T04:03:04.437 INFO:teuthology.orchestra.run.smithi104.stderr: 26200K .......... .......... .......... .......... .......... 28% 62.2M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26250K .......... .......... .......... .......... .......... 28% 72.2M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26300K .......... .......... .......... .......... .......... 28% 86.8M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26350K .......... .......... .......... .......... .......... 28% 53.7M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26400K .......... .......... .......... .......... .......... 28% 78.7M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26450K .......... .......... .......... .......... .......... 28% 57.0M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26500K .......... .......... .......... .......... .......... 28% 67.4M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26550K .......... .......... .......... .......... .......... 28% 63.2M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26600K .......... .......... .......... .......... .......... 28% 50.0M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26650K .......... .......... .......... .......... .......... 28% 79.3M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26700K .......... .......... .......... .......... .......... 28% 56.1M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26750K .......... .......... .......... .......... .......... 28% 52.6M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26800K .......... .......... .......... .......... .......... 28% 72.5M 1s 2024-04-03T04:03:04.438 INFO:teuthology.orchestra.run.smithi104.stderr: 26850K .......... .......... .......... .......... .......... 28% 68.0M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 26900K .......... .......... .......... .......... .......... 29% 66.7M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 26950K .......... .......... .......... .......... .......... 29% 63.7M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27000K .......... .......... .......... .......... .......... 29% 57.7M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27050K .......... .......... .......... .......... .......... 29% 57.5M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27100K .......... .......... .......... .......... .......... 29% 74.1M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27150K .......... .......... .......... .......... .......... 29% 103M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27200K .......... .......... .......... .......... .......... 29% 70.6M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27250K .......... .......... .......... .......... .......... 29% 84.6M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27300K .......... .......... .......... .......... .......... 29% 124M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27350K .......... .......... .......... .......... .......... 29% 66.9M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27400K .......... .......... .......... .......... .......... 29% 97.7M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27450K .......... .......... .......... .......... .......... 29% 201M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27500K .......... .......... .......... .......... .......... 29% 177M 1s 2024-04-03T04:03:04.439 INFO:teuthology.orchestra.run.smithi104.stderr: 27550K .......... .......... .......... .......... .......... 29% 108M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 27600K .......... .......... .......... .......... .......... 29% 151M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 27650K .......... .......... .......... .......... .......... 29% 137M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 27700K .......... .......... .......... .......... .......... 29% 86.8M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 27750K .......... .......... .......... .......... .......... 29% 92.8M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 27800K .......... .......... .......... .......... .......... 29% 116M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 27850K .......... .......... .......... .......... .......... 30% 73.5M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 27900K .......... .......... .......... .......... .......... 30% 58.2M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 27950K .......... .......... .......... .......... .......... 30% 65.0M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 28000K .......... .......... .......... .......... .......... 30% 52.9M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 28050K .......... .......... .......... .......... .......... 30% 122M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 28100K .......... .......... .......... .......... .......... 30% 57.0M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 28150K .......... .......... .......... .......... .......... 30% 57.6M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 28200K .......... .......... .......... .......... .......... 30% 89.2M 1s 2024-04-03T04:03:04.440 INFO:teuthology.orchestra.run.smithi104.stderr: 28250K .......... .......... .......... .......... .......... 30% 118M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28300K .......... .......... .......... .......... .......... 30% 67.4M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28350K .......... .......... .......... .......... .......... 30% 46.9M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28400K .......... .......... .......... .......... .......... 30% 137M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28450K .......... .......... .......... .......... .......... 30% 101M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28500K .......... .......... .......... .......... .......... 30% 103M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28550K .......... .......... .......... .......... .......... 30% 85.1M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28600K .......... .......... .......... .......... .......... 30% 115M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28650K .......... .......... .......... .......... .......... 30% 77.7M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28700K .......... .......... .......... .......... .......... 30% 116M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28750K .......... .......... .......... .......... .......... 31% 55.6M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28800K .......... .......... .......... .......... .......... 31% 106M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28850K .......... .......... .......... .......... .......... 31% 63.0M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28900K .......... .......... .......... .......... .......... 31% 109M 1s 2024-04-03T04:03:04.441 INFO:teuthology.orchestra.run.smithi104.stderr: 28950K .......... .......... .......... .......... .......... 31% 87.6M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29000K .......... .......... .......... .......... .......... 31% 74.1M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29050K .......... .......... .......... .......... .......... 31% 67.8M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29100K .......... .......... .......... .......... .......... 31% 79.3M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29150K .......... .......... .......... .......... .......... 31% 96.9M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29200K .......... .......... .......... .......... .......... 31% 118M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29250K .......... .......... .......... .......... .......... 31% 43.4M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29300K .......... .......... .......... .......... .......... 31% 64.4M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29350K .......... .......... .......... .......... .......... 31% 81.6M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29400K .......... .......... .......... .......... .......... 31% 71.9M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29450K .......... .......... .......... .......... .......... 31% 118M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29500K .......... .......... .......... .......... .......... 31% 92.1M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29550K .......... .......... .......... .......... .......... 31% 91.0M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29600K .......... .......... .......... .......... .......... 31% 109M 1s 2024-04-03T04:03:04.442 INFO:teuthology.orchestra.run.smithi104.stderr: 29650K .......... .......... .......... .......... .......... 31% 80.7M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 29700K .......... .......... .......... .......... .......... 32% 114M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 29750K .......... .......... .......... .......... .......... 32% 97.5M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 29800K .......... .......... .......... .......... .......... 32% 120M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 29850K .......... .......... .......... .......... .......... 32% 108M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 29900K .......... .......... .......... .......... .......... 32% 114M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 29950K .......... .......... .......... .......... .......... 32% 86.6M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 30000K .......... .......... .......... .......... .......... 32% 118M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 30050K .......... .......... .......... .......... .......... 32% 114M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 30100K .......... .......... .......... .......... .......... 32% 46.0M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 30150K .......... .......... .......... .......... .......... 32% 103M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 30200K .......... .......... .......... .......... .......... 32% 71.6M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 30250K .......... .......... .......... .......... .......... 32% 91.4M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 30300K .......... .......... .......... .......... .......... 32% 50.5M 1s 2024-04-03T04:03:04.443 INFO:teuthology.orchestra.run.smithi104.stderr: 30350K .......... .......... .......... .......... .......... 32% 82.0M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30400K .......... .......... .......... .......... .......... 32% 114M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30450K .......... .......... .......... .......... .......... 32% 108M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30500K .......... .......... .......... .......... .......... 32% 102M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30550K .......... .......... .......... .......... .......... 32% 84.5M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30600K .......... .......... .......... .......... .......... 32% 115M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30650K .......... .......... .......... .......... .......... 33% 65.3M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30700K .......... .......... .......... .......... .......... 33% 66.2M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30750K .......... .......... .......... .......... .......... 33% 57.8M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30800K .......... .......... .......... .......... .......... 33% 72.0M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30850K .......... .......... .......... .......... .......... 33% 114M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30900K .......... .......... .......... .......... .......... 33% 61.0M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 30950K .......... .......... .......... .......... .......... 33% 52.3M 1s 2024-04-03T04:03:04.444 INFO:teuthology.orchestra.run.smithi104.stderr: 31000K .......... .......... .......... .......... .......... 33% 57.6M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31050K .......... .......... .......... .......... .......... 33% 112M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31100K .......... .......... .......... .......... .......... 33% 62.6M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31150K .......... .......... .......... .......... .......... 33% 62.1M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31200K .......... .......... .......... .......... .......... 33% 99.9M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31250K .......... .......... .......... .......... .......... 33% 70.5M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31300K .......... .......... .......... .......... .......... 33% 111M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31350K .......... .......... .......... .......... .......... 33% 45.2M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31400K .......... .......... .......... .......... .......... 33% 64.5M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31450K .......... .......... .......... .......... .......... 33% 82.4M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31500K .......... .......... .......... .......... .......... 33% 117M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31550K .......... .......... .......... .......... .......... 34% 60.4M 1s 2024-04-03T04:03:04.445 INFO:teuthology.orchestra.run.smithi104.stderr: 31600K .......... .......... .......... .......... .......... 34% 66.5M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 31650K .......... .......... .......... .......... .......... 34% 86.2M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 31700K .......... .......... .......... .......... .......... 34% 56.1M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 31750K .......... .......... .......... .......... .......... 34% 109M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 31800K .......... .......... .......... .......... .......... 34% 39.4M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 31850K .......... .......... .......... .......... .......... 34% 63.2M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 31900K .......... .......... .......... .......... .......... 34% 117M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 31950K .......... .......... .......... .......... .......... 34% 26.5M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 32000K .......... .......... .......... .......... .......... 34% 73.4M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 32050K .......... .......... .......... .......... .......... 34% 101M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 32100K .......... .......... .......... .......... .......... 34% 39.1M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 32150K .......... .......... .......... .......... .......... 34% 75.2M 1s 2024-04-03T04:03:04.446 INFO:teuthology.orchestra.run.smithi104.stderr: 32200K .......... .......... .......... .......... .......... 34% 74.3M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32250K .......... .......... .......... .......... .......... 34% 119M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32300K .......... .......... .......... .......... .......... 34% 102M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32350K .......... .......... .......... .......... .......... 34% 71.9M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32400K .......... .......... .......... .......... .......... 34% 119M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32450K .......... .......... .......... .......... .......... 34% 110M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32500K .......... .......... .......... .......... .......... 35% 110M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32550K .......... .......... .......... .......... .......... 35% 99.1M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32600K .......... .......... .......... .......... .......... 35% 124M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32650K .......... .......... .......... .......... .......... 35% 122M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32700K .......... .......... .......... .......... .......... 35% 108M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32750K .......... .......... .......... .......... .......... 35% 79.6M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32800K .......... .......... .......... .......... .......... 35% 100M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32850K .......... .......... .......... .......... .......... 35% 123M 1s 2024-04-03T04:03:04.447 INFO:teuthology.orchestra.run.smithi104.stderr: 32900K .......... .......... .......... .......... .......... 35% 93.8M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 32950K .......... .......... .......... .......... .......... 35% 109M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33000K .......... .......... .......... .......... .......... 35% 112M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33050K .......... .......... .......... .......... .......... 35% 117M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33100K .......... .......... .......... .......... .......... 35% 91.2M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33150K .......... .......... .......... .......... .......... 35% 86.1M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33200K .......... .......... .......... .......... .......... 35% 96.2M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33250K .......... .......... .......... .......... .......... 35% 105M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33300K .......... .......... .......... .......... .......... 35% 119M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33350K .......... .......... .......... .......... .......... 35% 96.4M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33400K .......... .......... .......... .......... .......... 36% 112M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33450K .......... .......... .......... .......... .......... 36% 89.0M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33500K .......... .......... .......... .......... .......... 36% 70.6M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33550K .......... .......... .......... .......... .......... 36% 67.7M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33600K .......... .......... .......... .......... .......... 36% 92.9M 1s 2024-04-03T04:03:04.448 INFO:teuthology.orchestra.run.smithi104.stderr: 33650K .......... .......... .......... .......... .......... 36% 139M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 33700K .......... .......... .......... .......... .......... 36% 59.9M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 33750K .......... .......... .......... .......... .......... 36% 74.0M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 33800K .......... .......... .......... .......... .......... 36% 84.5M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 33850K .......... .......... .......... .......... .......... 36% 119M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 33900K .......... .......... .......... .......... .......... 36% 83.6M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 33950K .......... .......... .......... .......... .......... 36% 60.7M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 34000K .......... .......... .......... .......... .......... 36% 71.3M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 34050K .......... .......... .......... .......... .......... 36% 66.9M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 34100K .......... .......... .......... .......... .......... 36% 113M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 34150K .......... .......... .......... .......... .......... 36% 46.1M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 34200K .......... .......... .......... .......... .......... 36% 45.6M 1s 2024-04-03T04:03:04.449 INFO:teuthology.orchestra.run.smithi104.stderr: 34250K .......... .......... .......... .......... .......... 36% 62.3M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34300K .......... .......... .......... .......... .......... 36% 111M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34350K .......... .......... .......... .......... .......... 37% 34.8M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34400K .......... .......... .......... .......... .......... 37% 46.3M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34450K .......... .......... .......... .......... .......... 37% 59.8M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34500K .......... .......... .......... .......... .......... 37% 73.7M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34550K .......... .......... .......... .......... .......... 37% 108M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34600K .......... .......... .......... .......... .......... 37% 65.3M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34650K .......... .......... .......... .......... .......... 37% 80.9M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34700K .......... .......... .......... .......... .......... 37% 44.9M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34750K .......... .......... .......... .......... .......... 37% 72.8M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34800K .......... .......... .......... .......... .......... 37% 47.1M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34850K .......... .......... .......... .......... .......... 37% 133M 1s 2024-04-03T04:03:04.450 INFO:teuthology.orchestra.run.smithi104.stderr: 34900K .......... .......... .......... .......... .......... 37% 44.4M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 34950K .......... .......... .......... .......... .......... 37% 129M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35000K .......... .......... .......... .......... .......... 37% 62.5M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35050K .......... .......... .......... .......... .......... 37% 85.2M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35100K .......... .......... .......... .......... .......... 37% 59.3M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35150K .......... .......... .......... .......... .......... 37% 100M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35200K .......... .......... .......... .......... .......... 37% 140M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35250K .......... .......... .......... .......... .......... 37% 98.3M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35300K .......... .......... .......... .......... .......... 38% 89.0M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35350K .......... .......... .......... .......... .......... 38% 143M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35400K .......... .......... .......... .......... .......... 38% 111M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35450K .......... .......... .......... .......... .......... 38% 92.8M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35500K .......... .......... .......... .......... .......... 38% 120M 1s 2024-04-03T04:03:04.451 INFO:teuthology.orchestra.run.smithi104.stderr: 35550K .......... .......... .......... .......... .......... 38% 86.7M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 35600K .......... .......... .......... .......... .......... 38% 118M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 35650K .......... .......... .......... .......... .......... 38% 108M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 35700K .......... .......... .......... .......... .......... 38% 116M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 35750K .......... .......... .......... .......... .......... 38% 110M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 35800K .......... .......... .......... .......... .......... 38% 83.4M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 35850K .......... .......... .......... .......... .......... 38% 87.1M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 35900K .......... .......... .......... .......... .......... 38% 70.0M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 35950K .......... .......... .......... .......... .......... 38% 98.8M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 36000K .......... .......... .......... .......... .......... 38% 119M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 36050K .......... .......... .......... .......... .......... 38% 114M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 36100K .......... .......... .......... .......... .......... 38% 67.9M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 36150K .......... .......... .......... .......... .......... 38% 106M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 36200K .......... .......... .......... .......... .......... 39% 109M 1s 2024-04-03T04:03:04.452 INFO:teuthology.orchestra.run.smithi104.stderr: 36250K .......... .......... .......... .......... .......... 39% 87.5M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36300K .......... .......... .......... .......... .......... 39% 108M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36350K .......... .......... .......... .......... .......... 39% 67.8M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36400K .......... .......... .......... .......... .......... 39% 87.8M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36450K .......... .......... .......... .......... .......... 39% 115M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36500K .......... .......... .......... .......... .......... 39% 71.4M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36550K .......... .......... .......... .......... .......... 39% 76.9M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36600K .......... .......... .......... .......... .......... 39% 94.1M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36650K .......... .......... .......... .......... .......... 39% 113M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36700K .......... .......... .......... .......... .......... 39% 96.0M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36750K .......... .......... .......... .......... .......... 39% 69.3M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36800K .......... .......... .......... .......... .......... 39% 86.4M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36850K .......... .......... .......... .......... .......... 39% 83.9M 1s 2024-04-03T04:03:04.453 INFO:teuthology.orchestra.run.smithi104.stderr: 36900K .......... .......... .......... .......... .......... 39% 122M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 36950K .......... .......... .......... .......... .......... 39% 76.9M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37000K .......... .......... .......... .......... .......... 39% 93.2M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37050K .......... .......... .......... .......... .......... 39% 88.8M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37100K .......... .......... .......... .......... .......... 39% 114M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37150K .......... .......... .......... .......... .......... 40% 66.2M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37200K .......... .......... .......... .......... .......... 40% 90.7M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37250K .......... .......... .......... .......... .......... 40% 50.3M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37300K .......... .......... .......... .......... .......... 40% 55.6M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37350K .......... .......... .......... .......... .......... 40% 44.3M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37400K .......... .......... .......... .......... .......... 40% 113M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37450K .......... .......... .......... .......... .......... 40% 73.8M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37500K .......... .......... .......... .......... .......... 40% 87.9M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37550K .......... .......... .......... .......... .......... 40% 55.0M 1s 2024-04-03T04:03:04.454 INFO:teuthology.orchestra.run.smithi104.stderr: 37600K .......... .......... .......... .......... .......... 40% 35.0M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 37650K .......... .......... .......... .......... .......... 40% 125M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 37700K .......... .......... .......... .......... .......... 40% 86.6M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 37750K .......... .......... .......... .......... .......... 40% 49.2M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 37800K .......... .......... .......... .......... .......... 40% 74.2M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 37850K .......... .......... .......... .......... .......... 40% 92.1M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 37900K .......... .......... .......... .......... .......... 40% 82.9M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 37950K .......... .......... .......... .......... .......... 40% 66.3M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 38000K .......... .......... .......... .......... .......... 40% 78.2M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 38050K .......... .......... .......... .......... .......... 41% 74.3M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 38100K .......... .......... .......... .......... .......... 41% 117M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 38150K .......... .......... .......... .......... .......... 41% 63.3M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 38200K .......... .......... .......... .......... .......... 41% 47.4M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 38250K .......... .......... .......... .......... .......... 41% 112M 1s 2024-04-03T04:03:04.455 INFO:teuthology.orchestra.run.smithi104.stderr: 38300K .......... .......... .......... .......... .......... 41% 118M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38350K .......... .......... .......... .......... .......... 41% 77.6M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38400K .......... .......... .......... .......... .......... 41% 105M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38450K .......... .......... .......... .......... .......... 41% 66.2M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38500K .......... .......... .......... .......... .......... 41% 76.0M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38550K .......... .......... .......... .......... .......... 41% 114M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38600K .......... .......... .......... .......... .......... 41% 79.0M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38650K .......... .......... .......... .......... .......... 41% 117M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38700K .......... .......... .......... .......... .......... 41% 94.5M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38750K .......... .......... .......... .......... .......... 41% 63.9M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38800K .......... .......... .......... .......... .......... 41% 112M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38850K .......... .......... .......... .......... .......... 41% 84.0M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38900K .......... .......... .......... .......... .......... 41% 96.8M 1s 2024-04-03T04:03:04.456 INFO:teuthology.orchestra.run.smithi104.stderr: 38950K .......... .......... .......... .......... .......... 41% 101M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39000K .......... .......... .......... .......... .......... 42% 122M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39050K .......... .......... .......... .......... .......... 42% 92.3M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39100K .......... .......... .......... .......... .......... 42% 123M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39150K .......... .......... .......... .......... .......... 42% 73.1M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39200K .......... .......... .......... .......... .......... 42% 94.3M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39250K .......... .......... .......... .......... .......... 42% 115M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39300K .......... .......... .......... .......... .......... 42% 80.2M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39350K .......... .......... .......... .......... .......... 42% 62.9M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39400K .......... .......... .......... .......... .......... 42% 89.3M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39450K .......... .......... .......... .......... .......... 42% 120M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39500K .......... .......... .......... .......... .......... 42% 64.3M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39550K .......... .......... .......... .......... .......... 42% 50.7M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39600K .......... .......... .......... .......... .......... 42% 75.5M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39650K .......... .......... .......... .......... .......... 42% 104M 1s 2024-04-03T04:03:04.457 INFO:teuthology.orchestra.run.smithi104.stderr: 39700K .......... .......... .......... .......... .......... 42% 118M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 39750K .......... .......... .......... .......... .......... 42% 67.2M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 39800K .......... .......... .......... .......... .......... 42% 77.2M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 39850K .......... .......... .......... .......... .......... 42% 92.8M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 39900K .......... .......... .......... .......... .......... 43% 92.3M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 39950K .......... .......... .......... .......... .......... 43% 57.3M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 40000K .......... .......... .......... .......... .......... 43% 62.0M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 40050K .......... .......... .......... .......... .......... 43% 59.0M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 40100K .......... .......... .......... .......... .......... 43% 90.8M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 40150K .......... .......... .......... .......... .......... 43% 75.2M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 40200K .......... .......... .......... .......... .......... 43% 63.0M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 40250K .......... .......... .......... .......... .......... 43% 77.8M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 40300K .......... .......... .......... .......... .......... 43% 72.1M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 40350K .......... .......... .......... .......... .......... 43% 58.0M 1s 2024-04-03T04:03:04.458 INFO:teuthology.orchestra.run.smithi104.stderr: 40400K .......... .......... .......... .......... .......... 43% 40.0M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40450K .......... .......... .......... .......... .......... 43% 115M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40500K .......... .......... .......... .......... .......... 43% 105M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40550K .......... .......... .......... .......... .......... 43% 54.5M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40600K .......... .......... .......... .......... .......... 43% 78.8M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40650K .......... .......... .......... .......... .......... 43% 91.7M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40700K .......... .......... .......... .......... .......... 43% 39.6M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40750K .......... .......... .......... .......... .......... 43% 69.2M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40800K .......... .......... .......... .......... .......... 43% 72.7M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40850K .......... .......... .......... .......... .......... 44% 78.0M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40900K .......... .......... .......... .......... .......... 44% 107M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 40950K .......... .......... .......... .......... .......... 44% 104M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 41000K .......... .......... .......... .......... .......... 44% 64.0M 1s 2024-04-03T04:03:04.459 INFO:teuthology.orchestra.run.smithi104.stderr: 41050K .......... .......... .......... .......... .......... 44% 72.1M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41100K .......... .......... .......... .......... .......... 44% 111M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41150K .......... .......... .......... .......... .......... 44% 45.6M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41200K .......... .......... .......... .......... .......... 44% 119M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41250K .......... .......... .......... .......... .......... 44% 72.2M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41300K .......... .......... .......... .......... .......... 44% 92.4M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41350K .......... .......... .......... .......... .......... 44% 108M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41400K .......... .......... .......... .......... .......... 44% 90.3M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41450K .......... .......... .......... .......... .......... 44% 90.0M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41500K .......... .......... .......... .......... .......... 44% 114M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41550K .......... .......... .......... .......... .......... 44% 75.9M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41600K .......... .......... .......... .......... .......... 44% 114M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41650K .......... .......... .......... .......... .......... 44% 101M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41700K .......... .......... .......... .......... .......... 44% 114M 1s 2024-04-03T04:03:04.460 INFO:teuthology.orchestra.run.smithi104.stderr: 41750K .......... .......... .......... .......... .......... 44% 63.1M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 41800K .......... .......... .......... .......... .......... 45% 119M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 41850K .......... .......... .......... .......... .......... 45% 88.4M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 41900K .......... .......... .......... .......... .......... 45% 54.1M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 41950K .......... .......... .......... .......... .......... 45% 60.2M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42000K .......... .......... .......... .......... .......... 45% 71.0M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42050K .......... .......... .......... .......... .......... 45% 110M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42100K .......... .......... .......... .......... .......... 45% 76.2M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42150K .......... .......... .......... .......... .......... 45% 116M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42200K .......... .......... .......... .......... .......... 45% 86.4M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42250K .......... .......... .......... .......... .......... 45% 116M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42300K .......... .......... .......... .......... .......... 45% 91.0M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42350K .......... .......... .......... .......... .......... 45% 65.4M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42400K .......... .......... .......... .......... .......... 45% 93.8M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42450K .......... .......... .......... .......... .......... 45% 74.2M 1s 2024-04-03T04:03:04.461 INFO:teuthology.orchestra.run.smithi104.stderr: 42500K .......... .......... .......... .......... .......... 45% 113M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 42550K .......... .......... .......... .......... .......... 45% 64.9M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 42600K .......... .......... .......... .......... .......... 45% 63.8M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 42650K .......... .......... .......... .......... .......... 45% 104M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 42700K .......... .......... .......... .......... .......... 46% 54.9M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 42750K .......... .......... .......... .......... .......... 46% 69.9M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 42800K .......... .......... .......... .......... .......... 46% 112M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 42850K .......... .......... .......... .......... .......... 46% 75.9M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 42900K .......... .......... .......... .......... .......... 46% 87.8M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 42950K .......... .......... .......... .......... .......... 46% 56.4M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 43000K .......... .......... .......... .......... .......... 46% 120M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 43050K .......... .......... .......... .......... .......... 46% 62.8M 1s 2024-04-03T04:03:04.462 INFO:teuthology.orchestra.run.smithi104.stderr: 43100K .......... .......... .......... .......... .......... 46% 66.4M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43150K .......... .......... .......... .......... .......... 46% 74.9M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43200K .......... .......... .......... .......... .......... 46% 38.9M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43250K .......... .......... .......... .......... .......... 46% 121M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43300K .......... .......... .......... .......... .......... 46% 74.1M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43350K .......... .......... .......... .......... .......... 46% 78.3M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43400K .......... .......... .......... .......... .......... 46% 95.9M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43450K .......... .......... .......... .......... .......... 46% 128M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43500K .......... .......... .......... .......... .......... 46% 61.2M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43550K .......... .......... .......... .......... .......... 46% 80.4M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43600K .......... .......... .......... .......... .......... 46% 86.7M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43650K .......... .......... .......... .......... .......... 47% 85.5M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43700K .......... .......... .......... .......... .......... 47% 118M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43750K .......... .......... .......... .......... .......... 47% 70.8M 1s 2024-04-03T04:03:04.463 INFO:teuthology.orchestra.run.smithi104.stderr: 43800K .......... .......... .......... .......... .......... 47% 79.4M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 43850K .......... .......... .......... .......... .......... 47% 80.3M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 43900K .......... .......... .......... .......... .......... 47% 121M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 43950K .......... .......... .......... .......... .......... 47% 90.2M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44000K .......... .......... .......... .......... .......... 47% 75.2M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44050K .......... .......... .......... .......... .......... 47% 87.4M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44100K .......... .......... .......... .......... .......... 47% 73.4M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44150K .......... .......... .......... .......... .......... 47% 107M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44200K .......... .......... .......... .......... .......... 47% 78.0M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44250K .......... .......... .......... .......... .......... 47% 76.8M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44300K .......... .......... .......... .......... .......... 47% 76.7M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44350K .......... .......... .......... .......... .......... 47% 53.0M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44400K .......... .......... .......... .......... .......... 47% 119M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44450K .......... .......... .......... .......... .......... 47% 89.2M 1s 2024-04-03T04:03:04.464 INFO:teuthology.orchestra.run.smithi104.stderr: 44500K .......... .......... .......... .......... .......... 47% 113M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 44550K .......... .......... .......... .......... .......... 48% 51.6M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 44600K .......... .......... .......... .......... .......... 48% 123M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 44650K .......... .......... .......... .......... .......... 48% 80.0M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 44700K .......... .......... .......... .......... .......... 48% 107M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 44750K .......... .......... .......... .......... .......... 48% 71.2M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 44800K .......... .......... .......... .......... .......... 48% 46.9M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 44850K .......... .......... .......... .......... .......... 48% 103M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 44900K .......... .......... .......... .......... .......... 48% 61.4M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 44950K .......... .......... .......... .......... .......... 48% 57.5M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 45000K .......... .......... .......... .......... .......... 48% 71.4M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 45050K .......... .......... .......... .......... .......... 48% 129M 1s 2024-04-03T04:03:04.465 INFO:teuthology.orchestra.run.smithi104.stderr: 45100K .......... .......... .......... .......... .......... 48% 67.6M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45150K .......... .......... .......... .......... .......... 48% 50.6M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45200K .......... .......... .......... .......... .......... 48% 64.4M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45250K .......... .......... .......... .......... .......... 48% 49.7M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45300K .......... .......... .......... .......... .......... 48% 109M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45350K .......... .......... .......... .......... .......... 48% 81.0M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45400K .......... .......... .......... .......... .......... 48% 44.2M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45450K .......... .......... .......... .......... .......... 48% 37.7M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45500K .......... .......... .......... .......... .......... 49% 63.8M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45550K .......... .......... .......... .......... .......... 49% 46.5M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45600K .......... .......... .......... .......... .......... 49% 89.3M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45650K .......... .......... .......... .......... .......... 49% 84.9M 1s 2024-04-03T04:03:04.466 INFO:teuthology.orchestra.run.smithi104.stderr: 45700K .......... .......... .......... .......... .......... 49% 75.3M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 45750K .......... .......... .......... .......... .......... 49% 46.2M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 45800K .......... .......... .......... .......... .......... 49% 104M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 45850K .......... .......... .......... .......... .......... 49% 90.0M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 45900K .......... .......... .......... .......... .......... 49% 88.2M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 45950K .......... .......... .......... .......... .......... 49% 64.6M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 46000K .......... .......... .......... .......... .......... 49% 58.9M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 46050K .......... .......... .......... .......... .......... 49% 114M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 46100K .......... .......... .......... .......... .......... 49% 102M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 46150K .......... .......... .......... .......... .......... 49% 69.4M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 46200K .......... .......... .......... .......... .......... 49% 102M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 46250K .......... .......... .......... .......... .......... 49% 109M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 46300K .......... .......... .......... .......... .......... 49% 68.3M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 46350K .......... .......... .......... .......... .......... 49% 58.5M 1s 2024-04-03T04:03:04.467 INFO:teuthology.orchestra.run.smithi104.stderr: 46400K .......... .......... .......... .......... .......... 49% 105M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46450K .......... .......... .......... .......... .......... 50% 129M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46500K .......... .......... .......... .......... .......... 50% 97.2M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46550K .......... .......... .......... .......... .......... 50% 47.3M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46600K .......... .......... .......... .......... .......... 50% 121M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46650K .......... .......... .......... .......... .......... 50% 60.4M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46700K .......... .......... .......... .......... .......... 50% 108M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46750K .......... .......... .......... .......... .......... 50% 78.1M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46800K .......... .......... .......... .......... .......... 50% 116M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46850K .......... .......... .......... .......... .......... 50% 111M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46900K .......... .......... .......... .......... .......... 50% 118M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 46950K .......... .......... .......... .......... .......... 50% 90.1M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 47000K .......... .......... .......... .......... .......... 50% 116M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 47050K .......... .......... .......... .......... .......... 50% 81.3M 1s 2024-04-03T04:03:04.468 INFO:teuthology.orchestra.run.smithi104.stderr: 47100K .......... .......... .......... .......... .......... 50% 109M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47150K .......... .......... .......... .......... .......... 50% 62.0M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47200K .......... .......... .......... .......... .......... 50% 121M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47250K .......... .......... .......... .......... .......... 50% 90.1M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47300K .......... .......... .......... .......... .......... 50% 56.5M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47350K .......... .......... .......... .......... .......... 51% 72.6M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47400K .......... .......... .......... .......... .......... 51% 106M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47450K .......... .......... .......... .......... .......... 51% 58.5M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47500K .......... .......... .......... .......... .......... 51% 82.8M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47550K .......... .......... .......... .......... .......... 51% 58.3M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47600K .......... .......... .......... .......... .......... 51% 77.0M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47650K .......... .......... .......... .......... .......... 51% 112M 1s 2024-04-03T04:03:04.469 INFO:teuthology.orchestra.run.smithi104.stderr: 47700K .......... .......... .......... .......... .......... 51% 60.5M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 47750K .......... .......... .......... .......... .......... 51% 65.6M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 47800K .......... .......... .......... .......... .......... 51% 73.1M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 47850K .......... .......... .......... .......... .......... 51% 112M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 47900K .......... .......... .......... .......... .......... 51% 80.1M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 47950K .......... .......... .......... .......... .......... 51% 66.7M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 48000K .......... .......... .......... .......... .......... 51% 88.5M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 48050K .......... .......... .......... .......... .......... 51% 67.0M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 48100K .......... .......... .......... .......... .......... 51% 70.1M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 48150K .......... .......... .......... .......... .......... 51% 101M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 48200K .......... .......... .......... .......... .......... 51% 62.8M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 48250K .......... .......... .......... .......... .......... 51% 57.9M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 48300K .......... .......... .......... .......... .......... 52% 73.1M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 48350K .......... .......... .......... .......... .......... 52% 27.3M 1s 2024-04-03T04:03:04.470 INFO:teuthology.orchestra.run.smithi104.stderr: 48400K .......... .......... .......... .......... .......... 52% 148M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48450K .......... .......... .......... .......... .......... 52% 150M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48500K .......... .......... .......... .......... .......... 52% 175M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48550K .......... .......... .......... .......... .......... 52% 79.9M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48600K .......... .......... .......... .......... .......... 52% 181M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48650K .......... .......... .......... .......... .......... 52% 52.2M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48700K .......... .......... .......... .......... .......... 52% 111M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48750K .......... .......... .......... .......... .......... 52% 72.2M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48800K .......... .......... .......... .......... .......... 52% 91.3M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48850K .......... .......... .......... .......... .......... 52% 117M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48900K .......... .......... .......... .......... .......... 52% 114M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 48950K .......... .......... .......... .......... .......... 52% 101M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 49000K .......... .......... .......... .......... .......... 52% 114M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 49050K .......... .......... .......... .......... .......... 52% 115M 1s 2024-04-03T04:03:04.471 INFO:teuthology.orchestra.run.smithi104.stderr: 49100K .......... .......... .......... .......... .......... 52% 99.6M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49150K .......... .......... .......... .......... .......... 52% 91.4M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49200K .......... .......... .......... .......... .......... 53% 102M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49250K .......... .......... .......... .......... .......... 53% 111M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49300K .......... .......... .......... .......... .......... 53% 115M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49350K .......... .......... .......... .......... .......... 53% 80.0M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49400K .......... .......... .......... .......... .......... 53% 95.4M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49450K .......... .......... .......... .......... .......... 53% 101M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49500K .......... .......... .......... .......... .......... 53% 109M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49550K .......... .......... .......... .......... .......... 53% 90.9M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49600K .......... .......... .......... .......... .......... 53% 107M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49650K .......... .......... .......... .......... .......... 53% 116M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49700K .......... .......... .......... .......... .......... 53% 111M 1s 2024-04-03T04:03:04.472 INFO:teuthology.orchestra.run.smithi104.stderr: 49750K .......... .......... .......... .......... .......... 53% 105M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 49800K .......... .......... .......... .......... .......... 53% 99.7M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 49850K .......... .......... .......... .......... .......... 53% 81.7M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 49900K .......... .......... .......... .......... .......... 53% 118M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 49950K .......... .......... .......... .......... .......... 53% 86.9M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 50000K .......... .......... .......... .......... .......... 53% 132M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 50050K .......... .......... .......... .......... .......... 53% 85.0M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 50100K .......... .......... .......... .......... .......... 53% 114M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 50150K .......... .......... .......... .......... .......... 54% 103M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 50200K .......... .......... .......... .......... .......... 54% 115M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 50250K .......... .......... .......... .......... .......... 54% 110M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 50300K .......... .......... .......... .......... .......... 54% 104M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 50350K .......... .......... .......... .......... .......... 54% 67.6M 1s 2024-04-03T04:03:04.473 INFO:teuthology.orchestra.run.smithi104.stderr: 50400K .......... .......... .......... .......... .......... 54% 53.0M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50450K .......... .......... .......... .......... .......... 54% 113M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50500K .......... .......... .......... .......... .......... 54% 114M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50550K .......... .......... .......... .......... .......... 54% 98.1M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50600K .......... .......... .......... .......... .......... 54% 89.7M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50650K .......... .......... .......... .......... .......... 54% 101M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50700K .......... .......... .......... .......... .......... 54% 70.1M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50750K .......... .......... .......... .......... .......... 54% 59.2M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50800K .......... .......... .......... .......... .......... 54% 68.0M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50850K .......... .......... .......... .......... .......... 54% 42.1M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50900K .......... .......... .......... .......... .......... 54% 39.6M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 50950K .......... .......... .......... .......... .......... 54% 104M 1s 2024-04-03T04:03:04.474 INFO:teuthology.orchestra.run.smithi104.stderr: 51000K .......... .......... .......... .......... .......... 54% 58.5M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51050K .......... .......... .......... .......... .......... 55% 94.3M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51100K .......... .......... .......... .......... .......... 55% 81.8M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51150K .......... .......... .......... .......... .......... 55% 58.0M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51200K .......... .......... .......... .......... .......... 55% 102M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51250K .......... .......... .......... .......... .......... 55% 72.8M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51300K .......... .......... .......... .......... .......... 55% 115M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51350K .......... .......... .......... .......... .......... 55% 30.4M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51400K .......... .......... .......... .......... .......... 55% 93.9M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51450K .......... .......... .......... .......... .......... 55% 107M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51500K .......... .......... .......... .......... .......... 55% 74.2M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51550K .......... .......... .......... .......... .......... 55% 60.8M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51600K .......... .......... .......... .......... .......... 55% 104M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51650K .......... .......... .......... .......... .......... 55% 113M 1s 2024-04-03T04:03:04.475 INFO:teuthology.orchestra.run.smithi104.stderr: 51700K .......... .......... .......... .......... .......... 55% 110M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 51750K .......... .......... .......... .......... .......... 55% 88.8M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 51800K .......... .......... .......... .......... .......... 55% 111M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 51850K .......... .......... .......... .......... .......... 55% 118M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 51900K .......... .......... .......... .......... .......... 55% 114M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 51950K .......... .......... .......... .......... .......... 55% 63.5M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 52000K .......... .......... .......... .......... .......... 56% 87.3M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 52050K .......... .......... .......... .......... .......... 56% 67.2M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 52100K .......... .......... .......... .......... .......... 56% 107M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 52150K .......... .......... .......... .......... .......... 56% 81.0M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 52200K .......... .......... .......... .......... .......... 56% 89.5M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 52250K .......... .......... .......... .......... .......... 56% 90.0M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 52300K .......... .......... .......... .......... .......... 56% 126M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 52350K .......... .......... .......... .......... .......... 56% 60.8M 1s 2024-04-03T04:03:04.476 INFO:teuthology.orchestra.run.smithi104.stderr: 52400K .......... .......... .......... .......... .......... 56% 110M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52450K .......... .......... .......... .......... .......... 56% 91.2M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52500K .......... .......... .......... .......... .......... 56% 92.8M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52550K .......... .......... .......... .......... .......... 56% 112M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52600K .......... .......... .......... .......... .......... 56% 112M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52650K .......... .......... .......... .......... .......... 56% 112M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52700K .......... .......... .......... .......... .......... 56% 106M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52750K .......... .......... .......... .......... .......... 56% 93.4M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52800K .......... .......... .......... .......... .......... 56% 113M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52850K .......... .......... .......... .......... .......... 56% 74.8M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52900K .......... .......... .......... .......... .......... 56% 96.3M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 52950K .......... .......... .......... .......... .......... 57% 72.0M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 53000K .......... .......... .......... .......... .......... 57% 121M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 53050K .......... .......... .......... .......... .......... 57% 96.4M 1s 2024-04-03T04:03:04.477 INFO:teuthology.orchestra.run.smithi104.stderr: 53100K .......... .......... .......... .......... .......... 57% 98.2M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53150K .......... .......... .......... .......... .......... 57% 87.2M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53200K .......... .......... .......... .......... .......... 57% 81.0M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53250K .......... .......... .......... .......... .......... 57% 109M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53300K .......... .......... .......... .......... .......... 57% 83.5M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53350K .......... .......... .......... .......... .......... 57% 109M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53400K .......... .......... .......... .......... .......... 57% 71.9M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53450K .......... .......... .......... .......... .......... 57% 74.6M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53500K .......... .......... .......... .......... .......... 57% 118M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53550K .......... .......... .......... .......... .......... 57% 82.1M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53600K .......... .......... .......... .......... .......... 57% 109M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53650K .......... .......... .......... .......... .......... 57% 73.1M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53700K .......... .......... .......... .......... .......... 57% 87.3M 1s 2024-04-03T04:03:04.478 INFO:teuthology.orchestra.run.smithi104.stderr: 53750K .......... .......... .......... .......... .......... 57% 95.2M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 53800K .......... .......... .......... .......... .......... 57% 103M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 53850K .......... .......... .......... .......... .......... 58% 131M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 53900K .......... .......... .......... .......... .......... 58% 81.4M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 53950K .......... .......... .......... .......... .......... 58% 66.7M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 54000K .......... .......... .......... .......... .......... 58% 116M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 54050K .......... .......... .......... .......... .......... 58% 93.6M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 54100K .......... .......... .......... .......... .......... 58% 68.0M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 54150K .......... .......... .......... .......... .......... 58% 86.6M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 54200K .......... .......... .......... .......... .......... 58% 111M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 54250K .......... .......... .......... .......... .......... 58% 106M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 54300K .......... .......... .......... .......... .......... 58% 72.4M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 54350K .......... .......... .......... .......... .......... 58% 101M 1s 2024-04-03T04:03:04.479 INFO:teuthology.orchestra.run.smithi104.stderr: 54400K .......... .......... .......... .......... .......... 58% 57.7M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54450K .......... .......... .......... .......... .......... 58% 100M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54500K .......... .......... .......... .......... .......... 58% 78.1M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54550K .......... .......... .......... .......... .......... 58% 88.6M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54600K .......... .......... .......... .......... .......... 58% 111M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54650K .......... .......... .......... .......... .......... 58% 118M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54700K .......... .......... .......... .......... .......... 58% 69.7M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54750K .......... .......... .......... .......... .......... 58% 73.5M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54800K .......... .......... .......... .......... .......... 59% 117M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54850K .......... .......... .......... .......... .......... 59% 102M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54900K .......... .......... .......... .......... .......... 59% 105M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 54950K .......... .......... .......... .......... .......... 59% 77.1M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 55000K .......... .......... .......... .......... .......... 59% 93.9M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 55050K .......... .......... .......... .......... .......... 59% 140M 1s 2024-04-03T04:03:04.480 INFO:teuthology.orchestra.run.smithi104.stderr: 55100K .......... .......... .......... .......... .......... 59% 114M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55150K .......... .......... .......... .......... .......... 59% 41.8M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55200K .......... .......... .......... .......... .......... 59% 76.4M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55250K .......... .......... .......... .......... .......... 59% 81.8M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55300K .......... .......... .......... .......... .......... 59% 63.6M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55350K .......... .......... .......... .......... .......... 59% 83.9M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55400K .......... .......... .......... .......... .......... 59% 66.0M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55450K .......... .......... .......... .......... .......... 59% 70.5M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55500K .......... .......... .......... .......... .......... 59% 79.4M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55550K .......... .......... .......... .......... .......... 59% 71.8M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55600K .......... .......... .......... .......... .......... 59% 119M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55650K .......... .......... .......... .......... .......... 59% 64.2M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55700K .......... .......... .......... .......... .......... 60% 90.8M 1s 2024-04-03T04:03:04.481 INFO:teuthology.orchestra.run.smithi104.stderr: 55750K .......... .......... .......... .......... .......... 60% 94.1M 1s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 55800K .......... .......... .......... .......... .......... 60% 105M 1s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 55850K .......... .......... .......... .......... .......... 60% 99.8M 1s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 55900K .......... .......... .......... .......... .......... 60% 113M 1s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 55950K .......... .......... .......... .......... .......... 60% 70.7M 1s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 56000K .......... .......... .......... .......... .......... 60% 111M 1s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 56050K .......... .......... .......... .......... .......... 60% 117M 1s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 56100K .......... .......... .......... .......... .......... 60% 82.5M 1s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 56150K .......... .......... .......... .......... .......... 60% 85.8M 1s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 56200K .......... .......... .......... .......... .......... 60% 80.4M 0s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 56250K .......... .......... .......... .......... .......... 60% 95.2M 0s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 56300K .......... .......... .......... .......... .......... 60% 117M 0s 2024-04-03T04:03:04.482 INFO:teuthology.orchestra.run.smithi104.stderr: 56350K .......... .......... .......... .......... .......... 60% 36.0M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56400K .......... .......... .......... .......... .......... 60% 40.4M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56450K .......... .......... .......... .......... .......... 60% 99.3M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56500K .......... .......... .......... .......... .......... 60% 115M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56550K .......... .......... .......... .......... .......... 60% 105M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56600K .......... .......... .......... .......... .......... 60% 93.9M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56650K .......... .......... .......... .......... .......... 61% 108M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56700K .......... .......... .......... .......... .......... 61% 88.4M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56750K .......... .......... .......... .......... .......... 61% 53.1M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56800K .......... .......... .......... .......... .......... 61% 110M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56850K .......... .......... .......... .......... .......... 61% 100M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56900K .......... .......... .......... .......... .......... 61% 111M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 56950K .......... .......... .......... .......... .......... 61% 89.7M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 57000K .......... .......... .......... .......... .......... 61% 138M 0s 2024-04-03T04:03:04.483 INFO:teuthology.orchestra.run.smithi104.stderr: 57050K .......... .......... .......... .......... .......... 61% 114M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57100K .......... .......... .......... .......... .......... 61% 95.8M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57150K .......... .......... .......... .......... .......... 61% 71.1M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57200K .......... .......... .......... .......... .......... 61% 120M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57250K .......... .......... .......... .......... .......... 61% 112M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57300K .......... .......... .......... .......... .......... 61% 111M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57350K .......... .......... .......... .......... .......... 61% 82.9M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57400K .......... .......... .......... .......... .......... 61% 98.4M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57450K .......... .......... .......... .......... .......... 61% 107M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57500K .......... .......... .......... .......... .......... 61% 101M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57550K .......... .......... .......... .......... .......... 62% 62.2M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57600K .......... .......... .......... .......... .......... 62% 75.2M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57650K .......... .......... .......... .......... .......... 62% 112M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57700K .......... .......... .......... .......... .......... 62% 112M 0s 2024-04-03T04:03:04.484 INFO:teuthology.orchestra.run.smithi104.stderr: 57750K .......... .......... .......... .......... .......... 62% 74.5M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 57800K .......... .......... .......... .......... .......... 62% 114M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 57850K .......... .......... .......... .......... .......... 62% 69.2M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 57900K .......... .......... .......... .......... .......... 62% 119M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 57950K .......... .......... .......... .......... .......... 62% 51.2M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 58000K .......... .......... .......... .......... .......... 62% 76.5M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 58050K .......... .......... .......... .......... .......... 62% 111M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 58100K .......... .......... .......... .......... .......... 62% 90.1M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 58150K .......... .......... .......... .......... .......... 62% 96.7M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 58200K .......... .......... .......... .......... .......... 62% 86.9M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 58250K .......... .......... .......... .......... .......... 62% 54.0M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 58300K .......... .......... .......... .......... .......... 62% 66.7M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 58350K .......... .......... .......... .......... .......... 62% 57.6M 0s 2024-04-03T04:03:04.485 INFO:teuthology.orchestra.run.smithi104.stderr: 58400K .......... .......... .......... .......... .......... 62% 87.6M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58450K .......... .......... .......... .......... .......... 62% 53.6M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58500K .......... .......... .......... .......... .......... 63% 61.4M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58550K .......... .......... .......... .......... .......... 63% 55.3M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58600K .......... .......... .......... .......... .......... 63% 119M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58650K .......... .......... .......... .......... .......... 63% 99.5M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58700K .......... .......... .......... .......... .......... 63% 123M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58750K .......... .......... .......... .......... .......... 63% 75.0M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58800K .......... .......... .......... .......... .......... 63% 58.4M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58850K .......... .......... .......... .......... .......... 63% 110M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58900K .......... .......... .......... .......... .......... 63% 114M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 58950K .......... .......... .......... .......... .......... 63% 83.0M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 59000K .......... .......... .......... .......... .......... 63% 74.0M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 59050K .......... .......... .......... .......... .......... 63% 30.4M 0s 2024-04-03T04:03:04.486 INFO:teuthology.orchestra.run.smithi104.stderr: 59100K .......... .......... .......... .......... .......... 63% 94.8M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59150K .......... .......... .......... .......... .......... 63% 55.3M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59200K .......... .......... .......... .......... .......... 63% 84.9M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59250K .......... .......... .......... .......... .......... 63% 92.3M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59300K .......... .......... .......... .......... .......... 63% 79.6M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59350K .......... .......... .......... .......... .......... 63% 68.8M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59400K .......... .......... .......... .......... .......... 63% 62.3M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59450K .......... .......... .......... .......... .......... 64% 89.0M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59500K .......... .......... .......... .......... .......... 64% 115M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59550K .......... .......... .......... .......... .......... 64% 104M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59600K .......... .......... .......... .......... .......... 64% 107M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59650K .......... .......... .......... .......... .......... 64% 108M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59700K .......... .......... .......... .......... .......... 64% 81.8M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59750K .......... .......... .......... .......... .......... 64% 86.4M 0s 2024-04-03T04:03:04.487 INFO:teuthology.orchestra.run.smithi104.stderr: 59800K .......... .......... .......... .......... .......... 64% 114M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 59850K .......... .......... .......... .......... .......... 64% 106M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 59900K .......... .......... .......... .......... .......... 64% 85.9M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 59950K .......... .......... .......... .......... .......... 64% 108M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60000K .......... .......... .......... .......... .......... 64% 103M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60050K .......... .......... .......... .......... .......... 64% 113M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60100K .......... .......... .......... .......... .......... 64% 99.8M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60150K .......... .......... .......... .......... .......... 64% 97.1M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60200K .......... .......... .......... .......... .......... 64% 98.2M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60250K .......... .......... .......... .......... .......... 64% 121M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60300K .......... .......... .......... .......... .......... 64% 111M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60350K .......... .......... .......... .......... .......... 65% 57.0M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60400K .......... .......... .......... .......... .......... 65% 139M 0s 2024-04-03T04:03:04.488 INFO:teuthology.orchestra.run.smithi104.stderr: 60450K .......... .......... .......... .......... .......... 65% 102M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60500K .......... .......... .......... .......... .......... 65% 120M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60550K .......... .......... .......... .......... .......... 65% 69.1M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60600K .......... .......... .......... .......... .......... 65% 77.5M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60650K .......... .......... .......... .......... .......... 65% 129M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60700K .......... .......... .......... .......... .......... 65% 111M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60750K .......... .......... .......... .......... .......... 65% 71.1M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60800K .......... .......... .......... .......... .......... 65% 64.0M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60850K .......... .......... .......... .......... .......... 65% 77.7M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60900K .......... .......... .......... .......... .......... 65% 95.2M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 60950K .......... .......... .......... .......... .......... 65% 96.8M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 61000K .......... .......... .......... .......... .......... 65% 53.2M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 61050K .......... .......... .......... .......... .......... 65% 99.9M 0s 2024-04-03T04:03:04.489 INFO:teuthology.orchestra.run.smithi104.stderr: 61100K .......... .......... .......... .......... .......... 65% 69.6M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61150K .......... .......... .......... .......... .......... 65% 81.8M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61200K .......... .......... .......... .......... .......... 65% 115M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61250K .......... .......... .......... .......... .......... 65% 57.4M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61300K .......... .......... .......... .......... .......... 66% 24.8M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61350K .......... .......... .......... .......... .......... 66% 44.4M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61400K .......... .......... .......... .......... .......... 66% 114M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61450K .......... .......... .......... .......... .......... 66% 60.0M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61500K .......... .......... .......... .......... .......... 66% 67.7M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61550K .......... .......... .......... .......... .......... 66% 91.1M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61600K .......... .......... .......... .......... .......... 66% 59.9M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61650K .......... .......... .......... .......... .......... 66% 48.5M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61700K .......... .......... .......... .......... .......... 66% 102M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61750K .......... .......... .......... .......... .......... 66% 49.8M 0s 2024-04-03T04:03:04.490 INFO:teuthology.orchestra.run.smithi104.stderr: 61800K .......... .......... .......... .......... .......... 66% 60.4M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 61850K .......... .......... .......... .......... .......... 66% 87.7M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 61900K .......... .......... .......... .......... .......... 66% 123M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 61950K .......... .......... .......... .......... .......... 66% 84.0M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62000K .......... .......... .......... .......... .......... 66% 114M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62050K .......... .......... .......... .......... .......... 66% 105M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62100K .......... .......... .......... .......... .......... 66% 71.3M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62150K .......... .......... .......... .......... .......... 66% 69.2M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62200K .......... .......... .......... .......... .......... 67% 69.1M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62250K .......... .......... .......... .......... .......... 67% 73.7M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62300K .......... .......... .......... .......... .......... 67% 62.4M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62350K .......... .......... .......... .......... .......... 67% 76.1M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62400K .......... .......... .......... .......... .......... 67% 111M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62450K .......... .......... .......... .......... .......... 67% 86.3M 0s 2024-04-03T04:03:04.491 INFO:teuthology.orchestra.run.smithi104.stderr: 62500K .......... .......... .......... .......... .......... 67% 135M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 62550K .......... .......... .......... .......... .......... 67% 63.0M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 62600K .......... .......... .......... .......... .......... 67% 114M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 62650K .......... .......... .......... .......... .......... 67% 87.7M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 62700K .......... .......... .......... .......... .......... 67% 63.6M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 62750K .......... .......... .......... .......... .......... 67% 84.2M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 62800K .......... .......... .......... .......... .......... 67% 100M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 62850K .......... .......... .......... .......... .......... 67% 115M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 62900K .......... .......... .......... .......... .......... 67% 87.6M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 62950K .......... .......... .......... .......... .......... 67% 100M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 63000K .......... .......... .......... .......... .......... 67% 99.4M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 63050K .......... .......... .......... .......... .......... 67% 127M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 63100K .......... .......... .......... .......... .......... 67% 98.9M 0s 2024-04-03T04:03:04.492 INFO:teuthology.orchestra.run.smithi104.stderr: 63150K .......... .......... .......... .......... .......... 68% 94.7M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63200K .......... .......... .......... .......... .......... 68% 71.6M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63250K .......... .......... .......... .......... .......... 68% 112M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63300K .......... .......... .......... .......... .......... 68% 119M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63350K .......... .......... .......... .......... .......... 68% 90.1M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63400K .......... .......... .......... .......... .......... 68% 106M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63450K .......... .......... .......... .......... .......... 68% 90.0M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63500K .......... .......... .......... .......... .......... 68% 114M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63550K .......... .......... .......... .......... .......... 68% 71.8M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63600K .......... .......... .......... .......... .......... 68% 69.0M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63650K .......... .......... .......... .......... .......... 68% 87.9M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63700K .......... .......... .......... .......... .......... 68% 115M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63750K .......... .......... .......... .......... .......... 68% 102M 0s 2024-04-03T04:03:04.493 INFO:teuthology.orchestra.run.smithi104.stderr: 63800K .......... .......... .......... .......... .......... 68% 113M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 63850K .......... .......... .......... .......... .......... 68% 47.0M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 63900K .......... .......... .......... .......... .......... 68% 96.6M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 63950K .......... .......... .......... .......... .......... 68% 99.5M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64000K .......... .......... .......... .......... .......... 68% 121M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64050K .......... .......... .......... .......... .......... 68% 109M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64100K .......... .......... .......... .......... .......... 69% 114M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64150K .......... .......... .......... .......... .......... 69% 63.4M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64200K .......... .......... .......... .......... .......... 69% 116M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64250K .......... .......... .......... .......... .......... 69% 107M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64300K .......... .......... .......... .......... .......... 69% 89.1M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64350K .......... .......... .......... .......... .......... 69% 45.2M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64400K .......... .......... .......... .......... .......... 69% 87.6M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64450K .......... .......... .......... .......... .......... 69% 34.7M 0s 2024-04-03T04:03:04.494 INFO:teuthology.orchestra.run.smithi104.stderr: 64500K .......... .......... .......... .......... .......... 69% 96.5M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 64550K .......... .......... .......... .......... .......... 69% 36.6M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 64600K .......... .......... .......... .......... .......... 69% 89.1M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 64650K .......... .......... .......... .......... .......... 69% 51.7M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 64700K .......... .......... .......... .......... .......... 69% 117M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 64750K .......... .......... .......... .......... .......... 69% 48.9M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 64800K .......... .......... .......... .......... .......... 69% 80.0M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 64850K .......... .......... .......... .......... .......... 69% 81.2M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 64900K .......... .......... .......... .......... .......... 69% 66.2M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 64950K .......... .......... .......... .......... .......... 69% 99.3M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 65000K .......... .......... .......... .......... .......... 70% 138M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 65050K .......... .......... .......... .......... .......... 70% 72.1M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 65100K .......... .......... .......... .......... .......... 70% 104M 0s 2024-04-03T04:03:04.495 INFO:teuthology.orchestra.run.smithi104.stderr: 65150K .......... .......... .......... .......... .......... 70% 67.2M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65200K .......... .......... .......... .......... .......... 70% 120M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65250K .......... .......... .......... .......... .......... 70% 99.0M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65300K .......... .......... .......... .......... .......... 70% 111M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65350K .......... .......... .......... .......... .......... 70% 59.2M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65400K .......... .......... .......... .......... .......... 70% 104M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65450K .......... .......... .......... .......... .......... 70% 120M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65500K .......... .......... .......... .......... .......... 70% 97.1M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65550K .......... .......... .......... .......... .......... 70% 34.7M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65600K .......... .......... .......... .......... .......... 70% 46.0M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65650K .......... .......... .......... .......... .......... 70% 121M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65700K .......... .......... .......... .......... .......... 70% 57.3M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65750K .......... .......... .......... .......... .......... 70% 74.8M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65800K .......... .......... .......... .......... .......... 70% 125M 0s 2024-04-03T04:03:04.496 INFO:teuthology.orchestra.run.smithi104.stderr: 65850K .......... .......... .......... .......... .......... 70% 117M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 65900K .......... .......... .......... .......... .......... 70% 98.7M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 65950K .......... .......... .......... .......... .......... 71% 49.9M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66000K .......... .......... .......... .......... .......... 71% 86.0M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66050K .......... .......... .......... .......... .......... 71% 108M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66100K .......... .......... .......... .......... .......... 71% 124M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66150K .......... .......... .......... .......... .......... 71% 80.5M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66200K .......... .......... .......... .......... .......... 71% 111M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66250K .......... .......... .......... .......... .......... 71% 87.6M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66300K .......... .......... .......... .......... .......... 71% 110M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66350K .......... .......... .......... .......... .......... 71% 89.3M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66400K .......... .......... .......... .......... .......... 71% 68.5M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66450K .......... .......... .......... .......... .......... 71% 100M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66500K .......... .......... .......... .......... .......... 71% 116M 0s 2024-04-03T04:03:04.497 INFO:teuthology.orchestra.run.smithi104.stderr: 66550K .......... .......... .......... .......... .......... 71% 109M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 66600K .......... .......... .......... .......... .......... 71% 112M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 66650K .......... .......... .......... .......... .......... 71% 82.7M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 66700K .......... .......... .......... .......... .......... 71% 94.1M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 66750K .......... .......... .......... .......... .......... 71% 93.6M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 66800K .......... .......... .......... .......... .......... 71% 123M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 66850K .......... .......... .......... .......... .......... 72% 96.6M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 66900K .......... .......... .......... .......... .......... 72% 46.6M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 66950K .......... .......... .......... .......... .......... 72% 84.7M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 67000K .......... .......... .......... .......... .......... 72% 87.1M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 67050K .......... .......... .......... .......... .......... 72% 111M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 67100K .......... .......... .......... .......... .......... 72% 51.8M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 67150K .......... .......... .......... .......... .......... 72% 64.9M 0s 2024-04-03T04:03:04.498 INFO:teuthology.orchestra.run.smithi104.stderr: 67200K .......... .......... .......... .......... .......... 72% 50.1M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67250K .......... .......... .......... .......... .......... 72% 107M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67300K .......... .......... .......... .......... .......... 72% 109M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67350K .......... .......... .......... .......... .......... 72% 90.4M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67400K .......... .......... .......... .......... .......... 72% 56.0M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67450K .......... .......... .......... .......... .......... 72% 69.7M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67500K .......... .......... .......... .......... .......... 72% 102M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67550K .......... .......... .......... .......... .......... 72% 50.5M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67600K .......... .......... .......... .......... .......... 72% 48.5M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67650K .......... .......... .......... .......... .......... 72% 75.8M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67700K .......... .......... .......... .......... .......... 72% 74.2M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67750K .......... .......... .......... .......... .......... 72% 106M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67800K .......... .......... .......... .......... .......... 73% 56.0M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67850K .......... .......... .......... .......... .......... 73% 127M 0s 2024-04-03T04:03:04.499 INFO:teuthology.orchestra.run.smithi104.stderr: 67900K .......... .......... .......... .......... .......... 73% 109M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 67950K .......... .......... .......... .......... .......... 73% 72.2M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68000K .......... .......... .......... .......... .......... 73% 108M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68050K .......... .......... .......... .......... .......... 73% 98.9M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68100K .......... .......... .......... .......... .......... 73% 66.0M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68150K .......... .......... .......... .......... .......... 73% 85.3M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68200K .......... .......... .......... .......... .......... 73% 102M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68250K .......... .......... .......... .......... .......... 73% 94.3M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68300K .......... .......... .......... .......... .......... 73% 96.7M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68350K .......... .......... .......... .......... .......... 73% 50.1M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68400K .......... .......... .......... .......... .......... 73% 107M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68450K .......... .......... .......... .......... .......... 73% 111M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68500K .......... .......... .......... .......... .......... 73% 102M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68550K .......... .......... .......... .......... .......... 73% 82.9M 0s 2024-04-03T04:03:04.500 INFO:teuthology.orchestra.run.smithi104.stderr: 68600K .......... .......... .......... .......... .......... 73% 82.3M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 68650K .......... .......... .......... .......... .......... 73% 104M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 68700K .......... .......... .......... .......... .......... 74% 71.7M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 68750K .......... .......... .......... .......... .......... 74% 129M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 68800K .......... .......... .......... .......... .......... 74% 72.7M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 68850K .......... .......... .......... .......... .......... 74% 118M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 68900K .......... .......... .......... .......... .......... 74% 63.3M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 68950K .......... .......... .......... .......... .......... 74% 145M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 69000K .......... .......... .......... .......... .......... 74% 107M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 69050K .......... .......... .......... .......... .......... 74% 83.2M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 69100K .......... .......... .......... .......... .......... 74% 117M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 69150K .......... .......... .......... .......... .......... 74% 58.3M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 69200K .......... .......... .......... .......... .......... 74% 54.7M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 69250K .......... .......... .......... .......... .......... 74% 149M 0s 2024-04-03T04:03:04.501 INFO:teuthology.orchestra.run.smithi104.stderr: 69300K .......... .......... .......... .......... .......... 74% 129M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69350K .......... .......... .......... .......... .......... 74% 97.3M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69400K .......... .......... .......... .......... .......... 74% 86.6M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69450K .......... .......... .......... .......... .......... 74% 77.9M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69500K .......... .......... .......... .......... .......... 74% 77.2M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69550K .......... .......... .......... .......... .......... 74% 77.3M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69600K .......... .......... .......... .......... .......... 74% 61.6M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69650K .......... .......... .......... .......... .......... 75% 158M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69700K .......... .......... .......... .......... .......... 75% 70.9M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69750K .......... .......... .......... .......... .......... 75% 50.1M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69800K .......... .......... .......... .......... .......... 75% 112M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69850K .......... .......... .......... .......... .......... 75% 143M 0s 2024-04-03T04:03:04.502 INFO:teuthology.orchestra.run.smithi104.stderr: 69900K .......... .......... .......... .......... .......... 75% 47.8M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 69950K .......... .......... .......... .......... .......... 75% 50.6M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70000K .......... .......... .......... .......... .......... 75% 114M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70050K .......... .......... .......... .......... .......... 75% 51.3M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70100K .......... .......... .......... .......... .......... 75% 123M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70150K .......... .......... .......... .......... .......... 75% 61.4M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70200K .......... .......... .......... .......... .......... 75% 83.0M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70250K .......... .......... .......... .......... .......... 75% 149M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70300K .......... .......... .......... .......... .......... 75% 134M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70350K .......... .......... .......... .......... .......... 75% 104M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70400K .......... .......... .......... .......... .......... 75% 60.1M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70450K .......... .......... .......... .......... .......... 75% 77.3M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70500K .......... .......... .......... .......... .......... 75% 68.9M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70550K .......... .......... .......... .......... .......... 75% 118M 0s 2024-04-03T04:03:04.503 INFO:teuthology.orchestra.run.smithi104.stderr: 70600K .......... .......... .......... .......... .......... 76% 98.4M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 70650K .......... .......... .......... .......... .......... 76% 106M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 70700K .......... .......... .......... .......... .......... 76% 106M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 70750K .......... .......... .......... .......... .......... 76% 76.4M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 70800K .......... .......... .......... .......... .......... 76% 128M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 70850K .......... .......... .......... .......... .......... 76% 65.5M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 70900K .......... .......... .......... .......... .......... 76% 62.8M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 70950K .......... .......... .......... .......... .......... 76% 77.7M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 71000K .......... .......... .......... .......... .......... 76% 110M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 71050K .......... .......... .......... .......... .......... 76% 69.9M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 71100K .......... .......... .......... .......... .......... 76% 85.4M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 71150K .......... .......... .......... .......... .......... 76% 91.0M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 71200K .......... .......... .......... .......... .......... 76% 76.9M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 71250K .......... .......... .......... .......... .......... 76% 114M 0s 2024-04-03T04:03:04.504 INFO:teuthology.orchestra.run.smithi104.stderr: 71300K .......... .......... .......... .......... .......... 76% 71.3M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71350K .......... .......... .......... .......... .......... 76% 76.2M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71400K .......... .......... .......... .......... .......... 76% 104M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71450K .......... .......... .......... .......... .......... 76% 116M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71500K .......... .......... .......... .......... .......... 77% 100M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71550K .......... .......... .......... .......... .......... 77% 66.4M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71600K .......... .......... .......... .......... .......... 77% 84.3M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71650K .......... .......... .......... .......... .......... 77% 90.8M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71700K .......... .......... .......... .......... .......... 77% 123M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71750K .......... .......... .......... .......... .......... 77% 101M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71800K .......... .......... .......... .......... .......... 77% 69.6M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71850K .......... .......... .......... .......... .......... 77% 120M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71900K .......... .......... .......... .......... .......... 77% 116M 0s 2024-04-03T04:03:04.505 INFO:teuthology.orchestra.run.smithi104.stderr: 71950K .......... .......... .......... .......... .......... 77% 89.2M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72000K .......... .......... .......... .......... .......... 77% 108M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72050K .......... .......... .......... .......... .......... 77% 115M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72100K .......... .......... .......... .......... .......... 77% 107M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72150K .......... .......... .......... .......... .......... 77% 112M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72200K .......... .......... .......... .......... .......... 77% 95.8M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72250K .......... .......... .......... .......... .......... 77% 28.5M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72300K .......... .......... .......... .......... .......... 77% 58.6M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72350K .......... .......... .......... .......... .......... 77% 36.2M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72400K .......... .......... .......... .......... .......... 77% 132M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72450K .......... .......... .......... .......... .......... 78% 107M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72500K .......... .......... .......... .......... .......... 78% 48.5M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72550K .......... .......... .......... .......... .......... 78% 61.7M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72600K .......... .......... .......... .......... .......... 78% 81.1M 0s 2024-04-03T04:03:04.506 INFO:teuthology.orchestra.run.smithi104.stderr: 72650K .......... .......... .......... .......... .......... 78% 100M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 72700K .......... .......... .......... .......... .......... 78% 68.2M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 72750K .......... .......... .......... .......... .......... 78% 74.8M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 72800K .......... .......... .......... .......... .......... 78% 92.8M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 72850K .......... .......... .......... .......... .......... 78% 51.9M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 72900K .......... .......... .......... .......... .......... 78% 91.6M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 72950K .......... .......... .......... .......... .......... 78% 28.5M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 73000K .......... .......... .......... .......... .......... 78% 68.7M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 73050K .......... .......... .......... .......... .......... 78% 130M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 73100K .......... .......... .......... .......... .......... 78% 114M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 73150K .......... .......... .......... .......... .......... 78% 69.7M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 73200K .......... .......... .......... .......... .......... 78% 128M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 73250K .......... .......... .......... .......... .......... 78% 111M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 73300K .......... .......... .......... .......... .......... 78% 86.5M 0s 2024-04-03T04:03:04.507 INFO:teuthology.orchestra.run.smithi104.stderr: 73350K .......... .......... .......... .......... .......... 79% 124M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73400K .......... .......... .......... .......... .......... 79% 133M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73450K .......... .......... .......... .......... .......... 79% 85.5M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73500K .......... .......... .......... .......... .......... 79% 85.7M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73550K .......... .......... .......... .......... .......... 79% 82.8M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73600K .......... .......... .......... .......... .......... 79% 114M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73650K .......... .......... .......... .......... .......... 79% 99.6M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73700K .......... .......... .......... .......... .......... 79% 116M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73750K .......... .......... .......... .......... .......... 79% 96.7M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73800K .......... .......... .......... .......... .......... 79% 122M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73850K .......... .......... .......... .......... .......... 79% 74.9M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73900K .......... .......... .......... .......... .......... 79% 107M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 73950K .......... .......... .......... .......... .......... 79% 89.0M 0s 2024-04-03T04:03:04.508 INFO:teuthology.orchestra.run.smithi104.stderr: 74000K .......... .......... .......... .......... .......... 79% 96.9M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74050K .......... .......... .......... .......... .......... 79% 97.3M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74100K .......... .......... .......... .......... .......... 79% 149M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74150K .......... .......... .......... .......... .......... 79% 90.4M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74200K .......... .......... .......... .......... .......... 79% 90.6M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74250K .......... .......... .......... .......... .......... 79% 119M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74300K .......... .......... .......... .......... .......... 80% 99.8M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74350K .......... .......... .......... .......... .......... 80% 55.4M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74400K .......... .......... .......... .......... .......... 80% 88.5M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74450K .......... .......... .......... .......... .......... 80% 61.6M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74500K .......... .......... .......... .......... .......... 80% 97.3M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74550K .......... .......... .......... .......... .......... 80% 92.0M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74600K .......... .......... .......... .......... .......... 80% 97.7M 0s 2024-04-03T04:03:04.509 INFO:teuthology.orchestra.run.smithi104.stderr: 74650K .......... .......... .......... .......... .......... 80% 62.3M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 74700K .......... .......... .......... .......... .......... 80% 104M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 74750K .......... .......... .......... .......... .......... 80% 70.2M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 74800K .......... .......... .......... .......... .......... 80% 92.3M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 74850K .......... .......... .......... .......... .......... 80% 96.5M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 74900K .......... .......... .......... .......... .......... 80% 62.6M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 74950K .......... .......... .......... .......... .......... 80% 86.0M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 75000K .......... .......... .......... .......... .......... 80% 105M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 75050K .......... .......... .......... .......... .......... 80% 78.2M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 75100K .......... .......... .......... .......... .......... 80% 111M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 75150K .......... .......... .......... .......... .......... 80% 59.3M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 75200K .......... .......... .......... .......... .......... 81% 107M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 75250K .......... .......... .......... .......... .......... 81% 123M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 75300K .......... .......... .......... .......... .......... 81% 52.5M 0s 2024-04-03T04:03:04.510 INFO:teuthology.orchestra.run.smithi104.stderr: 75350K .......... .......... .......... .......... .......... 81% 59.8M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75400K .......... .......... .......... .......... .......... 81% 74.4M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75450K .......... .......... .......... .......... .......... 81% 92.1M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75500K .......... .......... .......... .......... .......... 81% 82.7M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75550K .......... .......... .......... .......... .......... 81% 87.3M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75600K .......... .......... .......... .......... .......... 81% 81.6M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75650K .......... .......... .......... .......... .......... 81% 96.8M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75700K .......... .......... .......... .......... .......... 81% 120M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75750K .......... .......... .......... .......... .......... 81% 73.3M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75800K .......... .......... .......... .......... .......... 81% 125M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75850K .......... .......... .......... .......... .......... 81% 86.1M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75900K .......... .......... .......... .......... .......... 81% 113M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 75950K .......... .......... .......... .......... .......... 81% 77.9M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 76000K .......... .......... .......... .......... .......... 81% 63.8M 0s 2024-04-03T04:03:04.511 INFO:teuthology.orchestra.run.smithi104.stderr: 76050K .......... .......... .......... .......... .......... 81% 88.1M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76100K .......... .......... .......... .......... .......... 81% 127M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76150K .......... .......... .......... .......... .......... 82% 103M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76200K .......... .......... .......... .......... .......... 82% 116M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76250K .......... .......... .......... .......... .......... 82% 107M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76300K .......... .......... .......... .......... .......... 82% 90.9M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76350K .......... .......... .......... .......... .......... 82% 81.7M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76400K .......... .......... .......... .......... .......... 82% 120M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76450K .......... .......... .......... .......... .......... 82% 84.7M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76500K .......... .......... .......... .......... .......... 82% 112M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76550K .......... .......... .......... .......... .......... 82% 102M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76600K .......... .......... .......... .......... .......... 82% 106M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76650K .......... .......... .......... .......... .......... 82% 90.0M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76700K .......... .......... .......... .......... .......... 82% 105M 0s 2024-04-03T04:03:04.512 INFO:teuthology.orchestra.run.smithi104.stderr: 76750K .......... .......... .......... .......... .......... 82% 71.0M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 76800K .......... .......... .......... .......... .......... 82% 126M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 76850K .......... .......... .......... .......... .......... 82% 106M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 76900K .......... .......... .......... .......... .......... 82% 78.0M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 76950K .......... .......... .......... .......... .......... 82% 85.0M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 77000K .......... .......... .......... .......... .......... 82% 86.2M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 77050K .......... .......... .......... .......... .......... 82% 116M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 77100K .......... .......... .......... .......... .......... 83% 103M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 77150K .......... .......... .......... .......... .......... 83% 86.5M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 77200K .......... .......... .......... .......... .......... 83% 45.6M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 77250K .......... .......... .......... .......... .......... 83% 124M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 77300K .......... .......... .......... .......... .......... 83% 129M 0s 2024-04-03T04:03:04.513 INFO:teuthology.orchestra.run.smithi104.stderr: 77350K .......... .......... .......... .......... .......... 83% 66.8M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77400K .......... .......... .......... .......... .......... 83% 127M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77450K .......... .......... .......... .......... .......... 83% 112M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77500K .......... .......... .......... .......... .......... 83% 114M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77550K .......... .......... .......... .......... .......... 83% 73.3M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77600K .......... .......... .......... .......... .......... 83% 134M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77650K .......... .......... .......... .......... .......... 83% 104M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77700K .......... .......... .......... .......... .......... 83% 51.2M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77750K .......... .......... .......... .......... .......... 83% 105M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77800K .......... .......... .......... .......... .......... 83% 115M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77850K .......... .......... .......... .......... .......... 83% 41.4M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77900K .......... .......... .......... .......... .......... 83% 115M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 77950K .......... .......... .......... .......... .......... 83% 82.4M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 78000K .......... .......... .......... .......... .......... 84% 98.3M 0s 2024-04-03T04:03:04.514 INFO:teuthology.orchestra.run.smithi104.stderr: 78050K .......... .......... .......... .......... .......... 84% 108M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78100K .......... .......... .......... .......... .......... 84% 96.3M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78150K .......... .......... .......... .......... .......... 84% 45.5M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78200K .......... .......... .......... .......... .......... 84% 158M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78250K .......... .......... .......... .......... .......... 84% 137M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78300K .......... .......... .......... .......... .......... 84% 99.3M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78350K .......... .......... .......... .......... .......... 84% 61.7M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78400K .......... .......... .......... .......... .......... 84% 69.5M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78450K .......... .......... .......... .......... .......... 84% 121M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78500K .......... .......... .......... .......... .......... 84% 120M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78550K .......... .......... .......... .......... .......... 84% 65.5M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78600K .......... .......... .......... .......... .......... 84% 96.7M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78650K .......... .......... .......... .......... .......... 84% 48.3M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78700K .......... .......... .......... .......... .......... 84% 158M 0s 2024-04-03T04:03:04.515 INFO:teuthology.orchestra.run.smithi104.stderr: 78750K .......... .......... .......... .......... .......... 84% 70.7M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 78800K .......... .......... .......... .......... .......... 84% 75.8M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 78850K .......... .......... .......... .......... .......... 84% 93.9M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 78900K .......... .......... .......... .......... .......... 84% 119M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 78950K .......... .......... .......... .......... .......... 85% 89.2M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79000K .......... .......... .......... .......... .......... 85% 90.8M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79050K .......... .......... .......... .......... .......... 85% 97.1M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79100K .......... .......... .......... .......... .......... 85% 87.8M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79150K .......... .......... .......... .......... .......... 85% 51.1M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79200K .......... .......... .......... .......... .......... 85% 124M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79250K .......... .......... .......... .......... .......... 85% 110M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79300K .......... .......... .......... .......... .......... 85% 72.7M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79350K .......... .......... .......... .......... .......... 85% 111M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79400K .......... .......... .......... .......... .......... 85% 117M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79450K .......... .......... .......... .......... .......... 85% 82.4M 0s 2024-04-03T04:03:04.516 INFO:teuthology.orchestra.run.smithi104.stderr: 79500K .......... .......... .......... .......... .......... 85% 118M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 79550K .......... .......... .......... .......... .......... 85% 89.9M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 79600K .......... .......... .......... .......... .......... 85% 112M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 79650K .......... .......... .......... .......... .......... 85% 119M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 79700K .......... .......... .......... .......... .......... 85% 92.5M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 79750K .......... .......... .......... .......... .......... 85% 61.5M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 79800K .......... .......... .......... .......... .......... 85% 90.7M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 79850K .......... .......... .......... .......... .......... 86% 109M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 79900K .......... .......... .......... .......... .......... 86% 109M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 79950K .......... .......... .......... .......... .......... 86% 84.3M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 80000K .......... .......... .......... .......... .......... 86% 74.9M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 80050K .......... .......... .......... .......... .......... 86% 152M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 80100K .......... .......... .......... .......... .......... 86% 124M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 80150K .......... .......... .......... .......... .......... 86% 100M 0s 2024-04-03T04:03:04.517 INFO:teuthology.orchestra.run.smithi104.stderr: 80200K .......... .......... .......... .......... .......... 86% 75.9M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80250K .......... .......... .......... .......... .......... 86% 84.4M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80300K .......... .......... .......... .......... .......... 86% 134M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80350K .......... .......... .......... .......... .......... 86% 22.8M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80400K .......... .......... .......... .......... .......... 86% 116M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80450K .......... .......... .......... .......... .......... 86% 65.3M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80500K .......... .......... .......... .......... .......... 86% 104M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80550K .......... .......... .......... .......... .......... 86% 108M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80600K .......... .......... .......... .......... .......... 86% 98.0M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80650K .......... .......... .......... .......... .......... 86% 88.2M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80700K .......... .......... .......... .......... .......... 86% 113M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80750K .......... .......... .......... .......... .......... 86% 85.8M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80800K .......... .......... .......... .......... .......... 87% 78.1M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80850K .......... .......... .......... .......... .......... 87% 115M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80900K .......... .......... .......... .......... .......... 87% 92.1M 0s 2024-04-03T04:03:04.518 INFO:teuthology.orchestra.run.smithi104.stderr: 80950K .......... .......... .......... .......... .......... 87% 45.2M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81000K .......... .......... .......... .......... .......... 87% 92.8M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81050K .......... .......... .......... .......... .......... 87% 116M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81100K .......... .......... .......... .......... .......... 87% 62.5M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81150K .......... .......... .......... .......... .......... 87% 65.2M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81200K .......... .......... .......... .......... .......... 87% 66.4M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81250K .......... .......... .......... .......... .......... 87% 86.9M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81300K .......... .......... .......... .......... .......... 87% 116M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81350K .......... .......... .......... .......... .......... 87% 66.0M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81400K .......... .......... .......... .......... .......... 87% 46.4M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81450K .......... .......... .......... .......... .......... 87% 125M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81500K .......... .......... .......... .......... .......... 87% 102M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81550K .......... .......... .......... .......... .......... 87% 81.7M 0s 2024-04-03T04:03:04.519 INFO:teuthology.orchestra.run.smithi104.stderr: 81600K .......... .......... .......... .......... .......... 87% 75.5M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 81650K .......... .......... .......... .......... .......... 87% 110M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 81700K .......... .......... .......... .......... .......... 87% 71.6M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 81750K .......... .......... .......... .......... .......... 88% 118M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 81800K .......... .......... .......... .......... .......... 88% 72.9M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 81850K .......... .......... .......... .......... .......... 88% 68.5M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 81900K .......... .......... .......... .......... .......... 88% 77.3M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 81950K .......... .......... .......... .......... .......... 88% 67.1M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 82000K .......... .......... .......... .......... .......... 88% 98.4M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 82050K .......... .......... .......... .......... .......... 88% 120M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 82100K .......... .......... .......... .......... .......... 88% 77.7M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 82150K .......... .......... .......... .......... .......... 88% 97.3M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 82200K .......... .......... .......... .......... .......... 88% 119M 0s 2024-04-03T04:03:04.520 INFO:teuthology.orchestra.run.smithi104.stderr: 82250K .......... .......... .......... .......... .......... 88% 82.8M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82300K .......... .......... .......... .......... .......... 88% 96.3M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82350K .......... .......... .......... .......... .......... 88% 78.8M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82400K .......... .......... .......... .......... .......... 88% 71.0M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82450K .......... .......... .......... .......... .......... 88% 125M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82500K .......... .......... .......... .......... .......... 88% 111M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82550K .......... .......... .......... .......... .......... 88% 101M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82600K .......... .......... .......... .......... .......... 88% 59.4M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82650K .......... .......... .......... .......... .......... 89% 211M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82700K .......... .......... .......... .......... .......... 89% 69.6M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82750K .......... .......... .......... .......... .......... 89% 68.0M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82800K .......... .......... .......... .......... .......... 89% 60.6M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82850K .......... .......... .......... .......... .......... 89% 102M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82900K .......... .......... .......... .......... .......... 89% 98.0M 0s 2024-04-03T04:03:04.521 INFO:teuthology.orchestra.run.smithi104.stderr: 82950K .......... .......... .......... .......... .......... 89% 82.7M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83000K .......... .......... .......... .......... .......... 89% 77.2M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83050K .......... .......... .......... .......... .......... 89% 81.8M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83100K .......... .......... .......... .......... .......... 89% 85.0M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83150K .......... .......... .......... .......... .......... 89% 86.8M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83200K .......... .......... .......... .......... .......... 89% 113M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83250K .......... .......... .......... .......... .......... 89% 82.3M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83300K .......... .......... .......... .......... .......... 89% 87.3M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83350K .......... .......... .......... .......... .......... 89% 113M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83400K .......... .......... .......... .......... .......... 89% 121M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83450K .......... .......... .......... .......... .......... 89% 30.2M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83500K .......... .......... .......... .......... .......... 89% 121M 0s 2024-04-03T04:03:04.522 INFO:teuthology.orchestra.run.smithi104.stderr: 83550K .......... .......... .......... .......... .......... 89% 91.3M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 83600K .......... .......... .......... .......... .......... 90% 96.5M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 83650K .......... .......... .......... .......... .......... 90% 115M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 83700K .......... .......... .......... .......... .......... 90% 105M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 83750K .......... .......... .......... .......... .......... 90% 114M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 83800K .......... .......... .......... .......... .......... 90% 74.3M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 83850K .......... .......... .......... .......... .......... 90% 141M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 83900K .......... .......... .......... .......... .......... 90% 95.5M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 83950K .......... .......... .......... .......... .......... 90% 67.3M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 84000K .......... .......... .......... .......... .......... 90% 108M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 84050K .......... .......... .......... .......... .......... 90% 116M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 84100K .......... .......... .......... .......... .......... 90% 120M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 84150K .......... .......... .......... .......... .......... 90% 49.4M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 84200K .......... .......... .......... .......... .......... 90% 93.7M 0s 2024-04-03T04:03:04.523 INFO:teuthology.orchestra.run.smithi104.stderr: 84250K .......... .......... .......... .......... .......... 90% 94.4M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84300K .......... .......... .......... .......... .......... 90% 112M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84350K .......... .......... .......... .......... .......... 90% 86.5M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84400K .......... .......... .......... .......... .......... 90% 66.2M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84450K .......... .......... .......... .......... .......... 90% 62.1M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84500K .......... .......... .......... .......... .......... 91% 86.5M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84550K .......... .......... .......... .......... .......... 91% 116M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84600K .......... .......... .......... .......... .......... 91% 87.5M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84650K .......... .......... .......... .......... .......... 91% 66.5M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84700K .......... .......... .......... .......... .......... 91% 100M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84750K .......... .......... .......... .......... .......... 91% 71.1M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84800K .......... .......... .......... .......... .......... 91% 108M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84850K .......... .......... .......... .......... .......... 91% 58.5M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84900K .......... .......... .......... .......... .......... 91% 50.1M 0s 2024-04-03T04:03:04.524 INFO:teuthology.orchestra.run.smithi104.stderr: 84950K .......... .......... .......... .......... .......... 91% 57.8M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85000K .......... .......... .......... .......... .......... 91% 136M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85050K .......... .......... .......... .......... .......... 91% 94.9M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85100K .......... .......... .......... .......... .......... 91% 86.3M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85150K .......... .......... .......... .......... .......... 91% 70.1M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85200K .......... .......... .......... .......... .......... 91% 97.0M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85250K .......... .......... .......... .......... .......... 91% 101M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85300K .......... .......... .......... .......... .......... 91% 81.1M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85350K .......... .......... .......... .......... .......... 91% 84.0M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85400K .......... .......... .......... .......... .......... 91% 71.0M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85450K .......... .......... .......... .......... .......... 92% 120M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85500K .......... .......... .......... .......... .......... 92% 62.2M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85550K .......... .......... .......... .......... .......... 92% 56.3M 0s 2024-04-03T04:03:04.525 INFO:teuthology.orchestra.run.smithi104.stderr: 85600K .......... .......... .......... .......... .......... 92% 88.7M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 85650K .......... .......... .......... .......... .......... 92% 122M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 85700K .......... .......... .......... .......... .......... 92% 118M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 85750K .......... .......... .......... .......... .......... 92% 46.2M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 85800K .......... .......... .......... .......... .......... 92% 78.4M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 85850K .......... .......... .......... .......... .......... 92% 112M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 85900K .......... .......... .......... .......... .......... 92% 62.0M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 85950K .......... .......... .......... .......... .......... 92% 89.6M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 86000K .......... .......... .......... .......... .......... 92% 154M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 86050K .......... .......... .......... .......... .......... 92% 64.0M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 86100K .......... .......... .......... .......... .......... 92% 86.5M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 86150K .......... .......... .......... .......... .......... 92% 97.2M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 86200K .......... .......... .......... .......... .......... 92% 103M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 86250K .......... .......... .......... .......... .......... 92% 88.5M 0s 2024-04-03T04:03:04.526 INFO:teuthology.orchestra.run.smithi104.stderr: 86300K .......... .......... .......... .......... .......... 92% 74.1M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86350K .......... .......... .......... .......... .......... 93% 70.4M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86400K .......... .......... .......... .......... .......... 93% 75.4M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86450K .......... .......... .......... .......... .......... 93% 126M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86500K .......... .......... .......... .......... .......... 93% 79.3M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86550K .......... .......... .......... .......... .......... 93% 93.5M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86600K .......... .......... .......... .......... .......... 93% 62.3M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86650K .......... .......... .......... .......... .......... 93% 102M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86700K .......... .......... .......... .......... .......... 93% 78.9M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86750K .......... .......... .......... .......... .......... 93% 71.0M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86800K .......... .......... .......... .......... .......... 93% 88.8M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86850K .......... .......... .......... .......... .......... 93% 48.4M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86900K .......... .......... .......... .......... .......... 93% 121M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 86950K .......... .......... .......... .......... .......... 93% 57.6M 0s 2024-04-03T04:03:04.527 INFO:teuthology.orchestra.run.smithi104.stderr: 87000K .......... .......... .......... .......... .......... 93% 81.0M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87050K .......... .......... .......... .......... .......... 93% 85.3M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87100K .......... .......... .......... .......... .......... 93% 116M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87150K .......... .......... .......... .......... .......... 93% 86.7M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87200K .......... .......... .......... .......... .......... 93% 42.1M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87250K .......... .......... .......... .......... .......... 93% 58.3M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87300K .......... .......... .......... .......... .......... 94% 124M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87350K .......... .......... .......... .......... .......... 94% 105M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87400K .......... .......... .......... .......... .......... 94% 78.4M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87450K .......... .......... .......... .......... .......... 94% 96.4M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87500K .......... .......... .......... .......... .......... 94% 98.2M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87550K .......... .......... .......... .......... .......... 94% 68.1M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87600K .......... .......... .......... .......... .......... 94% 142M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87650K .......... .......... .......... .......... .......... 94% 112M 0s 2024-04-03T04:03:04.528 INFO:teuthology.orchestra.run.smithi104.stderr: 87700K .......... .......... .......... .......... .......... 94% 93.0M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 87750K .......... .......... .......... .......... .......... 94% 48.0M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 87800K .......... .......... .......... .......... .......... 94% 116M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 87850K .......... .......... .......... .......... .......... 94% 73.4M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 87900K .......... .......... .......... .......... .......... 94% 43.2M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 87950K .......... .......... .......... .......... .......... 94% 33.7M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 88000K .......... .......... .......... .......... .......... 94% 66.9M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 88050K .......... .......... .......... .......... .......... 94% 110M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 88100K .......... .......... .......... .......... .......... 94% 80.7M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 88150K .......... .......... .......... .......... .......... 94% 57.3M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 88200K .......... .......... .......... .......... .......... 94% 60.1M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 88250K .......... .......... .......... .......... .......... 95% 106M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 88300K .......... .......... .......... .......... .......... 95% 52.3M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 88350K .......... .......... .......... .......... .......... 95% 88.6M 0s 2024-04-03T04:03:04.529 INFO:teuthology.orchestra.run.smithi104.stderr: 88400K .......... .......... .......... .......... .......... 95% 88.6M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88450K .......... .......... .......... .......... .......... 95% 107M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88500K .......... .......... .......... .......... .......... 95% 29.4M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88550K .......... .......... .......... .......... .......... 95% 93.4M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88600K .......... .......... .......... .......... .......... 95% 68.0M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88650K .......... .......... .......... .......... .......... 95% 79.5M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88700K .......... .......... .......... .......... .......... 95% 82.9M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88750K .......... .......... .......... .......... .......... 95% 76.0M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88800K .......... .......... .......... .......... .......... 95% 119M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88850K .......... .......... .......... .......... .......... 95% 76.5M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88900K .......... .......... .......... .......... .......... 95% 88.1M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 88950K .......... .......... .......... .......... .......... 95% 88.5M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 89000K .......... .......... .......... .......... .......... 95% 118M 0s 2024-04-03T04:03:04.530 INFO:teuthology.orchestra.run.smithi104.stderr: 89050K .......... .......... .......... .......... .......... 95% 77.4M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89100K .......... .......... .......... .......... .......... 95% 49.4M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89150K .......... .......... .......... .......... .......... 96% 62.9M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89200K .......... .......... .......... .......... .......... 96% 56.4M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89250K .......... .......... .......... .......... .......... 96% 117M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89300K .......... .......... .......... .......... .......... 96% 89.7M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89350K .......... .......... .......... .......... .......... 96% 64.6M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89400K .......... .......... .......... .......... .......... 96% 55.4M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89450K .......... .......... .......... .......... .......... 96% 113M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89500K .......... .......... .......... .......... .......... 96% 68.6M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89550K .......... .......... .......... .......... .......... 96% 38.7M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89600K .......... .......... .......... .......... .......... 96% 85.4M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89650K .......... .......... .......... .......... .......... 96% 24.4M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89700K .......... .......... .......... .......... .......... 96% 111M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89750K .......... .......... .......... .......... .......... 96% 47.7M 0s 2024-04-03T04:03:04.531 INFO:teuthology.orchestra.run.smithi104.stderr: 89800K .......... .......... .......... .......... .......... 96% 57.6M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 89850K .......... .......... .......... .......... .......... 96% 73.4M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 89900K .......... .......... .......... .......... .......... 96% 116M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 89950K .......... .......... .......... .......... .......... 96% 48.8M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90000K .......... .......... .......... .......... .......... 96% 33.7M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90050K .......... .......... .......... .......... .......... 96% 88.9M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90100K .......... .......... .......... .......... .......... 97% 63.3M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90150K .......... .......... .......... .......... .......... 97% 111M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90200K .......... .......... .......... .......... .......... 97% 105M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90250K .......... .......... .......... .......... .......... 97% 75.8M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90300K .......... .......... .......... .......... .......... 97% 115M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90350K .......... .......... .......... .......... .......... 97% 10.8M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90400K .......... .......... .......... .......... .......... 97% 124M 0s 2024-04-03T04:03:04.532 INFO:teuthology.orchestra.run.smithi104.stderr: 90450K .......... .......... .......... .......... .......... 97% 174M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90500K .......... .......... .......... .......... .......... 97% 165M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90550K .......... .......... .......... .......... .......... 97% 154M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90600K .......... .......... .......... .......... .......... 97% 161M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90650K .......... .......... .......... .......... .......... 97% 184M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90700K .......... .......... .......... .......... .......... 97% 171M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90750K .......... .......... .......... .......... .......... 97% 135M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90800K .......... .......... .......... .......... .......... 97% 168M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90850K .......... .......... .......... .......... .......... 97% 178M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90900K .......... .......... .......... .......... .......... 97% 173M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 90950K .......... .......... .......... .......... .......... 97% 152M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 91000K .......... .......... .......... .......... .......... 98% 49.7M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 91050K .......... .......... .......... .......... .......... 98% 72.8M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 91100K .......... .......... .......... .......... .......... 98% 31.9M 0s 2024-04-03T04:03:04.533 INFO:teuthology.orchestra.run.smithi104.stderr: 91150K .......... .......... .......... .......... .......... 98% 50.6M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91200K .......... .......... .......... .......... .......... 98% 119M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91250K .......... .......... .......... .......... .......... 98% 54.1M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91300K .......... .......... .......... .......... .......... 98% 20.4M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91350K .......... .......... .......... .......... .......... 98% 90.9M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91400K .......... .......... .......... .......... .......... 98% 89.6M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91450K .......... .......... .......... .......... .......... 98% 69.6M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91500K .......... .......... .......... .......... .......... 98% 88.5M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91550K .......... .......... .......... .......... .......... 98% 41.8M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91600K .......... .......... .......... .......... .......... 98% 91.2M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91650K .......... .......... .......... .......... .......... 98% 120M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91700K .......... .......... .......... .......... .......... 98% 99.0M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91750K .......... .......... .......... .......... .......... 98% 90.8M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91800K .......... .......... .......... .......... .......... 98% 116M 0s 2024-04-03T04:03:04.534 INFO:teuthology.orchestra.run.smithi104.stderr: 91850K .......... .......... .......... .......... .......... 98% 43.9M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 91900K .......... .......... .......... .......... .......... 98% 49.1M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 91950K .......... .......... .......... .......... .......... 99% 62.4M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92000K .......... .......... .......... .......... .......... 99% 55.6M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92050K .......... .......... .......... .......... .......... 99% 89.3M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92100K .......... .......... .......... .......... .......... 99% 67.2M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92150K .......... .......... .......... .......... .......... 99% 40.4M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92200K .......... .......... .......... .......... .......... 99% 64.1M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92250K .......... .......... .......... .......... .......... 99% 89.1M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92300K .......... .......... .......... .......... .......... 99% 70.4M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92350K .......... .......... .......... .......... .......... 99% 96.2M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92400K .......... .......... .......... .......... .......... 99% 70.5M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92450K .......... .......... .......... .......... .......... 99% 91.5M 0s 2024-04-03T04:03:04.535 INFO:teuthology.orchestra.run.smithi104.stderr: 92500K .......... .......... .......... .......... .......... 99% 113M 0s 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 92550K .......... .......... .......... .......... .......... 99% 34.6M 0s 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 92600K .......... .......... .......... .......... .......... 99% 37.7M 0s 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 92650K .......... .......... .......... .......... .......... 99% 66.3M 0s 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 92700K .......... .......... .......... .......... .......... 99% 125M 0s 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 92750K .......... .......... .......... .......... .......... 99% 40.6M 0s 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 92800K .......... .......... .......... .......... .......... 99% 68.4M 0s 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 92850K .......... .......... .......... .......... .......... 99% 37.1M 0s 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 92900K 100% 134G=1.2s 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03 04:03:04 (74.5 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-04-03T04:03:04.536 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-03T04:03:04.542 INFO:teuthology.orchestra.run.smithi104.stdout:Archive: gradle-6.0.1-bin.zip 2024-04-03T04:03:04.542 INFO:teuthology.orchestra.run.smithi104.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-04-03T04:03:04.543 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-04-03T04:03:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-04-03T04:03:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-04-03T04:03:04.546 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-04-03T04:03:04.546 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-04-03T04:03:04.587 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-04-03T04:03:04.588 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-04-03T04:03:04.588 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-04-03T04:03:04.588 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-04-03T04:03:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-04-03T04:03:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-04-03T04:03:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-04-03T04:03:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-04-03T04:03:04.643 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-04-03T04:03:04.660 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-04-03T04:03:04.661 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-04-03T04:03:04.664 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-04-03T04:03:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-04-03T04:03:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-04-03T04:03:04.665 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-04-03T04:03:04.666 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-04-03T04:03:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-04-03T04:03:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-04-03T04:03:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-04-03T04:03:04.682 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-04-03T04:03:04.683 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-04-03T04:03:04.684 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-04-03T04:03:04.686 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-04-03T04:03:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-04-03T04:03:04.688 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-04-03T04:03:04.704 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-04-03T04:03:04.708 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-04-03T04:03:04.711 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-04-03T04:03:04.714 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-04-03T04:03:04.714 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-04-03T04:03:04.716 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-04-03T04:03:04.717 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-04-03T04:03:04.717 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-04-03T04:03:04.721 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-04-03T04:03:04.723 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-04-03T04:03:04.745 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-04-03T04:03:04.746 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-04-03T04:03:04.752 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-04-03T04:03:04.752 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-04-03T04:03:04.752 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-04-03T04:03:04.752 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-04-03T04:03:04.752 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-04-03T04:03:04.760 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-04-03T04:03:04.760 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-04-03T04:03:04.762 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-04-03T04:03:04.762 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-04-03T04:03:04.762 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-04-03T04:03:04.763 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-04-03T04:03:04.763 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-04-03T04:03:04.763 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-04-03T04:03:04.763 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-04-03T04:03:04.763 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-04-03T04:03:04.763 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-04-03T04:03:04.763 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-04-03T04:03:04.765 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-04-03T04:03:04.765 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-04-03T04:03:04.765 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-04-03T04:03:04.765 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-04-03T04:03:04.765 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-04-03T04:03:04.765 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-04-03T04:03:04.765 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-04-03T04:03:04.765 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-04-03T04:03:04.765 INFO:teuthology.orchestra.run.smithi104.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-04-03T04:03:04.766 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-04-03T04:03:04.766 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-04-03T04:03:04.766 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-04-03T04:03:04.766 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-04-03T04:03:04.768 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-04-03T04:03:04.768 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-04-03T04:03:04.771 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-04-03T04:03:04.772 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-04-03T04:03:04.773 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-04-03T04:03:04.774 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-04-03T04:03:04.774 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-04-03T04:03:04.778 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-04-03T04:03:04.778 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-04-03T04:03:04.778 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-04-03T04:03:04.779 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-04-03T04:03:04.780 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-04-03T04:03:04.780 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-04-03T04:03:04.781 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-04-03T04:03:04.783 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-04-03T04:03:04.784 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-04-03T04:03:04.786 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-04-03T04:03:04.787 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-04-03T04:03:04.787 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-04-03T04:03:04.788 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-04-03T04:03:04.788 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-04-03T04:03:04.788 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-04-03T04:03:04.789 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-04-03T04:03:04.791 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-04-03T04:03:04.791 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-04-03T04:03:04.792 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-04-03T04:03:04.796 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-04-03T04:03:04.797 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-04-03T04:03:04.798 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-04-03T04:03:04.799 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-04-03T04:03:04.801 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-04-03T04:03:04.801 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-04-03T04:03:04.807 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-04-03T04:03:04.807 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-04-03T04:03:04.821 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-04-03T04:03:04.821 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-04-03T04:03:04.822 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-04-03T04:03:04.822 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-04-03T04:03:04.822 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-04-03T04:03:04.822 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-04-03T04:03:04.823 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-04-03T04:03:04.823 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-04-03T04:03:04.823 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-04-03T04:03:04.824 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-04-03T04:03:04.842 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-04-03T04:03:04.842 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-04-03T04:03:04.842 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-04-03T04:03:04.843 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-04-03T04:03:04.844 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-04-03T04:03:04.844 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-04-03T04:03:04.852 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-04-03T04:03:04.854 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-04-03T04:03:04.858 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-04-03T04:03:04.858 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-04-03T04:03:04.858 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-04-03T04:03:04.858 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-04-03T04:03:04.860 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-04-03T04:03:04.860 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-04-03T04:03:04.862 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-04-03T04:03:04.870 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-04-03T04:03:04.871 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-04-03T04:03:04.873 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-04-03T04:03:04.873 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-04-03T04:03:04.873 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-04-03T04:03:04.874 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-04-03T04:03:04.874 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-04-03T04:03:04.876 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-04-03T04:03:04.880 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-04-03T04:03:04.882 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-04-03T04:03:04.882 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-04-03T04:03:04.885 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-04-03T04:03:04.887 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-04-03T04:03:04.888 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-04-03T04:03:04.894 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-04-03T04:03:04.897 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-04-03T04:03:04.904 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-04-03T04:03:04.908 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-04-03T04:03:04.911 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-04-03T04:03:04.912 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-04-03T04:03:04.920 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-04-03T04:03:04.922 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-04-03T04:03:04.929 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-04-03T04:03:04.929 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-04-03T04:03:04.937 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-04-03T04:03:04.940 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-04-03T04:03:04.940 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-04-03T04:03:04.944 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-04-03T04:03:04.949 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-04-03T04:03:04.978 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-04-03T04:03:04.980 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-04-03T04:03:04.980 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-04-03T04:03:04.981 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-04-03T04:03:04.982 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-04-03T04:03:04.982 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-04-03T04:03:04.983 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-04-03T04:03:04.983 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-04-03T04:03:04.985 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-04-03T04:03:04.986 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-04-03T04:03:04.986 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-04-03T04:03:04.986 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-04-03T04:03:04.987 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-04-03T04:03:04.990 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-04-03T04:03:04.990 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-04-03T04:03:04.990 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-04-03T04:03:04.990 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-04-03T04:03:04.990 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-04-03T04:03:04.990 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-04-03T04:03:04.991 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-04-03T04:03:04.991 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-04-03T04:03:04.991 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-04-03T04:03:04.992 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-04-03T04:03:04.993 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-04-03T04:03:04.994 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-04-03T04:03:04.997 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-04-03T04:03:04.998 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-04-03T04:03:04.999 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-04-03T04:03:05.000 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-04-03T04:03:05.000 INFO:teuthology.orchestra.run.smithi104.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-04-03T04:03:05.033 INFO:teuthology.orchestra.run.smithi104.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-04-03T04:03:05.449 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:05.449 INFO:teuthology.orchestra.run.smithi104.stdout:Welcome to Gradle 6.0.1! 2024-04-03T04:03:05.449 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:05.449 INFO:teuthology.orchestra.run.smithi104.stdout:Here are the highlights of this release: 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - Substantial improvements in dependency management, including 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - Advanced control of transitive versions 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - Support for optional features and dependencies 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - Rules to tweak published metadata 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - Support for Java 13 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - Faster incremental Java and Groovy compilation 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - New Zinc compiler for Scala 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - VS2019 support 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: - Support for Gradle Enterprise plugin 3.0 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-04-03T04:03:05.450 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:05.451 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:05.451 INFO:teuthology.orchestra.run.smithi104.stdout:------------------------------------------------------------ 2024-04-03T04:03:05.451 INFO:teuthology.orchestra.run.smithi104.stdout:Gradle 6.0.1 2024-04-03T04:03:05.451 INFO:teuthology.orchestra.run.smithi104.stdout:------------------------------------------------------------ 2024-04-03T04:03:05.451 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:05.451 INFO:teuthology.orchestra.run.smithi104.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-04-03T04:03:05.452 INFO:teuthology.orchestra.run.smithi104.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-04-03T04:03:05.452 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:05.453 INFO:teuthology.orchestra.run.smithi104.stdout:Kotlin: 1.3.50 2024-04-03T04:03:05.453 INFO:teuthology.orchestra.run.smithi104.stdout:Groovy: 2.5.8 2024-04-03T04:03:05.453 INFO:teuthology.orchestra.run.smithi104.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-04-03T04:03:05.453 INFO:teuthology.orchestra.run.smithi104.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-04-03T04:03:05.453 INFO:teuthology.orchestra.run.smithi104.stdout:OS: Linux 5.15.0-101-generic amd64 2024-04-03T04:03:05.453 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:05.456 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-04-03T04:03:05.456 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-03T04:03:05.457 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T04:03:05.457 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-03T04:03:05.457 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T04:03:05.457 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-04-03T04:03:05.639 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-04-03T04:03:05.639 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-04-03T04:03:05.639 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'MOELMXVAJVQJHGFPWPHV', 'access_secret': 'xuYaj30FgjjLknilHzQaKSTnGKue1KI756KuCkIuTu7vPSKbVG/8mg==', 'region': 'mexico', 'endpoint': 'smithi104.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi104.front.sepia.ceph.com'} 2024-04-03T04:03:05.639 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-04-03T04:03:05.639 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'MOELMXVAJVQJHGFPWPHV', '--secret', 'xuYaj30FgjjLknilHzQaKSTnGKue1KI756KuCkIuTu7vPSKbVG/8mg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-04-03T04:03:05.640 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key MOELMXVAJVQJHGFPWPHV --secret xuYaj30FgjjLknilHzQaKSTnGKue1KI756KuCkIuTu7vPSKbVG/8mg== --email tester.client.0_test@test.test --cluster ceph 2024-04-03T04:03:05.675 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:03:05.675 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:03:05.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.733+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.733+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.733+0000 7fbce32d7980 20 realm 2024-04-03T04:03:05.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.733+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.733+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.733+0000 7fbce32d7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:03:05.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.733+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.737+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.737+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.737+0000 7fbce32d7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:03:05.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.737+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.737+0000 7fbce32d7980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:03:05.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.737+0000 7fbce32d7980 20 searching for the correct realm 2024-04-03T04:03:05.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.741+0000 7fbce0df2640 0 -- 172.21.15.104:0/1451796763 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x55e376a8bd70 msgr2=0x55e376a8e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:03:05.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.749+0000 7fbce05f1640 0 -- 172.21.15.104:0/1451796763 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fbcd8046040 msgr2=0x7fbcd8059020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:03:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:03:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:03:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:03:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:03:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:03:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:03:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:03:05.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 zone default found 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 4 Realm: () 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 zonegroup default 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 started sync module instance, tier type = 2024-04-03T04:03:05.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.757+0000 7fbce32d7980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:03:05.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.773+0000 7fbce32d7980 20 add_watcher() i=0 2024-04-03T04:03:05.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.773+0000 7fbce32d7980 20 add_watcher() i=1 2024-04-03T04:03:05.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.773+0000 7fbce32d7980 20 add_watcher() i=2 2024-04-03T04:03:05.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.773+0000 7fbce32d7980 20 add_watcher() i=3 2024-04-03T04:03:05.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.773+0000 7fbce32d7980 20 add_watcher() i=4 2024-04-03T04:03:05.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.773+0000 7fbce32d7980 20 add_watcher() i=5 2024-04-03T04:03:05.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.773+0000 7fbce32d7980 20 add_watcher() i=6 2024-04-03T04:03:05.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.773+0000 7fbce32d7980 20 add_watcher() i=7 2024-04-03T04:03:05.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.773+0000 7fbce32d7980 2 all 8 watchers are set, enabling cache 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbb977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 5 note: GC not initialized 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbb967e4640 20 reqs_thread_entry: start 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 20 init_complete bucket index max shards: 11 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 20 Filter name: none 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbb8f7fe640 20 reqs_thread_entry: start 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-04-03T04:03:05.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-04-03T04:03:05.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-04-03T04:03:05.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-04-03T04:03:05.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-04-03T04:03:05.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-04-03T04:03:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 10 cache get: name=default.rgw.meta+users.keys+MOELMXVAJVQJHGFPWPHV : miss 2024-04-03T04:03:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.777+0000 7fbce32d7980 20 rados->read ofs=0 len=0 2024-04-03T04:03:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbce32d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbce32d7980 10 cache put: name=default.rgw.meta+users.keys+MOELMXVAJVQJHGFPWPHV info.flags=0x0 2024-04-03T04:03:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbce32d7980 10 adding default.rgw.meta+users.keys+MOELMXVAJVQJHGFPWPHV to cache LRU end 2024-04-03T04:03:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbce32d7980 10 cache get: name=default.rgw.meta+users.keys+MOELMXVAJVQJHGFPWPHV : hit (negative entry) 2024-04-03T04:03:05.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbce32d7980 10 cache get: name=default.rgw.meta+users.keys+MOELMXVAJVQJHGFPWPHV : hit (negative entry) 2024-04-03T04:03:05.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbce32d7980 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-04-03T04:03:05.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbce32d7980 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-04-03T04:03:05.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbce32d7980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-04-03T04:03:05.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbbb7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562465 cookie 94435436786176 notifier 7425 bl.length()=637 2024-04-03T04:03:05.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbbb7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-04-03T04:03:05.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.781+0000 7fbbb7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-04-03T04:03:05.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.785+0000 7fbce32d7980 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-04-03T04:03:05.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.785+0000 7fbce32d7980 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-04-03T04:03:05.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.785+0000 7fbce32d7980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-04-03T04:03:05.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.785+0000 7fbbb7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562404 cookie 94435436772880 notifier 7425 bl.length()=200 2024-04-03T04:03:05.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.785+0000 7fbbb7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-04-03T04:03:05.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.785+0000 7fbbb7fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-04-03T04:03:05.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.789+0000 7fbce32d7980 10 cache put: name=default.rgw.meta+users.keys+MOELMXVAJVQJHGFPWPHV info.flags=0x7 2024-04-03T04:03:05.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.789+0000 7fbce32d7980 10 moving default.rgw.meta+users.keys+MOELMXVAJVQJHGFPWPHV to cache LRU end 2024-04-03T04:03:05.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.789+0000 7fbce32d7980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:MOELMXVAJVQJHGFPWPHV, ofs0, ns] 2024-04-03T04:03:05.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.789+0000 7fbbb77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 94435436780080 notifier 7425 bl.length()=189 2024-04-03T04:03:05.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.789+0000 7fbbb77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MOELMXVAJVQJHGFPWPHV info.flags=0x7 2024-04-03T04:03:05.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.789+0000 7fbbb77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MOELMXVAJVQJHGFPWPHV to cache LRU end 2024-04-03T04:03:05.773 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T04:03:05.773 INFO:teuthology.orchestra.run.smithi104.stdout: "user_id": "tester.client.0", 2024-04-03T04:03:05.774 INFO:teuthology.orchestra.run.smithi104.stdout: "display_name": "Ms. tester.client.0", 2024-04-03T04:03:05.774 INFO:teuthology.orchestra.run.smithi104.stdout: "email": "tester.client.0_test@test.test", 2024-04-03T04:03:05.774 INFO:teuthology.orchestra.run.smithi104.stdout: "suspended": 0, 2024-04-03T04:03:05.774 INFO:teuthology.orchestra.run.smithi104.stdout: "max_buckets": 1000, 2024-04-03T04:03:05.774 INFO:teuthology.orchestra.run.smithi104.stdout: "subusers": [], 2024-04-03T04:03:05.774 INFO:teuthology.orchestra.run.smithi104.stdout: "keys": [ 2024-04-03T04:03:05.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:03:05.774 INFO:teuthology.orchestra.run.smithi104.stdout: "user": "tester.client.0", 2024-04-03T04:03:05.775 INFO:teuthology.orchestra.run.smithi104.stdout: "access_key": "MOELMXVAJVQJHGFPWPHV", 2024-04-03T04:03:05.775 INFO:teuthology.orchestra.run.smithi104.stdout: "secret_key": "xuYaj30FgjjLknilHzQaKSTnGKue1KI756KuCkIuTu7vPSKbVG/8mg==", 2024-04-03T04:03:05.775 INFO:teuthology.orchestra.run.smithi104.stdout: "active": true 2024-04-03T04:03:05.775 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:03:05.775 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:03:05.775 INFO:teuthology.orchestra.run.smithi104.stdout: "swift_keys": [], 2024-04-03T04:03:05.775 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": [], 2024-04-03T04:03:05.775 INFO:teuthology.orchestra.run.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T04:03:05.775 INFO:teuthology.orchestra.run.smithi104.stdout: "default_placement": "", 2024-04-03T04:03:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: "default_storage_class": "", 2024-04-03T04:03:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: "placement_tags": [], 2024-04-03T04:03:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: "bucket_quota": { 2024-04-03T04:03:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:03:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:03:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:03:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:03:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:03:05.776 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:03:05.777 INFO:teuthology.orchestra.run.smithi104.stdout: "user_quota": { 2024-04-03T04:03:05.777 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:03:05.777 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:03:05.777 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:03:05.777 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:03:05.777 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:03:05.778 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:03:05.778 INFO:teuthology.orchestra.run.smithi104.stdout: "temp_url_keys": [], 2024-04-03T04:03:05.778 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "rgw", 2024-04-03T04:03:05.778 INFO:teuthology.orchestra.run.smithi104.stdout: "mfa_ids": [] 2024-04-03T04:03:05.779 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T04:03:05.779 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:05.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.793+0000 7fbb977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:03:05.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.797+0000 7fbce32d7980 20 remove_watcher() i=0 2024-04-03T04:03:05.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.797+0000 7fbce32d7980 2 removed watcher, disabling cache 2024-04-03T04:03:05.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.797+0000 7fbce32d7980 20 remove_watcher() i=1 2024-04-03T04:03:05.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.801+0000 7fbce32d7980 20 remove_watcher() i=2 2024-04-03T04:03:05.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.801+0000 7fbce32d7980 20 remove_watcher() i=3 2024-04-03T04:03:05.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.805+0000 7fbce32d7980 20 remove_watcher() i=4 2024-04-03T04:03:05.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.805+0000 7fbce32d7980 20 remove_watcher() i=5 2024-04-03T04:03:05.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.809+0000 7fbce32d7980 20 remove_watcher() i=6 2024-04-03T04:03:05.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:05.809+0000 7fbce32d7980 20 remove_watcher() i=7 2024-04-03T04:03:05.799 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T04:03:05.799 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-04-03T04:03:05.848 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-04-03T04:03:05.848 DEBUG:teuthology.orchestra.run.smithi104:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-04-03T04:03:05.894 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:03:05.967 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:03:05.967 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:03:06.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.029+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:06.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 20 realm 2024-04-03T04:03:06.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:03:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:03:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.033+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.037+0000 7f43a148b980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:03:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.037+0000 7f43a148b980 20 searching for the correct realm 2024-04-03T04:03:06.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.041+0000 7f439e7a5640 0 -- 172.21.15.104:0/125013838 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f4390066720 msgr2=0x7f4390059040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:03:06.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.045+0000 7f439e7a5640 0 -- 172.21.15.104:0/125013838 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f43980fe840 msgr2=0x7f4398114360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:03:06.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.261+0000 7f43a148b980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:03:06.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.261+0000 7f43a148b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:03:06.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.261+0000 7f43a148b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:03:06.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.261+0000 7f43a148b980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:03:06.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.261+0000 7f43a148b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:03:06.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.261+0000 7f43a148b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:03:06.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.261+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.261+0000 7f43a148b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:06.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.261+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:03:06.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:03:06.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 zone default found 2024-04-03T04:03:06.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 4 Realm: () 2024-04-03T04:03:06.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:03:06.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:03:06.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:03:06.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 zonegroup default 2024-04-03T04:03:06.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:06.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:06.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.265+0000 7f43a148b980 20 rados->read ofs=0 len=0 2024-04-03T04:03:06.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.269+0000 7f43a148b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:06.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.269+0000 7f43a148b980 20 started sync module instance, tier type = 2024-04-03T04:03:06.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.269+0000 7f43a148b980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:03:06.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.293+0000 7f43a148b980 20 add_watcher() i=0 2024-04-03T04:03:06.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.293+0000 7f43a148b980 20 add_watcher() i=1 2024-04-03T04:03:06.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.293+0000 7f43a148b980 20 add_watcher() i=2 2024-04-03T04:03:06.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.293+0000 7f43a148b980 20 add_watcher() i=3 2024-04-03T04:03:06.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.293+0000 7f43a148b980 20 add_watcher() i=4 2024-04-03T04:03:06.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.293+0000 7f43a148b980 20 add_watcher() i=5 2024-04-03T04:03:06.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.293+0000 7f43a148b980 20 add_watcher() i=6 2024-04-03T04:03:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.293+0000 7f43a148b980 20 add_watcher() i=7 2024-04-03T04:03:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.293+0000 7f43a148b980 2 all 8 watchers are set, enabling cache 2024-04-03T04:03:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.297+0000 7f42557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:03:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.301+0000 7f43a148b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:03:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.301+0000 7f43a148b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:03:06.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.397+0000 7f41cffff640 20 reqs_thread_entry: start 2024-04-03T04:03:06.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.397+0000 7f43a148b980 20 init_complete bucket index max shards: 11 2024-04-03T04:03:06.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.397+0000 7f43a148b980 20 Filter name: none 2024-04-03T04:03:06.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.397+0000 7f41cdffb640 20 reqs_thread_entry: start 2024-04-03T04:03:06.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.397+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:03:06.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-04-03T04:03:06.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_y8C2gOa1rpmOZx5B56HnYCEz96ymeBn', time=2024-04-03T05:57:44.023407+0000, chain.objs.size()=2 2024-04-03T04:03:06.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.zSjMuV8bD3vIXZn3L5sSu_yPHR3vcs2_0 2024-04-03T04:03:06.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.zSjMuV8bD3vIXZn3L5sSu_yPHR3vcs2_1 2024-04-03T04:03:06.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17483528783572376059', time=2024-04-03T05:57:44.626901+0000, chain.objs.size()=1 2024-04-03T04:03:06.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7__shadow_.pWiCZKBTi4xklWOna8ugd17JJyqiyeb_0 2024-04-03T04:03:06.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16376008751601045939', time=2024-04-03T05:59:37.529292+0000, chain.objs.size()=1 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.FlOo4MS2C1uYSYwSYRSzjyr4ZbRLQgP_0 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2454394820817521394', time=2024-04-03T06:00:22.132883+0000, chain.objs.size()=1 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.4b2wG_btv8XRRPGjqDAKv_RArqH3H1X_0 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2182095334653703181', time=2024-04-03T06:00:58.623376+0000, chain.objs.size()=1 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.sKC0X6cfafSKkIpQR59uCDBHwxJ_OAm_0 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9996062718890875624', time=2024-04-03T06:01:03.709981+0000, chain.objs.size()=1 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.S0_APLY83GWkF8p4jU__RsJ6Eq8snbb_0 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.249155197317799620', time=2024-04-03T06:01:06.888888+0000, chain.objs.size()=1 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.uo12bsxDe7ylLbt-KCfDTZyLg--wx0d_0 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12619537579802485603', time=2024-04-03T06:02:21.960694+0000, chain.objs.size()=1 2024-04-03T04:03:06.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.crHmT-bEiuA5_BKTZt4qqYZjAVhB9yT_0 2024-04-03T04:03:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4642091644113171830', time=2024-04-03T06:02:23.991340+0000, chain.objs.size()=1 2024-04-03T04:03:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17__shadow_.8vpVuSsBUO0yF_GW74D0fkT1An9PlcH_0 2024-04-03T04:03:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3914142291462812165', time=2024-04-03T06:02:24.024089+0000, chain.objs.size()=1 2024-04-03T04:03:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17__shadow_.sfNjiD20lud9osfdjypcdJbD0qHGyDl_0 2024-04-03T04:03:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6149265253505577871', time=2024-04-03T06:02:32.692579+0000, chain.objs.size()=1 2024-04-03T04:03:06.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.401+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18__shadow:BKEgPJhd9rBiltDJDt5EoJtq8UyWiiw_.SFDElbf3BTd5GzjTqDniL_43ogiHjoz_0 2024-04-03T04:03:06.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.413+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.417+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:03:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-04-03T04:03:06.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_zykspPtf34qVxABsZomM6rq9H7Y9aSb', time=2024-04-03T05:57:44.057265+0000, chain.objs.size()=2 2024-04-03T04:03:06.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.PVDABwzXHdKfkuWI8tQQf-QcE_ibhKp_0 2024-04-03T04:03:06.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.PVDABwzXHdKfkuWI8tQQf-QcE_ibhKp_1 2024-04-03T04:03:06.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2750051355139788687', time=2024-04-03T05:57:44.256121+0000, chain.objs.size()=5 2024-04-03T04:03:06.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1 2024-04-03T04:03:06.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1_1 2024-04-03T04:03:06.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.2 2024-04-03T04:03:06.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.2_1 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.3 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.325538438334975008', time=2024-04-03T05:59:37.521796+0000, chain.objs.size()=1 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.-JQcpFwwJ7dQKjSalGuLCDDPwmuE69y_0 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6044358997369926779', time=2024-04-03T05:59:37.523848+0000, chain.objs.size()=1 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.WIWgtwoeZR3K59opqNOr683k5zIC-mP_0 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3890557513766325153', time=2024-04-03T06:00:58.523968+0000, chain.objs.size()=1 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.e_himw3EPTnqMVYpHoRCxlanuX3qqA2_0 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1567743982080510988', time=2024-04-03T06:00:58.601492+0000, chain.objs.size()=1 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.UJxNbHftPryj6kDMVml_hh2AleCl_zL_0 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14974891333296945648', time=2024-04-03T06:00:58.603195+0000, chain.objs.size()=1 2024-04-03T04:03:06.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.421+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.Rsq9oqnCHOe7eIeMrXsLEB6zYgeuaHf_0 2024-04-03T04:03:06.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.425+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4294331087986737288', time=2024-04-03T06:01:03.553596+0000, chain.objs.size()=1 2024-04-03T04:03:06.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.425+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.Z2s-msl8otNwjIR9KmY_hGlACTNQ96w_0 2024-04-03T04:03:06.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.429+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6476932038737130214', time=2024-04-03T06:01:07.035457+0000, chain.objs.size()=1 2024-04-03T04:03:06.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.429+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.C9K8oKULi72lRZIJIolE6E3YnCFLFcH_0 2024-04-03T04:03:06.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.429+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5848329849534451126', time=2024-04-03T06:01:46.215399+0000, chain.objs.size()=1 2024-04-03T04:03:06.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.429+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.wKvIIM4CP-tfqx200fznVKGAeT7ndpi_0 2024-04-03T04:03:06.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.429+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4985936961165962348', time=2024-04-03T06:02:21.761483+0000, chain.objs.size()=1 2024-04-03T04:03:06.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.429+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.Uo0w6eZo08-T6UImg1X4wFyzrRB1sF0_0 2024-04-03T04:03:06.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.433+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.437+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:03:06.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-04-03T04:03:06.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.202705690236748296', time=2024-04-03T05:57:43.699918+0000, chain.objs.size()=1 2024-04-03T04:03:06.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.6H57frOjMCEa0Ub2LbjtR4bWcSYYYXc_0 2024-04-03T04:03:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14896964589214078392', time=2024-04-03T05:57:44.071006+0000, chain.objs.size()=2 2024-04-03T04:03:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_0 2024-04-03T04:03:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_1 2024-04-03T04:03:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_1_8c3844c3b04dd61e74306997d2c69365', time=2024-04-03T05:57:44.115395+0000, chain.objs.size()=2 2024-04-03T04:03:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_0 2024-04-03T04:03:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.441+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_1 2024-04-03T04:03:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6557673275438879606', time=2024-04-03T05:59:41.929804+0000, chain.objs.size()=1 2024-04-03T04:03:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.aMz9SZfQx2pcxvtJZrBxnuQOTyMSUX1_0 2024-04-03T04:03:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.684719481328669356', time=2024-04-03T06:00:16.871864+0000, chain.objs.size()=1 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.Jr2u6FiF1nx-GbG4lbrAb5czToKiN5j_0 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7839577050848396255', time=2024-04-03T06:00:22.043904+0000, chain.objs.size()=1 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.9O_1BuUJKyXM683CZy46VfCrMd2MUix_0 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5983057774442603736', time=2024-04-03T06:00:22.120393+0000, chain.objs.size()=1 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.bWHNYeXUl_JM8eHvqDzyba81PkIFOqZ_0 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7935690647701277204', time=2024-04-03T06:00:22.222271+0000, chain.objs.size()=1 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.i-rATMx2mqb5T989pV2-ZoXI06uA71G_0 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10972813667876878063', time=2024-04-03T06:01:40.795177+0000, chain.objs.size()=1 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.dxymTKfl3O98BhmsmZfd2V0NXVADsSU_0 2024-04-03T04:03:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2666632857540638830', time=2024-04-03T06:01:41.881085+0000, chain.objs.size()=1 2024-04-03T04:03:06.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.445+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.P-7QvuVqMMKlIe4YMXFmg38p33NY84x_0 2024-04-03T04:03:06.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2655648429230379291', time=2024-04-03T06:01:46.315604+0000, chain.objs.size()=1 2024-04-03T04:03:06.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.BV8HsT-TEzaETSxBUo-io0IZ1qLLd9t_0 2024-04-03T04:03:06.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18049922761621358948', time=2024-04-03T06:01:46.429591+0000, chain.objs.size()=1 2024-04-03T04:03:06.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.3OrAnaVK4-DdCgmWhK_8xr6jiEqLY61_0 2024-04-03T04:03:06.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5011071607119483920', time=2024-04-03T06:02:21.835504+0000, chain.objs.size()=1 2024-04-03T04:03:06.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.gJOHBDnrMJumWDqqqVN1By1P5tyuzEQ_0 2024-04-03T04:03:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2440125601584156819', time=2024-04-03T06:02:21.959093+0000, chain.objs.size()=1 2024-04-03T04:03:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.k4q3IEbKsupua9io82hDN5pjdLJQocx_0 2024-04-03T04:03:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2695271781848564756', time=2024-04-03T06:02:21.961760+0000, chain.objs.size()=1 2024-04-03T04:03:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.h7AZlADI2dM5Lozsq-4F9UEnCxYDQ9a_0 2024-04-03T04:03:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4760118863874903891', time=2024-04-03T06:02:22.019772+0000, chain.objs.size()=1 2024-04-03T04:03:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.ip77FQI-UkfthUrFvdYRc2RmfZZcuiy_0 2024-04-03T04:03:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9182407318946172453', time=2024-04-03T06:02:39.678468+0000, chain.objs.size()=1 2024-04-03T04:03:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.449+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18__shadow:e5GIhco79IAJiDxpsO2AEXtgb6Jk9ro_.QPLOsCMxlgJZUZnTav-56UlnmKhVsoB_0 2024-04-03T04:03:06.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.461+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.465+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:03:06.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.465+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-04-03T04:03:06.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_yBWQvi_W0RqmrQNG8vRFZXI4eb6BoEP', time=2024-04-03T05:57:44.174696+0000, chain.objs.size()=1 2024-04-03T04:03:06.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.j04-b-tMnq12qtJYwJRMQkUFUCH0j-h_0 2024-04-03T04:03:06.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5376031056284945021', time=2024-04-03T05:57:44.384724+0000, chain.objs.size()=5 2024-04-03T04:03:06.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.1 2024-04-03T04:03:06.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__shadow_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.1_1 2024-04-03T04:03:06.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.2 2024-04-03T04:03:06.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__shadow_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.2_1 2024-04-03T04:03:06.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-LUKEWARM.2~OdfuzyUfO20dGlIcN9ziu6BtOqQ1mdw.3 2024-04-03T04:03:06.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8878676191510139598', time=2024-04-03T05:59:41.709517+0000, chain.objs.size()=1 2024-04-03T04:03:06.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.EiaMlcLCdimpqjLwTw4wsE14kgOtqv6_0 2024-04-03T04:03:06.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4123242834318895835', time=2024-04-03T06:00:21.999059+0000, chain.objs.size()=1 2024-04-03T04:03:06.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.GsSX3yE6elOXpMj0OgRQuZ2x2fT3Tlr_0 2024-04-03T04:03:06.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15393345199139951971', time=2024-04-03T06:01:07.087710+0000, chain.objs.size()=1 2024-04-03T04:03:06.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.mk5y5h_-HC4uWDWTfTwheyl09YL7xP4_0 2024-04-03T04:03:06.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17927721378656364654', time=2024-04-03T06:01:46.348757+0000, chain.objs.size()=1 2024-04-03T04:03:06.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.469+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.A2uvr96OWNCBeucIqdE1YTsOqSDgaui_0 2024-04-03T04:03:06.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.477+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.481+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:03:06.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.481+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.481+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16637720023288216725', time=2024-04-03T05:57:43.650581+0000, chain.objs.size()=1 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.fuFTZ6gJMgS0dgdFUPwhUI9mM-3wUOg_0 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_7Bebe9jHey_gcinccmB9fIaGwQeWjEA', time=2024-04-03T05:57:44.185550+0000, chain.objs.size()=3 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.9gyC4_fVhJBWkeSBDwoGSRvFhF1Cnq-_0 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.9gyC4_fVhJBWkeSBDwoGSRvFhF1Cnq-_1 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.9gyC4_fVhJBWkeSBDwoGSRvFhF1Cnq-_2 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1563498169672134863', time=2024-04-03T05:59:37.571411+0000, chain.objs.size()=1 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.N-_NxX2a_10fC4U38aATO20O6CRM5S6_0 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13425290055672101966', time=2024-04-03T05:59:37.650220+0000, chain.objs.size()=1 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.8PzECeiLt2XtqUSqybe8u_x_Ut7ggcl_0 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11022976261223897096', time=2024-04-03T06:00:16.937889+0000, chain.objs.size()=1 2024-04-03T04:03:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.2Hvvk5v_K6vh6egP8v5UB_8QjV0jDLp_0 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17157195048509605231', time=2024-04-03T06:00:22.131556+0000, chain.objs.size()=1 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.1zUeSxRYGxQSEdVwyixJoB0P67z2dDP_0 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1530227056821779087', time=2024-04-03T06:00:58.608951+0000, chain.objs.size()=1 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.K2c63b8-VAK_HjTW2ImflxEHcRlgNTL_0 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10472413725235419451', time=2024-04-03T06:00:58.720080+0000, chain.objs.size()=1 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.3zFu25JAYJ8gImVQRieuCk9jPh9fkeB_0 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8777823518574815242', time=2024-04-03T06:01:41.656486+0000, chain.objs.size()=1 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.dwbLdkdMbUXAkMUkeEYIS1yO5ry5yG__0 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.802513220546133545', time=2024-04-03T06:02:21.763908+0000, chain.objs.size()=1 2024-04-03T04:03:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.485+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.shTHZZ6BuHD-uD8hVzTl1COCjZSP4Tv_0 2024-04-03T04:03:06.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.493+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5502453737940661251', time=2024-04-03T06:02:21.929446+0000, chain.objs.size()=1 2024-04-03T04:03:06.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.493+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.DwE3MSIPVEDQQwHzBKm-YfRPTGjBkbN_0 2024-04-03T04:03:06.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.493+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6053402446050632780', time=2024-04-03T06:02:24.018876+0000, chain.objs.size()=1 2024-04-03T04:03:06.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.493+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17__shadow_._1LFRUdT74ATYdL2IxlIDh5ZfoWO71k_0 2024-04-03T04:03:06.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.497+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.501+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:03:06.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T04:03:06.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1_1_df2c07fcb63508b201b3c60fefbb0878', time=2024-04-03T05:57:44.278929+0000, chain.objs.size()=5 2024-04-03T04:03:06.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1 2024-04-03T04:03:06.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.1_1 2024-04-03T04:03:06.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.2 2024-04-03T04:03:06.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.2_1 2024-04-03T04:03:06.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-LUKEWARM.2~4jomSLy0-JIq9fWWqZes6KzCS2TQle7.3 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1_1_09927ce8c749a41550406ddc3a89239b', time=2024-04-03T05:57:44.301791+0000, chain.objs.size()=5 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1_1 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.2 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.2_1 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.3 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4185928915863429018', time=2024-04-03T06:00:58.507907+0000, chain.objs.size()=1 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.uHI5y-cHKSLW_sziKUt2d8tTOt-BDKe_0 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4175695719719186998', time=2024-04-03T06:00:58.561776+0000, chain.objs.size()=1 2024-04-03T04:03:06.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.505+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.27KI5My9U10ytwntQ9QrKRWTfVh9sJX_0 2024-04-03T04:03:06.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.509+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17852529212258005239', time=2024-04-03T06:01:03.632824+0000, chain.objs.size()=1 2024-04-03T04:03:06.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.509+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.QT0KoDAdiToGAQx9BHAK86KmUjv9gNW_0 2024-04-03T04:03:06.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.509+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17838189628024797666', time=2024-04-03T06:01:46.274172+0000, chain.objs.size()=1 2024-04-03T04:03:06.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.509+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.nyxgzU2GhhRy7dCnIZ2MVrE4zw_66uX_0 2024-04-03T04:03:06.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.509+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12673183088169402546', time=2024-04-03T06:01:46.472080+0000, chain.objs.size()=1 2024-04-03T04:03:06.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.509+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.BAz8hh4SUK7pQGjuVG6oIMAfdnHG-u__0 2024-04-03T04:03:06.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.513+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.517+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:03:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.521+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.521+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7035081513436489375', time=2024-04-03T05:57:43.749823+0000, chain.objs.size()=4 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11__multipart_foo.2~NSDY6iNxjM9mMaRuBJhYB_IBzfa8jTl.1 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11__multipart_foo.2~NSDY6iNxjM9mMaRuBJhYB_IBzfa8jTl.2 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11__multipart_foo.2~NSDY6iNxjM9mMaRuBJhYB_IBzfa8jTl.3 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11__multipart_foo.2~NSDY6iNxjM9mMaRuBJhYB_IBzfa8jTl.4 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_eTEERapJK7J-eLLnl_zvGstv5N5kz2f', time=2024-04-03T05:57:44.037960+0000, chain.objs.size()=2 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.K8CKKS8KHS7SmGnkxbPCFx_GuV2M75O_0 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.K8CKKS8KHS7SmGnkxbPCFx_GuV2M75O_1 2024-04-03T04:03:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15039387427008388905', time=2024-04-03T05:59:41.689797+0000, chain.objs.size()=1 2024-04-03T04:03:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.usAJ8R6QQ3o7MbHUt8C0tw7pTucsZDM_0 2024-04-03T04:03:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4601723686515349997', time=2024-04-03T06:01:46.233610+0000, chain.objs.size()=1 2024-04-03T04:03:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.f8fMwj_ykOP5IW9bNgBZhSLdHqaQnsg_0 2024-04-03T04:03:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1191531920453201996', time=2024-04-03T06:02:21.783704+0000, chain.objs.size()=1 2024-04-03T04:03:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.N1pJOrbE6rBVjEVfEZ_TMhlP9ZFWj2q_0 2024-04-03T04:03:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11745022120096070051', time=2024-04-03T06:02:22.015257+0000, chain.objs.size()=1 2024-04-03T04:03:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.qbs-Uyzyureu84gMrVaHpnDVy85fg0l_0 2024-04-03T04:03:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7294226322364631778', time=2024-04-03T06:02:39.694845+0000, chain.objs.size()=1 2024-04-03T04:03:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.525+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18__shadow:YCg7f2ocBK6Sco5b-cnthEAQVkOU1-x_.LugKJcEVKFmaPrTzILihEXtjN_eKOuU_0 2024-04-03T04:03:06.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.537+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.541+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:03:06.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.541+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T04:03:06.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1178698595185313106', time=2024-04-03T05:59:37.616876+0000, chain.objs.size()=1 2024-04-03T04:03:06.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.WzLej3IpjU9sEyp1aqZ3vBbxR06roSX_0 2024-04-03T04:03:06.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18432733812966081394', time=2024-04-03T06:00:22.022531+0000, chain.objs.size()=1 2024-04-03T04:03:06.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.jjj1Ll3ACa9C-JnGsETpyEe2Whuqij-_0 2024-04-03T04:03:06.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17609983531704856485', time=2024-04-03T06:01:03.592883+0000, chain.objs.size()=1 2024-04-03T04:03:06.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.FDnseP3dkmg_gGAJ0iUHsn_ECIRJVXg_0 2024-04-03T04:03:06.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7821422530845219736', time=2024-04-03T06:01:41.791056+0000, chain.objs.size()=1 2024-04-03T04:03:06.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.yQYZd3g1hr5LSMz-tcPfohtKXFVkhfO_0 2024-04-03T04:03:06.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6871334255990149613', time=2024-04-03T06:02:24.024175+0000, chain.objs.size()=1 2024-04-03T04:03:06.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17__shadow_.TpVdLrlBuT6MvfnFzu-9j4DQk7tOa5B_0 2024-04-03T04:03:06.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1248222951685252074', time=2024-04-03T06:02:24.069361+0000, chain.objs.size()=1 2024-04-03T04:03:06.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17__shadow_.tF5nZz2DAL0m9gidgfwfWz9AI_xU3AB_0 2024-04-03T04:03:06.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12916751621040881971', time=2024-04-03T06:02:39.691196+0000, chain.objs.size()=1 2024-04-03T04:03:06.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.545+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18__shadow:X1f4Gd2m2f53LAtYViNpM3BEq91h1X6_.l7xdUP3XBQlKBoejL64PrYR-oRBWg3x_0 2024-04-03T04:03:06.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.553+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.557+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:03:06.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.557+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-04-03T04:03:06.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5914675007708559068', time=2024-04-03T05:57:44.048516+0000, chain.objs.size()=1 2024-04-03T04:03:06.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.xCDSMbLvTNmwDeSkKd1GyIq-caRqUsE_0 2024-04-03T04:03:06.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14530197417117173309', time=2024-04-03T05:57:44.462333+0000, chain.objs.size()=1 2024-04-03T04:03:06.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.FzxByaZWCo9JCcbnbXCabMWQ791wHa-_0 2024-04-03T04:03:06.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16170361956413707533', time=2024-04-03T06:00:58.588367+0000, chain.objs.size()=1 2024-04-03T04:03:06.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.G0Qgag1m4Y7h0Cblst8OMCAColjfG6K_0 2024-04-03T04:03:06.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14716121486537915663', time=2024-04-03T06:01:41.801337+0000, chain.objs.size()=1 2024-04-03T04:03:06.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.561+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.TLYJKf0a2ZEWdhVj5NcRJRNt27dKiHd_0 2024-04-03T04:03:06.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.565+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.569+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:03:06.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.569+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_MZkcysoYj3835IrkgXkhTvjh1oqK8Oe', time=2024-04-03T05:57:44.289982+0000, chain.objs.size()=1 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.rKjvHE-FpAPMFY0lAZhC812uvxmxIo5_0 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3598067952049809957', time=2024-04-03T05:57:44.727397+0000, chain.objs.size()=1 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8__shadow_.BodMfJyoBbIpCOm1-2pZUDtI5i4HWn6_0 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9018919202526996654', time=2024-04-03T06:00:16.833027+0000, chain.objs.size()=1 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.Q75EDRqcfrP7nAXqATQvxt_G2rju1b6_0 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5489484044246506408', time=2024-04-03T06:01:03.632945+0000, chain.objs.size()=1 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.-WF8f6ymDWZGCKyfRxLsjFDXTxixKrN_0 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.136207950007954251', time=2024-04-03T06:01:03.690344+0000, chain.objs.size()=1 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.sgWWZbnVL2lLpmkpEGRb-fYph9yLaV7_0 2024-04-03T04:03:06.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3303407187917677358', time=2024-04-03T06:01:07.108246+0000, chain.objs.size()=1 2024-04-03T04:03:06.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.AX5E8i52BADnjVA9k3fb5S-1t5u8N8E_0 2024-04-03T04:03:06.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8091226018034873402', time=2024-04-03T06:01:07.179659+0000, chain.objs.size()=1 2024-04-03T04:03:06.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.573+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.2NffgWqMz1tqm--Fg1TBBL5sg8QFd0b_0 2024-04-03T04:03:06.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.577+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.581+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:03:06.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9767927350498353998', time=2024-04-03T05:57:43.931016+0000, chain.objs.size()=4 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9__multipart_foo.2~781vtT8wSOROcdsUMDSYc-ifwkj8f-o.1 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9__multipart_foo.2~781vtT8wSOROcdsUMDSYc-ifwkj8f-o.2 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9__multipart_foo.2~781vtT8wSOROcdsUMDSYc-ifwkj8f-o.3 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9__multipart_foo.2~781vtT8wSOROcdsUMDSYc-ifwkj8f-o.4 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11839593790148591634', time=2024-04-03T05:57:44.752724+0000, chain.objs.size()=1 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8__shadow_.RAbJg2bvmjIJal7DKf0yM5diBj_lNTL_0 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15583447170562245231', time=2024-04-03T05:59:41.689857+0000, chain.objs.size()=1 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.r8vP9z-_DWu0PM4kTpAxEbVkpe1NsNV_0 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14709705414466604196', time=2024-04-03T06:00:21.986437+0000, chain.objs.size()=1 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.FKTV4_BYab8WXHeNWIIDYhFZxK6n_HH_0 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5218196846846273753', time=2024-04-03T06:00:58.678498+0000, chain.objs.size()=1 2024-04-03T04:03:06.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.AyaFZzQRYaw3fJcseOmxMy9Y51UGB0G_0 2024-04-03T04:03:06.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14977067416981092720', time=2024-04-03T06:01:03.510362+0000, chain.objs.size()=1 2024-04-03T04:03:06.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.jwNM3YFtlpFkDXswBjBz_ACeduMCoAa_0 2024-04-03T04:03:06.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6878516796743192634', time=2024-04-03T06:01:03.584496+0000, chain.objs.size()=1 2024-04-03T04:03:06.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.T6lG3xM4oewPARy3LVZ7Lwyh9Qfd9Ow_0 2024-04-03T04:03:06.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8989123544279998678', time=2024-04-03T06:01:03.693234+0000, chain.objs.size()=1 2024-04-03T04:03:06.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.oucf4LnOro6qdCwYKrUxEDG3A_2CvcZ_0 2024-04-03T04:03:06.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2362727806190401152', time=2024-04-03T06:02:22.048421+0000, chain.objs.size()=1 2024-04-03T04:03:06.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.585+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.kwKmD7FwUWeZ27nPrKyS-pOJSXeD0lu_0 2024-04-03T04:03:06.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.593+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.597+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:03:06.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-04-03T04:03:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8243957558089370221', time=2024-04-03T05:59:37.525331+0000, chain.objs.size()=1 2024-04-03T04:03:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.8EoTnjnmHhj6oaGdZiSz2kAsn0B4e9M_0 2024-04-03T04:03:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2667458777624911236', time=2024-04-03T05:59:41.750779+0000, chain.objs.size()=1 2024-04-03T04:03:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.TWI2XkZiCGorqjmL1fhdqcMTAiCOKsD_0 2024-04-03T04:03:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4585680311930139089', time=2024-04-03T06:00:58.601105+0000, chain.objs.size()=1 2024-04-03T04:03:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.X_8zFwzajeM0T8QGQMtmY0h4syD4MEA_0 2024-04-03T04:03:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17327083747079325008', time=2024-04-03T06:01:41.696786+0000, chain.objs.size()=1 2024-04-03T04:03:06.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.jJQc5w8Pu6sevu-QowBzKUvWYWZvfbW_0 2024-04-03T04:03:06.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6308836962610880021', time=2024-04-03T06:01:41.748959+0000, chain.objs.size()=1 2024-04-03T04:03:06.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.yVRvpXKbXu3NmQ6ZD1X1qRkG8YtL-A2_0 2024-04-03T04:03:06.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16871057838230960086', time=2024-04-03T06:01:41.809745+0000, chain.objs.size()=1 2024-04-03T04:03:06.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.601+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.NVnCSYDCv-8SgwMLYjBhOztMuiaksDl_0 2024-04-03T04:03:06.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.605+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.613+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:03:06.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.613+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-04-03T04:03:06.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7865710561540188488', time=2024-04-03T05:57:44.375654+0000, chain.objs.size()=3 2024-04-03T04:03:06.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-STANDARD.2~k2DyYY6X866zLnc6eIZHK5cl_RLoNfL.1 2024-04-03T04:03:06.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-STANDARD.2~k2DyYY6X866zLnc6eIZHK5cl_RLoNfL.2 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-STANDARD.2~k2DyYY6X866zLnc6eIZHK5cl_RLoNfL.3 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3423588646988965381', time=2024-04-03T05:59:41.747327+0000, chain.objs.size()=1 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.arTYiPXbQ5b9_QWfe-can2K0UvjKy7s_0 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3071240308334484930', time=2024-04-03T06:00:16.844013+0000, chain.objs.size()=1 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.wmT22ViCMReyRG1o4gvzyBW_WxNTVsK_0 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12579358829879592595', time=2024-04-03T06:01:03.533523+0000, chain.objs.size()=1 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.QEkTuitv54ZA5txmprcggXmE0muBnUJ_0 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4784222984490976223', time=2024-04-03T06:01:06.923685+0000, chain.objs.size()=1 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.TSN5oISngXbr7Z9ethwqgD9PR-RIrny_0 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6066326127400081645', time=2024-04-03T06:01:07.089492+0000, chain.objs.size()=1 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.LH4G9Gxs_nXpuRroPViDaV4ic0wKOGt_0 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5689183946819003428', time=2024-04-03T06:01:41.897853+0000, chain.objs.size()=1 2024-04-03T04:03:06.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.XT-jMVvAfmif1XXEtWzT42MYOWTKEWg_0 2024-04-03T04:03:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7480114796965365657', time=2024-04-03T06:02:21.802425+0000, chain.objs.size()=1 2024-04-03T04:03:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.mjPLGuCG9WXgnDRNtnEJozm9X9qgGoj_0 2024-04-03T04:03:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14328870911801438327', time=2024-04-03T06:02:22.013700+0000, chain.objs.size()=1 2024-04-03T04:03:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.617+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.Q-DPp489vU1YGhTZmA8hkSWkvnu925l_0 2024-04-03T04:03:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.625+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.629+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:03:06.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-04-03T04:03:06.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16209451607924295726', time=2024-04-03T05:57:44.235175+0000, chain.objs.size()=3 2024-04-03T04:03:06.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.1 2024-04-03T04:03:06.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.2 2024-04-03T04:03:06.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.3 2024-04-03T04:03:06.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5901497429528035660', time=2024-04-03T05:59:37.571397+0000, chain.objs.size()=1 2024-04-03T04:03:06.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.xVN2oKjGCHLajEFqI6_KobJNk_WrPIU_0 2024-04-03T04:03:06.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.264369574450588973', time=2024-04-03T05:59:41.698291+0000, chain.objs.size()=1 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.yqF2rz0tsrv6LnZEZGdORGnfy1nD5cV_0 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1642487003054092747', time=2024-04-03T05:59:41.816849+0000, chain.objs.size()=1 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.hOq3YT6zvM-sQM71SXyZj5glFOpJEsH_0 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9445594825394845336', time=2024-04-03T06:00:20.873490+0000, chain.objs.size()=1 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.h8ZsKz8IqedTPBFBCq9d0CMstfxJjX2_0 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12096268382993008208', time=2024-04-03T06:01:41.734599+0000, chain.objs.size()=1 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.3y2_8T34iIsYNy1vk1wvM_-ujq5OEZE_0 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4815889036175154886', time=2024-04-03T06:01:46.198082+0000, chain.objs.size()=1 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.z8TWYePVQfEfRiHbJGPPsPaNsIoSGZW_0 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1791446576675184697', time=2024-04-03T06:02:20.416233+0000, chain.objs.size()=1 2024-04-03T04:03:06.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.633+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.W-R7MIjbt2a2Cr_I7f9L_jzjiZmWHdT_0 2024-04-03T04:03:06.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.641+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.645+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:03:06.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.645+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.645+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-04-03T04:03:06.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12801209278348468370', time=2024-04-03T05:57:43.663743+0000, chain.objs.size()=1 2024-04-03T04:03:06.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.GIwEtGv0VokuzOaXNkMcF26tBd8PbTB_0 2024-04-03T04:03:06.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10817620256925432579', time=2024-04-03T05:57:43.797764+0000, chain.objs.size()=4 2024-04-03T04:03:06.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12__multipart_foo.2~z8MvErCeI41qt4uu-VGRcRqxsUs2LK6.1 2024-04-03T04:03:06.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12__multipart_foo.2~z8MvErCeI41qt4uu-VGRcRqxsUs2LK6.2 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12__multipart_foo.2~z8MvErCeI41qt4uu-VGRcRqxsUs2LK6.3 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12__multipart_foo.2~z8MvErCeI41qt4uu-VGRcRqxsUs2LK6.4 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.931163491536878405', time=2024-04-03T05:57:44.740726+0000, chain.objs.size()=1 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8__shadow_.hltaCS2lqk0LmzeRlyDjETOT4I_AqoH_0 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2909623933982757496', time=2024-04-03T05:59:37.525440+0000, chain.objs.size()=1 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.fNuYO8_f2XpVepnn_I6FZUVWUoN708u_0 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9825025612241323272', time=2024-04-03T05:59:41.753868+0000, chain.objs.size()=1 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.90n4JqYeGmHajmzNMNHR3gp8XylBCAq_0 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17790851010658644411', time=2024-04-03T06:00:16.995400+0000, chain.objs.size()=1 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.Q3jortiYVXOh0ga6cBPXkYzQnWwPTdx_0 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16540552658700500523', time=2024-04-03T06:00:22.211282+0000, chain.objs.size()=1 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.8rnm2ceGMs90WSl-Vac_AO4LfTPP3_e_0 2024-04-03T04:03:06.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3773748588191667646', time=2024-04-03T06:00:58.601254+0000, chain.objs.size()=1 2024-04-03T04:03:06.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.9KDGFKwA7ia5SYSnxV50eWWSYeKM8km_0 2024-04-03T04:03:06.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10154426469728783509', time=2024-04-03T06:01:07.032148+0000, chain.objs.size()=1 2024-04-03T04:03:06.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.649+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.Yvv-zNBgOPpkf0cr3xxM_BTa_uCsYYB_0 2024-04-03T04:03:06.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.653+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7088220718506588420', time=2024-04-03T06:01:07.195674+0000, chain.objs.size()=1 2024-04-03T04:03:06.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.653+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.md2om1blft8aLG87WsbY2L8vxK19CuP_0 2024-04-03T04:03:06.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.653+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5981017928187194984', time=2024-04-03T06:01:41.745787+0000, chain.objs.size()=1 2024-04-03T04:03:06.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.653+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.2ebC-Vn3tWAJu58djuw1S46_cLPNIfb_0 2024-04-03T04:03:06.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.653+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14975089010713644298', time=2024-04-03T06:01:46.308940+0000, chain.objs.size()=1 2024-04-03T04:03:06.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.653+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.UH9UQENUQgd_tFGWCweaJDlb2186QmQ_0 2024-04-03T04:03:06.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.653+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15564038497409446770', time=2024-04-03T06:02:21.915342+0000, chain.objs.size()=1 2024-04-03T04:03:06.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.653+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.yNzLGyK0iocT84WEBR0QyUAuegloZ1t_0 2024-04-03T04:03:06.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.657+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.661+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:03:06.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T04:03:06.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15114030286413342291', time=2024-04-03T05:57:43.672220+0000, chain.objs.size()=1 2024-04-03T04:03:06.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.oJzbLwNiKVe0sWrYo__zKKZFzrbkK64_0 2024-04-03T04:03:06.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7020526588595340421', time=2024-04-03T05:57:43.679348+0000, chain.objs.size()=1 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.-n9Xk2S-fHXFZEIlz06BeAdLF_iqz3o_0 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_GG5-kf7qTUWs7EnQQxHOzaEIG-a0-LU', time=2024-04-03T05:57:44.218595+0000, chain.objs.size()=3 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.kxKqp89WoS3DR3NLRuMmHgKPCDFqbQ7_0 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.kxKqp89WoS3DR3NLRuMmHgKPCDFqbQ7_1 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.kxKqp89WoS3DR3NLRuMmHgKPCDFqbQ7_2 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16260139883612237335', time=2024-04-03T05:57:44.615459+0000, chain.objs.size()=1 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7__shadow_.DuRl3DIIGsWR1EieurhIYs1rFKBTBul_0 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6622861645986387367', time=2024-04-03T05:57:44.650839+0000, chain.objs.size()=1 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7__shadow_.k3MZi7uD9C9wsxGMF41opP2V5WSLhXV_0 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17678434219583228637', time=2024-04-03T06:00:22.078309+0000, chain.objs.size()=1 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.6K9p0OujHODsl9h-UYSDwopuFdAwFuH_0 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10580050345659689598', time=2024-04-03T06:01:46.348667+0000, chain.objs.size()=1 2024-04-03T04:03:06.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.665+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.ZOkgy0J5jV8dOq-u_1aZA__g5toQcWK_0 2024-04-03T04:03:06.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.673+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:03:06.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-04-03T04:03:06.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_sebyoyr_bkSzp8HhufPvltG2GLFYzvo', time=2024-04-03T05:57:44.102291+0000, chain.objs.size()=1 2024-04-03T04:03:06.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.sjXRfrLT07_i84BsJnN70ag2oRQ8pwm_0 2024-04-03T04:03:06.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13777591731289222374', time=2024-04-03T06:00:16.804410+0000, chain.objs.size()=1 2024-04-03T04:03:06.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.j7GFqU-E3nTQ9A8D5VYJW3njhabKw96_0 2024-04-03T04:03:06.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13509752232048975688', time=2024-04-03T06:00:22.055478+0000, chain.objs.size()=1 2024-04-03T04:03:06.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.J42md96qJu7bE_E9aTlFvjjh9btW6_H_0 2024-04-03T04:03:06.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16502657522104454009', time=2024-04-03T06:00:26.449937+0000, chain.objs.size()=1 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.khDhangEbpRtCQaRIyMoqG3HmXvHnW7_0 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3678544539385716635', time=2024-04-03T06:01:03.750868+0000, chain.objs.size()=1 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.XhhMeIlDd3dfLqxhw77VfioZYI59VRA_0 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7994932707606599954', time=2024-04-03T06:01:07.030664+0000, chain.objs.size()=1 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.WIOCjAQj9crvKEKRIy8TU0g6mxOv_XM_0 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6239728944171298228', time=2024-04-03T06:01:07.108148+0000, chain.objs.size()=1 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.ntuXmtTbEQ3kqaVOF3jY4M6MkI67k4Z_0 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12120329598697513247', time=2024-04-03T06:01:41.661835+0000, chain.objs.size()=1 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.5Yyf-1Ie372k-p7LVP6t-mB6elqT-qT_0 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7612680210392217349', time=2024-04-03T06:01:46.313000+0000, chain.objs.size()=1 2024-04-03T04:03:06.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.677+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.TxsCNljOth4M4zAlsdpm5pXyIbU0GCi_0 2024-04-03T04:03:06.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.685+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:03:06.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T04:03:06.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9160627060110453547', time=2024-04-03T05:59:41.778896+0000, chain.objs.size()=1 2024-04-03T04:03:06.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.S2_tYWwM4gXI9MWzDrkMiq_gApzeNGU_0 2024-04-03T04:03:06.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9673210178700139853', time=2024-04-03T05:59:41.929750+0000, chain.objs.size()=1 2024-04-03T04:03:06.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.H8qcI-cOM9BPJpvl2yXE1ZrDYFg0TTc_0 2024-04-03T04:03:06.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4225946588219827049', time=2024-04-03T06:00:16.871977+0000, chain.objs.size()=1 2024-04-03T04:03:06.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.Dc1lG3I6XPgW0ZZn9hCzOLqUXzY8egf_0 2024-04-03T04:03:06.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6781106470396708565', time=2024-04-03T06:00:16.873959+0000, chain.objs.size()=1 2024-04-03T04:03:06.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.OQ44k6DQnz436YVMZYgumg0_ZmBW2rv_0 2024-04-03T04:03:06.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3073267696939782635', time=2024-04-03T06:00:22.122891+0000, chain.objs.size()=1 2024-04-03T04:03:06.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.T4Iwrq1ddoFREMLDdJaqMtYlgSEUzme_0 2024-04-03T04:03:06.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8068298388362057526', time=2024-04-03T06:00:58.725473+0000, chain.objs.size()=1 2024-04-03T04:03:06.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.AGCkqpIM-63dgb1IuLqs2TWwIect5XJ_0 2024-04-03T04:03:06.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3546958313150467959', time=2024-04-03T06:02:21.954939+0000, chain.objs.size()=1 2024-04-03T04:03:06.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.689+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.GKOqa86Jig4ObXvvV3vw2sMYz6nyR7t_0 2024-04-03T04:03:06.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.697+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:03:06.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-04-03T04:03:06.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_9_nE5kidgdiCpU00dPXwEeniWH0u0xx', time=2024-04-03T05:57:44.002440+0000, chain.objs.size()=2 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.qwgZdWZR-0HveL2mVt9YVQDbfuC0cCv_0 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.qwgZdWZR-0HveL2mVt9YVQDbfuC0cCv_1 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.xCDSMbLvTNmwDeSkKd1GyIq-caRqUsE_1_9fd476d092270f4ed19124bd0132afe9', time=2024-04-03T05:57:44.082989+0000, chain.objs.size()=1 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.xCDSMbLvTNmwDeSkKd1GyIq-caRqUsE_0 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4966262017284479158', time=2024-04-03T06:00:22.054046+0000, chain.objs.size()=1 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.7oqRcWKCMBvW6kMuDFTDc3w19_UjWRH_0 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16288718372962414935', time=2024-04-03T06:01:03.534868+0000, chain.objs.size()=1 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.PxYX2XbJ7ZEAMBfji1mDL1fJhGfhMv7_0 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9962540777987592642', time=2024-04-03T06:01:03.767210+0000, chain.objs.size()=1 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.ifh0F6QuuaYIJej9Ta48vBsKH-hy0dt_0 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13163953043921412273', time=2024-04-03T06:01:41.899201+0000, chain.objs.size()=1 2024-04-03T04:03:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.LOAkUig2HRUyczyGmMUuYmr_Am-Gtrc_0 2024-04-03T04:03:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10920685508167619095', time=2024-04-03T06:01:46.308901+0000, chain.objs.size()=1 2024-04-03T04:03:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.yaBxRxuIuQJph4Sm9NEoBWsW3GbBSan_0 2024-04-03T04:03:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.796891601234956675', time=2024-04-03T06:02:21.915441+0000, chain.objs.size()=1 2024-04-03T04:03:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.iEorktMqJosUmxXBc4G86KLNLbiAuXN_0 2024-04-03T04:03:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17360347274958063982', time=2024-04-03T06:02:22.048328+0000, chain.objs.size()=1 2024-04-03T04:03:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.bH3OlLLPVDKkXg4YXpnT5XofjvVUMDZ_0 2024-04-03T04:03:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5339407347332197993', time=2024-04-03T06:02:24.051328+0000, chain.objs.size()=1 2024-04-03T04:03:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.701+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17__shadow_.O0NcGaxQxCV5NgVyg9iS7ZMd_KsT9qC_0 2024-04-03T04:03:06.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.709+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.713+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:03:06.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.713+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-04-03T04:03:06.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5797104295003157547', time=2024-04-03T05:59:37.529501+0000, chain.objs.size()=1 2024-04-03T04:03:06.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.eQV_hgIvHp74GM0AYn0Dmwd4p5-7L85_0 2024-04-03T04:03:06.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.233015595384773429', time=2024-04-03T06:00:16.865003+0000, chain.objs.size()=1 2024-04-03T04:03:06.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.wAJUNwDl_GsgbxaLmHWNuprw3nn-1LX_0 2024-04-03T04:03:06.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2922094516359111538', time=2024-04-03T06:00:22.078528+0000, chain.objs.size()=1 2024-04-03T04:03:06.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.Dz-MtExZnR1ohl8Ni27mGmfMvMkVvGz_0 2024-04-03T04:03:06.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6522961917787130367', time=2024-04-03T06:00:58.623294+0000, chain.objs.size()=1 2024-04-03T04:03:06.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.717+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.jqnixf0-JKD21OMd_TCXJV0hmfe5xHD_0 2024-04-03T04:03:06.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.721+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:03:06.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8180822803570175848', time=2024-04-03T05:57:43.642594+0000, chain.objs.size()=1 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.tFEAv59uxYCTibhsK69uv2Eg2hQy4eI_0 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6942760159716307327', time=2024-04-03T05:57:43.861880+0000, chain.objs.size()=4 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10__multipart_foo.2~PZjGmnlImUHlTomir_qccYeou5XLQHP.1 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10__multipart_foo.2~PZjGmnlImUHlTomir_qccYeou5XLQHP.2 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10__multipart_foo.2~PZjGmnlImUHlTomir_qccYeou5XLQHP.3 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10__multipart_foo.2~PZjGmnlImUHlTomir_qccYeou5XLQHP.4 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_NOHDn15mSSbzDGkMwD0AmduFck3nGt3', time=2024-04-03T05:57:44.209361+0000, chain.objs.size()=3 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.gVHAd9HxzhzLyL4zYoBQ6MUHbaqGrmw_0 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.gVHAd9HxzhzLyL4zYoBQ6MUHbaqGrmw_1 2024-04-03T04:03:06.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.gVHAd9HxzhzLyL4zYoBQ6MUHbaqGrmw_2 2024-04-03T04:03:06.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15035041160971305993', time=2024-04-03T05:59:37.539845+0000, chain.objs.size()=1 2024-04-03T04:03:06.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.qxh2NzlapdsS2MFc2-_qD44SdoIjAcq_0 2024-04-03T04:03:06.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.303883576345707678', time=2024-04-03T05:59:37.541727+0000, chain.objs.size()=1 2024-04-03T04:03:06.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.NC3Kzx4hUlcB4OwoTHSZB-nfmxz4hXO_0 2024-04-03T04:03:06.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9284541585791940798', time=2024-04-03T06:00:16.877665+0000, chain.objs.size()=1 2024-04-03T04:03:06.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.JETNEROKNzYSGYyw6l5cRp4bGPLcyMc_0 2024-04-03T04:03:06.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2459416368372100574', time=2024-04-03T06:01:07.198672+0000, chain.objs.size()=1 2024-04-03T04:03:06.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.725+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.lB-6O1q_bKsl4Nlv0MrMJZ9lSPSy-Cg_0 2024-04-03T04:03:06.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.733+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1557441127464058201', time=2024-04-03T06:01:41.807186+0000, chain.objs.size()=1 2024-04-03T04:03:06.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.733+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.xxsXf6BfxMzqIbPZH3drhyEDc4ArJO8_0 2024-04-03T04:03:06.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.733+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13646732133307301196', time=2024-04-03T06:01:41.808790+0000, chain.objs.size()=1 2024-04-03T04:03:06.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.733+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.JN8_Bf1QkTVQnRac3nrGTsVWEPAB8BE_0 2024-04-03T04:03:06.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.733+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.398527088878383923', time=2024-04-03T06:01:45.295899+0000, chain.objs.size()=1 2024-04-03T04:03:06.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.733+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.ySggSgGxS3IU8E_w9DJfSVdQHyz0ISw_0 2024-04-03T04:03:06.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.733+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1244744245766225238', time=2024-04-03T06:01:46.311857+0000, chain.objs.size()=1 2024-04-03T04:03:06.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.733+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.4dzov68spFbVvt7q8jumUvT3EBaadfs_0 2024-04-03T04:03:06.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.737+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:03:06.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7464122805623493680', time=2024-04-03T05:59:37.461779+0000, chain.objs.size()=1 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.HUfQkm14RTedb7j33zHDzO5DinrcCx3_0 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8187631312021802600', time=2024-04-03T05:59:41.705312+0000, chain.objs.size()=1 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.S9AEGG64kDPxcfRhtRWNUdNZcDAxdKX_0 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13907191863205400889', time=2024-04-03T05:59:41.805916+0000, chain.objs.size()=1 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.TQ58JtyCTuMtSWZIHR6L7TC__hIqHf6_0 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12591490324081884778', time=2024-04-03T06:00:17.039207+0000, chain.objs.size()=1 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.iNLzzoLs2pOaL52B5_gjTA1k0D_ugQP_0 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4619139958140281448', time=2024-04-03T06:01:41.736341+0000, chain.objs.size()=1 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.cIck6-pTD6HdjyobfagOiiluIle9ZmQ_0 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1628504707061269402', time=2024-04-03T06:01:41.797337+0000, chain.objs.size()=1 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_._mjn3GCWMhhmuZLrgIzA2JOcOMMXVgO_0 2024-04-03T04:03:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13203932014024629532', time=2024-04-03T06:01:46.311295+0000, chain.objs.size()=1 2024-04-03T04:03:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.741+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.q2nNJBpi3Kmpq258RjJYvd3-cSzvDc8_0 2024-04-03T04:03:06.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.745+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.749+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:03:06.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-04-03T04:03:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_N9X3hxf7oYIJBL6Vewt8_I1y5IPTZAX', time=2024-04-03T05:57:44.247850+0000, chain.objs.size()=3 2024-04-03T04:03:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.q62EKyhn4h23id5J3lyp5t65qHkeMjE_0 2024-04-03T04:03:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.q62EKyhn4h23id5J3lyp5t65qHkeMjE_1 2024-04-03T04:03:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_.q62EKyhn4h23id5J3lyp5t65qHkeMjE_2 2024-04-03T04:03:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16500532093660992301', time=2024-04-03T05:57:44.640815+0000, chain.objs.size()=1 2024-04-03T04:03:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7__shadow_.QqVgHuLwK-V1rdcoVBuV8HuHlsDZ9dV_0 2024-04-03T04:03:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5951238019708502504', time=2024-04-03T05:57:44.717026+0000, chain.objs.size()=1 2024-04-03T04:03:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8__shadow_.TNezj2AtlJEn22XOWWem8SFtUfDqDKB_0 2024-04-03T04:03:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5528358091006580695', time=2024-04-03T05:59:37.691958+0000, chain.objs.size()=1 2024-04-03T04:03:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.r0TYkDZ-6JmjpiEbK-qGzBi8StWytwF_0 2024-04-03T04:03:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3058538605516877669', time=2024-04-03T05:59:41.781662+0000, chain.objs.size()=1 2024-04-03T04:03:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.S35Tu79SbM94jTfe8-CCtxyjBUwo2DJ_0 2024-04-03T04:03:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13051274665815799763', time=2024-04-03T05:59:41.783748+0000, chain.objs.size()=1 2024-04-03T04:03:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.0psMPNzv9M67Yhye13F8qVBvpZVVLAO_0 2024-04-03T04:03:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16033478800050806481', time=2024-04-03T06:01:06.944702+0000, chain.objs.size()=1 2024-04-03T04:03:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.EnfmL17nNQAQsUepjvWz_gpsCOX2r_F_0 2024-04-03T04:03:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14764551296129315408', time=2024-04-03T06:01:07.029073+0000, chain.objs.size()=1 2024-04-03T04:03:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.Ep6gtDFFzZXnbkMoebbYTQmP1CQNVAG_0 2024-04-03T04:03:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13487797538193944145', time=2024-04-03T06:01:46.224079+0000, chain.objs.size()=1 2024-04-03T04:03:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.OKocGNPQBqblPT73_bUXbGd8zG7mqFI_0 2024-04-03T04:03:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7564681155031732574', time=2024-04-03T06:02:21.956533+0000, chain.objs.size()=1 2024-04-03T04:03:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.753+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.mJSrPoubRvPjcgJZdFNHZZB5Dho1Vlh_0 2024-04-03T04:03:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.757+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6858304604083330204', time=2024-04-03T06:02:21.959844+0000, chain.objs.size()=1 2024-04-03T04:03:06.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.757+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.28__shadow_.ahTLIQORuXif5M8TOhZhpmcKBQp95G9_0 2024-04-03T04:03:06.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.761+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11524223171601584773', time=2024-04-03T06:02:24.023113+0000, chain.objs.size()=1 2024-04-03T04:03:06.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.761+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17__shadow_.IkIqS5NWeN2lhoj0I5OM0OP4BnMtnBP_0 2024-04-03T04:03:06.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.761+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.765+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:03:06.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9964214447498242199', time=2024-04-03T05:59:37.674567+0000, chain.objs.size()=1 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.9T7iNes7R9A4iaUVVVBBkdhk3GOyjaG_0 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13702314163092848055', time=2024-04-03T05:59:41.713027+0000, chain.objs.size()=1 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.F5OySBnxegoNmUNxfqqVOGGG_bSeulk_0 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1825368051447763323', time=2024-04-03T05:59:41.781720+0000, chain.objs.size()=1 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.nwjwWiccARDJ4zrdZhT7-mL8Y4H1UjC_0 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18048804004080297750', time=2024-04-03T06:00:22.122784+0000, chain.objs.size()=1 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.SWi2Tc5K2DuwBiYRkQuTgOV8Wl41TuL_0 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6841395232760393004', time=2024-04-03T06:01:03.559028+0000, chain.objs.size()=1 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.jSCFY7pYAvJC1moxTkUuTvUk0YHZp_U_0 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13737970403763964088', time=2024-04-03T06:01:03.636571+0000, chain.objs.size()=1 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.TXymLI1bFeRFq2K9bLpu7fBabS0Gn5m_0 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6078033133777814324', time=2024-04-03T06:01:07.167533+0000, chain.objs.size()=1 2024-04-03T04:03:06.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.Ip9BmlqRDWZ_9wrFC4WjuUaqc8U-UrY_0 2024-04-03T04:03:06.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15815821271054149441', time=2024-04-03T06:01:41.662755+0000, chain.objs.size()=1 2024-04-03T04:03:06.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.3b675tMwJk9bUekHe5kbueFgaemKlBx_0 2024-04-03T04:03:06.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7802162761078831389', time=2024-04-03T06:01:46.284855+0000, chain.objs.size()=1 2024-04-03T04:03:06.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.FyOSIhOVB1FNuFUitLucUDsHeBAFurE_0 2024-04-03T04:03:06.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7594097755826254261', time=2024-04-03T06:01:46.315502+0000, chain.objs.size()=1 2024-04-03T04:03:06.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.769+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.Xnzlc_3Uk3fD7wJdAOrEYec9MkVh-lr_0 2024-04-03T04:03:06.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.773+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.777+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:03:06.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.781+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.781+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.781+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:03:06.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.781+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13468214941126940861', time=2024-04-03T06:00:58.492122+0000, chain.objs.size()=1 2024-04-03T04:03:06.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.781+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.f3t6EUc4JXkAad3TjhbYWtAT-AF_yYC_0 2024-04-03T04:03:06.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.781+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.785+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:03:06.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4807064518723147682', time=2024-04-03T05:57:43.623265+0000, chain.objs.size()=1 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.ibZ4JmVdTzq9swXTv1uIKIgJcKpolQK_0 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13341621077915098289', time=2024-04-03T05:57:44.014176+0000, chain.objs.size()=2 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_0 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.VnhFO4BgZFMk16ax--uPOJUjEZaCc5h_1 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6611674781398408524', time=2024-04-03T05:59:41.780788+0000, chain.objs.size()=1 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.SBmlLHO2sZkkrVaFdmywMbF3i-jlall_0 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17781193591598392098', time=2024-04-03T06:00:17.040121+0000, chain.objs.size()=1 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.mmxqj8OeMXqvfl_uHLqDieORvqpmY6s_0 2024-04-03T04:03:06.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3890467816967404249', time=2024-04-03T06:00:22.211495+0000, chain.objs.size()=1 2024-04-03T04:03:06.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.789+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.RPByEaCvs7p47wZesFglsUdYasQ5VLH_0 2024-04-03T04:03:06.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:06.997+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:06.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.005+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:03:06.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.005+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:06.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13938245759147916025', time=2024-04-03T05:59:37.572872+0000, chain.objs.size()=1 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.9pRiWBq1tKRBIgajk1RT-DbpBDPqAN4_0 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3610525449705903870', time=2024-04-03T05:59:37.650170+0000, chain.objs.size()=1 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.Lk0rK7yUO5U_uyinkU7IF8JKmidB12b_0 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10478181372429916674', time=2024-04-03T05:59:45.184827+0000, chain.objs.size()=1 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.RwAqn3_OSBDhzGbyU5FXXoata04SY6-_0 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13690789745793648054', time=2024-04-03T06:00:22.131609+0000, chain.objs.size()=1 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.7jbNC9VTU3q8nqmrCauJO-9hIajSTg0_0 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5033586968245317862', time=2024-04-03T06:00:58.491952+0000, chain.objs.size()=1 2024-04-03T04:03:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.Bhoabmwme0zfY1Qq6jjW337341C8XtC_0 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4773584670976260759', time=2024-04-03T06:00:58.608920+0000, chain.objs.size()=1 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.-yyKk-0bvh1nitSYVG2kAKB4MshA2Pi_0 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11071640300837206004', time=2024-04-03T06:00:58.720149+0000, chain.objs.size()=1 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.lyuMa9m7bT07DJJ5IDd5v-9_6SlB9gV_0 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4343831701434065935', time=2024-04-03T06:01:02.151144+0000, chain.objs.size()=1 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.WWtRfYNc4QUZuq2vfdqdeyMbnlpZniE_0 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7891146214042205258', time=2024-04-03T06:01:03.548112+0000, chain.objs.size()=1 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.LJfiwwBQnUz9KJt84PZFh2jX-UVs_55_0 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12582917650450519049', time=2024-04-03T06:01:06.965511+0000, chain.objs.size()=1 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.Y2MnuoqlxDKYUUNO0JLJ4vaAd89ZONU_0 2024-04-03T04:03:06.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1550046362126247908', time=2024-04-03T06:01:46.454046+0000, chain.objs.size()=1 2024-04-03T04:03:06.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.009+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.ecnwrLxKu7QgboAIBbi_YNlZWppH70s_0 2024-04-03T04:03:06.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.021+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:07.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.025+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:03:07.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.029+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.029+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T04:03:07.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_1_29d789029cf147f0317a638612d31541', time=2024-04-03T05:57:44.091587+0000, chain.objs.size()=2 2024-04-03T04:03:07.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_0 2024-04-03T04:03:07.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.vPxze38QIvjjS15roeWP6uCX8if2umV_1 2024-04-03T04:03:07.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16568584420205316147', time=2024-04-03T05:57:44.196379+0000, chain.objs.size()=5 2024-04-03T04:03:07.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1 2024-04-03T04:03:07.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.1_1 2024-04-03T04:03:07.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.2 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__shadow_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.2_1 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-FROZEN.2~C8FQB9srrvsj0vUCflMdONgNt506ZDI.3 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.310885445738139356', time=2024-04-03T05:59:41.896912+0000, chain.objs.size()=1 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.yryUyPHKTLst1QHUE7ooY8MNPnpa9Pp_0 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14409130238663998642', time=2024-04-03T06:00:16.864752+0000, chain.objs.size()=1 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.NYLHtnJnZk6EvBDWr0Rg2ozvMry4zd8_0 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9584854435824210590', time=2024-04-03T06:00:16.867236+0000, chain.objs.size()=1 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.70EnY0tNCXKfEgNAvyeCtKhC6UvGm2g_0 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2831505783184514350', time=2024-04-03T06:00:58.623287+0000, chain.objs.size()=1 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.23__shadow_.ciCuLCwLcFOLI1O_Ql7BoR_rvXcC2___0 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1640007823303476096', time=2024-04-03T06:01:03.594978+0000, chain.objs.size()=1 2024-04-03T04:03:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.033+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.MUreGQJQkQ0k3PTnZTxlqSHcjOJXrbS_0 2024-04-03T04:03:07.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.041+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:07.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.049+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:03:07.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-04-03T04:03:07.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17186089222573891090', time=2024-04-03T05:57:43.687727+0000, chain.objs.size()=1 2024-04-03T04:03:07.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.Ve79gqXoDQC4U_DElYHbHTzMrOoufFL_0 2024-04-03T04:03:07.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.725420286464203017', time=2024-04-03T05:57:44.446536+0000, chain.objs.size()=3 2024-04-03T04:03:07.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.GNNMGNbQ4mK4Gx0TkOJ8nFjtTR4wZ4Y_0 2024-04-03T04:03:07.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.GNNMGNbQ4mK4Gx0TkOJ8nFjtTR4wZ4Y_1 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.GNNMGNbQ4mK4Gx0TkOJ8nFjtTR4wZ4Y_2 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10422069577905086086', time=2024-04-03T05:59:41.913012+0000, chain.objs.size()=1 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20__shadow_.LW3EJzOlZ4bP3GGrLKHUO7H5Yu8ry73_0 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16229297688264395745', time=2024-04-03T06:00:16.938379+0000, chain.objs.size()=1 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.45dqNyWjVC-sKIqiZR8niNfpvsJlxyY_0 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18387404319713873079', time=2024-04-03T06:00:21.969199+0000, chain.objs.size()=1 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.0kwTlQZmcZguM8yWl5sQfgxLFBiOy3p_0 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.529173478720313549', time=2024-04-03T06:00:22.027237+0000, chain.objs.size()=1 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.22__shadow_.OqLpU-HuNZ9w995rmM4QT_w76pNswPI_0 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10212749674320213019', time=2024-04-03T06:01:03.652248+0000, chain.objs.size()=1 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.pTbTi5_SOXni7KGCQMFttmf_xat9KGf_0 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11509056395963836618', time=2024-04-03T06:01:03.753249+0000, chain.objs.size()=1 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.24__shadow_.gB3QTXrnF5Udp6WvCqAUpj1xDmT0hyg_0 2024-04-03T04:03:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12916926513477774291', time=2024-04-03T06:01:07.068131+0000, chain.objs.size()=1 2024-04-03T04:03:07.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.rXGU9YtDZvz5IAbyNAy7w8gEbnec6R5_0 2024-04-03T04:03:07.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7430252593834245423', time=2024-04-03T06:01:07.083501+0000, chain.objs.size()=1 2024-04-03T04:03:07.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.053+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.vph1joH9fcaV8ErnZwmG4CC-II9RidT_0 2024-04-03T04:03:07.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.061+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14625410816140096682', time=2024-04-03T06:01:46.357991+0000, chain.objs.size()=1 2024-04-03T04:03:07.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.061+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.27__shadow_.rCXfyomod6oAQUrsVyB43NyzxsMkWYa_0 2024-04-03T04:03:07.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.065+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4570801045800539027', time=2024-04-03T06:02:24.066935+0000, chain.objs.size()=1 2024-04-03T04:03:07.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.065+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17__shadow_.AYd4o-nkaF4HbWopQ_dMPGjChw9QYxc_0 2024-04-03T04:03:07.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.069+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:07.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.077+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:03:07.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-04-03T04:03:07.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11181538900668775929', time=2024-04-03T05:57:43.631741+0000, chain.objs.size()=1 2024-04-03T04:03:07.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4__shadow_.YU7CdM05DJIxKKaPTLMRMEhH51K1COK_0 2024-04-03T04:03:07.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7491817295739647489', time=2024-04-03T05:57:44.473017+0000, chain.objs.size()=3 2024-04-03T04:03:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.fe43YwTA3nfj2kIX74Gqgzm9_69V7zx_0 2024-04-03T04:03:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.fe43YwTA3nfj2kIX74Gqgzm9_69V7zx_1 2024-04-03T04:03:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13__shadow_.fe43YwTA3nfj2kIX74Gqgzm9_69V7zx_2 2024-04-03T04:03:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5033727610197502091', time=2024-04-03T05:59:37.707736+0000, chain.objs.size()=1 2024-04-03T04:03:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.S2Oi_d9fNRaPoifTJWwxYRmakOiIdGD_0 2024-04-03T04:03:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18389439134375737258', time=2024-04-03T06:00:16.994786+0000, chain.objs.size()=1 2024-04-03T04:03:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.QmDuCxb8_04gg0Rg0DukVayOBHUYOXi_0 2024-04-03T04:03:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15106894984227763911', time=2024-04-03T06:01:07.090586+0000, chain.objs.size()=1 2024-04-03T04:03:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.081+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.LyTXEMkmBcuhTJ44-j2hIFdih5K4D5__0 2024-04-03T04:03:07.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.093+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:07.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.097+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:03:07.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.101+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.2_54bd89792803af4d44be22fee2bd9b04', time=2024-04-03T05:57:44.266813+0000, chain.objs.size()=3 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.1 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.2 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16__multipart_foo-STANDARD.2~D5DOgRqiwEwle8oLhAFbekqCmPpqaRf.3 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15676206524179853865', time=2024-04-03T05:57:44.361786+0000, chain.objs.size()=5 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.1 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__shadow_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.1_1 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.2 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__shadow_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.2_1 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14__multipart_foo-FROZEN.2~fF9kGBiBU8XCdhG7nK-ONN1EZ08P8hh.3 2024-04-03T04:03:07.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12130375689569786736', time=2024-04-03T06:00:16.804413+0000, chain.objs.size()=1 2024-04-03T04:03:07.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.TgCV2KCm9qVLHXNJLtwHOYX4ccd1Gcu_0 2024-04-03T04:03:07.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9677569057019618', time=2024-04-03T06:01:06.971090+0000, chain.objs.size()=1 2024-04-03T04:03:07.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.25__shadow_.JQerHU-7pOG57kqdv3e9CcXzEd0ZwTU_0 2024-04-03T04:03:07.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5131030007466202480', time=2024-04-03T06:01:41.736506+0000, chain.objs.size()=1 2024-04-03T04:03:07.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.105+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.kMW_fgV1TzncO3uBq-QAcOQbjPUKazW_0 2024-04-03T04:03:07.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.113+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:07.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.121+0000 7f43a148b980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:03:07.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.121+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-04-03T04:03:07.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='_dZLa63QQs7sEVkvx2lFQCQCFhpkkD0W', time=2024-04-03T05:57:43.991390+0000, chain.objs.size()=1 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15__shadow_.Uawvtzv7WTPwWEBMkLlsycrNUuOwZIS_0 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15368815340854039683', time=2024-04-03T05:59:36.252218+0000, chain.objs.size()=1 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.1FdcXc3wvvW-QrkFQlbyB8I1a407HrO_0 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12090585083173803466', time=2024-04-03T05:59:37.538369+0000, chain.objs.size()=1 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.19__shadow_.ZeCXY4hbUoYSHy4p3qJ25CDwG9PmoFz_0 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11526500737567155619', time=2024-04-03T06:00:16.869734+0000, chain.objs.size()=1 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.CrT1afu3PmZ6Gdx88ApUVBcCWE7gvPa_0 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1207015858285370074', time=2024-04-03T06:00:17.024084+0000, chain.objs.size()=1 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.21__shadow_.w9j8pZKNAfMZViT3Ose9m8Z8InQnzqF_0 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.331669988071251699', time=2024-04-03T06:01:41.661249+0000, chain.objs.size()=1 2024-04-03T04:03:07.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.125+0000 7f43a148b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.26__shadow_.Pgw-3-ZGfTTvU4_aiacieMECbyI-JzZ_0 2024-04-03T04:03:07.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.133+0000 7f43a148b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:03:07.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.141+0000 7f42557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:03:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.149+0000 7f43a148b980 20 remove_watcher() i=0 2024-04-03T04:03:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.149+0000 7f43a148b980 2 removed watcher, disabling cache 2024-04-03T04:03:07.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.149+0000 7f43a148b980 20 remove_watcher() i=1 2024-04-03T04:03:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.153+0000 7f43a148b980 20 remove_watcher() i=2 2024-04-03T04:03:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.157+0000 7f43a148b980 20 remove_watcher() i=3 2024-04-03T04:03:07.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.157+0000 7f43a148b980 20 remove_watcher() i=4 2024-04-03T04:03:07.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.161+0000 7f43a148b980 20 remove_watcher() i=5 2024-04-03T04:03:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.165+0000 7f43a148b980 20 remove_watcher() i=6 2024-04-03T04:03:07.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.165+0000 7f43a148b980 20 remove_watcher() i=7 2024-04-03T04:03:07.162 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:03:07.235 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:03:07.236 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:03:07.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.305+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.305+0000 7f766dbdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:07.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.305+0000 7f766dbdf980 20 realm 2024-04-03T04:03:07.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.305+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.305+0000 7f766dbdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:07.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.305+0000 7f766dbdf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:03:07.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.305+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.305+0000 7f766dbdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:07.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.305+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.309+0000 7f766dbdf980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:03:07.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.309+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.309+0000 7f766dbdf980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:03:07.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.309+0000 7f766dbdf980 20 searching for the correct realm 2024-04-03T04:03:07.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.309+0000 7f766b6fa640 0 -- 172.21.15.104:0/2608854976 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x5568f14d3380 msgr2=0x5568f14d5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:03:07.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.521+0000 7f766b6fa640 0 -- 172.21.15.104:0/2608854976 >> [v2:172.21.15.130:6804/3494208016,v1:172.21.15.130:6807/3494208016] conn(0x5568f12928a0 msgr2=0x7f766406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:03:07.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:03:07.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:03:07.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:03:07.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:03:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:03:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:03:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:03:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:03:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 zone default found 2024-04-03T04:03:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 4 Realm: () 2024-04-03T04:03:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:03:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:03:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:03:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 zonegroup default 2024-04-03T04:03:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.745+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.749+0000 7f766dbdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.749+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.749+0000 7f766dbdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.749+0000 7f766dbdf980 20 rados->read ofs=0 len=0 2024-04-03T04:03:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.749+0000 7f766dbdf980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:03:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.749+0000 7f766dbdf980 20 started sync module instance, tier type = 2024-04-03T04:03:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.749+0000 7f766dbdf980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:03:07.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.773+0000 7f766dbdf980 20 add_watcher() i=0 2024-04-03T04:03:07.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.773+0000 7f766dbdf980 20 add_watcher() i=1 2024-04-03T04:03:07.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.773+0000 7f766dbdf980 20 add_watcher() i=2 2024-04-03T04:03:07.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.773+0000 7f766dbdf980 20 add_watcher() i=3 2024-04-03T04:03:07.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.773+0000 7f766dbdf980 20 add_watcher() i=4 2024-04-03T04:03:07.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.773+0000 7f766dbdf980 20 add_watcher() i=5 2024-04-03T04:03:07.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.773+0000 7f766dbdf980 20 add_watcher() i=6 2024-04-03T04:03:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.777+0000 7f766dbdf980 20 add_watcher() i=7 2024-04-03T04:03:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.777+0000 7f766dbdf980 2 all 8 watchers are set, enabling cache 2024-04-03T04:03:07.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.781+0000 7f7521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:03:07.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.781+0000 7f766dbdf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:03:07.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.781+0000 7f766dbdf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:03:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.873+0000 7f7520fe1640 20 reqs_thread_entry: start 2024-04-03T04:03:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.873+0000 7f766dbdf980 20 init_complete bucket index max shards: 11 2024-04-03T04:03:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.873+0000 7f766dbdf980 20 Filter name: none 2024-04-03T04:03:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.873+0000 7f749a7fc640 20 reqs_thread_entry: start 2024-04-03T04:03:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.873+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:03:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.877+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.881+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.881+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.885+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:03:07.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.889+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.889+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.889+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.893+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:03:07.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.893+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.897+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.897+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.901+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:03:07.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.905+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.905+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.905+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.909+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:03:07.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.913+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.913+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.913+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.917+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:03:07.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.921+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.921+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.921+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.921+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:03:07.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.925+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.929+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.929+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.933+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:03:07.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.933+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.933+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.933+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.937+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:03:07.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.937+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.937+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.941+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.941+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:03:07.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.945+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.945+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.949+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.949+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:03:07.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.953+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.957+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.957+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.961+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:03:07.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.961+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.961+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.965+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.965+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:03:07.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.969+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.969+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.973+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.973+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:03:07.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.977+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.977+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.977+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.981+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:03:07.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.985+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.985+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.985+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.989+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:03:07.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.993+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.993+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.997+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:07.997+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:03:07.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.001+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.001+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.001+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.005+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:03:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.009+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.009+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.009+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.013+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:03:07.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.017+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.017+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:07.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.017+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:07.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.021+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:03:08.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.025+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.025+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.025+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.029+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:03:08.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.029+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.033+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.033+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.037+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:03:08.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.041+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.041+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.041+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.045+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:03:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.049+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.049+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.049+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.053+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:03:08.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.057+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.061+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.061+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.065+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:03:08.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.065+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.065+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.065+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.069+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:03:08.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.073+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.073+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.073+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.077+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:03:08.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.081+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.081+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.081+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.085+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:03:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.085+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.089+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.089+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.089+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:03:08.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.093+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.097+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.097+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.097+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:03:08.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.101+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.105+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.105+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.105+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:03:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.109+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.113+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.113+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.117+0000 7f766dbdf980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:03:08.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.117+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.117+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:03:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.121+0000 7f766dbdf980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:03:08.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.125+0000 7f7521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:03:08.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.129+0000 7f766dbdf980 20 remove_watcher() i=0 2024-04-03T04:03:08.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.129+0000 7f766dbdf980 2 removed watcher, disabling cache 2024-04-03T04:03:08.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.129+0000 7f766dbdf980 20 remove_watcher() i=1 2024-04-03T04:03:08.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.133+0000 7f766dbdf980 20 remove_watcher() i=2 2024-04-03T04:03:08.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.137+0000 7f766dbdf980 20 remove_watcher() i=3 2024-04-03T04:03:08.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.137+0000 7f766dbdf980 20 remove_watcher() i=4 2024-04-03T04:03:08.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.141+0000 7f766dbdf980 20 remove_watcher() i=5 2024-04-03T04:03:08.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.141+0000 7f766dbdf980 20 remove_watcher() i=6 2024-04-03T04:03:08.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:03:08.145+0000 7f766dbdf980 20 remove_watcher() i=7 2024-04-03T04:03:08.143 DEBUG:teuthology.orchestra.run.smithi104:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-04-03T04:03:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-04-03T04:03:13.247 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :clean UP-TO-DATE 2024-04-03T04:03:33.445 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :compileJava 2024-04-03T04:03:33.446 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :processResources 2024-04-03T04:03:33.446 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :classes 2024-04-03T04:03:34.145 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:34.265 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :compileTestJava 2024-04-03T04:03:34.266 INFO:teuthology.orchestra.run.smithi104.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-04-03T04:03:34.266 INFO:teuthology.orchestra.run.smithi104.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-04-03T04:03:34.267 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:34.267 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :processTestResources NO-SOURCE 2024-04-03T04:03:34.267 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :testClasses 2024-04-03T04:03:40.746 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:40.746 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :test 2024-04-03T04:03:40.746 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:40.746 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-04-03T04:03:52.845 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:52.846 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-04-03T04:03:53.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:53.545 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-04-03T04:03:53.745 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:53.745 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-04-03T04:03:54.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:03:54.629 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-04-03T04:04:16.446 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:04:16.446 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-04-03T04:04:17.245 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:04:17.246 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-04-03T04:04:17.345 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:04:17.345 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-04-03T04:04:17.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:04:17.545 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-04-03T04:04:17.645 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:04:17.645 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-04-03T04:04:18.445 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:04:18.445 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-04-03T04:04:31.445 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:04:31.445 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-04-03T04:04:32.945 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:04:32.945 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-04-03T04:04:33.345 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:04:33.345 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-04-03T04:04:33.345 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03 04:04:33,322 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-04-03T04:05:15.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:15.545 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-04-03T04:05:16.944 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:16.944 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-04-03T04:05:17.144 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:17.145 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-04-03T04:05:17.844 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:17.844 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-04-03T04:05:18.045 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:18.045 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-04-03T04:05:19.344 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:19.344 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-04-03T04:05:31.944 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:31.944 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-04-03T04:05:32.744 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:32.744 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-04-03T04:05:32.844 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:32.844 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-04-03T04:05:33.044 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:05:33.044 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-04-03T04:06:00.444 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:06:00.445 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-04-03T04:06:12.644 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:06:12.644 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-04-03T04:06:39.344 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:06:39.344 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-04-03T04:06:40.444 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:06:40.444 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-04-03T04:06:46.844 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:06:46.844 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-04-03T04:06:47.544 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:06:47.544 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-04-03T04:09:34.943 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:09:34.944 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-04-03T04:09:35.843 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:09:35.843 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-04-03T04:09:52.442 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:09:52.443 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-04-03T04:09:53.242 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:09:53.243 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-04-03T04:10:06.442 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:06.443 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-04-03T04:10:07.242 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:07.242 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-04-03T04:10:11.942 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:11.943 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-04-03T04:10:24.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:24.542 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-04-03T04:10:25.242 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:25.242 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-04-03T04:10:28.342 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:28.342 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-04-03T04:10:28.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:28.542 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-04-03T04:10:29.342 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:29.342 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-04-03T04:10:29.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:29.542 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-04-03T04:10:30.342 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:30.342 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-04-03T04:10:30.642 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:30.642 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-04-03T04:10:31.443 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:31.443 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-04-03T04:10:31.642 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:31.643 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-04-03T04:10:32.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:32.542 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-04-03T04:10:32.742 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:32.742 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-04-03T04:10:33.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:33.542 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-04-03T04:10:33.742 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:33.742 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-04-03T04:10:34.442 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:10:34.442 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-04-03T04:11:03.543 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:03.543 INFO:teuthology.orchestra.run.smithi104.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-04-03T04:11:04.544 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:04.544 INFO:teuthology.orchestra.run.smithi104.stdout:---------------------------------------------------------------------- 2024-04-03T04:11:04.544 INFO:teuthology.orchestra.run.smithi104.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-04-03T04:11:04.544 INFO:teuthology.orchestra.run.smithi104.stdout:---------------------------------------------------------------------- 2024-04-03T04:11:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:04.545 INFO:teuthology.orchestra.run.smithi104.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-04-03T04:11:04.545 INFO:teuthology.orchestra.run.smithi104.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-04-03T04:11:04.545 INFO:teuthology.orchestra.run.smithi104.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-04-03T04:11:04.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:04.545 INFO:teuthology.orchestra.run.smithi104.stdout:BUILD SUCCESSFUL in 7m 56s 2024-04-03T04:11:04.546 INFO:teuthology.orchestra.run.smithi104.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-04-03T04:11:04.868 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:11:04.900 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:11:04.900 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:11:04.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.968+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:04.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:04.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 20 realm 2024-04-03T04:11:04.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:04.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:04.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:11:04.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:04.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:04.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:04.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:04.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.972+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:04.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.976+0000 7f088bd88980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:11:04.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.976+0000 7f088bd88980 20 searching for the correct realm 2024-04-03T04:11:04.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.980+0000 7f088a0a4640 0 -- 172.21.15.104:0/3917582010 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f0884066b90 msgr2=0x7f0884054c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:04.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:04.988+0000 7f08890a2640 0 -- 172.21.15.104:0/3917582010 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f088406f3a0 msgr2=0x7f088403e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:05.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:11:05.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:11:05.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:11:05.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:11:05.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:11:05.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:11:05.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:05.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:11:05.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 zone default found 2024-04-03T04:11:05.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 4 Realm: () 2024-04-03T04:11:05.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:11:05.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:11:05.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:11:05.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 zonegroup default 2024-04-03T04:11:05.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.208+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.212+0000 7f088bd88980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.212+0000 7f088bd88980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.212+0000 7f088bd88980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.212+0000 7f088bd88980 20 started sync module instance, tier type = 2024-04-03T04:11:05.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.212+0000 7f088bd88980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:11:05.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.236+0000 7f088bd88980 20 add_watcher() i=0 2024-04-03T04:11:05.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.236+0000 7f088bd88980 20 add_watcher() i=1 2024-04-03T04:11:05.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.236+0000 7f088bd88980 20 add_watcher() i=2 2024-04-03T04:11:05.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.236+0000 7f088bd88980 20 add_watcher() i=3 2024-04-03T04:11:05.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.236+0000 7f088bd88980 20 add_watcher() i=4 2024-04-03T04:11:05.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.236+0000 7f088bd88980 20 add_watcher() i=5 2024-04-03T04:11:05.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.236+0000 7f088bd88980 20 add_watcher() i=6 2024-04-03T04:11:05.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.240+0000 7f088bd88980 20 add_watcher() i=7 2024-04-03T04:11:05.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.240+0000 7f088bd88980 2 all 8 watchers are set, enabling cache 2024-04-03T04:11:05.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.244+0000 7f073ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:05.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.244+0000 7f088bd88980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:11:05.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.244+0000 7f088bd88980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:11:05.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.336+0000 7f073efe5640 20 reqs_thread_entry: start 2024-04-03T04:11:05.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.336+0000 7f088bd88980 20 init_complete bucket index max shards: 11 2024-04-03T04:11:05.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.336+0000 7f088bd88980 20 Filter name: none 2024-04-03T04:11:05.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.336+0000 7f073cfe1640 20 reqs_thread_entry: start 2024-04-03T04:11:05.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.336+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:11:05.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-04-03T04:11:05.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10029917913209456052', time=2024-04-03T06:04:31.658368+0000, chain.objs.size()=9 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.1 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__shadow_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.1_1 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.2 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__shadow_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.2_1 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.3 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__shadow_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.3_1 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.4 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__shadow_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.4_1 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.5 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7533804898179205951', time=2024-04-03T06:09:52.687174+0000, chain.objs.size()=9 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__multipart_key1.2~dfRjkEOwAqtMkFs5gEkwjU9C4pRKTwB.1 2024-04-03T04:11:05.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__shadow_key1.2~dfRjkEOwAqtMkFs5gEkwjU9C4pRKTwB.1_1 2024-04-03T04:11:05.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.340+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__multipart_key1.2~dfRjkEOwAqtMkFs5gEkwjU9C4pRKTwB.2 2024-04-03T04:11:05.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__shadow_key1.2~dfRjkEOwAqtMkFs5gEkwjU9C4pRKTwB.2_1 2024-04-03T04:11:05.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__multipart_key1.2~dfRjkEOwAqtMkFs5gEkwjU9C4pRKTwB.3 2024-04-03T04:11:05.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__shadow_key1.2~dfRjkEOwAqtMkFs5gEkwjU9C4pRKTwB.3_1 2024-04-03T04:11:05.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__multipart_key1.2~dfRjkEOwAqtMkFs5gEkwjU9C4pRKTwB.4 2024-04-03T04:11:05.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__shadow_key1.2~dfRjkEOwAqtMkFs5gEkwjU9C4pRKTwB.4_1 2024-04-03T04:11:05.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__multipart_key1.2~dfRjkEOwAqtMkFs5gEkwjU9C4pRKTwB.5 2024-04-03T04:11:05.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53', time=2024-04-03T06:10:20.849853+0000, chain.objs.size()=1 2024-04-03T04:11:05.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.11 2024-04-03T04:11:05.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53', time=2024-04-03T06:10:20.993173+0000, chain.objs.size()=1 2024-04-03T04:11:05.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.16 2024-04-03T04:11:05.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53', time=2024-04-03T06:10:21.092276+0000, chain.objs.size()=1 2024-04-03T04:11:05.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.352+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.17 2024-04-03T04:11:05.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.356+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53', time=2024-04-03T06:10:21.592583+0000, chain.objs.size()=1 2024-04-03T04:11:05.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.356+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.18 2024-04-03T04:11:05.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.356+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53', time=2024-04-03T06:10:21.691576+0000, chain.objs.size()=1 2024-04-03T04:11:05.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.356+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.19 2024-04-03T04:11:05.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.360+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53', time=2024-04-03T06:10:21.817378+0000, chain.objs.size()=35 2024-04-03T04:11:05.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.360+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.1 2024-04-03T04:11:05.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.360+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.2 2024-04-03T04:11:05.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.360+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.3 2024-04-03T04:11:05.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.364+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.4 2024-04-03T04:11:05.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.368+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.5 2024-04-03T04:11:05.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.368+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.6 2024-04-03T04:11:05.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.368+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.7 2024-04-03T04:11:05.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.368+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.8 2024-04-03T04:11:05.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.372+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.9 2024-04-03T04:11:05.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.372+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.10 2024-04-03T04:11:05.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.372+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.w3298j-J4yezNdcHwo1m1oG0_lrMiDlF.11 2024-04-03T04:11:05.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.372+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.12 2024-04-03T04:11:05.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.372+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.13 2024-04-03T04:11:05.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.372+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.14 2024-04-03T04:11:05.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.372+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.15 2024-04-03T04:11:05.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.372+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.wpICBqMjbtU9gvOiBiVs4m5s65Q3Emkd.16 2024-04-03T04:11:05.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.376+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.X26FCffQsc75QHtc3wcM4cHshhwKC3p5.17 2024-04-03T04:11:05.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.376+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.6lFiJoF1bAqk4jBFFiOmO1m8F59o4rd-.18 2024-04-03T04:11:05.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.376+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.4Cr30ZPliGOvOynPyVUFGB6JMgWlUIEQ.19 2024-04-03T04:11:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.380+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.20 2024-04-03T04:11:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.380+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.21 2024-04-03T04:11:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.380+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.22 2024-04-03T04:11:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.380+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.23 2024-04-03T04:11:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.380+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.24 2024-04-03T04:11:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.380+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.25 2024-04-03T04:11:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.380+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.26 2024-04-03T04:11:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.384+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.27 2024-04-03T04:11:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.384+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.28 2024-04-03T04:11:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.384+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.29 2024-04-03T04:11:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.384+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.30 2024-04-03T04:11:05.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.388+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.31 2024-04-03T04:11:05.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.388+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.32 2024-04-03T04:11:05.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.388+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.33 2024-04-03T04:11:05.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.392+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.34 2024-04-03T04:11:05.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.392+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.47__multipart_key1.2~2KUXeZxfyKHITDC6-bNZmAlxHX03b53.35 2024-04-03T04:11:05.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.400+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.404+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:11:05.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.404+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.404+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:11:05.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15198971095543697006', time=2024-04-03T06:05:11.103609+0000, chain.objs.size()=7 2024-04-03T04:11:05.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~YS8E9JBDOF7j6cn2Yds72ypLOC3u-tK.1 2024-04-03T04:11:05.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~YS8E9JBDOF7j6cn2Yds72ypLOC3u-tK.1_1 2024-04-03T04:11:05.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~YS8E9JBDOF7j6cn2Yds72ypLOC3u-tK.1_2 2024-04-03T04:11:05.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~YS8E9JBDOF7j6cn2Yds72ypLOC3u-tK.2 2024-04-03T04:11:05.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~YS8E9JBDOF7j6cn2Yds72ypLOC3u-tK.2_1 2024-04-03T04:11:05.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~YS8E9JBDOF7j6cn2Yds72ypLOC3u-tK.2_2 2024-04-03T04:11:05.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~YS8E9JBDOF7j6cn2Yds72ypLOC3u-tK.3 2024-04-03T04:11:05.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18105175959695024282', time=2024-04-03T06:06:39.795530+0000, chain.objs.size()=1 2024-04-03T04:11:05.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_.6ysz97yc1nnCdM7QYX82SKGirHJsSzw_0 2024-04-03T04:11:05.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7813046746497903212', time=2024-04-03T06:06:39.864639+0000, chain.objs.size()=1 2024-04-03T04:11:05.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.408+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_.d1aJVsyaIZHZKPBNtlvC7QmiNNdY1cm_0 2024-04-03T04:11:05.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.416+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.416+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:11:05.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.420+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.420+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.420+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.424+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:11:05.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-04-03T04:11:05.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11878990162706397264', time=2024-04-03T06:05:15.406649+0000, chain.objs.size()=7 2024-04-03T04:11:05.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~73frsY6T_R9gSL1xpRRYI2uMoJhSRvt.1 2024-04-03T04:11:05.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~73frsY6T_R9gSL1xpRRYI2uMoJhSRvt.1_1 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~73frsY6T_R9gSL1xpRRYI2uMoJhSRvt.1_2 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~73frsY6T_R9gSL1xpRRYI2uMoJhSRvt.2 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~73frsY6T_R9gSL1xpRRYI2uMoJhSRvt.2_1 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~73frsY6T_R9gSL1xpRRYI2uMoJhSRvt.2_2 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~73frsY6T_R9gSL1xpRRYI2uMoJhSRvt.3 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1578525898950535368', time=2024-04-03T06:06:39.713691+0000, chain.objs.size()=9 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file2.mpg.2~DW7ZBvg8mHaQGdYgStJlMewMoCeDPbV.1 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_file2.mpg.2~DW7ZBvg8mHaQGdYgStJlMewMoCeDPbV.1_1 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file2.mpg.2~DW7ZBvg8mHaQGdYgStJlMewMoCeDPbV.2 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_file2.mpg.2~DW7ZBvg8mHaQGdYgStJlMewMoCeDPbV.2_1 2024-04-03T04:11:05.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.428+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file2.mpg.2~DW7ZBvg8mHaQGdYgStJlMewMoCeDPbV.3 2024-04-03T04:11:05.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.436+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_file2.mpg.2~DW7ZBvg8mHaQGdYgStJlMewMoCeDPbV.3_1 2024-04-03T04:11:05.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.440+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file2.mpg.2~DW7ZBvg8mHaQGdYgStJlMewMoCeDPbV.4 2024-04-03T04:11:05.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.440+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_file2.mpg.2~DW7ZBvg8mHaQGdYgStJlMewMoCeDPbV.4_1 2024-04-03T04:11:05.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.440+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file2.mpg.2~DW7ZBvg8mHaQGdYgStJlMewMoCeDPbV.5 2024-04-03T04:11:05.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.448+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.452+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:11:05.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-04-03T04:11:05.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__shadow_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.1_1_867e909afbe63a807de8e3273f9caf1f', time=2024-04-03T06:04:32.330987+0000, chain.objs.size()=9 2024-04-03T04:11:05.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.1 2024-04-03T04:11:05.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__shadow_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.1_1 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.2 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__shadow_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.2_1 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.3 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__shadow_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.3_1 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.4 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__shadow_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.4_1 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.33__multipart_key1.2~r4FsAG21I7wkQ8fxs28fYpgaKwE9ary.5 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12842906349746724562', time=2024-04-03T06:05:06.612287+0000, chain.objs.size()=9 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~kX6qdhc-Tv9s9oceojnvPgWsMTda5tf.1 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~kX6qdhc-Tv9s9oceojnvPgWsMTda5tf.1_1 2024-04-03T04:11:05.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.456+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~kX6qdhc-Tv9s9oceojnvPgWsMTda5tf.2 2024-04-03T04:11:05.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.460+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~kX6qdhc-Tv9s9oceojnvPgWsMTda5tf.2_1 2024-04-03T04:11:05.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.460+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~kX6qdhc-Tv9s9oceojnvPgWsMTda5tf.3 2024-04-03T04:11:05.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.464+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~kX6qdhc-Tv9s9oceojnvPgWsMTda5tf.3_1 2024-04-03T04:11:05.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.464+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~kX6qdhc-Tv9s9oceojnvPgWsMTda5tf.4 2024-04-03T04:11:05.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.464+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~kX6qdhc-Tv9s9oceojnvPgWsMTda5tf.4_1 2024-04-03T04:11:05.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.464+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~kX6qdhc-Tv9s9oceojnvPgWsMTda5tf.5 2024-04-03T04:11:05.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.468+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.472+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:11:05.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.472+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:05.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15921032605399188231', time=2024-04-03T06:09:07.525299+0000, chain.objs.size()=16 2024-04-03T04:11:05.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.1 2024-04-03T04:11:05.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.1_1 2024-04-03T04:11:05.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.1_2 2024-04-03T04:11:05.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.2 2024-04-03T04:11:05.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.2_1 2024-04-03T04:11:05.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.2_2 2024-04-03T04:11:05.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.3 2024-04-03T04:11:05.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.3_1 2024-04-03T04:11:05.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.3_2 2024-04-03T04:11:05.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.4 2024-04-03T04:11:05.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.4_1 2024-04-03T04:11:05.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.476+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.4_2 2024-04-03T04:11:05.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.480+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.5 2024-04-03T04:11:05.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.484+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.5_1 2024-04-03T04:11:05.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.484+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.5_2 2024-04-03T04:11:05.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.484+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~ZwJPppvRN3qjpX1HUf9fTkCYgs9QzCO.6 2024-04-03T04:11:05.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.492+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.492+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:11:05.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.496+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.496+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.496+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.500+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:11:05.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.500+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.500+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.500+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.504+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:11:05.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.504+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.504+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.508+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:05.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.508+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538160093801530905', time=2024-04-03T06:10:29.821635+0000, chain.objs.size()=1 2024-04-03T04:11:05.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.508+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.50__shadow_.YjA_ZUvlRUVAUroThxFaI8wBUcLt34J_0 2024-04-03T04:11:05.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.508+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.512+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:11:05.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.512+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.516+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.516+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.516+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:11:05.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16929274247624861906', time=2024-04-03T06:07:43.003803+0000, chain.objs.size()=21 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.1 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.1_1 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.2 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.2_1 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.3 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.3_1 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.4 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.4_1 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.5 2024-04-03T04:11:05.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.5_1 2024-04-03T04:11:05.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.6 2024-04-03T04:11:05.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.520+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.6_1 2024-04-03T04:11:05.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.524+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.7 2024-04-03T04:11:05.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.524+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.7_1 2024-04-03T04:11:05.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.524+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.8 2024-04-03T04:11:05.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.524+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.8_1 2024-04-03T04:11:05.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.528+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.9 2024-04-03T04:11:05.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.528+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.9_1 2024-04-03T04:11:05.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.528+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.10 2024-04-03T04:11:05.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.528+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.10_1 2024-04-03T04:11:05.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.528+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~IV0GEE1Nt9LL5w2Tckvlg_9uT0Bps9-.11 2024-04-03T04:11:05.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.536+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:11:05.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-04-03T04:11:05.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA', time=2024-04-03T06:03:52.743708+0000, chain.objs.size()=9 2024-04-03T04:11:05.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29__multipart_key1.2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA.1 2024-04-03T04:11:05.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29__shadow_key1.2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA.1_1 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29__multipart_key1.2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA.2 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29__shadow_key1.2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA.2_1 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29__multipart_key1.2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA.3 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29__shadow_key1.2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA.3_1 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29__multipart_key1.2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA.4 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29__shadow_key1.2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA.4_1 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29__multipart_key1.2~q9fXtwU6N8EwqoPNfqQe1riK7i-ZfhA.5 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4691577575099920122', time=2024-04-03T06:05:16.397296+0000, chain.objs.size()=6 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.35__shadow_.e87NgJPmfJjWc1EI76_qT5VI-w1_voB_0 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.35__shadow_.e87NgJPmfJjWc1EI76_qT5VI-w1_voB_1 2024-04-03T04:11:05.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.540+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.35__shadow_.e87NgJPmfJjWc1EI76_qT5VI-w1_voB_2 2024-04-03T04:11:05.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.544+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.35__shadow_.e87NgJPmfJjWc1EI76_qT5VI-w1_voB_3 2024-04-03T04:11:05.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.548+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.35__shadow_.e87NgJPmfJjWc1EI76_qT5VI-w1_voB_4 2024-04-03T04:11:05.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.548+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.35__shadow_.e87NgJPmfJjWc1EI76_qT5VI-w1_voB_5 2024-04-03T04:11:05.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.552+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.556+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:11:05.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.556+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.556+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.556+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:05.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.556+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4603099231423095476', time=2024-04-03T06:10:32.974820+0000, chain.objs.size()=1 2024-04-03T04:11:05.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.556+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.53__shadow_.VHCRWCDd-XexzaeSLMsYGmBUGeDlMBd_0 2024-04-03T04:11:05.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.560+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.564+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:11:05.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.564+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.564+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.564+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.568+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:11:05.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.568+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.568+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.568+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:11:05.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10303829474275930876', time=2024-04-03T06:09:34.868659+0000, chain.objs.size()=16 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.1 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.1_1 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.1_2 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.2 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.2_1 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.2_2 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.3 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.3_1 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.3_2 2024-04-03T04:11:05.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.572+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.4 2024-04-03T04:11:05.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.576+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.4_1 2024-04-03T04:11:05.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.576+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.4_2 2024-04-03T04:11:05.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.576+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.5 2024-04-03T04:11:05.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.580+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.5_1 2024-04-03T04:11:05.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.580+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.5_2 2024-04-03T04:11:05.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.580+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~Sra_7fJyAsdci_SEj0-o-EHHQB66bX_.6 2024-04-03T04:11:05.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.584+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.588+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:11:05.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.592+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.592+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.592+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.592+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:11:05.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6602242495548163272', time=2024-04-03T06:06:39.527108+0000, chain.objs.size()=9 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file.mpg.2~svcWvEb6pC1sOeT3GJ2coas5vIzNnTE.1 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_file.mpg.2~svcWvEb6pC1sOeT3GJ2coas5vIzNnTE.1_1 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file.mpg.2~svcWvEb6pC1sOeT3GJ2coas5vIzNnTE.2 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_file.mpg.2~svcWvEb6pC1sOeT3GJ2coas5vIzNnTE.2_1 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file.mpg.2~svcWvEb6pC1sOeT3GJ2coas5vIzNnTE.3 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_file.mpg.2~svcWvEb6pC1sOeT3GJ2coas5vIzNnTE.3_1 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file.mpg.2~svcWvEb6pC1sOeT3GJ2coas5vIzNnTE.4 2024-04-03T04:11:05.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_file.mpg.2~svcWvEb6pC1sOeT3GJ2coas5vIzNnTE.4_1 2024-04-03T04:11:05.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.596+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__multipart_file.mpg.2~svcWvEb6pC1sOeT3GJ2coas5vIzNnTE.5 2024-04-03T04:11:05.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.600+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.604+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:11:05.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.604+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.604+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:11:05.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10428017385371792', time=2024-04-03T06:09:35.231612+0000, chain.objs.size()=16 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.1 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.1_1 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.1_2 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.2 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.2_1 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.2_2 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.3 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.3_1 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.3_2 2024-04-03T04:11:05.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.4 2024-04-03T04:11:05.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.4_1 2024-04-03T04:11:05.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.608+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.4_2 2024-04-03T04:11:05.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.612+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.5 2024-04-03T04:11:05.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.612+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.5_1 2024-04-03T04:11:05.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.612+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.5_2 2024-04-03T04:11:05.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.612+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~NPU8ommcvKsMH4CI6-kbWbm7m-4XnNQ.6 2024-04-03T04:11:05.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.612+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7582386866767702558', time=2024-04-03T06:10:26.374875+0000, chain.objs.size()=1 2024-04-03T04:11:05.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.612+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.48__shadow_.MurRlQI4BPmRVmG3T9_hfF5_ihLZZRW_0 2024-04-03T04:11:05.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.612+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10379031695271411237', time=2024-04-03T06:10:28.768860+0000, chain.objs.size()=1 2024-04-03T04:11:05.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.612+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.49__shadow_.33T5W3e2ccwbAAgLz6HFr27q2RqoGJ6_0 2024-04-03T04:11:05.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.616+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.620+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:11:05.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.620+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.620+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.620+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:11:05.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:05.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8194460865977868752', time=2024-04-03T06:05:01.922616+0000, chain.objs.size()=9 2024-04-03T04:11:05.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~f68YeieFtdPQ0rBhVqI3Hv8M2DwGeps.1 2024-04-03T04:11:05.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~f68YeieFtdPQ0rBhVqI3Hv8M2DwGeps.1_1 2024-04-03T04:11:05.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~f68YeieFtdPQ0rBhVqI3Hv8M2DwGeps.2 2024-04-03T04:11:05.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~f68YeieFtdPQ0rBhVqI3Hv8M2DwGeps.2_1 2024-04-03T04:11:05.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~f68YeieFtdPQ0rBhVqI3Hv8M2DwGeps.3 2024-04-03T04:11:05.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~f68YeieFtdPQ0rBhVqI3Hv8M2DwGeps.3_1 2024-04-03T04:11:05.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~f68YeieFtdPQ0rBhVqI3Hv8M2DwGeps.4 2024-04-03T04:11:05.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~f68YeieFtdPQ0rBhVqI3Hv8M2DwGeps.4_1 2024-04-03T04:11:05.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.624+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~f68YeieFtdPQ0rBhVqI3Hv8M2DwGeps.5 2024-04-03T04:11:05.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.632+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.632+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:11:05.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:05.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4065826575003830421', time=2024-04-03T06:06:06.421015+0000, chain.objs.size()=9 2024-04-03T04:11:05.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41__multipart_key1.2~14SUQocJkAHzEbFTLTH1w-wd2d3sIGf.1 2024-04-03T04:11:05.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41__shadow_key1.2~14SUQocJkAHzEbFTLTH1w-wd2d3sIGf.1_1 2024-04-03T04:11:05.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41__multipart_key1.2~14SUQocJkAHzEbFTLTH1w-wd2d3sIGf.2 2024-04-03T04:11:05.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41__shadow_key1.2~14SUQocJkAHzEbFTLTH1w-wd2d3sIGf.2_1 2024-04-03T04:11:05.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41__multipart_key1.2~14SUQocJkAHzEbFTLTH1w-wd2d3sIGf.3 2024-04-03T04:11:05.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41__shadow_key1.2~14SUQocJkAHzEbFTLTH1w-wd2d3sIGf.3_1 2024-04-03T04:11:05.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41__multipart_key1.2~14SUQocJkAHzEbFTLTH1w-wd2d3sIGf.4 2024-04-03T04:11:05.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41__shadow_key1.2~14SUQocJkAHzEbFTLTH1w-wd2d3sIGf.4_1 2024-04-03T04:11:05.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.636+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41__multipart_key1.2~14SUQocJkAHzEbFTLTH1w-wd2d3sIGf.5 2024-04-03T04:11:05.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.640+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.644+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:11:05.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.644+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.644+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.644+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.648+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:11:05.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.648+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.648+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.648+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.652+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:11:05.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.652+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.652+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.652+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.652+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:11:05.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16189418083007138796', time=2024-04-03T06:05:32.194834+0000, chain.objs.size()=9 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.40__multipart_key1.2~bkMKPKBCO0_AVmazoojsHDlEswoWpf9.1 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.40__shadow_key1.2~bkMKPKBCO0_AVmazoojsHDlEswoWpf9.1_1 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.40__multipart_key1.2~bkMKPKBCO0_AVmazoojsHDlEswoWpf9.2 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.40__shadow_key1.2~bkMKPKBCO0_AVmazoojsHDlEswoWpf9.2_1 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.40__multipart_key1.2~bkMKPKBCO0_AVmazoojsHDlEswoWpf9.3 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.40__shadow_key1.2~bkMKPKBCO0_AVmazoojsHDlEswoWpf9.3_1 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.40__multipart_key1.2~bkMKPKBCO0_AVmazoojsHDlEswoWpf9.4 2024-04-03T04:11:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.40__shadow_key1.2~bkMKPKBCO0_AVmazoojsHDlEswoWpf9.4_1 2024-04-03T04:11:05.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.40__multipart_key1.2~bkMKPKBCO0_AVmazoojsHDlEswoWpf9.5 2024-04-03T04:11:05.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6210010394075548864', time=2024-04-03T06:06:39.613889+0000, chain.objs.size()=1 2024-04-03T04:11:05.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.42__shadow_.GI_6-ueChCku74IDRvDieOq5T7PtgOY_0 2024-04-03T04:11:05.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9821396046562973639', time=2024-04-03T06:09:48.424197+0000, chain.objs.size()=1 2024-04-03T04:11:05.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.656+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.45__shadow_.XMLcMpnZA2cw4cyxU6q1JQzWzNuLVH4_0 2024-04-03T04:11:05.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.664+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:11:05.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:11:05.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6762824324441593450', time=2024-04-03T06:05:15.767833+0000, chain.objs.size()=7 2024-04-03T04:11:05.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~wMGDc4U93ytw1sRE6vn80bBNeLf2IQm.1 2024-04-03T04:11:05.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~wMGDc4U93ytw1sRE6vn80bBNeLf2IQm.1_1 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~wMGDc4U93ytw1sRE6vn80bBNeLf2IQm.1_2 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~wMGDc4U93ytw1sRE6vn80bBNeLf2IQm.2 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~wMGDc4U93ytw1sRE6vn80bBNeLf2IQm.2_1 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~wMGDc4U93ytw1sRE6vn80bBNeLf2IQm.2_2 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~wMGDc4U93ytw1sRE6vn80bBNeLf2IQm.3 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2518430035161728609', time=2024-04-03T06:08:12.227810+0000, chain.objs.size()=21 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.1 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.1_1 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.2 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.2_1 2024-04-03T04:11:05.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.668+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.3 2024-04-03T04:11:05.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.672+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.3_1 2024-04-03T04:11:05.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.672+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.4 2024-04-03T04:11:05.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.672+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.4_1 2024-04-03T04:11:05.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.672+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.5 2024-04-03T04:11:05.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.672+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.5_1 2024-04-03T04:11:05.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.672+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.6 2024-04-03T04:11:05.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.676+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.6_1 2024-04-03T04:11:05.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.676+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.7 2024-04-03T04:11:05.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.676+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.7_1 2024-04-03T04:11:05.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.676+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.8 2024-04-03T04:11:05.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.676+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.8_1 2024-04-03T04:11:05.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.676+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.9 2024-04-03T04:11:05.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.676+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.9_1 2024-04-03T04:11:05.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.680+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.10 2024-04-03T04:11:05.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.680+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.10_1 2024-04-03T04:11:05.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.680+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~uYclvt9yhyWIW2HYBCcg3AHKSH4kXo-.11 2024-04-03T04:11:05.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.680+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.903735046661861760', time=2024-04-03T06:11:03.834972+0000, chain.objs.size()=21 2024-04-03T04:11:05.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.680+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.1 2024-04-03T04:11:05.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.680+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.1_1 2024-04-03T04:11:05.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.680+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.2 2024-04-03T04:11:05.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.680+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.2_1 2024-04-03T04:11:05.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.684+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.3 2024-04-03T04:11:05.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.684+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.3_1 2024-04-03T04:11:05.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.684+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.4 2024-04-03T04:11:05.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.684+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.4_1 2024-04-03T04:11:05.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.684+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.5 2024-04-03T04:11:05.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.684+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.5_1 2024-04-03T04:11:05.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.684+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.6 2024-04-03T04:11:05.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.684+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.6_1 2024-04-03T04:11:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.688+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.7 2024-04-03T04:11:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.688+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.7_1 2024-04-03T04:11:05.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.688+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.8 2024-04-03T04:11:05.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.688+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.8_1 2024-04-03T04:11:05.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.688+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.9 2024-04-03T04:11:05.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.688+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.9_1 2024-04-03T04:11:05.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.688+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.10 2024-04-03T04:11:05.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.688+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__shadow_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.10_1 2024-04-03T04:11:05.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.688+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.55__multipart_key1.2~Zn8Q8ct2tkSCzL9GzCxF5icFcMGSr7O.11 2024-04-03T04:11:05.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.696+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:11:05.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-04-03T04:11:05.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6483333864290453285', time=2024-04-03T06:08:39.371167+0000, chain.objs.size()=19 2024-04-03T04:11:05.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.1 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.1_1 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.2 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.2_1 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.3 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.3_1 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.4 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.4_1 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.5 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.5_1 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.6 2024-04-03T04:11:05.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.700+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.6_1 2024-04-03T04:11:05.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.704+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.7 2024-04-03T04:11:05.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.704+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.7_1 2024-04-03T04:11:05.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.704+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.8 2024-04-03T04:11:05.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.704+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.8_1 2024-04-03T04:11:05.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.704+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.9 2024-04-03T04:11:05.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.704+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__shadow_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.9_1 2024-04-03T04:11:05.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.704+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.44__multipart_key1.2~wH029GIKMcXvcQVLWqeMg-EhlQClVVp.10 2024-04-03T04:11:05.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.704+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16477024357543256664', time=2024-04-03T06:10:30.863791+0000, chain.objs.size()=1 2024-04-03T04:11:05.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.704+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.51__shadow_.GuhYswzoq7sP6vd4tFauTI_O7j8op94_0 2024-04-03T04:11:05.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.712+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:11:05.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12930773832624625227', time=2024-04-03T06:04:16.747599+0000, chain.objs.size()=9 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.31__multipart_key1.2~vOLjNMUEEJrKUaduYzQpDPG6jRVhRip.1 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.31__shadow_key1.2~vOLjNMUEEJrKUaduYzQpDPG6jRVhRip.1_1 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.31__multipart_key1.2~vOLjNMUEEJrKUaduYzQpDPG6jRVhRip.2 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.31__shadow_key1.2~vOLjNMUEEJrKUaduYzQpDPG6jRVhRip.2_1 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.31__multipart_key1.2~vOLjNMUEEJrKUaduYzQpDPG6jRVhRip.3 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.31__shadow_key1.2~vOLjNMUEEJrKUaduYzQpDPG6jRVhRip.3_1 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.31__multipart_key1.2~vOLjNMUEEJrKUaduYzQpDPG6jRVhRip.4 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.31__shadow_key1.2~vOLjNMUEEJrKUaduYzQpDPG6jRVhRip.4_1 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.31__multipart_key1.2~vOLjNMUEEJrKUaduYzQpDPG6jRVhRip.5 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10647555291518513756', time=2024-04-03T06:04:56.554179+0000, chain.objs.size()=9 2024-04-03T04:11:05.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~VKN9YfSM-xvzSMrPNjulbtpBhtUDRni.1 2024-04-03T04:11:05.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~VKN9YfSM-xvzSMrPNjulbtpBhtUDRni.1_1 2024-04-03T04:11:05.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.716+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~VKN9YfSM-xvzSMrPNjulbtpBhtUDRni.2 2024-04-03T04:11:05.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.720+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~VKN9YfSM-xvzSMrPNjulbtpBhtUDRni.2_1 2024-04-03T04:11:05.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.720+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~VKN9YfSM-xvzSMrPNjulbtpBhtUDRni.3 2024-04-03T04:11:05.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~VKN9YfSM-xvzSMrPNjulbtpBhtUDRni.3_1 2024-04-03T04:11:05.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~VKN9YfSM-xvzSMrPNjulbtpBhtUDRni.4 2024-04-03T04:11:05.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__shadow_key1.2~VKN9YfSM-xvzSMrPNjulbtpBhtUDRni.4_1 2024-04-03T04:11:05.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.36__multipart_key1.2~VKN9YfSM-xvzSMrPNjulbtpBhtUDRni.5 2024-04-03T04:11:05.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13420689557793873843', time=2024-04-03T06:10:06.699108+0000, chain.objs.size()=9 2024-04-03T04:11:05.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.46__multipart_key1.2~eXik5-irEB8iKi0vukcYUnOZrr-k3er.1 2024-04-03T04:11:05.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.46__shadow_key1.2~eXik5-irEB8iKi0vukcYUnOZrr-k3er.1_1 2024-04-03T04:11:05.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.46__multipart_key1.2~eXik5-irEB8iKi0vukcYUnOZrr-k3er.2 2024-04-03T04:11:05.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.46__shadow_key1.2~eXik5-irEB8iKi0vukcYUnOZrr-k3er.2_1 2024-04-03T04:11:05.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.724+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.46__multipart_key1.2~eXik5-irEB8iKi0vukcYUnOZrr-k3er.3 2024-04-03T04:11:05.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.728+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.46__shadow_key1.2~eXik5-irEB8iKi0vukcYUnOZrr-k3er.3_1 2024-04-03T04:11:05.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.728+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.46__multipart_key1.2~eXik5-irEB8iKi0vukcYUnOZrr-k3er.4 2024-04-03T04:11:05.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.728+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.46__shadow_key1.2~eXik5-irEB8iKi0vukcYUnOZrr-k3er.4_1 2024-04-03T04:11:05.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.728+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.46__multipart_key1.2~eXik5-irEB8iKi0vukcYUnOZrr-k3er.5 2024-04-03T04:11:05.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.732+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.736+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:11:05.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.736+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.736+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.736+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.740+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:11:05.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.740+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.740+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.740+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:05.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.740+0000 7f088bd88980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5558654960826856118', time=2024-04-03T06:10:31.920090+0000, chain.objs.size()=1 2024-04-03T04:11:05.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.740+0000 7f088bd88980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.52__shadow_.Hg4RXzZnzKeWUptHI8ZWsAaYdRmW9Ec_0 2024-04-03T04:11:05.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.740+0000 7f088bd88980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:05.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.744+0000 7f088bd88980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:11:05.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.744+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.748+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.748+0000 7f088bd88980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.748+0000 7f073ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:05.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.752+0000 7f088bd88980 20 remove_watcher() i=0 2024-04-03T04:11:05.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.752+0000 7f088bd88980 2 removed watcher, disabling cache 2024-04-03T04:11:05.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.752+0000 7f088bd88980 20 remove_watcher() i=1 2024-04-03T04:11:05.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.752+0000 7f088bd88980 20 remove_watcher() i=2 2024-04-03T04:11:05.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.756+0000 7f088bd88980 20 remove_watcher() i=3 2024-04-03T04:11:05.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.756+0000 7f088bd88980 20 remove_watcher() i=4 2024-04-03T04:11:05.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.756+0000 7f088bd88980 20 remove_watcher() i=5 2024-04-03T04:11:05.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.760+0000 7f088bd88980 20 remove_watcher() i=6 2024-04-03T04:11:05.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.760+0000 7f088bd88980 20 remove_watcher() i=7 2024-04-03T04:11:05.748 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:11:05.820 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:11:05.820 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:11:05.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 realm 2024-04-03T04:11:05.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:11:05.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:05.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.888+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.892+0000 7f0931602980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:11:05.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.892+0000 7f0931602980 20 searching for the correct realm 2024-04-03T04:11:05.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.896+0000 7f092f11d640 0 -- 172.21.15.104:0/1647371167 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x558e940684f0 msgr2=0x558e9406a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:05.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.904+0000 7f092e91c640 0 -- 172.21.15.104:0/1647371167 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f0928051080 msgr2=0x7f0928051460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:05.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.908+0000 7f0931602980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:11:05.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.908+0000 7f0931602980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:11:05.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.908+0000 7f0931602980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:11:05.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.908+0000 7f0931602980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:11:05.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.908+0000 7f0931602980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:11:05.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.908+0000 7f0931602980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:11:05.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.908+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.908+0000 7f0931602980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.908+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:05.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:11:05.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 zone default found 2024-04-03T04:11:05.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 4 Realm: () 2024-04-03T04:11:05.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:11:05.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:11:05.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:11:05.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 zonegroup default 2024-04-03T04:11:05.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 rados->read ofs=0 len=0 2024-04-03T04:11:05.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:05.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 started sync module instance, tier type = 2024-04-03T04:11:05.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.912+0000 7f0931602980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:11:05.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.928+0000 7f0931602980 20 add_watcher() i=0 2024-04-03T04:11:05.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.928+0000 7f0931602980 20 add_watcher() i=1 2024-04-03T04:11:05.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.928+0000 7f0931602980 20 add_watcher() i=2 2024-04-03T04:11:05.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.928+0000 7f0931602980 20 add_watcher() i=3 2024-04-03T04:11:05.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.928+0000 7f0931602980 20 add_watcher() i=4 2024-04-03T04:11:05.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.928+0000 7f0931602980 20 add_watcher() i=5 2024-04-03T04:11:05.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.928+0000 7f0931602980 20 add_watcher() i=6 2024-04-03T04:11:05.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.928+0000 7f0931602980 20 add_watcher() i=7 2024-04-03T04:11:05.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.928+0000 7f0931602980 2 all 8 watchers are set, enabling cache 2024-04-03T04:11:05.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.932+0000 7f07e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:05.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.932+0000 7f0931602980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:11:05.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:05.932+0000 7f0931602980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:11:05.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.004+0000 7f07e57e2640 20 reqs_thread_entry: start 2024-04-03T04:11:05.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.004+0000 7f0931602980 20 init_complete bucket index max shards: 11 2024-04-03T04:11:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.008+0000 7f0931602980 20 Filter name: none 2024-04-03T04:11:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.008+0000 7f07de7fc640 20 reqs_thread_entry: start 2024-04-03T04:11:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.008+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:11:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.008+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.012+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.012+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.012+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:11:05.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.016+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.020+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:05.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.020+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:05.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.024+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:11:06.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.028+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.028+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.028+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.032+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:11:06.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.036+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.036+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.036+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.036+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:11:06.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.044+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.044+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.044+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.048+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:11:06.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.052+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.052+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.052+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.056+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:11:06.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.060+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.060+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.060+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.064+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:11:06.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.068+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.068+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.072+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.072+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:11:06.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.076+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.080+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.080+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.080+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:11:06.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.084+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.088+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.088+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.092+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:11:06.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.096+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.096+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.096+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.100+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:11:06.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.104+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.104+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.108+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.108+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:11:06.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.112+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.116+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.116+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.116+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:11:06.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.120+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.124+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.124+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.128+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:11:06.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.132+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.132+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.132+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.136+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:11:06.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.140+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.140+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.140+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.144+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:11:06.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.148+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.148+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.152+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.152+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:11:06.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.156+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.156+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.160+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.160+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:11:06.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.164+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.168+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.168+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.172+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:11:06.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.176+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.176+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.176+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.180+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:11:06.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.184+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.184+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.184+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.188+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:11:06.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.192+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.192+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.192+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.196+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:11:06.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.200+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.200+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.200+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.204+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:11:06.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.208+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.208+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.208+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.212+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:11:06.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.216+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.216+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.220+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.220+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:11:06.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.224+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.228+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.228+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.232+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:11:06.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.236+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.236+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.236+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.240+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:11:06.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.244+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.248+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.248+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.252+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:11:06.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.256+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.260+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.260+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.264+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:11:06.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.268+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.268+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.268+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.272+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:11:06.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.276+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.280+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.280+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.284+0000 7f0931602980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:11:06.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.288+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.288+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.288+0000 7f0931602980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.296+0000 7f07e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:06.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.300+0000 7f0931602980 20 remove_watcher() i=0 2024-04-03T04:11:06.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.300+0000 7f0931602980 2 removed watcher, disabling cache 2024-04-03T04:11:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.304+0000 7f0931602980 20 remove_watcher() i=1 2024-04-03T04:11:06.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.304+0000 7f0931602980 20 remove_watcher() i=2 2024-04-03T04:11:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.308+0000 7f0931602980 20 remove_watcher() i=3 2024-04-03T04:11:06.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.308+0000 7f0931602980 20 remove_watcher() i=4 2024-04-03T04:11:06.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.312+0000 7f0931602980 20 remove_watcher() i=5 2024-04-03T04:11:06.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.312+0000 7f0931602980 20 remove_watcher() i=6 2024-04-03T04:11:06.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.316+0000 7f0931602980 20 remove_watcher() i=7 2024-04-03T04:11:06.311 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:11:06.384 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:11:06.384 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:11:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.452+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 20 realm 2024-04-03T04:11:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:11:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:06.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.456+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.460+0000 7f1488ebb980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:11:06.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.460+0000 7f1488ebb980 20 searching for the correct realm 2024-04-03T04:11:06.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.464+0000 7f14861d5640 0 -- 172.21.15.104:0/611427932 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f1478018040 msgr2=0x7f147805c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:06.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.468+0000 7f14861d5640 0 -- 172.21.15.104:0/611427932 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f14801080c0 msgr2=0x7f14801087d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:06.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.684+0000 7f1488ebb980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:11:06.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.684+0000 7f1488ebb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:11:06.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.684+0000 7f1488ebb980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:11:06.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.684+0000 7f1488ebb980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:11:06.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.684+0000 7f1488ebb980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:11:06.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.684+0000 7f1488ebb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:11:06.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.684+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:06.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:06.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:11:06.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 zone default found 2024-04-03T04:11:06.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 4 Realm: () 2024-04-03T04:11:06.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:11:06.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:11:06.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:11:06.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 zonegroup default 2024-04-03T04:11:06.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:06.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:06.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.688+0000 7f1488ebb980 20 rados->read ofs=0 len=0 2024-04-03T04:11:06.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.692+0000 7f1488ebb980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:06.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.692+0000 7f1488ebb980 20 started sync module instance, tier type = 2024-04-03T04:11:06.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.692+0000 7f1488ebb980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:11:06.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.716+0000 7f1488ebb980 20 add_watcher() i=0 2024-04-03T04:11:06.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.716+0000 7f1488ebb980 20 add_watcher() i=1 2024-04-03T04:11:06.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.716+0000 7f1488ebb980 20 add_watcher() i=2 2024-04-03T04:11:06.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.716+0000 7f1488ebb980 20 add_watcher() i=3 2024-04-03T04:11:06.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.716+0000 7f1488ebb980 20 add_watcher() i=4 2024-04-03T04:11:06.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.716+0000 7f1488ebb980 20 add_watcher() i=5 2024-04-03T04:11:06.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.716+0000 7f1488ebb980 20 add_watcher() i=6 2024-04-03T04:11:06.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.720+0000 7f1488ebb980 20 add_watcher() i=7 2024-04-03T04:11:06.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.720+0000 7f1488ebb980 2 all 8 watchers are set, enabling cache 2024-04-03T04:11:06.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.724+0000 7f133d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:06.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.724+0000 7f1488ebb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:11:06.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.724+0000 7f1488ebb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:11:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.816+0000 7f12b7fff640 20 reqs_thread_entry: start 2024-04-03T04:11:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.816+0000 7f1488ebb980 20 init_complete bucket index max shards: 11 2024-04-03T04:11:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.816+0000 7f1488ebb980 20 Filter name: none 2024-04-03T04:11:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.816+0000 7f12b5ffb640 20 reqs_thread_entry: start 2024-04-03T04:11:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.816+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:11:06.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.820+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.824+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.824+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.828+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:11:06.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.828+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.832+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.832+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.832+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:11:06.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.836+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.836+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.836+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.840+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:11:06.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.844+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.844+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.844+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.848+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:11:06.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.852+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.852+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.856+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.856+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:11:06.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.860+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.860+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.860+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.864+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:11:06.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.864+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.868+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.868+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.872+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:11:06.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.872+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.876+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.876+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.876+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:11:06.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.880+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.884+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.884+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.888+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:11:06.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.888+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.892+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.892+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.896+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:11:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.900+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.900+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.900+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.904+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:11:06.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.908+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.908+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.908+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.912+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:11:06.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.916+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.916+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.916+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.920+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:11:06.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.924+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.928+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.928+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.932+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:11:06.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.936+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.936+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.936+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.940+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:11:06.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.944+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.948+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.948+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.952+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:11:06.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.956+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.956+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.956+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.960+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:11:06.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.964+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.964+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.968+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.968+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:11:06.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.972+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.976+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.976+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.976+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:11:06.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.980+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.984+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.984+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.984+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:11:06.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.988+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.992+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.992+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.992+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:11:06.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:06.996+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.000+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.000+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.004+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:11:06.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.004+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.008+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.008+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.012+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:11:06.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.016+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.016+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:06.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.016+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:06.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.020+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:11:06.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.024+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.024+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.024+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.028+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:11:07.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.032+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.032+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.032+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.036+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:11:07.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.040+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.040+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.040+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.044+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:11:07.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.048+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.048+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.052+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.052+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:11:07.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.056+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.056+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.056+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.060+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:11:07.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.064+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.064+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.068+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.068+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:11:07.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.072+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.076+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.076+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.080+0000 7f1488ebb980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:11:07.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.080+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.084+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.084+0000 7f1488ebb980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.088+0000 7f133d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:07.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.092+0000 7f1488ebb980 20 remove_watcher() i=0 2024-04-03T04:11:07.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.092+0000 7f1488ebb980 2 removed watcher, disabling cache 2024-04-03T04:11:07.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.096+0000 7f1488ebb980 20 remove_watcher() i=1 2024-04-03T04:11:07.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.100+0000 7f1488ebb980 20 remove_watcher() i=2 2024-04-03T04:11:07.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.100+0000 7f1488ebb980 20 remove_watcher() i=3 2024-04-03T04:11:07.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.104+0000 7f1488ebb980 20 remove_watcher() i=4 2024-04-03T04:11:07.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.104+0000 7f1488ebb980 20 remove_watcher() i=5 2024-04-03T04:11:07.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.108+0000 7f1488ebb980 20 remove_watcher() i=6 2024-04-03T04:11:07.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.108+0000 7f1488ebb980 20 remove_watcher() i=7 2024-04-03T04:11:07.104 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:11:07.177 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:11:07.177 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:11:07.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.244+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:07.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 realm 2024-04-03T04:11:07.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:07.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:11:07.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:07.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:07.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:11:07.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.248+0000 7fc928603980 20 searching for the correct realm 2024-04-03T04:11:07.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.256+0000 7fc92611e640 0 -- 172.21.15.104:0/2447560191 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x560006c7f380 msgr2=0x560006c81810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:07.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.260+0000 7fc92691f640 0 -- 172.21.15.104:0/2447560191 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fc920039040 msgr2=0x7fc92002c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:11:07.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.268+0000 7fc928603980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:11:07.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.268+0000 7fc928603980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:11:07.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.268+0000 7fc928603980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:11:07.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.268+0000 7fc928603980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:11:07.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.268+0000 7fc928603980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:11:07.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.268+0000 7fc928603980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:11:07.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.268+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.268+0000 7fc928603980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:07.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.268+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:07.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:11:07.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 zone default found 2024-04-03T04:11:07.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 4 Realm: () 2024-04-03T04:11:07.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:11:07.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:11:07.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:11:07.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 zonegroup default 2024-04-03T04:11:07.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:07.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:07.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 rados->read ofs=0 len=0 2024-04-03T04:11:07.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:07.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 started sync module instance, tier type = 2024-04-03T04:11:07.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.272+0000 7fc928603980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:11:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.288+0000 7fc928603980 20 add_watcher() i=0 2024-04-03T04:11:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.288+0000 7fc928603980 20 add_watcher() i=1 2024-04-03T04:11:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.288+0000 7fc928603980 20 add_watcher() i=2 2024-04-03T04:11:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.288+0000 7fc928603980 20 add_watcher() i=3 2024-04-03T04:11:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.288+0000 7fc928603980 20 add_watcher() i=4 2024-04-03T04:11:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.288+0000 7fc928603980 20 add_watcher() i=5 2024-04-03T04:11:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.288+0000 7fc928603980 20 add_watcher() i=6 2024-04-03T04:11:07.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.288+0000 7fc928603980 20 add_watcher() i=7 2024-04-03T04:11:07.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.288+0000 7fc928603980 2 all 8 watchers are set, enabling cache 2024-04-03T04:11:07.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.292+0000 7fc7dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:07.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.292+0000 7fc928603980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:11:07.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.292+0000 7fc928603980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:11:07.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.368+0000 7fc7d77fe640 20 reqs_thread_entry: start 2024-04-03T04:11:07.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.368+0000 7fc928603980 20 init_complete bucket index max shards: 11 2024-04-03T04:11:07.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.368+0000 7fc928603980 20 Filter name: none 2024-04-03T04:11:07.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.368+0000 7fc7d57fa640 20 reqs_thread_entry: start 2024-04-03T04:11:07.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.368+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:11:07.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.372+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.376+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.376+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.380+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:11:07.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.380+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.380+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.380+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.384+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:11:07.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.384+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.388+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.388+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.388+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:11:07.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.392+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.392+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.392+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.396+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:11:07.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.396+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.400+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.400+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.400+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:11:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.404+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.404+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.404+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.404+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:11:07.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.408+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.412+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.412+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.416+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:11:07.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.420+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.420+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.420+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.420+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:11:07.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.424+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.428+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.428+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.432+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:11:07.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.432+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.432+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.432+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.436+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:11:07.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.436+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.440+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.440+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.440+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:11:07.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.444+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.444+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.444+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.448+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:11:07.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.452+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.452+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.452+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.452+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:11:07.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.456+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.456+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.456+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.460+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:11:07.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.464+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.464+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.464+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.468+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:11:07.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.468+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.472+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.472+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.476+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:11:07.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.480+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.480+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.480+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.480+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:11:07.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.484+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.488+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.488+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.492+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:11:07.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.492+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.496+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.496+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.496+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:11:07.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.500+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.504+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.504+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.504+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:11:07.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.512+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.512+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.516+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.516+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:11:07.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.520+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.524+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.524+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.528+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:11:07.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.532+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.532+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.532+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.536+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:11:07.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.540+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.544+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.544+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.548+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:11:07.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.548+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.552+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.552+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.556+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:11:07.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.560+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.560+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.560+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.564+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:11:07.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.568+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.568+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.568+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.572+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:11:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.576+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.580+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.580+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.580+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:11:07.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.584+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.588+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.588+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.592+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:11:07.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.592+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.596+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.596+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.600+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:11:07.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.604+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.604+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.604+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.608+0000 7fc928603980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:11:07.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.612+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.612+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:07.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.616+0000 7fc928603980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:07.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.620+0000 7fc7dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:07.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.624+0000 7fc928603980 20 remove_watcher() i=0 2024-04-03T04:11:07.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.624+0000 7fc928603980 2 removed watcher, disabling cache 2024-04-03T04:11:07.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.628+0000 7fc928603980 20 remove_watcher() i=1 2024-04-03T04:11:07.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.628+0000 7fc928603980 20 remove_watcher() i=2 2024-04-03T04:11:07.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.632+0000 7fc928603980 20 remove_watcher() i=3 2024-04-03T04:11:07.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.636+0000 7fc928603980 20 remove_watcher() i=4 2024-04-03T04:11:07.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.636+0000 7fc928603980 20 remove_watcher() i=5 2024-04-03T04:11:07.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.640+0000 7fc928603980 20 remove_watcher() i=6 2024-04-03T04:11:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:07.640+0000 7fc928603980 20 remove_watcher() i=7 2024-04-03T04:11:07.638 DEBUG:teuthology.orchestra.run.smithi104:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-04-03T04:11:08.337 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :clean 2024-04-03T04:11:09.132 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :compileJava 2024-04-03T04:11:09.132 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :processResources 2024-04-03T04:11:09.132 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :classes 2024-04-03T04:11:09.632 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:09.632 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :compileTestJava 2024-04-03T04:11:09.633 INFO:teuthology.orchestra.run.smithi104.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-04-03T04:11:09.633 INFO:teuthology.orchestra.run.smithi104.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-04-03T04:11:09.633 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:09.633 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :processTestResources NO-SOURCE 2024-04-03T04:11:09.634 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :testClasses 2024-04-03T04:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :test 2024-04-03T04:11:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:11.633 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests STANDARD_OUT 2024-04-03T04:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03 04:11:10,922 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-04-03T04:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-04-03T04:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:11.634 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-04-03T04:11:12.032 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:12.032 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-04-03T04:11:12.132 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:12.132 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-04-03T04:11:12.832 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:12.832 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-04-03T04:11:12.932 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:12.932 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-04-03T04:11:13.632 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:13.632 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-04-03T04:11:14.132 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:14.132 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-04-03T04:11:14.332 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:14.332 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-04-03T04:11:14.633 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:14.633 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-04-03T04:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:15.432 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-04-03T04:11:15.532 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:15.532 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-04-03T04:11:15.632 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:15.632 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-04-03T04:11:16.032 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:16.032 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-04-03T04:11:17.332 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:17.332 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-04-03T04:11:17.532 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:17.532 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-04-03T04:11:18.232 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:18.232 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-04-03T04:11:18.332 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:18.332 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-04-03T04:11:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:18.518 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------- 2024-04-03T04:11:18.518 INFO:teuthology.orchestra.run.smithi104.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-04-03T04:11:18.518 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------- 2024-04-03T04:11:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:18.518 INFO:teuthology.orchestra.run.smithi104.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-04-03T04:11:18.518 INFO:teuthology.orchestra.run.smithi104.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-04-03T04:11:18.518 INFO:teuthology.orchestra.run.smithi104.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-04-03T04:11:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:18.519 INFO:teuthology.orchestra.run.smithi104.stdout:BUILD SUCCESSFUL in 10s 2024-04-03T04:11:18.519 INFO:teuthology.orchestra.run.smithi104.stdout:5 actionable tasks: 5 executed 2024-04-03T04:11:18.526 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:11:18.555 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:11:18.555 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:11:18.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.620+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:18.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 20 realm 2024-04-03T04:11:18.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:18.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:11:18.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:18.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:18.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.624+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.628+0000 7f59f0bcc980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:11:18.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.628+0000 7f59f0bcc980 20 searching for the correct realm 2024-04-03T04:11:18.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.632+0000 7f59ee6e7640 0 -- 172.21.15.104:0/443237222 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x55be9522d8f0 msgr2=0x55be9522fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:11:18.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.640+0000 7f59edee6640 0 -- 172.21.15.104:0/443237222 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f59e8066940 msgr2=0x7f59e805eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:18.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:11:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:11:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:11:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:11:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:11:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:11:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:18.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:11:18.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 zone default found 2024-04-03T04:11:18.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 4 Realm: () 2024-04-03T04:11:18.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:11:18.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:11:18.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:11:18.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 zonegroup default 2024-04-03T04:11:18.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:18.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:18.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados->read ofs=0 len=0 2024-04-03T04:11:18.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:18.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 started sync module instance, tier type = 2024-04-03T04:11:18.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.648+0000 7f59f0bcc980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:11:18.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.668+0000 7f59f0bcc980 20 add_watcher() i=0 2024-04-03T04:11:18.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.668+0000 7f59f0bcc980 20 add_watcher() i=1 2024-04-03T04:11:18.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.668+0000 7f59f0bcc980 20 add_watcher() i=2 2024-04-03T04:11:18.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.668+0000 7f59f0bcc980 20 add_watcher() i=3 2024-04-03T04:11:18.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.668+0000 7f59f0bcc980 20 add_watcher() i=4 2024-04-03T04:11:18.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.668+0000 7f59f0bcc980 20 add_watcher() i=5 2024-04-03T04:11:18.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.668+0000 7f59f0bcc980 20 add_watcher() i=6 2024-04-03T04:11:18.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.668+0000 7f59f0bcc980 20 add_watcher() i=7 2024-04-03T04:11:18.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.668+0000 7f59f0bcc980 2 all 8 watchers are set, enabling cache 2024-04-03T04:11:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.672+0000 7f58a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.672+0000 7f59f0bcc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:11:18.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.672+0000 7f59f0bcc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:11:18.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.740+0000 7f581f7fe640 20 reqs_thread_entry: start 2024-04-03T04:11:18.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.740+0000 7f59f0bcc980 20 init_complete bucket index max shards: 11 2024-04-03T04:11:18.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.740+0000 7f59f0bcc980 20 Filter name: none 2024-04-03T04:11:18.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.740+0000 7f581d7fa640 20 reqs_thread_entry: start 2024-04-03T04:11:18.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.740+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:11:18.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.744+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.744+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.744+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.748+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:11:18.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.752+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.752+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.752+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.756+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:11:18.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.760+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.760+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.760+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.760+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:11:18.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.764+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.764+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.764+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.768+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:11:18.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.768+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.768+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.772+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.772+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:11:18.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.772+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.772+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.772+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.776+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:11:18.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.776+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.780+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.780+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.784+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:11:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.784+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.784+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.784+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.784+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:11:18.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.788+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.788+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.788+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.792+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:11:18.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.796+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.796+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.796+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.796+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:11:18.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.800+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.804+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.804+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:18.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.804+0000 7f59f0bcc980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10168201978607969772', time=2024-04-03T06:11:16.282545+0000, chain.objs.size()=1 2024-04-03T04:11:18.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.804+0000 7f59f0bcc980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.61__shadow_.8-qHR4odJ8Kb5cciIeSQZ3ao210S3iM_0 2024-04-03T04:11:18.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.808+0000 7f59f0bcc980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:18.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.812+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:11:18.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.816+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.816+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.816+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.820+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:11:18.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.824+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.824+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.824+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.828+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:11:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.832+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.832+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.832+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.836+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:11:18.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.836+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.840+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.840+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.844+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:11:18.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.848+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.848+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.848+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.852+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:11:18.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.856+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.856+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.856+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.860+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:11:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.868+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.868+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.868+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.872+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:11:18.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.876+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.876+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.876+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.880+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:11:18.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.884+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.884+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.884+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.884+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:11:18.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.888+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.892+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.892+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.896+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:11:18.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.900+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.900+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.900+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.904+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:11:18.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.908+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.908+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.908+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.912+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:11:18.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.916+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.916+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.916+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:11:18.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.916+0000 7f59f0bcc980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4147848475748294040', time=2024-04-03T06:11:14.870304+0000, chain.objs.size()=1 2024-04-03T04:11:18.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.916+0000 7f59f0bcc980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.60__shadow_.IS8Box9IpLHNvucqHUGizBzrTvWuJXw_0 2024-04-03T04:11:18.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.920+0000 7f59f0bcc980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:11:18.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.928+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:11:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.928+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.932+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.932+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.932+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:11:18.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.940+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.940+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.940+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.944+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:11:18.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.948+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.948+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.948+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.952+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:11:18.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.956+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.956+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.960+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.960+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:11:18.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.964+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.964+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.968+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.968+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:11:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.972+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.976+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.976+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.980+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:11:18.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.980+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.984+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.984+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.988+0000 7f59f0bcc980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:11:18.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.992+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.992+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:18.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:18.992+0000 7f59f0bcc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:18.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.000+0000 7f58a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:18.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.004+0000 7f59f0bcc980 20 remove_watcher() i=0 2024-04-03T04:11:18.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.004+0000 7f59f0bcc980 2 removed watcher, disabling cache 2024-04-03T04:11:18.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.008+0000 7f59f0bcc980 20 remove_watcher() i=1 2024-04-03T04:11:18.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.012+0000 7f59f0bcc980 20 remove_watcher() i=2 2024-04-03T04:11:18.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.016+0000 7f59f0bcc980 20 remove_watcher() i=3 2024-04-03T04:11:18.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.016+0000 7f59f0bcc980 20 remove_watcher() i=4 2024-04-03T04:11:18.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.020+0000 7f59f0bcc980 20 remove_watcher() i=5 2024-04-03T04:11:18.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.020+0000 7f59f0bcc980 20 remove_watcher() i=6 2024-04-03T04:11:18.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.024+0000 7f59f0bcc980 20 remove_watcher() i=7 2024-04-03T04:11:19.023 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:11:19.097 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:11:19.097 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:11:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.364+0000 7f09e2222640 0 --2- 172.21.15.104:0/3616880795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5562d77d0b40 0x5562d77ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-04-03T04:11:19.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.372+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.372+0000 7f09e4707980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:19.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.372+0000 7f09e4707980 20 realm 2024-04-03T04:11:19.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.372+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.372+0000 7f09e4707980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:19.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.372+0000 7f09e4707980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:11:19.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.372+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.372+0000 7f09e4707980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:19.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.372+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.376+0000 7f09e4707980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:19.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.376+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.376+0000 7f09e4707980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:11:19.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.376+0000 7f09e4707980 20 searching for the correct realm 2024-04-03T04:11:19.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.380+0000 7f09e1a21640 0 -- 172.21.15.104:0/1594590429 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f09dc0872d0 msgr2=0x7f09dc055610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:19.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.596+0000 7f09e2a23640 0 -- 172.21.15.104:0/1594590429 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x5562d7820450 msgr2=0x5562d7822860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:19.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:11:19.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:11:19.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:11:19.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:11:19.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:11:19.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:11:19.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:19.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:19.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.612+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:11:19.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 zone default found 2024-04-03T04:11:19.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 4 Realm: () 2024-04-03T04:11:19.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:11:19.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:11:19.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:11:19.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 zonegroup default 2024-04-03T04:11:19.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:19.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:19.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 rados->read ofs=0 len=0 2024-04-03T04:11:19.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:19.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 started sync module instance, tier type = 2024-04-03T04:11:19.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.616+0000 7f09e4707980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:11:19.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.640+0000 7f09e4707980 20 add_watcher() i=0 2024-04-03T04:11:19.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.640+0000 7f09e4707980 20 add_watcher() i=1 2024-04-03T04:11:19.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.640+0000 7f09e4707980 20 add_watcher() i=2 2024-04-03T04:11:19.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.640+0000 7f09e4707980 20 add_watcher() i=3 2024-04-03T04:11:19.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.640+0000 7f09e4707980 20 add_watcher() i=4 2024-04-03T04:11:19.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.640+0000 7f09e4707980 20 add_watcher() i=5 2024-04-03T04:11:19.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.640+0000 7f09e4707980 20 add_watcher() i=6 2024-04-03T04:11:19.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.644+0000 7f09e4707980 20 add_watcher() i=7 2024-04-03T04:11:19.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.644+0000 7f09e4707980 2 all 8 watchers are set, enabling cache 2024-04-03T04:11:19.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.648+0000 7f08997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:19.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.648+0000 7f09e4707980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:11:19.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.648+0000 7f09e4707980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:11:19.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.740+0000 7f08937fe640 20 reqs_thread_entry: start 2024-04-03T04:11:19.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.740+0000 7f09e4707980 20 init_complete bucket index max shards: 11 2024-04-03T04:11:19.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.740+0000 7f09e4707980 20 Filter name: none 2024-04-03T04:11:19.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.740+0000 7f08917fa640 20 reqs_thread_entry: start 2024-04-03T04:11:19.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.740+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:11:19.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.744+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.748+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.748+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.748+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:11:19.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.752+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.752+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.752+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.756+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:11:19.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.756+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.760+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.760+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.764+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:11:19.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.764+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.764+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.764+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.768+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:11:19.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.772+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.772+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.772+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.776+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:11:19.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.776+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.780+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.780+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.780+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:11:19.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.784+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.788+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.788+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.788+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:11:19.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.792+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.796+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.796+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.796+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:11:19.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.800+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.804+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.804+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.804+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:11:19.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.808+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.808+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.808+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.812+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:11:19.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.816+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.816+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.816+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.820+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:11:19.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.824+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.824+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.824+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.828+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:11:19.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.832+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.832+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.836+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.836+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:11:19.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.840+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.840+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.844+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.844+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:11:19.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.848+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.852+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.852+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.856+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:11:19.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.856+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.860+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.860+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.860+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:11:19.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.864+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.864+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.868+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.868+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:11:19.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.872+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.876+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.876+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.880+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:11:19.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.884+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.884+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.884+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.888+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:11:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.892+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.892+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.892+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.896+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:11:19.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.900+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.900+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.904+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.904+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:11:19.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.908+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.912+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.912+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.916+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:11:19.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.916+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.920+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.920+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.924+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:11:19.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.928+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.928+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.928+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.932+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:11:19.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.936+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.940+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.940+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.940+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:11:19.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.944+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.948+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.948+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.948+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:11:19.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.952+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.956+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.956+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.960+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:11:19.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.960+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.964+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.964+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.968+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:11:19.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.972+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.972+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.972+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.976+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:11:19.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.980+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.980+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.984+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.984+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:11:19.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.988+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.992+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.992+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:19.996+0000 7f09e4707980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:11:19.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.000+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.000+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:19.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.000+0000 7f09e4707980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:19.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.008+0000 7f08997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:19.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.012+0000 7f09e4707980 20 remove_watcher() i=0 2024-04-03T04:11:19.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.012+0000 7f09e4707980 2 removed watcher, disabling cache 2024-04-03T04:11:19.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.012+0000 7f09e4707980 20 remove_watcher() i=1 2024-04-03T04:11:19.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.016+0000 7f09e4707980 20 remove_watcher() i=2 2024-04-03T04:11:19.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.020+0000 7f09e4707980 20 remove_watcher() i=3 2024-04-03T04:11:19.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.024+0000 7f09e4707980 20 remove_watcher() i=4 2024-04-03T04:11:20.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.024+0000 7f09e4707980 20 remove_watcher() i=5 2024-04-03T04:11:20.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.024+0000 7f09e4707980 20 remove_watcher() i=6 2024-04-03T04:11:20.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.028+0000 7f09e4707980 20 remove_watcher() i=7 2024-04-03T04:11:20.023 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:11:20.096 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:11:20.096 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:11:20.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.164+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 realm 2024-04-03T04:11:20.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:11:20.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:20.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:11:20.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.168+0000 7f91147da980 20 searching for the correct realm 2024-04-03T04:11:20.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.176+0000 7f9112af6640 0 -- 172.21.15.104:0/1043839072 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f910c05d650 msgr2=0x7f910c05c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:20.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.180+0000 7f9111af4640 0 -- 172.21.15.104:0/1043839072 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f910c06e040 msgr2=0x7f910c006950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:11:20.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.396+0000 7f91147da980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:11:20.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.396+0000 7f91147da980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:11:20.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.396+0000 7f91147da980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:11:20.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.396+0000 7f91147da980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:11:20.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.396+0000 7f91147da980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:11:20.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.396+0000 7f91147da980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:11:20.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.396+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.396+0000 7f91147da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.396+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:20.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:11:20.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 zone default found 2024-04-03T04:11:20.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 4 Realm: () 2024-04-03T04:11:20.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:11:20.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:11:20.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:11:20.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 zonegroup default 2024-04-03T04:11:20.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 started sync module instance, tier type = 2024-04-03T04:11:20.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.400+0000 7f91147da980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:11:20.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.424+0000 7f91147da980 20 add_watcher() i=0 2024-04-03T04:11:20.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.424+0000 7f91147da980 20 add_watcher() i=1 2024-04-03T04:11:20.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.424+0000 7f91147da980 20 add_watcher() i=2 2024-04-03T04:11:20.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.424+0000 7f91147da980 20 add_watcher() i=3 2024-04-03T04:11:20.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.424+0000 7f91147da980 20 add_watcher() i=4 2024-04-03T04:11:20.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.424+0000 7f91147da980 20 add_watcher() i=5 2024-04-03T04:11:20.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.424+0000 7f91147da980 20 add_watcher() i=6 2024-04-03T04:11:20.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.424+0000 7f91147da980 20 add_watcher() i=7 2024-04-03T04:11:20.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.424+0000 7f91147da980 2 all 8 watchers are set, enabling cache 2024-04-03T04:11:20.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.428+0000 7f8fc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:20.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.428+0000 7f91147da980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:11:20.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.428+0000 7f91147da980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:11:20.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.520+0000 7f8f437fe640 20 reqs_thread_entry: start 2024-04-03T04:11:20.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.520+0000 7f91147da980 20 init_complete bucket index max shards: 11 2024-04-03T04:11:20.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.520+0000 7f91147da980 20 Filter name: none 2024-04-03T04:11:20.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.520+0000 7f8f417fa640 20 reqs_thread_entry: start 2024-04-03T04:11:20.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.520+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:11:20.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.524+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.524+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.524+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.524+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:11:20.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.528+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.528+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.528+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.532+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:11:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.536+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.536+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.536+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.540+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:11:20.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.540+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.544+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.544+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.548+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:11:20.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.548+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.548+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.552+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.552+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:11:20.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.556+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.556+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.556+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.560+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:11:20.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.564+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.564+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.564+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.564+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:11:20.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.568+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.568+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.568+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.572+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:11:20.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.576+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.576+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.580+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.580+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:11:20.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.584+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.584+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.584+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.588+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:11:20.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.592+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.592+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.592+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.596+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:11:20.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.600+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.600+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.600+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.600+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:11:20.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.604+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.608+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.608+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.608+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:11:20.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.612+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.616+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.616+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.616+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:11:20.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.624+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.628+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.628+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.632+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:11:20.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.636+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.636+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.636+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.640+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:11:20.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.644+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.644+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.648+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.648+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:11:20.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.652+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.656+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.656+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.660+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:11:20.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.664+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.664+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.664+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.668+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:11:20.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.672+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.672+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.672+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.676+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:11:20.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.680+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.680+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.684+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.684+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:11:20.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.688+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.688+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.688+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.692+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:11:20.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.692+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.696+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.696+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.700+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:11:20.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.700+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.704+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.704+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.708+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:11:20.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.712+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.712+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.712+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.716+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:11:20.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.720+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.720+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.724+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.724+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:11:20.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.728+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.732+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.732+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.736+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:11:20.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.736+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.740+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.740+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.740+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:11:20.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.744+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.748+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.748+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.752+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:11:20.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.756+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.756+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.756+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.760+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:11:20.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.764+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.764+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.764+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.768+0000 7f91147da980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:11:20.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.772+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.772+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:20.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.772+0000 7f91147da980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:20.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.776+0000 7f8fc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:20.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.780+0000 7f91147da980 20 remove_watcher() i=0 2024-04-03T04:11:20.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.780+0000 7f91147da980 2 removed watcher, disabling cache 2024-04-03T04:11:20.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.784+0000 7f91147da980 20 remove_watcher() i=1 2024-04-03T04:11:20.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.788+0000 7f91147da980 20 remove_watcher() i=2 2024-04-03T04:11:20.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.788+0000 7f91147da980 20 remove_watcher() i=3 2024-04-03T04:11:20.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.792+0000 7f91147da980 20 remove_watcher() i=4 2024-04-03T04:11:20.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.792+0000 7f91147da980 20 remove_watcher() i=5 2024-04-03T04:11:20.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.792+0000 7f91147da980 20 remove_watcher() i=6 2024-04-03T04:11:20.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.796+0000 7f91147da980 20 remove_watcher() i=7 2024-04-03T04:11:20.789 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:11:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:11:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:11:20.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.928+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 realm 2024-04-03T04:11:20.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:11:20.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:20.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:11:20.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.932+0000 7f076ccea980 20 searching for the correct realm 2024-04-03T04:11:20.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.940+0000 7f076a805640 0 -- 172.21.15.104:0/1039143879 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x56175db3cce0 msgr2=0x56175db3f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:20.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.944+0000 7f076a004640 0 -- 172.21.15.104:0/1039143879 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f076403a730 msgr2=0x7f076407b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:11:20.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:11:20.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:11:20.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:11:20.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:11:20.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:11:20.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:11:20.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.952+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 zone default found 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 4 Realm: () 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 zonegroup default 2024-04-03T04:11:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 rados->read ofs=0 len=0 2024-04-03T04:11:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:11:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 started sync module instance, tier type = 2024-04-03T04:11:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.956+0000 7f076ccea980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:11:20.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.972+0000 7f076ccea980 20 add_watcher() i=0 2024-04-03T04:11:20.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.972+0000 7f076ccea980 20 add_watcher() i=1 2024-04-03T04:11:20.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.972+0000 7f076ccea980 20 add_watcher() i=2 2024-04-03T04:11:20.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.972+0000 7f076ccea980 20 add_watcher() i=3 2024-04-03T04:11:20.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.972+0000 7f076ccea980 20 add_watcher() i=4 2024-04-03T04:11:20.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.972+0000 7f076ccea980 20 add_watcher() i=5 2024-04-03T04:11:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.972+0000 7f076ccea980 20 add_watcher() i=6 2024-04-03T04:11:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.972+0000 7f076ccea980 20 add_watcher() i=7 2024-04-03T04:11:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.972+0000 7f076ccea980 2 all 8 watchers are set, enabling cache 2024-04-03T04:11:20.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.976+0000 7f0621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:20.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.976+0000 7f076ccea980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:11:20.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:20.976+0000 7f076ccea980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:11:21.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.044+0000 7f0620fe1640 20 reqs_thread_entry: start 2024-04-03T04:11:21.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.044+0000 7f076ccea980 20 init_complete bucket index max shards: 11 2024-04-03T04:11:21.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.044+0000 7f076ccea980 20 Filter name: none 2024-04-03T04:11:21.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.044+0000 7f0619ffb640 20 reqs_thread_entry: start 2024-04-03T04:11:21.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.044+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:11:21.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.048+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.048+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.052+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.052+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:11:21.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.056+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.060+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.060+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.064+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:11:21.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.068+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.068+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.068+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.072+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:11:21.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.072+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.072+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.076+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.076+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:11:21.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.080+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.080+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.080+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.084+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:11:21.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.084+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.088+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.088+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.088+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:11:21.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.092+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.092+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.092+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.096+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:11:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.096+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.100+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.100+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.100+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:11:21.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.104+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.108+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.108+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.112+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:11:21.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.112+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.116+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.116+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.116+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:11:21.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.120+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.120+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.124+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.124+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:11:21.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.128+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.128+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.128+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.132+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:11:21.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.136+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.136+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.136+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.140+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:11:21.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.144+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.144+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.144+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.148+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:11:21.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.152+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.152+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.156+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.156+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:11:21.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.160+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.160+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.164+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.164+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:11:21.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.168+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.168+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.168+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.172+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:11:21.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.172+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.176+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.176+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.180+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:11:21.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.180+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.184+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.184+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.188+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:11:21.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.192+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.192+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.192+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.196+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:11:21.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.200+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.200+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.200+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.200+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:11:21.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.204+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.208+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.208+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.212+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:11:21.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.212+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.216+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.216+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.216+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:11:21.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.220+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.220+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.224+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.224+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:11:21.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.228+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.228+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.232+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.232+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:11:21.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.236+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.236+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.236+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.240+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:11:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.240+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.244+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.244+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.244+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:11:21.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.248+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.248+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.252+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.252+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:11:21.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.256+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.260+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.260+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.264+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:11:21.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.264+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.264+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.268+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.268+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:11:21.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.272+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.272+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.272+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.276+0000 7f076ccea980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:11:21.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.280+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.280+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:11:21.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.280+0000 7f076ccea980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:11:21.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.284+0000 7f0621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:11:21.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.292+0000 7f076ccea980 20 remove_watcher() i=0 2024-04-03T04:11:21.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.292+0000 7f076ccea980 2 removed watcher, disabling cache 2024-04-03T04:11:21.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.292+0000 7f076ccea980 20 remove_watcher() i=1 2024-04-03T04:11:21.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.296+0000 7f076ccea980 20 remove_watcher() i=2 2024-04-03T04:11:21.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.296+0000 7f076ccea980 20 remove_watcher() i=3 2024-04-03T04:11:21.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.300+0000 7f076ccea980 20 remove_watcher() i=4 2024-04-03T04:11:21.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.304+0000 7f076ccea980 20 remove_watcher() i=5 2024-04-03T04:11:21.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.304+0000 7f076ccea980 20 remove_watcher() i=6 2024-04-03T04:11:21.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:11:21.308+0000 7f076ccea980 20 remove_watcher() i=7 2024-04-03T04:11:21.300 DEBUG:teuthology.orchestra.run.smithi104:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-04-03T04:11:21.976 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :clean 2024-04-03T04:11:22.574 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :compileJava 2024-04-03T04:11:22.574 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :processResources 2024-04-03T04:11:22.574 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :classes 2024-04-03T04:11:23.174 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:23.174 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :compileTestJava 2024-04-03T04:11:23.175 INFO:teuthology.orchestra.run.smithi104.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-04-03T04:11:23.175 INFO:teuthology.orchestra.run.smithi104.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-04-03T04:11:23.175 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:23.176 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :processTestResources NO-SOURCE 2024-04-03T04:11:23.176 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :testClasses 2024-04-03T04:11:25.174 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:25.175 INFO:teuthology.orchestra.run.smithi104.stdout:> Task :test 2024-04-03T04:11:25.175 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:25.175 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests STANDARD_OUT 2024-04-03T04:11:25.175 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03 04:11:24,618 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-04-03T04:11:25.175 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:25.175 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-04-03T04:11:25.175 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:25.175 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-04-03T04:11:26.474 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:26.474 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-04-03T04:11:26.674 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:26.674 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-04-03T04:11:27.374 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:27.374 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-04-03T04:11:27.573 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:27.575 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-04-03T04:11:28.274 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:28.274 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-04-03T04:11:49.574 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:49.575 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-04-03T04:11:50.173 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:50.174 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-04-03T04:11:50.373 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:50.374 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-04-03T04:11:51.073 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:51.074 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-04-03T04:11:51.474 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:51.474 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-04-03T04:11:52.274 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:52.274 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-04-03T04:11:52.274 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:52.274 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-04-03T04:11:52.473 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:52.474 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-04-03T04:11:52.573 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:52.574 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-04-03T04:11:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:11:53.273 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-04-03T04:12:02.473 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:02.474 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-04-03T04:12:03.173 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:03.173 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-04-03T04:12:03.473 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:03.474 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-04-03T04:12:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:04.273 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-04-03T04:12:04.573 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:04.574 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-04-03T04:12:05.373 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:05.373 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-04-03T04:12:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:05.574 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-04-03T04:12:06.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:06.273 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-04-03T04:12:06.373 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:06.373 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-04-03T04:12:07.073 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:07.073 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-04-03T04:12:07.373 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:07.373 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-04-03T04:12:08.073 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:08.073 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-04-03T04:12:08.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:08.273 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-04-03T04:12:08.974 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:08.974 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-04-03T04:12:09.373 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:09.374 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-04-03T04:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:09.973 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-04-03T04:12:22.874 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:22.874 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-04-03T04:12:24.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:12:24.273 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-04-03T04:13:14.574 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:14.575 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-04-03T04:13:15.873 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:15.873 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-04-03T04:13:16.073 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:16.073 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-04-03T04:13:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:16.673 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-04-03T04:13:16.973 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:16.973 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-04-03T04:13:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:18.074 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-04-03T04:13:40.173 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:40.173 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-04-03T04:13:40.873 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:40.873 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-04-03T04:13:40.973 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:40.973 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-04-03T04:13:41.073 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:41.073 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-04-03T04:13:58.373 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:13:58.373 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-04-03T04:14:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:14:03.273 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests STANDARD_OUT 2024-04-03T04:14:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03 04:14:03,201 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-04-03T04:14:03.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03 04:14:03,205 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-04-03T04:14:03.274 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03 04:14:03,262 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-04-03T04:14:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:14:04.472 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-04-03T04:14:35.772 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:14:35.773 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-04-03T04:14:36.772 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:14:36.773 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-04-03T04:14:57.472 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:14:57.473 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-04-03T04:14:58.172 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:14:58.172 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-04-03T04:16:21.272 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:16:21.272 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-04-03T04:16:21.971 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:16:21.972 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-04-03T04:16:47.672 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:16:47.672 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-04-03T04:16:48.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:16:48.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-04-03T04:17:10.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:10.072 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-04-03T04:17:10.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:10.772 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-04-03T04:17:14.971 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:14.972 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-04-03T04:17:27.171 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:27.171 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-04-03T04:17:27.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:27.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-04-03T04:17:27.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:27.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-04-03T04:17:28.471 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:28.471 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-04-03T04:17:33.471 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:33.472 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-04-03T04:17:33.571 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:33.571 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-04-03T04:17:34.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:34.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-04-03T04:17:34.471 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:34.471 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-04-03T04:17:35.171 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:35.171 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-04-03T04:17:35.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:35.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-04-03T04:17:36.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:36.071 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-04-03T04:17:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:36.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-04-03T04:17:36.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:36.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-04-03T04:17:37.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:37.071 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-04-03T04:17:37.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:37.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-04-03T04:17:38.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:38.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-04-03T04:17:39.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:39.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-04-03T04:17:39.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:39.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-04-03T04:17:40.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:40.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-04-03T04:17:41.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:41.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-04-03T04:17:42.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:42.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-04-03T04:17:42.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:42.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-04-03T04:17:43.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:43.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-04-03T04:17:44.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:44.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-04-03T04:17:45.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:45.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-04-03T04:17:45.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:45.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-04-03T04:17:46.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:46.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-04-03T04:17:47.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:47.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-04-03T04:17:48.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:48.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-04-03T04:17:48.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:48.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-04-03T04:17:49.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:49.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-04-03T04:17:50.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:50.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-04-03T04:17:51.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:51.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-04-03T04:17:51.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:51.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-04-03T04:17:52.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:52.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-04-03T04:17:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:53.273 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-04-03T04:17:54.171 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:54.171 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-04-03T04:17:54.671 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:54.671 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-04-03T04:17:55.571 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:55.571 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-04-03T04:17:56.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:56.071 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-04-03T04:17:56.971 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:56.971 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-04-03T04:17:57.471 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:57.471 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-04-03T04:17:58.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:58.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-04-03T04:17:58.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:58.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-04-03T04:17:59.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:17:59.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-04-03T04:18:00.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:00.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-04-03T04:18:01.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:01.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-04-03T04:18:01.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:01.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-04-03T04:18:02.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:02.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-04-03T04:18:03.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:03.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-04-03T04:18:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:04.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-04-03T04:18:04.671 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:04.671 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-04-03T04:18:05.671 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:05.671 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-04-03T04:18:06.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:06.071 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-04-03T04:18:06.971 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:06.971 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-04-03T04:18:07.471 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:07.471 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-04-03T04:18:08.270 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:08.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-04-03T04:18:08.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:08.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-04-03T04:18:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:09.671 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-04-03T04:18:09.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:09.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-04-03T04:18:10.571 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:10.571 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-04-03T04:18:10.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:10.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-04-03T04:18:11.471 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:11.471 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-04-03T04:18:11.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:11.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-04-03T04:18:12.570 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:12.571 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-04-03T04:18:12.770 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:12.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-04-03T04:18:13.571 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:13.571 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-04-03T04:18:14.170 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:14.171 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-04-03T04:18:14.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:14.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-04-03T04:18:14.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:14.871 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-04-03T04:18:15.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:15.071 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-04-03T04:18:15.370 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:15.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-04-03T04:18:16.070 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:16.071 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-04-03T04:18:16.370 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:16.371 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-04-03T04:18:17.171 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:17.171 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-04-03T04:18:17.471 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:17.471 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-04-03T04:18:18.070 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:18.071 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-04-03T04:18:18.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:18.271 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-04-03T04:18:18.971 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:18.971 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-04-03T04:18:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:31.771 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-04-03T04:18:32.470 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:32.470 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-04-03T04:18:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:46.171 INFO:teuthology.orchestra.run.smithi104.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-04-03T04:18:46.970 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:46.970 INFO:teuthology.orchestra.run.smithi104.stdout:---------------------------------------------------------------------- 2024-04-03T04:18:46.970 INFO:teuthology.orchestra.run.smithi104.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-04-03T04:18:46.971 INFO:teuthology.orchestra.run.smithi104.stdout:---------------------------------------------------------------------- 2024-04-03T04:18:46.983 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:46.983 INFO:teuthology.orchestra.run.smithi104.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-04-03T04:18:46.983 INFO:teuthology.orchestra.run.smithi104.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-04-03T04:18:46.983 INFO:teuthology.orchestra.run.smithi104.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-04-03T04:18:46.983 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:46.983 INFO:teuthology.orchestra.run.smithi104.stdout:BUILD SUCCESSFUL in 7m 25s 2024-04-03T04:18:46.983 INFO:teuthology.orchestra.run.smithi104.stdout:5 actionable tasks: 5 executed 2024-04-03T04:18:46.992 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:18:47.018 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:47.018 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:47.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.087+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:47.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 realm 2024-04-03T04:18:47.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:47.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:47.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:47.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:47.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.091+0000 7f6d9c1e6980 20 searching for the correct realm 2024-04-03T04:18:47.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.099+0000 7f6d99500640 0 -- 172.21.15.104:0/3288262907 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f6d8c0c3c20 msgr2=0x7f6d8c0d4950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:47.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.103+0000 7f6d99500640 0 -- 172.21.15.104:0/3288262907 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f6d94054bc0 msgr2=0x7f6d94084250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:18:47.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.319+0000 7f6d9c1e6980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:47.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.319+0000 7f6d9c1e6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:47.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.319+0000 7f6d9c1e6980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:47.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.319+0000 7f6d9c1e6980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:47.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.319+0000 7f6d9c1e6980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:47.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.319+0000 7f6d9c1e6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:47.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.319+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.319+0000 7f6d9c1e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:47.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.319+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:47.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 zone default found 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 4 Realm: () 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 zonegroup default 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:47.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:47.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 rados->read ofs=0 len=0 2024-04-03T04:18:47.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:47.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 started sync module instance, tier type = 2024-04-03T04:18:47.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.323+0000 7f6d9c1e6980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:47.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.347+0000 7f6d9c1e6980 20 add_watcher() i=0 2024-04-03T04:18:47.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.347+0000 7f6d9c1e6980 20 add_watcher() i=1 2024-04-03T04:18:47.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.347+0000 7f6d9c1e6980 20 add_watcher() i=2 2024-04-03T04:18:47.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.351+0000 7f6d9c1e6980 20 add_watcher() i=3 2024-04-03T04:18:47.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.351+0000 7f6d9c1e6980 20 add_watcher() i=4 2024-04-03T04:18:47.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.351+0000 7f6d9c1e6980 20 add_watcher() i=5 2024-04-03T04:18:47.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.351+0000 7f6d9c1e6980 20 add_watcher() i=6 2024-04-03T04:18:47.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.351+0000 7f6d9c1e6980 20 add_watcher() i=7 2024-04-03T04:18:47.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.351+0000 7f6d9c1e6980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:47.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.355+0000 7f6c4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:47.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.355+0000 7f6d9c1e6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:47.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.355+0000 7f6d9c1e6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:47.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.447+0000 7f6c4a7fc640 20 reqs_thread_entry: start 2024-04-03T04:18:47.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.447+0000 7f6d9c1e6980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:47.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.447+0000 7f6d9c1e6980 20 Filter name: none 2024-04-03T04:18:47.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.451+0000 7f6bbbfff640 20 reqs_thread_entry: start 2024-04-03T04:18:47.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.451+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:18:47.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.451+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.455+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.455+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.459+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:18:47.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.459+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-04-03T04:18:47.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15097152603607072753', time=2024-04-03T06:17:40.355581+0000, chain.objs.size()=1 2024-04-03T04:18:47.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.102__shadow_.8Bg8QeU6tkOfHEOKo3gHyBGdv__r1G5_0 2024-04-03T04:18:47.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15436056603722224977', time=2024-04-03T06:17:50.554055+0000, chain.objs.size()=1 2024-04-03T04:18:47.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.109__shadow_.yIE-YhXkquhUq9bAyDAQr3mgwV8Y1MI_0 2024-04-03T04:18:47.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6873387442518372401', time=2024-04-03T06:17:52.233514+0000, chain.objs.size()=1 2024-04-03T04:18:47.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.110__shadow_.Hmr9CL_dkBdlOsQzV-A_2P-RJHrMh5o_0 2024-04-03T04:18:47.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14403114306057110565', time=2024-04-03T06:17:54.937286+0000, chain.objs.size()=1 2024-04-03T04:18:47.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.463+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.112__shadow_.2YkS_jKClXDjZ50OMjmTyTBdStSa_jc_0 2024-04-03T04:18:47.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.467+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.471+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:18:47.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-04-03T04:18:47.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12494099945867108626', time=2024-04-03T06:17:40.127470+0000, chain.objs.size()=1 2024-04-03T04:18:47.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.102__shadow_.RWB2rSdMEh3Ob-yPjv2ZdT4vrzxE-VP_0 2024-04-03T04:18:47.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12607664535132211517', time=2024-04-03T06:17:47.586493+0000, chain.objs.size()=1 2024-04-03T04:18:47.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.107__shadow_.kEnRFUrzDH14iPnEL3m4BfLEckyrx_X_0 2024-04-03T04:18:47.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1450648796842935422', time=2024-04-03T06:17:49.257526+0000, chain.objs.size()=1 2024-04-03T04:18:47.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.108__shadow_.y5YHVQI020iqky6lrCB5BA5NRx_Di5x_0 2024-04-03T04:18:47.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.705369961651002268', time=2024-04-03T06:17:50.625242+0000, chain.objs.size()=1 2024-04-03T04:18:47.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.109__shadow_.BskyHTXjudmOpyKbG21n-adStREn17r_0 2024-04-03T04:18:47.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11870376188346302633', time=2024-04-03T06:17:53.595982+0000, chain.objs.size()=1 2024-04-03T04:18:47.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.111__shadow_.yxQ-K1shaONNUDeprSP1uVGHRayvpZG_0 2024-04-03T04:18:47.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14352866710347160886', time=2024-04-03T06:18:04.931039+0000, chain.objs.size()=1 2024-04-03T04:18:47.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.475+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.119__shadow_.OwjHgYm4GOtpNaIFKV_DacND2Lsl0oA_0 2024-04-03T04:18:47.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.483+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.487+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:18:47.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8694395664316191664', time=2024-04-03T06:12:02.638453+0000, chain.objs.size()=3 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.72__shadow_.VPXtv0F1Q0WqJNIrVDUnMjK-9hhC6tH_0 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.72__shadow_.VPXtv0F1Q0WqJNIrVDUnMjK-9hhC6tH_1 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.72__shadow_.VPXtv0F1Q0WqJNIrVDUnMjK-9hhC6tH_2 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17575211071222718037', time=2024-04-03T06:14:36.066896+0000, chain.objs.size()=5 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file2.mpg.2~Li-DX25hZO2rjwnHvr_CPTBxCxzVz9j.1 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file2.mpg.2~Li-DX25hZO2rjwnHvr_CPTBxCxzVz9j.2 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file2.mpg.2~Li-DX25hZO2rjwnHvr_CPTBxCxzVz9j.3 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file2.mpg.2~Li-DX25hZO2rjwnHvr_CPTBxCxzVz9j.4 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file2.mpg.2~Li-DX25hZO2rjwnHvr_CPTBxCxzVz9j.5 2024-04-03T04:18:47.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6216168265724894782', time=2024-04-03T06:14:36.204334+0000, chain.objs.size()=1 2024-04-03T04:18:47.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__shadow_.3vremVP68amnVgooLZR0CKE8ynLQL37_0 2024-04-03T04:18:47.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6565041772551148803', time=2024-04-03T06:18:02.272628+0000, chain.objs.size()=1 2024-04-03T04:18:47.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.117__shadow_.xTSwX7HWmMK4PoziF529ro6urhNQkol_0 2024-04-03T04:18:47.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9916951559588080342', time=2024-04-03T06:18:03.517850+0000, chain.objs.size()=1 2024-04-03T04:18:47.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.491+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.118__shadow_.q0r0JgTkZBWguZxQ5rknnicc8D5dDt7_0 2024-04-03T04:18:47.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.503+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.507+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:18:47.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.511+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13240924485312697973', time=2024-04-03T06:16:43.557554+0000, chain.objs.size()=1 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__shadow_.KQfh5RhmUNzdTkbBrUUiMf_LaeKsfZe_0 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH', time=2024-04-03T06:17:23.245018+0000, chain.objs.size()=1 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.11 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH', time=2024-04-03T06:17:23.524320+0000, chain.objs.size()=1 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.14 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH', time=2024-04-03T06:17:23.695686+0000, chain.objs.size()=1 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.16 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH', time=2024-04-03T06:17:23.777868+0000, chain.objs.size()=1 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.17 2024-04-03T04:18:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH', time=2024-04-03T06:17:23.949453+0000, chain.objs.size()=1 2024-04-03T04:18:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.18 2024-04-03T04:18:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH', time=2024-04-03T06:17:24.297250+0000, chain.objs.size()=1 2024-04-03T04:18:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.19 2024-04-03T04:18:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH', time=2024-04-03T06:17:24.535949+0000, chain.objs.size()=1 2024-04-03T04:18:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.20 2024-04-03T04:18:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH', time=2024-04-03T06:17:24.706020+0000, chain.objs.size()=34 2024-04-03T04:18:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.1 2024-04-03T04:18:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.2 2024-04-03T04:18:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.3 2024-04-03T04:18:47.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.515+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.4 2024-04-03T04:18:47.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.519+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.5 2024-04-03T04:18:47.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.519+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.6 2024-04-03T04:18:47.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.523+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.7 2024-04-03T04:18:47.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.523+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.8 2024-04-03T04:18:47.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.523+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.9 2024-04-03T04:18:47.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.523+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.10 2024-04-03T04:18:47.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.523+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.-MEFRmnJdyd-uhSPlUheGeQ64vVi47vv.11 2024-04-03T04:18:47.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.523+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.12 2024-04-03T04:18:47.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.523+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.13 2024-04-03T04:18:47.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.523+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.1otOuPJgVj4PHnM7uQ3VgWqLOPkoehaE.14 2024-04-03T04:18:47.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.523+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.15 2024-04-03T04:18:47.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.531+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.g8dDNjcodP3wTR3PsIE_0U4giZxE6yh2.16 2024-04-03T04:18:47.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.531+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.9aqBw1ZQZXdaPxRV8_oGBxDZfUVhFeXc.17 2024-04-03T04:18:47.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.531+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.p_Bp8mdlyc8uimMMBqC87FjdxIVN8KFy.18 2024-04-03T04:18:47.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.531+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.brpQ5Zb43_RM1b89caR_AawXhaXJ8cg9.19 2024-04-03T04:18:47.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.535+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.VCBw6byizl4J6gtoC36eYserkvZAL45f.20 2024-04-03T04:18:47.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.539+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.21 2024-04-03T04:18:47.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.539+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.22 2024-04-03T04:18:47.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.539+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.23 2024-04-03T04:18:47.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.539+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.24 2024-04-03T04:18:47.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.539+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.25 2024-04-03T04:18:47.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.539+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.26 2024-04-03T04:18:47.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.543+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.27 2024-04-03T04:18:47.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.543+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.28 2024-04-03T04:18:47.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.543+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.29 2024-04-03T04:18:47.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.543+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.30 2024-04-03T04:18:47.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.543+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.31 2024-04-03T04:18:47.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.543+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.32 2024-04-03T04:18:47.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.543+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.33 2024-04-03T04:18:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.547+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.94__multipart_key1.2~kOuL66RNnx3tvlXZby40t-LxYfpVEFH.34 2024-04-03T04:18:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.547+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17982136759493231156', time=2024-04-03T06:17:44.742919+0000, chain.objs.size()=1 2024-04-03T04:18:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.547+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.105__shadow_.Jng4ssKkM85Wq4tJ0A2aziMj2Q0Ev6i_0 2024-04-03T04:18:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.547+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15810953297699499262', time=2024-04-03T06:17:47.527982+0000, chain.objs.size()=1 2024-04-03T04:18:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.547+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.107__shadow_.0ZCgArpPOiciZeK-35fj5GEBdYguonl_0 2024-04-03T04:18:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.547+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5050282953185742717', time=2024-04-03T06:18:03.651969+0000, chain.objs.size()=1 2024-04-03T04:18:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.547+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.118__shadow_.pIsaQ9DgrsBcK_9mD27dvji7rAjDgPg_0 2024-04-03T04:18:47.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.559+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.563+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:18:47.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.563+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.567+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.567+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-04-03T04:18:47.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.567+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7002541111237839056', time=2024-04-03T06:11:26.856571+0000, chain.objs.size()=1 2024-04-03T04:18:47.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.567+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.66__shadow_.l6kKuowUtdgPNCkmbRdBhIXWVDqZeNU_0 2024-04-03T04:18:47.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.567+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13933066585060086645', time=2024-04-03T06:18:03.587281+0000, chain.objs.size()=1 2024-04-03T04:18:47.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.567+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.118__shadow_.DagS05ToPPBIa4Ha65FaGHNqex4TSvd_0 2024-04-03T04:18:47.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.567+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.571+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:18:47.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.575+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.575+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:18:47.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15475515088435632726', time=2024-04-03T06:12:09.177679+0000, chain.objs.size()=1 2024-04-03T04:18:47.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.79__shadow_.1OOClJbJPNUctgBmwky3_Gfwxm3VAtH_0 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6382244259777616280', time=2024-04-03T06:17:46.278319+0000, chain.objs.size()=1 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.106__shadow_.ai4Pp4CJJQ2co66JrjD9OPkQ-BpSUYp_0 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14433314574864491883', time=2024-04-03T06:18:31.944295+0000, chain.objs.size()=9 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132__multipart_key1.2~v8vYn17BXK7_yvBvmaKinH1e5PpO-h1.1 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132__shadow_key1.2~v8vYn17BXK7_yvBvmaKinH1e5PpO-h1.1_1 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132__multipart_key1.2~v8vYn17BXK7_yvBvmaKinH1e5PpO-h1.2 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132__shadow_key1.2~v8vYn17BXK7_yvBvmaKinH1e5PpO-h1.2_1 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132__multipart_key1.2~v8vYn17BXK7_yvBvmaKinH1e5PpO-h1.3 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132__shadow_key1.2~v8vYn17BXK7_yvBvmaKinH1e5PpO-h1.3_1 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132__multipart_key1.2~v8vYn17BXK7_yvBvmaKinH1e5PpO-h1.4 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132__shadow_key1.2~v8vYn17BXK7_yvBvmaKinH1e5PpO-h1.4_1 2024-04-03T04:18:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.579+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132__multipart_key1.2~v8vYn17BXK7_yvBvmaKinH1e5PpO-h1.5 2024-04-03T04:18:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.583+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.591+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:18:47.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.591+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.591+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.591+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-04-03T04:18:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.591+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2005046513088169250', time=2024-04-03T06:17:44.672556+0000, chain.objs.size()=1 2024-04-03T04:18:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.591+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.105__shadow_.XUpGK1HUXPvahKdOR4PLEbd0X5YGxlp_0 2024-04-03T04:18:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.591+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.808133559947057233', time=2024-04-03T06:17:57.745383+0000, chain.objs.size()=1 2024-04-03T04:18:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.591+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.114__shadow_._26P13zFaCrVSkG92SJiiEqcoRCGfb3_0 2024-04-03T04:18:47.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.595+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.599+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:18:47.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10049329103232802235', time=2024-04-03T06:12:03.692819+0000, chain.objs.size()=1 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.73__shadow_.s8pWtQP-giqUxZq_LLsJOav9XcVBtiH_0 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15869179611365490318', time=2024-04-03T06:12:23.121027+0000, chain.objs.size()=9 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.1 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__shadow_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.1_1 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.2 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__shadow_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.2_1 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.3 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__shadow_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.3_1 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.4 2024-04-03T04:18:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__shadow_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.4_1 2024-04-03T04:18:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.5 2024-04-03T04:18:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2646725820400163600', time=2024-04-03T06:13:14.506042+0000, chain.objs.size()=7 2024-04-03T04:18:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~gQzIVis_OvxlIlgDOgutStL4zInBrpt.1 2024-04-03T04:18:47.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.603+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~gQzIVis_OvxlIlgDOgutStL4zInBrpt.1_1 2024-04-03T04:18:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.607+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~gQzIVis_OvxlIlgDOgutStL4zInBrpt.1_2 2024-04-03T04:18:47.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.607+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~gQzIVis_OvxlIlgDOgutStL4zInBrpt.2 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~gQzIVis_OvxlIlgDOgutStL4zInBrpt.2_1 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~gQzIVis_OvxlIlgDOgutStL4zInBrpt.2_2 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~gQzIVis_OvxlIlgDOgutStL4zInBrpt.3 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11942069288373857125', time=2024-04-03T06:16:08.732716+0000, chain.objs.size()=7 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~p6-BGbRp3s6QxplStSQe7TL5lBRRqqe.1 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~p6-BGbRp3s6QxplStSQe7TL5lBRRqqe.1_1 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~p6-BGbRp3s6QxplStSQe7TL5lBRRqqe.1_2 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~p6-BGbRp3s6QxplStSQe7TL5lBRRqqe.2 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~p6-BGbRp3s6QxplStSQe7TL5lBRRqqe.2_1 2024-04-03T04:18:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.611+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~p6-BGbRp3s6QxplStSQe7TL5lBRRqqe.2_2 2024-04-03T04:18:47.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.615+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~p6-BGbRp3s6QxplStSQe7TL5lBRRqqe.3 2024-04-03T04:18:47.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.615+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17299871733742479868', time=2024-04-03T06:18:00.627374+0000, chain.objs.size()=1 2024-04-03T04:18:47.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.615+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.116__shadow_.06FcocWmupk5y2UitefrwzpqxPygSZO_0 2024-04-03T04:18:47.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.615+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9639919079063084812', time=2024-04-03T06:18:06.442660+0000, chain.objs.size()=1 2024-04-03T04:18:47.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.615+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.120__shadow_.WoVG7jxu2eTvXlyxy8QcgKPQb7Z3gJI_0 2024-04-03T04:18:47.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.623+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:18:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3939240683313686191', time=2024-04-03T06:13:02.257899+0000, chain.objs.size()=9 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~EPK9BFX7pIPfhQtHgi9FQBGoXM1AsLh.1 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~EPK9BFX7pIPfhQtHgi9FQBGoXM1AsLh.1_1 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~EPK9BFX7pIPfhQtHgi9FQBGoXM1AsLh.2 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~EPK9BFX7pIPfhQtHgi9FQBGoXM1AsLh.2_1 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~EPK9BFX7pIPfhQtHgi9FQBGoXM1AsLh.3 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~EPK9BFX7pIPfhQtHgi9FQBGoXM1AsLh.3_1 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~EPK9BFX7pIPfhQtHgi9FQBGoXM1AsLh.4 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~EPK9BFX7pIPfhQtHgi9FQBGoXM1AsLh.4_1 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~EPK9BFX7pIPfhQtHgi9FQBGoXM1AsLh.5 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8207753498642662088', time=2024-04-03T06:17:41.807320+0000, chain.objs.size()=1 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.103__shadow_.AlbLuZOqnp-SEtoi3WQeaIzq5kqXvMb_0 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15583431661313973665', time=2024-04-03T06:17:54.870367+0000, chain.objs.size()=1 2024-04-03T04:18:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.627+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.112__shadow_.jjFM6oyXq4Gjrsb6LcvldicyR7Fbg5c_0 2024-04-03T04:18:47.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.635+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.639+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:18:47.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:18:47.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8093947835271689517', time=2024-04-03T06:16:21.484283+0000, chain.objs.size()=7 2024-04-03T04:18:47.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~U99fSSgEjqMuYMxhhL_-cuSIPAkj5Li.1 2024-04-03T04:18:47.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~U99fSSgEjqMuYMxhhL_-cuSIPAkj5Li.1_1 2024-04-03T04:18:47.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~U99fSSgEjqMuYMxhhL_-cuSIPAkj5Li.1_2 2024-04-03T04:18:47.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~U99fSSgEjqMuYMxhhL_-cuSIPAkj5Li.2 2024-04-03T04:18:47.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~U99fSSgEjqMuYMxhhL_-cuSIPAkj5Li.2_1 2024-04-03T04:18:47.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~U99fSSgEjqMuYMxhhL_-cuSIPAkj5Li.2_2 2024-04-03T04:18:47.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~U99fSSgEjqMuYMxhhL_-cuSIPAkj5Li.3 2024-04-03T04:18:47.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7825346774388246382', time=2024-04-03T06:17:49.042112+0000, chain.objs.size()=1 2024-04-03T04:18:47.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.108__shadow_.BBCASP2U-G0XCR5a7uOw4vA8xwezXXE_0 2024-04-03T04:18:47.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2576882798455504415', time=2024-04-03T06:18:03.713598+0000, chain.objs.size()=1 2024-04-03T04:18:47.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.643+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.118__shadow_.5jB036QR1Sqya1F0d_MRsBP7PHY8oxm_0 2024-04-03T04:18:47.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.651+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:18:47.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-04-03T04:18:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15662304383641455551', time=2024-04-03T06:17:41.679234+0000, chain.objs.size()=1 2024-04-03T04:18:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.103__shadow_.I1fUTnGiUipPx1-1AAHn9k7jxTWQsW9_0 2024-04-03T04:18:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1498208684065780791', time=2024-04-03T06:17:44.519708+0000, chain.objs.size()=1 2024-04-03T04:18:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.105__shadow_.nh3mFJoq8FolVDcnJjfZkvTXlXcUB_n_0 2024-04-03T04:18:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8438430964254072359', time=2024-04-03T06:17:56.380217+0000, chain.objs.size()=1 2024-04-03T04:18:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.113__shadow_.0pd-ESZcSHHLFramgeA9_60RgBFLCMt_0 2024-04-03T04:18:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3801437947929239238', time=2024-04-03T06:17:57.627154+0000, chain.objs.size()=1 2024-04-03T04:18:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.114__shadow_.fbjCaFgDSdMx2AhLQglO8slqH_PtWEl_0 2024-04-03T04:18:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10678690693693205248', time=2024-04-03T06:18:00.769234+0000, chain.objs.size()=1 2024-04-03T04:18:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.116__shadow_.4M-x2aOo6Kdr0H_VrNaK20xx5CEOkjs_0 2024-04-03T04:18:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9303078195518250048', time=2024-04-03T06:18:05.059228+0000, chain.objs.size()=1 2024-04-03T04:18:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.655+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.119__shadow_.l2-dvzmcc41JF_P-Sc1otLYdHxKi5Gg_0 2024-04-03T04:18:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.659+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.663+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:18:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-04-03T04:18:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12849804000942155344', time=2024-04-03T06:15:44.459658+0000, chain.objs.size()=9 2024-04-03T04:18:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~VmDpkuFN9EBeN6HCqvU3_L5OwidTDK_.1 2024-04-03T04:18:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~VmDpkuFN9EBeN6HCqvU3_L5OwidTDK_.1_1 2024-04-03T04:18:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~VmDpkuFN9EBeN6HCqvU3_L5OwidTDK_.2 2024-04-03T04:18:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~VmDpkuFN9EBeN6HCqvU3_L5OwidTDK_.2_1 2024-04-03T04:18:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~VmDpkuFN9EBeN6HCqvU3_L5OwidTDK_.3 2024-04-03T04:18:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~VmDpkuFN9EBeN6HCqvU3_L5OwidTDK_.3_1 2024-04-03T04:18:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~VmDpkuFN9EBeN6HCqvU3_L5OwidTDK_.4 2024-04-03T04:18:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~VmDpkuFN9EBeN6HCqvU3_L5OwidTDK_.4_1 2024-04-03T04:18:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~VmDpkuFN9EBeN6HCqvU3_L5OwidTDK_.5 2024-04-03T04:18:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2765131077551673581', time=2024-04-03T06:17:46.123465+0000, chain.objs.size()=1 2024-04-03T04:18:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.106__shadow_.mkaenw6k0Mdyzhq6E_w0WDNou1ThNyy_0 2024-04-03T04:18:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16009062896728948991', time=2024-04-03T06:17:53.454953+0000, chain.objs.size()=1 2024-04-03T04:18:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.111__shadow_.3sZy2mpwPpgwisTTbpLoATpiguDrc7q_0 2024-04-03T04:18:47.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18389364811532542575', time=2024-04-03T06:18:02.126441+0000, chain.objs.size()=1 2024-04-03T04:18:47.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.667+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.117__shadow_.LdGwgJn_W3KaPJK-BXsaiofRO6NAyD3_0 2024-04-03T04:18:47.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.675+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3931250830567796009', time=2024-04-03T06:18:46.432091+0000, chain.objs.size()=1 2024-04-03T04:18:47.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.675+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__shadow_.oiYuOmoOTsItIfXSAzNGWJ3LffBp40Z_0 2024-04-03T04:18:47.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.675+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.679+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:18:47.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.679+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.679+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16623824997418802394', time=2024-04-03T06:14:35.987687+0000, chain.objs.size()=1 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__shadow_.dUc4EhEQn62RJElNhMwRma2yp8i1l26_0 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2824637462550270642', time=2024-04-03T06:17:10.229360+0000, chain.objs.size()=9 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.93__multipart_key1.2~k8o0OJlzfUk7SV0ELP7gOk-yb5ePbWX.1 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.93__shadow_key1.2~k8o0OJlzfUk7SV0ELP7gOk-yb5ePbWX.1_1 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.93__multipart_key1.2~k8o0OJlzfUk7SV0ELP7gOk-yb5ePbWX.2 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.93__shadow_key1.2~k8o0OJlzfUk7SV0ELP7gOk-yb5ePbWX.2_1 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.93__multipart_key1.2~k8o0OJlzfUk7SV0ELP7gOk-yb5ePbWX.3 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.93__shadow_key1.2~k8o0OJlzfUk7SV0ELP7gOk-yb5ePbWX.3_1 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.93__multipart_key1.2~k8o0OJlzfUk7SV0ELP7gOk-yb5ePbWX.4 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.93__shadow_key1.2~k8o0OJlzfUk7SV0ELP7gOk-yb5ePbWX.4_1 2024-04-03T04:18:47.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.93__multipart_key1.2~k8o0OJlzfUk7SV0ELP7gOk-yb5ePbWX.5 2024-04-03T04:18:47.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8569442987523146571', time=2024-04-03T06:17:43.221575+0000, chain.objs.size()=1 2024-04-03T04:18:47.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.104__shadow_.BFvAaX8ln5bMPSPJRpI8TwH51r7URTO_0 2024-04-03T04:18:47.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12836029494945680632', time=2024-04-03T06:17:44.589874+0000, chain.objs.size()=1 2024-04-03T04:18:47.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.105__shadow_.m1fnCRh42-XhjoGyHhnLyYrmJtBnPkU_0 2024-04-03T04:18:47.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3074535121642204117', time=2024-04-03T06:18:07.632508+0000, chain.objs.size()=1 2024-04-03T04:18:47.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.683+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.121__shadow_.Sk5Bv78f9WvclU2v5APCACnPP7qMIO3_0 2024-04-03T04:18:47.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.687+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8975412086749323593', time=2024-04-03T06:18:16.594818+0000, chain.objs.size()=1 2024-04-03T04:18:47.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.687+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.129__shadow_.9l8X0DrE8_Jr8Rshr3bswldNK-BkGR0_0 2024-04-03T04:18:47.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.691+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:18:47.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:18:47.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.315777043745272988', time=2024-04-03T06:17:30.435222+0000, chain.objs.size()=1 2024-04-03T04:18:47.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.95__shadow_.zi-f5SASbrJYmbWPa-3uitTJjVJ_Y8d_0 2024-04-03T04:18:47.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14447117661944495572', time=2024-04-03T06:17:46.051372+0000, chain.objs.size()=1 2024-04-03T04:18:47.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.106__shadow_.PlaKJgiDl6aa_E-Z9ayaA6pzxrcmq_J_0 2024-04-03T04:18:47.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13938945335338020276', time=2024-04-03T06:17:59.269345+0000, chain.objs.size()=1 2024-04-03T04:18:47.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.695+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.115__shadow_.4ES24OfYbDeUVrCE03jm4dp9TCOJtW9_0 2024-04-03T04:18:47.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.699+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:18:47.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16240118358927611769', time=2024-04-03T06:13:14.822495+0000, chain.objs.size()=7 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~8GFNgh1fL8NVKL95f9TjbVZOkD9ppbu.1 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~8GFNgh1fL8NVKL95f9TjbVZOkD9ppbu.1_1 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~8GFNgh1fL8NVKL95f9TjbVZOkD9ppbu.1_2 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~8GFNgh1fL8NVKL95f9TjbVZOkD9ppbu.2 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~8GFNgh1fL8NVKL95f9TjbVZOkD9ppbu.2_1 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~8GFNgh1fL8NVKL95f9TjbVZOkD9ppbu.2_2 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~8GFNgh1fL8NVKL95f9TjbVZOkD9ppbu.3 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12993447572484038213', time=2024-04-03T06:15:57.056512+0000, chain.objs.size()=9 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~6vR3CwvwZwHhdDQ2f_EHSCWKI2hVXjc.1 2024-04-03T04:18:47.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~6vR3CwvwZwHhdDQ2f_EHSCWKI2hVXjc.1_1 2024-04-03T04:18:47.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~6vR3CwvwZwHhdDQ2f_EHSCWKI2hVXjc.2 2024-04-03T04:18:47.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~6vR3CwvwZwHhdDQ2f_EHSCWKI2hVXjc.2_1 2024-04-03T04:18:47.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.703+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~6vR3CwvwZwHhdDQ2f_EHSCWKI2hVXjc.3 2024-04-03T04:18:47.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.707+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~6vR3CwvwZwHhdDQ2f_EHSCWKI2hVXjc.3_1 2024-04-03T04:18:47.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.707+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~6vR3CwvwZwHhdDQ2f_EHSCWKI2hVXjc.4 2024-04-03T04:18:47.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.711+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~6vR3CwvwZwHhdDQ2f_EHSCWKI2hVXjc.4_1 2024-04-03T04:18:47.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.711+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~6vR3CwvwZwHhdDQ2f_EHSCWKI2hVXjc.5 2024-04-03T04:18:47.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.711+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3725746030257927222', time=2024-04-03T06:17:38.781618+0000, chain.objs.size()=1 2024-04-03T04:18:47.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.711+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.101__shadow_.cLod4BemL4uRzVyyrxWe__hgPRqLQuc_0 2024-04-03T04:18:47.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.711+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15768275538006806601', time=2024-04-03T06:18:09.090028+0000, chain.objs.size()=1 2024-04-03T04:18:47.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.711+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.122__shadow_.mDEhoTK6qeefzQzgL1bpx_tbd5xBaRm_0 2024-04-03T04:18:47.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.715+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.719+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:18:47.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-04-03T04:18:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7317743146704284511', time=2024-04-03T06:17:43.155817+0000, chain.objs.size()=1 2024-04-03T04:18:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.104__shadow_.l55S6PPC0wePEXoiSlGLi_nmBSbf283_0 2024-04-03T04:18:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13776994891520789643', time=2024-04-03T06:17:47.727438+0000, chain.objs.size()=1 2024-04-03T04:18:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.107__shadow_.SSTdH-_UCoSdx_BwCHgKCOAhp_zzCwj_0 2024-04-03T04:18:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11456036379316379526', time=2024-04-03T06:17:59.200130+0000, chain.objs.size()=1 2024-04-03T04:18:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.115__shadow_.jWekyUCf1mO9k0loxtWXyU5AgWyXpAs_0 2024-04-03T04:18:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2047203254810906445', time=2024-04-03T06:18:00.698056+0000, chain.objs.size()=1 2024-04-03T04:18:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.723+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.116__shadow_.HQ8G_wA1fA8JUfrk9ctwsTRsCuzcEmX_0 2024-04-03T04:18:47.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.727+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.727+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:18:47.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.731+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.731+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.731+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:18:47.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.731+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10810865208350082809', time=2024-04-03T06:17:38.628545+0000, chain.objs.size()=1 2024-04-03T04:18:47.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.731+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.101__shadow_.zgEIO_AaHWa7E7qFwq-J16zFNM7tMHB_0 2024-04-03T04:18:47.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.731+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17155508401653718195', time=2024-04-03T06:17:43.024010+0000, chain.objs.size()=1 2024-04-03T04:18:47.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.731+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.104__shadow_.hPHU710XXQsUGWZOFtHrB3QuO0dIEHO_0 2024-04-03T04:18:47.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.731+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10731649815817800266', time=2024-04-03T06:17:57.801408+0000, chain.objs.size()=1 2024-04-03T04:18:47.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.731+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.114__shadow_.4IfoVfZozpmQwLsdSMmac4fehdGhI9U_0 2024-04-03T04:18:47.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.735+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.735+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:18:47.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-04-03T04:18:47.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8149569585225615064', time=2024-04-03T06:13:06.427316+0000, chain.objs.size()=9 2024-04-03T04:18:47.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~KvKjoAY8ywqY9u_Mrw4KeEl1xhqr4V0.1 2024-04-03T04:18:47.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~KvKjoAY8ywqY9u_Mrw4KeEl1xhqr4V0.1_1 2024-04-03T04:18:47.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~KvKjoAY8ywqY9u_Mrw4KeEl1xhqr4V0.2 2024-04-03T04:18:47.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~KvKjoAY8ywqY9u_Mrw4KeEl1xhqr4V0.2_1 2024-04-03T04:18:47.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~KvKjoAY8ywqY9u_Mrw4KeEl1xhqr4V0.3 2024-04-03T04:18:47.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~KvKjoAY8ywqY9u_Mrw4KeEl1xhqr4V0.3_1 2024-04-03T04:18:47.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~KvKjoAY8ywqY9u_Mrw4KeEl1xhqr4V0.4 2024-04-03T04:18:47.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~KvKjoAY8ywqY9u_Mrw4KeEl1xhqr4V0.4_1 2024-04-03T04:18:47.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~KvKjoAY8ywqY9u_Mrw4KeEl1xhqr4V0.5 2024-04-03T04:18:47.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.578030935109439161', time=2024-04-03T06:14:02.566715+0000, chain.objs.size()=9 2024-04-03T04:18:47.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.88__multipart_key1.2~Xd6x1jK66hIq9Vnxr3agKKrcrRlowxq.1 2024-04-03T04:18:47.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.88__shadow_key1.2~Xd6x1jK66hIq9Vnxr3agKKrcrRlowxq.1_1 2024-04-03T04:18:47.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.739+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.88__multipart_key1.2~Xd6x1jK66hIq9Vnxr3agKKrcrRlowxq.2 2024-04-03T04:18:47.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.743+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.88__shadow_key1.2~Xd6x1jK66hIq9Vnxr3agKKrcrRlowxq.2_1 2024-04-03T04:18:47.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.743+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.88__multipart_key1.2~Xd6x1jK66hIq9Vnxr3agKKrcrRlowxq.3 2024-04-03T04:18:47.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.743+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.88__shadow_key1.2~Xd6x1jK66hIq9Vnxr3agKKrcrRlowxq.3_1 2024-04-03T04:18:47.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.743+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.88__multipart_key1.2~Xd6x1jK66hIq9Vnxr3agKKrcrRlowxq.4 2024-04-03T04:18:47.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.743+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.88__shadow_key1.2~Xd6x1jK66hIq9Vnxr3agKKrcrRlowxq.4_1 2024-04-03T04:18:47.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.743+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.88__multipart_key1.2~Xd6x1jK66hIq9Vnxr3agKKrcrRlowxq.5 2024-04-03T04:18:47.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.743+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4525833962577312151', time=2024-04-03T06:15:32.275942+0000, chain.objs.size()=9 2024-04-03T04:18:47.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.743+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~Xc3qPIk-7gvvKLFVY27CUdSh6fp82Nf.1 2024-04-03T04:18:47.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.747+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~Xc3qPIk-7gvvKLFVY27CUdSh6fp82Nf.1_1 2024-04-03T04:18:47.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.747+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~Xc3qPIk-7gvvKLFVY27CUdSh6fp82Nf.2 2024-04-03T04:18:47.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.747+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~Xc3qPIk-7gvvKLFVY27CUdSh6fp82Nf.2_1 2024-04-03T04:18:47.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.747+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~Xc3qPIk-7gvvKLFVY27CUdSh6fp82Nf.3 2024-04-03T04:18:47.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.747+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~Xc3qPIk-7gvvKLFVY27CUdSh6fp82Nf.3_1 2024-04-03T04:18:47.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.747+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~Xc3qPIk-7gvvKLFVY27CUdSh6fp82Nf.4 2024-04-03T04:18:47.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.747+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~Xc3qPIk-7gvvKLFVY27CUdSh6fp82Nf.4_1 2024-04-03T04:18:47.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.751+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~Xc3qPIk-7gvvKLFVY27CUdSh6fp82Nf.5 2024-04-03T04:18:47.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.751+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1096667344223877125', time=2024-04-03T06:17:41.739709+0000, chain.objs.size()=1 2024-04-03T04:18:47.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.751+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.103__shadow_.a1Bch_6JtODWBa9K0A8oG7jEdfW9UNE_0 2024-04-03T04:18:47.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.751+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17550182432334074710', time=2024-04-03T06:18:02.199647+0000, chain.objs.size()=1 2024-04-03T04:18:47.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.751+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.117__shadow_.COWupFY96Peg5BSOXs8Ml6q72p14BqE_0 2024-04-03T04:18:47.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.751+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13238632288426540838', time=2024-04-03T06:18:06.310261+0000, chain.objs.size()=1 2024-04-03T04:18:47.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.751+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.120__shadow_.PMNHETJM8xz_O3r9IaRuRahwKFwm8j2_0 2024-04-03T04:18:47.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.755+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:18:47.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-04-03T04:18:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17331714172523866139', time=2024-04-03T06:11:51.719514+0000, chain.objs.size()=1 2024-04-03T04:18:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.70__shadow_.udaWXC_6BmC5hWwOhi3RGk4q9CmhJ25_0 2024-04-03T04:18:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4271535718571820776', time=2024-04-03T06:17:41.624218+0000, chain.objs.size()=1 2024-04-03T04:18:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.103__shadow_.R--CNp4YzlCL6RKwnf2SPvV3uxd7jb3_0 2024-04-03T04:18:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4578462889327221183', time=2024-04-03T06:18:07.759965+0000, chain.objs.size()=1 2024-04-03T04:18:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.121__shadow_.bjoXMVlFPTUT33hq0quPet4JQHobC9O_0 2024-04-03T04:18:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3955085570874527668', time=2024-04-03T06:18:11.997556+0000, chain.objs.size()=1 2024-04-03T04:18:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.759+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.125__shadow_.aRWm5aNKbAUyQtDViBkUxffYYbU4lmZ_0 2024-04-03T04:18:47.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.763+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:18:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:18:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17896047409138032586', time=2024-04-03T06:14:36.136169+0000, chain.objs.size()=1 2024-04-03T04:18:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__shadow_.RyrZ7rXYDFnkXjZboIaGRveFZY9PUU-_0 2024-04-03T04:18:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18409269604535044420', time=2024-04-03T06:17:46.197879+0000, chain.objs.size()=1 2024-04-03T04:18:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.106__shadow_.bNlm71XzTlJ2VjbZoRt4M33T2fFMM_t_0 2024-04-03T04:18:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17566876516736598660', time=2024-04-03T06:18:14.046458+0000, chain.objs.size()=1 2024-04-03T04:18:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.767+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.127__shadow_.FCWiv6SbPBx20jrevGuyIcytbgLW3Uq_0 2024-04-03T04:18:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.771+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.771+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:18:47.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-04-03T04:18:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14491155425084155351', time=2024-04-03T06:13:15.381962+0000, chain.objs.size()=6 2024-04-03T04:18:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.82__shadow_.xY4-qjRJ1QaeQx1mEON0242s0fCLjik_0 2024-04-03T04:18:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.82__shadow_.xY4-qjRJ1QaeQx1mEON0242s0fCLjik_1 2024-04-03T04:18:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.82__shadow_.xY4-qjRJ1QaeQx1mEON0242s0fCLjik_2 2024-04-03T04:18:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.82__shadow_.xY4-qjRJ1QaeQx1mEON0242s0fCLjik_3 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.82__shadow_.xY4-qjRJ1QaeQx1mEON0242s0fCLjik_4 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.82__shadow_.xY4-qjRJ1QaeQx1mEON0242s0fCLjik_5 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.661543312838392366', time=2024-04-03T06:17:52.086881+0000, chain.objs.size()=1 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.110__shadow_.ABH3nCafic6kfYrREqpZsBNXmUkcaOU_0 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7423370166269525958', time=2024-04-03T06:17:53.666778+0000, chain.objs.size()=1 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.111__shadow_.tPoS-B9bcNS2us0-RQjH9KGBdupe1ww_0 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12869287269670706019', time=2024-04-03T06:17:59.055691+0000, chain.objs.size()=1 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.115__shadow_.0uBtlfQvu8LlTk0BNhA2yvUSRgH2P42_0 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8450077076108942964', time=2024-04-03T06:18:13.879828+0000, chain.objs.size()=1 2024-04-03T04:18:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.775+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.127__shadow_.RpLtEd8mBqvPLzB4fIB0DWjC3whzFVU_0 2024-04-03T04:18:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.783+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.783+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:18:47.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-04-03T04:18:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4578253462935544170', time=2024-04-03T06:17:40.287170+0000, chain.objs.size()=1 2024-04-03T04:18:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.102__shadow_.YddkjbxNo3GtO2b551XaWoWr2i8--CI_0 2024-04-03T04:18:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18023435171054876075', time=2024-04-03T06:17:49.187136+0000, chain.objs.size()=1 2024-04-03T04:18:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.108__shadow_.AR1XB9guAsyO6SrkYV2lxy4kYTlpMxm_0 2024-04-03T04:18:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14692343188985607009', time=2024-04-03T06:18:00.558477+0000, chain.objs.size()=1 2024-04-03T04:18:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.116__shadow_.J1d-3hTy6SZANc2u7EJwDwFCZ14Yr0F_0 2024-04-03T04:18:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11598679494822172867', time=2024-04-03T06:18:09.017972+0000, chain.objs.size()=1 2024-04-03T04:18:47.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.787+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.122__shadow_.NEMj6v7AMfRgVjB85a75B6PbDeJflq3_0 2024-04-03T04:18:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.791+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.791+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:18:47.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-04-03T04:18:47.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ', time=2024-04-03T06:11:49.466255+0000, chain.objs.size()=9 2024-04-03T04:18:47.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.68__multipart_key1.2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ.1 2024-04-03T04:18:47.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.68__shadow_key1.2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ.1_1 2024-04-03T04:18:47.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.68__multipart_key1.2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ.2 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.68__shadow_key1.2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ.2_1 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.68__multipart_key1.2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ.3 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.68__shadow_key1.2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ.3_1 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.68__multipart_key1.2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ.4 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.68__shadow_key1.2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ.4_1 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.68__multipart_key1.2~sjfIYqj1fTnXSJV-1-_gQ8aHKQszsgZ.5 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13123090220614185221', time=2024-04-03T06:12:04.796689+0000, chain.objs.size()=1 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.74__shadow_.Cv4RcG-oYjKzViLAXYvIycCX8yXw8Mc_0 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13523247015373928079', time=2024-04-03T06:17:38.854017+0000, chain.objs.size()=1 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.101__shadow_.jgm-ezWnAu4dpSMdif3ZJkwpL3zy5TL_0 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3515445277316083711', time=2024-04-03T06:17:56.236425+0000, chain.objs.size()=1 2024-04-03T04:18:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.795+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.113__shadow_.0X-ql1haDSYTfwyhREKe2AuwFpN8YeJ_0 2024-04-03T04:18:47.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.803+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.803+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:18:47.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:18:47.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13961779497201119780', time=2024-04-03T06:17:38.703792+0000, chain.objs.size()=1 2024-04-03T04:18:47.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.101__shadow_.zw1_ob-ydOpnAFbwb2Ss4gvL9vzAswo_0 2024-04-03T04:18:47.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2882792270893678157', time=2024-04-03T06:18:02.053295+0000, chain.objs.size()=1 2024-04-03T04:18:47.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.117__shadow_.9sz33u7HocmGIRpHNLre02IMgq0CqD-_0 2024-04-03T04:18:47.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8474043544093478449', time=2024-04-03T06:18:04.989041+0000, chain.objs.size()=1 2024-04-03T04:18:47.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.119__shadow_.e-k3QegqiUAb_a_HhhpW7jHYzd4mxrm_0 2024-04-03T04:18:47.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.807+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.811+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:18:47.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.811+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-04-03T04:18:47.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1555281981115983940', time=2024-04-03T06:14:35.917588+0000, chain.objs.size()=9 2024-04-03T04:18:47.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file.mpg.2~PnFA6gw6NYDjn-kKxane9yd8lbOkrOA.1 2024-04-03T04:18:47.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__shadow_file.mpg.2~PnFA6gw6NYDjn-kKxane9yd8lbOkrOA.1_1 2024-04-03T04:18:47.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file.mpg.2~PnFA6gw6NYDjn-kKxane9yd8lbOkrOA.2 2024-04-03T04:18:47.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__shadow_file.mpg.2~PnFA6gw6NYDjn-kKxane9yd8lbOkrOA.2_1 2024-04-03T04:18:47.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file.mpg.2~PnFA6gw6NYDjn-kKxane9yd8lbOkrOA.3 2024-04-03T04:18:47.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__shadow_file.mpg.2~PnFA6gw6NYDjn-kKxane9yd8lbOkrOA.3_1 2024-04-03T04:18:47.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file.mpg.2~PnFA6gw6NYDjn-kKxane9yd8lbOkrOA.4 2024-04-03T04:18:47.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__shadow_file.mpg.2~PnFA6gw6NYDjn-kKxane9yd8lbOkrOA.4_1 2024-04-03T04:18:47.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.89__multipart_file.mpg.2~PnFA6gw6NYDjn-kKxane9yd8lbOkrOA.5 2024-04-03T04:18:47.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.746727337132585208', time=2024-04-03T06:16:21.161640+0000, chain.objs.size()=7 2024-04-03T04:18:47.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~Jb93FiIPqxZjRZeIEYJFoRRdHo1Fv0c.1 2024-04-03T04:18:47.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~Jb93FiIPqxZjRZeIEYJFoRRdHo1Fv0c.1_1 2024-04-03T04:18:47.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.815+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~Jb93FiIPqxZjRZeIEYJFoRRdHo1Fv0c.1_2 2024-04-03T04:18:47.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~Jb93FiIPqxZjRZeIEYJFoRRdHo1Fv0c.2 2024-04-03T04:18:47.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~Jb93FiIPqxZjRZeIEYJFoRRdHo1Fv0c.2_1 2024-04-03T04:18:47.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__shadow_key1.2~Jb93FiIPqxZjRZeIEYJFoRRdHo1Fv0c.2_2 2024-04-03T04:18:47.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91__multipart_key1.2~Jb93FiIPqxZjRZeIEYJFoRRdHo1Fv0c.3 2024-04-03T04:18:47.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2433963039793838355', time=2024-04-03T06:17:49.111616+0000, chain.objs.size()=1 2024-04-03T04:18:47.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.108__shadow_.dAZh2E5OznfQCXkSJPYTVZ__ps1E1sR_0 2024-04-03T04:18:47.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9676991272010469972', time=2024-04-03T06:17:52.017961+0000, chain.objs.size()=1 2024-04-03T04:18:47.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.110__shadow_.WC9a4YfKW5INuC_n02IKtJ2Zlf7Td43_0 2024-04-03T04:18:47.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15828576749430617081', time=2024-04-03T06:17:53.525828+0000, chain.objs.size()=1 2024-04-03T04:18:47.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.111__shadow_.LikNgPYMSmWid0erfe5ZIk5PahF3Jhe_0 2024-04-03T04:18:47.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10034471000720166488', time=2024-04-03T06:18:06.371968+0000, chain.objs.size()=1 2024-04-03T04:18:47.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.819+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.120__shadow_.Haw27AdPpsAvCpftpYdp7hT_5ycpM2-_0 2024-04-03T04:18:47.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.823+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.827+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:18:47.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T04:18:47.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6448037641332797243', time=2024-04-03T06:13:10.379252+0000, chain.objs.size()=7 2024-04-03T04:18:47.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~6lpi45wdZZH_vbiiHetfd4mhH9aiKI-.1 2024-04-03T04:18:47.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~6lpi45wdZZH_vbiiHetfd4mhH9aiKI-.1_1 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~6lpi45wdZZH_vbiiHetfd4mhH9aiKI-.1_2 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~6lpi45wdZZH_vbiiHetfd4mhH9aiKI-.2 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~6lpi45wdZZH_vbiiHetfd4mhH9aiKI-.2_1 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~6lpi45wdZZH_vbiiHetfd4mhH9aiKI-.2_2 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~6lpi45wdZZH_vbiiHetfd4mhH9aiKI-.3 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11761026345748039575', time=2024-04-03T06:17:40.213840+0000, chain.objs.size()=1 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.102__shadow_.P1Kjatr5iumddahx4zOK_2bnlBknBow_0 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.563077056224116873', time=2024-04-03T06:17:47.654849+0000, chain.objs.size()=1 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.107__shadow_.wBmYVoUxY6ZTBZlSuTsoBCc4FCiAVfg_0 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11821195017738874995', time=2024-04-03T06:17:50.689368+0000, chain.objs.size()=1 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.109__shadow_.nob31mcQ2RNl9zZPENn0p2Uj9WQSIF__0 2024-04-03T04:18:47.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1468729249555487971', time=2024-04-03T06:17:55.007630+0000, chain.objs.size()=1 2024-04-03T04:18:47.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.112__shadow_.Ms92fmK7pKX_EhGOhKsodwBIFAgU0M-_0 2024-04-03T04:18:47.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13145513348743046460', time=2024-04-03T06:17:56.310797+0000, chain.objs.size()=1 2024-04-03T04:18:47.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.831+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.113__shadow_.03hBjxD8c6Uzy77wElcpmFBh-lUcxuB_0 2024-04-03T04:18:47.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.835+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6767501123010916663', time=2024-04-03T06:18:15.577747+0000, chain.objs.size()=1 2024-04-03T04:18:47.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.835+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.128__shadow_.mtcyooqa000DXlMLe7DpyMCEIgwvxhK_0 2024-04-03T04:18:47.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.839+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.839+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:18:47.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9378480578588469986', time=2024-04-03T06:13:40.359919+0000, chain.objs.size()=9 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.87__multipart_key1.2~LgraupBzuhefeF4xWV6V3X2VYxQ6xYA.1 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.87__shadow_key1.2~LgraupBzuhefeF4xWV6V3X2VYxQ6xYA.1_1 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.87__multipart_key1.2~LgraupBzuhefeF4xWV6V3X2VYxQ6xYA.2 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.87__shadow_key1.2~LgraupBzuhefeF4xWV6V3X2VYxQ6xYA.2_1 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.87__multipart_key1.2~LgraupBzuhefeF4xWV6V3X2VYxQ6xYA.3 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.87__shadow_key1.2~LgraupBzuhefeF4xWV6V3X2VYxQ6xYA.3_1 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.87__multipart_key1.2~LgraupBzuhefeF4xWV6V3X2VYxQ6xYA.4 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.87__shadow_key1.2~LgraupBzuhefeF4xWV6V3X2VYxQ6xYA.4_1 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.87__multipart_key1.2~LgraupBzuhefeF4xWV6V3X2VYxQ6xYA.5 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11174318254667694876', time=2024-04-03T06:16:47.759674+0000, chain.objs.size()=9 2024-04-03T04:18:47.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__multipart_key1.2~Jmx_3b7stxUNOIWhmNWVHoI_tHyCotZ.1 2024-04-03T04:18:47.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__shadow_key1.2~Jmx_3b7stxUNOIWhmNWVHoI_tHyCotZ.1_1 2024-04-03T04:18:47.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.843+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__multipart_key1.2~Jmx_3b7stxUNOIWhmNWVHoI_tHyCotZ.2 2024-04-03T04:18:47.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.847+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__shadow_key1.2~Jmx_3b7stxUNOIWhmNWVHoI_tHyCotZ.2_1 2024-04-03T04:18:47.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.847+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__multipart_key1.2~Jmx_3b7stxUNOIWhmNWVHoI_tHyCotZ.3 2024-04-03T04:18:47.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.847+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__shadow_key1.2~Jmx_3b7stxUNOIWhmNWVHoI_tHyCotZ.3_1 2024-04-03T04:18:47.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.847+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__multipart_key1.2~Jmx_3b7stxUNOIWhmNWVHoI_tHyCotZ.4 2024-04-03T04:18:47.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.851+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__shadow_key1.2~Jmx_3b7stxUNOIWhmNWVHoI_tHyCotZ.4_1 2024-04-03T04:18:47.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.851+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.92__multipart_key1.2~Jmx_3b7stxUNOIWhmNWVHoI_tHyCotZ.5 2024-04-03T04:18:47.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.851+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2100755716278212610', time=2024-04-03T06:17:59.128847+0000, chain.objs.size()=1 2024-04-03T04:18:47.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.851+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.115__shadow_.2TtNv4hMJ-SqImVyEQ-I0ZK_pIIzzHk_0 2024-04-03T04:18:47.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.855+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.855+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:18:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-04-03T04:18:47.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15799300635968230201', time=2024-04-03T06:17:43.087785+0000, chain.objs.size()=1 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.104__shadow_.b3F9ipcgjxC7j3gv_wCVU7qZp7vbklz_0 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10033736377322669277', time=2024-04-03T06:18:46.360434+0000, chain.objs.size()=9 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__multipart_key1/data/file.mpg.2~M1Q81ct1Bii-3wjcTWPcn_bsvESLgfd.1 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__shadow_key1/data/file.mpg.2~M1Q81ct1Bii-3wjcTWPcn_bsvESLgfd.1_1 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__multipart_key1/data/file.mpg.2~M1Q81ct1Bii-3wjcTWPcn_bsvESLgfd.2 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__shadow_key1/data/file.mpg.2~M1Q81ct1Bii-3wjcTWPcn_bsvESLgfd.2_1 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__multipart_key1/data/file.mpg.2~M1Q81ct1Bii-3wjcTWPcn_bsvESLgfd.3 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__shadow_key1/data/file.mpg.2~M1Q81ct1Bii-3wjcTWPcn_bsvESLgfd.3_1 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__multipart_key1/data/file.mpg.2~M1Q81ct1Bii-3wjcTWPcn_bsvESLgfd.4 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__shadow_key1/data/file.mpg.2~M1Q81ct1Bii-3wjcTWPcn_bsvESLgfd.4_1 2024-04-03T04:18:47.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.859+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.133__multipart_key1/data/file.mpg.2~M1Q81ct1Bii-3wjcTWPcn_bsvESLgfd.5 2024-04-03T04:18:47.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.863+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.867+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:18:47.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.867+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.867+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-03T04:18:47.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5408055860804816858', time=2024-04-03T06:12:57.030982+0000, chain.objs.size()=9 2024-04-03T04:18:47.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~pJ7FS_lPN3FKMxcFCsBW04k4wE42Lx_.1 2024-04-03T04:18:47.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~pJ7FS_lPN3FKMxcFCsBW04k4wE42Lx_.1_1 2024-04-03T04:18:47.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~pJ7FS_lPN3FKMxcFCsBW04k4wE42Lx_.2 2024-04-03T04:18:47.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~pJ7FS_lPN3FKMxcFCsBW04k4wE42Lx_.2_1 2024-04-03T04:18:47.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~pJ7FS_lPN3FKMxcFCsBW04k4wE42Lx_.3 2024-04-03T04:18:47.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~pJ7FS_lPN3FKMxcFCsBW04k4wE42Lx_.3_1 2024-04-03T04:18:47.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~pJ7FS_lPN3FKMxcFCsBW04k4wE42Lx_.4 2024-04-03T04:18:47.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__shadow_key1.2~pJ7FS_lPN3FKMxcFCsBW04k4wE42Lx_.4_1 2024-04-03T04:18:47.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.871+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83__multipart_key1.2~pJ7FS_lPN3FKMxcFCsBW04k4wE42Lx_.5 2024-04-03T04:18:47.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.875+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.875+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:18:47.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-04-03T04:18:47.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7457053294261793408', time=2024-04-03T06:17:50.760387+0000, chain.objs.size()=1 2024-04-03T04:18:47.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.109__shadow_.ueZL3DMMW3-6b6LElppuJ1pBW5wEUIN_0 2024-04-03T04:18:47.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12027074522517801840', time=2024-04-03T06:18:07.711000+0000, chain.objs.size()=1 2024-04-03T04:18:47.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.121__shadow_.qX1ZVKtkvD9RUoTr_zh7NTk194KLn_b_0 2024-04-03T04:18:47.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3840100453009690307', time=2024-04-03T06:18:09.161899+0000, chain.objs.size()=1 2024-04-03T04:18:47.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.122__shadow_.6tYjGp-cVBm1DK1O3bjLC7UktfT-Kc8_0 2024-04-03T04:18:47.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6720638685952743881', time=2024-04-03T06:18:13.020243+0000, chain.objs.size()=1 2024-04-03T04:18:47.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.879+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.126__shadow_.ZhQNguqho-tBoIz5iwD7qeO75JSH1VA_0 2024-04-03T04:18:47.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.883+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.883+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:18:47.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:47.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:47.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-04-03T04:18:47.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__shadow_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.1_1_0a0e62631987c42e2b15016855fb9100', time=2024-04-03T06:12:23.713156+0000, chain.objs.size()=9 2024-04-03T04:18:47.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.1 2024-04-03T04:18:47.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__shadow_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.1_1 2024-04-03T04:18:47.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.2 2024-04-03T04:18:47.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__shadow_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.2_1 2024-04-03T04:18:47.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.3 2024-04-03T04:18:47.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__shadow_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.3_1 2024-04-03T04:18:47.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.4 2024-04-03T04:18:47.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__shadow_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.4_1 2024-04-03T04:18:47.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80__multipart_key1.2~qPpT6gDs_hxbsJa1P4g2M5wMObMJIVh.5 2024-04-03T04:18:47.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12825293852415400690', time=2024-04-03T06:17:52.160944+0000, chain.objs.size()=1 2024-04-03T04:18:47.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.110__shadow_.MNjx2yEhrfZy9XdRM32NyV10hBEJ39V_0 2024-04-03T04:18:47.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11905552013838561683', time=2024-04-03T06:17:57.695661+0000, chain.objs.size()=1 2024-04-03T04:18:47.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.887+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.114__shadow_.BPlOyrt9cAE4nVvUU-TXExASr8JLp25_0 2024-04-03T04:18:47.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.891+0000 7f6d9c1e6980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T04:18:47.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.895+0000 7f6c4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:47.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.895+0000 7f6d9c1e6980 20 remove_watcher() i=0 2024-04-03T04:18:47.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.895+0000 7f6d9c1e6980 2 removed watcher, disabling cache 2024-04-03T04:18:47.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.899+0000 7f6d9c1e6980 20 remove_watcher() i=1 2024-04-03T04:18:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.899+0000 7f6d9c1e6980 20 remove_watcher() i=2 2024-04-03T04:18:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.899+0000 7f6d9c1e6980 20 remove_watcher() i=3 2024-04-03T04:18:47.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.899+0000 7f6d9c1e6980 20 remove_watcher() i=4 2024-04-03T04:18:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.903+0000 7f6d9c1e6980 20 remove_watcher() i=5 2024-04-03T04:18:47.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.903+0000 7f6d9c1e6980 20 remove_watcher() i=6 2024-04-03T04:18:47.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:47.903+0000 7f6d9c1e6980 20 remove_watcher() i=7 2024-04-03T04:18:47.891 DEBUG:teuthology.orchestra.run.smithi104:> radosgw-admin gc process --include-all 2024-04-03T04:18:47.962 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:47.962 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:48.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.031+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.031+0000 7fef2ada4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:48.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.031+0000 7fef2ada4980 20 realm 2024-04-03T04:18:48.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.031+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.031+0000 7fef2ada4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:48.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.031+0000 7fef2ada4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:48.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.031+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.031+0000 7fef2ada4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:48.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.031+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.035+0000 7fef2ada4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:48.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.035+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.035+0000 7fef2ada4980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:48.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.035+0000 7fef2ada4980 20 searching for the correct realm 2024-04-03T04:18:48.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.039+0000 7fef290c0640 0 -- 172.21.15.104:0/1672326075 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x5630a1318370 msgr2=0x5630a131a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:48.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.047+0000 7fef290c0640 0 -- 172.21.15.104:0/1672326075 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7fef1802e060 msgr2=0x7fef1805a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:18:48.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.055+0000 7fef2ada4980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:48.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.055+0000 7fef2ada4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:48.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.055+0000 7fef2ada4980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:48.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.055+0000 7fef2ada4980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:48.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.055+0000 7fef2ada4980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:48.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.055+0000 7fef2ada4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:48.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.055+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.055+0000 7fef2ada4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:48.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.055+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:48.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:48.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 zone default found 2024-04-03T04:18:48.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 4 Realm: () 2024-04-03T04:18:48.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:48.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:48.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:48.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 zonegroup default 2024-04-03T04:18:48.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:48.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:48.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 rados->read ofs=0 len=0 2024-04-03T04:18:48.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:48.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 started sync module instance, tier type = 2024-04-03T04:18:48.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.059+0000 7fef2ada4980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:48.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.075+0000 7fef2ada4980 20 add_watcher() i=0 2024-04-03T04:18:48.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.075+0000 7fef2ada4980 20 add_watcher() i=1 2024-04-03T04:18:48.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.075+0000 7fef2ada4980 20 add_watcher() i=2 2024-04-03T04:18:48.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.075+0000 7fef2ada4980 20 add_watcher() i=3 2024-04-03T04:18:48.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.075+0000 7fef2ada4980 20 add_watcher() i=4 2024-04-03T04:18:48.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.075+0000 7fef2ada4980 20 add_watcher() i=5 2024-04-03T04:18:48.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.075+0000 7fef2ada4980 20 add_watcher() i=6 2024-04-03T04:18:48.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.075+0000 7fef2ada4980 20 add_watcher() i=7 2024-04-03T04:18:48.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.075+0000 7fef2ada4980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:48.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.079+0000 7feddf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:48.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.079+0000 7fef2ada4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:48.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.079+0000 7fef2ada4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:48.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.147+0000 7fedde7e4640 20 reqs_thread_entry: start 2024-04-03T04:18:48.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.147+0000 7fef2ada4980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:48.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.147+0000 7fef2ada4980 20 Filter name: none 2024-04-03T04:18:48.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.147+0000 7fedd7fff640 20 reqs_thread_entry: start 2024-04-03T04:18:48.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.147+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T04:18:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.151+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.155+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.155+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.155+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T04:18:48.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.159+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.159+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.159+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.163+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T04:18:48.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.167+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.167+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.167+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.171+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T04:18:48.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.171+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.171+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.175+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.175+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T04:18:48.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.179+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.179+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.179+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.183+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T04:18:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.187+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.187+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.191+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.191+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T04:18:48.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.195+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.195+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.195+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.199+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T04:18:48.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.199+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.203+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.203+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.203+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T04:18:48.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.207+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.207+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.211+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.211+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T04:18:48.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.215+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.215+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.215+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.219+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T04:18:48.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.219+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.223+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.223+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.223+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T04:18:48.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.227+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.231+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.231+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.231+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T04:18:48.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.235+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.235+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.235+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.239+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T04:18:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.243+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.243+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.243+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.247+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T04:18:48.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.247+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.247+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.247+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.251+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T04:18:48.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.251+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.251+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.251+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.255+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T04:18:48.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.255+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.259+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.259+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.259+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T04:18:48.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.263+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.263+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.263+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.267+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T04:18:48.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.267+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.271+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.271+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.271+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T04:18:48.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.275+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.275+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.275+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.279+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T04:18:48.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.283+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.283+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.283+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.287+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T04:18:48.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.291+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.291+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.291+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.295+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T04:18:48.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.295+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.299+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.299+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.299+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T04:18:48.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.303+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.303+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.303+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.307+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T04:18:48.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.311+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.311+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.311+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.315+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T04:18:48.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.319+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.323+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.323+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.327+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T04:18:48.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.331+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.331+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.331+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.335+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T04:18:48.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.335+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.339+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.339+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.339+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T04:18:48.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.343+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.343+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.347+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.351+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T04:18:48.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.355+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.355+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.359+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.359+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T04:18:48.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.363+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.363+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.367+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.367+0000 7fef2ada4980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T04:18:48.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.371+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.375+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T04:18:48.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.375+0000 7fef2ada4980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T04:18:48.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.379+0000 7feddf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:48.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.387+0000 7fef2ada4980 20 remove_watcher() i=0 2024-04-03T04:18:48.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.387+0000 7fef2ada4980 2 removed watcher, disabling cache 2024-04-03T04:18:48.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.387+0000 7fef2ada4980 20 remove_watcher() i=1 2024-04-03T04:18:48.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.391+0000 7fef2ada4980 20 remove_watcher() i=2 2024-04-03T04:18:48.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.391+0000 7fef2ada4980 20 remove_watcher() i=3 2024-04-03T04:18:48.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.395+0000 7fef2ada4980 20 remove_watcher() i=4 2024-04-03T04:18:48.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.395+0000 7fef2ada4980 20 remove_watcher() i=5 2024-04-03T04:18:48.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.399+0000 7fef2ada4980 20 remove_watcher() i=6 2024-04-03T04:18:48.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:48.399+0000 7fef2ada4980 20 remove_watcher() i=7 2024-04-03T04:18:48.395 INFO:teuthology.run_tasks:Running task s3tests... 2024-04-03T04:18:48.410 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-04-03T04:18:48.411 INFO:tasks.s3tests:Downloading s3-tests... 2024-04-03T04:18:48.411 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-04-03T04:18:48.411 DEBUG:teuthology.orchestra.run.smithi104:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-04-03T04:18:48.440 INFO:teuthology.orchestra.run.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-04-03T04:18:49.164 INFO:tasks.s3tests:Creating rgw users... 2024-04-03T04:18:49.164 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-04-03T04:18:49.165 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --email foo.client.0+test@test.test --caps 'user-policy=*' --access-key QUGDIMHIYKODQGLABMQU --secret oSgXZYV8T7u5esLtEdR++ea6ebowxfXQuHZe34F8rqO7tBDwcwDs/A== --cluster ceph 2024-04-03T04:18:49.254 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:49.254 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:49.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.319+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 realm 2024-04-03T04:18:49.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:49.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:49.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:49.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.323+0000 7f5884ac8980 20 searching for the correct realm 2024-04-03T04:18:49.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.331+0000 7f58825e3640 0 -- 172.21.15.104:0/1660585912 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x55e66dda9090 msgr2=0x55e66ddab500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:49.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.335+0000 7f5881de2640 0 -- 172.21.15.104:0/1660585912 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f587400fa50 msgr2=0x7f5874055b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:49.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:49.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:49.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:49.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:49.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:49.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:49.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:49.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.343+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:49.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 zone default found 2024-04-03T04:18:49.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 4 Realm: () 2024-04-03T04:18:49.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 zonegroup default 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 started sync module instance, tier type = 2024-04-03T04:18:49.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.347+0000 7f5884ac8980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:49.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.363+0000 7f5884ac8980 20 add_watcher() i=0 2024-04-03T04:18:49.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.363+0000 7f5884ac8980 20 add_watcher() i=1 2024-04-03T04:18:49.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.363+0000 7f5884ac8980 20 add_watcher() i=2 2024-04-03T04:18:49.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.363+0000 7f5884ac8980 20 add_watcher() i=3 2024-04-03T04:18:49.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.363+0000 7f5884ac8980 20 add_watcher() i=4 2024-04-03T04:18:49.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.363+0000 7f5884ac8980 20 add_watcher() i=5 2024-04-03T04:18:49.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.363+0000 7f5884ac8980 20 add_watcher() i=6 2024-04-03T04:18:49.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.363+0000 7f5884ac8980 20 add_watcher() i=7 2024-04-03T04:18:49.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.363+0000 7f5884ac8980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:49.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5738fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:49.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:49.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:49.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 5 note: GC not initialized 2024-04-03T04:18:49.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f56b37fe640 20 reqs_thread_entry: start 2024-04-03T04:18:49.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:49.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 Filter name: none 2024-04-03T04:18:49.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f56b17fa640 20 reqs_thread_entry: start 2024-04-03T04:18:49.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-04-03T04:18:49.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 cache get: name=default.rgw.meta+users.keys+QUGDIMHIYKODQGLABMQU : miss 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 cache put: name=default.rgw.meta+users.keys+QUGDIMHIYKODQGLABMQU info.flags=0x0 2024-04-03T04:18:49.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 adding default.rgw.meta+users.keys+QUGDIMHIYKODQGLABMQU to cache LRU end 2024-04-03T04:18:49.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 cache get: name=default.rgw.meta+users.keys+QUGDIMHIYKODQGLABMQU : hit (negative entry) 2024-04-03T04:18:49.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 cache get: name=default.rgw.meta+users.keys+QUGDIMHIYKODQGLABMQU : hit (negative entry) 2024-04-03T04:18:49.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-04-03T04:18:49.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-04-03T04:18:49.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.367+0000 7f5884ac8980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-04-03T04:18:49.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.371+0000 7f5765ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562550 cookie 94448173887632 notifier 7665 bl.length()=641 2024-04-03T04:18:49.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.371+0000 7f5765ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-04-03T04:18:49.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.371+0000 7f5765ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-04-03T04:18:49.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.375+0000 7f5884ac8980 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2024-04-03T04:18:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.375+0000 7f5884ac8980 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-04-03T04:18:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.375+0000 7f5884ac8980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.email:foo.client.0+test@test.test, ofs0, ns] 2024-04-03T04:18:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.375+0000 7f5765ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562555 cookie 94448173954640 notifier 7665 bl.length()=194 2024-04-03T04:18:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.375+0000 7f5765ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2024-04-03T04:18:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.375+0000 7f5765ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-04-03T04:18:49.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.379+0000 7f5884ac8980 10 cache put: name=default.rgw.meta+users.keys+QUGDIMHIYKODQGLABMQU info.flags=0x7 2024-04-03T04:18:49.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.379+0000 7f5884ac8980 10 moving default.rgw.meta+users.keys+QUGDIMHIYKODQGLABMQU to cache LRU end 2024-04-03T04:18:49.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.379+0000 7f5884ac8980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:QUGDIMHIYKODQGLABMQU, ofs0, ns] 2024-04-03T04:18:49.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.379+0000 7f57657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562456 cookie 94448173958192 notifier 7665 bl.length()=186 2024-04-03T04:18:49.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.379+0000 7f57657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QUGDIMHIYKODQGLABMQU info.flags=0x7 2024-04-03T04:18:49.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.379+0000 7f57657fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QUGDIMHIYKODQGLABMQU to cache LRU end 2024-04-03T04:18:49.355 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T04:18:49.355 INFO:teuthology.orchestra.run.smithi104.stdout: "user_id": "foo.client.0", 2024-04-03T04:18:49.355 INFO:teuthology.orchestra.run.smithi104.stdout: "display_name": "Mr. foo.client.0", 2024-04-03T04:18:49.355 INFO:teuthology.orchestra.run.smithi104.stdout: "email": "foo.client.0+test@test.test", 2024-04-03T04:18:49.355 INFO:teuthology.orchestra.run.smithi104.stdout: "suspended": 0, 2024-04-03T04:18:49.355 INFO:teuthology.orchestra.run.smithi104.stdout: "max_buckets": 1000, 2024-04-03T04:18:49.355 INFO:teuthology.orchestra.run.smithi104.stdout: "subusers": [], 2024-04-03T04:18:49.355 INFO:teuthology.orchestra.run.smithi104.stdout: "keys": [ 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: "user": "foo.client.0", 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: "access_key": "QUGDIMHIYKODQGLABMQU", 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: "secret_key": "oSgXZYV8T7u5esLtEdR++ea6ebowxfXQuHZe34F8rqO7tBDwcwDs/A==", 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: "active": true 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: "swift_keys": [], 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": [ 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "user-policy", 2024-04-03T04:18:49.356 INFO:teuthology.orchestra.run.smithi104.stdout: "perm": "*" 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "default_placement": "", 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "default_storage_class": "", 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "placement_tags": [], 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "bucket_quota": { 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:49.357 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: "user_quota": { 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: "temp_url_keys": [], 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "rgw", 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: "mfa_ids": [] 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T04:18:49.358 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.383+0000 7f5738fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.387+0000 7f5884ac8980 20 remove_watcher() i=0 2024-04-03T04:18:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.387+0000 7f5884ac8980 2 removed watcher, disabling cache 2024-04-03T04:18:49.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.387+0000 7f5884ac8980 20 remove_watcher() i=1 2024-04-03T04:18:49.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.391+0000 7f5884ac8980 20 remove_watcher() i=2 2024-04-03T04:18:49.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.391+0000 7f5884ac8980 20 remove_watcher() i=3 2024-04-03T04:18:49.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.395+0000 7f5884ac8980 20 remove_watcher() i=4 2024-04-03T04:18:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.395+0000 7f5884ac8980 20 remove_watcher() i=5 2024-04-03T04:18:49.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.399+0000 7f5884ac8980 20 remove_watcher() i=6 2024-04-03T04:18:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.399+0000 7f5884ac8980 20 remove_watcher() i=7 2024-04-03T04:18:49.386 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5008047408 --totp-seed 772RCAYEUYMPPHTMIIQSMU6JJ4PEHKH2ST5536UDH5NQEHKOU2Q4C5OLGIY3GAFY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-04-03T04:18:49.425 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:49.425 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:49.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.491+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.491+0000 7f3f65677980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.491+0000 7f3f65677980 20 realm 2024-04-03T04:18:49.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.491+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.491+0000 7f3f65677980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.491+0000 7f3f65677980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:49.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.491+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.491+0000 7f3f65677980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.491+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.495+0000 7f3f65677980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:49.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.495+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.495+0000 7f3f65677980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:49.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.495+0000 7f3f65677980 20 searching for the correct realm 2024-04-03T04:18:49.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.499+0000 7f3f63192640 0 -- 172.21.15.104:0/2505273089 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x5575d9f12410 msgr2=0x5575d9f148d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:18:49.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.711+0000 7f3f62991640 0 -- 172.21.15.104:0/2505273089 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f3f5c120ba0 msgr2=0x7f3f5c120330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:49.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.927+0000 7f3f65677980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:49.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.927+0000 7f3f65677980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:49.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.927+0000 7f3f65677980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:49.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.927+0000 7f3f65677980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:49.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.927+0000 7f3f65677980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:49.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.927+0000 7f3f65677980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:49.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.927+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:49.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:49.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 zone default found 2024-04-03T04:18:49.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 4 Realm: () 2024-04-03T04:18:49.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:49.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:49.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:49.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 zonegroup default 2024-04-03T04:18:49.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.931+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.935+0000 7f3f65677980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:49.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.935+0000 7f3f65677980 20 started sync module instance, tier type = 2024-04-03T04:18:49.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.935+0000 7f3f65677980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:49.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.959+0000 7f3f65677980 20 add_watcher() i=0 2024-04-03T04:18:49.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.959+0000 7f3f65677980 20 add_watcher() i=1 2024-04-03T04:18:49.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.959+0000 7f3f65677980 20 add_watcher() i=2 2024-04-03T04:18:49.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.959+0000 7f3f65677980 20 add_watcher() i=3 2024-04-03T04:18:49.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.959+0000 7f3f65677980 20 add_watcher() i=4 2024-04-03T04:18:49.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.959+0000 7f3f65677980 20 add_watcher() i=5 2024-04-03T04:18:49.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.959+0000 7f3f65677980 20 add_watcher() i=6 2024-04-03T04:18:49.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.959+0000 7f3f65677980 20 add_watcher() i=7 2024-04-03T04:18:49.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.959+0000 7f3f65677980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:49.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:49.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:49.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:49.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 5 note: GC not initialized 2024-04-03T04:18:49.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3e18fe1640 20 reqs_thread_entry: start 2024-04-03T04:18:49.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:49.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 20 Filter name: none 2024-04-03T04:18:49.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3d927fc640 20 reqs_thread_entry: start 2024-04-03T04:18:49.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-04-03T04:18:49.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 20 rados->read ofs=0 len=0 2024-04-03T04:18:49.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 20 rados_obj.operate() r=0 bl.length=456 2024-04-03T04:18:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-04-03T04:18:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-04-03T04:18:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:49.967+0000 7f3f65677980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:18:51.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.375+0000 7f3f65677980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-04-03T04:18:51.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.375+0000 7f3f65677980 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-04-03T04:18:51.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.375+0000 7f3f65677980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-04-03T04:18:51.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.375+0000 7f3e467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497143 cookie 93964656002000 notifier 7193 bl.length()=655 2024-04-03T04:18:51.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.375+0000 7f3e467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-04-03T04:18:51.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.375+0000 7f3e467fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-04-03T04:18:51.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.383+0000 7f3e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:51.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.387+0000 7f3f65677980 20 remove_watcher() i=0 2024-04-03T04:18:51.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.387+0000 7f3f65677980 2 removed watcher, disabling cache 2024-04-03T04:18:51.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.391+0000 7f3f65677980 20 remove_watcher() i=1 2024-04-03T04:18:51.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.395+0000 7f3f65677980 20 remove_watcher() i=2 2024-04-03T04:18:51.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.395+0000 7f3f65677980 20 remove_watcher() i=3 2024-04-03T04:18:51.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.399+0000 7f3f65677980 20 remove_watcher() i=4 2024-04-03T04:18:51.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.399+0000 7f3f65677980 20 remove_watcher() i=5 2024-04-03T04:18:51.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.403+0000 7f3f65677980 20 remove_watcher() i=6 2024-04-03T04:18:51.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.407+0000 7f3f65677980 20 remove_watcher() i=7 2024-04-03T04:18:51.398 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-04-03T04:18:51.398 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --email bar.client.0+test@test.test --caps 'user-policy=*' --access-key VUTBBRVDHVOONNFQSYDF --secret 3V5VAjNlXM1L3V3ZJNzbKHiEJiv/60+jnTY0dC4TY0uRzhv3uKypQw== --cluster ceph 2024-04-03T04:18:51.485 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:51.485 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:51.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.551+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.551+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.551+0000 7f61cf70a980 20 realm 2024-04-03T04:18:51.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.551+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.555+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.555+0000 7f61cf70a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:51.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.555+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.555+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.555+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.555+0000 7f61cf70a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:51.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.555+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.555+0000 7f61cf70a980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:51.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.555+0000 7f61cf70a980 20 searching for the correct realm 2024-04-03T04:18:51.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.559+0000 7f61cca24640 0 -- 172.21.15.104:0/528731231 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f61c00a5040 msgr2=0x7f61c00efa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:51.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.771+0000 7f61cda26640 0 -- 172.21.15.104:0/528731231 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x5578561c4aa0 msgr2=0x5578561c6eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:51.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:51.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 zone default found 2024-04-03T04:18:51.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 4 Realm: () 2024-04-03T04:18:51.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:51.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:51.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:51.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 zonegroup default 2024-04-03T04:18:51.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.791+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.795+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.795+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.795+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.795+0000 7f61cf70a980 20 started sync module instance, tier type = 2024-04-03T04:18:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.795+0000 7f61cf70a980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:51.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.815+0000 7f61cf70a980 20 add_watcher() i=0 2024-04-03T04:18:51.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.815+0000 7f61cf70a980 20 add_watcher() i=1 2024-04-03T04:18:51.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.815+0000 7f61cf70a980 20 add_watcher() i=2 2024-04-03T04:18:51.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.815+0000 7f61cf70a980 20 add_watcher() i=3 2024-04-03T04:18:51.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.815+0000 7f61cf70a980 20 add_watcher() i=4 2024-04-03T04:18:51.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.815+0000 7f61cf70a980 20 add_watcher() i=5 2024-04-03T04:18:51.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.815+0000 7f61cf70a980 20 add_watcher() i=6 2024-04-03T04:18:51.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.815+0000 7f61cf70a980 20 add_watcher() i=7 2024-04-03T04:18:51.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.815+0000 7f61cf70a980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:51.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.819+0000 7f6083fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:51.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.819+0000 7f61cf70a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:51.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.819+0000 7f61cf70a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:51.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.819+0000 7f61cf70a980 5 note: GC not initialized 2024-04-03T04:18:51.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f6082fe5640 20 reqs_thread_entry: start 2024-04-03T04:18:51.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:51.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 20 Filter name: none 2024-04-03T04:18:51.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f6080fe1640 20 reqs_thread_entry: start 2024-04-03T04:18:51.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-04-03T04:18:51.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-04-03T04:18:51.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-04-03T04:18:51.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2024-04-03T04:18:51.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2024-04-03T04:18:51.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-04-03T04:18:51.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 cache get: name=default.rgw.meta+users.keys+VUTBBRVDHVOONNFQSYDF : miss 2024-04-03T04:18:51.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 cache put: name=default.rgw.meta+users.keys+VUTBBRVDHVOONNFQSYDF info.flags=0x0 2024-04-03T04:18:51.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 adding default.rgw.meta+users.keys+VUTBBRVDHVOONNFQSYDF to cache LRU end 2024-04-03T04:18:51.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 cache get: name=default.rgw.meta+users.keys+VUTBBRVDHVOONNFQSYDF : hit (negative entry) 2024-04-03T04:18:51.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.823+0000 7f61cf70a980 10 cache get: name=default.rgw.meta+users.keys+VUTBBRVDHVOONNFQSYDF : hit (negative entry) 2024-04-03T04:18:51.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.827+0000 7f61cf70a980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-04-03T04:18:51.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.827+0000 7f61cf70a980 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-04-03T04:18:51.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.827+0000 7f61cf70a980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-04-03T04:18:51.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.831+0000 7f60b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497069 cookie 93975329165328 notifier 7701 bl.length()=641 2024-04-03T04:18:51.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.831+0000 7f60b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-04-03T04:18:51.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.831+0000 7f60b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-04-03T04:18:51.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.835+0000 7f61cf70a980 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2024-04-03T04:18:51.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.835+0000 7f61cf70a980 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-04-03T04:18:51.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.835+0000 7f61cf70a980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:bar.client.0+test@test.test, ofs0, ns] 2024-04-03T04:18:51.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.835+0000 7f60b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497070 cookie 93975329165328 notifier 7701 bl.length()=194 2024-04-03T04:18:51.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.835+0000 7f60b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2024-04-03T04:18:51.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.835+0000 7f60b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-04-03T04:18:51.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.843+0000 7f61cf70a980 10 cache put: name=default.rgw.meta+users.keys+VUTBBRVDHVOONNFQSYDF info.flags=0x7 2024-04-03T04:18:51.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.843+0000 7f61cf70a980 10 moving default.rgw.meta+users.keys+VUTBBRVDHVOONNFQSYDF to cache LRU end 2024-04-03T04:18:51.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.843+0000 7f61cf70a980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:VUTBBRVDHVOONNFQSYDF, ofs0, ns] 2024-04-03T04:18:51.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.843+0000 7f60b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497144 cookie 93975329139072 notifier 7701 bl.length()=186 2024-04-03T04:18:51.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.843+0000 7f60b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VUTBBRVDHVOONNFQSYDF info.flags=0x7 2024-04-03T04:18:51.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.843+0000 7f60b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VUTBBRVDHVOONNFQSYDF to cache LRU end 2024-04-03T04:18:51.819 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T04:18:51.819 INFO:teuthology.orchestra.run.smithi104.stdout: "user_id": "bar.client.0", 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: "display_name": "Mr. bar.client.0", 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: "email": "bar.client.0+test@test.test", 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: "suspended": 0, 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: "max_buckets": 1000, 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: "subusers": [], 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: "keys": [ 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: "user": "bar.client.0", 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: "access_key": "VUTBBRVDHVOONNFQSYDF", 2024-04-03T04:18:51.820 INFO:teuthology.orchestra.run.smithi104.stdout: "secret_key": "3V5VAjNlXM1L3V3ZJNzbKHiEJiv/60+jnTY0dC4TY0uRzhv3uKypQw==", 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "active": true 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "swift_keys": [], 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": [ 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "user-policy", 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "perm": "*" 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "default_placement": "", 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "default_storage_class": "", 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "placement_tags": [], 2024-04-03T04:18:51.821 INFO:teuthology.orchestra.run.smithi104.stdout: "bucket_quota": { 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "user_quota": { 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "temp_url_keys": [], 2024-04-03T04:18:51.822 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "rgw", 2024-04-03T04:18:51.823 INFO:teuthology.orchestra.run.smithi104.stdout: "mfa_ids": [] 2024-04-03T04:18:51.823 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T04:18:51.823 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:51.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.847+0000 7f6083fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:51.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.851+0000 7f61cf70a980 20 remove_watcher() i=0 2024-04-03T04:18:51.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.851+0000 7f61cf70a980 2 removed watcher, disabling cache 2024-04-03T04:18:51.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.855+0000 7f61cf70a980 20 remove_watcher() i=1 2024-04-03T04:18:51.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.855+0000 7f61cf70a980 20 remove_watcher() i=2 2024-04-03T04:18:51.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.859+0000 7f61cf70a980 20 remove_watcher() i=3 2024-04-03T04:18:51.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.859+0000 7f61cf70a980 20 remove_watcher() i=4 2024-04-03T04:18:51.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.863+0000 7f61cf70a980 20 remove_watcher() i=5 2024-04-03T04:18:51.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.863+0000 7f61cf70a980 20 remove_watcher() i=6 2024-04-03T04:18:51.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.863+0000 7f61cf70a980 20 remove_watcher() i=7 2024-04-03T04:18:51.855 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 9303910729 --totp-seed SZYD6BPDXTMNNQTR6OAYXCGREYLJT4SSH3XFHJERCMYMPOSZ5XLGYETIZDDIPJVT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-04-03T04:18:51.900 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:51.900 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:51.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.967+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.967+0000 7fbd3a03d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.967+0000 7fbd3a03d980 20 realm 2024-04-03T04:18:51.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.967+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.967+0000 7fbd3a03d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.967+0000 7fbd3a03d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:51.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.967+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.967+0000 7fbd3a03d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:51.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.967+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.971+0000 7fbd3a03d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:51.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.971+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:51.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.971+0000 7fbd3a03d980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:51.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.971+0000 7fbd3a03d980 20 searching for the correct realm 2024-04-03T04:18:51.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.975+0000 7fbd37357640 0 -- 172.21.15.104:0/2751773017 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fbd300602c0 msgr2=0x7fbd30075da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:18:51.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:51.983+0000 7fbd37357640 0 -- 172.21.15.104:0/2751773017 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fbd28019040 msgr2=0x7fbd2804d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T04:18:52.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.199+0000 7fbd3a03d980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:52.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.199+0000 7fbd3a03d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:52.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.199+0000 7fbd3a03d980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:52.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.199+0000 7fbd3a03d980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:52.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.199+0000 7fbd3a03d980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:52.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.199+0000 7fbd3a03d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:52.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.199+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.199+0000 7fbd3a03d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.199+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:52.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:52.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 zone default found 2024-04-03T04:18:52.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 4 Realm: () 2024-04-03T04:18:52.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:52.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:52.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:52.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 zonegroup default 2024-04-03T04:18:52.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 started sync module instance, tier type = 2024-04-03T04:18:52.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.203+0000 7fbd3a03d980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:52.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.227+0000 7fbd3a03d980 20 add_watcher() i=0 2024-04-03T04:18:52.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.227+0000 7fbd3a03d980 20 add_watcher() i=1 2024-04-03T04:18:52.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.227+0000 7fbd3a03d980 20 add_watcher() i=2 2024-04-03T04:18:52.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.227+0000 7fbd3a03d980 20 add_watcher() i=3 2024-04-03T04:18:52.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.227+0000 7fbd3a03d980 20 add_watcher() i=4 2024-04-03T04:18:52.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.227+0000 7fbd3a03d980 20 add_watcher() i=5 2024-04-03T04:18:52.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.227+0000 7fbd3a03d980 20 add_watcher() i=6 2024-04-03T04:18:52.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.231+0000 7fbd3a03d980 20 add_watcher() i=7 2024-04-03T04:18:52.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.231+0000 7fbd3a03d980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:52.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.235+0000 7fbbee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:52.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.235+0000 7fbd3a03d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:52.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.235+0000 7fbd3a03d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:52.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.235+0000 7fbd3a03d980 5 note: GC not initialized 2024-04-03T04:18:52.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.235+0000 7fbbed7e2640 20 reqs_thread_entry: start 2024-04-03T04:18:52.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.235+0000 7fbd3a03d980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:52.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.235+0000 7fbd3a03d980 20 Filter name: none 2024-04-03T04:18:52.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.239+0000 7fbbe67fc640 20 reqs_thread_entry: start 2024-04-03T04:18:52.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.239+0000 7fbd3a03d980 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-04-03T04:18:52.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.239+0000 7fbd3a03d980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.239+0000 7fbd3a03d980 20 rados_obj.operate() r=0 bl.length=456 2024-04-03T04:18:52.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.239+0000 7fbd3a03d980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-04-03T04:18:52.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.239+0000 7fbd3a03d980 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-04-03T04:18:52.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.239+0000 7fbd3a03d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:18:52.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.247+0000 7fbd3a03d980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-04-03T04:18:52.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.247+0000 7fbd3a03d980 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-04-03T04:18:52.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.247+0000 7fbd3a03d980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-04-03T04:18:52.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.247+0000 7fbc16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497071 cookie 94810095024176 notifier 7223 bl.length()=655 2024-04-03T04:18:52.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.247+0000 7fbc16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-04-03T04:18:52.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.247+0000 7fbc16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-04-03T04:18:52.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.251+0000 7fbbee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:52.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.255+0000 7fbd3a03d980 20 remove_watcher() i=0 2024-04-03T04:18:52.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.255+0000 7fbd3a03d980 2 removed watcher, disabling cache 2024-04-03T04:18:52.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.259+0000 7fbd3a03d980 20 remove_watcher() i=1 2024-04-03T04:18:52.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.259+0000 7fbd3a03d980 20 remove_watcher() i=2 2024-04-03T04:18:52.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.263+0000 7fbd3a03d980 20 remove_watcher() i=3 2024-04-03T04:18:52.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.263+0000 7fbd3a03d980 20 remove_watcher() i=4 2024-04-03T04:18:52.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.267+0000 7fbd3a03d980 20 remove_watcher() i=5 2024-04-03T04:18:52.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.267+0000 7fbd3a03d980 20 remove_watcher() i=6 2024-04-03T04:18:52.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.271+0000 7fbd3a03d980 20 remove_watcher() i=7 2024-04-03T04:18:52.263 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-04-03T04:18:52.263 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --email 'testx$tenanteduser.client.0+test@test.test' --caps 'user-policy=*' --access-key WISWHMKAXTTODHSQRQLU --secret kOAQaqQ3aSLB43QxhLv1zj4+xUUFdHZXoD69RBG+hQOHzPW8DU5ttQ== --cluster ceph 2024-04-03T04:18:52.352 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:52.352 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:52.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.435+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.435+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.435+0000 7f961bdaa980 20 realm 2024-04-03T04:18:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.435+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.435+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.435+0000 7f961bdaa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.435+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.435+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.435+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.439+0000 7f961bdaa980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:52.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.439+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.439+0000 7f961bdaa980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:52.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.439+0000 7f961bdaa980 20 searching for the correct realm 2024-04-03T04:18:52.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.451+0000 7f96198c5640 0 -- 172.21.15.104:0/101795510 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x55db050df030 msgr2=0x55db050e14f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.463+0000 7f961a0c6640 0 -- 172.21.15.104:0/101795510 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f9614029060 msgr2=0x7f9614055500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:52.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:52.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:52.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:52.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:52.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.471+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:52.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 zone default found 2024-04-03T04:18:52.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 4 Realm: () 2024-04-03T04:18:52.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:52.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:52.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:52.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 zonegroup default 2024-04-03T04:18:52.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 started sync module instance, tier type = 2024-04-03T04:18:52.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.475+0000 7f961bdaa980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.491+0000 7f961bdaa980 20 add_watcher() i=0 2024-04-03T04:18:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.491+0000 7f961bdaa980 20 add_watcher() i=1 2024-04-03T04:18:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.491+0000 7f961bdaa980 20 add_watcher() i=2 2024-04-03T04:18:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.491+0000 7f961bdaa980 20 add_watcher() i=3 2024-04-03T04:18:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.491+0000 7f961bdaa980 20 add_watcher() i=4 2024-04-03T04:18:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.491+0000 7f961bdaa980 20 add_watcher() i=5 2024-04-03T04:18:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.491+0000 7f961bdaa980 20 add_watcher() i=6 2024-04-03T04:18:52.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.491+0000 7f961bdaa980 20 add_watcher() i=7 2024-04-03T04:18:52.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.491+0000 7f961bdaa980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f94cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 5 note: GC not initialized 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f94ca7fc640 20 reqs_thread_entry: start 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 20 Filter name: none 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f943bfff640 20 reqs_thread_entry: start 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-04-03T04:18:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 10 cache get: name=default.rgw.meta+users.keys+WISWHMKAXTTODHSQRQLU : miss 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.495+0000 7f961bdaa980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f961bdaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f961bdaa980 10 cache put: name=default.rgw.meta+users.keys+WISWHMKAXTTODHSQRQLU info.flags=0x0 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f961bdaa980 10 adding default.rgw.meta+users.keys+WISWHMKAXTTODHSQRQLU to cache LRU end 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f961bdaa980 10 cache get: name=default.rgw.meta+users.keys+WISWHMKAXTTODHSQRQLU : hit (negative entry) 2024-04-03T04:18:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f961bdaa980 10 cache get: name=default.rgw.meta+users.keys+WISWHMKAXTTODHSQRQLU : hit (negative entry) 2024-04-03T04:18:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f961bdaa980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-04-03T04:18:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f961bdaa980 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-04-03T04:18:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f961bdaa980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-04-03T04:18:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f94fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464444 cookie 94399171074192 notifier 7740 bl.length()=715 2024-04-03T04:18:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f94fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-04-03T04:18:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.499+0000 7f94fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-04-03T04:18:52.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.503+0000 7f961bdaa980 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2024-04-03T04:18:52.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.503+0000 7f961bdaa980 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-04-03T04:18:52.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.503+0000 7f961bdaa980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test, ofs0, ns] 2024-04-03T04:18:52.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.503+0000 7f94fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94399171070912 notifier 7740 bl.length()=224 2024-04-03T04:18:52.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.503+0000 7f94fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2024-04-03T04:18:52.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.503+0000 7f94fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-04-03T04:18:52.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.507+0000 7f961bdaa980 10 cache put: name=default.rgw.meta+users.keys+WISWHMKAXTTODHSQRQLU info.flags=0x7 2024-04-03T04:18:52.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.507+0000 7f961bdaa980 10 moving default.rgw.meta+users.keys+WISWHMKAXTTODHSQRQLU to cache LRU end 2024-04-03T04:18:52.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.507+0000 7f961bdaa980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:WISWHMKAXTTODHSQRQLU, ofs0, ns] 2024-04-03T04:18:52.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.507+0000 7f94fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94399171064656 notifier 7740 bl.length()=201 2024-04-03T04:18:52.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.507+0000 7f94fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WISWHMKAXTTODHSQRQLU info.flags=0x7 2024-04-03T04:18:52.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.507+0000 7f94fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WISWHMKAXTTODHSQRQLU to cache LRU end 2024-04-03T04:18:52.485 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T04:18:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: "user_id": "testx$tenanteduser.client.0", 2024-04-03T04:18:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2024-04-03T04:18:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2024-04-03T04:18:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: "suspended": 0, 2024-04-03T04:18:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: "max_buckets": 1000, 2024-04-03T04:18:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: "subusers": [], 2024-04-03T04:18:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: "keys": [ 2024-04-03T04:18:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: "user": "testx$tenanteduser.client.0", 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: "access_key": "WISWHMKAXTTODHSQRQLU", 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: "secret_key": "kOAQaqQ3aSLB43QxhLv1zj4+xUUFdHZXoD69RBG+hQOHzPW8DU5ttQ==", 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: "active": true 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: "swift_keys": [], 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": [ 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "user-policy", 2024-04-03T04:18:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: "perm": "*" 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "default_placement": "", 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "default_storage_class": "", 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "placement_tags": [], 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "bucket_quota": { 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: "user_quota": { 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: "temp_url_keys": [], 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "rgw", 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: "mfa_ids": [] 2024-04-03T04:18:52.488 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T04:18:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:52.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.511+0000 7f94cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.515+0000 7f961bdaa980 20 remove_watcher() i=0 2024-04-03T04:18:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.515+0000 7f961bdaa980 2 removed watcher, disabling cache 2024-04-03T04:18:52.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.519+0000 7f961bdaa980 20 remove_watcher() i=1 2024-04-03T04:18:52.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.519+0000 7f961bdaa980 20 remove_watcher() i=2 2024-04-03T04:18:52.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.523+0000 7f961bdaa980 20 remove_watcher() i=3 2024-04-03T04:18:52.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.523+0000 7f961bdaa980 20 remove_watcher() i=4 2024-04-03T04:18:52.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.527+0000 7f961bdaa980 20 remove_watcher() i=5 2024-04-03T04:18:52.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.527+0000 7f961bdaa980 20 remove_watcher() i=6 2024-04-03T04:18:52.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.527+0000 7f961bdaa980 20 remove_watcher() i=7 2024-04-03T04:18:52.517 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 9811787472 --totp-seed 4R2HEWSZT7PEPFQPKWOSNKRLAVJ53DEJ25CYMMBE3FGZO4TSZXQ752L6GU2FSHXY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-04-03T04:18:52.558 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:52.558 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:52.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.623+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 realm 2024-04-03T04:18:52.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:52.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:52.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:52.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:52.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:52.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.627+0000 7f33c7ce5980 20 searching for the correct realm 2024-04-03T04:18:52.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.631+0000 7f33c6001640 0 -- 172.21.15.104:0/517283124 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f33c00f8080 msgr2=0x7f33c0126810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:52.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:52.847+0000 7f33c4fff640 0 -- 172.21.15.104:0/517283124 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f33c0100ba0 msgr2=0x7f33c00b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:53.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.063+0000 7f33c7ce5980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:53.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.063+0000 7f33c7ce5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:53.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.063+0000 7f33c7ce5980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:53.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.063+0000 7f33c7ce5980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:53.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.063+0000 7f33c7ce5980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:53.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.063+0000 7f33c7ce5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:53.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.063+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.063+0000 7f33c7ce5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.063+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 zone default found 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 4 Realm: () 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 zonegroup default 2024-04-03T04:18:53.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 started sync module instance, tier type = 2024-04-03T04:18:53.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.067+0000 7f33c7ce5980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:53.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.091+0000 7f33c7ce5980 20 add_watcher() i=0 2024-04-03T04:18:53.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.091+0000 7f33c7ce5980 20 add_watcher() i=1 2024-04-03T04:18:53.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.091+0000 7f33c7ce5980 20 add_watcher() i=2 2024-04-03T04:18:53.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.091+0000 7f33c7ce5980 20 add_watcher() i=3 2024-04-03T04:18:53.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.091+0000 7f33c7ce5980 20 add_watcher() i=4 2024-04-03T04:18:53.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.091+0000 7f33c7ce5980 20 add_watcher() i=5 2024-04-03T04:18:53.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.091+0000 7f33c7ce5980 20 add_watcher() i=6 2024-04-03T04:18:53.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.095+0000 7f33c7ce5980 20 add_watcher() i=7 2024-04-03T04:18:53.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.095+0000 7f33c7ce5980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f327b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 5 note: GC not initialized 2024-04-03T04:18:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f327a7e4640 20 reqs_thread_entry: start 2024-04-03T04:18:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 20 Filter name: none 2024-04-03T04:18:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f31ebfff640 20 reqs_thread_entry: start 2024-04-03T04:18:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-04-03T04:18:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 20 rados_obj.operate() r=0 bl.length=515 2024-04-03T04:18:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-04-03T04:18:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-04-03T04:18:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.099+0000 7f33c7ce5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:18:53.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.103+0000 7f33c7ce5980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-04-03T04:18:53.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.103+0000 7f33c7ce5980 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-04-03T04:18:53.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.103+0000 7f33c7ce5980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-04-03T04:18:53.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.107+0000 7f32a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464445 cookie 94046813330224 notifier 7758 bl.length()=729 2024-04-03T04:18:53.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.107+0000 7f32a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-04-03T04:18:53.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.107+0000 7f32a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-04-03T04:18:53.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.107+0000 7f327b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:53.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.115+0000 7f33c7ce5980 20 remove_watcher() i=0 2024-04-03T04:18:53.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.115+0000 7f33c7ce5980 2 removed watcher, disabling cache 2024-04-03T04:18:53.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.119+0000 7f33c7ce5980 20 remove_watcher() i=1 2024-04-03T04:18:53.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.119+0000 7f33c7ce5980 20 remove_watcher() i=2 2024-04-03T04:18:53.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.123+0000 7f33c7ce5980 20 remove_watcher() i=3 2024-04-03T04:18:53.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.123+0000 7f33c7ce5980 20 remove_watcher() i=4 2024-04-03T04:18:53.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.127+0000 7f33c7ce5980 20 remove_watcher() i=5 2024-04-03T04:18:53.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.127+0000 7f33c7ce5980 20 remove_watcher() i=6 2024-04-03T04:18:53.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.127+0000 7f33c7ce5980 20 remove_watcher() i=7 2024-04-03T04:18:53.119 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-04-03T04:18:53.119 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name 'Mr. foobar.client.0' --email foobar.client.0+test@test.test --caps 'user-policy=*' --access-key FQWIKYYGXOXIPJLUAFCH --secret m3qPZD4E5fznRgbIxqmkYowSrFLuMMLUCqt9iyvzI3LpX2YGgHLdEQ== --cluster ceph 2024-04-03T04:18:53.210 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:53.210 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:53.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.275+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.275+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.275+0000 7f7e184ac980 20 realm 2024-04-03T04:18:53.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.275+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.275+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.275+0000 7f7e184ac980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:53.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.275+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.275+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.275+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.279+0000 7f7e184ac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:53.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.279+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.279+0000 7f7e184ac980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:53.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.279+0000 7f7e184ac980 20 searching for the correct realm 2024-04-03T04:18:53.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.283+0000 7f7e157c6640 0 -- 172.21.15.104:0/253456974 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x564546ea3310 msgr2=0x7f7e08008440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:53.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.291+0000 7f7e157c6640 0 -- 172.21.15.104:0/253456974 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f7e10111420 msgr2=0x7f7e100bf0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:53.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.507+0000 7f7e184ac980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:53.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.507+0000 7f7e184ac980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:53.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.507+0000 7f7e184ac980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:53.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.507+0000 7f7e184ac980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:53.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.507+0000 7f7e184ac980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:53.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.507+0000 7f7e184ac980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:53.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.507+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.507+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.507+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:53.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:53.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 zone default found 2024-04-03T04:18:53.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 4 Realm: () 2024-04-03T04:18:53.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:53.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:53.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:53.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 zonegroup default 2024-04-03T04:18:53.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 started sync module instance, tier type = 2024-04-03T04:18:53.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.511+0000 7f7e184ac980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:53.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.535+0000 7f7e184ac980 20 add_watcher() i=0 2024-04-03T04:18:53.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.535+0000 7f7e184ac980 20 add_watcher() i=1 2024-04-03T04:18:53.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.535+0000 7f7e184ac980 20 add_watcher() i=2 2024-04-03T04:18:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.535+0000 7f7e184ac980 20 add_watcher() i=3 2024-04-03T04:18:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.535+0000 7f7e184ac980 20 add_watcher() i=4 2024-04-03T04:18:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.535+0000 7f7e184ac980 20 add_watcher() i=5 2024-04-03T04:18:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.535+0000 7f7e184ac980 20 add_watcher() i=6 2024-04-03T04:18:53.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.535+0000 7f7e184ac980 20 add_watcher() i=7 2024-04-03T04:18:53.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.535+0000 7f7e184ac980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.539+0000 7f7ccc7e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.539+0000 7f7e184ac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.539+0000 7f7e184ac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.539+0000 7f7e184ac980 5 note: GC not initialized 2024-04-03T04:18:53.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7ccb7e6640 20 reqs_thread_entry: start 2024-04-03T04:18:53.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:53.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 20 Filter name: none 2024-04-03T04:18:53.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7cc97e2640 20 reqs_thread_entry: start 2024-04-03T04:18:53.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-04-03T04:18:53.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-04-03T04:18:53.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:53.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 cache get: name=default.rgw.meta+users.email+foobar.client.0+test@test.test : miss 2024-04-03T04:18:53.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x0 2024-04-03T04:18:53.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 adding default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-04-03T04:18:53.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 cache get: name=default.rgw.meta+users.keys+FQWIKYYGXOXIPJLUAFCH : miss 2024-04-03T04:18:53.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 cache put: name=default.rgw.meta+users.keys+FQWIKYYGXOXIPJLUAFCH info.flags=0x0 2024-04-03T04:18:53.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 adding default.rgw.meta+users.keys+FQWIKYYGXOXIPJLUAFCH to cache LRU end 2024-04-03T04:18:53.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 cache get: name=default.rgw.meta+users.keys+FQWIKYYGXOXIPJLUAFCH : hit (negative entry) 2024-04-03T04:18:53.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.543+0000 7f7e184ac980 10 cache get: name=default.rgw.meta+users.keys+FQWIKYYGXOXIPJLUAFCH : hit (negative entry) 2024-04-03T04:18:53.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.547+0000 7f7e184ac980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-04-03T04:18:53.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.547+0000 7f7e184ac980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:53.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.547+0000 7f7e184ac980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-04-03T04:18:53.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.547+0000 7f7cf97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 94855544488864 notifier 7274 bl.length()=656 2024-04-03T04:18:53.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.547+0000 7f7cf97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-04-03T04:18:53.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.547+0000 7f7cf97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:53.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.551+0000 7f7e184ac980 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2024-04-03T04:18:53.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.551+0000 7f7e184ac980 10 moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-04-03T04:18:53.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.551+0000 7f7e184ac980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:foobar.client.0+test@test.test, ofs0, ns] 2024-04-03T04:18:53.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.551+0000 7f7cf97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464446 cookie 94855544482736 notifier 7274 bl.length()=200 2024-04-03T04:18:53.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.551+0000 7f7cf97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2024-04-03T04:18:53.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.551+0000 7f7cf97fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-04-03T04:18:53.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.555+0000 7f7e184ac980 10 cache put: name=default.rgw.meta+users.keys+FQWIKYYGXOXIPJLUAFCH info.flags=0x7 2024-04-03T04:18:53.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.555+0000 7f7e184ac980 10 moving default.rgw.meta+users.keys+FQWIKYYGXOXIPJLUAFCH to cache LRU end 2024-04-03T04:18:53.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.555+0000 7f7e184ac980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:FQWIKYYGXOXIPJLUAFCH, ofs0, ns] 2024-04-03T04:18:53.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.555+0000 7f7cf8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464341 cookie 94855544469920 notifier 7274 bl.length()=189 2024-04-03T04:18:53.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.555+0000 7f7cf8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FQWIKYYGXOXIPJLUAFCH info.flags=0x7 2024-04-03T04:18:53.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.555+0000 7f7cf8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FQWIKYYGXOXIPJLUAFCH to cache LRU end 2024-04-03T04:18:53.533 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T04:18:53.533 INFO:teuthology.orchestra.run.smithi104.stdout: "user_id": "foobar.client.0", 2024-04-03T04:18:53.533 INFO:teuthology.orchestra.run.smithi104.stdout: "display_name": "Mr. foobar.client.0", 2024-04-03T04:18:53.533 INFO:teuthology.orchestra.run.smithi104.stdout: "email": "foobar.client.0+test@test.test", 2024-04-03T04:18:53.533 INFO:teuthology.orchestra.run.smithi104.stdout: "suspended": 0, 2024-04-03T04:18:53.533 INFO:teuthology.orchestra.run.smithi104.stdout: "max_buckets": 1000, 2024-04-03T04:18:53.533 INFO:teuthology.orchestra.run.smithi104.stdout: "subusers": [], 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: "keys": [ 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: "user": "foobar.client.0", 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: "access_key": "FQWIKYYGXOXIPJLUAFCH", 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: "secret_key": "m3qPZD4E5fznRgbIxqmkYowSrFLuMMLUCqt9iyvzI3LpX2YGgHLdEQ==", 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: "active": true 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: "swift_keys": [], 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": [ 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "user-policy", 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: "perm": "*" 2024-04-03T04:18:53.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "default_placement": "", 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "default_storage_class": "", 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "placement_tags": [], 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "bucket_quota": { 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "user_quota": { 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:53.535 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stdout: "temp_url_keys": [], 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "rgw", 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stdout: "mfa_ids": [] 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:53.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.559+0000 7f7ccc7e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:53.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.567+0000 7f7e184ac980 20 remove_watcher() i=0 2024-04-03T04:18:53.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.567+0000 7f7e184ac980 2 removed watcher, disabling cache 2024-04-03T04:18:53.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.567+0000 7f7e184ac980 20 remove_watcher() i=1 2024-04-03T04:18:53.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.571+0000 7f7e184ac980 20 remove_watcher() i=2 2024-04-03T04:18:53.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.571+0000 7f7e184ac980 20 remove_watcher() i=3 2024-04-03T04:18:53.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.575+0000 7f7e184ac980 20 remove_watcher() i=4 2024-04-03T04:18:53.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.575+0000 7f7e184ac980 20 remove_watcher() i=5 2024-04-03T04:18:53.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.579+0000 7f7e184ac980 20 remove_watcher() i=6 2024-04-03T04:18:53.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.579+0000 7f7e184ac980 20 remove_watcher() i=7 2024-04-03T04:18:53.571 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 4349984641 --totp-seed TE63KRLQA3MAGJM4A2IO42AXBDNL65K5DVEUSHBCSHB6YVQB2O2Q7Z5KZ63SAZAU --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-04-03T04:18:53.661 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:53.661 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:53.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.727+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.727+0000 7fbd0ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.727+0000 7fbd0ed53980 20 realm 2024-04-03T04:18:53.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.727+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.727+0000 7fbd0ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.727+0000 7fbd0ed53980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:53.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.727+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.731+0000 7fbd0ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.731+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.731+0000 7fbd0ed53980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:53.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.731+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.731+0000 7fbd0ed53980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:53.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.731+0000 7fbd0ed53980 20 searching for the correct realm 2024-04-03T04:18:53.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.735+0000 7fbd0c06d640 0 -- 172.21.15.104:0/1172468775 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fbcfc0c1020 msgr2=0x7fbcfc0f0030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:53.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.743+0000 7fbd0c06d640 0 -- 172.21.15.104:0/1172468775 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7fbd04039730 msgr2=0x7fbd040468f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:53.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.959+0000 7fbd0ed53980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.959+0000 7fbd0ed53980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.959+0000 7fbd0ed53980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.959+0000 7fbd0ed53980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.959+0000 7fbd0ed53980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.959+0000 7fbd0ed53980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.959+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.959+0000 7fbd0ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.959+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 zone default found 2024-04-03T04:18:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 4 Realm: () 2024-04-03T04:18:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 zonegroup default 2024-04-03T04:18:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.963+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.967+0000 7fbd0ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:53.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.967+0000 7fbd0ed53980 20 started sync module instance, tier type = 2024-04-03T04:18:53.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.967+0000 7fbd0ed53980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:53.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.991+0000 7fbd0ed53980 20 add_watcher() i=0 2024-04-03T04:18:53.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.991+0000 7fbd0ed53980 20 add_watcher() i=1 2024-04-03T04:18:53.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.991+0000 7fbd0ed53980 20 add_watcher() i=2 2024-04-03T04:18:53.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.991+0000 7fbd0ed53980 20 add_watcher() i=3 2024-04-03T04:18:53.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.991+0000 7fbd0ed53980 20 add_watcher() i=4 2024-04-03T04:18:53.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.991+0000 7fbd0ed53980 20 add_watcher() i=5 2024-04-03T04:18:53.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.991+0000 7fbd0ed53980 20 add_watcher() i=6 2024-04-03T04:18:53.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.991+0000 7fbd0ed53980 20 add_watcher() i=7 2024-04-03T04:18:53.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.991+0000 7fbd0ed53980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:53.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.995+0000 7fbbc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:53.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.995+0000 7fbd0ed53980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:53.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.995+0000 7fbd0ed53980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:53.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.995+0000 7fbd0ed53980 5 note: GC not initialized 2024-04-03T04:18:53.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbbc1fe3640 20 reqs_thread_entry: start 2024-04-03T04:18:53.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbd0ed53980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:53.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbd0ed53980 20 Filter name: none 2024-04-03T04:18:53.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbb337fe640 20 reqs_thread_entry: start 2024-04-03T04:18:53.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbd0ed53980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-04-03T04:18:53.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbd0ed53980 20 rados->read ofs=0 len=0 2024-04-03T04:18:53.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbd0ed53980 20 rados_obj.operate() r=0 bl.length=468 2024-04-03T04:18:53.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbd0ed53980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-04-03T04:18:53.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbd0ed53980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:53.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:53.999+0000 7fbd0ed53980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:18:53.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.003+0000 7fbd0ed53980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-04-03T04:18:53.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.003+0000 7fbd0ed53980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:53.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.003+0000 7fbd0ed53980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-04-03T04:18:53.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.003+0000 7fbbe3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94395013479552 notifier 7292 bl.length()=670 2024-04-03T04:18:53.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.003+0000 7fbbe3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-04-03T04:18:53.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.003+0000 7fbbe3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:53.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.007+0000 7fbbc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:53.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.011+0000 7fbd0ed53980 20 remove_watcher() i=0 2024-04-03T04:18:53.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.011+0000 7fbd0ed53980 2 removed watcher, disabling cache 2024-04-03T04:18:53.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.015+0000 7fbd0ed53980 20 remove_watcher() i=1 2024-04-03T04:18:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.015+0000 7fbd0ed53980 20 remove_watcher() i=2 2024-04-03T04:18:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.019+0000 7fbd0ed53980 20 remove_watcher() i=3 2024-04-03T04:18:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.019+0000 7fbd0ed53980 20 remove_watcher() i=4 2024-04-03T04:18:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.023+0000 7fbd0ed53980 20 remove_watcher() i=5 2024-04-03T04:18:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.023+0000 7fbd0ed53980 20 remove_watcher() i=6 2024-04-03T04:18:53.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.023+0000 7fbd0ed53980 20 remove_watcher() i=7 2024-04-03T04:18:54.016 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'roles=*' --cluster ceph 2024-04-03T04:18:54.051 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:54.051 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:54.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.119+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.119+0000 7f80f3d7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.119+0000 7f80f3d7f980 20 realm 2024-04-03T04:18:54.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.119+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.119+0000 7f80f3d7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.119+0000 7f80f3d7f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:54.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.119+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.119+0000 7f80f3d7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.119+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.123+0000 7f80f3d7f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:54.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.123+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.123+0000 7f80f3d7f980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:54.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.123+0000 7f80f3d7f980 20 searching for the correct realm 2024-04-03T04:18:54.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.123+0000 7f80f1099640 0 -- 172.21.15.104:0/3470367391 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f80e40fab80 msgr2=0x7f80e40c3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:54.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.335+0000 7f80f209b640 0 -- 172.21.15.104:0/3470367391 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x55c178919d60 msgr2=0x55c17891c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:54.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:54.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:54.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:54.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:54.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:54.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:54.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:54.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 zone default found 2024-04-03T04:18:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 4 Realm: () 2024-04-03T04:18:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 zonegroup default 2024-04-03T04:18:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.355+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.359+0000 7f80f3d7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.359+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.359+0000 7f80f3d7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.359+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.359+0000 7f80f3d7f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.359+0000 7f80f3d7f980 20 started sync module instance, tier type = 2024-04-03T04:18:54.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.359+0000 7f80f3d7f980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:54.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.379+0000 7f80f3d7f980 20 add_watcher() i=0 2024-04-03T04:18:54.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.379+0000 7f80f3d7f980 20 add_watcher() i=1 2024-04-03T04:18:54.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.379+0000 7f80f3d7f980 20 add_watcher() i=2 2024-04-03T04:18:54.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.379+0000 7f80f3d7f980 20 add_watcher() i=3 2024-04-03T04:18:54.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.379+0000 7f80f3d7f980 20 add_watcher() i=4 2024-04-03T04:18:54.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.379+0000 7f80f3d7f980 20 add_watcher() i=5 2024-04-03T04:18:54.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.379+0000 7f80f3d7f980 20 add_watcher() i=6 2024-04-03T04:18:54.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.383+0000 7f80f3d7f980 20 add_watcher() i=7 2024-04-03T04:18:54.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.383+0000 7f80f3d7f980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:54.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f7fa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:54.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:54.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:54.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 5 note: GC not initialized 2024-04-03T04:18:54.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f7fa27fc640 20 reqs_thread_entry: start 2024-04-03T04:18:54.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:54.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 20 Filter name: none 2024-04-03T04:18:54.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f7f13fff640 20 reqs_thread_entry: start 2024-04-03T04:18:54.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-04-03T04:18:54.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 20 rados_obj.operate() r=0 bl.length=482 2024-04-03T04:18:54.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-04-03T04:18:54.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:54.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.387+0000 7f80f3d7f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:18:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.391+0000 7f80f3d7f980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-04-03T04:18:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.391+0000 7f80f3d7f980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.391+0000 7f80f3d7f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-04-03T04:18:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.391+0000 7f7fd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464348 cookie 94289439909456 notifier 7818 bl.length()=683 2024-04-03T04:18:54.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.391+0000 7f7fd57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-04-03T04:18:54.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.391+0000 7f7fd57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:54.368 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T04:18:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "user_id": "foobar.client.0", 2024-04-03T04:18:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "display_name": "Mr. foobar.client.0", 2024-04-03T04:18:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "email": "foobar.client.0+test@test.test", 2024-04-03T04:18:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "suspended": 0, 2024-04-03T04:18:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "max_buckets": 1000, 2024-04-03T04:18:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: "subusers": [], 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "keys": [ 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "user": "foobar.client.0", 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "access_key": "FQWIKYYGXOXIPJLUAFCH", 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "secret_key": "m3qPZD4E5fznRgbIxqmkYowSrFLuMMLUCqt9iyvzI3LpX2YGgHLdEQ==", 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "active": true 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "swift_keys": [], 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": [ 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "roles", 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: "perm": "*" 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "user-policy", 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "perm": "*" 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "default_placement": "", 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "default_storage_class": "", 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "placement_tags": [], 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "bucket_quota": { 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "user_quota": { 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "temp_url_keys": [], 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "rgw", 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "mfa_ids": [ 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: "4349984641" 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T04:18:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.395+0000 7f7fa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:54.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.399+0000 7f80f3d7f980 20 remove_watcher() i=0 2024-04-03T04:18:54.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.399+0000 7f80f3d7f980 2 removed watcher, disabling cache 2024-04-03T04:18:54.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.403+0000 7f80f3d7f980 20 remove_watcher() i=1 2024-04-03T04:18:54.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.407+0000 7f80f3d7f980 20 remove_watcher() i=2 2024-04-03T04:18:54.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.407+0000 7f80f3d7f980 20 remove_watcher() i=3 2024-04-03T04:18:54.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.411+0000 7f80f3d7f980 20 remove_watcher() i=4 2024-04-03T04:18:54.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.411+0000 7f80f3d7f980 20 remove_watcher() i=5 2024-04-03T04:18:54.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.411+0000 7f80f3d7f980 20 remove_watcher() i=6 2024-04-03T04:18:54.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.415+0000 7f80f3d7f980 20 remove_watcher() i=7 2024-04-03T04:18:54.405 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*' --cluster ceph 2024-04-03T04:18:54.484 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T04:18:54.484 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T04:18:54.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.551+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.551+0000 7efe665f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.551+0000 7efe665f1980 20 realm 2024-04-03T04:18:54.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.551+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.551+0000 7efe665f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.551+0000 7efe665f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T04:18:54.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.551+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.551+0000 7efe665f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.551+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.555+0000 7efe665f1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:54.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.555+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.555+0000 7efe665f1980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T04:18:54.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.555+0000 7efe665f1980 20 searching for the correct realm 2024-04-03T04:18:54.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.559+0000 7efe6490d640 0 -- 172.21.15.104:0/803929961 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7efe5c029070 msgr2=0x7efe5c029960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:54.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.771+0000 7efe6390b640 0 -- 172.21.15.104:0/803929961 >> [v2:172.21.15.130:6805/2542797043,v1:172.21.15.130:6808/2542797043] conn(0x55eac5bbe2b0 msgr2=0x55eac5bc0700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T04:18:54.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.783+0000 7efe665f1980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T04:18:54.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.783+0000 7efe665f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T04:18:54.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.783+0000 7efe665f1980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T04:18:54.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.783+0000 7efe665f1980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T04:18:54.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.783+0000 7efe665f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T04:18:54.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.783+0000 7efe665f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T04:18:54.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.783+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.783+0000 7efe665f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.783+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T04:18:54.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T04:18:54.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 zone default found 2024-04-03T04:18:54.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 4 Realm: () 2024-04-03T04:18:54.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T04:18:54.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T04:18:54.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T04:18:54.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 zonegroup default 2024-04-03T04:18:54.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T04:18:54.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 started sync module instance, tier type = 2024-04-03T04:18:54.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.787+0000 7efe665f1980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T04:18:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.811+0000 7efe665f1980 20 add_watcher() i=0 2024-04-03T04:18:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.811+0000 7efe665f1980 20 add_watcher() i=1 2024-04-03T04:18:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.811+0000 7efe665f1980 20 add_watcher() i=2 2024-04-03T04:18:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.811+0000 7efe665f1980 20 add_watcher() i=3 2024-04-03T04:18:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.811+0000 7efe665f1980 20 add_watcher() i=4 2024-04-03T04:18:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.811+0000 7efe665f1980 20 add_watcher() i=5 2024-04-03T04:18:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.811+0000 7efe665f1980 20 add_watcher() i=6 2024-04-03T04:18:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.815+0000 7efe665f1980 20 add_watcher() i=7 2024-04-03T04:18:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.815+0000 7efe665f1980 2 all 8 watchers are set, enabling cache 2024-04-03T04:18:54.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efd1b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:54.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T04:18:54.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T04:18:54.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 5 note: GC not initialized 2024-04-03T04:18:54.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efd1a7dc640 20 reqs_thread_entry: start 2024-04-03T04:18:54.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 20 init_complete bucket index max shards: 11 2024-04-03T04:18:54.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 20 Filter name: none 2024-04-03T04:18:54.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efd137fe640 20 reqs_thread_entry: start 2024-04-03T04:18:54.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-04-03T04:18:54.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 20 rados->read ofs=0 len=0 2024-04-03T04:18:54.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 20 rados_obj.operate() r=0 bl.length=495 2024-04-03T04:18:54.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-04-03T04:18:54.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:54.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.819+0000 7efe665f1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T04:18:54.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.823+0000 7efe665f1980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-04-03T04:18:54.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.823+0000 7efe665f1980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:54.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.823+0000 7efe665f1980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-04-03T04:18:54.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.823+0000 7efd3b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464349 cookie 94466828199232 notifier 7322 bl.length()=704 2024-04-03T04:18:54.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.823+0000 7efd3b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-04-03T04:18:54.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.823+0000 7efd3b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-04-03T04:18:54.799 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T04:18:54.799 INFO:teuthology.orchestra.run.smithi104.stdout: "user_id": "foobar.client.0", 2024-04-03T04:18:54.799 INFO:teuthology.orchestra.run.smithi104.stdout: "display_name": "Mr. foobar.client.0", 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "email": "foobar.client.0+test@test.test", 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "suspended": 0, 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "max_buckets": 1000, 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "subusers": [], 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "keys": [ 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "user": "foobar.client.0", 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "access_key": "FQWIKYYGXOXIPJLUAFCH", 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "secret_key": "m3qPZD4E5fznRgbIxqmkYowSrFLuMMLUCqt9iyvzI3LpX2YGgHLdEQ==", 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "active": true 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "swift_keys": [], 2024-04-03T04:18:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": [ 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "oidc-provider", 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: "perm": "*" 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "roles", 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: "perm": "*" 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "user-policy", 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: "perm": "*" 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-04-03T04:18:54.801 INFO:teuthology.orchestra.run.smithi104.stdout: "op_mask": "read, write, delete", 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "default_placement": "", 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "default_storage_class": "", 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "placement_tags": [], 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "bucket_quota": { 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "user_quota": { 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "enabled": false, 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "check_on_raw": false, 2024-04-03T04:18:54.802 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size": -1, 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout: "max_size_kb": 0, 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout: "max_objects": -1 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout: "temp_url_keys": [], 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "rgw", 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout: "mfa_ids": [ 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout: "4349984641" 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T04:18:54.803 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:18:54.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.827+0000 7efd1b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T04:18:54.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.831+0000 7efe665f1980 20 remove_watcher() i=0 2024-04-03T04:18:54.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.831+0000 7efe665f1980 2 removed watcher, disabling cache 2024-04-03T04:18:54.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.835+0000 7efe665f1980 20 remove_watcher() i=1 2024-04-03T04:18:54.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.835+0000 7efe665f1980 20 remove_watcher() i=2 2024-04-03T04:18:54.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.839+0000 7efe665f1980 20 remove_watcher() i=3 2024-04-03T04:18:54.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.839+0000 7efe665f1980 20 remove_watcher() i=4 2024-04-03T04:18:54.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.843+0000 7efe665f1980 20 remove_watcher() i=5 2024-04-03T04:18:54.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.843+0000 7efe665f1980 20 remove_watcher() i=6 2024-04-03T04:18:54.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T04:18:54.847+0000 7efe665f1980 20 remove_watcher() i=7 2024-04-03T04:18:54.837 INFO:tasks.s3tests:Configuring s3-tests... 2024-04-03T04:18:54.837 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T04:18:54.837 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-04-03T04:18:54.886 INFO:tasks.s3tests:Configuring boto... 2024-04-03T04:18:54.886 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T04:18:54.886 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-04-03T04:18:54.932 DEBUG:teuthology.orchestra.run.smithi104:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-04-03T04:18:55.094 INFO:teuthology.orchestra.run.smithi104.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-04-03T04:18:55.284 INFO:teuthology.orchestra.run.smithi104.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-04-03T04:18:55.554 INFO:teuthology.orchestra.run.smithi104.stdout:py installdeps: -rrequirements.txt 2024-04-03T04:20:34.571 INFO:teuthology.orchestra.run.smithi104.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-04-03T04:20:36.543 INFO:teuthology.orchestra.run.smithi104.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.3,certifi==2024.2.2,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.0,filelock==3.13.3,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.6,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.2.1,munch==4.0.0,packaging==24.0,platformdirs==4.2.0,pluggy==1.4.0,pyparsing==3.1.2,pyproject-api==1.6.1,pytest==8.1.1,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=e91b92007cd132da0a41e528472c7c5086c44a8f4eba752d3db4197ee05c44bd,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.14.2,urllib3==1.26.18,virtualenv==20.25.1,zope.event==5.0,zope.interface==6.2 2024-04-03T04:20:36.543 INFO:teuthology.orchestra.run.smithi104.stdout:py run-test-pre: PYTHONHASHSEED='3434456251' 2024-04-03T04:20:36.543 INFO:teuthology.orchestra.run.smithi104.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-04-03T04:20:36.729 INFO:teuthology.orchestra.run.smithi104.stdout:============================= test session starts ============================== 2024-04-03T04:20:36.729 INFO:teuthology.orchestra.run.smithi104.stdout:platform linux -- Python 3.10.6, pytest-8.1.1, pluggy-1.4.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-04-03T04:20:36.729 INFO:teuthology.orchestra.run.smithi104.stdout:cachedir: .tox/py/.pytest_cache 2024-04-03T04:20:36.730 INFO:teuthology.orchestra.run.smithi104.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-04-03T04:20:36.730 INFO:teuthology.orchestra.run.smithi104.stdout:configfile: pytest.ini 2024-04-03T04:20:38.264 INFO:teuthology.orchestra.run.smithi104.stdout:collecting ... collected 797 items / 124 deselected / 673 selected 2024-04-03T04:20:38.265 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T04:20:39.554 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-04-03T04:20:40.427 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-04-03T04:20:41.283 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-04-03T04:20:42.120 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-04-03T04:20:42.957 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-04-03T04:20:43.646 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-04-03T04:20:44.641 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 1%] 2024-04-03T04:20:45.337 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-04-03T04:20:45.514 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-04-03T04:20:45.684 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-04-03T04:20:46.557 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-04-03T04:20:47.420 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-04-03T04:20:48.276 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-04-03T04:20:49.120 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 2%] 2024-04-03T04:20:49.297 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-04-03T04:20:49.474 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-04-03T04:20:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-04-03T04:20:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-04-03T04:20:49.852 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-04-03T04:20:49.980 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-04-03T04:20:50.111 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 3%] 2024-04-03T04:20:50.240 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2024-04-03T04:20:50.367 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-04-03T04:20:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-04-03T04:20:50.621 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-04-03T04:20:50.749 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-04-03T04:20:50.914 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 4%] 2024-04-03T04:20:51.040 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 4%] 2024-04-03T04:20:51.165 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 4%] 2024-04-03T04:20:51.293 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-04-03T04:20:51.418 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-04-03T04:20:51.544 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-04-03T04:20:51.673 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-04-03T04:20:51.800 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 5%] 2024-04-03T04:20:51.928 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 5%] 2024-04-03T04:20:52.055 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 5%] 2024-04-03T04:20:52.181 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2024-04-03T04:20:52.308 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-04-03T04:20:52.435 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-04-03T04:20:52.561 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-04-03T04:20:52.689 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 6%] 2024-04-03T04:20:52.818 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 6%] 2024-04-03T04:20:52.950 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 6%] 2024-04-03T04:20:53.074 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2024-04-03T04:20:53.200 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-04-03T04:20:53.331 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-04-03T04:20:53.456 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-04-03T04:20:53.582 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 7%] 2024-04-03T04:20:53.709 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 7%] 2024-04-03T04:20:53.835 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 7%] 2024-04-03T04:20:53.962 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2024-04-03T04:20:54.087 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2024-04-03T04:20:54.212 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-04-03T04:20:55.841 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 8%] 2024-04-03T04:21:14.457 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 8%] 2024-04-03T04:21:34.891 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 8%] 2024-04-03T04:22:03.907 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 8%] 2024-04-03T04:22:41.581 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 8%] 2024-04-03T04:22:52.417 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2024-04-03T04:23:03.202 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-04-03T04:23:06.741 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 9%] 2024-04-03T04:23:07.620 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 9%] 2024-04-03T04:23:11.747 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 9%] 2024-04-03T04:23:17.017 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 9%] 2024-04-03T04:23:19.445 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 9%] 2024-04-03T04:23:21.110 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2024-04-03T04:23:22.493 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 9%] 2024-04-03T04:23:22.495 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 10%] 2024-04-03T04:23:22.497 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 10%] 2024-04-03T04:23:22.500 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 10%] 2024-04-03T04:23:22.503 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 10%] 2024-04-03T04:23:22.506 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 10%] 2024-04-03T04:23:22.508 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 10%] 2024-04-03T04:23:22.511 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-04-03T04:23:22.513 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2024-04-03T04:23:22.516 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2024-04-03T04:23:22.519 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2024-04-03T04:23:22.521 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2024-04-03T04:23:22.524 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 11%] 2024-04-03T04:23:22.527 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2024-04-03T04:23:22.529 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2024-04-03T04:23:22.532 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2024-04-03T04:23:22.535 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2024-04-03T04:23:22.538 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2024-04-03T04:23:22.541 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2024-04-03T04:23:22.544 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2024-04-03T04:23:22.548 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 12%] 2024-04-03T04:23:22.550 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 13%] 2024-04-03T04:23:22.553 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 13%] 2024-04-03T04:23:22.555 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 13%] 2024-04-03T04:23:22.556 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 13%] 2024-04-03T04:23:22.559 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 13%] 2024-04-03T04:23:22.561 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 13%] 2024-04-03T04:23:22.563 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 13%] 2024-04-03T04:23:22.664 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 14%] 2024-04-03T04:23:22.674 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 14%] 2024-04-03T04:23:24.984 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 14%] 2024-04-03T04:23:30.951 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 14%] 2024-04-03T04:23:32.609 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 14%] 2024-04-03T04:23:34.605 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 14%] 2024-04-03T04:23:36.557 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 15%] 2024-04-03T04:23:38.490 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 15%] 2024-04-03T04:23:40.516 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 15%] 2024-04-03T04:23:42.151 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 15%] 2024-04-03T04:23:44.131 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 15%] 2024-04-03T04:23:45.952 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 15%] 2024-04-03T04:23:47.696 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 15%] 2024-04-03T04:23:49.306 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 16%] 2024-04-03T04:23:50.722 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 16%] 2024-04-03T04:23:52.169 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 16%] 2024-04-03T04:23:53.103 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 16%] 2024-04-03T04:23:54.747 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 16%] 2024-04-03T04:23:56.555 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-04-03T04:23:58.377 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 16%] 2024-04-03T04:24:00.016 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 17%] 2024-04-03T04:24:01.627 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 17%] 2024-04-03T04:24:03.294 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 17%] 2024-04-03T04:24:04.947 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2024-04-03T04:24:06.548 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 17%] 2024-04-03T04:24:07.974 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 17%] 2024-04-03T04:24:09.580 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 17%] 2024-04-03T04:24:10.479 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 18%] 2024-04-03T04:24:11.420 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 18%] 2024-04-03T04:24:12.350 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 18%] 2024-04-03T04:24:13.287 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 18%] 2024-04-03T04:24:14.200 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 18%] 2024-04-03T04:24:15.861 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 18%] 2024-04-03T04:24:16.772 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 19%] 2024-04-03T04:24:17.859 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 19%] 2024-04-03T04:24:19.107 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 19%] 2024-04-03T04:24:20.293 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 19%] 2024-04-03T04:24:21.241 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 19%] 2024-04-03T04:24:22.544 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 19%] 2024-04-03T04:24:23.677 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 19%] 2024-04-03T04:24:25.181 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 20%] 2024-04-03T04:24:26.269 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 20%] 2024-04-03T04:24:27.388 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 20%] 2024-04-03T04:24:28.586 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 20%] 2024-04-03T04:24:30.371 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 20%] 2024-04-03T04:24:32.437 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 20%] 2024-04-03T04:24:34.223 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 20%] 2024-04-03T04:24:36.386 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 21%] 2024-04-03T04:24:38.676 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 21%] 2024-04-03T04:24:43.267 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 21%] 2024-04-03T04:24:48.082 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 21%] 2024-04-03T04:24:50.520 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 21%] 2024-04-03T04:24:52.785 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 21%] 2024-04-03T04:24:54.631 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 21%] 2024-04-03T04:24:56.797 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 22%] 2024-04-03T04:24:58.217 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 22%] 2024-04-03T04:25:00.345 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 22%] 2024-04-03T04:25:02.691 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 22%] 2024-04-03T04:25:04.912 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 22%] 2024-04-03T04:25:07.043 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 22%] 2024-04-03T04:25:09.209 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 23%] 2024-04-03T04:25:11.376 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 23%] 2024-04-03T04:25:13.554 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 23%] 2024-04-03T04:25:15.701 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 23%] 2024-04-03T04:25:17.875 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 23%] 2024-04-03T04:25:21.645 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 23%] 2024-04-03T04:25:25.361 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 23%] 2024-04-03T04:25:27.127 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2024-04-03T04:25:28.988 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2024-04-03T04:25:31.159 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 24%] 2024-04-03T04:25:33.378 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 24%] 2024-04-03T04:25:37.078 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 24%] 2024-04-03T04:25:40.848 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 24%] 2024-04-03T04:25:43.017 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 24%] 2024-04-03T04:25:45.255 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 25%] 2024-04-03T04:25:47.440 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 25%] 2024-04-03T04:25:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 25%] 2024-04-03T04:25:51.851 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 25%] 2024-04-03T04:25:54.091 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 25%] 2024-04-03T04:25:56.197 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 25%] 2024-04-03T04:25:58.395 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 26%] 2024-04-03T04:26:00.581 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 26%] 2024-04-03T04:26:02.818 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 26%] 2024-04-03T04:26:05.070 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 26%] 2024-04-03T04:26:07.187 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 26%] 2024-04-03T04:26:09.349 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 26%] 2024-04-03T04:26:11.393 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 26%] 2024-04-03T04:26:13.498 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 27%] 2024-04-03T04:26:15.732 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 27%] 2024-04-03T04:26:17.906 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 27%] 2024-04-03T04:28:22.141 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 27%] 2024-04-03T04:28:24.247 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 27%] 2024-04-03T04:28:26.353 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 27%] 2024-04-03T04:28:28.534 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 27%] 2024-04-03T04:28:30.624 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 28%] 2024-04-03T04:28:32.656 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 28%] 2024-04-03T04:28:34.735 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 28%] 2024-04-03T04:28:36.844 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 28%] 2024-04-03T04:28:38.881 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 28%] 2024-04-03T04:28:40.964 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 28%] 2024-04-03T04:28:43.062 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 28%] 2024-04-03T04:28:45.151 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 29%] 2024-04-03T04:28:47.202 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 29%] 2024-04-03T04:28:49.394 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 29%] 2024-04-03T04:28:51.635 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 29%] 2024-04-03T04:28:53.820 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 29%] 2024-04-03T04:28:56.061 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 29%] 2024-04-03T04:28:58.265 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2024-04-03T04:29:00.477 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2024-04-03T04:29:02.669 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2024-04-03T04:29:05.057 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2024-04-03T04:29:07.583 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 30%] 2024-04-03T04:29:10.058 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 30%] 2024-04-03T04:29:12.451 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 30%] 2024-04-03T04:29:14.766 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 31%] 2024-04-03T04:29:16.997 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 31%] 2024-04-03T04:29:19.152 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 31%] 2024-04-03T04:29:21.394 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 31%] 2024-04-03T04:29:23.599 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 31%] 2024-04-03T04:29:24.600 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 31%] 2024-04-03T04:29:26.480 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 31%] 2024-04-03T04:29:31.883 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 32%] 2024-04-03T04:29:37.152 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 32%] 2024-04-03T04:29:39.346 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 32%] 2024-04-03T04:29:41.607 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 32%] 2024-04-03T04:29:43.902 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 32%] 2024-04-03T04:29:46.138 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 32%] 2024-04-03T04:29:48.411 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 32%] 2024-04-03T04:29:50.681 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 33%] 2024-04-03T04:29:52.853 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 33%] 2024-04-03T04:29:55.065 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 33%] 2024-04-03T04:29:57.274 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 33%] 2024-04-03T04:29:59.544 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 33%] 2024-04-03T04:30:01.716 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 33%] 2024-04-03T04:30:03.951 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 34%] 2024-04-03T04:30:06.580 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 34%] 2024-04-03T04:30:10.047 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 34%] 2024-04-03T04:30:12.045 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 34%] 2024-04-03T04:30:13.863 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 34%] 2024-04-03T04:30:15.505 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 34%] 2024-04-03T04:30:17.119 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 34%] 2024-04-03T04:30:17.986 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 35%] 2024-04-03T04:30:18.929 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 35%] 2024-04-03T04:30:19.823 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 35%] 2024-04-03T04:30:21.701 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 35%] 2024-04-03T04:30:30.859 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 35%] 2024-04-03T04:30:31.843 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 35%] 2024-04-03T04:30:33.680 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 35%] 2024-04-03T04:30:35.288 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 36%] 2024-04-03T04:30:36.950 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 36%] 2024-04-03T04:30:38.579 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 36%] 2024-04-03T04:30:44.266 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 36%] 2024-04-03T04:30:46.713 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 36%] 2024-04-03T04:30:49.099 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 36%] 2024-04-03T04:32:53.259 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 36%] 2024-04-03T04:34:57.634 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 37%] 2024-04-03T04:34:59.452 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 37%] 2024-04-03T04:35:01.166 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 37%] 2024-04-03T04:35:02.981 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 37%] 2024-04-03T04:35:04.835 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 37%] 2024-04-03T04:35:06.877 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 37%] 2024-04-03T04:35:08.684 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 38%] 2024-04-03T04:35:10.534 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 38%] 2024-04-03T04:35:12.708 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 38%] 2024-04-03T04:35:14.669 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 38%] 2024-04-03T04:35:16.564 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 38%] 2024-04-03T04:35:18.504 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 38%] 2024-04-03T04:35:20.533 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 38%] 2024-04-03T04:35:22.372 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 39%] 2024-04-03T04:35:23.970 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 39%] 2024-04-03T04:35:25.718 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 39%] 2024-04-03T04:35:27.468 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 39%] 2024-04-03T04:35:31.410 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 39%] 2024-04-03T04:35:33.365 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 39%] 2024-04-03T04:35:35.196 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 39%] 2024-04-03T04:35:36.958 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 40%] 2024-04-03T04:35:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 40%] 2024-04-03T04:35:40.835 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 40%] 2024-04-03T04:35:42.467 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 40%] 2024-04-03T04:35:44.096 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 40%] 2024-04-03T04:35:45.770 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 40%] 2024-04-03T04:35:47.353 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 41%] 2024-04-03T04:35:48.995 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 41%] 2024-04-03T04:35:50.625 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 41%] 2024-04-03T04:35:52.573 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 41%] 2024-04-03T04:35:54.189 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 41%] 2024-04-03T04:35:55.874 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 41%] 2024-04-03T04:35:57.445 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 41%] 2024-04-03T04:35:59.040 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 42%] 2024-04-03T04:36:01.390 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 42%] 2024-04-03T04:36:03.070 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 42%] 2024-04-03T04:36:04.691 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 42%] 2024-04-03T04:36:06.234 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 42%] 2024-04-03T04:36:07.866 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 42%] 2024-04-03T04:36:09.482 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 42%] 2024-04-03T04:36:11.299 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 43%] 2024-04-03T04:36:12.934 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 43%] 2024-04-03T04:36:17.068 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 43%] 2024-04-03T04:36:18.685 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 43%] 2024-04-03T04:36:20.582 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 43%] 2024-04-03T04:36:22.513 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 43%] 2024-04-03T04:36:24.364 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 43%] 2024-04-03T04:36:26.197 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 44%] 2024-04-03T04:36:28.110 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 44%] 2024-04-03T04:36:31.169 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 44%] 2024-04-03T04:36:33.004 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 44%] 2024-04-03T04:36:34.889 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 44%] 2024-04-03T04:36:36.951 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 44%] 2024-04-03T04:36:39.076 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 45%] 2024-04-03T04:36:41.213 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 45%] 2024-04-03T04:36:43.005 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 45%] 2024-04-03T04:36:45.082 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 45%] 2024-04-03T04:36:47.223 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 45%] 2024-04-03T04:36:49.092 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 45%] 2024-04-03T04:36:51.245 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 45%] 2024-04-03T04:36:53.007 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 46%] 2024-04-03T04:36:54.867 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 46%] 2024-04-03T04:36:56.676 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 46%] 2024-04-03T04:36:58.572 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 46%] 2024-04-03T04:37:00.168 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 46%] 2024-04-03T04:37:01.052 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 46%] 2024-04-03T04:37:03.538 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 46%] 2024-04-03T04:37:05.316 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 47%] 2024-04-03T04:37:07.088 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 47%] 2024-04-03T04:37:12.001 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 47%] 2024-04-03T04:37:13.817 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 47%] 2024-04-03T04:37:15.646 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 47%] 2024-04-03T04:37:17.432 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 47%] 2024-04-03T04:37:19.245 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 47%] 2024-04-03T04:37:20.930 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 48%] 2024-04-03T04:37:22.763 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 48%] 2024-04-03T04:37:24.750 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 48%] 2024-04-03T04:37:27.265 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 48%] 2024-04-03T04:37:29.019 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 48%] 2024-04-03T04:37:30.795 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 48%] 2024-04-03T04:37:32.656 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 49%] 2024-04-03T04:37:34.584 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 49%] 2024-04-03T04:37:36.470 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 49%] 2024-04-03T04:37:38.257 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 49%] 2024-04-03T04:37:40.142 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 49%] 2024-04-03T04:37:42.201 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 49%] 2024-04-03T04:37:44.082 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 49%] 2024-04-03T04:37:45.032 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 50%] 2024-04-03T04:37:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 50%] 2024-04-03T04:37:46.948 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 50%] 2024-04-03T04:37:48.345 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 50%] 2024-04-03T04:37:49.749 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 50%] 2024-04-03T04:37:51.203 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 50%] 2024-04-03T04:37:52.706 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 50%] 2024-04-03T04:37:54.288 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 51%] 2024-04-03T04:37:55.200 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 51%] 2024-04-03T04:37:56.070 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 51%] 2024-04-03T04:37:57.578 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 51%] 2024-04-03T04:37:58.552 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 51%] 2024-04-03T04:37:59.462 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 51%] 2024-04-03T04:38:00.365 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 52%] 2024-04-03T04:38:01.235 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 52%] 2024-04-03T04:38:02.883 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 52%] 2024-04-03T04:38:04.461 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 52%] 2024-04-03T04:38:06.058 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 52%] 2024-04-03T04:38:07.673 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 52%] 2024-04-03T04:38:09.172 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 52%] 2024-04-03T04:38:10.787 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 53%] 2024-04-03T04:38:12.353 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 53%] 2024-04-03T04:38:14.053 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 53%] 2024-04-03T04:38:15.634 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 53%] 2024-04-03T04:38:17.237 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 53%] 2024-04-03T04:38:19.148 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 53%] 2024-04-03T04:38:20.972 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 53%] 2024-04-03T04:38:23.076 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 54%] 2024-04-03T04:38:24.949 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 54%] 2024-04-03T04:38:26.791 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 54%] 2024-04-03T04:38:28.855 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 54%] 2024-04-03T04:38:30.842 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 54%] 2024-04-03T04:38:33.035 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 54%] 2024-04-03T04:38:35.293 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 54%] 2024-04-03T04:38:36.975 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 55%] 2024-04-03T04:38:39.047 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 55%] 2024-04-03T04:38:41.160 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 55%] 2024-04-03T04:38:43.282 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 55%] 2024-04-03T04:38:45.334 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 55%] 2024-04-03T04:38:47.371 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 55%] 2024-04-03T04:38:50.321 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 56%] 2024-04-03T04:38:52.922 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 56%] 2024-04-03T04:38:55.543 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 56%] 2024-04-03T04:38:58.273 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 56%] 2024-04-03T04:39:00.837 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 56%] 2024-04-03T04:39:02.653 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 56%] 2024-04-03T04:39:05.578 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_no_grants PASSED [ 56%] 2024-04-03T04:39:07.833 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 57%] 2024-04-03T04:39:09.996 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 57%] 2024-04-03T04:39:12.036 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 57%] 2024-04-03T04:39:14.002 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 57%] 2024-04-03T04:39:16.102 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 57%] 2024-04-03T04:39:18.905 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 57%] 2024-04-03T04:39:21.599 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 57%] 2024-04-03T04:39:24.505 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 58%] 2024-04-03T04:39:27.246 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 58%] 2024-04-03T04:39:30.098 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 58%] 2024-04-03T04:39:32.899 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 58%] 2024-04-03T04:39:35.784 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 58%] 2024-04-03T04:39:38.739 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 58%] 2024-04-03T04:39:41.552 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 58%] 2024-04-03T04:39:44.382 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 59%] 2024-04-03T04:39:47.162 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 59%] 2024-04-03T04:39:50.023 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 59%] 2024-04-03T04:39:54.117 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 59%] 2024-04-03T04:39:58.007 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 59%] 2024-04-03T04:39:58.993 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 59%] 2024-04-03T04:39:59.943 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 60%] 2024-04-03T04:40:00.878 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 60%] 2024-04-03T04:40:02.619 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 60%] 2024-04-03T04:40:04.408 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 60%] 2024-04-03T04:40:05.855 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 60%] 2024-04-03T04:40:07.256 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 60%] 2024-04-03T04:40:09.764 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 60%] 2024-04-03T04:40:15.296 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 61%] 2024-04-03T04:40:17.853 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 61%] 2024-04-03T04:40:20.054 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 61%] 2024-04-03T04:40:28.977 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 61%] 2024-04-03T04:40:31.106 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 61%] 2024-04-03T04:40:33.170 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 61%] 2024-04-03T04:40:35.169 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 61%] 2024-04-03T04:40:37.142 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 62%] 2024-04-03T04:40:39.978 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 62%] 2024-04-03T04:40:42.388 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 62%] 2024-04-03T04:40:45.118 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 62%] 2024-04-03T04:40:47.513 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 62%] 2024-04-03T04:40:51.472 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 62%] 2024-04-03T04:40:55.258 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 63%] 2024-04-03T04:40:56.884 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 63%] 2024-04-03T04:40:58.428 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 63%] 2024-04-03T04:41:04.185 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 63%] 2024-04-03T04:41:06.542 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 63%] 2024-04-03T04:41:46.208 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 63%] 2024-04-03T04:41:48.057 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 63%] 2024-04-03T04:41:50.487 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 64%] 2024-04-03T04:41:58.707 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 64%] 2024-04-03T04:42:00.866 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 64%] 2024-04-03T04:42:04.569 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 64%] 2024-04-03T04:42:28.665 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 64%] 2024-04-03T04:43:08.527 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 64%] 2024-04-03T04:43:58.825 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 64%] 2024-04-03T04:47:33.736 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 65%] 2024-04-03T04:48:02.275 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 65%] 2024-04-03T04:48:37.285 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 65%] 2024-04-03T04:48:40.290 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 65%] 2024-04-03T04:48:54.520 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 65%] 2024-04-03T04:49:06.190 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 65%] 2024-04-03T04:49:13.844 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 65%] 2024-04-03T04:49:15.687 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 66%] 2024-04-03T04:49:26.863 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 66%] 2024-04-03T04:49:29.146 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 66%] 2024-04-03T04:49:31.052 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 66%] 2024-04-03T04:49:33.009 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 66%] 2024-04-03T04:50:02.591 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 66%] 2024-04-03T04:50:04.561 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 67%] 2024-04-03T04:50:06.470 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 67%] 2024-04-03T04:50:08.519 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 67%] 2024-04-03T04:50:18.611 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 67%] 2024-04-03T04:50:23.661 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 67%] 2024-04-03T04:50:28.519 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 67%] 2024-04-03T04:50:30.553 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 67%] 2024-04-03T04:50:32.692 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 68%] 2024-04-03T04:50:34.673 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 68%] 2024-04-03T04:50:36.732 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 68%] 2024-04-03T04:50:38.780 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 68%] 2024-04-03T04:50:40.787 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 68%] 2024-04-03T04:50:42.704 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 68%] 2024-04-03T04:50:46.427 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 68%] 2024-04-03T04:50:54.071 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 69%] 2024-04-03T04:51:07.009 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 69%] 2024-04-03T04:51:11.756 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 69%] 2024-04-03T04:51:21.522 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 69%] 2024-04-03T04:51:37.401 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 69%] 2024-04-03T04:51:41.728 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 69%] 2024-04-03T04:51:50.611 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 69%] 2024-04-03T04:52:06.094 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 70%] 2024-04-03T04:52:10.519 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 70%] 2024-04-03T04:52:12.631 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 70%] 2024-04-03T04:52:15.716 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 70%] 2024-04-03T04:52:17.619 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 70%] 2024-04-03T04:52:27.795 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 70%] 2024-04-03T04:52:29.675 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-04-03T04:52:31.490 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 71%] 2024-04-03T04:52:33.362 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 71%] 2024-04-03T04:52:35.249 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 71%] 2024-04-03T04:52:37.871 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 71%] 2024-04-03T04:53:00.969 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 71%] 2024-04-03T04:53:04.284 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 71%] 2024-04-03T04:53:06.813 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-04-03T04:53:09.772 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 72%] 2024-04-03T04:53:12.787 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 72%] 2024-04-03T04:53:22.992 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 72%] 2024-04-03T04:53:26.224 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 72%] 2024-04-03T04:53:37.673 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 72%] 2024-04-03T04:54:18.646 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 72%] 2024-04-03T04:55:19.533 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-04-03T04:55:25.218 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-04-03T04:55:30.863 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 73%] 2024-04-03T04:55:33.603 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 73%] 2024-04-03T04:55:36.519 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 73%] 2024-04-03T04:55:38.742 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 73%] 2024-04-03T04:55:42.137 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 73%] 2024-04-03T04:55:45.222 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-04-03T04:55:50.343 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-04-03T04:55:52.279 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 74%] 2024-04-03T04:55:54.040 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 74%] 2024-04-03T04:55:55.809 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 74%] 2024-04-03T04:55:57.513 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 74%] 2024-04-03T04:55:59.157 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-04-03T04:56:00.912 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-04-03T04:56:02.609 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-04-03T04:56:04.268 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 75%] 2024-04-03T04:56:06.203 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 75%] 2024-04-03T04:56:07.952 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 75%] 2024-04-03T04:56:09.607 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 75%] 2024-04-03T04:56:11.276 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-04-03T04:56:12.999 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-04-03T04:56:14.593 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-04-03T04:56:16.470 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-04-03T04:56:18.482 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 76%] 2024-04-03T04:56:21.260 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 76%] 2024-04-03T04:56:23.208 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 76%] 2024-04-03T04:56:25.154 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-04-03T04:56:27.108 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-04-03T04:56:28.987 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-04-03T04:56:30.671 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-04-03T04:56:32.399 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 77%] 2024-04-03T04:56:34.025 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 77%] 2024-04-03T04:56:35.758 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-04-03T04:57:46.093 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-04-03T04:58:55.336 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-04-03T04:59:18.036 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-04-03T04:59:20.030 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-04-03T04:59:22.104 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 78%] 2024-04-03T04:59:23.954 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 78%] 2024-04-03T04:59:25.644 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-04-03T04:59:27.342 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-04-03T05:00:18.498 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-04-03T05:00:38.393 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-04-03T05:00:58.195 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 79%] 2024-04-03T05:01:00.150 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 79%] 2024-04-03T05:01:02.026 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 79%] 2024-04-03T05:01:03.963 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-04-03T05:01:06.802 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-04-03T05:01:08.853 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-04-03T05:01:10.723 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-04-03T05:01:12.839 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-04-03T05:01:14.845 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 80%] 2024-04-03T05:01:17.129 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 80%] 2024-04-03T05:01:19.388 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-04-03T05:01:22.706 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-04-03T05:01:26.117 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-04-03T05:01:31.557 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 81%] 2024-04-03T05:01:36.945 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 81%] 2024-04-03T05:01:42.382 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 81%] 2024-04-03T05:01:47.916 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-04-03T05:01:53.461 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-04-03T05:01:58.859 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-04-03T05:02:04.828 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-04-03T05:02:10.887 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-04-03T05:02:16.522 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 82%] 2024-04-03T05:02:18.484 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 82%] 2024-04-03T05:02:20.479 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-04-03T05:02:22.463 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-04-03T05:02:28.047 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-04-03T05:02:33.871 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-04-03T05:02:39.749 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-04-03T05:02:44.124 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 83%] 2024-04-03T05:03:35.551 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 83%] 2024-04-03T05:03:38.360 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-04-03T05:03:41.270 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-04-03T05:03:44.095 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-04-03T05:03:47.850 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-04-03T05:03:51.193 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-04-03T05:03:53.231 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-04-03T05:03:56.535 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 84%] 2024-04-03T05:03:58.166 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-04-03T05:03:59.769 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-04-03T05:04:01.436 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-04-03T05:04:03.069 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-04-03T05:04:05.039 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-04-03T05:04:06.800 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-04-03T05:04:09.594 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-04-03T05:04:11.330 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-04-03T05:04:12.847 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-04-03T05:04:14.434 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-04-03T05:04:16.085 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-04-03T05:04:17.611 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-04-03T05:04:19.213 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-04-03T05:04:20.840 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 87%] 2024-04-03T05:04:22.415 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-04-03T05:04:23.999 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-04-03T05:04:25.532 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-04-03T05:04:27.569 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-04-03T05:04:29.265 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-04-03T05:04:31.312 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-04-03T05:04:33.255 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 88%] 2024-04-03T05:04:35.161 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-04-03T05:04:36.954 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-04-03T05:04:39.156 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-04-03T05:04:41.225 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-04-03T05:04:43.277 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-04-03T05:04:45.232 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 89%] 2024-04-03T05:04:47.382 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 89%] 2024-04-03T05:04:49.315 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-04-03T05:04:51.554 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-04-03T05:04:53.828 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-04-03T05:04:55.935 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-04-03T05:04:57.943 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-04-03T05:04:59.700 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 90%] 2024-04-03T05:05:01.602 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 90%] 2024-04-03T05:05:03.710 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 90%] 2024-04-03T05:05:05.475 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-04-03T05:05:07.585 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-04-03T05:05:09.863 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-04-03T05:05:11.826 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-04-03T05:05:13.889 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 91%] 2024-04-03T05:05:15.782 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 91%] 2024-04-03T05:05:27.245 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 91%] 2024-04-03T05:05:29.094 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-04-03T05:05:40.153 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-04-03T05:05:42.281 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-04-03T05:05:44.354 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-04-03T05:05:45.927 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 92%] 2024-04-03T05:05:47.735 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 92%] 2024-04-03T05:05:49.467 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 92%] 2024-04-03T05:05:51.241 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-04-03T05:05:53.094 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-04-03T05:05:54.859 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status PASSED [ 92%] 2024-04-03T05:05:56.552 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 93%] 2024-04-03T05:05:58.628 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 93%] 2024-04-03T05:06:00.321 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 93%] 2024-04-03T05:06:02.333 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 93%] 2024-04-03T05:06:04.236 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-04-03T05:06:05.961 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-04-03T05:06:08.415 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-04-03T05:06:36.033 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 94%] 2024-04-03T05:06:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 94%] 2024-04-03T05:06:39.429 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 94%] 2024-04-03T05:06:41.307 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 94%] 2024-04-03T05:06:43.562 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-04-03T05:06:48.712 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-04-03T05:07:12.465 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-04-03T05:07:33.974 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-04-03T05:07:35.597 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-04-03T05:07:38.245 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-04-03T05:07:56.793 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-04-03T05:08:36.069 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-04-03T05:08:42.620 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-04-03T05:08:46.911 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-04-03T05:08:50.924 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 96%] 2024-04-03T05:08:54.682 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-04-03T05:08:56.471 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-04-03T05:09:03.083 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-04-03T05:09:11.225 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-04-03T05:09:34.613 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-04-03T05:09:55.181 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 97%] 2024-04-03T05:10:03.629 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 97%] 2024-04-03T05:10:06.908 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-04-03T05:10:09.049 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-04-03T05:10:17.630 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-04-03T05:10:22.974 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-04-03T05:10:25.562 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-04-03T05:10:27.995 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 98%] 2024-04-03T05:10:37.399 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 98%] 2024-04-03T05:10:43.236 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 98%] 2024-04-03T05:10:50.457 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-04-03T05:10:54.059 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-04-03T05:10:54.851 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-04-03T05:11:01.523 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-04-03T05:11:08.070 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 99%] 2024-04-03T05:11:12.013 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 99%] 2024-04-03T05:11:18.063 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 99%] 2024-04-03T05:11:20.748 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-04-03T05:12:13.638 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-04-03T05:12:14.389 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-04-03T05:12:14.444 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-04-03T05:12:14.444 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout:=============================== warnings summary =============================== 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout: import imp 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py:120 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout: if boto_type is 'S3Connection': 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_headers.py:124 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout: elif boto_type is 'HTTPRequest': 2024-04-03T05:12:14.445 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3.py:359 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py:176 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout: if k is 'BucketName': 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py:253 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout: @pytest.mark.timeout(10) 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.446 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests/functional/test_s3_website.py:1077 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: @pytest.mark.s3website_routing_rules 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2212 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: ["starts-with", "$key", "\$foo"],\ 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2227 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2233 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.447 INFO:teuthology.orchestra.run.smithi104.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2290 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: ["starts-with", "$key", "\$foo"],\ 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2305 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2323 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: ["starts-with", "$key", "\$foo"],\ 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.448 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2338 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2356 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: ["starts-with", "$key", "\$foo"],\ 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2371 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2421 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.449 INFO:teuthology.orchestra.run.smithi104.stdout: ["starts-with", "$key", "\$foo"],\ 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py:2453 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence '\$' 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout: ["starts-with", "$key", "\$foo"],\ 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_iam.py: 23 warnings 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py: 487 warnings 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi104.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout: warnings.warn( 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.450 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6526: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout: s = ssl.wrap_socket(s); 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout: context = SSLContext(ssl_version) 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-04-03T05:12:14.451 INFO:teuthology.orchestra.run.smithi104.stdout:= 607 passed, 65 skipped, 124 deselected, 1 xfailed, 594 warnings in 3097.69s (0:51:37) = 2024-04-03T05:12:14.613 INFO:teuthology.orchestra.run.smithi104.stdout:___________________________________ summary ____________________________________ 2024-04-03T05:12:14.614 INFO:teuthology.orchestra.run.smithi104.stdout: py: commands succeeded 2024-04-03T05:12:14.614 INFO:teuthology.orchestra.run.smithi104.stdout: congratulations :) 2024-04-03T05:12:14.646 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-04-03T05:12:14.646 DEBUG:teuthology.orchestra.run.smithi104:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-04-03T05:12:14.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T05:12:14.726 INFO:tasks.s3tests:Cleaning up boto... 2024-04-03T05:12:14.726 DEBUG:teuthology.orchestra.run.smithi104:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-04-03T05:12:14.731 INFO:tasks.s3tests:Removing s3-tests... 2024-04-03T05:12:14.731 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-04-03T05:12:14.915 INFO:teuthology.run_tasks:Running task workunit... 2024-04-03T05:12:14.926 INFO:tasks.workunit:Pulling workunits from ref 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T05:12:14.926 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-03T05:12:14.926 DEBUG:teuthology.orchestra.run.smithi104:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-03T05:12:14.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T05:12:14.931 INFO:teuthology.orchestra.run.smithi104.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-03T05:12:14.932 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T05:12:14.978 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-03T05:12:14.978 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-03T05:12:15.026 INFO:tasks.workunit:timeout=3h 2024-04-03T05:12:15.026 INFO:tasks.workunit:cleanup=True 2024-04-03T05:12:15.026 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 888a4a757aa90aa5ed4fb3291576474bc07507ce 2024-04-03T05:12:15.076 INFO:tasks.workunit.client.0.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-03T05:13:38.499 INFO:tasks.workunit.client.0.smithi104.stderr:Note: switching to '888a4a757aa90aa5ed4fb3291576474bc07507ce'. 2024-04-03T05:13:38.500 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:38.500 INFO:tasks.workunit.client.0.smithi104.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-03T05:13:38.500 INFO:tasks.workunit.client.0.smithi104.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-03T05:13:38.500 INFO:tasks.workunit.client.0.smithi104.stderr:state without impacting any branches by switching back to a branch. 2024-04-03T05:13:38.500 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:38.500 INFO:tasks.workunit.client.0.smithi104.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-03T05:13:38.500 INFO:tasks.workunit.client.0.smithi104.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-03T05:13:38.500 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:38.501 INFO:tasks.workunit.client.0.smithi104.stderr: git switch -c 2024-04-03T05:13:38.501 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:38.501 INFO:tasks.workunit.client.0.smithi104.stderr:Or undo this operation with: 2024-04-03T05:13:38.501 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:38.501 INFO:tasks.workunit.client.0.smithi104.stderr: git switch - 2024-04-03T05:13:38.501 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:38.501 INFO:tasks.workunit.client.0.smithi104.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-03T05:13:38.501 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:38.501 INFO:tasks.workunit.client.0.smithi104.stderr:HEAD is now at 888a4a757aa Merge branch 'pr-56562' into wip-cbodley-testing 2024-04-03T05:13:38.505 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-03T05:13:38.556 INFO:tasks.workunit.client.0.smithi104.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-03T05:13:38.558 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T05:13:38.558 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-03T05:13:38.614 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-03T05:13:38.668 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-03T05:13:38.711 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-03T05:13:38.712 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T05:13:38.712 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-03T05:13:38.753 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-03T05:13:38.756 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-04-03T05:13:38.757 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-03T05:13:38.802 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-04-03T05:13:38.803 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-04-03T05:13:38.804 DEBUG:teuthology.orchestra.run.smithi104:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=888a4a757aa90aa5ed4fb3291576474bc07507ce TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-04-03T05:13:38.854 INFO:tasks.workunit.client.0.smithi104.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-04-03T05:13:38.855 INFO:tasks.workunit.client.0.smithi104.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-04-03T05:13:38.855 INFO:tasks.workunit.client.0.smithi104.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-04-03T05:13:41.765 INFO:tasks.workunit.client.0.smithi104.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-04-03T05:13:41.765 INFO:tasks.workunit.client.0.smithi104.stderr:++ deactivate nondestructive 2024-04-03T05:13:41.765 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T05:13:41.765 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T05:13:41.765 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-04-03T05:13:41.765 INFO:tasks.workunit.client.0.smithi104.stderr:++ hash -r 2024-04-03T05:13:41.765 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T05:13:41.766 INFO:tasks.workunit.client.0.smithi104.stderr:++ unset VIRTUAL_ENV 2024-04-03T05:13:41.766 INFO:tasks.workunit.client.0.smithi104.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-04-03T05:13:41.766 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-04-03T05:13:41.766 INFO:tasks.workunit.client.0.smithi104.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-04-03T05:13:41.766 INFO:tasks.workunit.client.0.smithi104.stderr:++ export VIRTUAL_ENV 2024-04-03T05:13:41.767 INFO:tasks.workunit.client.0.smithi104.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-04-03T05:13:41.767 INFO:tasks.workunit.client.0.smithi104.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-04-03T05:13:41.767 INFO:tasks.workunit.client.0.smithi104.stderr:++ export PATH 2024-04-03T05:13:41.767 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n '' ']' 2024-04-03T05:13:41.768 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -z '' ']' 2024-04-03T05:13:41.768 INFO:tasks.workunit.client.0.smithi104.stderr:++ _OLD_VIRTUAL_PS1= 2024-04-03T05:13:41.768 INFO:tasks.workunit.client.0.smithi104.stderr:++ PS1='(rgw) ' 2024-04-03T05:13:41.768 INFO:tasks.workunit.client.0.smithi104.stderr:++ export PS1 2024-04-03T05:13:41.768 INFO:tasks.workunit.client.0.smithi104.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-04-03T05:13:41.768 INFO:tasks.workunit.client.0.smithi104.stderr:++ export VIRTUAL_ENV_PROMPT 2024-04-03T05:13:41.768 INFO:tasks.workunit.client.0.smithi104.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-04-03T05:13:41.768 INFO:tasks.workunit.client.0.smithi104.stderr:++ hash -r 2024-04-03T05:13:41.768 INFO:tasks.workunit.client.0.smithi104.stderr:+ pip install pip --upgrade 2024-04-03T05:13:42.124 INFO:tasks.workunit.client.0.smithi104.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-04-03T05:13:42.336 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting pip 2024-04-03T05:13:42.343 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-04-03T05:13:42.379 INFO:tasks.workunit.client.0.smithi104.stdout:Installing collected packages: pip 2024-04-03T05:13:42.380 INFO:tasks.workunit.client.0.smithi104.stdout: Attempting uninstall: pip 2024-04-03T05:13:42.380 INFO:tasks.workunit.client.0.smithi104.stdout: Found existing installation: pip 22.0.2 2024-04-03T05:13:42.636 INFO:tasks.workunit.client.0.smithi104.stdout: Uninstalling pip-22.0.2: 2024-04-03T05:13:42.642 INFO:tasks.workunit.client.0.smithi104.stdout: Successfully uninstalled pip-22.0.2 2024-04-03T05:13:43.650 INFO:tasks.workunit.client.0.smithi104.stdout:Successfully installed pip-24.0 2024-04-03T05:13:43.712 INFO:tasks.workunit.client.0.smithi104.stderr:+ pip install boto3 2024-04-03T05:13:44.621 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting boto3 2024-04-03T05:13:44.623 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached boto3-1.34.76-py3-none-any.whl.metadata (6.6 kB) 2024-04-03T05:13:45.165 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting botocore<1.35.0,>=1.34.76 (from boto3) 2024-04-03T05:13:45.166 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached botocore-1.34.76-py3-none-any.whl.metadata (5.7 kB) 2024-04-03T05:13:45.221 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-04-03T05:13:45.222 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-04-03T05:13:45.276 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-04-03T05:13:45.277 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached s3transfer-0.10.1-py3-none-any.whl.metadata (1.7 kB) 2024-04-03T05:13:45.334 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T05:13:45.335 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-04-03T05:13:45.412 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T05:13:45.413 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached urllib3-2.2.1-py3-none-any.whl.metadata (6.4 kB) 2024-04-03T05:13:45.657 INFO:tasks.workunit.client.0.smithi104.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.76->boto3) 2024-04-03T05:13:45.658 INFO:tasks.workunit.client.0.smithi104.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-04-03T05:13:45.669 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached boto3-1.34.76-py3-none-any.whl (139 kB) 2024-04-03T05:13:45.671 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached botocore-1.34.76-py3-none-any.whl (12.1 MB) 2024-04-03T05:13:45.691 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-04-03T05:13:45.692 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached s3transfer-0.10.1-py3-none-any.whl (82 kB) 2024-04-03T05:13:45.693 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-04-03T05:13:45.694 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached urllib3-2.2.1-py3-none-any.whl (121 kB) 2024-04-03T05:13:45.696 INFO:tasks.workunit.client.0.smithi104.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-04-03T05:13:45.787 INFO:tasks.workunit.client.0.smithi104.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-04-03T05:13:46.817 INFO:tasks.workunit.client.0.smithi104.stdout:Successfully installed boto3-1.34.76 botocore-1.34.76 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.1 six-1.16.0 urllib3-2.2.1 2024-04-03T05:13:46.963 INFO:tasks.workunit.client.0.smithi104.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-04-03T05:13:47.098 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-04-03T05:13:47.135 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T05:13:47.135 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T05:13:47.177 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.169+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:47.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 realm 2024-04-03T05:13:47.178 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:47.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T05:13:47.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:47.179 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:13:47.180 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T05:13:47.181 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.173+0000 7f9ebc19f980 20 searching for the correct realm 2024-04-03T05:13:47.185 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.181+0000 7f9eb9cba640 0 -- 172.21.15.104:0/60655523 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x55f4fcf54960 msgr2=0x55f4fcf56e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:13:47.192 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.185+0000 7f9eb94b9640 0 -- 172.21.15.104:0/60655523 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f9eb40b0ba0 msgr2=0x7f9eb40b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T05:13:47.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T05:13:47.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T05:13:47.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T05:13:47.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T05:13:47.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T05:13:47.408 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T05:13:47.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:47.409 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.401+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 zone default found 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 4 Realm: () 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 zonegroup default 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:47.410 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:47.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:47.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 started sync module instance, tier type = 2024-04-03T05:13:47.411 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.405+0000 7f9ebc19f980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T05:13:47.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.429+0000 7f9ebc19f980 20 add_watcher() i=0 2024-04-03T05:13:47.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.429+0000 7f9ebc19f980 20 add_watcher() i=1 2024-04-03T05:13:47.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.429+0000 7f9ebc19f980 20 add_watcher() i=2 2024-04-03T05:13:47.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.429+0000 7f9ebc19f980 20 add_watcher() i=3 2024-04-03T05:13:47.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.429+0000 7f9ebc19f980 20 add_watcher() i=4 2024-04-03T05:13:47.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.429+0000 7f9ebc19f980 20 add_watcher() i=5 2024-04-03T05:13:47.435 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.429+0000 7f9ebc19f980 20 add_watcher() i=6 2024-04-03T05:13:47.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.429+0000 7f9ebc19f980 20 add_watcher() i=7 2024-04-03T05:13:47.437 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.429+0000 7f9ebc19f980 2 all 8 watchers are set, enabling cache 2024-04-03T05:13:47.440 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.433+0000 7f9d707e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:13:47.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T05:13:47.441 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T05:13:47.442 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 5 note: GC not initialized 2024-04-03T05:13:47.442 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9d6f7e6640 20 reqs_thread_entry: start 2024-04-03T05:13:47.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 20 init_complete bucket index max shards: 11 2024-04-03T05:13:47.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 20 Filter name: none 2024-04-03T05:13:47.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9d6d7e2640 20 reqs_thread_entry: start 2024-04-03T05:13:47.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-04-03T05:13:47.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.443 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:47.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-04-03T05:13:47.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-04-03T05:13:47.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-04-03T05:13:47.444 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 20 rados->read ofs=0 len=0 2024-04-03T05:13:47.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:47.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-04-03T05:13:47.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-04-03T05:13:47.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-04-03T05:13:47.445 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.437+0000 7f9ebc19f980 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-04-03T05:13:47.447 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.441+0000 7f9ebc19f980 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-04-03T05:13:47.447 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.441+0000 7f9ebc19f980 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-04-03T05:13:47.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.441+0000 7f9ebc19f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-04-03T05:13:47.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.441+0000 7f9d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399257 cookie 94510704332240 notifier 7337 bl.length()=580 2024-04-03T05:13:47.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.441+0000 7f9d9d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-04-03T05:13:47.448 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.441+0000 7f9d9d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-04-03T05:13:47.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.449+0000 7f9ebc19f980 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-04-03T05:13:47.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.449+0000 7f9ebc19f980 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-04-03T05:13:47.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.449+0000 7f9ebc19f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-04-03T05:13:47.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.449+0000 7f9d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400058 cookie 94510704330432 notifier 7337 bl.length()=191 2024-04-03T05:13:47.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.449+0000 7f9d9d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-04-03T05:13:47.454 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.449+0000 7f9d9d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-04-03T05:13:47.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.449+0000 7f9d707e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:13:47.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.457+0000 7f9ebc19f980 20 remove_watcher() i=0 2024-04-03T05:13:47.462 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.457+0000 7f9ebc19f980 2 removed watcher, disabling cache 2024-04-03T05:13:47.464 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.457+0000 7f9ebc19f980 20 remove_watcher() i=1 2024-04-03T05:13:47.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.461+0000 7f9ebc19f980 20 remove_watcher() i=2 2024-04-03T05:13:47.469 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.461+0000 7f9ebc19f980 20 remove_watcher() i=3 2024-04-03T05:13:47.471 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.465+0000 7f9ebc19f980 20 remove_watcher() i=4 2024-04-03T05:13:47.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.465+0000 7f9ebc19f980 20 remove_watcher() i=5 2024-04-03T05:13:47.474 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.469+0000 7f9ebc19f980 20 remove_watcher() i=6 2024-04-03T05:13:47.475 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:47.469+0000 7f9ebc19f980 20 remove_watcher() i=7 2024-04-03T05:13:47.714 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:47.714 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:47.786 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:47.786 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:47.924 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:47.924 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:48.040 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:48.040 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:48.105 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-04-03T05:13:48.105 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:48.117 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:48.117 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:48.211 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:48.211 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:48.302 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:48.302 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:48.411 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-04-03T05:13:48.442 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T05:13:48.443 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T05:13:48.487 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.481+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.481+0000 7f6bb2ec3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:48.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.481+0000 7f6bb2ec3980 20 realm 2024-04-03T05:13:48.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.481+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.481+0000 7f6bb2ec3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:48.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.481+0000 7f6bb2ec3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T05:13:48.489 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.481+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.485+0000 7f6bb2ec3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:48.490 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.485+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.485+0000 7f6bb2ec3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:13:48.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.485+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.491 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.485+0000 7f6bb2ec3980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T05:13:48.492 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.485+0000 7f6bb2ec3980 20 searching for the correct realm 2024-04-03T05:13:48.495 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.489+0000 7f6bb11df640 0 -- 172.21.15.104:0/532853208 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f6ba8118020 msgr2=0x7f6ba8127ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T05:13:48.711 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.705+0000 7f6bb01dd640 0 -- 172.21.15.104:0/532853208 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f6ba80bac00 msgr2=0x7f6ba8122120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:13:48.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.921+0000 7f6bb2ec3980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T05:13:48.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.921+0000 7f6bb2ec3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T05:13:48.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.921+0000 7f6bb2ec3980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T05:13:48.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.921+0000 7f6bb2ec3980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T05:13:48.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.921+0000 7f6bb2ec3980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T05:13:48.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.921+0000 7f6bb2ec3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T05:13:48.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.921+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.929 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.921+0000 7f6bb2ec3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:48.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.921+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:13:48.930 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T05:13:48.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 zone default found 2024-04-03T05:13:48.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 4 Realm: () 2024-04-03T05:13:48.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T05:13:48.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T05:13:48.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T05:13:48.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 zonegroup default 2024-04-03T05:13:48.931 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:48.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.932 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:48.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.925+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.929+0000 7f6bb2ec3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:48.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.929+0000 7f6bb2ec3980 20 started sync module instance, tier type = 2024-04-03T05:13:48.933 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.929+0000 7f6bb2ec3980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T05:13:48.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.949+0000 7f6bb2ec3980 20 add_watcher() i=0 2024-04-03T05:13:48.956 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.949+0000 7f6bb2ec3980 20 add_watcher() i=1 2024-04-03T05:13:48.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.949+0000 7f6bb2ec3980 20 add_watcher() i=2 2024-04-03T05:13:48.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.949+0000 7f6bb2ec3980 20 add_watcher() i=3 2024-04-03T05:13:48.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.949+0000 7f6bb2ec3980 20 add_watcher() i=4 2024-04-03T05:13:48.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.949+0000 7f6bb2ec3980 20 add_watcher() i=5 2024-04-03T05:13:48.957 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.949+0000 7f6bb2ec3980 20 add_watcher() i=6 2024-04-03T05:13:48.958 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.953+0000 7f6bb2ec3980 20 add_watcher() i=7 2024-04-03T05:13:48.959 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.953+0000 7f6bb2ec3980 2 all 8 watchers are set, enabling cache 2024-04-03T05:13:48.962 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6a677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:13:48.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6bb2ec3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T05:13:48.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6bb2ec3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T05:13:48.963 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6bb2ec3980 5 note: GC not initialized 2024-04-03T05:13:48.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6a667e4640 20 reqs_thread_entry: start 2024-04-03T05:13:48.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6bb2ec3980 20 init_complete bucket index max shards: 11 2024-04-03T05:13:48.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6bb2ec3980 20 Filter name: none 2024-04-03T05:13:48.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6a5f7fe640 20 reqs_thread_entry: start 2024-04-03T05:13:48.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6bb2ec3980 20 rados_obj.operate() r=0 bl.length=209 2024-04-03T05:13:48.964 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.957+0000 7f6bb2ec3980 20 rados->read ofs=0 len=0 2024-04-03T05:13:48.965 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 rados_obj.operate() r=0 bl.length=382 2024-04-03T05:13:48.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T05:13:48.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T05:13:48.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: starting shard=0 2024-04-03T05:13:48.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.0 2024-04-03T05:13:48.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: starting shard=1 2024-04-03T05:13:48.966 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.1 2024-04-03T05:13:48.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: starting shard=2 2024-04-03T05:13:48.967 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.2 2024-04-03T05:13:48.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: starting shard=3 2024-04-03T05:13:48.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.3 2024-04-03T05:13:48.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: starting shard=4 2024-04-03T05:13:48.968 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.4 2024-04-03T05:13:48.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 INFO: main: starting shard=5 2024-04-03T05:13:48.969 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.961+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.5 2024-04-03T05:13:48.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.965+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.965+0000 7f6bb2ec3980 20 INFO: main: starting shard=6 2024-04-03T05:13:48.970 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.965+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.6 2024-04-03T05:13:48.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.965+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.965+0000 7f6bb2ec3980 20 INFO: main: starting shard=7 2024-04-03T05:13:48.972 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.965+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.7 2024-04-03T05:13:48.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.965+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.965+0000 7f6bb2ec3980 20 INFO: main: starting shard=8 2024-04-03T05:13:48.973 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.965+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.8 2024-04-03T05:13:48.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.969+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.969+0000 7f6bb2ec3980 20 INFO: main: starting shard=9 2024-04-03T05:13:48.974 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.969+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.9 2024-04-03T05:13:48.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.969+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.975 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.969+0000 7f6bb2ec3980 20 INFO: main: starting shard=10 2024-04-03T05:13:48.976 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.969+0000 7f6bb2ec3980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.10 2024-04-03T05:13:48.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.969+0000 7f6bb2ec3980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:48.977 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.969+0000 7f6bb2ec3980 20 INFO: main: done 2024-04-03T05:13:48.978 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.973+0000 7f6a677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:13:48.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.977+0000 7f6bb2ec3980 20 remove_watcher() i=0 2024-04-03T05:13:48.983 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.977+0000 7f6bb2ec3980 2 removed watcher, disabling cache 2024-04-03T05:13:48.985 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.981+0000 7f6bb2ec3980 20 remove_watcher() i=1 2024-04-03T05:13:48.988 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.981+0000 7f6bb2ec3980 20 remove_watcher() i=2 2024-04-03T05:13:48.990 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.985+0000 7f6bb2ec3980 20 remove_watcher() i=3 2024-04-03T05:13:48.992 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.985+0000 7f6bb2ec3980 20 remove_watcher() i=4 2024-04-03T05:13:48.994 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.989+0000 7f6bb2ec3980 20 remove_watcher() i=5 2024-04-03T05:13:48.995 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.989+0000 7f6bb2ec3980 20 remove_watcher() i=6 2024-04-03T05:13:48.997 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:48.989+0000 7f6bb2ec3980 20 remove_watcher() i=7 2024-04-03T05:13:49.012 INFO:tasks.workunit.client.0.smithi104.stderr:rados -p default.rgw.buckets.data ls | grep 9de6f06f-70fe-43d6-801e-fac4abf0246b 2024-04-03T05:13:49.034 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T05:13:49.034 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T05:13:49.203 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:49.197+0000 7fec09ad1640 0 -- 172.21.15.104:0/1480723628 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7fec0003bc20 msgr2=0x7fec0003f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T05:13:49.233 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-04-03T05:13:49.233 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:49.233 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-04-03T05:13:50.660 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:50.661 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:50.738 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-04-03T05:13:51.174 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-04-03T05:13:51.203 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T05:13:51.203 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T05:13:51.446 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.441+0000 7f8a0aebc640 0 --2- 172.21.15.104:0/2556994599 >> [v2:172.21.15.104:3301/0,v1:172.21.15.104:6790/0] conn(0x563afa15cf10 0x563afa166b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-04-03T05:13:51.450 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.445+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.445+0000 7f8a0dba2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:51.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.445+0000 7f8a0dba2980 20 realm 2024-04-03T05:13:51.452 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.445+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.445+0000 7f8a0dba2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:51.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.445+0000 7f8a0dba2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T05:13:51.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.445+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.445+0000 7f8a0dba2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:51.453 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.445+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.449+0000 7f8a0dba2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:13:51.455 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.449+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.456 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.449+0000 7f8a0dba2980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T05:13:51.457 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.449+0000 7f8a0dba2980 20 searching for the correct realm 2024-04-03T05:13:51.459 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.453+0000 7f8a0aebc640 0 -- 172.21.15.104:0/2556994599 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7f89fc018070 msgr2=0x7f89fc054770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:13:51.466 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.461+0000 7f8a0bebe640 0 -- 172.21.15.104:0/2556994599 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x563afa17e160 msgr2=0x563afa180550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:13:51.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T05:13:51.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T05:13:51.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T05:13:51.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T05:13:51.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T05:13:51.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T05:13:51.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:51.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:13:51.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T05:13:51.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 zone default found 2024-04-03T05:13:51.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 4 Realm: () 2024-04-03T05:13:51.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T05:13:51.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T05:13:51.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T05:13:51.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 zonegroup default 2024-04-03T05:13:51.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:51.480 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:51.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:51.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 started sync module instance, tier type = 2024-04-03T05:13:51.481 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.473+0000 7f8a0dba2980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T05:13:51.498 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.493+0000 7f8a0dba2980 20 add_watcher() i=0 2024-04-03T05:13:51.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.493+0000 7f8a0dba2980 20 add_watcher() i=1 2024-04-03T05:13:51.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.493+0000 7f8a0dba2980 20 add_watcher() i=2 2024-04-03T05:13:51.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.493+0000 7f8a0dba2980 20 add_watcher() i=3 2024-04-03T05:13:51.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.493+0000 7f8a0dba2980 20 add_watcher() i=4 2024-04-03T05:13:51.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.493+0000 7f8a0dba2980 20 add_watcher() i=5 2024-04-03T05:13:51.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.493+0000 7f8a0dba2980 20 add_watcher() i=6 2024-04-03T05:13:51.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.493+0000 7f8a0dba2980 20 add_watcher() i=7 2024-04-03T05:13:51.499 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.493+0000 7f8a0dba2980 2 all 8 watchers are set, enabling cache 2024-04-03T05:13:51.502 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f88c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:13:51.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T05:13:51.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T05:13:51.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 5 note: GC not initialized 2024-04-03T05:13:51.503 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f88c0fe1640 20 reqs_thread_entry: start 2024-04-03T05:13:51.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 init_complete bucket index max shards: 11 2024-04-03T05:13:51.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 Filter name: none 2024-04-03T05:13:51.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f883a7fc640 20 reqs_thread_entry: start 2024-04-03T05:13:51.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 rados_obj.operate() r=0 bl.length=209 2024-04-03T05:13:51.504 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 rados->read ofs=0 len=0 2024-04-03T05:13:51.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 rados_obj.operate() r=0 bl.length=382 2024-04-03T05:13:51.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-03T05:13:51.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-04-03T05:13:51.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 INFO: main: starting shard=0 2024-04-03T05:13:51.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.497+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.0 2024-04-03T05:13:51.505 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: starting shard=1 2024-04-03T05:13:51.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.1 2024-04-03T05:13:51.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.506 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: starting shard=2 2024-04-03T05:13:51.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.2 2024-04-03T05:13:51.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: starting shard=3 2024-04-03T05:13:51.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.3 2024-04-03T05:13:51.507 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: starting shard=4 2024-04-03T05:13:51.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.4 2024-04-03T05:13:51.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 INFO: main: starting shard=5 2024-04-03T05:13:51.508 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.501+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.5 2024-04-03T05:13:51.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 INFO: main: starting shard=6 2024-04-03T05:13:51.509 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.6 2024-04-03T05:13:51.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 INFO: main: starting shard=7 2024-04-03T05:13:51.511 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.7 2024-04-03T05:13:51.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 INFO: main: starting shard=8 2024-04-03T05:13:51.512 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.8 2024-04-03T05:13:51.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 INFO: main: starting shard=9 2024-04-03T05:13:51.513 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.505+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.9 2024-04-03T05:13:51.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.509+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.514 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.509+0000 7f8a0dba2980 20 INFO: main: starting shard=10 2024-04-03T05:13:51.515 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.509+0000 7f8a0dba2980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.10 2024-04-03T05:13:51.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.509+0000 7f8a0dba2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-04-03T05:13:51.516 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.509+0000 7f8a0dba2980 20 INFO: main: done 2024-04-03T05:13:51.517 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.509+0000 7f88c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:13:51.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.517+0000 7f8a0dba2980 20 remove_watcher() i=0 2024-04-03T05:13:51.522 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.517+0000 7f8a0dba2980 2 removed watcher, disabling cache 2024-04-03T05:13:51.524 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.517+0000 7f8a0dba2980 20 remove_watcher() i=1 2024-04-03T05:13:51.526 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.521+0000 7f8a0dba2980 20 remove_watcher() i=2 2024-04-03T05:13:51.528 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.521+0000 7f8a0dba2980 20 remove_watcher() i=3 2024-04-03T05:13:51.530 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.525+0000 7f8a0dba2980 20 remove_watcher() i=4 2024-04-03T05:13:51.531 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.525+0000 7f8a0dba2980 20 remove_watcher() i=5 2024-04-03T05:13:51.532 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.525+0000 7f8a0dba2980 20 remove_watcher() i=6 2024-04-03T05:13:51.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.529+0000 7f8a0dba2980 20 remove_watcher() i=7 2024-04-03T05:13:51.548 INFO:tasks.workunit.client.0.smithi104.stderr:rados -p default.rgw.buckets.data ls | grep e376db3d-a33d-4bea-9850-d999cc26a8be 2024-04-03T05:13:51.572 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T05:13:51.572 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T05:13:51.749 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:51.741+0000 7f0120e8c640 0 -- 172.21.15.104:0/2967959293 >> [v2:172.21.15.104:6808/2848281456,v1:172.21.15.104:6811/2848281456] conn(0x7f01140f2870 msgr2=0x7f01140ef060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:13:51.778 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-04-03T05:13:51.778 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:51.781 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:51.781 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:51.848 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:51.848 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:51.937 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:51.937 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:51.984 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-04-03T05:13:53.428 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:53.428 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:53.594 INFO:tasks.workunit.client.0.smithi104.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-04-03T05:13:53.595 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-04-03T05:13:54.027 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:54.027 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:54.122 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:54.122 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:54.186 INFO:tasks.workunit.client.0.smithi104.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-04-03T05:13:54.186 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-04-03T05:13:54.190 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:54.190 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:54.327 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:54.327 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:54.484 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:54.484 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:54.579 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-04-03T05:13:56.011 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:56.011 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:56.157 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:56.157 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:58.315 INFO:tasks.workunit.client.0.smithi104.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-04-03T05:13:58.737 INFO:tasks.workunit.client.0.smithi104.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-04-03T05:13:58.768 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T05:13:58.768 INFO:tasks.workunit.client.0.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T05:13:58.811 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.805+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.812 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.805+0000 7f22ec9a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:58.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.805+0000 7f22ec9a7980 20 realm 2024-04-03T05:13:58.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.805+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.805+0000 7f22ec9a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:58.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.805+0000 7f22ec9a7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T05:13:58.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.805+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.805+0000 7f22ec9a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:58.813 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.805+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.809+0000 7f22ec9a7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:13:58.814 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.809+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.809+0000 7f22ec9a7980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T05:13:58.815 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.809+0000 7f22ec9a7980 20 searching for the correct realm 2024-04-03T05:13:58.818 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.813+0000 7f22eacc3640 0 -- 172.21.15.104:0/2401707940 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x55698e3aeb20 msgr2=0x55698e3b0f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:13:58.825 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.817+0000 7f22eacc3640 0 -- 172.21.15.104:0/2401707940 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x7f21b4078270 msgr2=0x7f21b407a6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:13:58.835 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T05:13:58.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T05:13:58.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T05:13:58.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T05:13:58.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T05:13:58.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T05:13:58.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:58.836 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.837 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 zone default found 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 4 Realm: () 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 zonegroup default 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:58.838 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.829+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.833+0000 7f22ec9a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:58.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.833+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.833+0000 7f22ec9a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:58.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.833+0000 7f22ec9a7980 20 started sync module instance, tier type = 2024-04-03T05:13:58.839 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.833+0000 7f22ec9a7980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T05:13:58.854 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.849+0000 7f22ec9a7980 20 add_watcher() i=0 2024-04-03T05:13:58.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.849+0000 7f22ec9a7980 20 add_watcher() i=1 2024-04-03T05:13:58.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.849+0000 7f22ec9a7980 20 add_watcher() i=2 2024-04-03T05:13:58.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.849+0000 7f22ec9a7980 20 add_watcher() i=3 2024-04-03T05:13:58.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.849+0000 7f22ec9a7980 20 add_watcher() i=4 2024-04-03T05:13:58.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.849+0000 7f22ec9a7980 20 add_watcher() i=5 2024-04-03T05:13:58.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.849+0000 7f22ec9a7980 20 add_watcher() i=6 2024-04-03T05:13:58.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.849+0000 7f22ec9a7980 20 add_watcher() i=7 2024-04-03T05:13:58.855 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.849+0000 7f22ec9a7980 2 all 8 watchers are set, enabling cache 2024-04-03T05:13:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f21a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:13:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T05:13:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T05:13:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 5 note: GC not initialized 2024-04-03T05:13:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f211b7fe640 20 reqs_thread_entry: start 2024-04-03T05:13:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 20 init_complete bucket index max shards: 11 2024-04-03T05:13:58.859 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 20 Filter name: none 2024-04-03T05:13:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f21197fa640 20 reqs_thread_entry: start 2024-04-03T05:13:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-04-03T05:13:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 20 rados_obj.operate() r=0 bl.length=209 2024-04-03T05:13:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-04-03T05:13:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-04-03T05:13:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739 : miss 2024-04-03T05:13:58.860 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 20 rados->read ofs=0 len=0 2024-04-03T05:13:58.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 20 rados_obj.operate() r=0 bl.length=382 2024-04-03T05:13:58.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739 info.flags=0x17 2024-04-03T05:13:58.861 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739 to cache LRU end 2024-04-03T05:13:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T05:13:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-04-03T05:13:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739 2024-04-03T05:13:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.853+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.0 2024-04-03T05:13:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 1 NOTICE: finished shard 0 (0 entries found) 2024-04-03T05:13:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.1 2024-04-03T05:13:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 1 NOTICE: finished shard 1 (0 entries found) 2024-04-03T05:13:58.862 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.2 2024-04-03T05:13:58.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 1 NOTICE: finished shard 2 (0 entries found) 2024-04-03T05:13:58.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.3 2024-04-03T05:13:58.863 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 1 NOTICE: finished shard 3 (0 entries found) 2024-04-03T05:13:58.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.4 2024-04-03T05:13:58.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 1 NOTICE: finished shard 4 (0 entries found) 2024-04-03T05:13:58.864 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.857+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.5 2024-04-03T05:13:58.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.861+0000 7f22ec9a7980 1 NOTICE: finished shard 5 (0 entries found) 2024-04-03T05:13:58.865 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.861+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.6 2024-04-03T05:13:58.866 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.861+0000 7f22ec9a7980 1 NOTICE: finished shard 6 (0 entries found) 2024-04-03T05:13:58.867 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.861+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.7 2024-04-03T05:13:58.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.861+0000 7f22ec9a7980 1 NOTICE: finished shard 7 (0 entries found) 2024-04-03T05:13:58.868 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.861+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.8 2024-04-03T05:13:58.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.865+0000 7f22ec9a7980 1 NOTICE: finished shard 8 (0 entries found) 2024-04-03T05:13:58.869 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.865+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.9 2024-04-03T05:13:58.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.865+0000 7f22ec9a7980 1 NOTICE: finished shard 9 (0 entries found) 2024-04-03T05:13:58.870 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.865+0000 7f22ec9a7980 20 bucket index object: :.dir.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739.10 2024-04-03T05:13:58.871 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.865+0000 7f22ec9a7980 1 NOTICE: finished shard 10 (0 entries found) 2024-04-03T05:13:58.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.865+0000 7f22ec9a7980 1 NOTICE: finished all shards (0 entries found) 2024-04-03T05:13:58.872 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.865+0000 7f21a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:13:58.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.869+0000 7f22ec9a7980 20 remove_watcher() i=0 2024-04-03T05:13:58.877 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.869+0000 7f22ec9a7980 2 removed watcher, disabling cache 2024-04-03T05:13:58.879 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.873+0000 7f22ec9a7980 20 remove_watcher() i=1 2024-04-03T05:13:58.881 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.873+0000 7f22ec9a7980 20 remove_watcher() i=2 2024-04-03T05:13:58.883 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.877+0000 7f22ec9a7980 20 remove_watcher() i=3 2024-04-03T05:13:58.885 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.881+0000 7f22ec9a7980 20 remove_watcher() i=4 2024-04-03T05:13:58.887 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.881+0000 7f22ec9a7980 20 remove_watcher() i=5 2024-04-03T05:13:58.888 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.881+0000 7f22ec9a7980 20 remove_watcher() i=6 2024-04-03T05:13:58.889 INFO:tasks.workunit.client.0.smithi104.stderr:2024-04-03T05:13:58.881+0000 7f22ec9a7980 20 remove_watcher() i=7 2024-04-03T05:13:58.902 INFO:tasks.workunit.client.0.smithi104.stderr:Deleting bucket versioning-bucket 2024-04-03T05:13:58.903 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:58.903 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:58.939 INFO:tasks.workunit.client.0.smithi104.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1103: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-04-03T05:13:58.939 INFO:tasks.workunit.client.0.smithi104.stderr: warnings.warn( 2024-04-03T05:13:59.227 INFO:tasks.workunit.client.0.smithi104.stderr:Completed bucket versioning tests 2024-04-03T05:13:59.228 INFO:tasks.workunit.client.0.smithi104.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-04-03T05:13:59.228 INFO:tasks.workunit.client.0.smithi104.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-04-03T05:13:59.228 INFO:tasks.workunit.client.0.smithi104.stdout:connected to https://localhost:443 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ deactivate 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ export PATH 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset _OLD_VIRTUAL_PATH 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n '' ']' 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ hash -r 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' -n '' ']' 2024-04-03T05:13:59.324 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset VIRTUAL_ENV 2024-04-03T05:13:59.325 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-04-03T05:13:59.325 INFO:tasks.workunit.client.0.smithi104.stderr:+ '[' '!' '' = nondestructive ']' 2024-04-03T05:13:59.325 INFO:tasks.workunit.client.0.smithi104.stderr:+ unset -f deactivate 2024-04-03T05:13:59.325 INFO:tasks.workunit.client.0.smithi104.stderr:+ echo OK. 2024-04-03T05:13:59.326 INFO:tasks.workunit.client.0.smithi104.stdout:OK. 2024-04-03T05:13:59.326 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-03T05:13:59.326 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-03T05:13:59.383 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-04-03T05:13:59.383 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-03T05:13:59.753 DEBUG:teuthology.parallel:result is None 2024-04-03T05:13:59.753 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T05:13:59.766 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T05:13:59.766 DEBUG:teuthology.orchestra.run.smithi104:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-03T05:13:59.813 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-03T05:13:59.814 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-04-03T05:13:59.824 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-04-03T05:13:59.840 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-04-03T05:13:59.840 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-04-03T05:13:59.840 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-04-03T05:13:59.906 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-04-03T05:13:59.906 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-04-03T05:13:59.935 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T05:13:59.936 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T05:13:59.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.965+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:13:59.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:59.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 realm 2024-04-03T05:13:59.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:13:59.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:59.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T05:13:59.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:13:59.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:13:59.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:13:59.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:13:59.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:13:59.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T05:13:59.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.969+0000 7f746b78b980 20 searching for the correct realm 2024-04-03T05:13:59.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:13:59.973+0000 7f7469aa7640 0 -- 172.21.15.104:0/521978613 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7f74640e3a90 msgr2=0x7f74640b8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:14:00.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.189+0000 7f7468aa5640 0 -- 172.21.15.104:0/521978613 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7f74640aa8e0 msgr2=0x7f74640ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:14:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T05:14:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T05:14:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T05:14:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T05:14:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T05:14:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T05:14:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:14:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:14:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:14:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.405+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:14:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T05:14:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 zone default found 2024-04-03T05:14:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 4 Realm: () 2024-04-03T05:14:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T05:14:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T05:14:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T05:14:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 zonegroup default 2024-04-03T05:14:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:14:00.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:00.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:14:00.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:00.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:14:00.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:00.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 started sync module instance, tier type = 2024-04-03T05:14:00.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.409+0000 7f746b78b980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T05:14:00.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.433+0000 7f746b78b980 20 add_watcher() i=0 2024-04-03T05:14:00.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.433+0000 7f746b78b980 20 add_watcher() i=1 2024-04-03T05:14:00.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.433+0000 7f746b78b980 20 add_watcher() i=2 2024-04-03T05:14:00.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.433+0000 7f746b78b980 20 add_watcher() i=3 2024-04-03T05:14:00.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.433+0000 7f746b78b980 20 add_watcher() i=4 2024-04-03T05:14:00.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.433+0000 7f746b78b980 20 add_watcher() i=5 2024-04-03T05:14:00.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.433+0000 7f746b78b980 20 add_watcher() i=6 2024-04-03T05:14:00.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.437+0000 7f746b78b980 20 add_watcher() i=7 2024-04-03T05:14:00.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.437+0000 7f746b78b980 2 all 8 watchers are set, enabling cache 2024-04-03T05:14:00.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.441+0000 7f731f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:14:00.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.441+0000 7f746b78b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T05:14:00.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.441+0000 7f746b78b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T05:14:00.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.537+0000 7f731e7e4640 20 reqs_thread_entry: start 2024-04-03T05:14:00.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.537+0000 7f746b78b980 20 init_complete bucket index max shards: 11 2024-04-03T05:14:00.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.537+0000 7f746b78b980 20 Filter name: none 2024-04-03T05:14:00.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.537+0000 7f728ffff640 20 reqs_thread_entry: start 2024-04-03T05:14:00.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.537+0000 7f746b78b980 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-04-03T05:14:00.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.537+0000 7f746b78b980 20 rados->read ofs=0 len=0 2024-04-03T05:14:00.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.541+0000 7f746b78b980 20 rados_obj.operate() r=0 bl.length=449 2024-04-03T05:14:00.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.541+0000 7f746b78b980 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-04-03T05:14:00.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.541+0000 7f746b78b980 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-04-03T05:14:00.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.541+0000 7f746b78b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-03T05:14:00.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.541+0000 7f746b78b980 10 removing key index: MOELMXVAJVQJHGFPWPHV 2024-04-03T05:14:00.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.545+0000 7f746b78b980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:MOELMXVAJVQJHGFPWPHV, ofs0, ns] 2024-04-03T05:14:00.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.545+0000 7f734cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399258 cookie 94132381044992 notifier 7445 bl.length()=170 2024-04-03T05:14:00.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.545+0000 7f746b78b980 10 removing email index: tester.client.0_test@test.test 2024-04-03T05:14:00.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.549+0000 7f746b78b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-04-03T05:14:00.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.549+0000 7f734cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398952 cookie 94132381036240 notifier 7445 bl.length()=181 2024-04-03T05:14:00.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.549+0000 7f746b78b980 10 removing user buckets index 2024-04-03T05:14:00.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.553+0000 7f746b78b980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-04-03T05:14:00.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.553+0000 7f734cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399259 cookie 94132381044992 notifier 7445 bl.length()=172 2024-04-03T05:14:00.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.557+0000 7f746b78b980 10 removing user index: tester.client.0 2024-04-03T05:14:00.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.561+0000 7f746b78b980 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-04-03T05:14:00.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.561+0000 7f746b78b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-04-03T05:14:00.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.561+0000 7f733ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400061 cookie 94132381041440 notifier 7445 bl.length()=164 2024-04-03T05:14:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.565+0000 7f731f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:14:00.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.569+0000 7f746b78b980 20 remove_watcher() i=0 2024-04-03T05:14:00.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.569+0000 7f746b78b980 2 removed watcher, disabling cache 2024-04-03T05:14:00.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.573+0000 7f746b78b980 20 remove_watcher() i=1 2024-04-03T05:14:00.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.577+0000 7f746b78b980 20 remove_watcher() i=2 2024-04-03T05:14:00.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.577+0000 7f746b78b980 20 remove_watcher() i=3 2024-04-03T05:14:00.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.581+0000 7f746b78b980 20 remove_watcher() i=4 2024-04-03T05:14:00.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.581+0000 7f746b78b980 20 remove_watcher() i=5 2024-04-03T05:14:00.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.585+0000 7f746b78b980 20 remove_watcher() i=6 2024-04-03T05:14:00.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:00.585+0000 7f746b78b980 20 remove_watcher() i=7 2024-04-03T05:14:00.608 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-04-03T05:14:00.618 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-04-03T05:14:00.627 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-04-03T05:14:00.692 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-03T05:14:00.702 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-03T05:14:00.702 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:14:00.742 INFO:tasks.rgw.client.0.smithi104.stdout:2024-04-03T05:14:00.733+0000 e533640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 37660) UID: 0 2024-04-03T05:14:00.742 INFO:tasks.rgw.client.0.smithi104.stdout:2024-04-03T05:14:00.733+0000 8e9be80 -1 shutting down 2024-04-03T05:14:05.111 INFO:tasks.rgw.client.0.smithi104.stderr:==00:01:35:26.466 37664== could not unlink /tmp/vgdb-pipe-from-vgdb-to-37664-by-root-on-??? 2024-04-03T05:14:05.111 INFO:tasks.rgw.client.0.smithi104.stderr:==00:01:35:26.466 37664== could not unlink /tmp/vgdb-pipe-to-vgdb-from-37664-by-root-on-??? 2024-04-03T05:14:05.111 INFO:tasks.rgw.client.0.smithi104.stderr:==00:01:35:26.466 37664== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-37664-by-root-on-??? 2024-04-03T05:14:06.804 INFO:tasks.rgw.client.0:Stopped 2024-04-03T05:14:06.804 DEBUG:teuthology.orchestra.run.smithi104:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-03T05:14:06.811 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f /etc/ceph/vault-root-token 2024-04-03T05:14:06.866 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-03T05:14:06.922 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-03T05:14:06.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-03T05:14:06.923 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-03T05:14:07.001 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-04-03T05:14:07.001 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-04-03T05:14:07.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:07.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 realm 2024-04-03T05:14:07.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:07.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-03T05:14:07.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:07.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:14:07.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.037+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.041+0000 7efe1d9f3980 20 rados_obj.operate() r=0 bl.length=1057 2024-04-03T05:14:07.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.041+0000 7efe1d9f3980 20 searching for the correct realm 2024-04-03T05:14:07.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.045+0000 7efe1bd0f640 0 -- 172.21.15.104:0/4071443380 >> [v2:172.21.15.130:6824/3307467241,v1:172.21.15.130:6825/3307467241] conn(0x7efe140c6040 msgr2=0x7efe140c7940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:14:07.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.261+0000 7efe1ad0d640 0 -- 172.21.15.104:0/4071443380 >> [v2:172.21.15.104:6809/1629744318,v1:172.21.15.104:6810/1629744318] conn(0x7efe140bb030 msgr2=0x7efe140f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:14:07.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 RGWRados::pool_iterate: got zone_info.87e710bc-6ab8-4bc9-b5e4-c80563afdb7d 2024-04-03T05:14:07.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-03T05:14:07.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 RGWRados::pool_iterate: got default.zone. 2024-04-03T05:14:07.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 RGWRados::pool_iterate: got zonegroup_info.deafe728-efc6-42f5-87cb-2d3a5074bae2 2024-04-03T05:14:07.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 RGWRados::pool_iterate: got zone_names.default 2024-04-03T05:14:07.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-03T05:14:07.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:07.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 rados_obj.operate() r=0 bl.length=46 2024-04-03T05:14:07.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.477+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 rados_obj.operate() r=0 bl.length=470 2024-04-03T05:14:07.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 zone default found 2024-04-03T05:14:07.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 4 Realm: () 2024-04-03T05:14:07.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 4 ZoneGroup: default (deafe728-efc6-42f5-87cb-2d3a5074bae2) 2024-04-03T05:14:07.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 4 Zone: default (87e710bc-6ab8-4bc9-b5e4-c80563afdb7d) 2024-04-03T05:14:07.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-03T05:14:07.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 zonegroup default 2024-04-03T05:14:07.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:07.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:07.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 rados->read ofs=0 len=0 2024-04-03T05:14:07.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-04-03T05:14:07.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 started sync module instance, tier type = 2024-04-03T05:14:07.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.481+0000 7efe1d9f3980 20 started zone id=87e710bc-6ab8-4bc9-b5e4-c80563afdb7d (name=default) with tier type = 2024-04-03T05:14:07.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.509+0000 7efe1d9f3980 20 add_watcher() i=0 2024-04-03T05:14:07.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.509+0000 7efe1d9f3980 20 add_watcher() i=1 2024-04-03T05:14:07.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.509+0000 7efe1d9f3980 20 add_watcher() i=2 2024-04-03T05:14:07.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.509+0000 7efe1d9f3980 20 add_watcher() i=3 2024-04-03T05:14:07.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.509+0000 7efe1d9f3980 20 add_watcher() i=4 2024-04-03T05:14:07.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.509+0000 7efe1d9f3980 20 add_watcher() i=5 2024-04-03T05:14:07.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.509+0000 7efe1d9f3980 20 add_watcher() i=6 2024-04-03T05:14:07.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.509+0000 7efe1d9f3980 20 add_watcher() i=7 2024-04-03T05:14:07.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.509+0000 7efe1d9f3980 2 all 8 watchers are set, enabling cache 2024-04-03T05:14:07.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.513+0000 7efcd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:14:07.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.513+0000 7efe1d9f3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-03T05:14:07.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.513+0000 7efe1d9f3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-03T05:14:07.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.605+0000 7efcd17e2640 20 reqs_thread_entry: start 2024-04-03T05:14:07.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.605+0000 7efe1d9f3980 20 init_complete bucket index max shards: 11 2024-04-03T05:14:07.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.605+0000 7efe1d9f3980 20 Filter name: none 2024-04-03T05:14:07.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.605+0000 7efcca7fc640 20 reqs_thread_entry: start 2024-04-03T05:14:07.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.605+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-03T05:14:07.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:07.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50205' 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16259380969837099435', time=2024-04-03T06:23:57.445408+0000, chain.objs.size()=1 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.178__shadow_.K2_BjnGtNOEHkDewQE_xjYznAN-zeub_0 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13939067077138717652', time=2024-04-03T06:25:12.656874+0000, chain.objs.size()=1 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.203__shadow_.9Bzs3hhB4c2EMS_ydn5YWI4urQQEYQq_0 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11734259034657518028', time=2024-04-03T06:25:16.942349+0000, chain.objs.size()=1 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.205__shadow_.XIUzaB9FtimxmgMXBSuhUHxy_efvQYD_0 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15734000902489714413', time=2024-04-03T06:25:20.713306+0000, chain.objs.size()=1 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.206__shadow_.2-pe1loMNbLReXDw86ruA2zxhxbN8Ac_0 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4382827258064788674', time=2024-04-03T06:25:36.167080+0000, chain.objs.size()=1 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.212__shadow_.Z6i1FJAKKBfbaoKYwD_RFcHYM8Kp6H8_0 2024-04-03T05:14:07.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3447422173957924289', time=2024-04-03T06:27:52.151660+0000, chain.objs.size()=1 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ftqyEB-5XyPFKRXtByFiWiJlh8PAeZn_0 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9867165876193101404', time=2024-04-03T06:27:53.533863+0000, chain.objs.size()=1 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.CExDr9eR5BJWPKFyfChm1pkcSY80nBx_0 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18365882787437747513', time=2024-04-03T06:27:54.104357+0000, chain.objs.size()=1 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LM0AdjvWY0noBaS6gbLmdCZqRmXwJ4g_0 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10723477590890939965', time=2024-04-03T06:27:54.317146+0000, chain.objs.size()=1 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.IHhDbg6Zdh_wrNbaRjVoPcaRDfzvRz5_0 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9482980001500785687', time=2024-04-03T06:27:55.172662+0000, chain.objs.size()=1 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QsS24QifH1aqQ88BoHX9LUaSha09qUn_0 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5977878486537267153', time=2024-04-03T06:27:56.672201+0000, chain.objs.size()=1 2024-04-03T05:14:07.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.z77M6cKdwNUeE0xsT48d1FOSnQ5XNRd_0 2024-04-03T05:14:07.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.613+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1917072318765241756', time=2024-04-03T06:27:57.733180+0000, chain.objs.size()=1 2024-04-03T05:14:07.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.613+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.2mciQ7sj7Si_BqAQw19jRmj3hhVOOq1_0 2024-04-03T05:14:07.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8375089596568777597', time=2024-04-03T06:27:58.249905+0000, chain.objs.size()=1 2024-04-03T05:14:07.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ew2JdbMYp1VsjBkeXvNSO7NpVf4-Oi5_0 2024-04-03T05:14:07.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16006287976100914286', time=2024-04-03T06:27:58.946907+0000, chain.objs.size()=1 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.unGLQiqhmhvBspZ5x2ZxMsa-ykAZq-8_0 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4187203798834940575', time=2024-04-03T06:27:59.036833+0000, chain.objs.size()=1 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0eZdb1EWxCBMS83CEEjMqF15bGUyDE1_0 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4575875505618779674', time=2024-04-03T06:28:00.668693+0000, chain.objs.size()=1 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Q8LMf1cz8aplIsIKYGdshBYFBDwWI18_0 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9333936973864572898', time=2024-04-03T06:28:01.113467+0000, chain.objs.size()=1 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Ix5YpZftwmXYWg9YM0l_l7GBHfdmJhP_0 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7815960524505212091', time=2024-04-03T06:28:04.670065+0000, chain.objs.size()=1 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.57XrPJDB2EujIBrEJMbw6pK0uoeOCpO_0 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17731951382585572035', time=2024-04-03T06:28:04.870287+0000, chain.objs.size()=1 2024-04-03T05:14:07.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vTi1oGjDABAL7YSX2UAUHsv3-BlPsSd_0 2024-04-03T05:14:07.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5759249351025606187', time=2024-04-03T06:28:05.245378+0000, chain.objs.size()=1 2024-04-03T05:14:07.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.we-5m1BmCjAfN5U6GeRgS4BHswqv1oQ_0 2024-04-03T05:14:07.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18373408726398244758', time=2024-04-03T06:28:08.977952+0000, chain.objs.size()=1 2024-04-03T05:14:07.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8GJbYBU-BrBZhj-pBnwF1yv6tnICUci_0 2024-04-03T05:14:07.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17753044071906219413', time=2024-04-03T06:28:10.230095+0000, chain.objs.size()=1 2024-04-03T05:14:07.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9wBWJvqhZVxiPMhyFN2Dyf7oiLAPXek_0 2024-04-03T05:14:07.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6127854542990329370', time=2024-04-03T06:28:10.387098+0000, chain.objs.size()=1 2024-04-03T05:14:07.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.69rYk8I-W7SsIDp_YIO3Em98Xz-SE5p_0 2024-04-03T05:14:07.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8388336156758852271', time=2024-04-03T06:28:10.450974+0000, chain.objs.size()=1 2024-04-03T05:14:07.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.AL4Kuh_v-4tMnqjl7tBNUlEhEBspJv-_0 2024-04-03T05:14:07.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6269636850119490867', time=2024-04-03T06:28:10.737109+0000, chain.objs.size()=1 2024-04-03T05:14:07.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7uh2emEbKaNGBgQRgBBGhVlZhItQU5D_0 2024-04-03T05:14:07.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4724875868863492713', time=2024-04-03T06:28:11.531905+0000, chain.objs.size()=1 2024-04-03T05:14:07.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TRaitVrBaL0jS-JX_HZkelw0d70LfRF_0 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14743915438137566973', time=2024-04-03T06:28:12.657292+0000, chain.objs.size()=1 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ItwjMCY66zzrZVCK1FEi7HSYMd271bw_0 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5840440469744771808', time=2024-04-03T06:28:12.990111+0000, chain.objs.size()=1 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.PBNNPAQV4cB2rVwVqOczPiWzf93XsvY_0 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16238753828549689727', time=2024-04-03T06:28:15.574480+0000, chain.objs.size()=1 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5TW7FqvjQh_yFCprxbDMPlf4-I8touM_0 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6502719185523325824', time=2024-04-03T06:28:15.650876+0000, chain.objs.size()=1 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LNh0SprHjbvYA_KDK02Y4TBmsX_jgpH_0 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14542229402590974831', time=2024-04-03T06:28:19.140893+0000, chain.objs.size()=1 2024-04-03T05:14:07.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.uLojuSK-Ubd4IygR_0F2ZdaRDh3Ijx3_0 2024-04-03T05:14:07.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13371309902309560421', time=2024-04-03T06:28:20.591659+0000, chain.objs.size()=1 2024-04-03T05:14:07.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.S36a98RCDmAPvQMV0voL6FcC7Gyz_WQ_0 2024-04-03T05:14:07.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8709365121169800014', time=2024-04-03T06:29:22.655833+0000, chain.objs.size()=1 2024-04-03T05:14:07.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.259__shadow_.Q5Pq-s03cC1QEjfUZhoT4vxobzqnsBL_0 2024-04-03T05:14:07.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13584125187154477869', time=2024-04-03T06:29:36.214545+0000, chain.objs.size()=1 2024-04-03T05:14:07.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.Kwo-H6Rz758GT_Xr_Oy9VyX3HyC85xO_0 2024-04-03T05:14:07.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.637+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12928813596358509638', time=2024-04-03T06:29:58.630776+0000, chain.objs.size()=1 2024-04-03T05:14:07.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.637+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.272__shadow_.CBAUxX3kCk8_63DCkO0OOXfpcZPiAI__0 2024-04-03T05:14:07.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3798892487724624389', time=2024-04-03T06:30:05.609025+0000, chain.objs.size()=1 2024-04-03T05:14:07.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.275__shadow_.2oaK1Cpy51c56MTvlWfJFO8LIKPWqsk_0 2024-04-03T05:14:07.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9214127908551855504', time=2024-04-03T06:30:32.757456+0000, chain.objs.size()=1 2024-04-03T05:14:07.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.284__shadow_.DgI9m3IJaeaErt1B_Q5QOhKozdRnttV_0 2024-04-03T05:14:07.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.645+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17092019794894847588', time=2024-04-03T06:32:25.220796+0000, chain.objs.size()=1 2024-04-03T05:14:07.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.645+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.kHXact_em0CDQy76tbZWyqVbjWDVCGW_0 2024-04-03T05:14:07.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.645+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11468314953677214032', time=2024-04-03T06:32:26.306088+0000, chain.objs.size()=1 2024-04-03T05:14:07.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.645+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.a-52wTdD2cYe3H3w4L8ErWPFlFzzNjm_0 2024-04-03T05:14:07.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1875381737113354530', time=2024-04-03T06:32:28.061053+0000, chain.objs.size()=1 2024-04-03T05:14:07.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AXK8SfxmnuRuYrMirD4lwFjXw7hkXWO_0 2024-04-03T05:14:07.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12046728068704788144', time=2024-04-03T06:32:28.789718+0000, chain.objs.size()=1 2024-04-03T05:14:07.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MLjq4cPsgnMV_-jZYARFZLv1cUFZaeo_0 2024-04-03T05:14:07.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14754432544579214664', time=2024-04-03T06:32:30.117010+0000, chain.objs.size()=1 2024-04-03T05:14:07.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.nmvcOpzGBZIpCXfuUwuuw3RCkjFlCdx_0 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11789788414174458686', time=2024-04-03T06:32:30.549145+0000, chain.objs.size()=1 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xVsiVaiS9usoEnn30mabCAh3retFHVj_0 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2784123006766546056', time=2024-04-03T06:32:34.566924+0000, chain.objs.size()=1 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.T2hBnEKQWz4FZz9mGIiHDcVl6V2fM5g_0 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2842061557519318759', time=2024-04-03T06:32:35.659156+0000, chain.objs.size()=1 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uum9BDaP23QwwQNLWMhif9mNlRsPFyb_0 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4890804241587574538', time=2024-04-03T06:32:36.136591+0000, chain.objs.size()=1 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Ahg916aKdMz_P5xdTinE6UJWqDuxVSt_0 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12263642717164689382', time=2024-04-03T06:32:36.418122+0000, chain.objs.size()=1 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Fh9zmtOU0yyH9XO-wKP6IOzyR4NR90-_0 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12607129764569371845', time=2024-04-03T06:32:37.417769+0000, chain.objs.size()=1 2024-04-03T05:14:07.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2OJGH_FrZrIfTEAURGJ91KfOykpCegV_0 2024-04-03T05:14:07.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7610996915784537446', time=2024-04-03T06:32:39.802754+0000, chain.objs.size()=1 2024-04-03T05:14:07.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lUeMUW4sk0VT4-59KCBv0XHtOubpiEp_0 2024-04-03T05:14:07.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11658919092310486324', time=2024-04-03T06:32:41.066272+0000, chain.objs.size()=1 2024-04-03T05:14:07.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qkqNmIioJeNuMAcQPTX5gEzSeyWDqwC_0 2024-04-03T05:14:07.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10685579810721835808', time=2024-04-03T06:32:41.544696+0000, chain.objs.size()=1 2024-04-03T05:14:07.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Grz9HYTD2cBgovtI3uCEt3nPZeZZIwV_0 2024-04-03T05:14:07.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13725402818792148036', time=2024-04-03T06:32:41.939372+0000, chain.objs.size()=1 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.3yG-1VKS6z3nTN8KxYzSo9iFiqmh2pD_0 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16750720346071741183', time=2024-04-03T06:32:42.046715+0000, chain.objs.size()=1 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hwdvL44Xe1gnJeuK-6AtguIsGoKr_Zd_0 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.867548884483928929', time=2024-04-03T06:32:43.314989+0000, chain.objs.size()=1 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-6iwdCLBrJeL46UlkEXBM09nxsi0mYS_0 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9916735415814969539', time=2024-04-03T06:32:43.482284+0000, chain.objs.size()=1 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-1O34aLTpeI2H_FWVj6RFPHK7oAfjCL_0 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4719219492257467232', time=2024-04-03T06:32:44.455461+0000, chain.objs.size()=1 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YEtiI_RGZvXVadNfq7xIajci7KU4m_z_0 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13004107210678268773', time=2024-04-03T06:32:45.408257+0000, chain.objs.size()=1 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GKWzqunlY3DxM_LutYOhjlCOAhUc1Ry_0 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3037979428323804505', time=2024-04-03T06:32:45.475789+0000, chain.objs.size()=1 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1XbAkojtBrvvvJWQfC1-vU-JfgSNrtV_0 2024-04-03T05:14:07.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10149294815530978113', time=2024-04-03T06:32:45.477537+0000, chain.objs.size()=1 2024-04-03T05:14:07.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xMwukzzyXC0lGJ_M9JgCLctEhwybRAc_0 2024-04-03T05:14:07.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2313297053080309048', time=2024-04-03T06:32:46.425655+0000, chain.objs.size()=1 2024-04-03T05:14:07.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gFZpOLGZ-a-qHk3yi-AJ8ypYME4upqg_0 2024-04-03T05:14:07.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.665+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6940041048330061992', time=2024-04-03T06:32:46.492747+0000, chain.objs.size()=1 2024-04-03T05:14:07.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.665+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.kXEzDvrDXQJg0hfqcIEStIarT3E0CvY_0 2024-04-03T05:14:07.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.665+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5425377672474789038', time=2024-04-03T06:32:47.229059+0000, chain.objs.size()=1 2024-04-03T05:14:07.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.665+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gc87s3VmdCWuXFN620aQaBJJmdGlP3a_0 2024-04-03T05:14:07.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.669+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5633915306069597377', time=2024-04-03T06:32:47.470052+0000, chain.objs.size()=1 2024-04-03T05:14:07.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.669+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XqTm3w8gObMO71fWTwh_5eAb8UJrukb_0 2024-04-03T05:14:07.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17273300837338407413', time=2024-04-03T06:32:48.795368+0000, chain.objs.size()=1 2024-04-03T05:14:07.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RxAVzcAz-Z-ze6fXejMdSI3hxAwhgr-_0 2024-04-03T05:14:07.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13792968317721245435', time=2024-04-03T06:32:50.926701+0000, chain.objs.size()=1 2024-04-03T05:14:07.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.l2v8tRl_fTFJ1kAT3J9dSRAdJWKOA-j_0 2024-04-03T05:14:07.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5164472965450307769', time=2024-04-03T06:32:51.367178+0000, chain.objs.size()=1 2024-04-03T05:14:07.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CNIxcOMGQFyoAzJbelNSQjbDM9-3awp_0 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6356034377527230814', time=2024-04-03T06:32:52.053662+0000, chain.objs.size()=1 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hgP9Z8kWf9u0vDwQley3_ElPrJ2OVRf_0 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6607145294917676558', time=2024-04-03T06:34:30.472606+0000, chain.objs.size()=1 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dPM7u5NxTHLQyG2znKtLX9qRNTuuhpv_0 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18085419251881276764', time=2024-04-03T06:34:30.691927+0000, chain.objs.size()=1 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.A9vBOEUjmMakik5BakwT9LJ3PlACfod_0 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4134466279429591080', time=2024-04-03T06:34:30.996082+0000, chain.objs.size()=1 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KVl0SdJWRzkbRoASJneCAzKvF5vWW2L_0 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13570187174768495837', time=2024-04-03T06:34:32.602329+0000, chain.objs.size()=1 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Hbvn2h0ndv8vraz1_onbEzwyDslTVIO_0 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3514881562742138505', time=2024-04-03T06:34:33.694528+0000, chain.objs.size()=1 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.UQr5NWm7N57ZjuAdTvAputyYTnpKJF6_0 2024-04-03T05:14:07.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4869841171099269334', time=2024-04-03T06:34:34.206071+0000, chain.objs.size()=1 2024-04-03T05:14:07.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zyZwxTq2qyxoRjhUgX2LMpaOKukoAXN_0 2024-04-03T05:14:07.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.677+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.892398872809887186', time=2024-04-03T06:34:34.553141+0000, chain.objs.size()=1 2024-04-03T05:14:07.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.V4tM98M7S93Rl_emv3CzdespIfqZCdv_0 2024-04-03T05:14:07.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13507555841600528242', time=2024-04-03T06:34:34.675343+0000, chain.objs.size()=1 2024-04-03T05:14:07.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.m3n8lxZnfMZBaJQKgmOjSALkZRWKldq_0 2024-04-03T05:14:07.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14066461496306965441', time=2024-04-03T06:34:36.434556+0000, chain.objs.size()=1 2024-04-03T05:14:07.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9jUh4AhDG5rF_oZF_MjDFEIhBc70VWO_0 2024-04-03T05:14:07.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17502006306971204661', time=2024-04-03T06:34:36.436056+0000, chain.objs.size()=1 2024-04-03T05:14:07.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QPiJTSAmKVzKrRnfLkF5dQw5Q6f7XJp_0 2024-04-03T05:14:07.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.928066147338330733', time=2024-04-03T06:34:37.205369+0000, chain.objs.size()=1 2024-04-03T05:14:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nw0KQ3LzfftL7hu0ykWyuAD_7QCx4gn_0 2024-04-03T05:14:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1926600406758212597', time=2024-04-03T06:34:38.783543+0000, chain.objs.size()=1 2024-04-03T05:14:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ZI-KsnCPmJBfODmPicwadesLhOJgk_s_0 2024-04-03T05:14:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5253412620141942703', time=2024-04-03T06:34:41.963114+0000, chain.objs.size()=1 2024-04-03T05:14:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LghGDvCCA_sfJ2KEnrTsFPbfnic-kCV_0 2024-04-03T05:14:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11060377571500724030', time=2024-04-03T06:34:44.536716+0000, chain.objs.size()=1 2024-04-03T05:14:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.OA5d6RWPQGghchNgrIj70hikQrM254w_0 2024-04-03T05:14:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18021811551189784136', time=2024-04-03T06:34:44.753825+0000, chain.objs.size()=1 2024-04-03T05:14:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.uOeYMt2rFLcJ9SzkJS9_VMUeyQoVizg_0 2024-04-03T05:14:07.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2077319730298112156', time=2024-04-03T06:34:44.831913+0000, chain.objs.size()=1 2024-04-03T05:14:07.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9Le5xF7ufBFIxPFTQ3S4IydGiR4k4Ld_0 2024-04-03T05:14:07.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2135491899035181723', time=2024-04-03T06:34:47.364316+0000, chain.objs.size()=1 2024-04-03T05:14:07.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1v4GarBLKTgwmB1-rkXAjdyvyKJEF83_0 2024-04-03T05:14:07.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14077205825476560962', time=2024-04-03T06:34:47.653189+0000, chain.objs.size()=1 2024-04-03T05:14:07.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.NVHBDzw5NNUJwytLVjzemR8tczBRmhY_0 2024-04-03T05:14:07.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6851366826841935117', time=2024-04-03T06:34:48.037856+0000, chain.objs.size()=1 2024-04-03T05:14:07.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.v-HgmQyRRwHtQXK9hAeG_nKlxXc5D7h_0 2024-04-03T05:14:07.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5508594294293837824', time=2024-04-03T06:34:48.334374+0000, chain.objs.size()=1 2024-04-03T05:14:07.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BnH9muw944tig30y3HrDt5WyR8I0XwX_0 2024-04-03T05:14:07.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4369222874906716975', time=2024-04-03T06:34:48.375202+0000, chain.objs.size()=1 2024-04-03T05:14:07.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.d_lTYWqm-YvYJalHuImLj_WQBUQx_WE_0 2024-04-03T05:14:07.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8526024297224126238', time=2024-04-03T06:34:49.145490+0000, chain.objs.size()=1 2024-04-03T05:14:07.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Hg-1q7FTIjYym6K3E0_6bgUXlguYCdm_0 2024-04-03T05:14:07.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11636479527213141017', time=2024-04-03T06:34:50.076863+0000, chain.objs.size()=1 2024-04-03T05:14:07.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1YDdM3FnKc5xhFzwkd1Y2nottEIws1G_0 2024-04-03T05:14:07.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18305186712958126664', time=2024-04-03T06:34:51.654254+0000, chain.objs.size()=1 2024-04-03T05:14:07.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yR5D4T4HOu3LVfF5gQgHFL_3_dy_BVX_0 2024-04-03T05:14:07.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.263888250879023565', time=2024-04-03T06:34:52.682266+0000, chain.objs.size()=1 2024-04-03T05:14:07.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0Mc9IMFhIVh8iODGA76B70koGqa-gau_0 2024-04-03T05:14:07.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12296969437391758334', time=2024-04-03T06:34:53.284041+0000, chain.objs.size()=1 2024-04-03T05:14:07.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3stbrrELlb0U9pO1fEKElK2WiccDzjo_0 2024-04-03T05:14:07.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.929101367111770231', time=2024-04-03T06:34:54.495682+0000, chain.objs.size()=1 2024-04-03T05:14:07.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rObdc3Sx7hnE9lfL84IyCAuwAbAvu1f_0 2024-04-03T05:14:07.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1473769896979096133', time=2024-04-03T06:34:55.142467+0000, chain.objs.size()=1 2024-04-03T05:14:07.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dRLV7A-DsXw5VAZCKxOeEGmbEKhDT5N_0 2024-04-03T05:14:07.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11485861999489714564', time=2024-04-03T06:34:56.365214+0000, chain.objs.size()=1 2024-04-03T05:14:07.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._6QRj2PjTZgyuq1tQFaf7XZ6GUz4bPD_0 2024-04-03T05:14:07.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9949911074417673112', time=2024-04-03T06:34:56.463526+0000, chain.objs.size()=1 2024-04-03T05:14:07.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dYLg8XiR2hw3Ub-gqNTMardTTux6Jbz_0 2024-04-03T05:14:07.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3108454558436852846', time=2024-04-03T06:37:02.603730+0000, chain.objs.size()=1 2024-04-03T05:14:07.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.359__shadow_.fa-3VW8iuAclgCuplv-VRmBl-owAGWw_0 2024-04-03T05:14:07.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5019542308839339397', time=2024-04-03T06:39:40.609730+0000, chain.objs.size()=1 2024-04-03T05:14:07.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.433__shadow_.xgxoXacRh9ej1jIHx41IwZ0J7CBOO1a_0 2024-04-03T05:14:07.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7063498519342603187', time=2024-04-03T06:39:49.074329+0000, chain.objs.size()=1 2024-04-03T05:14:07.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.436__shadow_.SZBkQiHT_enrOY4iRcmSLwuvyZ19lwo_0 2024-04-03T05:14:07.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/50205 2024-04-03T05:14:07.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-04-03T05:14:07.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.465__shadow_.zp0-638skNtfHlIlb2aqBlBLgh6px6Q_1_ff0dacfccecc9a3a6d785352916f8a8f', time=2024-04-03T06:40:44.153571+0000, chain.objs.size()=1 2024-04-03T05:14:07.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.465__shadow_.zp0-638skNtfHlIlb2aqBlBLgh6px6Q_0 2024-04-03T05:14:07.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6918428648867251831', time=2024-04-03T06:40:54.313042+0000, chain.objs.size()=1 2024-04-03T05:14:07.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.470__shadow_.mIBx_Q87CWFOZ0ZA6-iV97_Iv4XBdce_0 2024-04-03T05:14:07.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_1_79a4d79e9d5b71deace9b5c49b6c323d', time=2024-04-03T06:41:02.032981+0000, chain.objs.size()=1 2024-04-03T05:14:07.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_0 2024-04-03T05:14:07.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7150534971085153306', time=2024-04-03T06:42:27.168854+0000, chain.objs.size()=1 2024-04-03T05:14:07.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.487__shadow_.Cmjc4xkKK5wR21nRyAm5Jjvh6W4leTe_0 2024-04-03T05:14:07.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7721897425510003580', time=2024-04-03T06:43:51.257445+0000, chain.objs.size()=6 2024-04-03T05:14:07.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__multipart_mymultipart.2~v9NbmGl-Gbj0tmzl9REOoeVF60BB8CE.1 2024-04-03T05:14:07.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__shadow_mymultipart.2~v9NbmGl-Gbj0tmzl9REOoeVF60BB8CE.1_1 2024-04-03T05:14:07.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__multipart_mymultipart.2~v9NbmGl-Gbj0tmzl9REOoeVF60BB8CE.2 2024-04-03T05:14:07.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__shadow_mymultipart.2~v9NbmGl-Gbj0tmzl9REOoeVF60BB8CE.2_1 2024-04-03T05:14:07.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__multipart_mymultipart.2~v9NbmGl-Gbj0tmzl9REOoeVF60BB8CE.3 2024-04-03T05:14:07.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__shadow_mymultipart.2~v9NbmGl-Gbj0tmzl9REOoeVF60BB8CE.3_1 2024-04-03T05:14:07.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17248996835970154847', time=2024-04-03T06:53:05.280288+0000, chain.objs.size()=1 2024-04-03T05:14:07.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.540__shadow_.dL9zHb4szxT0yqz4USRCSs4jLG_zbwO_0 2024-04-03T05:14:07.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8810623527808244631', time=2024-04-03T06:53:15.207731+0000, chain.objs.size()=1 2024-04-03T05:14:07.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow_.sFG_l62F45_Xe44vu41bUwa-eVBwCwT_0 2024-04-03T05:14:07.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16300277605538958972', time=2024-04-03T06:53:42.438131+0000, chain.objs.size()=1 2024-04-03T05:14:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:Tt0SlOASQb1RTDjV7-sL00Dgd-O9S3Q_.hQnScjAigosNp11gQl89aj6DuW95u5Y_0 2024-04-03T05:14:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5337321175197000319', time=2024-04-03T06:53:57.253651+0000, chain.objs.size()=1 2024-04-03T05:14:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:UCCxACg6jmJkBdgmcoXflaARl7mqI9q_.IQ-fDhYbdqRthw784PV9YCHj-iCUDAE_0 2024-04-03T05:14:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9520289035830647664', time=2024-04-03T07:03:37.422231+0000, chain.objs.size()=1 2024-04-03T05:14:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.628__shadow_.Pknu_mcr3wEvRucUU5v1_QPsgFoCCP0_0 2024-04-03T05:14:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8761143884702839529', time=2024-04-03T07:03:40.349598+0000, chain.objs.size()=1 2024-04-03T05:14:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.629__shadow_.5xapQRHLWGeGWrPELagbWCNEWsp2vvY_0 2024-04-03T05:14:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17864323147306574905', time=2024-04-03T07:05:12.678756+0000, chain.objs.size()=1 2024-04-03T05:14:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.678__shadow:OIgkcU.Nr6ueordwHWpvdkTQ6Zc8Lyk_.IWVZrKlJFScaLmCXJ5HZlrUBQdOZKoR_0 2024-04-03T05:14:07.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6935376086783235715', time=2024-04-03T07:05:28.132897+0000, chain.objs.size()=1 2024-04-03T05:14:07.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.681__shadow:oPISxH6pHAN86YXfCmtBjaY-iNhj2QJ_.yv9yA0mVImJtxJdUiig9yA2rUFlbBGn_0 2024-04-03T05:14:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:07.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-03T05:14:07.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:07.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44870' 2024-04-03T05:14:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_QQMa9EniMt2rZTQgUmSsBnLofop-nbf', time=2024-04-03T06:22:52.001614+0000, chain.objs.size()=1 2024-04-03T05:14:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.152__shadow_.HQD_Y7aizcyfmB77gi_No_BYDZFgJy2_0 2024-04-03T05:14:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15487654635764623659', time=2024-04-03T06:24:51.546601+0000, chain.objs.size()=1 2024-04-03T05:14:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.193__shadow_.M4Z7B_uLnQyHzb3w6Gu9I13ANI6Yi55_0 2024-04-03T05:14:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13281993561005949310', time=2024-04-03T06:25:14.798270+0000, chain.objs.size()=1 2024-04-03T05:14:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.204__shadow_.eV9Z37doOTOquGitUSoz-Klkouh4Z6L_0 2024-04-03T05:14:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16694306217843135443', time=2024-04-03T06:25:30.217287+0000, chain.objs.size()=1 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.210__shadow_.SvMGpYNAbb_YMAGLAaX1YDnzS2TMxiy_0 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9129144619715023190', time=2024-04-03T06:27:53.152652+0000, chain.objs.size()=1 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.T4F1qZkIhxQl5MuEszmIaevyO7Jeuo0_0 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17483454795739268850', time=2024-04-03T06:27:53.544316+0000, chain.objs.size()=1 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_._X84P_wGwQqXXVqRJ4FJ9s02zlFC0hQ_0 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17547644855603639630', time=2024-04-03T06:27:54.497020+0000, chain.objs.size()=1 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.76rhBJ0KLqOBXI1OBTCAQ_m5S9-6JoA_0 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13562009510222971281', time=2024-04-03T06:27:54.854944+0000, chain.objs.size()=1 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.D6mG2_PH1bULetnFBPdIgbgnc64t94v_0 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4522046254965586792', time=2024-04-03T06:27:55.062951+0000, chain.objs.size()=1 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7PLCMc7h7Fh6uobSxAp03kNYHIZYcO2_0 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13606783434370469425', time=2024-04-03T06:27:56.274775+0000, chain.objs.size()=1 2024-04-03T05:14:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.iHsTo1TUGHvXO9yX-W7IO6_TlNwUo7N_0 2024-04-03T05:14:07.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5471449983986240018', time=2024-04-03T06:27:56.970702+0000, chain.objs.size()=1 2024-04-03T05:14:07.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gISoho9vE3B0JY9lnhaTLU__cbOsCuz_0 2024-04-03T05:14:07.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6768526560919792746', time=2024-04-03T06:28:01.235430+0000, chain.objs.size()=1 2024-04-03T05:14:07.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Q_ZRZTtw_6krYNPeL-yqohOxwqEbIdd_0 2024-04-03T05:14:07.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3738596679411970463', time=2024-04-03T06:28:02.221834+0000, chain.objs.size()=1 2024-04-03T05:14:07.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.RZVIIzdbB2cIYe5k-6VRnkRaVA32a6__0 2024-04-03T05:14:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17253857744048331462', time=2024-04-03T06:28:04.194626+0000, chain.objs.size()=1 2024-04-03T05:14:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UMpqj6GoXJz4rWIy35o7oW8dgw6mT_u_0 2024-04-03T05:14:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3137417499760661477', time=2024-04-03T06:28:05.236965+0000, chain.objs.size()=1 2024-04-03T05:14:07.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.KNwz4YRTOfNAL0AY7HOOwyflSAhClYg_0 2024-04-03T05:14:07.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11160925342321731446', time=2024-04-03T06:28:06.265630+0000, chain.objs.size()=1 2024-04-03T05:14:07.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.O0XWh3YPhXXwImsjb6c_OxFAuvdY8Hf_0 2024-04-03T05:14:07.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14280266022940606851', time=2024-04-03T06:28:06.678564+0000, chain.objs.size()=1 2024-04-03T05:14:07.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mQaL06VLxMsZekgN3wtre37rCX128v0_0 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14721608726008246058', time=2024-04-03T06:28:07.827696+0000, chain.objs.size()=1 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.F6sDrVezaAXJM35vW_nLaavVDh9ZQTf_0 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17362488478939870234', time=2024-04-03T06:28:09.484729+0000, chain.objs.size()=1 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ofyV_TKZoLC9-BCZkeSxKOiumAwsvKT_0 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.337636008472611150', time=2024-04-03T06:28:10.034371+0000, chain.objs.size()=1 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qu4QWOBUyaGQk7J3KC6RYwOYXJt_da0_0 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.86041248492568629', time=2024-04-03T06:28:10.619109+0000, chain.objs.size()=1 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8HquoKPELoiOiaYsBKrPqzu5kfhGztD_0 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.177790591844555532', time=2024-04-03T06:28:10.661631+0000, chain.objs.size()=1 2024-04-03T05:14:07.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.623NNbHk0BoiyfENhf1EvbkVC2j8SXs_0 2024-04-03T05:14:07.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.745+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6875608095426937841', time=2024-04-03T06:28:11.551089+0000, chain.objs.size()=1 2024-04-03T05:14:07.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.745+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.s-J1me46-4xYupwaZ83AKFfJzu9NUfk_0 2024-04-03T05:14:07.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.745+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14158234365526414959', time=2024-04-03T06:28:12.113968+0000, chain.objs.size()=1 2024-04-03T05:14:07.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.745+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9YwZjDKUFU5mfsob0oobKUKAHZTVL7g_0 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2704680208968793984', time=2024-04-03T06:28:12.670689+0000, chain.objs.size()=1 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.t0ZdzpBnm2aMDn4TY3wqtDVcwnhG7oV_0 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13760750706315702352', time=2024-04-03T06:28:17.465915+0000, chain.objs.size()=1 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.H5zGfcXcwFZ5NfF8YKIuayJyNaxI3sG_0 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.874705835621574002', time=2024-04-03T06:28:17.888491+0000, chain.objs.size()=1 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7cUnG3-Vpg2hUrYtghW0NYN3nJcMa0T_0 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13174896585970547145', time=2024-04-03T06:28:18.660499+0000, chain.objs.size()=1 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QMcZPUQlQFmAwxoIDNQT_2xmsNrEW5N_0 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.945370005904515833', time=2024-04-03T06:28:18.786858+0000, chain.objs.size()=1 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.C9ODZ3MQTLsaTPGozLGWAlw3PYVDke5_0 2024-04-03T05:14:07.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5059588046879157685', time=2024-04-03T06:28:20.273578+0000, chain.objs.size()=1 2024-04-03T05:14:07.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.bGSEgs0xgmJNmAiY2BBsOivb-Q7RaxB_0 2024-04-03T05:14:07.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1399750471988185430', time=2024-04-03T06:28:33.795459+0000, chain.objs.size()=1 2024-04-03T05:14:07.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.237__shadow_.D3CGLBFQlb_hDU4hQOvtXmmDxv58uFk_0 2024-04-03T05:14:07.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17276315318084475627', time=2024-04-03T06:28:40.002295+0000, chain.objs.size()=1 2024-04-03T05:14:07.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.240__shadow_.ICXm7njwtvAqtInalyfmovwoDT3w4OX_0 2024-04-03T05:14:07.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17129671608952050131', time=2024-04-03T06:28:48.445290+0000, chain.objs.size()=1 2024-04-03T05:14:07.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.244__shadow_.3aW4w-tHDtYk4HMsR-ohwzRl-H2oqeV_0 2024-04-03T05:14:07.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.753+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1210708139566965925', time=2024-04-03T06:29:30.861103+0000, chain.objs.size()=1 2024-04-03T05:14:07.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.753+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.8LTR0H7hJWdFUCsLXOATeCVViQg7r8S_0 2024-04-03T05:14:07.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.753+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10659783543501216307', time=2024-04-03T06:30:02.972258+0000, chain.objs.size()=1 2024-04-03T05:14:07.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.753+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.274__shadow_.NjYgq_VNA4M05COzzII6SiJkx2o5iK3_0 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10599793290143033839', time=2024-04-03T06:32:24.407435+0000, chain.objs.size()=1 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.F6Dgjsa0_8A8si-_Auy43UuiGvL1hEh_0 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17830090102430755968', time=2024-04-03T06:32:25.507708+0000, chain.objs.size()=1 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7pOIIRJe5IXBT_-aq6oXABstjBukiT__0 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10846078842735300571', time=2024-04-03T06:32:26.045564+0000, chain.objs.size()=1 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.w2rtWIisMKJ4yVIEYnvMpRomDEaJkdk_0 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18244491643508701013', time=2024-04-03T06:32:26.148309+0000, chain.objs.size()=1 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zQajMTDBk9sVsfJrPFBDhguN9652xZ2_0 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8619446217009048927', time=2024-04-03T06:32:28.800121+0000, chain.objs.size()=1 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.oCyjV6GpCB6qu5tGubQTOe0Q2WRapv9_0 2024-04-03T05:14:07.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.635531584749822922', time=2024-04-03T06:32:29.400908+0000, chain.objs.size()=1 2024-04-03T05:14:07.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8y9zAH7qSwPIb2hNPqOmdG9w6SrnnHM_0 2024-04-03T05:14:07.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11334385694925084805', time=2024-04-03T06:32:29.490884+0000, chain.objs.size()=1 2024-04-03T05:14:07.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FeJn7TTvwVcEBQKLnLCzo9J4YjiSRo4_0 2024-04-03T05:14:07.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3974108056873345880', time=2024-04-03T06:32:33.232084+0000, chain.objs.size()=1 2024-04-03T05:14:07.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OXAMw9-jcrbBOSkalIIxS-zPyXRTDPK_0 2024-04-03T05:14:07.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2736882835116176033', time=2024-04-03T06:32:36.456727+0000, chain.objs.size()=1 2024-04-03T05:14:07.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zSeoh9hRnDZggFsmpYnuZQfsmZXK99x_0 2024-04-03T05:14:07.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4737887838251565314', time=2024-04-03T06:32:37.130388+0000, chain.objs.size()=1 2024-04-03T05:14:07.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lw4boVsn2XYt7snTYHj-pmXjW57RVJD_0 2024-04-03T05:14:07.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1394831514825263772', time=2024-04-03T06:32:37.724061+0000, chain.objs.size()=1 2024-04-03T05:14:07.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.N0nmYaIbJ6i0_GT2ELRHoVmTvbHmfcS_0 2024-04-03T05:14:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16834418615734923780', time=2024-04-03T06:32:38.380553+0000, chain.objs.size()=1 2024-04-03T05:14:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.895qI14IoxaUTIHjTk1H158p_NUSCBr_0 2024-04-03T05:14:07.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11798080834701690203', time=2024-04-03T06:32:39.303279+0000, chain.objs.size()=1 2024-04-03T05:14:07.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sunBMLq49BddHn67BYLf8iTUDIApa7Q_0 2024-04-03T05:14:07.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.841751509153075680', time=2024-04-03T06:32:39.840272+0000, chain.objs.size()=1 2024-04-03T05:14:07.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1wZGc-DCrEz76QfnuqqplSMuE7v172n_0 2024-04-03T05:14:07.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8465466927651264206', time=2024-04-03T06:32:40.770834+0000, chain.objs.size()=1 2024-04-03T05:14:07.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.We4tOmgnM9XME6XHMngGBIIlA221oFS_0 2024-04-03T05:14:07.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17906954093636875813', time=2024-04-03T06:32:41.404616+0000, chain.objs.size()=1 2024-04-03T05:14:07.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9XlXgQ92J3cv_Rk4U3iqP_-8KqTkASx_0 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9268480425607978144', time=2024-04-03T06:32:41.694494+0000, chain.objs.size()=1 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yF5MYuMyYM3ww406-kpnVkJOE6BxpVd_0 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9943232947161066155', time=2024-04-03T06:32:44.145641+0000, chain.objs.size()=1 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pDM63SzLz1_KnJcsjW9Sn5bHgM_y_vP_0 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3532209572098418043', time=2024-04-03T06:32:45.199854+0000, chain.objs.size()=1 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BBk9HzUn55G6DpKEnWrfoQeVjMhJZTJ_0 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14539107186042163707', time=2024-04-03T06:32:45.706541+0000, chain.objs.size()=1 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.LB655UgdnnYHQWEjfI7jmMEz0W9JElI_0 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14571240974062524841', time=2024-04-03T06:32:46.871627+0000, chain.objs.size()=1 2024-04-03T05:14:07.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.iY_qEdJL7TBsmn4zOW0ACG-injJZddQ_0 2024-04-03T05:14:07.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6827411732019815526', time=2024-04-03T06:32:47.292842+0000, chain.objs.size()=1 2024-04-03T05:14:07.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-UDbdZS5HCPs-VmCIsaEOQr4xeRLg9i_0 2024-04-03T05:14:07.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9575481070943894299', time=2024-04-03T06:32:48.397626+0000, chain.objs.size()=1 2024-04-03T05:14:07.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7vz-bSdIU9WNL13OQ2klMMYtvTfFrhz_0 2024-04-03T05:14:07.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8715215818649332912', time=2024-04-03T06:32:48.701120+0000, chain.objs.size()=1 2024-04-03T05:14:07.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0uYrvQGr1S0jLcMbfw2px_g6Z65NA3j_0 2024-04-03T05:14:07.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14518618124738897799', time=2024-04-03T06:32:51.209479+0000, chain.objs.size()=1 2024-04-03T05:14:07.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.N07S81fLxb9OPWh08ULain2wYeuH-sx_0 2024-04-03T05:14:07.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1589366049590360555', time=2024-04-03T06:32:51.214053+0000, chain.objs.size()=1 2024-04-03T05:14:07.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1c0u8TD2paELGnf3Rymxjy-dw72BS4Q_0 2024-04-03T05:14:07.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7131388473377658897', time=2024-04-03T06:34:28.529656+0000, chain.objs.size()=1 2024-04-03T05:14:07.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.276mL4E324TO2BL6cMaFYzDQ7oeLepv_0 2024-04-03T05:14:07.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2253922571854552959', time=2024-04-03T06:34:29.140711+0000, chain.objs.size()=1 2024-04-03T05:14:07.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Vk-vo7dqE9stM48tisAd0CbYY73ToTX_0 2024-04-03T05:14:07.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5720246157883272580', time=2024-04-03T06:34:30.449296+0000, chain.objs.size()=1 2024-04-03T05:14:07.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.MZTrDZcmgXrllOpBOCETh5QnKtUdjN2_0 2024-04-03T05:14:07.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5652460293195173780', time=2024-04-03T06:34:32.606541+0000, chain.objs.size()=1 2024-04-03T05:14:07.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Oc8FmZIkK8WwXYM4oqGQYfZeWLOoXSC_0 2024-04-03T05:14:07.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17792867262326576052', time=2024-04-03T06:34:32.989257+0000, chain.objs.size()=1 2024-04-03T05:14:07.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KVWHHp4CYaz1qXPQX4-Oq2zz6HiHreX_0 2024-04-03T05:14:07.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.881469375413714934', time=2024-04-03T06:34:33.272594+0000, chain.objs.size()=1 2024-04-03T05:14:07.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Y2H31oOMwdkwfI_onCVL2mz21Cpg-Np_0 2024-04-03T05:14:07.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4530920910110670187', time=2024-04-03T06:34:33.352734+0000, chain.objs.size()=1 2024-04-03T05:14:07.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cVUPpZfAzdmL4Cib6MrFWz_W6iIPiKJ_0 2024-04-03T05:14:07.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13580982429763850606', time=2024-04-03T06:34:34.752627+0000, chain.objs.size()=1 2024-04-03T05:14:07.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JNPFG1uN3aO0WwHx84BU7tJGGehvRc-_0 2024-04-03T05:14:07.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3736988762070190860', time=2024-04-03T06:34:36.728629+0000, chain.objs.size()=1 2024-04-03T05:14:07.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.sbfUiODCf1HRmstXgr4IwXWcCm3iTRA_0 2024-04-03T05:14:07.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15140199623855175117', time=2024-04-03T06:34:36.846238+0000, chain.objs.size()=1 2024-04-03T05:14:07.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yefj_vAph7M3aJKxwxjKcleT-OiNj-f_0 2024-04-03T05:14:07.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11027213631807992478', time=2024-04-03T06:34:37.087772+0000, chain.objs.size()=1 2024-04-03T05:14:07.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.UBCARP6RvKefiXziFTvb1WCpj_ON2pT_0 2024-04-03T05:14:07.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17243689267125241503', time=2024-04-03T06:34:37.519991+0000, chain.objs.size()=1 2024-04-03T05:14:07.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.EswBHdzOu1OR28QLzInYVMddZqdu0WL_0 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17867431246187391201', time=2024-04-03T06:34:38.272843+0000, chain.objs.size()=1 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.UTQT1R5QtAG9_njywhnwKDdK-OcfKyg_0 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16748802879424647542', time=2024-04-03T06:34:38.718920+0000, chain.objs.size()=1 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.FpPCxiFT-NI2wz66W4w_hNPIftIf5EN_0 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3665938561400801849', time=2024-04-03T06:34:41.939872+0000, chain.objs.size()=1 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.HWsIH2iFBzr3zYDO-ZHtGRi8UMt51O0_0 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7247298412312647932', time=2024-04-03T06:34:42.721508+0000, chain.objs.size()=1 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nq7GYd3o-EBkZ3WXHLmENM2Rq3jsb7t_0 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4424884806741618605', time=2024-04-03T06:34:46.059096+0000, chain.objs.size()=1 2024-04-03T05:14:07.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SborY49Burtx9GgTLBKW7fi-JChvwCr_0 2024-04-03T05:14:07.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14333020009379413144', time=2024-04-03T06:34:47.918987+0000, chain.objs.size()=1 2024-04-03T05:14:07.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.p202GPVEbYLq45kMiqb54tNoCA9dcTt_0 2024-04-03T05:14:07.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7862682710456299896', time=2024-04-03T06:34:48.980396+0000, chain.objs.size()=1 2024-04-03T05:14:07.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SbbgwOkCtSSnYfXroSKLA3AK-TBSJeA_0 2024-04-03T05:14:07.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2602075237941217123', time=2024-04-03T06:34:49.413545+0000, chain.objs.size()=1 2024-04-03T05:14:07.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BxmPcA1qmVcxR3qb2kkZsCGNt2CRSEn_0 2024-04-03T05:14:07.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5990555765832222445', time=2024-04-03T06:34:49.639613+0000, chain.objs.size()=1 2024-04-03T05:14:07.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dE8de5e8R5ay05LJ70ltk4ecRuPxQLW_0 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14108211922353976418', time=2024-04-03T06:34:50.120761+0000, chain.objs.size()=1 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dWBDvSZdgPE8kBj99Dspithvi8sJWU4_0 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12396963750100967266', time=2024-04-03T06:34:51.435031+0000, chain.objs.size()=1 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Uu6NntsSsvuiAQx5vJ78xZgQhPM75Id_0 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11655633161064640745', time=2024-04-03T06:34:51.529022+0000, chain.objs.size()=1 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xB6qY1qZ9j4zKRCr1pUElSXoPGXkVbx_0 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6904659760731962167', time=2024-04-03T06:34:52.100040+0000, chain.objs.size()=1 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5hhOQxxEmLWxLZQadg5_SXgH7ljvTEL_0 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15368324067912875526', time=2024-04-03T06:34:52.770896+0000, chain.objs.size()=1 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.iI5wUer97MUDzJvtpIqcoqrcCUp3CVF_0 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12043129315362938155', time=2024-04-03T06:34:53.112760+0000, chain.objs.size()=1 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vBuYBhOHscZ6JCaW3XASCkk5RebAUsi_0 2024-04-03T05:14:07.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1948087093691987785', time=2024-04-03T06:34:53.488029+0000, chain.objs.size()=1 2024-04-03T05:14:07.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fD-gah5OXItWtLxe36NfPXTv9VKMewk_0 2024-04-03T05:14:07.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17280093213766631229', time=2024-04-03T06:34:54.532068+0000, chain.objs.size()=1 2024-04-03T05:14:07.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._l8jjTuQtaUgR-iM9plgyRikrE5jOhO_0 2024-04-03T05:14:07.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1587491988222422950', time=2024-04-03T06:34:55.171143+0000, chain.objs.size()=1 2024-04-03T05:14:07.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.PQDQtM3IrpIibLIJ5bfGzbDAJzQpRos_0 2024-04-03T05:14:07.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13226395317591982301', time=2024-04-03T06:34:55.897941+0000, chain.objs.size()=1 2024-04-03T05:14:07.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.jrUqGXoJgaNcr7QnYr1wxNzzU8XJC0P_0 2024-04-03T05:14:07.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11136112376903582909', time=2024-04-03T06:37:02.615496+0000, chain.objs.size()=1 2024-04-03T05:14:07.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.359__shadow_.YD_f-xTVM7aknFoVfqECHMWtb2S3TjC_0 2024-04-03T05:14:07.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2037865995855706443', time=2024-04-03T06:38:18.248003+0000, chain.objs.size()=1 2024-04-03T05:14:07.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.398__shadow_.yU8INcHvgfuq3diSr531KaAqvax2e6R_0 2024-04-03T05:14:07.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14784836035649481084', time=2024-04-03T06:40:08.824822+0000, chain.objs.size()=1 2024-04-03T05:14:07.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.451__shadow_.jsvMPFAur857G-zU0uAqa3uggLVFdxA_0 2024-04-03T05:14:07.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3985986377952216181', time=2024-04-03T06:50:45.506650+0000, chain.objs.size()=1 2024-04-03T05:14:07.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.519__shadow_.iN00nh40_nkgMj6orVfBrG-FHJS_FtW_0 2024-04-03T05:14:07.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7859655587375064871', time=2024-04-03T06:51:10.013079+0000, chain.objs.size()=1 2024-04-03T05:14:07.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.522__shadow_.uYzvQcbqzhdEdBcTsYzf7GT4GwiOxrR_0 2024-04-03T05:14:07.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2814281783717674961', time=2024-04-03T06:52:16.675028+0000, chain.objs.size()=1 2024-04-03T05:14:07.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.531__shadow_.vZoJXZoHQb-HScuruNR7bxFbT38i5zJ_0 2024-04-03T05:14:07.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13972788512244065716', time=2024-04-03T06:52:28.726995+0000, chain.objs.size()=1 2024-04-03T05:14:07.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.533__shadow_.KmdxQ6uEyBUf3zMynZVgdFiztADgIq8_0 2024-04-03T05:14:07.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10125132622207655755', time=2024-04-03T06:52:30.566204+0000, chain.objs.size()=1 2024-04-03T05:14:07.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.534__shadow_.0BAX_BqLziufEZiQ0mbi6QXWbNUGpcx_0 2024-04-03T05:14:07.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/44870 2024-04-03T05:14:07.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T05:14:07.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4034598198944509941', time=2024-04-03T06:53:35.382331+0000, chain.objs.size()=1 2024-04-03T05:14:07.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:-8zOHZUqBmLeCcqD4n9K8T1GJYeBIPC_.1qnP1e0Ir33GVCfGeOi3bzo0yESbWD5_0 2024-04-03T05:14:07.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9265315379310132388', time=2024-04-03T06:53:47.553065+0000, chain.objs.size()=1 2024-04-03T05:14:07.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:-rgqB8elfH-YO0nFn6H0p916z3rLXBb_.DbcYJ_qPlKxMvSyb22cAN1No7vJbHVm_0 2024-04-03T05:14:07.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13283881716419359954', time=2024-04-03T06:55:23.917786+0000, chain.objs.size()=1 2024-04-03T05:14:07.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:.Vw9yxLU0J43ZP0PBlfsURIKaOxGefO_.nMCHnGpzJBuaXlXNVjrRx7gnTPv9V0I_0 2024-04-03T05:14:07.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.960799180327631958', time=2024-04-03T06:55:40.807565+0000, chain.objs.size()=1 2024-04-03T05:14:07.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.554__shadow:TqyycVOGK0AMINUjNOMxxhKz-OIZ-0H_.VveMEZufALUXe-5lB1Xafg584z01F98_0 2024-04-03T05:14:07.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4780204014702967747', time=2024-04-03T06:55:44.172551+0000, chain.objs.size()=1 2024-04-03T05:14:07.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.555__shadow:UyG1vvbJDgQMAVtUaq-7odQvuNoSz4H_.jVDmVbpI8TimgV418eUQ6ZOTa7c6aUD_0 2024-04-03T05:14:07.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17224869700591727714', time=2024-04-03T07:01:18.473407+0000, chain.objs.size()=1 2024-04-03T05:14:07.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.602__shadow_.ITUUAc-gJfU2m4XGZhW3xgIpY58HZxw_0 2024-04-03T05:14:07.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12710858672909102540', time=2024-04-03T07:02:32.881958+0000, chain.objs.size()=2 2024-04-03T05:14:07.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.620__shadow_.2kKsT58q6Fjf4YdqdqsrjN1ufyutePv_0 2024-04-03T05:14:07.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.620__shadow_.2kKsT58q6Fjf4YdqdqsrjN1ufyutePv_1 2024-04-03T05:14:07.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:07.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.821+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-03T05:14:07.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:07.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:07.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46304' 2024-04-03T05:14:07.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1445041565784793652', time=2024-04-03T06:23:02.213279+0000, chain.objs.size()=2 2024-04-03T05:14:07.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.153__multipart_foo.2~4nFkuOPPQXDBMELPh2SvNZ2Yx2tULOO.1 2024-04-03T05:14:07.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.153__multipart_foo.2~4nFkuOPPQXDBMELPh2SvNZ2Yx2tULOO.2 2024-04-03T05:14:07.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17225263577944846962', time=2024-04-03T06:25:01.360490+0000, chain.objs.size()=1 2024-04-03T05:14:07.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.197__shadow_.6caiR-SNzgf06aBkG_0UKLFx-smswme_0 2024-04-03T05:14:07.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15744829177452034510', time=2024-04-03T06:25:06.116409+0000, chain.objs.size()=1 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.200__shadow_.PFUEj1lFg5EoFCrgX91p6qlptN7exIS_0 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5552299038095732728', time=2024-04-03T06:25:16.926385+0000, chain.objs.size()=1 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.205__shadow_.m73f37m34E7_iZWAFDjsa2aMmPI5ZDZ_0 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4599280032864727325', time=2024-04-03T06:25:26.210730+0000, chain.objs.size()=1 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.208__shadow_.hHAjb2oZ5SlbqmRKAQ-gRIEXmSrpqMp_0 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17648591885413884706', time=2024-04-03T06:25:28.091856+0000, chain.objs.size()=1 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.209__shadow_.thPLawurv5Cxe_M_3IFomxhG7872LW9_0 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5898631259458269338', time=2024-04-03T06:25:36.153270+0000, chain.objs.size()=1 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.212__shadow_.y8UILQrHz3vDYcpUzclenGPl3QT8bTi_0 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.633916243498977298', time=2024-04-03T06:25:53.115217+0000, chain.objs.size()=1 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.219__shadow_.8wnZziIBUMB92p-Z-XqHRs9om2imCeZ_0 2024-04-03T05:14:07.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16360064503489245058', time=2024-04-03T06:25:59.693674+0000, chain.objs.size()=1 2024-04-03T05:14:07.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.222__shadow_.06hz9LeMaotdJ2YJmA5PLSVNSMhUg9l_0 2024-04-03T05:14:07.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7789626001328517699', time=2024-04-03T06:27:52.187625+0000, chain.objs.size()=1 2024-04-03T05:14:07.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0TDp8uIgkQ2TIpatvQvM_E9MtmSjUnG_0 2024-04-03T05:14:07.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12043539339771946704', time=2024-04-03T06:27:53.853625+0000, chain.objs.size()=1 2024-04-03T05:14:07.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_._zcYPsy4LFMRrg9GIMgC-WcfKwnve39_0 2024-04-03T05:14:07.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12286704282145774768', time=2024-04-03T06:27:54.306858+0000, chain.objs.size()=1 2024-04-03T05:14:07.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0rCtj17xd8UI66rA8Ax1nyZRfCqM2rZ_0 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17018265504604881977', time=2024-04-03T06:27:54.453768+0000, chain.objs.size()=1 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eXmA5aWEQo0V2a4caLOk0OCJVjyMDJd_0 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7529830813298148822', time=2024-04-03T06:27:54.939957+0000, chain.objs.size()=1 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9NAzuL6H2TH9vU9JC3TlxJo1poLQhUW_0 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8888326017008790103', time=2024-04-03T06:27:56.653118+0000, chain.objs.size()=1 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Jn2BNIBV5-7uj8WQhGZ5YczD8_oy5az_0 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12170044468265054510', time=2024-04-03T06:27:56.741090+0000, chain.objs.size()=1 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mqpA_Qf8lREXLUPRl-3f2_nVlHarzHA_0 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11303902699093047419', time=2024-04-03T06:27:57.050191+0000, chain.objs.size()=1 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wFWSgVVBSe1mzSD3CCiPUTwwoKbGMp7_0 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5162850318402921039', time=2024-04-03T06:27:58.326941+0000, chain.objs.size()=1 2024-04-03T05:14:07.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oO9co2WmT8LB_ueTwY0xGqBfrzpqCdf_0 2024-04-03T05:14:07.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16604344651438368252', time=2024-04-03T06:27:58.806839+0000, chain.objs.size()=1 2024-04-03T05:14:07.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.AOrLGAGjFaFpjjGQo3wtXJp0AkO0czL_0 2024-04-03T05:14:07.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.922944728127684335', time=2024-04-03T06:27:59.035285+0000, chain.objs.size()=1 2024-04-03T05:14:07.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eyS6Ae8YYbrLzTG7Zf1nDQbbuiOXn-P_0 2024-04-03T05:14:07.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5460484911097563368', time=2024-04-03T06:28:00.100870+0000, chain.objs.size()=1 2024-04-03T05:14:07.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qyk6FxE5qyQEfHF93ibqYRtfkyrt1Z9_0 2024-04-03T05:14:07.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4656976787951511753', time=2024-04-03T06:28:00.102503+0000, chain.objs.size()=1 2024-04-03T05:14:07.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.KRR9xtCVXit40r9KahPrFmqKMNAfRaN_0 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12339788444631746164', time=2024-04-03T06:28:00.104035+0000, chain.objs.size()=1 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eAi0ygVgGWDZw_1lNxEeW5WC-HMv0xN_0 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5936070732965646535', time=2024-04-03T06:28:00.539232+0000, chain.objs.size()=1 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.D1XNPlwIYLCdjw0koe6oB27DUagRYq-_0 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13636805147105168799', time=2024-04-03T06:28:01.142999+0000, chain.objs.size()=1 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0VIOUUDPe7ynyL6y0s5warHEu2Lhc63_0 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16530121211756905290', time=2024-04-03T06:28:02.337011+0000, chain.objs.size()=1 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LX25ob61uSqRilWKh9sTyBGpMSHdMQL_0 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8889562053844607343', time=2024-04-03T06:28:04.320234+0000, chain.objs.size()=1 2024-04-03T05:14:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.soVuMCgSWJIZ4UCf6TOAeQD0MDUUFYm_0 2024-04-03T05:14:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3985561516462577855', time=2024-04-03T06:28:04.676951+0000, chain.objs.size()=1 2024-04-03T05:14:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.PHTe5Qx1MYf071cyzy4t7icqlpbUzG1_0 2024-04-03T05:14:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11268114088641492113', time=2024-04-03T06:28:06.256751+0000, chain.objs.size()=1 2024-04-03T05:14:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.YqPP7rwTH3hHKdGsj1w6w7JE9-ELzj2_0 2024-04-03T05:14:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1484689086373077179', time=2024-04-03T06:28:06.605183+0000, chain.objs.size()=1 2024-04-03T05:14:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JJ1MKFiqVg2grJIb12QbJHHjxNKMUHO_0 2024-04-03T05:14:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1729884194070271871', time=2024-04-03T06:28:07.863344+0000, chain.objs.size()=1 2024-04-03T05:14:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.d0MVTlU_Inoqo-oL3-KmGEw9TIN2R9v_0 2024-04-03T05:14:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16462682977999670383', time=2024-04-03T06:28:09.037452+0000, chain.objs.size()=1 2024-04-03T05:14:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8yz3WiPqW25eQiDgPElWV-Odr61Oy6z_0 2024-04-03T05:14:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2194706698569754091', time=2024-04-03T06:28:09.186239+0000, chain.objs.size()=1 2024-04-03T05:14:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.VWoIBp7vWwByVAdH86ocIOgwSpVh-Sx_0 2024-04-03T05:14:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9714453305010105934', time=2024-04-03T06:28:09.299076+0000, chain.objs.size()=1 2024-04-03T05:14:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rhAxUn2_ngje6Z_eUm01vvGu8fbqtPx_0 2024-04-03T05:14:07.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1864590169376294368', time=2024-04-03T06:28:09.412721+0000, chain.objs.size()=1 2024-04-03T05:14:07.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.RYp7zn0oUrmMTRM1BpxEucyJmI0x7uC_0 2024-04-03T05:14:07.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15209241497133304057', time=2024-04-03T06:28:11.812482+0000, chain.objs.size()=1 2024-04-03T05:14:07.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ZUbymlAaLXz-dChMDBbKiAnjZlmG8YT_0 2024-04-03T05:14:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5004903796838058324', time=2024-04-03T06:28:12.363746+0000, chain.objs.size()=1 2024-04-03T05:14:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.W_bK-myb7YMF_A_HoByJs4f-i7bXJpC_0 2024-04-03T05:14:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16037351035427862373', time=2024-04-03T06:28:15.124350+0000, chain.objs.size()=1 2024-04-03T05:14:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1g9C1GeLmhhkJkdXFRagxaR0-Wyg11q_0 2024-04-03T05:14:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.979240535523831134', time=2024-04-03T06:28:15.273058+0000, chain.objs.size()=1 2024-04-03T05:14:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BZiXF4dd8SiTF7tNwU0vYDSK98Uk3zF_0 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12370035080121408205', time=2024-04-03T06:28:19.108266+0000, chain.objs.size()=1 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LeIjU04RfFT9W-NpdIxGH0I_BUSp23v_0 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17338643228765921593', time=2024-04-03T06:28:19.540558+0000, chain.objs.size()=1 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.YZBk1M1VOBNKxxScQ3bK7jVxKPJfNDb_0 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10610432479837950933', time=2024-04-03T06:28:20.461931+0000, chain.objs.size()=1 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Vp6YPNr0zOsN4IoFTF_yFZ3mKnqAIeC_0 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5214275302711316528', time=2024-04-03T06:28:59.485837+0000, chain.objs.size()=1 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.249__shadow_.Iv5F_sPaCFpmZJKZwDILg-CVSkhNfMH_0 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13550532516176291685', time=2024-04-03T06:29:13.843067+0000, chain.objs.size()=1 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.255__shadow_.qVgmgSRu992VZh7lUOhVyfph2HsAOav_0 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18154172670751024679', time=2024-04-03T06:29:16.077977+0000, chain.objs.size()=1 2024-04-03T05:14:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.256__shadow_.OlFyFG-Kk9lTq2HTKRWhUNvdm2GXkTU_0 2024-04-03T05:14:07.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2446877154028769105', time=2024-04-03T06:29:30.685042+0000, chain.objs.size()=1 2024-04-03T05:14:07.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.0UPz5CuDVTLBKvuzzEIX7JZCwnH92zA_0 2024-04-03T05:14:07.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17538145834029300144', time=2024-04-03T06:29:38.383442+0000, chain.objs.size()=1 2024-04-03T05:14:07.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.263__shadow_.87r4tvxpO5goc2g_-LBzVbjFDNSbxxL_0 2024-04-03T05:14:07.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16905601555554829980', time=2024-04-03T06:29:47.464854+0000, chain.objs.size()=1 2024-04-03T05:14:07.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.267__shadow_.7Hl-rtnIp9uZ4fGFiArhskoZHBInxAu_0 2024-04-03T05:14:07.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9934585815393977204', time=2024-04-03T06:29:56.323775+0000, chain.objs.size()=1 2024-04-03T05:14:07.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.271__shadow_.6hWtiPu1OMepzWQCOD7UBGWlb2ESkPt_0 2024-04-03T05:14:07.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4920506019704769166', time=2024-04-03T06:32:24.315885+0000, chain.objs.size()=1 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.i6wIHsuJ1qt9TJjtqknpkDsf89fHAwY_0 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.801097953322508925', time=2024-04-03T06:32:25.130849+0000, chain.objs.size()=1 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gi_hM6742KQhbqPYxZZdlpwNbCPHPxO_0 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1156915774381553771', time=2024-04-03T06:32:25.749717+0000, chain.objs.size()=1 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xg1bupi1QMyMetEnZW3jowh9Pv2JcBl_0 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.599615058433784671', time=2024-04-03T06:32:25.895995+0000, chain.objs.size()=1 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Sa0OO14FHcBjMr1dUEwGCXRkI_LN_jl_0 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10684423351662821742', time=2024-04-03T06:32:26.974030+0000, chain.objs.size()=1 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Cq2cb4kDhnMpcw4qg0_TDC-UNZTwVGQ_0 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15370948092274062927', time=2024-04-03T06:32:28.092503+0000, chain.objs.size()=1 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UIFIdEi8gQnGT8NiL_zDCUMg_-X0lmn_0 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12736930784415426244', time=2024-04-03T06:32:31.710269+0000, chain.objs.size()=1 2024-04-03T05:14:07.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0ASfa2lliOpuNJOXzUO3A1f_ZTuRRHX_0 2024-04-03T05:14:07.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7547631723729217102', time=2024-04-03T06:32:32.018930+0000, chain.objs.size()=1 2024-04-03T05:14:07.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MnRSU9iZKOkVZIZfVrt_GlkeWN_8j27_0 2024-04-03T05:14:07.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.475025277004823395', time=2024-04-03T06:32:32.020618+0000, chain.objs.size()=1 2024-04-03T05:14:07.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CW2U0du0uUg14qFmP79eY264ZfcfUAH_0 2024-04-03T05:14:07.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6141665142026917653', time=2024-04-03T06:32:32.513042+0000, chain.objs.size()=1 2024-04-03T05:14:07.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cQYn3MWPdkCJIL4ghtfRa3ErMhFW0Gk_0 2024-04-03T05:14:07.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7703959193162468215', time=2024-04-03T06:32:32.620078+0000, chain.objs.size()=1 2024-04-03T05:14:07.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.oLrn-c3mu5vu1C1TSDi9pUo4ITN95Uo_0 2024-04-03T05:14:07.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18283049996964682035', time=2024-04-03T06:32:33.072313+0000, chain.objs.size()=1 2024-04-03T05:14:07.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.X-iTer6i0jvBkczxuu9XWGsbSYNRvxN_0 2024-04-03T05:14:07.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4083382210818142953', time=2024-04-03T06:32:33.617509+0000, chain.objs.size()=1 2024-04-03T05:14:07.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._dGzDlkKaGCj_1V-Ab5ixRVe09lRcz0_0 2024-04-03T05:14:07.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11528705380859843944', time=2024-04-03T06:32:35.699194+0000, chain.objs.size()=1 2024-04-03T05:14:07.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.jWIqTMzdiouuWfwdOhaI7Z2m93yxCCh_0 2024-04-03T05:14:07.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15239177404339903363', time=2024-04-03T06:32:35.701299+0000, chain.objs.size()=1 2024-04-03T05:14:07.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qG9AhLprNFKCT57MFhWC3E5pJhJN_0J_0 2024-04-03T05:14:07.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14437475902457546535', time=2024-04-03T06:32:36.266336+0000, chain.objs.size()=1 2024-04-03T05:14:07.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.P09S1MJbHZMQPPDH6t74DkfXH61hSWA_0 2024-04-03T05:14:07.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7047082342973718773', time=2024-04-03T06:32:36.759772+0000, chain.objs.size()=1 2024-04-03T05:14:07.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OpVdxg-He2lJs2sMg7wBzsW2eBx6aMF_0 2024-04-03T05:14:07.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.684874150753795775', time=2024-04-03T06:32:36.863535+0000, chain.objs.size()=1 2024-04-03T05:14:07.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uaRde6iIrvm4gBLWjLs5gD7FB4SkgtN_0 2024-04-03T05:14:07.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10312341399414482141', time=2024-04-03T06:32:37.288248+0000, chain.objs.size()=1 2024-04-03T05:14:07.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.IJrnX6--Fy5uugGBuSsC2oDW9L5p4k6_0 2024-04-03T05:14:07.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16891832373211978255', time=2024-04-03T06:32:37.290474+0000, chain.objs.size()=1 2024-04-03T05:14:07.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7dlx0-jmcwIV2d8YFKapAlMnlHZFNTr_0 2024-04-03T05:14:07.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13341246068500975905', time=2024-04-03T06:32:38.072219+0000, chain.objs.size()=1 2024-04-03T05:14:07.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8DiqT3tW1zyhmauN21qN7Xj0sL_UyB-_0 2024-04-03T05:14:07.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10126184298277066592', time=2024-04-03T06:32:38.443040+0000, chain.objs.size()=1 2024-04-03T05:14:07.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Dyz3HeR7avPlB_-fsXuU43msw7F25kq_0 2024-04-03T05:14:07.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.434865596885953027', time=2024-04-03T06:32:42.975835+0000, chain.objs.size()=1 2024-04-03T05:14:07.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vWGmE1rjW3e25fL4YoyXsRLO4nOhI8C_0 2024-04-03T05:14:07.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15801432240623011543', time=2024-04-03T06:32:43.039600+0000, chain.objs.size()=1 2024-04-03T05:14:07.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dmY7HprkS98CjJNwRL-MR-_PRmN8B1M_0 2024-04-03T05:14:07.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14393350536331907527', time=2024-04-03T06:32:45.495510+0000, chain.objs.size()=1 2024-04-03T05:14:07.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.QHsBAue-LLRW4Hq4AX32oQX19RMJnPY_0 2024-04-03T05:14:07.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14471085167171733050', time=2024-04-03T06:32:45.724014+0000, chain.objs.size()=1 2024-04-03T05:14:07.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.PUEeaQCZL86q0RMB2QQCKa83kBDky1n_0 2024-04-03T05:14:07.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15826295388831728978', time=2024-04-03T06:32:47.245099+0000, chain.objs.size()=1 2024-04-03T05:14:07.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.e3Y0x33lsU3Jn8Qh82m67KJem-Jyekb_0 2024-04-03T05:14:07.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13993312829062285331', time=2024-04-03T06:32:48.672397+0000, chain.objs.size()=1 2024-04-03T05:14:07.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.a9wREvEQwnG2DbYEp_QNW-iAFomVA8M_0 2024-04-03T05:14:07.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16879104541756342537', time=2024-04-03T06:32:49.223516+0000, chain.objs.size()=1 2024-04-03T05:14:07.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.US9IRDZxBRq2ESeTmAw9dynmyQhgnMg_0 2024-04-03T05:14:07.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9804975798533230337', time=2024-04-03T06:32:49.960267+0000, chain.objs.size()=1 2024-04-03T05:14:07.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4lNnIFz02SwQy2J3CbUM76pWNLPkWjp_0 2024-04-03T05:14:07.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9598872002364474007', time=2024-04-03T06:32:50.869512+0000, chain.objs.size()=1 2024-04-03T05:14:07.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VWsVVBtujUpLkthIjCG2RaO6hKT198K_0 2024-04-03T05:14:07.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8495628187112916779', time=2024-04-03T06:32:50.871365+0000, chain.objs.size()=1 2024-04-03T05:14:07.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CUo1i6m3q5y7sFQanQJelduOC-ZZ6Zf_0 2024-04-03T05:14:07.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1913385520052319220', time=2024-04-03T06:32:51.082493+0000, chain.objs.size()=1 2024-04-03T05:14:07.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hhjTmtkxv3KlgLeNip3ycpD27mf6Ayw_0 2024-04-03T05:14:07.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5216488443663297374', time=2024-04-03T06:34:29.465278+0000, chain.objs.size()=1 2024-04-03T05:14:07.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.FH9W-WAdRWzoDhuLT93UnhdK4RdDgjf_0 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15784830077829877805', time=2024-04-03T06:34:29.737695+0000, chain.objs.size()=1 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YrYfbDhaLCGpbu2_Mqv1jj7XNxP2Rre_0 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11542276518563419556', time=2024-04-03T06:34:29.970682+0000, chain.objs.size()=1 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.EAZrk55xedAD6W4bms4gzDeWC3Fwt6E_0 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3397233091192834307', time=2024-04-03T06:34:30.251416+0000, chain.objs.size()=1 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.sgLljy_80XiOFDYn54J6Xl5cWsPgoxQ_0 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4458518327473421755', time=2024-04-03T06:34:30.695322+0000, chain.objs.size()=1 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lh-IjIA17zjGQZ_sa4AJ7PVmFCvFkXk_0 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17061375154556212439', time=2024-04-03T06:34:30.767307+0000, chain.objs.size()=1 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JjvsSwOChUZtSgxDNQaKAuwcTrYDIz0_0 2024-04-03T05:14:07.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8942428554274664471', time=2024-04-03T06:34:31.400188+0000, chain.objs.size()=1 2024-04-03T05:14:07.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JcIsTWbDzC_XPwui3QJJ1ZIPWdIQ51H_0 2024-04-03T05:14:07.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5539027551867883277', time=2024-04-03T06:34:32.615525+0000, chain.objs.size()=1 2024-04-03T05:14:07.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3PIft-wRQOfJeIq6shpk3L3L7ejPGLy_0 2024-04-03T05:14:07.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7037730858975518099', time=2024-04-03T06:34:32.901438+0000, chain.objs.size()=1 2024-04-03T05:14:07.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.HQa8vRFQXHfNbGLkHkwc8jxvG3TO2Qh_0 2024-04-03T05:14:07.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10083626510844698035', time=2024-04-03T06:34:32.999196+0000, chain.objs.size()=1 2024-04-03T05:14:07.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-PO3GTXW9OUi_WvXyN9z5LZ3srA7j2r_0 2024-04-03T05:14:07.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8510454798678892928', time=2024-04-03T06:34:33.316833+0000, chain.objs.size()=1 2024-04-03T05:14:07.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Oa8_vt2kp38m45Xudzb-_tlZeHWDOyB_0 2024-04-03T05:14:07.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12105570160945706938', time=2024-04-03T06:34:33.777772+0000, chain.objs.size()=1 2024-04-03T05:14:07.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2IL44D91_N_zpT2U22OZ6nDldiACjpA_0 2024-04-03T05:14:07.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9038777779172249486', time=2024-04-03T06:34:34.374183+0000, chain.objs.size()=1 2024-04-03T05:14:07.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.__H12GhSASUSH7_GKoqic0pP1qXnz97_0 2024-04-03T05:14:07.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.614004593527529024', time=2024-04-03T06:34:37.193683+0000, chain.objs.size()=1 2024-04-03T05:14:07.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cEfTIDRWqji2HT3RFMkxPeVyUc0p8hF_0 2024-04-03T05:14:07.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4578119003637164128', time=2024-04-03T06:34:37.980528+0000, chain.objs.size()=1 2024-04-03T05:14:07.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.sFV0MniYdL0GQ5ugg_t-lVoo8C5emZ9_0 2024-04-03T05:14:07.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9855637157450494044', time=2024-04-03T06:34:38.357016+0000, chain.objs.size()=1 2024-04-03T05:14:07.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Rum-s_42Bpp_o3lfdegVkjUDKOjyWB8_0 2024-04-03T05:14:07.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16835235346664757799', time=2024-04-03T06:34:38.652446+0000, chain.objs.size()=1 2024-04-03T05:14:07.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JLsZYot5k72GxpetRnPrRlPLSnxcwdv_0 2024-04-03T05:14:07.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.29018894448111546', time=2024-04-03T06:34:39.091141+0000, chain.objs.size()=1 2024-04-03T05:14:07.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vyCjpyYFfSR_5pSmFgFw1onOgspPMUS_0 2024-04-03T05:14:07.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/46304 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10639055802555085814', time=2024-04-03T06:34:40.168562+0000, chain.objs.size()=1 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nmh6Ok8rf_P3iZuUYn71yUNUn7g_DP8_0 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15085743474869708863', time=2024-04-03T06:34:40.840242+0000, chain.objs.size()=1 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Rmu5BKgpOJjgsMjskDOfiH70mBYnOHp_0 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16734665108694027903', time=2024-04-03T06:34:41.177073+0000, chain.objs.size()=1 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8i9SaGcOIaM2Zr6LR3Tqj22VCQZQsgU_0 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12683948535858452869', time=2024-04-03T06:34:41.221416+0000, chain.objs.size()=1 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fguHeAAEq8OfhY6IowD5Na1eOYFxKpF_0 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3977051966459527608', time=2024-04-03T06:34:41.490762+0000, chain.objs.size()=1 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.arZbjcxczCMFT8GJhv6tjraxfuqMa3Y_0 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8490580429315325540', time=2024-04-03T06:34:41.917402+0000, chain.objs.size()=1 2024-04-03T05:14:07.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.iKQH84PHCtfD9m_aMBh7k27aKNIMNMZ_0 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7830410374296696208', time=2024-04-03T06:34:42.402335+0000, chain.objs.size()=1 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GPgIuRAhmgqCdz6gT7NKdm1KtHHDqyU_0 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4158657914984124068', time=2024-04-03T06:34:44.754759+0000, chain.objs.size()=1 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.aWWg9Q1MwUxKGy8-zYziWeuxAEJ7CHd_0 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11260508077979104310', time=2024-04-03T06:34:45.390420+0000, chain.objs.size()=1 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ErjG2pnsYMnby18SPXrN6ZiWerS7RhQ_0 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16102681924842950285', time=2024-04-03T06:34:46.134392+0000, chain.objs.size()=1 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1pnlXHWmBzoqC6X8_Ao3diXeX8zR0Yz_0 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17282251997187145739', time=2024-04-03T06:34:47.290262+0000, chain.objs.size()=1 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vc5zF9FRyk-q9WutHlJtWoXZdumKRo8_0 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2949449746501184054', time=2024-04-03T06:34:49.449709+0000, chain.objs.size()=1 2024-04-03T05:14:07.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CPnivkXR4lSwi-4_4CQZpCtY3BCQ_yY_0 2024-04-03T05:14:07.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6612267955383567984', time=2024-04-03T06:34:50.980915+0000, chain.objs.size()=1 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kf5d2ETDo_5jPvBteyyR-8UggGRCPKn_0 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8972590269006413080', time=2024-04-03T06:34:51.649149+0000, chain.objs.size()=1 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.r3A_8yH7a_Ibkv1AMLabKizvG-d9VcF_0 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15760090138164650339', time=2024-04-03T06:34:52.880997+0000, chain.objs.size()=1 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dgblgU471WMbJ5JaDDMD-1BKX3wHsHV_0 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4140560286562965231', time=2024-04-03T06:34:53.186027+0000, chain.objs.size()=1 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wPreUv3svIBfNthgOoy5Usju_4PDLdQ_0 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18078516096642184943', time=2024-04-03T06:34:53.656019+0000, chain.objs.size()=1 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yXBhKN8eL0hB7L3KS-AYCxr6zVuwf5Y_0 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9484119136673645402', time=2024-04-03T06:34:54.961053+0000, chain.objs.size()=1 2024-04-03T05:14:07.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.t_3PEX4UtgTICeD0NUb6_HgpNl5zW-H_0 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3867934073237692627', time=2024-04-03T06:34:55.202021+0000, chain.objs.size()=1 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.WRtovX9EiuCJ290tza7D7Fls_JOZll-_0 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14705909136180570914', time=2024-04-03T06:34:55.596106+0000, chain.objs.size()=1 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zMxXPiCszCJW7NzvnkJ-GzzxdKS5_j8_0 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10888039154739102309', time=2024-04-03T06:34:55.699023+0000, chain.objs.size()=1 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Goxgv6pNMTX_6O0PuZzt1bPAg51vZIV_0 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12802902627553269219', time=2024-04-03T06:36:16.102762+0000, chain.objs.size()=1 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.336__shadow_.qTdOQa1OLTq5CDSgLvt3qTEA7Z8XSNt_0 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3993651513597092786', time=2024-04-03T06:38:22.080154+0000, chain.objs.size()=1 2024-04-03T05:14:07.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.400__shadow_.FccDP4IfhtEhobJSP_wfC5L1gyow-51_0 2024-04-03T05:14:07.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11923698111344961536', time=2024-04-03T06:39:40.619930+0000, chain.objs.size()=1 2024-04-03T05:14:07.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.433__shadow_.CMlwftLR6rGRkCUPeEaPhANr7VCYHQC_0 2024-04-03T05:14:07.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.466__shadow_.IA7DjHEEtP0qOt1ydtdbATHAq5WhFsY_1_b946d7a5f0b29ae1dc4d3e4987cdd503', time=2024-04-03T06:40:46.566650+0000, chain.objs.size()=1 2024-04-03T05:14:07.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.466__shadow_.IA7DjHEEtP0qOt1ydtdbATHAq5WhFsY_0 2024-04-03T05:14:07.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2_fd078219b623808381a499cc3d6f4649', time=2024-04-03T06:41:45.303125+0000, chain.objs.size()=6 2024-04-03T05:14:07.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.1 2024-04-03T05:14:07.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2 2024-04-03T05:14:07.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.3 2024-04-03T05:14:07.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.4 2024-04-03T05:14:07.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.5 2024-04-03T05:14:07.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.6 2024-04-03T05:14:07.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.913+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2888730315806619571', time=2024-04-03T06:47:55.452020+0000, chain.objs.size()=5 2024-04-03T05:14:07.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~tmCQ-K3MlTCJWGwSqs3LeNkoJYWvKm6.1 2024-04-03T05:14:07.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__shadow_mymultipart.2~tmCQ-K3MlTCJWGwSqs3LeNkoJYWvKm6.1_1 2024-04-03T05:14:07.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~tmCQ-K3MlTCJWGwSqs3LeNkoJYWvKm6.2 2024-04-03T05:14:07.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__shadow_mymultipart.2~tmCQ-K3MlTCJWGwSqs3LeNkoJYWvKm6.2_1 2024-04-03T05:14:07.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~tmCQ-K3MlTCJWGwSqs3LeNkoJYWvKm6.3 2024-04-03T05:14:07.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16183872364951972758', time=2024-04-03T06:51:19.272632+0000, chain.objs.size()=1 2024-04-03T05:14:07.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.523__shadow_.1lefC-3P39aZXDAALSlFekNHAgPs25b_0 2024-04-03T05:14:07.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1788476572810998566', time=2024-04-03T06:52:51.380171+0000, chain.objs.size()=1 2024-04-03T05:14:07.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:hguyIoE.zqL.5-ecd1lDRi9-APd5U7b_.0RMRf2UEhf5DbLViOciJpCwhSf_xFQ9_0 2024-04-03T05:14:07.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15959204524738620103', time=2024-04-03T06:53:02.644406+0000, chain.objs.size()=1 2024-04-03T05:14:07.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.539__shadow:XNwTVMnUsFvQKqF-a87r0zH.-VwULQ3_.CreQTBaOIs8tFXMiqoTFg4XJ5MvfDP-_0 2024-04-03T05:14:07.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12504039589436927811', time=2024-04-03T06:54:00.698067+0000, chain.objs.size()=1 2024-04-03T05:14:07.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:jXkHgoCxjXApiEVNRyJkMnFer0VnJok_.j2Ty21aib01TMG2QLvxP2frmDecfz46_0 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7016780576852427316', time=2024-04-03T06:58:54.497547+0000, chain.objs.size()=12 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__multipart_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.1 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__shadow_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.1_1 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__multipart_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.2 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__shadow_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.2_1 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__multipart_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.3 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__shadow_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.3_1 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__multipart_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.4 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__shadow_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.4_1 2024-04-03T05:14:07.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__multipart_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.5 2024-04-03T05:14:07.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__shadow_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.5_1 2024-04-03T05:14:07.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__multipart_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.6 2024-04-03T05:14:07.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583__shadow_multipart_enc.2~ea6mUEnnDpBcJlIv1E8vBg-elUeYZ2M.6_1 2024-04-03T05:14:07.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4406708614163853604', time=2024-04-03T07:01:25.174144+0000, chain.objs.size()=1 2024-04-03T05:14:07.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.606__shadow_.335J0q6PV08JDk2yTzAsiqJwP8_beYG_0 2024-04-03T05:14:07.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8464997277892178112', time=2024-04-03T07:04:08.685173+0000, chain.objs.size()=1 2024-04-03T05:14:07.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.644__shadow_.dZV3tnbg663SOjbdbmqx4R_9caZetAa_0 2024-04-03T05:14:07.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9012037011187327019', time=2024-04-03T07:04:58.806747+0000, chain.objs.size()=1 2024-04-03T05:14:07.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.671__shadow_.DJGptWLvwYNzRXjyOI-18YRxd7UL94m_0 2024-04-03T05:14:07.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:07.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-03T05:14:07.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:07.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:07.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45435' 2024-04-03T05:14:07.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_EnWxbhIZGUssVlrrbXbupkVYMaOhbpN', time=2024-04-03T06:23:02.804722+0000, chain.objs.size()=1 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.154__shadow_.786qGTVvL_hC95AezdHW7tvQW92-mHD_0 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14584734264874679203', time=2024-04-03T06:25:10.445037+0000, chain.objs.size()=1 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.202__shadow_.BUBV3YuJ25ehWj25CPHnNAbZbNiK_qQ_0 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11400362041371360915', time=2024-04-03T06:25:30.214190+0000, chain.objs.size()=1 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.210__shadow_.TitzYbP-cymu3cZDD2Emd2FQQJntRmY_0 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1701038705988755975', time=2024-04-03T06:25:39.935249+0000, chain.objs.size()=1 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.213__shadow_.pzQo2ie5doG-_C_efnkfXEzWF1Ro83o_0 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5728949107482119101', time=2024-04-03T06:25:57.445841+0000, chain.objs.size()=1 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.221__shadow_.dPLST-NPe9XMWtrYW-oT5RU_z_Smpvo_0 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10217981709131692994', time=2024-04-03T06:26:01.861371+0000, chain.objs.size()=1 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.223__shadow_.Yu6Nt0wVZXP2YMB8N_lOsQ5BMuQhIqF_0 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3687088281890979548', time=2024-04-03T06:26:06.270101+0000, chain.objs.size()=1 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.225__shadow_.9manU1rzVJHcrlFkjnWvnfVwM1Twk86_0 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1410906781939702183', time=2024-04-03T06:27:52.658613+0000, chain.objs.size()=1 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Z-5o7GLOaEJOYjWsmsJWCaqQnXJKpc2_0 2024-04-03T05:14:07.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10170281433361733656', time=2024-04-03T06:27:52.830145+0000, chain.objs.size()=1 2024-04-03T05:14:07.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ica7YieUksC5sTPP2L5VefEJzqHqfan_0 2024-04-03T05:14:07.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8177698851841015506', time=2024-04-03T06:27:54.102987+0000, chain.objs.size()=1 2024-04-03T05:14:07.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ZuK3_iIWxvh7Jr2Y0iM5GSY62pdteE-_0 2024-04-03T05:14:07.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15961764772631337504', time=2024-04-03T06:27:55.076190+0000, chain.objs.size()=1 2024-04-03T05:14:07.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.KYraFWoMT5QNOAqhaMqp1wb-dWJ61g0_0 2024-04-03T05:14:07.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8535240316893751672', time=2024-04-03T06:28:00.786940+0000, chain.objs.size()=1 2024-04-03T05:14:07.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.C2OuhWFydC-nyLyw9GaAjg8SJD0waeu_0 2024-04-03T05:14:07.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4798300524276407377', time=2024-04-03T06:28:03.970585+0000, chain.objs.size()=1 2024-04-03T05:14:07.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tHKzJ_6XK6G5HDokTn5EXeK11hIdMmE_0 2024-04-03T05:14:07.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2319049085799012508', time=2024-04-03T06:28:05.369689+0000, chain.objs.size()=1 2024-04-03T05:14:07.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.CV2XeifLvnl03mohMmRty3p3HvsKRu6_0 2024-04-03T05:14:07.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5775684545658502369', time=2024-04-03T06:28:07.881341+0000, chain.objs.size()=1 2024-04-03T05:14:07.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.A8Jq859guDmss6YWSJWBZBsvnNTw_bH_0 2024-04-03T05:14:07.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6693892441841683070', time=2024-04-03T06:28:08.229560+0000, chain.objs.size()=1 2024-04-03T05:14:07.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.r-dNscHKq-VcQUCBJRYvx2DKKelUoav_0 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17608008670960655966', time=2024-04-03T06:28:08.232339+0000, chain.objs.size()=1 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qINiocz4Z9vzklBc46UF95f-3oGW1k__0 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16606640887772877480', time=2024-04-03T06:28:08.289439+0000, chain.objs.size()=1 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.muRyk52tHu22oifpo4s_zUXPLi26l-Q_0 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17542574478183760136', time=2024-04-03T06:28:08.666757+0000, chain.objs.size()=1 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.u74wfQFd4Xe-qI1ycsk5fsg6oVcP2dW_0 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10411609436060454673', time=2024-04-03T06:28:08.896886+0000, chain.objs.size()=1 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.pVp7b2UIr6MSNJZgxSp-p4br0EYMgw__0 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16624387814337558246', time=2024-04-03T06:28:09.024885+0000, chain.objs.size()=1 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cyDTH4uZOMZicZTlIthIpIm_iEHayLK_0 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11201707958634522595', time=2024-04-03T06:28:10.140285+0000, chain.objs.size()=1 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wev-lUANYahyVfb6W1xZjrHuntHJRmr_0 2024-04-03T05:14:07.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17968163820159881532', time=2024-04-03T06:28:10.385647+0000, chain.objs.size()=1 2024-04-03T05:14:07.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WCo4rci9bjpV_aZ-vXHGmloCqswx71y_0 2024-04-03T05:14:07.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18236807968492413659', time=2024-04-03T06:28:13.957786+0000, chain.objs.size()=1 2024-04-03T05:14:07.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.EQTdtoYLxHeiGCaGzP1jnEwgkzsSAMO_0 2024-04-03T05:14:07.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5807811850374995896', time=2024-04-03T06:28:16.796114+0000, chain.objs.size()=1 2024-04-03T05:14:07.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XuvkV0o-ClfcOhCQ4oRXF2fqi3Ow-qZ_0 2024-04-03T05:14:07.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15534204772569402110', time=2024-04-03T06:28:17.324385+0000, chain.objs.size()=1 2024-04-03T05:14:07.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6j4jYcpACnIzyYLVV1wPjsFw95tilVw_0 2024-04-03T05:14:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16214098691529850778', time=2024-04-03T06:28:17.451664+0000, chain.objs.size()=1 2024-04-03T05:14:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.FOMvcD1VwMpFqbZUhDla-1DwB-sX5fx_0 2024-04-03T05:14:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3011211043483073264', time=2024-04-03T06:28:17.901210+0000, chain.objs.size()=1 2024-04-03T05:14:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.aUyZjhwsx1qya98uMgQSKyA2jOE4fFa_0 2024-04-03T05:14:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10048954849738822501', time=2024-04-03T06:28:17.938054+0000, chain.objs.size()=1 2024-04-03T05:14:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BsBjV0ki-EJ-D51l8XhVWWTtv1jjgeA_0 2024-04-03T05:14:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18320843320564235013', time=2024-04-03T06:28:17.987980+0000, chain.objs.size()=1 2024-04-03T05:14:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9aHLGOHczdgY03JVrDDGGjuVqVClsfL_0 2024-04-03T05:14:07.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5905822856220722660', time=2024-04-03T06:28:19.136085+0000, chain.objs.size()=1 2024-04-03T05:14:07.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.erkb3wfY1NfK8ivdnbd9otmsdvrVm4__0 2024-04-03T05:14:07.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5490196569864342249', time=2024-04-03T06:28:19.560050+0000, chain.objs.size()=1 2024-04-03T05:14:07.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BOSJoBDOpA4JywClmFi27FRLPfiGAPH_0 2024-04-03T05:14:07.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1036982731720184235', time=2024-04-03T06:28:20.244643+0000, chain.objs.size()=1 2024-04-03T05:14:07.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XSgYKUBGAUMez4NU6SsDvxKWkfbzAEg_0 2024-04-03T05:14:07.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10322889945262778558', time=2024-04-03T06:28:20.486672+0000, chain.objs.size()=1 2024-04-03T05:14:07.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.FGdpSYpoGMR1_NlLGsuEEfVUD2JZUzE_0 2024-04-03T05:14:07.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18006596061651743323', time=2024-04-03T06:28:20.753385+0000, chain.objs.size()=1 2024-04-03T05:14:07.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0I6QIHku1uGU9-Wc4Qkk02f1WIUBQfX_0 2024-04-03T05:14:07.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9589181969214841983', time=2024-04-03T06:28:20.895115+0000, chain.objs.size()=1 2024-04-03T05:14:07.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.961+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.AbFVQbvgeI1JbtTz0IR3dEqD54lAQxr_0 2024-04-03T05:14:07.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2409309685199375396', time=2024-04-03T06:28:21.159836+0000, chain.objs.size()=1 2024-04-03T05:14:07.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WrjM6bnIRGOMJQT_1uVGa8ONaIRqiD6_0 2024-04-03T05:14:07.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13209414971379056645', time=2024-04-03T06:28:31.769268+0000, chain.objs.size()=1 2024-04-03T05:14:07.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.236__shadow_.prVF-TBq9GqwZxEcHBEXnNN2EIhAkvb_0 2024-04-03T05:14:07.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4392729582371735625', time=2024-04-03T06:28:48.477873+0000, chain.objs.size()=1 2024-04-03T05:14:07.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.244__shadow_.lYebvnBa6SztGMZs5BCuvIUIj8Xls6M_0 2024-04-03T05:14:07.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10409643276988089710', time=2024-04-03T06:28:57.336741+0000, chain.objs.size()=1 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.248__shadow_.B3_N36xiE45KRP7sLdMWTQDdsZ0NqvU_0 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5653812284317933949', time=2024-04-03T06:29:01.711751+0000, chain.objs.size()=1 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.250__shadow_.rwRrpwydBS9eis8d9jrBCuKYE838qGB_0 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7542649930703040664', time=2024-04-03T06:29:13.839413+0000, chain.objs.size()=1 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.255__shadow_.VXc-kIOtWFI80iy5MW1HmLRRuRPU1qo_0 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.808002087821807314', time=2024-04-03T06:29:20.402293+0000, chain.objs.size()=1 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.258__shadow_.MlhRKWkKxtGPANwbZvLvMA_6gXQ2lhk_0 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10511242564963457635', time=2024-04-03T06:29:30.572150+0000, chain.objs.size()=1 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.RPpfmu-_JoeRDCbYh65YpRt1vm0v8n__0 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14316255944379627283', time=2024-04-03T06:29:35.922238+0000, chain.objs.size()=1 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.TC4YI2Q3LgeJwaqO0pFy02xUvJyTI8Z_0 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4212862939561617408', time=2024-04-03T06:29:36.211865+0000, chain.objs.size()=1 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.MEnPNiaat-ceW2ecOJ2IiLBPfrmpV0F_0 2024-04-03T05:14:07.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16954735517659799319', time=2024-04-03T06:30:41.668292+0000, chain.objs.size()=1 2024-04-03T05:14:07.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.288__shadow:zJoS475HDOUJIL3eiv9ANMUegrV3QmD_.itPSw--ppJtXHiAAOya9br4Z2N5QzpJ_0 2024-04-03T05:14:07.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3341757757819794300', time=2024-04-03T06:32:24.163528+0000, chain.objs.size()=1 2024-04-03T05:14:07.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.fMku9rKq_BuVGv7u89SajygxdVN04rg_0 2024-04-03T05:14:07.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14090106373951130111', time=2024-04-03T06:32:25.480859+0000, chain.objs.size()=1 2024-04-03T05:14:07.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ooGDe7XfW1hdDq5rPHXvyK-2ng40HNa_0 2024-04-03T05:14:07.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10510668789349890124', time=2024-04-03T06:32:25.755994+0000, chain.objs.size()=1 2024-04-03T05:14:07.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.l88Hc6_g2xBaDM_zWWQtniFq5_8KR8u_0 2024-04-03T05:14:07.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11271440498123393095', time=2024-04-03T06:32:26.530769+0000, chain.objs.size()=1 2024-04-03T05:14:07.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Wfm77DbyVLAehqWvEXNOzQhJZe2WiW-_0 2024-04-03T05:14:07.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7458883825795548703', time=2024-04-03T06:32:26.744993+0000, chain.objs.size()=1 2024-04-03T05:14:07.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Mg_kn2aq6kV0T4_0fOmNU1okwSWAGZE_0 2024-04-03T05:14:07.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2751017925766230328', time=2024-04-03T06:32:28.703390+0000, chain.objs.size()=1 2024-04-03T05:14:07.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Ndo0s24ioP19qzn-oB6lEmCg3YfkR2C_0 2024-04-03T05:14:07.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17731971957787429034', time=2024-04-03T06:32:28.869074+0000, chain.objs.size()=1 2024-04-03T05:14:07.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.oaxJdFa97wg2or6e5htP79EHyf61rwr_0 2024-04-03T05:14:07.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15129845448272896536', time=2024-04-03T06:32:30.351264+0000, chain.objs.size()=1 2024-04-03T05:14:07.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yq4SoLs1hhh-wow5sLXiEtw4r1imVDf_0 2024-04-03T05:14:07.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17176590542452140437', time=2024-04-03T06:32:32.029194+0000, chain.objs.size()=1 2024-04-03T05:14:07.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tizIbniumLz35WNzfEar2GdFS2H7eOs_0 2024-04-03T05:14:07.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14275465884830266036', time=2024-04-03T06:32:32.910729+0000, chain.objs.size()=1 2024-04-03T05:14:07.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MgesBvMvmUGd7SKZn4Pn-3I-2eWO1wp_0 2024-04-03T05:14:07.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6125197475039671658', time=2024-04-03T06:32:33.923389+0000, chain.objs.size()=1 2024-04-03T05:14:07.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DbhQs5-OaEqQLFez6jOuyXYwXuW5KXo_0 2024-04-03T05:14:07.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16069636245852664990', time=2024-04-03T06:32:38.106212+0000, chain.objs.size()=1 2024-04-03T05:14:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ZJSQn2DHjl7mcoazJilWugt_EUZ_FWO_0 2024-04-03T05:14:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12711830595106689863', time=2024-04-03T06:32:39.408551+0000, chain.objs.size()=1 2024-04-03T05:14:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9A9wjBO66CDXLMsdvFxop5kJJKW9TGo_0 2024-04-03T05:14:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9763496642595958673', time=2024-04-03T06:32:39.690414+0000, chain.objs.size()=1 2024-04-03T05:14:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lRmegrsRRpPnA6_Er7iJcF9YEFAK0BL_0 2024-04-03T05:14:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8119632563466280651', time=2024-04-03T06:32:39.797530+0000, chain.objs.size()=1 2024-04-03T05:14:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8xhpYwb7eJ99A9LEADbIajrltwtt30t_0 2024-04-03T05:14:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14696065294753477318', time=2024-04-03T06:32:40.095981+0000, chain.objs.size()=1 2024-04-03T05:14:07.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.kEfxNXLENaKRSLLqSS4aOkshZ7pTK0R_0 2024-04-03T05:14:07.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15006969936998149235', time=2024-04-03T06:32:40.500751+0000, chain.objs.size()=1 2024-04-03T05:14:07.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sEDzXtK-DCBs_ru0jJeXt3AjCP2tH_k_0 2024-04-03T05:14:07.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18339741681036869825', time=2024-04-03T06:32:40.599170+0000, chain.objs.size()=1 2024-04-03T05:14:07.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Jm7exvkUIaVXZ4s7QHWzGRrLdH_75_W_0 2024-04-03T05:14:07.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11220186246543529271', time=2024-04-03T06:32:41.774643+0000, chain.objs.size()=1 2024-04-03T05:14:07.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MhKe5iJVa88qdVJ5T8tLNF46vGrDJy7_0 2024-04-03T05:14:07.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11759019044861996038', time=2024-04-03T06:32:42.967401+0000, chain.objs.size()=1 2024-04-03T05:14:07.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.wo8bYgb4C18skqt7pq18ReZcWFdr-A-_0 2024-04-03T05:14:07.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9016348822727141999', time=2024-04-03T06:32:43.446312+0000, chain.objs.size()=1 2024-04-03T05:14:07.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.l67xXuWvIvCvZS4l0kKLGsewJLCEGrz_0 2024-04-03T05:14:07.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12728904471406845028', time=2024-04-03T06:32:43.616439+0000, chain.objs.size()=1 2024-04-03T05:14:07.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4BwHE2O6I9DluIblVPuP7kxiOUlyyLV_0 2024-04-03T05:14:07.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11534676905304864434', time=2024-04-03T06:32:43.618728+0000, chain.objs.size()=1 2024-04-03T05:14:07.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HWvFq1226pUS9hjQwo5eZAzj70n0Ysi_0 2024-04-03T05:14:07.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8418660486667420205', time=2024-04-03T06:32:44.513472+0000, chain.objs.size()=1 2024-04-03T05:14:07.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DCRf-bF8pWZWu2iE1sLgYDZlTPMhn_I_0 2024-04-03T05:14:07.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10219158550117523289', time=2024-04-03T06:32:45.164365+0000, chain.objs.size()=1 2024-04-03T05:14:07.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XIAfiyM8GdSAEqzoeXhgxl87fI9uG4y_0 2024-04-03T05:14:07.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5111946133019434810', time=2024-04-03T06:32:47.665922+0000, chain.objs.size()=1 2024-04-03T05:14:07.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Y0KSwCQlPt3SH80Smq_T1vrEck9UzKj_0 2024-04-03T05:14:07.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5975035576044890468', time=2024-04-03T06:32:47.948559+0000, chain.objs.size()=1 2024-04-03T05:14:07.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pPPHHoEuZgcMV8ySWYzVH0IiK-IjLe__0 2024-04-03T05:14:07.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17987966892508426126', time=2024-04-03T06:32:48.098657+0000, chain.objs.size()=1 2024-04-03T05:14:07.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7gI0EBI_L1qzWrz8d1FN7zE-SQk_Cwi_0 2024-04-03T05:14:07.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1533868652797683232', time=2024-04-03T06:32:49.994214+0000, chain.objs.size()=1 2024-04-03T05:14:07.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._W7m_WKLEvxZg_Bb9zIddV5kcOUe1PW_0 2024-04-03T05:14:07.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13073411257254218118', time=2024-04-03T06:32:49.996720+0000, chain.objs.size()=1 2024-04-03T05:14:07.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2MmACnTxTyMWIfIkKskJvEOiwtNC-At_0 2024-04-03T05:14:07.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4735846639070871172', time=2024-04-03T06:32:49.998822+0000, chain.objs.size()=1 2024-04-03T05:14:07.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0VPBRPFBwJj0E4s_kVp-r4AivxsvqZl_0 2024-04-03T05:14:07.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14102691774586704251', time=2024-04-03T06:32:50.492233+0000, chain.objs.size()=1 2024-04-03T05:14:07.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XDbyJsRbFjq8YNrwkbjl8tqJGcOaGL8_0 2024-04-03T05:14:07.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2132881749674437961', time=2024-04-03T06:32:51.729676+0000, chain.objs.size()=1 2024-04-03T05:14:07.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5YmVYO7SaUD3STC1cEbIDbCr2lyEfus_0 2024-04-03T05:14:07.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12865073208056510693', time=2024-04-03T06:32:52.052721+0000, chain.objs.size()=1 2024-04-03T05:14:07.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lm5tbqiCuNgPqrwsMZRIAL5_Bv_i4od_0 2024-04-03T05:14:07.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18009442594977384219', time=2024-04-03T06:32:52.125975+0000, chain.objs.size()=1 2024-04-03T05:14:07.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.J2pLmBDWn6PaFSUdac6mVjzJYCxCynz_0 2024-04-03T05:14:07.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10286093023218476650', time=2024-04-03T06:34:28.629591+0000, chain.objs.size()=1 2024-04-03T05:14:07.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CUPxxZljtB_iVoUXOL6cRMW3vzrZKLl_0 2024-04-03T05:14:07.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6746428401149481279', time=2024-04-03T06:34:29.795656+0000, chain.objs.size()=1 2024-04-03T05:14:07.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dy9u9Ok-ofDV5rxldPwIusMOt0c4h0g_0 2024-04-03T05:14:07.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18193683543737983363', time=2024-04-03T06:34:29.882847+0000, chain.objs.size()=1 2024-04-03T05:14:07.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lGUdvZ57plr8JGT_jMjFf6OiuF2bS8O_0 2024-04-03T05:14:07.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16969859611726044099', time=2024-04-03T06:34:29.984346+0000, chain.objs.size()=1 2024-04-03T05:14:07.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5oLpX6mCObDGm_9AAqLG1WOYlew7KZa_0 2024-04-03T05:14:08.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.562252370952604942', time=2024-04-03T06:34:31.072190+0000, chain.objs.size()=1 2024-04-03T05:14:08.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.50M-q7aOk_WkKUGDNPYK9JRKMEbqWt-_0 2024-04-03T05:14:08.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1710571419697702578', time=2024-04-03T06:34:31.218670+0000, chain.objs.size()=1 2024-04-03T05:14:08.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wq4huNwqkobbz_svrztAUETNFw68w8f_0 2024-04-03T05:14:08.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18149251888212717971', time=2024-04-03T06:34:31.297209+0000, chain.objs.size()=1 2024-04-03T05:14:08.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gXpv30s-PThUrlUNF9I0dhky737FMCT_0 2024-04-03T05:14:08.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2783645591645805108', time=2024-04-03T06:34:32.584519+0000, chain.objs.size()=1 2024-04-03T05:14:08.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QMBRRnMPJ2EHkH_QBere2fPcE6soDFN_0 2024-04-03T05:14:08.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5299669358992314129', time=2024-04-03T06:34:35.170671+0000, chain.objs.size()=1 2024-04-03T05:14:08.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GJpCoYtVM0WN82PkL3Deey80ZsK_i7V_0 2024-04-03T05:14:08.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13816283554045857799', time=2024-04-03T06:34:36.820870+0000, chain.objs.size()=1 2024-04-03T05:14:08.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VhMdHj2bjaQWbDBADcEe3YnTyKtZBot_0 2024-04-03T05:14:08.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9208144776866886549', time=2024-04-03T06:34:38.646654+0000, chain.objs.size()=1 2024-04-03T05:14:08.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9a6l8oJHoJvdX4pJl5ARLqOjq4iXrj8_0 2024-04-03T05:14:08.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18033772194551019739', time=2024-04-03T06:34:39.107535+0000, chain.objs.size()=1 2024-04-03T05:14:08.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.77-L_ePF8DTIr3BatkUpkCUltV7UoYr_0 2024-04-03T05:14:08.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4092674580571373896', time=2024-04-03T06:34:41.648799+0000, chain.objs.size()=1 2024-04-03T05:14:08.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hTVp4UrV9CUeYsGDjPUOTzCV49xhKMl_0 2024-04-03T05:14:08.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17037597769691579504', time=2024-04-03T06:34:42.203272+0000, chain.objs.size()=1 2024-04-03T05:14:08.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.bJnyN1OJqELOVkHNm3tv7x6M9Sl-k73_0 2024-04-03T05:14:08.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5687316360164948424', time=2024-04-03T06:34:42.272024+0000, chain.objs.size()=1 2024-04-03T05:14:08.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:07.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7AkauP1Q2FyWxA8JYXPokr1QSTCViB1_0 2024-04-03T05:14:08.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.001+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5419513035569832523', time=2024-04-03T06:34:44.262643+0000, chain.objs.size()=1 2024-04-03T05:14:08.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.001+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9Of7QChIMKgRz2qkg4wYPYlxPScvUxx_0 2024-04-03T05:14:08.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11669232652216680510', time=2024-04-03T06:34:44.466569+0000, chain.objs.size()=1 2024-04-03T05:14:08.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hpNvpFAcBc26HlNLvU69NQooqQWfKUL_0 2024-04-03T05:14:08.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11986072637818740773', time=2024-04-03T06:34:46.544651+0000, chain.objs.size()=1 2024-04-03T05:14:08.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.RR14dB-_Wjcg2rYxqGhQtrqJrtrvDQS_0 2024-04-03T05:14:08.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/45435 2024-04-03T05:14:08.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11390967875801656866', time=2024-04-03T06:34:48.680513+0000, chain.objs.size()=1 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.qQ6p1RFHDZkFsDfytHxHUou0vvTW0Xw_0 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16424361938376265838', time=2024-04-03T06:34:50.075299+0000, chain.objs.size()=1 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._EjQFe8NlnbHNe1Osuwicmw-Czzuj1N_0 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18353301220090481978', time=2024-04-03T06:34:50.829040+0000, chain.objs.size()=1 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.guCJS6sk6h7JT8HL8_A20tBX7tOMsZI_0 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10389780948659545487', time=2024-04-03T06:34:52.181831+0000, chain.objs.size()=1 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.X8wqcIAHowgIXXxYrN4O3eyTgo9csL3_0 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8608359133882118276', time=2024-04-03T06:34:52.955987+0000, chain.objs.size()=1 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.f-KeP1vK_hFJskypB7gWqtu6XskJZcH_0 2024-04-03T05:14:08.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16311861903740790425', time=2024-04-03T06:34:54.786525+0000, chain.objs.size()=1 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.riS2WhPse5Ge2_hbrfDixVgL9-2hQJG_0 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6548445710806818844', time=2024-04-03T06:34:55.446948+0000, chain.objs.size()=1 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.NZaIR5pX-ehflygYwtEJLtL5WdYRKM__0 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13482196103239525022', time=2024-04-03T06:34:55.798372+0000, chain.objs.size()=1 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7u7H2V2XJfAgnAnJ1dxM5OM1N-b5-Ur_0 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14156655439440767662', time=2024-04-03T06:34:55.987155+0000, chain.objs.size()=1 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fkiBiCZBKzf4kYxw8_C80e0C-n-mbIs_0 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5117829322180804792', time=2024-04-03T06:34:56.353014+0000, chain.objs.size()=1 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ePRllvwL8Uq6eIUAdWWfZ9aQc6efACM_0 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.638951470631425282', time=2024-04-03T06:34:56.640682+0000, chain.objs.size()=1 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-_pCGeffCrBvjDuGQE97OBv2rTiFnoS_0 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14810157986592513316', time=2024-04-03T06:40:14.271675+0000, chain.objs.size()=1 2024-04-03T05:14:08.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.gnUBloYIgafTkIifKBj4pyHAT9toQdJ_0 2024-04-03T05:14:08.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.458__shadow_.C3IRSciIsIil-sohsb8KdH9gikpkF6m_1_b55a5f1fc3bcb39ffbbf520839001a65', time=2024-04-03T06:40:32.237757+0000, chain.objs.size()=1 2024-04-03T05:14:08.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.458__shadow_.C3IRSciIsIil-sohsb8KdH9gikpkF6m_0 2024-04-03T05:14:08.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12981339511806689166', time=2024-04-03T06:40:32.244519+0000, chain.objs.size()=1 2024-04-03T05:14:08.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.458__shadow_.C3IRSciIsIil-sohsb8KdH9gikpkF6m_0 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.461__shadow_.ouZ10vky4o-B3mzJwjMFVZjNmHsUfja_1_f96bd36bee3bd7ad97bfd9ae39fb9990', time=2024-04-03T06:40:39.113223+0000, chain.objs.size()=1 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.461__shadow_.ouZ10vky4o-B3mzJwjMFVZjNmHsUfja_0 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6862880180218801262', time=2024-04-03T06:41:02.050685+0000, chain.objs.size()=1 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_0 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5268618435190442751', time=2024-04-03T06:45:36.310830+0000, chain.objs.size()=6 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~eMRJNqtyT_3kvoBcaKAXGMhSPm_3nue.1 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.d08BZGM4GygA8VYsDYnBP7UuWtd3ZicF.2 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~eMRJNqtyT_3kvoBcaKAXGMhSPm_3nue.3 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~eMRJNqtyT_3kvoBcaKAXGMhSPm_3nue.4 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~eMRJNqtyT_3kvoBcaKAXGMhSPm_3nue.5 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~eMRJNqtyT_3kvoBcaKAXGMhSPm_3nue.6 2024-04-03T05:14:08.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16484386899636786498', time=2024-04-03T06:46:20.078982+0000, chain.objs.size()=12 2024-04-03T05:14:08.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.1 2024-04-03T05:14:08.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.1_1 2024-04-03T05:14:08.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.2 2024-04-03T05:14:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.2_1 2024-04-03T05:14:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.SNmUU4wFi1xIEMiiU4s-0w88_ODndOro.3 2024-04-03T05:14:08.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.SNmUU4wFi1xIEMiiU4s-0w88_ODndOro.3_1 2024-04-03T05:14:08.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.4 2024-04-03T05:14:08.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.4_1 2024-04-03T05:14:08.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.5 2024-04-03T05:14:08.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.5_1 2024-04-03T05:14:08.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.6 2024-04-03T05:14:08.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.6_1 2024-04-03T05:14:08.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5526322464589562088', time=2024-04-03T06:47:43.857919+0000, chain.objs.size()=2 2024-04-03T05:14:08.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.029+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~gkcHOBphjm7bW5qvdHquGHl9_yQ2P7Q.1 2024-04-03T05:14:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~gkcHOBphjm7bW5qvdHquGHl9_yQ2P7Q.2 2024-04-03T05:14:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12993502713853186700', time=2024-04-03T06:48:35.779859+0000, chain.objs.size()=1 2024-04-03T05:14:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.494__shadow_.OePMCp1iq3KdD-pLEDFBNN3GiRPxNIm_0 2024-04-03T05:14:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12159693026450869404', time=2024-04-03T06:50:03.621321+0000, chain.objs.size()=1 2024-04-03T05:14:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.506__shadow_.2TutCPJ0NhmwXrlI5gsrQq6WMTV52Hd_0 2024-04-03T05:14:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4020670019963119002', time=2024-04-03T06:52:39.995857+0000, chain.objs.size()=1 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:nRfaE7PT0GXZO6BVviX.2ODYYu.egOo_.KYR78-AINSqdAKB9Kim9TDR1XGMLXaG_0 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8538842443958813324', time=2024-04-03T06:52:57.809709+0000, chain.objs.size()=1 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:NWAQP4OlSqgpgl.PetIwo07mABsIiQB_.PD2tBeIwmh0U5V51Eu8DrNIFAZ9cODO_0 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15688267382797245972', time=2024-04-03T06:54:09.063354+0000, chain.objs.size()=1 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:1OQ5aTupY5V.QLXcaTGZ3zKl795KGxq_.ds0PBd6K_K2SFmN-Rs4z1fyMUdJkmny_0 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15701527936100289200', time=2024-04-03T06:54:14.687263+0000, chain.objs.size()=1 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:hoF4w-7hBN8W4G91PS1fAcwm.DJsu6h_.xvER0g9Qg9iEOU2HVhxpLxt3rWUmIc1_0 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.41804631105961956', time=2024-04-03T06:54:15.532373+0000, chain.objs.size()=1 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:g-JIHO6q3GTGzd-6XXh9PEV80xd6iim_.i4yaHfJATXsf_KkMboEYMoTKESUUIL6_0 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16921208543015471311', time=2024-04-03T06:55:23.761974+0000, chain.objs.size()=1 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:XXfkxAXI.BDcXfQYBUcA9Ec.9Pvx9RG_.NuxLT23yz0RZ4546mRYmmKYFJcgPAmo_0 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:rWJ4oB2Trp8PCi23coUzRivhsnYYYCl_.4P-xbcO_DZegdwcAnZKsKSHKHO_0CzH_1_f84a30a5bad469fb0fc58f5ea3121fc0', time=2024-04-03T06:55:29.910035+0000, chain.objs.size()=1 2024-04-03T05:14:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:rWJ4oB2Trp8PCi23coUzRivhsnYYYCl_.4P-xbcO_DZegdwcAnZKsKSHKHO_0CzH_0 2024-04-03T05:14:08.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1216973805001550178', time=2024-04-03T07:02:38.746375+0000, chain.objs.size()=2 2024-04-03T05:14:08.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.621__shadow_.mM1pzU8I8Ry8VSQCeS-eZFrzKRjT9dO_0 2024-04-03T05:14:08.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.621__shadow_.mM1pzU8I8Ry8VSQCeS-eZFrzKRjT9dO_1 2024-04-03T05:14:08.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4860515139276437616', time=2024-04-03T07:03:55.543246+0000, chain.objs.size()=1 2024-04-03T05:14:08.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.637__shadow_.1XfpMhWHRgOmommQvm85h13viN9-GCf_0 2024-04-03T05:14:08.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.669257647718664007', time=2024-04-03T07:04:37.745780+0000, chain.objs.size()=1 2024-04-03T05:14:08.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.661__shadow:-3BvsShsGrYX5dj0iJRjkAFjFGoaXJM_.DTz5JzPtCJlkMNJELsF-vOSdzkFEQpV_0 2024-04-03T05:14:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:08.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-03T05:14:08.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:08.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49543' 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9228066548007986619', time=2024-04-03T06:21:14.003086+0000, chain.objs.size()=3 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.147__shadow_.aqdHFOJJZi_wEXUKclhIC2j4ZZ3dAXq_0 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.147__shadow_.aqdHFOJJZi_wEXUKclhIC2j4ZZ3dAXq_1 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.147__shadow_.aqdHFOJJZi_wEXUKclhIC2j4ZZ3dAXq_2 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4114941437239770778', time=2024-04-03T06:21:59.948860+0000, chain.objs.size()=3 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.rUtGycdeZQ3wqBrSsC2kJzZpguTP5Fk_0 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.rUtGycdeZQ3wqBrSsC2kJzZpguTP5Fk_1 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.rUtGycdeZQ3wqBrSsC2kJzZpguTP5Fk_2 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7453541557638298979', time=2024-04-03T06:25:55.274894+0000, chain.objs.size()=1 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.220__shadow_.99S0atbQI0JGXoMqhpznh2G4HVntdnb_0 2024-04-03T05:14:08.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13487886972997809783', time=2024-04-03T06:26:10.475031+0000, chain.objs.size()=1 2024-04-03T05:14:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.227__shadow_.Bh8ZXh69embOIFZDtLVlD6kQsjn4T7x_0 2024-04-03T05:14:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6561272222055770365', time=2024-04-03T06:26:12.554724+0000, chain.objs.size()=1 2024-04-03T05:14:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.228__shadow_.IFflQPT3ZkXz_K1fTaZDP_HljB_vd___0 2024-04-03T05:14:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17215954015302989301', time=2024-04-03T06:27:53.160970+0000, chain.objs.size()=1 2024-04-03T05:14:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LO0JAOvrXIhCNeg-KLK98I3wwZg2ERI_0 2024-04-03T05:14:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10233670632324618087', time=2024-04-03T06:27:53.390570+0000, chain.objs.size()=1 2024-04-03T05:14:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.SK2FGyjbL1viig6V1QHZdY2qyp3V-HM_0 2024-04-03T05:14:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9599932998585850864', time=2024-04-03T06:27:53.988235+0000, chain.objs.size()=1 2024-04-03T05:14:08.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.H4OoY1YBNTWjlPuliwtqQ-sHuRyDlh9_0 2024-04-03T05:14:08.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3457680830867553883', time=2024-04-03T06:27:56.751032+0000, chain.objs.size()=1 2024-04-03T05:14:08.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qblLedRQcYjlwlCJ4lNRVV9GTRPKmw__0 2024-04-03T05:14:08.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9400525044404938288', time=2024-04-03T06:27:57.533169+0000, chain.objs.size()=1 2024-04-03T05:14:08.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.hO2SYwTsf6PrpmDuDN0Yv8xMzVuwJ4e_0 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.801895004558191652', time=2024-04-03T06:27:57.947883+0000, chain.objs.size()=1 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.VU0KqLdWS6aw_zWFy685wFYi4dnR0i__0 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11953124867669125460', time=2024-04-03T06:27:58.172627+0000, chain.objs.size()=1 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.P5vIWDtKtK2xCUgP16aLiFerolc8rOv_0 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3753447059512960416', time=2024-04-03T06:27:58.272210+0000, chain.objs.size()=1 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gjeNwSFYajAGpwYy2WsHWc7ktM-NW78_0 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11741544528729795128', time=2024-04-03T06:28:00.524716+0000, chain.objs.size()=1 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nq-3wXMdUK8tmTSoJffjT05Z5rAyOA9_0 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12661118806436288357', time=2024-04-03T06:28:00.581104+0000, chain.objs.size()=1 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.kryctcK_K6Ah-7LEETQlesTRQ7oQ9_l_0 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18055975261865960709', time=2024-04-03T06:28:01.005742+0000, chain.objs.size()=1 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ejdub_UAMikm3ZI5z3EHwUofx02AlOL_0 2024-04-03T05:14:08.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14397140812354174674', time=2024-04-03T06:28:01.506937+0000, chain.objs.size()=1 2024-04-03T05:14:08.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OXC4Go9-tCD790wW8bX-HyyMCE8xuSa_0 2024-04-03T05:14:08.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9035530846534630387', time=2024-04-03T06:28:04.160941+0000, chain.objs.size()=1 2024-04-03T05:14:08.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xo55e4botq-8uEnxLkAqu2lpYFwCR-C_0 2024-04-03T05:14:08.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14317383740750095158', time=2024-04-03T06:28:04.359443+0000, chain.objs.size()=1 2024-04-03T05:14:08.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wYFPWb344e_-CIDPbpB1vnAa1Kh0HGZ_0 2024-04-03T05:14:08.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10872879429345341353', time=2024-04-03T06:28:04.791118+0000, chain.objs.size()=1 2024-04-03T05:14:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8u-boKtayT034_-xosIOez41yBYLf5K_0 2024-04-03T05:14:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12906020690126612717', time=2024-04-03T06:28:05.013187+0000, chain.objs.size()=1 2024-04-03T05:14:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gdypEcxgxSuZgYIKpLB9-_39OtOXqEr_0 2024-04-03T05:14:08.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18254605569625283866', time=2024-04-03T06:28:05.614458+0000, chain.objs.size()=1 2024-04-03T05:14:08.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OoEwk9AvgwA7xMp652cU5K8rD-gCVKy_0 2024-04-03T05:14:08.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7434591257719707909', time=2024-04-03T06:28:05.888431+0000, chain.objs.size()=1 2024-04-03T05:14:08.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rLjoAMh55s2j5JOex5tKKUWTCgj6PCu_0 2024-04-03T05:14:08.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8362162161388536888', time=2024-04-03T06:28:06.435709+0000, chain.objs.size()=1 2024-04-03T05:14:08.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3IMZ_iX8HPqhI5ZwvJsbBnfLGsxUOHQ_0 2024-04-03T05:14:08.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11242565733168184644', time=2024-04-03T06:28:08.617387+0000, chain.objs.size()=1 2024-04-03T05:14:08.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-3nreU4suJsH6K8BC03Lkvatdq1AtDK_0 2024-04-03T05:14:08.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6464508355623186045', time=2024-04-03T06:28:09.026907+0000, chain.objs.size()=1 2024-04-03T05:14:08.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lbJGwyU9jn6X2IrTO7xQvujAZNtgJeC_0 2024-04-03T05:14:08.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1467327902429799697', time=2024-04-03T06:28:09.082493+0000, chain.objs.size()=1 2024-04-03T05:14:08.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.iI1Ela2HIikLwoYwVHbqk4xiD1p-k0A_0 2024-04-03T05:14:08.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13677804738273746062', time=2024-04-03T06:28:09.518919+0000, chain.objs.size()=1 2024-04-03T05:14:08.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.CVPFp7sJbEThbfyjUc8sqh0I64ln52F_0 2024-04-03T05:14:08.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8910649361529119503', time=2024-04-03T06:28:09.935016+0000, chain.objs.size()=1 2024-04-03T05:14:08.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MfYeCENjWXaSJbJXF1_76X5ippiLoyk_0 2024-04-03T05:14:08.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7922508774519847796', time=2024-04-03T06:28:12.415881+0000, chain.objs.size()=1 2024-04-03T05:14:08.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.g_RwbHw0l2XmA4fGYOrvvctGLKY8JN7_0 2024-04-03T05:14:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11730231468425196193', time=2024-04-03T06:28:16.428227+0000, chain.objs.size()=1 2024-04-03T05:14:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6NYN_6EtpJmAK_A2whprL9K6t5A2jJm_0 2024-04-03T05:14:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6651966141950055946', time=2024-04-03T06:28:17.008173+0000, chain.objs.size()=1 2024-04-03T05:14:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8OVnJGMchaT83XabNQfG-zqhNuC2Rgz_0 2024-04-03T05:14:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16368358794489371138', time=2024-04-03T06:28:17.115073+0000, chain.objs.size()=1 2024-04-03T05:14:08.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.pqMGuOigPlcuEfy-wTlec9sMJx79nki_0 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15247460219097608611', time=2024-04-03T06:28:17.175248+0000, chain.objs.size()=1 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.J9g3YMb9e2a_D25jS6XkTxdlmZVCu-6_0 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8914664386358795818', time=2024-04-03T06:28:17.614333+0000, chain.objs.size()=1 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.F-jZm8rsMCxAC-W_fRo2JYQh7kQwmPi_0 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16841256229260190041', time=2024-04-03T06:28:18.657524+0000, chain.objs.size()=1 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-51F7ILIXK7XcYHk1BINEjRLsO_Y2-H_0 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8169706684089620184', time=2024-04-03T06:28:19.112593+0000, chain.objs.size()=1 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.04JoYqK5dVT_6W2YH_a_qUA7kB6SjlB_0 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11639490224063411045', time=2024-04-03T06:28:19.388164+0000, chain.objs.size()=1 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.khozYsifQoxBrYUkOiIzeDNTTrRYQqw_0 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3671680556702387987', time=2024-04-03T06:28:46.307224+0000, chain.objs.size()=1 2024-04-03T05:14:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.243__shadow_.HnwhQus6g4gX6aqVqRZ_Ww_4nTwCBAv_0 2024-04-03T05:14:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15173786305454597884', time=2024-04-03T06:28:59.530848+0000, chain.objs.size()=1 2024-04-03T05:14:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.249__shadow_.0YDlugdcvS5dUZVyNBg3QHpB50MSpqT_0 2024-04-03T05:14:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6049031681328382044', time=2024-04-03T06:29:20.405408+0000, chain.objs.size()=1 2024-04-03T05:14:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.258__shadow_.WAPFHtK4f4CxN8PQ2KoLB4SZsm732Zf_0 2024-04-03T05:14:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14479416882662270367', time=2024-04-03T06:29:25.532024+0000, chain.objs.size()=1 2024-04-03T05:14:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.260__shadow_.KHLOH7nism33HQMnNVsGB73uNk9z_X0_0 2024-04-03T05:14:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12780154578310834562', time=2024-04-03T06:29:30.499898+0000, chain.objs.size()=1 2024-04-03T05:14:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.QduF9GiRe8uL-wb1VVcqFkjt6cSNoLa_0 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4093123644391134338', time=2024-04-03T06:29:58.597218+0000, chain.objs.size()=1 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.272__shadow_.a_MM3-N9tM4YXnGfGMvaUW2ck99R1vY_0 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12572274975362366736', time=2024-04-03T06:30:02.976416+0000, chain.objs.size()=1 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.274__shadow_.8tOReWh4pShLCNKorSTDyairXItysjB_0 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5085542947810739843', time=2024-04-03T06:32:24.162084+0000, chain.objs.size()=1 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Uw0M4OeaMlZW5Q_CysgxSkkQG1zmbvK_0 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10273401265475450426', time=2024-04-03T06:32:25.636978+0000, chain.objs.size()=1 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Zjd_6w6vDY89TD_90Y24VdGQ11y5IcM_0 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17877509944706543042', time=2024-04-03T06:32:26.530103+0000, chain.objs.size()=1 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.bXC9gmSdvu_Spcw2_SgtqLOSOW-N2eJ_0 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9022478583595541341', time=2024-04-03T06:32:28.510606+0000, chain.objs.size()=1 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pxFZe45dvoVIdy-MypfncptFE12w_r__0 2024-04-03T05:14:08.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10712053161212831644', time=2024-04-03T06:32:29.479676+0000, chain.objs.size()=1 2024-04-03T05:14:08.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.E8DuahffojHCGL_89jOPYg8Enhbps3n_0 2024-04-03T05:14:08.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16563602534836620230', time=2024-04-03T06:32:29.903685+0000, chain.objs.size()=1 2024-04-03T05:14:08.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HlWKwzwb7tabDe_yY6-XIk8NpfJEBqS_0 2024-04-03T05:14:08.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18043181661061468219', time=2024-04-03T06:32:30.036999+0000, chain.objs.size()=1 2024-04-03T05:14:08.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mwiemjBqil9lz0jBoPZ-pefnwaYKMF4_0 2024-04-03T05:14:08.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5369515310127591206', time=2024-04-03T06:32:32.248500+0000, chain.objs.size()=1 2024-04-03T05:14:08.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.h4lxBQdVihUkXp06RzQyQ8ga-d9Gv3O_0 2024-04-03T05:14:08.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1444509393697502110', time=2024-04-03T06:32:33.222646+0000, chain.objs.size()=1 2024-04-03T05:14:08.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EFdZVZ8eGbcgmEDPn7FK2vjg9sd-aJ3_0 2024-04-03T05:14:08.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8327969835268807284', time=2024-04-03T06:32:33.603599+0000, chain.objs.size()=1 2024-04-03T05:14:08.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.NAx4rbJ3B_2nDVxLez-_AQ2sZnH_qbh_0 2024-04-03T05:14:08.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5499902359224814740', time=2024-04-03T06:32:34.300670+0000, chain.objs.size()=1 2024-04-03T05:14:08.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.34HzMMLLd_HowjRhHq5HdgnW1FLgbKn_0 2024-04-03T05:14:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.170058151387981454', time=2024-04-03T06:32:35.902717+0000, chain.objs.size()=1 2024-04-03T05:14:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.22smU709Rv7WauOY_Xcb7VjwdrYFGWq_0 2024-04-03T05:14:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10053653883527836076', time=2024-04-03T06:32:37.056870+0000, chain.objs.size()=1 2024-04-03T05:14:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HNTWsoEjoQf9t1xEUa6EkyEJgFYMHPs_0 2024-04-03T05:14:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6114897075016253456', time=2024-04-03T06:32:38.111896+0000, chain.objs.size()=1 2024-04-03T05:14:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.e5GsiYT5-d2tXwXZwCv6tTWZSS7ru8n_0 2024-04-03T05:14:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10155956997596721545', time=2024-04-03T06:32:39.390642+0000, chain.objs.size()=1 2024-04-03T05:14:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DFEk4yZa_q6ETOQL7xwPe1Z8eSTmylp_0 2024-04-03T05:14:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10432576573914601053', time=2024-04-03T06:32:39.685484+0000, chain.objs.size()=1 2024-04-03T05:14:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rhh7ROdEpoxSwqUkRde5-vYWztyROxS_0 2024-04-03T05:14:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13125224099471946290', time=2024-04-03T06:32:40.393749+0000, chain.objs.size()=1 2024-04-03T05:14:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Jlrv6IZJPll3wSY_4ndGtaYmKcKbR5V_0 2024-04-03T05:14:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7447968448214854926', time=2024-04-03T06:32:41.550510+0000, chain.objs.size()=1 2024-04-03T05:14:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rJLgY54r1qfE1cIoU3rj8GYGzR4KLDF_0 2024-04-03T05:14:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2923785310038373317', time=2024-04-03T06:32:43.457982+0000, chain.objs.size()=1 2024-04-03T05:14:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FWJfjZk_k42bCysIOoIC0T2ZIRNqdnQ_0 2024-04-03T05:14:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1742171220992889385', time=2024-04-03T06:32:44.982266+0000, chain.objs.size()=1 2024-04-03T05:14:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sod0uy3SOPMaeY6t37USbfvi74Yv6HA_0 2024-04-03T05:14:08.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9957350464814913551', time=2024-04-03T06:32:46.494110+0000, chain.objs.size()=1 2024-04-03T05:14:08.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0dD7jSP2oK9tgfVs7jqKahLvNliYR9b_0 2024-04-03T05:14:08.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10585874283136060857', time=2024-04-03T06:32:48.407162+0000, chain.objs.size()=1 2024-04-03T05:14:08.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.p1patLAOOopHBVKOxPA-uxGopfuyIZB_0 2024-04-03T05:14:08.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9386018985936597349', time=2024-04-03T06:32:48.825892+0000, chain.objs.size()=1 2024-04-03T05:14:08.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mPVeW3iAze_QPp2UiwEgHKEDT1ePWQC_0 2024-04-03T05:14:08.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13984701987905368433', time=2024-04-03T06:32:50.173125+0000, chain.objs.size()=1 2024-04-03T05:14:08.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.I4xOtlmVIkEknZrH3lFOCe-fiy6bciU_0 2024-04-03T05:14:08.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17941985903453738971', time=2024-04-03T06:32:50.595974+0000, chain.objs.size()=1 2024-04-03T05:14:08.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Emrjbg6S-jsPG_Bpve8tu-iTwHbKBMH_0 2024-04-03T05:14:08.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1569767427874960179', time=2024-04-03T06:32:50.597966+0000, chain.objs.size()=1 2024-04-03T05:14:08.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.093+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.K-kAe7px4is5LrTSYT0MnlW12OTkPTL_0 2024-04-03T05:14:08.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3122175784947088628', time=2024-04-03T06:32:51.688552+0000, chain.objs.size()=1 2024-04-03T05:14:08.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cJRD_SuySrum_5H5dKyihgYyB5VstXU_0 2024-04-03T05:14:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16794622784470338361', time=2024-04-03T06:32:51.938989+0000, chain.objs.size()=1 2024-04-03T05:14:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CRpK6qSgXQ-IMzEHigpFDmDPY8B_V_c_0 2024-04-03T05:14:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10092891025369536309', time=2024-04-03T06:34:30.040005+0000, chain.objs.size()=1 2024-04-03T05:14:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.OPDY5YkFGOlMKm41Iat4o1rvStds4Vf_0 2024-04-03T05:14:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14849019537047468402', time=2024-04-03T06:34:30.892132+0000, chain.objs.size()=1 2024-04-03T05:14:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vbgjRMc9ya5wONC37DvugZsExCe0DTo_0 2024-04-03T05:14:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8732250372068693194', time=2024-04-03T06:34:32.866942+0000, chain.objs.size()=1 2024-04-03T05:14:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YO_Q71yeMLFRa56xi0bPF-yN2RghbL8_0 2024-04-03T05:14:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4551855476825445916', time=2024-04-03T06:34:33.853213+0000, chain.objs.size()=1 2024-04-03T05:14:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.scxC0oH6sn7RUqwGozWvojLFsSW_0kx_0 2024-04-03T05:14:08.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8247230329452439816', time=2024-04-03T06:34:34.415290+0000, chain.objs.size()=1 2024-04-03T05:14:08.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zKoq33PoeH4U_uo4oPMpTkQ9lcz6wTi_0 2024-04-03T05:14:08.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15238364631253404223', time=2024-04-03T06:34:36.339309+0000, chain.objs.size()=1 2024-04-03T05:14:08.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.33fYr-lZdulrQ4YRLtpka6F9qPeC5mQ_0 2024-04-03T05:14:08.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9590962620755558641', time=2024-04-03T06:34:37.901229+0000, chain.objs.size()=1 2024-04-03T05:14:08.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rNSJjS5qIKoMdxmU0lnifMalkXuY_Zl_0 2024-04-03T05:14:08.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.233484920871291120', time=2024-04-03T06:34:38.896115+0000, chain.objs.size()=1 2024-04-03T05:14:08.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hU8ez5thC5kjk3G2-cWle29p5fU3PaI_0 2024-04-03T05:14:08.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15777136305266460445', time=2024-04-03T06:34:40.419306+0000, chain.objs.size()=1 2024-04-03T05:14:08.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.j1ReX0n28ldhVEnRC_-3laDYdH8RRdx_0 2024-04-03T05:14:08.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.941464432730427569', time=2024-04-03T06:34:40.501300+0000, chain.objs.size()=1 2024-04-03T05:14:08.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gci8wLcbbqCPZA0F5f6UU-8nbbVZ6sc_0 2024-04-03T05:14:08.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2910940184255495192', time=2024-04-03T06:34:40.549838+0000, chain.objs.size()=1 2024-04-03T05:14:08.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yARgd4CvXD8xdrS1cQw9ZMb3C0EOhOU_0 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5550070521040491596', time=2024-04-03T06:34:41.914354+0000, chain.objs.size()=1 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xX5UrVzrsbuYLoeluojSWAaFluteY1Q_0 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13894605831204710373', time=2024-04-03T06:34:44.145401+0000, chain.objs.size()=1 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Wq5mlgoCRs_ub21Z3eWB-INsNFMoW8q_0 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13166292865925115589', time=2024-04-03T06:34:44.456536+0000, chain.objs.size()=1 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.oeQuLRk2lbO2Bx9vJ7DxjbXw3z7lMAh_0 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4647112375617578870', time=2024-04-03T06:34:45.650013+0000, chain.objs.size()=1 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7OliXKvXXrtqQJQK1fdja8WrrLSwAIc_0 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6759010473159353269', time=2024-04-03T06:34:45.859461+0000, chain.objs.size()=1 2024-04-03T05:14:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.99ODndjPuas6livUJley1FvhQmRygGB_0 2024-04-03T05:14:08.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8561404300616955169', time=2024-04-03T06:34:48.664225+0000, chain.objs.size()=1 2024-04-03T05:14:08.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ygqd7fwoKMekRm_iHckBxEMJcgWGX1K_0 2024-04-03T05:14:08.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6569405716811960811', time=2024-04-03T06:34:51.704224+0000, chain.objs.size()=1 2024-04-03T05:14:08.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.101+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.drmH2TJPe4AV3LsEFEYx9TZLV7YvjEt_0 2024-04-03T05:14:08.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17929835672309994363', time=2024-04-03T06:34:51.998367+0000, chain.objs.size()=1 2024-04-03T05:14:08.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kye4oeYCAc4a79GWbYE7LkvGogNU-KB_0 2024-04-03T05:14:08.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.39378668564071098', time=2024-04-03T06:34:52.636168+0000, chain.objs.size()=1 2024-04-03T05:14:08.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.MrK8H68P0gp0DkPu5LoTCN11qF51cdb_0 2024-04-03T05:14:08.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17710838420860665143', time=2024-04-03T06:34:53.061794+0000, chain.objs.size()=1 2024-04-03T05:14:08.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wRgn-DXugk7Zg7bbNl7Bzkt1TmAwl2h_0 2024-04-03T05:14:08.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1573271566641851894', time=2024-04-03T06:34:53.126674+0000, chain.objs.size()=1 2024-04-03T05:14:08.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hPY8wqkloIqTcPxfXZWByBEbqvaP2VV_0 2024-04-03T05:14:08.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1471117061751831284', time=2024-04-03T06:34:53.555852+0000, chain.objs.size()=1 2024-04-03T05:14:08.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4mydkFfX47q2a3CaQGzfcl9VXGhn2ss_0 2024-04-03T05:14:08.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4536765712701442794', time=2024-04-03T06:34:54.370958+0000, chain.objs.size()=1 2024-04-03T05:14:08.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kwp3N8kVtU7IrPRXfrlVyCdhNwqkmip_0 2024-04-03T05:14:08.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10318212822420886942', time=2024-04-03T06:34:54.744680+0000, chain.objs.size()=1 2024-04-03T05:14:08.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0-DiSAmndSurI0aCJtPwkzQHQWr-y2o_0 2024-04-03T05:14:08.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1684685421318138119', time=2024-04-03T06:34:54.847196+0000, chain.objs.size()=1 2024-04-03T05:14:08.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.izn1J9yI88TuGwQ-aMlq40dy6958wVg_0 2024-04-03T05:14:08.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1585541413560845408', time=2024-04-03T06:34:55.622154+0000, chain.objs.size()=1 2024-04-03T05:14:08.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LbaBJXUuKAdEUZAkDhb2kD9_YuvYF_V_0 2024-04-03T05:14:08.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/49543 2024-04-03T05:14:08.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-04-03T05:14:08.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16353490061849509847', time=2024-04-03T06:36:39.733761+0000, chain.objs.size()=1 2024-04-03T05:14:08.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.348__shadow_.x43AKbYDAxrN_bufF30H3dLE_f7AOS__0 2024-04-03T05:14:08.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18312168836083876201', time=2024-04-03T06:39:46.224089+0000, chain.objs.size()=1 2024-04-03T05:14:08.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.435__shadow_.mWs6uX1_HZctqtlb67YLy5FFIQeOtP-_0 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_1_cc245cea55b586b4e67c310254dccf81', time=2024-04-03T06:41:02.022526+0000, chain.objs.size()=1 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_0 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2_707ad3acf8836c09aadb0c8473d1d092', time=2024-04-03T06:41:43.957115+0000, chain.objs.size()=6 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.1 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.3 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.4 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.5 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.6 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1476050617622832436', time=2024-04-03T06:53:33.909262+0000, chain.objs.size()=1 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:zfuHlvrPrqEdH2FLxbTGYPyDJMOF1ku_.l-1ovV-LnAqWhqqNTPen5y6k2u_fH2E_0 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6370269715645948408', time=2024-04-03T06:53:52.182670+0000, chain.objs.size()=1 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:qboq9hpp7gF9dZen0B.cfUV3znhovak_.p034bQacSQ7T8T52KSZ9inCrRN1ZFBg_0 2024-04-03T05:14:08.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13608464764015234833', time=2024-04-03T06:55:12.723700+0000, chain.objs.size()=4 2024-04-03T05:14:08.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~Lc5_mHolwo0N0jB_CIE6AEv6Jl1RYpM.1 2024-04-03T05:14:08.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~Lc5_mHolwo0N0jB_CIE6AEv6Jl1RYpM.2 2024-04-03T05:14:08.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~Lc5_mHolwo0N0jB_CIE6AEv6Jl1RYpM.3 2024-04-03T05:14:08.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~Lc5_mHolwo0N0jB_CIE6AEv6Jl1RYpM.4 2024-04-03T05:14:08.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8159527497581771114', time=2024-04-03T06:55:23.442802+0000, chain.objs.size()=1 2024-04-03T05:14:08.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:TYD51-oxNq8QDHHKy0qWOnqUEzYsbPw_.RyWm65smsz4TU00AEogJKnBYASFFc6X_0 2024-04-03T05:14:08.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5887482506560829886', time=2024-04-03T06:59:23.049003+0000, chain.objs.size()=1 2024-04-03T05:14:08.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.587__shadow_.0dkiEKu9iylGCAbLlJFGY_Qxbf5M-q1_0 2024-04-03T05:14:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16716547242228583188', time=2024-04-03T07:03:37.412778+0000, chain.objs.size()=1 2024-04-03T05:14:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.628__shadow_.DiZZLZU25rn_03aQoYhJiMlC7962wBk_0 2024-04-03T05:14:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5658060113229252247', time=2024-04-03T07:04:46.083715+0000, chain.objs.size()=1 2024-04-03T05:14:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.665__shadow:IvSTmI9s0onWECd0LIFwWgMiagjLYGK_.HnStdPouK6qjM2kgoovUTYDoSP5LyLI_0 2024-04-03T05:14:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15862520792285439478', time=2024-04-03T07:04:48.063035+0000, chain.objs.size()=1 2024-04-03T05:14:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.666__shadow:FpcVmR9ohuhOoxEGKgQNJ6iTMTY55Wf_.OO9M746HOE7ytI49MiZ4Jsn_IBIDIq-_0 2024-04-03T05:14:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17742183833547173670', time=2024-04-03T07:05:02.767474+0000, chain.objs.size()=1 2024-04-03T05:14:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.673__shadow:2M70dziIfbKqKR53FkagkDF28FodY5c_.GRlZnfTWCkFt3SAvUrTvb__aUjVDfn9_0 2024-04-03T05:14:08.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:08.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-03T05:14:08.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:08.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:08.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45167' 2024-04-03T05:14:08.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12830383454259335440', time=2024-04-03T06:25:04.003636+0000, chain.objs.size()=1 2024-04-03T05:14:08.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.199__shadow_.GJ5H0r41Jrfxwh38HWM6D0Qt0KJ-MIt_0 2024-04-03T05:14:08.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4081906545144277708', time=2024-04-03T06:25:57.445929+0000, chain.objs.size()=1 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.221__shadow_.yGl_FO4DgjpcrRRogKS8pK2hr4KhQ8q_0 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13187585354392925987', time=2024-04-03T06:27:52.526287+0000, chain.objs.size()=1 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yf2ENQHXN52nzw9k6g7hzphxK_AGlo8_0 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5100305870955781371', time=2024-04-03T06:27:52.613533+0000, chain.objs.size()=1 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nQ2V76pT9Ej-HRtkZs5DFt8vK1Ft8vB_0 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8593123644672375480', time=2024-04-03T06:27:53.252008+0000, chain.objs.size()=1 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JOaWM5BIE32VyUIRzZAGsO3vm91CuL9_0 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3110992279049818277', time=2024-04-03T06:27:54.343825+0000, chain.objs.size()=1 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Gk7nuz9N11Dqu7eTf88qlVE0xmvDl4Z_0 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16823546235408316775', time=2024-04-03T06:27:54.360043+0000, chain.objs.size()=1 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WSqMR9lXDeiChF5zS9g8upqCP8sq58z_0 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2464200436736551590', time=2024-04-03T06:27:55.164940+0000, chain.objs.size()=1 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.H_xhk6COaldfAkqd9IWGlS77tyq25VG_0 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15812950380778387425', time=2024-04-03T06:27:56.289891+0000, chain.objs.size()=1 2024-04-03T05:14:08.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.otmO4X869-pNyiVXmxwkXvMxOmLp8ZT_0 2024-04-03T05:14:08.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4192454703732901061', time=2024-04-03T06:27:58.191599+0000, chain.objs.size()=1 2024-04-03T05:14:08.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sjQjT1l_RLK9_fRzeakoPGdCse2UPeL_0 2024-04-03T05:14:08.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5466779655835781694', time=2024-04-03T06:27:58.410796+0000, chain.objs.size()=1 2024-04-03T05:14:08.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_._hC6fU8jHC_soE0_ffJfcFUFF6NvMQo_0 2024-04-03T05:14:08.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2669665796053100579', time=2024-04-03T06:28:00.875966+0000, chain.objs.size()=1 2024-04-03T05:14:08.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mENLm_L8S561_tZ8-ymXR_d7zoIQ0qD_0 2024-04-03T05:14:08.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13229097661294690612', time=2024-04-03T06:28:01.206828+0000, chain.objs.size()=1 2024-04-03T05:14:08.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.c7LgLCiiejea-C1L27mJ9120QnckJzP_0 2024-04-03T05:14:08.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10779033427613444777', time=2024-04-03T06:28:02.307106+0000, chain.objs.size()=1 2024-04-03T05:14:08.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.PVqFORPko6iGT-4AWIwzsJ2Cg4697NO_0 2024-04-03T05:14:08.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13355458018192259876', time=2024-04-03T06:28:02.388982+0000, chain.objs.size()=1 2024-04-03T05:14:08.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.2ePIVrzcACEvW0M37YZeFfLv-qXdHOq_0 2024-04-03T05:14:08.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6935868375492114141', time=2024-04-03T06:28:02.492755+0000, chain.objs.size()=1 2024-04-03T05:14:08.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.07KmXVcZDg5DPqEAt1K5xd_nU8MFtUr_0 2024-04-03T05:14:08.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16266039698722114443', time=2024-04-03T06:28:02.966561+0000, chain.objs.size()=1 2024-04-03T05:14:08.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.CEIOirVndkTa7Z-Ql8kGJVC6rNOGsNv_0 2024-04-03T05:14:08.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1845836883296778777', time=2024-04-03T06:28:04.691161+0000, chain.objs.size()=1 2024-04-03T05:14:08.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jbFzUxPqJ-SheBUr0q_7IqICaiBSyXC_0 2024-04-03T05:14:08.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10394707441401556722', time=2024-04-03T06:28:05.268513+0000, chain.objs.size()=1 2024-04-03T05:14:08.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.zdGPLQMgzwPWzi9t1IIUJmpN-pEw61N_0 2024-04-03T05:14:08.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3359700688898337635', time=2024-04-03T06:28:05.836594+0000, chain.objs.size()=1 2024-04-03T05:14:08.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.L_YwkEox6aE9r-8-R3G3gZqXVXRaxCY_0 2024-04-03T05:14:08.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13837849988408988755', time=2024-04-03T06:28:06.686282+0000, chain.objs.size()=1 2024-04-03T05:14:08.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.T5PD9NzI9zAKvM2LTiazojQv9rZG13F_0 2024-04-03T05:14:08.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14330380523014980949', time=2024-04-03T06:28:09.085563+0000, chain.objs.size()=1 2024-04-03T05:14:08.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.j5sQKEZVgebMsttn4pmg1v6nC-UwVib_0 2024-04-03T05:14:08.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9314793274350185554', time=2024-04-03T06:28:09.412654+0000, chain.objs.size()=1 2024-04-03T05:14:08.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rADMO0RoyXwp2kgUujI3KewDFlOvUlZ_0 2024-04-03T05:14:08.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5522152379489660102', time=2024-04-03T06:28:09.414620+0000, chain.objs.size()=1 2024-04-03T05:14:08.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.aq324zVhpRg6Z4ypC3RyBPayiJYBP2y_0 2024-04-03T05:14:08.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10642957847385929799', time=2024-04-03T06:28:10.388547+0000, chain.objs.size()=1 2024-04-03T05:14:08.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.VagHj59n9HaTQ3lBjOWK3AdUPAn9g9D_0 2024-04-03T05:14:08.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13274670676803285027', time=2024-04-03T06:28:10.738703+0000, chain.objs.size()=1 2024-04-03T05:14:08.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.SeL8g88xd2JYhy_7gEgy2thurfPVofZ_0 2024-04-03T05:14:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11104408310166402046', time=2024-04-03T06:28:11.892231+0000, chain.objs.size()=1 2024-04-03T05:14:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9utqTw0PVXOU3k9Fk57DzQaB4vihYB7_0 2024-04-03T05:14:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2982704441710559839', time=2024-04-03T06:28:12.396148+0000, chain.objs.size()=1 2024-04-03T05:14:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.iAkbgIVF8D2fhrYWC_OdD0MNupSXGDV_0 2024-04-03T05:14:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12170080434602658160', time=2024-04-03T06:28:12.543859+0000, chain.objs.size()=1 2024-04-03T05:14:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9kMMVJyBnSXmd0nqXJ4BaTU0wnYKxmQ_0 2024-04-03T05:14:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13610649268048674924', time=2024-04-03T06:28:12.738864+0000, chain.objs.size()=1 2024-04-03T05:14:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.VRFx1G0f5075d_WmCWNDLjdj5FaTZk__0 2024-04-03T05:14:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3817122651283774186', time=2024-04-03T06:28:13.042173+0000, chain.objs.size()=1 2024-04-03T05:14:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.g6L6zLmq3DuG5KuQzs8DIcoZOr2dLtC_0 2024-04-03T05:14:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4671114709007163102', time=2024-04-03T06:28:13.243749+0000, chain.objs.size()=1 2024-04-03T05:14:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6Et5zUdb_79q1RMmRzfORhxZz2XSE2B_0 2024-04-03T05:14:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13520839841313500518', time=2024-04-03T06:28:13.558952+0000, chain.objs.size()=1 2024-04-03T05:14:08.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xCdH8XOjaPjpVDWPd_GQl9wESnFbRPQ_0 2024-04-03T05:14:08.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10805765751626569242', time=2024-04-03T06:28:14.267443+0000, chain.objs.size()=1 2024-04-03T05:14:08.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.VrxEY0EFF6QHo2LA5zMP42vUreXdIQY_0 2024-04-03T05:14:08.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7638095158842383552', time=2024-04-03T06:28:15.171217+0000, chain.objs.size()=1 2024-04-03T05:14:08.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6u2bwmHOderrBNLmDbPr5LoSDqmc_5__0 2024-04-03T05:14:08.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17790359724832477536', time=2024-04-03T06:28:16.888079+0000, chain.objs.size()=1 2024-04-03T05:14:08.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.R7pZnyQNAfnZTAc518BtOfAMcMZSE9a_0 2024-04-03T05:14:08.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16972966905294190520', time=2024-04-03T06:28:17.570574+0000, chain.objs.size()=1 2024-04-03T05:14:08.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.koJuZQRiUaTDTicT3ZlSXm2Tax5RIB7_0 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15672363967259058433', time=2024-04-03T06:28:17.798538+0000, chain.objs.size()=1 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.zPSeNfo9-DQQwbc9ly35bIuTTrwNgpF_0 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6936863664642113751', time=2024-04-03T06:28:18.836448+0000, chain.objs.size()=1 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4M6C-meQVMjl_IH9aIMkFqBKAy2muf4_0 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11828684988214284943', time=2024-04-03T06:28:20.359710+0000, chain.objs.size()=1 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QmxnO3hRrHonfhtwwALWUf0n89SrfZC_0 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15643800083059461686', time=2024-04-03T06:28:21.144245+0000, chain.objs.size()=1 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5MDtHUcGOz162d85EWM3iq65wTQNnKT_0 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2087877939898447073', time=2024-04-03T06:28:27.591501+0000, chain.objs.size()=1 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.234__shadow_.PCXc7kJdfkDQIOxNRqzo6etCRCEfLbr_0 2024-04-03T05:14:08.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10044212584618189583', time=2024-04-03T06:28:29.659454+0000, chain.objs.size()=1 2024-04-03T05:14:08.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.235__shadow_.ygD_NoLnjVLsNdxlSGu8pwWDCj6n8DR_0 2024-04-03T05:14:08.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16649421141219690472', time=2024-04-03T06:28:42.163846+0000, chain.objs.size()=1 2024-04-03T05:14:08.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.241__shadow_.TS85m9MHWN6Ek-SCDSg22dannWEG0QQ_0 2024-04-03T05:14:08.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3941593295830087575', time=2024-04-03T06:28:46.318078+0000, chain.objs.size()=1 2024-04-03T05:14:08.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.243__shadow_.oVT8k2LBr7CkNhHoAPr_rNRnvq7KytT_0 2024-04-03T05:14:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3839169610348268421', time=2024-04-03T06:28:57.323620+0000, chain.objs.size()=1 2024-04-03T05:14:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.248__shadow_.2uJOfR8Lk54Bjy4wkZ9qah9owKlDIzr_0 2024-04-03T05:14:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.108783993408884376', time=2024-04-03T06:29:36.172179+0000, chain.objs.size()=1 2024-04-03T05:14:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.hDVB3CSs7LgnHJDcEGhgPbguiEK1N6w_0 2024-04-03T05:14:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1748073604513308281', time=2024-04-03T06:29:45.150872+0000, chain.objs.size()=1 2024-04-03T05:14:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.266__shadow_.EFYY_Ni5FJmZ1HvhSfrGB5wTj4IFqpt_0 2024-04-03T05:14:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7222146448915473368', time=2024-04-03T06:29:47.443122+0000, chain.objs.size()=1 2024-04-03T05:14:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.267__shadow_.Q1mQhuQbSyk9YWqhNwvLagdNzOAslf3_0 2024-04-03T05:14:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3458322117452862355', time=2024-04-03T06:32:25.561903+0000, chain.objs.size()=1 2024-04-03T05:14:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tmME_g9ciI3RqHtdWLV7UdGGlw-xDRH_0 2024-04-03T05:14:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1116164290382812957', time=2024-04-03T06:32:26.753859+0000, chain.objs.size()=1 2024-04-03T05:14:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8FpZaWGqT5KNQqOLki8bh9oKtiE37DT_0 2024-04-03T05:14:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16863644716059260743', time=2024-04-03T06:32:28.168131+0000, chain.objs.size()=1 2024-04-03T05:14:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xwserTr8udkqk2WxhctwiutwMBR51G0_0 2024-04-03T05:14:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11818090597526334688', time=2024-04-03T06:32:28.324000+0000, chain.objs.size()=1 2024-04-03T05:14:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tyRRC3tIPB5cDRAz0v-4-AYiux3rRYm_0 2024-04-03T05:14:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7531058195707140472', time=2024-04-03T06:32:28.689205+0000, chain.objs.size()=1 2024-04-03T05:14:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tsF6VfSjzRkScq0RlvJ_NHhwfeeapgN_0 2024-04-03T05:14:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16170022696439626240', time=2024-04-03T06:32:28.846431+0000, chain.objs.size()=1 2024-04-03T05:14:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5td2d2DnLpcKNNkfuvodlnL-sZ3EXk__0 2024-04-03T05:14:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13163017663591533198', time=2024-04-03T06:32:29.521415+0000, chain.objs.size()=1 2024-04-03T05:14:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YjLuO9rUx4Hofwmc8ZshXCBRhZ-z1t1_0 2024-04-03T05:14:08.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9219735047267477795', time=2024-04-03T06:32:30.158294+0000, chain.objs.size()=1 2024-04-03T05:14:08.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.f4UmySCcTYCfchFJT4lRxUXyFCHgWh8_0 2024-04-03T05:14:08.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17278237472725058167', time=2024-04-03T06:32:30.524356+0000, chain.objs.size()=1 2024-04-03T05:14:08.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mg5y0oCcHs8kTDx7PBYaiyLsUWdDNux_0 2024-04-03T05:14:08.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15417349626342477878', time=2024-04-03T06:32:30.723524+0000, chain.objs.size()=1 2024-04-03T05:14:08.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DYaP-D_NhLM5bGwpBECnaWQDsP5LxzL_0 2024-04-03T05:14:08.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6850831096346392954', time=2024-04-03T06:32:31.696984+0000, chain.objs.size()=1 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.SMSvTPHMojGqGJCaEhqMA37H_xSs4O0_0 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8952470814006113002', time=2024-04-03T06:32:31.749336+0000, chain.objs.size()=1 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qV8-TV22d4IQXg5yRTT8w0PhoiobcQJ_0 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5544812473556024432', time=2024-04-03T06:32:31.933340+0000, chain.objs.size()=1 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BGJ9pnZPOd7AF7cBDt43U6YzLq_TUhD_0 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5547835524976400569', time=2024-04-03T06:32:33.184103+0000, chain.objs.size()=1 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.TCx_fyWE5RXopFNnHRZ-JI1M3V2sAB2_0 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2054405758728177360', time=2024-04-03T06:32:34.530793+0000, chain.objs.size()=1 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EVrwqY84p-46rPvjoGn8QqtkpPqjX1V_0 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12334632205848754824', time=2024-04-03T06:32:35.562657+0000, chain.objs.size()=1 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ugRRp94cKNULzp3M0Td_hZFn4faQnRk_0 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11884615684025897235', time=2024-04-03T06:32:37.413670+0000, chain.objs.size()=1 2024-04-03T05:14:08.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vtZZ4FA63_MRcAqIJEJfXjairrg5BTA_0 2024-04-03T05:14:08.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12576384681339532174', time=2024-04-03T06:32:37.495803+0000, chain.objs.size()=1 2024-04-03T05:14:08.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.NxCQjDx-gXuv9MwK5rGpcrCOoeLVRf0_0 2024-04-03T05:14:08.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.181+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2863766426204134647', time=2024-04-03T06:32:40.757416+0000, chain.objs.size()=1 2024-04-03T05:14:08.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.181+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.eRHaIZixGSgzhud6QwsOuKV66_4nEb6_0 2024-04-03T05:14:08.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1769779750960893704', time=2024-04-03T06:32:40.894738+0000, chain.objs.size()=1 2024-04-03T05:14:08.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.H8mpINYbG_wwyrNTv1R572cVmYJVnpA_0 2024-04-03T05:14:08.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.858238643231928120', time=2024-04-03T06:32:43.796807+0000, chain.objs.size()=1 2024-04-03T05:14:08.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xqoQqim9V-mTV_43lM38e4urNhKs-XR_0 2024-04-03T05:14:08.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1058157455558136213', time=2024-04-03T06:32:45.697741+0000, chain.objs.size()=1 2024-04-03T05:14:08.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._Stxt7GQCgfhZLjPXdzxN4bbwwzjEv3_0 2024-04-03T05:14:08.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3007113524570978601', time=2024-04-03T06:32:46.950672+0000, chain.objs.size()=1 2024-04-03T05:14:08.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.I1VTulxr5mRx7WAV_J3UxzZGgmFSyXX_0 2024-04-03T05:14:08.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16394799932473555168', time=2024-04-03T06:32:46.952314+0000, chain.objs.size()=1 2024-04-03T05:14:08.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.eEHirFLbgHhFTbd_8imvAdADLkRh8rE_0 2024-04-03T05:14:08.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16107987112109861252', time=2024-04-03T06:32:47.202348+0000, chain.objs.size()=1 2024-04-03T05:14:08.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.C3iMPs2qxX37F7yP52Duy-alz-hf4r3_0 2024-04-03T05:14:08.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9026080996278163242', time=2024-04-03T06:32:48.382592+0000, chain.objs.size()=1 2024-04-03T05:14:08.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GBJR0c994w5-eQ_rgKu7leFNDDWCvs-_0 2024-04-03T05:14:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16418237451768979064', time=2024-04-03T06:32:49.015786+0000, chain.objs.size()=1 2024-04-03T05:14:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vIY_Vk2aKfCwA_eUIzMvzPN9EfYvjwk_0 2024-04-03T05:14:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17432318278724240298', time=2024-04-03T06:32:49.220279+0000, chain.objs.size()=1 2024-04-03T05:14:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-CnvU0uSnWgE_LjwM4R--q11NrK4PHQ_0 2024-04-03T05:14:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4824854902106978550', time=2024-04-03T06:32:50.292727+0000, chain.objs.size()=1 2024-04-03T05:14:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XQ45PRQQ1OxtE1TvYNA-rCdQRa0vYPo_0 2024-04-03T05:14:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.959065498916823316', time=2024-04-03T06:34:28.634996+0000, chain.objs.size()=1 2024-04-03T05:14:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.tCt8yNplnEGoAzufPMPpK6hzEzR5DBm_0 2024-04-03T05:14:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.189+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12321669936063666002', time=2024-04-03T06:34:28.943756+0000, chain.objs.size()=1 2024-04-03T05:14:08.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.189+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.H9TZWl-GytykwwiJVPP-ZOC4PWjWV51_0 2024-04-03T05:14:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10178269114984682661', time=2024-04-03T06:34:29.465656+0000, chain.objs.size()=1 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ha7hvc5Vo1VmE5MtvPAUHP9-GsPlTxK_0 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3037924503852218577', time=2024-04-03T06:34:30.959083+0000, chain.objs.size()=1 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BqaxCF4iGJsakAuaw_jtmwZSluGyAay_0 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18345240042412046307', time=2024-04-03T06:34:32.590397+0000, chain.objs.size()=1 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zNLlLtQaRwR2T2mIgJQ4D5zv0thvUlq_0 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2115754546643017094', time=2024-04-03T06:34:32.841587+0000, chain.objs.size()=1 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IWX1I1GNXPs2bswhGnocPU57z-H0QxL_0 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12459234466402848483', time=2024-04-03T06:34:33.078135+0000, chain.objs.size()=1 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.n1EaGrMsxOPPMc3nFIn8IgmuPFZoAOi_0 2024-04-03T05:14:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11261147972984119238', time=2024-04-03T06:34:33.349574+0000, chain.objs.size()=1 2024-04-03T05:14:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XTWsK6wo3SPk3RekJ71fE9cCaZRH8dc_0 2024-04-03T05:14:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17019276225693153651', time=2024-04-03T06:34:35.167852+0000, chain.objs.size()=1 2024-04-03T05:14:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ycW5YT1qNJenjslvW031PG0W99TMXI7_0 2024-04-03T05:14:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5457621708873406286', time=2024-04-03T06:34:36.334811+0000, chain.objs.size()=1 2024-04-03T05:14:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.um4qY5kzjpgg_M2f--Go82EdR7S_zxM_0 2024-04-03T05:14:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15042869912528196215', time=2024-04-03T06:34:36.821418+0000, chain.objs.size()=1 2024-04-03T05:14:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VqXL3yFYtt7NNaGRQPGPeh4lAB38133_0 2024-04-03T05:14:08.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7715550135730701250', time=2024-04-03T06:34:38.356520+0000, chain.objs.size()=1 2024-04-03T05:14:08.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4g_mxUQtOjV569HZYg3j6hEtlVhIzXC_0 2024-04-03T05:14:08.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6032249308887234358', time=2024-04-03T06:34:38.520207+0000, chain.objs.size()=1 2024-04-03T05:14:08.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Qd_pTfLvmktf7GE5Zh0JPspfY18z9qU_0 2024-04-03T05:14:08.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4415057335710478228', time=2024-04-03T06:34:38.717333+0000, chain.objs.size()=1 2024-04-03T05:14:08.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LI4IfoMvE98EjMGS-hKqfmCtXVuWgEP_0 2024-04-03T05:14:08.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10147091112843488202', time=2024-04-03T06:34:38.720208+0000, chain.objs.size()=1 2024-04-03T05:14:08.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7VnFhYqG_Wz_wpfMZQRrJb2q1cUESt8_0 2024-04-03T05:14:08.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3521009221207611166', time=2024-04-03T06:34:38.939035+0000, chain.objs.size()=1 2024-04-03T05:14:08.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rrEgIIiGzcYUAettZr09Cwx_zV8ykQC_0 2024-04-03T05:14:08.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5053784922977176902', time=2024-04-03T06:34:39.021386+0000, chain.objs.size()=1 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3ha557k1vVOcqrPrYR7pSnAAmE697dB_0 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6362141628295881810', time=2024-04-03T06:34:39.097032+0000, chain.objs.size()=1 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ebo-4cVI3kEsMgvl-Hfb362m85Iwq2G_0 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15982966819117553001', time=2024-04-03T06:34:40.438201+0000, chain.objs.size()=1 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Eh1WtgyoBspsP2LGYyinFZVCwVEjpZQ_0 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10280248759650300940', time=2024-04-03T06:34:40.484178+0000, chain.objs.size()=1 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.t6c1vqX6c8-u2nOB4klGMxDmAyM8-H8_0 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3559881745389864276', time=2024-04-03T06:34:41.170412+0000, chain.objs.size()=1 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Z3GtBQJ-tpyj6zBeJyon_2-2qtxVZck_0 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8306904225928872236', time=2024-04-03T06:34:41.504753+0000, chain.objs.size()=1 2024-04-03T05:14:08.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.iH9U7yrmPdCIfRjz5_KBA8_8KY-4207_0 2024-04-03T05:14:08.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/45167 2024-04-03T05:14:08.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-04-03T05:14:08.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11238350254203707144', time=2024-04-03T06:34:42.582783+0000, chain.objs.size()=1 2024-04-03T05:14:08.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8M6azU5TSkna9yBuPL-l0QuNiXVuehA_0 2024-04-03T05:14:08.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3976520966907483404', time=2024-04-03T06:34:44.836412+0000, chain.objs.size()=1 2024-04-03T05:14:08.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ehe6TYBuQdC2cFzGU42j8TCo7HrYG1C_0 2024-04-03T05:14:08.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10307884977341662594', time=2024-04-03T06:34:45.346501+0000, chain.objs.size()=1 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.69zSiLYBPwd24h_jrw6ff5eU-9bix7B_0 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17806234535664631115', time=2024-04-03T06:34:45.348237+0000, chain.objs.size()=1 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dD2blLnC6o5UYgGeI4MDy7sMVWzOrmq_0 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11119206465203875492', time=2024-04-03T06:34:47.920308+0000, chain.objs.size()=1 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GUzK-gUo46EkHtlMLD_ouI7Y7FTW50N_0 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2609629564710202575', time=2024-04-03T06:34:48.031843+0000, chain.objs.size()=1 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.HnMj4rsCAOV23McOK9_j7Ea5J7-sWUf_0 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8200634049305427754', time=2024-04-03T06:34:48.738117+0000, chain.objs.size()=1 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.uuzVs4zak9WjYA9uYOcYpyDAOJMpmeR_0 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17566928705292607466', time=2024-04-03T06:34:50.081691+0000, chain.objs.size()=1 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.K4V9pSoEwqlFGzoUzK3vUxk2HQepTgO_0 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5217742197377835058', time=2024-04-03T06:34:50.126766+0000, chain.objs.size()=1 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2jWLG3xIX1-fKck9qoj7v8pMPX6E5uf_0 2024-04-03T05:14:08.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15266267662991048409', time=2024-04-03T06:34:50.936541+0000, chain.objs.size()=1 2024-04-03T05:14:08.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0LQ89WYOYZgLwy_5DvbXFC5Jgd8zpQN_0 2024-04-03T05:14:08.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1776496219690605329', time=2024-04-03T06:34:52.097485+0000, chain.objs.size()=1 2024-04-03T05:14:08.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Lx8vjwtW_NS2q0NKE9XDVUT77RShMbp_0 2024-04-03T05:14:08.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13186275535884045026', time=2024-04-03T06:34:52.179710+0000, chain.objs.size()=1 2024-04-03T05:14:08.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.n017hJaWsUR_DPQKIwqV0umzqSaQvYU_0 2024-04-03T05:14:08.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8649581987787808037', time=2024-04-03T06:34:52.845295+0000, chain.objs.size()=1 2024-04-03T05:14:08.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CJwfCuR1p8I-Qt1gFEXe4XqQomQHjYK_0 2024-04-03T05:14:08.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4513548941420117739', time=2024-04-03T06:34:53.511308+0000, chain.objs.size()=1 2024-04-03T05:14:08.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hxIDsgii02GWzIvRK22yryw3jDmCjKI_0 2024-04-03T05:14:08.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9083920817845109723', time=2024-04-03T06:34:53.599274+0000, chain.objs.size()=1 2024-04-03T05:14:08.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0qbfsUKX4TnJZhikPfNNetEDI7HCdtF_0 2024-04-03T05:14:08.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13472589725970039613', time=2024-04-03T06:34:55.576995+0000, chain.objs.size()=1 2024-04-03T05:14:08.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.S1KkiTh5C8vlIxK_pZKEVyvMqoWnfQV_0 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3513060798040460260', time=2024-04-03T06:36:19.710913+0000, chain.objs.size()=1 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.338__shadow_.r8d5KV6Vr1z179jK5W55FSfoNY-y0bd_0 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2321439361178375412', time=2024-04-03T06:36:50.261334+0000, chain.objs.size()=1 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.353__shadow_.jKVhTeBkfiCwu3GQtBBlb69cI1QKII7_0 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8752867815244057154', time=2024-04-03T06:37:41.537336+0000, chain.objs.size()=1 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.379__shadow_.i-2-ZouDi5EpTkRzdmPe1Du9ZsU1u3Q_0 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13813589357959868170', time=2024-04-03T06:40:34.259497+0000, chain.objs.size()=1 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.459__shadow_.EQ0L5Bh4nL-361coUseaM5cOg9oJBlr_0 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6581532709853303506', time=2024-04-03T06:42:03.591650+0000, chain.objs.size()=1 2024-04-03T05:14:08.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.486__multipart_mymultipartcopy.2~BLPjO6HL_uQmXTW0lQGT9Iv5UP1vwNz.1 2024-04-03T05:14:08.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4496214218977422123', time=2024-04-03T06:42:20.265827+0000, chain.objs.size()=1 2024-04-03T05:14:08.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.488__multipart_mymultipart.2~ZIkXOM7NRxza8Ujb7vSbsULncKK5Lt3.1 2024-04-03T05:14:08.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4618340295544047873', time=2024-04-03T06:50:44.649877+0000, chain.objs.size()=1 2024-04-03T05:14:08.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.519__shadow_.7MZYWh-NzaF5Wbb2WDsfhWnnwcU_3DS_0 2024-04-03T05:14:08.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16614967616767362931', time=2024-04-03T06:53:07.986112+0000, chain.objs.size()=1 2024-04-03T05:14:08.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.541__shadow:759qc.Ont-AKzSUOQZ5XfBD59LOLMgc_.Lw4lQfDZhzzBD7cE1lvThc7eOiQ2s8e_0 2024-04-03T05:14:08.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12710120596330876905', time=2024-04-03T06:53:14.923676+0000, chain.objs.size()=1 2024-04-03T05:14:08.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow_.uv60U-C6oGxXg-QcA6VLP3kfewmFin9_0 2024-04-03T05:14:08.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13823610881426959339', time=2024-04-03T06:53:16.085257+0000, chain.objs.size()=1 2024-04-03T05:14:08.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow:0TdqVRxME8bs.N62iZzOxWEVnvn5XKU_.uck6APhk38qCtWlJJm9quBfV9JwG0z__0 2024-04-03T05:14:08.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1606821674161059618', time=2024-04-03T06:54:03.028098+0000, chain.objs.size()=1 2024-04-03T05:14:08.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:EFnL0qBcbkgdJrFcwhFpO6JglFYFWyt_.kKwJ3J-kdmK8jOO-hGFGlCCiIeRRbB5_0 2024-04-03T05:14:08.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.233+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17487586674658611513', time=2024-04-03T06:55:29.129617+0000, chain.objs.size()=1 2024-04-03T05:14:08.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.233+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:E805VAtBd6H9pogkcGWg0Ox9sR19zt4_.0O0CQJKG3ukovqFPK5FwlFnQY-v3Pny_0 2024-04-03T05:14:08.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.233+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7022066664250309301', time=2024-04-03T06:55:48.840690+0000, chain.objs.size()=1 2024-04-03T05:14:08.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.233+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.556__shadow:.VjE79gfQOWAQgxTLoMmRDpq7ktc19c_.w164VMWYa18Q8xoyvWryu2XmhEyKVdX_0 2024-04-03T05:14:08.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.233+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15949511450728329825', time=2024-04-03T06:56:17.538588+0000, chain.objs.size()=1 2024-04-03T05:14:08.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.233+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.572__shadow_.btyTx2YVE5bQKotIC8D4RZQ0WiQ37ca_0 2024-04-03T05:14:08.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.233+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5273595445733110358', time=2024-04-03T06:56:24.224301+0000, chain.objs.size()=1 2024-04-03T05:14:08.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.233+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.575__shadow_.b0hoeAcqhV0izEGl43bFkITEpa_r4lN_0 2024-04-03T05:14:08.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16400676125078466082', time=2024-04-03T07:04:52.545839+0000, chain.objs.size()=1 2024-04-03T05:14:08.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.668__shadow:gGZhq2hdip0Ap4GCLgQYlB3OgHpSqqY_.pOhj99icgRO_jEsMSrGJl-c-yr0WICq_0 2024-04-03T05:14:08.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10917298062427859753', time=2024-04-03T07:05:00.599350+0000, chain.objs.size()=1 2024-04-03T05:14:08.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.672__shadow:Nx0con7i9HrZnYYefLjeqy864UKkrSW_.zi54wXK3irIRcksrG7ZgrCXHDTOvEGR_0 2024-04-03T05:14:08.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18280062557544317997', time=2024-04-03T07:13:54.439393+0000, chain.objs.size()=1 2024-04-03T05:14:08.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.739__shadow_.CxYbv-rVZzAx_VJgkV4XT0zFkkCfRIV_0 2024-04-03T05:14:08.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.245+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:08.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-03T05:14:08.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:08.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:08.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51340' 2024-04-03T05:14:08.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.421134315778596299', time=2024-04-03T06:21:50.461720+0000, chain.objs.size()=3 2024-04-03T05:14:08.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_._gG6svK2Rc2N2PLXaUNtYkRnDJQtp_C_0 2024-04-03T05:14:08.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_._gG6svK2Rc2N2PLXaUNtYkRnDJQtp_C_1 2024-04-03T05:14:08.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_._gG6svK2Rc2N2PLXaUNtYkRnDJQtp_C_2 2024-04-03T05:14:08.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8166353186037021866', time=2024-04-03T06:23:06.326107+0000, chain.objs.size()=1 2024-04-03T05:14:08.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.155__shadow_.rlylvuJgbz68qAtghaPWmJ_wsyv_X-q_0 2024-04-03T05:14:08.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8754626349677608365', time=2024-04-03T06:24:31.230803+0000, chain.objs.size()=1 2024-04-03T05:14:08.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.186__shadow_.gsb9opZaOl69rsCvZ0ZpQ0G9KCW-UPr_0 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5155631684609764447', time=2024-04-03T06:25:06.129823+0000, chain.objs.size()=1 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.200__shadow_.DbBbgufrMBQF-0RBNQENAeDgUvAUPRM_0 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7274373810260658218', time=2024-04-03T06:25:24.427385+0000, chain.objs.size()=1 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.207__shadow_.9F1OvkKuogOyEF-EJAAtBeHjt7NlAGe_0 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11284869144876877639', time=2024-04-03T06:25:53.103420+0000, chain.objs.size()=1 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.219__shadow_.ytVgAuR3NmYLYoeNcFaI8E-rXjArh2m_0 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4857401710299496974', time=2024-04-03T06:25:53.125288+0000, chain.objs.size()=1 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.219__shadow_.tEchuBu5rHETaq6xxUgrTlHuEXtOyGb_0 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11280463721644815936', time=2024-04-03T06:25:57.447192+0000, chain.objs.size()=1 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.221__shadow_.cLhEuEVQAh5-UW8kpmy7ePiR3QsjhRZ_0 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16839744148421143275', time=2024-04-03T06:26:04.097907+0000, chain.objs.size()=1 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.224__shadow_.osIISbFBWIfYrf2atf-sY_VwpStGKZq_0 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12089963289450106875', time=2024-04-03T06:26:08.381365+0000, chain.objs.size()=1 2024-04-03T05:14:08.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.226__shadow_.NOPEM0WNEhFv13AKSzIfKRRbLMeAPDD_0 2024-04-03T05:14:08.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12831225132701931960', time=2024-04-03T06:27:52.263375+0000, chain.objs.size()=1 2024-04-03T05:14:08.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ib5g3T7MRz6dl2p0-fRa8JaEQH1JsN7_0 2024-04-03T05:14:08.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7231665504521538891', time=2024-04-03T06:27:52.760812+0000, chain.objs.size()=1 2024-04-03T05:14:08.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Us7JgEQwc08TBNxTB4QqXLggk5gsuhi_0 2024-04-03T05:14:08.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16793575794246932776', time=2024-04-03T06:27:53.162664+0000, chain.objs.size()=1 2024-04-03T05:14:08.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TtcGD-QDPivN0W9auBw8lsRKuSMFXFV_0 2024-04-03T05:14:08.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6066243188785086332', time=2024-04-03T06:27:53.428354+0000, chain.objs.size()=1 2024-04-03T05:14:08.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.692084jngS5D7j2GzGfKtpGEFo6vjYD_0 2024-04-03T05:14:08.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15962296577496051583', time=2024-04-03T06:27:57.050123+0000, chain.objs.size()=1 2024-04-03T05:14:08.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Irfg0IZJomWC8H03IY1j0Upy512utrv_0 2024-04-03T05:14:08.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.296806160034839913', time=2024-04-03T06:27:57.843095+0000, chain.objs.size()=1 2024-04-03T05:14:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LHHLGM2SsoKC7RWV9i_45ZJyoWv08aJ_0 2024-04-03T05:14:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13487785200803841660', time=2024-04-03T06:28:02.714394+0000, chain.objs.size()=1 2024-04-03T05:14:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rNRAi41XnnLCb3Y1Wig14bnoP5WeTRg_0 2024-04-03T05:14:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10408361635832652562', time=2024-04-03T06:28:02.729615+0000, chain.objs.size()=1 2024-04-03T05:14:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tzfGk-1hOuZ7JvXE-PHXuEU7WGQ29Er_0 2024-04-03T05:14:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2485925983703229415', time=2024-04-03T06:28:08.425725+0000, chain.objs.size()=1 2024-04-03T05:14:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DeH1RYBDWiNXdOrZpQFnDdNtl6Rzew3_0 2024-04-03T05:14:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4762251520804907203', time=2024-04-03T06:28:08.553707+0000, chain.objs.size()=1 2024-04-03T05:14:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GKy9B005K94mRHPulMV85dHY5BeZDRv_0 2024-04-03T05:14:08.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15178819784521693932', time=2024-04-03T06:28:09.791223+0000, chain.objs.size()=1 2024-04-03T05:14:08.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1V3q338DTg9yulsq29JwQUQ09w5ApzR_0 2024-04-03T05:14:08.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5381074811141691868', time=2024-04-03T06:28:10.729856+0000, chain.objs.size()=1 2024-04-03T05:14:08.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yQuStD6U92PVdE3FMelB6aio5JclWLz_0 2024-04-03T05:14:08.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11837293071980636995', time=2024-04-03T06:28:11.591046+0000, chain.objs.size()=1 2024-04-03T05:14:08.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.YQSr7X19V_7OW2LtpK8U_iq05E9gIk1_0 2024-04-03T05:14:08.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3576331820053399295', time=2024-04-03T06:28:11.890079+0000, chain.objs.size()=1 2024-04-03T05:14:08.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ctwy6-rqrb2fU2FVOHKCEmKKla1flDW_0 2024-04-03T05:14:08.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2651562124565650194', time=2024-04-03T06:28:12.659930+0000, chain.objs.size()=1 2024-04-03T05:14:08.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.utEcK8X2-kMHeM3BoOhcvSeSFBqu3At_0 2024-04-03T05:14:08.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7475374127437569318', time=2024-04-03T06:28:12.749098+0000, chain.objs.size()=1 2024-04-03T05:14:08.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qce8GTkSzebVTOSyUCSG4KCgyWO1a3J_0 2024-04-03T05:14:08.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5788947849909609084', time=2024-04-03T06:28:13.334057+0000, chain.objs.size()=1 2024-04-03T05:14:08.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.h5gNSlRTa8ssKfDNda7thUk8sRaDQfi_0 2024-04-03T05:14:08.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10805211855424695152', time=2024-04-03T06:28:16.385358+0000, chain.objs.size()=1 2024-04-03T05:14:08.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qQ6pFwcjSag20r2QKkW73hnrZCKnDL8_0 2024-04-03T05:14:08.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14361830488908544234', time=2024-04-03T06:28:16.482061+0000, chain.objs.size()=1 2024-04-03T05:14:08.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Iu63MPR47CVWhWjykO78EUM5YD0IQax_0 2024-04-03T05:14:08.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9435860888745952180', time=2024-04-03T06:28:16.655784+0000, chain.objs.size()=1 2024-04-03T05:14:08.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cjAqTAe_CgIq6dCXSzwmQhY7BtuTjsE_0 2024-04-03T05:14:08.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11520529505182196737', time=2024-04-03T06:28:17.078439+0000, chain.objs.size()=1 2024-04-03T05:14:08.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TKJUC8T3CTzY9Fi0n692vF4ciHiBOnq_0 2024-04-03T05:14:08.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8687619795723950059', time=2024-04-03T06:28:19.542604+0000, chain.objs.size()=1 2024-04-03T05:14:08.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4zrr0OiwoOEJ7y4FHBA-1OdOVm80r3k_0 2024-04-03T05:14:08.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4387834612788873977', time=2024-04-03T06:28:19.748763+0000, chain.objs.size()=1 2024-04-03T05:14:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UNz8DbwCqQ8KwMeCfYCFscIr6ttUPVk_0 2024-04-03T05:14:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18022846957795763045', time=2024-04-03T06:28:19.841101+0000, chain.objs.size()=1 2024-04-03T05:14:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.v6olHKUVIaHhtQPOPA89njpNXbRZlkq_0 2024-04-03T05:14:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4144668218704739685', time=2024-04-03T06:29:01.739172+0000, chain.objs.size()=1 2024-04-03T05:14:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.250__shadow_.VcQ0AubZbqoOdHuDK5gy-DLUbI3YZCE_0 2024-04-03T05:14:08.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3749113367091029819', time=2024-04-03T06:29:03.914510+0000, chain.objs.size()=1 2024-04-03T05:14:08.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.251__shadow_.2LvduTt2tD8IrrHiPueC8VlXz-9ZolL_0 2024-04-03T05:14:08.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.988298228575041884', time=2024-04-03T06:29:06.462305+0000, chain.objs.size()=1 2024-04-03T05:14:08.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.252__shadow_.rxppMj6cZVjw-ldulo0iFclGZ-dPynV_0 2024-04-03T05:14:08.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11972084045354589232', time=2024-04-03T06:29:08.922568+0000, chain.objs.size()=1 2024-04-03T05:14:08.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.253__shadow_.P0hRlC-if7VonbGkxiwZnZ1Yb7k9gIt_0 2024-04-03T05:14:08.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12128755119155338057', time=2024-04-03T06:29:30.907216+0000, chain.objs.size()=1 2024-04-03T05:14:08.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.6qFMuquaAH5ApfgHk2XqdnhLnuexS3l_0 2024-04-03T05:14:08.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15465815623464011126', time=2024-04-03T06:29:30.950248+0000, chain.objs.size()=1 2024-04-03T05:14:08.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.1E4yOiq7t2eAbSLBfsUt3QcqsIIkiE5_0 2024-04-03T05:14:08.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13718154970402812026', time=2024-04-03T06:30:08.964034+0000, chain.objs.size()=1 2024-04-03T05:14:08.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.276__shadow:A8Sw60zUGhPxYs1.c3ss7a6T03.5abm_.BBx4Ira1OG3Zcrv_a9azZFdC_sokCL4_0 2024-04-03T05:14:08.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8235103267691082625', time=2024-04-03T06:30:41.383016+0000, chain.objs.size()=1 2024-04-03T05:14:08.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.288__shadow:87NIeXKwkWifuPO05T8IEo3Op93-Dzm_.XkGPpbKNSsKwNljlbDKkhYy6GEOkwZM_0 2024-04-03T05:14:08.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9571333489501239300', time=2024-04-03T06:32:24.316056+0000, chain.objs.size()=1 2024-04-03T05:14:08.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pMSTbwmvcSEkUZcM85mWO2pxLJrIleN_0 2024-04-03T05:14:08.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18041740808517429751', time=2024-04-03T06:32:26.280750+0000, chain.objs.size()=1 2024-04-03T05:14:08.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dhL8_J0-ET8s96Q7l4rBF3xmmv3d6zs_0 2024-04-03T05:14:08.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17851180266290870618', time=2024-04-03T06:32:27.102912+0000, chain.objs.size()=1 2024-04-03T05:14:08.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vI2yppNPBmldOZPRADQBxSnkKvUkLS6_0 2024-04-03T05:14:08.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16629789596174861959', time=2024-04-03T06:32:28.092566+0000, chain.objs.size()=1 2024-04-03T05:14:08.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MQ5ke3zDS0SFNO_Pwwzjj4A5J-rMoUp_0 2024-04-03T05:14:08.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16836423096952889334', time=2024-04-03T06:32:28.457829+0000, chain.objs.size()=1 2024-04-03T05:14:08.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ye_FMsMAy26RkM2L3B8dh9T6Hovmjmw_0 2024-04-03T05:14:08.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8924444444874934861', time=2024-04-03T06:32:30.164558+0000, chain.objs.size()=1 2024-04-03T05:14:08.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.KC2KXfgoigaI5HRchYLha7vksHKv3wr_0 2024-04-03T05:14:08.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1997723667540513121', time=2024-04-03T06:32:31.921488+0000, chain.objs.size()=1 2024-04-03T05:14:08.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.f74kPIiGgRCejMIogQDEJe6UGvGruWl_0 2024-04-03T05:14:08.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15740185005857093726', time=2024-04-03T06:32:32.372993+0000, chain.objs.size()=1 2024-04-03T05:14:08.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4U1osBEsfs28zEeqlXx1NqTOW2jRsoI_0 2024-04-03T05:14:08.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7292097142237861873', time=2024-04-03T06:32:33.151454+0000, chain.objs.size()=1 2024-04-03T05:14:08.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.QV-FK13c7bRJ0hUe5jWFKt2WERSt3dy_0 2024-04-03T05:14:08.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16645112866613138389', time=2024-04-03T06:32:33.617471+0000, chain.objs.size()=1 2024-04-03T05:14:08.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.WyIvfN-CvrZyMElbH57uBhm_V1B0Vs2_0 2024-04-03T05:14:08.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1340418964393994324', time=2024-04-03T06:32:35.585064+0000, chain.objs.size()=1 2024-04-03T05:14:08.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.281+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.A95E4ac_hXuEzrAlCWmrJhagKTWXMaJ_0 2024-04-03T05:14:08.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4116026794706286467', time=2024-04-03T06:32:36.353620+0000, chain.objs.size()=1 2024-04-03T05:14:08.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xAzxByjxwbIcyagJJdgqYTInOKSpuKT_0 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4482507649157778066', time=2024-04-03T06:32:36.504975+0000, chain.objs.size()=1 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pve5PfqZGFWWxlO7fmys2z39PCZRpgX_0 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14211258526849746341', time=2024-04-03T06:32:36.507048+0000, chain.objs.size()=1 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zXefOIycX1UUtmJnCm-Cy0yK4HaUEC4_0 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.405095921246935898', time=2024-04-03T06:32:36.831448+0000, chain.objs.size()=1 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.JDrHF9rqJBRd0I16KTCvHZPBorvYO0Y_0 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1925965747359302083', time=2024-04-03T06:32:38.442951+0000, chain.objs.size()=1 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mGbdXdkkE-VA5V6AYdFCP06yOtItEeQ_0 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14021756820459091541', time=2024-04-03T06:32:39.279802+0000, chain.objs.size()=1 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RsK3TglZcZSU3ah6VXhktQ5NF-twdEa_0 2024-04-03T05:14:08.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8745636167598138576', time=2024-04-03T06:32:39.445328+0000, chain.objs.size()=1 2024-04-03T05:14:08.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2hykF2vv8Gs2dT42Eo917Dqn0qDWc8P_0 2024-04-03T05:14:08.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15004804812008813822', time=2024-04-03T06:32:40.037215+0000, chain.objs.size()=1 2024-04-03T05:14:08.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Jh4p6LmeWntHdyIH1vtGcRMxbyv7vMd_0 2024-04-03T05:14:08.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16470258275110579380', time=2024-04-03T06:32:40.145753+0000, chain.objs.size()=1 2024-04-03T05:14:08.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.08IT2nJ1vuKOz_TnPQoGDjPDWkZ0GEB_0 2024-04-03T05:14:08.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2982443464570491755', time=2024-04-03T06:32:41.201527+0000, chain.objs.size()=1 2024-04-03T05:14:08.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.R2CjFFHCRBNcn89l5uX3d1uVy7aMsIa_0 2024-04-03T05:14:08.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7532757592273216969', time=2024-04-03T06:32:42.977464+0000, chain.objs.size()=1 2024-04-03T05:14:08.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.J-KOWS7zvqLs9dgxQCIwxmUcSKYVEoX_0 2024-04-03T05:14:08.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.493+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10358370885471899395', time=2024-04-03T06:32:44.033803+0000, chain.objs.size()=1 2024-04-03T05:14:08.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.493+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cj3BgJuPxPjvJeqUFM_ycFGOuZsWgsz_0 2024-04-03T05:14:08.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13859366029526456000', time=2024-04-03T06:32:44.716164+0000, chain.objs.size()=1 2024-04-03T05:14:08.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ukKy1w96M_SKe3JYvP3pngec6yl1ZYZ_0 2024-04-03T05:14:08.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16472567044257749122', time=2024-04-03T06:32:46.502726+0000, chain.objs.size()=1 2024-04-03T05:14:08.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dzx-8akAJmi_42T3nj-4tGkYAu7PlDk_0 2024-04-03T05:14:08.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8947631484012504937', time=2024-04-03T06:32:46.505024+0000, chain.objs.size()=1 2024-04-03T05:14:08.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1X50j9_ebWNOFCJMaf_rsmtkTS2hsfE_0 2024-04-03T05:14:08.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6680166267490403576', time=2024-04-03T06:32:48.748469+0000, chain.objs.size()=1 2024-04-03T05:14:08.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mK99pNVL-eO1ZnEL_VIhfrX_UHZxDfN_0 2024-04-03T05:14:08.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9715548710631241210', time=2024-04-03T06:32:49.090284+0000, chain.objs.size()=1 2024-04-03T05:14:08.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CT2fRi0ZGK79yCoXF_3SPYupY6wx2yD_0 2024-04-03T05:14:08.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.91784953204515355', time=2024-04-03T06:32:52.207755+0000, chain.objs.size()=1 2024-04-03T05:14:08.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gAB88a742r0q3h3EQecCjiot9twMc33_0 2024-04-03T05:14:08.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9211518590273770247', time=2024-04-03T06:34:28.477397+0000, chain.objs.size()=1 2024-04-03T05:14:08.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.n9hlyWD9zrwOA8vbLi20gTdJm6kWzFI_0 2024-04-03T05:14:08.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.501+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5923429963325892696', time=2024-04-03T06:34:28.662059+0000, chain.objs.size()=1 2024-04-03T05:14:08.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.501+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7vkd4FxwMEVP0ooTF_iNZH_cl8xGxVu_0 2024-04-03T05:14:08.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.501+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17911745010380288252', time=2024-04-03T06:34:28.859711+0000, chain.objs.size()=1 2024-04-03T05:14:08.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.501+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BkyoFune82s6MS8O1L3j5wXYA8m2eDn_0 2024-04-03T05:14:08.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.501+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18409026256226195013', time=2024-04-03T06:34:29.362432+0000, chain.objs.size()=1 2024-04-03T05:14:08.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.501+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1N5JAX7iqIb-9Toq5EWa8pOAg0ULad5_0 2024-04-03T05:14:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.505+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6818814357838222585', time=2024-04-03T06:34:31.369459+0000, chain.objs.size()=1 2024-04-03T05:14:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.505+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.07_3v7F2kKdN4izgi9LnVRM9FE8SMCT_0 2024-04-03T05:14:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.505+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7477855564211162072', time=2024-04-03T06:34:33.290996+0000, chain.objs.size()=1 2024-04-03T05:14:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.505+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.mmevpAb45ZmHl1U8FogY-xrV0IxqUp2_0 2024-04-03T05:14:08.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2931206347896742418', time=2024-04-03T06:34:33.807785+0000, chain.objs.size()=1 2024-04-03T05:14:08.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.v3_87bepMsc04vUON45B-3bi8v6cSun_0 2024-04-03T05:14:08.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3599754504415693867', time=2024-04-03T06:34:35.273663+0000, chain.objs.size()=1 2024-04-03T05:14:08.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fNm5-97LncX6d_7ayIk3Fwv9eEFSIsv_0 2024-04-03T05:14:08.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6558350249186716032', time=2024-04-03T06:34:37.531661+0000, chain.objs.size()=1 2024-04-03T05:14:08.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ZKfISnwd7OH9K0HuxmrFW4StXHS_MCV_0 2024-04-03T05:14:08.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1887337969508676477', time=2024-04-03T06:34:38.080724+0000, chain.objs.size()=1 2024-04-03T05:14:08.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.98HbTWChi_ANGfIbMNAUxwYpH3F90dH_0 2024-04-03T05:14:08.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13345538451604175788', time=2024-04-03T06:34:38.449705+0000, chain.objs.size()=1 2024-04-03T05:14:08.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IyzKtg2PgXgeLYnKrom1B-mu6CjKPQb_0 2024-04-03T05:14:08.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3677832958668063308', time=2024-04-03T06:34:38.652416+0000, chain.objs.size()=1 2024-04-03T05:14:08.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.J5gRcEiK87z9ATpT5P3irlHoVxZT0Ro_0 2024-04-03T05:14:08.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9265078875085226692', time=2024-04-03T06:34:40.965044+0000, chain.objs.size()=1 2024-04-03T05:14:08.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.RACCd3Id9LZUVChbKIrxv3eCTdFkZOF_0 2024-04-03T05:14:08.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3166189444541647129', time=2024-04-03T06:34:41.491678+0000, chain.objs.size()=1 2024-04-03T05:14:08.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.PAH_RYbvr2E93snCMg6f34sigD1knOM_0 2024-04-03T05:14:08.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6197283419472610699', time=2024-04-03T06:34:41.915727+0000, chain.objs.size()=1 2024-04-03T05:14:08.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Gcjb5Zx1e6pZIfV16gm6f1W47Enov1v_0 2024-04-03T05:14:08.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12473740101813600181', time=2024-04-03T06:34:41.972468+0000, chain.objs.size()=1 2024-04-03T05:14:08.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.bFUS46LRhVuraY6bo6r1LTCfzS-R4FP_0 2024-04-03T05:14:08.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17368699000857822353', time=2024-04-03T06:34:42.402003+0000, chain.objs.size()=1 2024-04-03T05:14:08.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yAgQIoe1JnjsbwXzZdREYhyHMSH4xd__0 2024-04-03T05:14:08.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5766135549601121120', time=2024-04-03T06:34:42.725066+0000, chain.objs.size()=1 2024-04-03T05:14:08.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CDtqJ8RBDAIK3hy3DFGhfo03RQmGG15_0 2024-04-03T05:14:08.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8526502285727488137', time=2024-04-03T06:34:43.782771+0000, chain.objs.size()=1 2024-04-03T05:14:08.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JsIjc2T0dsIWTycq-InQvOapDQbMZhK_0 2024-04-03T05:14:08.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4496060049919884447', time=2024-04-03T06:34:45.371344+0000, chain.objs.size()=1 2024-04-03T05:14:08.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.L_zLTGO5AZZC-8HC7dNDSBG8XP9uPDa_0 2024-04-03T05:14:08.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13908549081344280466', time=2024-04-03T06:34:46.134249+0000, chain.objs.size()=1 2024-04-03T05:14:08.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._jm9otlpK2oYF8Ngvjy9Bt6QG1gK0WT_0 2024-04-03T05:14:08.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1665891216764991066', time=2024-04-03T06:34:48.010755+0000, chain.objs.size()=1 2024-04-03T05:14:08.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GPtg4JBNXQ_mpX6c1mkSaQW72-FcFG2_0 2024-04-03T05:14:08.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.192761835418557584', time=2024-04-03T06:34:48.012541+0000, chain.objs.size()=1 2024-04-03T05:14:08.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vHoklRc48GUIljZ99-wLu4mw7lbvXdW_0 2024-04-03T05:14:08.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9208926799894399182', time=2024-04-03T06:34:48.398442+0000, chain.objs.size()=1 2024-04-03T05:14:08.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zXTaErBHOoQMwqupeHyjffA42hekijc_0 2024-04-03T05:14:08.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4837504347648562509', time=2024-04-03T06:34:48.400464+0000, chain.objs.size()=1 2024-04-03T05:14:08.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KpirMgd76rqHFLz_n-S6dDoGJLxbs2t_0 2024-04-03T05:14:08.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3711625896948511266', time=2024-04-03T06:34:48.778007+0000, chain.objs.size()=1 2024-04-03T05:14:08.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.P0BHIkebDRysnO3pDFnP80a-5fUhKST_0 2024-04-03T05:14:08.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13995012586408437932', time=2024-04-03T06:34:49.449488+0000, chain.objs.size()=1 2024-04-03T05:14:08.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6fTmD2xSM85FH2EMea-nBPgU_SQgQHB_0 2024-04-03T05:14:08.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15528603668330052749', time=2024-04-03T06:34:49.451704+0000, chain.objs.size()=1 2024-04-03T05:14:08.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.o2aEodsyWVk9UzKGrIE36ZEeFXGmqZx_0 2024-04-03T05:14:08.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.533+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17149149326391912995', time=2024-04-03T06:34:49.775844+0000, chain.objs.size()=1 2024-04-03T05:14:08.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.533+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1y88YqL2J22GALcZqpzPlWsW8dgsMxR_0 2024-04-03T05:14:08.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/51340 2024-04-03T05:14:08.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12453935693719790627', time=2024-04-03T06:34:50.135445+0000, chain.objs.size()=1 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.jb_Ue4oagP9IMjWP1vvdHeLSQvQkgV3_0 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6209106403759808096', time=2024-04-03T06:34:52.448827+0000, chain.objs.size()=1 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IyJavS2yZQJI5bYrz1-RW0EF8Mgzwyv_0 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12868913222336769773', time=2024-04-03T06:34:52.450989+0000, chain.objs.size()=1 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3yor7D4nn2RcN4mNclXfYxcIH_PZkTo_0 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15571316737225176830', time=2024-04-03T06:34:53.014207+0000, chain.objs.size()=1 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.osczjoNgZO5W2cNN7QCCStstynqvXzz_0 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8067341146477566911', time=2024-04-03T06:34:53.186421+0000, chain.objs.size()=1 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.UY2BQQxkdZBR3nHVSoMHhx90I4XWM7F_0 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8897027587912362604', time=2024-04-03T06:34:54.960853+0000, chain.objs.size()=1 2024-04-03T05:14:08.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.n-HovNqiyKiPTyYgUUxCbrM03sLGeb1_0 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14131613818911869144', time=2024-04-03T06:34:55.884749+0000, chain.objs.size()=1 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.beNKpmu4HuhLGG-GQdcoYOMmIZm1rK5_0 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7444218248846041665', time=2024-04-03T06:34:56.641944+0000, chain.objs.size()=1 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DekL4ohVzKuwXoOe-EYZno5p91V2a_s_0 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16659913583618652264', time=2024-04-03T06:36:23.438026+0000, chain.objs.size()=1 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.340__shadow_.3vgtdvslO1O9P3g2EmOXAwpmYfnexjA_0 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18260106510148504401', time=2024-04-03T06:39:42.709927+0000, chain.objs.size()=1 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.434__shadow_.DneeG4meuunhL7kNEuOzlbTRamNKzVq_0 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16485675148651117527', time=2024-04-03T06:39:45.588436+0000, chain.objs.size()=1 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.435__shadow_.Dcffyv6_RJQ7fJkxMhDN8z5Maco6rHu_0 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.542789460528348707', time=2024-04-03T06:40:53.719866+0000, chain.objs.size()=1 2024-04-03T05:14:08.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.469__shadow_.dQ1DlPyktVaUcDTm53ZOpxOfGzuUxWV_0 2024-04-03T05:14:08.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15513319183897457952', time=2024-04-03T06:52:41.714545+0000, chain.objs.size()=1 2024-04-03T05:14:08.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:TurI4p5iIdTVodPLGAl.R3yDWUokVGs_.8-bcvq28-BQgGDoklAiDr961HVpRQPi_0 2024-04-03T05:14:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18255554801333084791', time=2024-04-03T06:53:11.317448+0000, chain.objs.size()=1 2024-04-03T05:14:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.542__shadow_.kkWXCKcn-_oQILNUYXZYrpdHT5MtbOE_0 2024-04-03T05:14:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.847054574689555889', time=2024-04-03T06:53:59.361065+0000, chain.objs.size()=1 2024-04-03T05:14:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:dj3WQc3SiyBeicARq57d3jJxF08J7S9_.XuUwOQDxDZjcBBBvvnz_dl-_ZHCVsoW_0 2024-04-03T05:14:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7017068496533178738', time=2024-04-03T06:55:48.036422+0000, chain.objs.size()=1 2024-04-03T05:14:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.556__shadow:Lu7gbvfLos2stCJDhdddy44Q5N7mzUY_.DoV4votokDxbiGN5g4FZWMWGx4SXBGQ_0 2024-04-03T05:14:08.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.624317234303546132', time=2024-04-03T06:56:20.313558+0000, chain.objs.size()=1 2024-04-03T05:14:08.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.573__shadow_.M7xCj0aZSUPfJt9HMAOnG765Buqy_jS_0 2024-04-03T05:14:08.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.583551469426792868', time=2024-04-03T07:01:01.113031+0000, chain.objs.size()=1 2024-04-03T05:14:08.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.594__shadow_.aUXuzMcS7iSyZTfhXpiS-V_fRULVZ-m_0 2024-04-03T05:14:08.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:08.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.581+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-03T05:14:08.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:08.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:08.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56711' 2024-04-03T05:14:08.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18210654582683945717', time=2024-04-03T06:21:14.072167+0000, chain.objs.size()=1 2024-04-03T05:14:08.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.147__shadow_.XLEXwbeb6kVGaxnyyEqEYTFSJj9Yhlv_0 2024-04-03T05:14:08.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9744099696943117239', time=2024-04-03T06:21:34.406013+0000, chain.objs.size()=5 2024-04-03T05:14:08.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__multipart_mymultipart-LUKEWARM.2~w61QGTNqbDoa-lvGtiJ5AzgvV7sWM9L.1 2024-04-03T05:14:08.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__shadow_mymultipart-LUKEWARM.2~w61QGTNqbDoa-lvGtiJ5AzgvV7sWM9L.1_1 2024-04-03T05:14:08.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__multipart_mymultipart-LUKEWARM.2~w61QGTNqbDoa-lvGtiJ5AzgvV7sWM9L.2 2024-04-03T05:14:08.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__shadow_mymultipart-LUKEWARM.2~w61QGTNqbDoa-lvGtiJ5AzgvV7sWM9L.2_1 2024-04-03T05:14:08.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__multipart_mymultipart-LUKEWARM.2~w61QGTNqbDoa-lvGtiJ5AzgvV7sWM9L.3 2024-04-03T05:14:08.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~KoqaTJ3gcZ7ByRh81CMurb-KaghDxp4', time=2024-04-03T06:24:46.982015+0000, chain.objs.size()=1 2024-04-03T05:14:08.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.191__multipart_mymultipart.2~KoqaTJ3gcZ7ByRh81CMurb-KaghDxp4.1 2024-04-03T05:14:08.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10395797274259016463', time=2024-04-03T06:25:12.659437+0000, chain.objs.size()=1 2024-04-03T05:14:08.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.203__shadow_.laP1gGzrQA6CWXx89BrIj1vJaYauAN6_0 2024-04-03T05:14:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4167003842632659339', time=2024-04-03T06:25:42.101395+0000, chain.objs.size()=1 2024-04-03T05:14:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.214__shadow_.NwnpzB49ly1KrSBhomoTeQewei3HsXC_0 2024-04-03T05:14:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1142172730648205664', time=2024-04-03T06:27:52.829816+0000, chain.objs.size()=1 2024-04-03T05:14:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Fw7wawV_nqqUZDCwK6ow_9qeqTM4FQg_0 2024-04-03T05:14:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15588603628390282777', time=2024-04-03T06:27:53.255386+0000, chain.objs.size()=1 2024-04-03T05:14:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1ugsJRoo8Z9TAegxKh_1ccxGq4YOJxN_0 2024-04-03T05:14:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9582072456362203680', time=2024-04-03T06:27:53.864949+0000, chain.objs.size()=1 2024-04-03T05:14:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6qyqPlv6l5sxa0pqTtGn12bBaKLyMxd_0 2024-04-03T05:14:08.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5229563772904735287', time=2024-04-03T06:27:54.064239+0000, chain.objs.size()=1 2024-04-03T05:14:08.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DMQgXKAITbs_ZgpErAPSNnKp_X7dZV7_0 2024-04-03T05:14:08.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16136379831933352087', time=2024-04-03T06:27:54.311886+0000, chain.objs.size()=1 2024-04-03T05:14:08.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.z_gi2xHlDd1AOW4RwUqtuzWplZEtiLQ_0 2024-04-03T05:14:08.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8348340554264626527', time=2024-04-03T06:27:55.140712+0000, chain.objs.size()=1 2024-04-03T05:14:08.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Axxwz2KfNaZwSmtHECRrV4Zh7QYbVXU_0 2024-04-03T05:14:08.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9144135873698246296', time=2024-04-03T06:27:55.142299+0000, chain.objs.size()=1 2024-04-03T05:14:08.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JjN5qXV0vVJxTKXbaA5YjUr6-IMh7k6_0 2024-04-03T05:14:08.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16765160229313622927', time=2024-04-03T06:27:57.349120+0000, chain.objs.size()=1 2024-04-03T05:14:08.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JUhAwV2raDAW5X4yZE5AhSytggN8zU-_0 2024-04-03T05:14:08.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8062519183320122257', time=2024-04-03T06:27:58.623134+0000, chain.objs.size()=1 2024-04-03T05:14:08.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.uygIGrkwIF5tK8rgItL8gN9CsINfC7l_0 2024-04-03T05:14:08.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18391451222040290532', time=2024-04-03T06:27:58.624745+0000, chain.objs.size()=1 2024-04-03T05:14:08.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xngNqiVPzinnmh0lujbIicHwa3maEeG_0 2024-04-03T05:14:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10194991774028234229', time=2024-04-03T06:27:59.029863+0000, chain.objs.size()=1 2024-04-03T05:14:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rE_z3ffRvP4evGP4LqqYotELJBsu60__0 2024-04-03T05:14:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3007038660557669762', time=2024-04-03T06:28:00.090704+0000, chain.objs.size()=1 2024-04-03T05:14:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.R3pGDknzvGAo4SX4v9glFasdbfT8QTa_0 2024-04-03T05:14:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2357241363442738820', time=2024-04-03T06:28:01.098411+0000, chain.objs.size()=1 2024-04-03T05:14:08.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eljcZ_EEFGRwVGyw9WVKSrd3yn5H0QA_0 2024-04-03T05:14:08.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.601+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17328061510478144491', time=2024-04-03T06:28:02.047324+0000, chain.objs.size()=1 2024-04-03T05:14:08.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.601+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QuAuCfOBV5r0NfK3TI7_XBJm9fmogo__0 2024-04-03T05:14:08.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10344019855061277332', time=2024-04-03T06:28:02.954208+0000, chain.objs.size()=1 2024-04-03T05:14:08.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.NSoWJFHZLWcJ5QeihZZ-LWKvTu-e76N_0 2024-04-03T05:14:08.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6252202427820747467', time=2024-04-03T06:28:04.692536+0000, chain.objs.size()=1 2024-04-03T05:14:08.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xxhwHf4oUZ55KdR0QT2jsCVm4RphkRL_0 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17606522897002141644', time=2024-04-03T06:28:05.837695+0000, chain.objs.size()=1 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fiY9IYbCr2tHLRpoeeTqZIiqG0Jxmj1_0 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3271581055107230716', time=2024-04-03T06:28:07.926794+0000, chain.objs.size()=1 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gYbnxCZhGyCEadAQZOIA6uQH8VXS9g8_0 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10308880831284298149', time=2024-04-03T06:28:08.238866+0000, chain.objs.size()=1 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XuMwJ1QDjD_qbtVQXWkagt6LWK1G7E2_0 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12693797133999049860', time=2024-04-03T06:28:08.947185+0000, chain.objs.size()=1 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qjvY_NxK_ssbK4tdLijt22MIq3qMCgn_0 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.537076439302874445', time=2024-04-03T06:28:09.829150+0000, chain.objs.size()=1 2024-04-03T05:14:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.605+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8tgIoeKYq7FLxgYYGOzTVxpTcFT0ygK_0 2024-04-03T05:14:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17497185834179074389', time=2024-04-03T06:28:10.722216+0000, chain.objs.size()=1 2024-04-03T05:14:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nDDjQGE1oRs6Q5Ek1n3ZIVQYiyVvbBC_0 2024-04-03T05:14:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3398978130733538866', time=2024-04-03T06:28:11.596117+0000, chain.objs.size()=1 2024-04-03T05:14:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7MxGU6h1-axiijwyDZi8SlVsyQCEHqz_0 2024-04-03T05:14:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2624642886408080709', time=2024-04-03T06:28:13.157673+0000, chain.objs.size()=1 2024-04-03T05:14:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.M2Ea_fhfynqtk4WKbsPgrzvr9fuX0G__0 2024-04-03T05:14:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9044676258536844828', time=2024-04-03T06:28:13.446143+0000, chain.objs.size()=1 2024-04-03T05:14:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.hi8TiHx1azQ_gn91_e5nuy2xXXNPQzy_0 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6655787043476283326', time=2024-04-03T06:28:13.776141+0000, chain.objs.size()=1 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mt4O1-UL7NVJPq3X4Mak1AwLz8jYNNh_0 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5806998261238324616', time=2024-04-03T06:28:14.086869+0000, chain.objs.size()=1 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gw5neWiIYWwSUk7yu9Cl0JWOiOyaLVD_0 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4653367900555007251', time=2024-04-03T06:28:14.343762+0000, chain.objs.size()=1 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1bQk4g8au_srH8rcmbyO2DA_xZoWZQt_0 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5403898310665059033', time=2024-04-03T06:28:15.821702+0000, chain.objs.size()=1 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tVsSjBwQdPGS9QxvpyszuLYs3kN1M9f_0 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5988666306886036830', time=2024-04-03T06:28:16.712668+0000, chain.objs.size()=1 2024-04-03T05:14:08.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eN5cmDvDOdZU3xPf3swy1b7CAUpHh-a_0 2024-04-03T05:14:08.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6938146514840305938', time=2024-04-03T06:28:17.110528+0000, chain.objs.size()=1 2024-04-03T05:14:08.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OQtaACm2N_AfVLBFiTng7J7Yu689vUY_0 2024-04-03T05:14:08.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7672511355441837047', time=2024-04-03T06:28:17.244196+0000, chain.objs.size()=1 2024-04-03T05:14:08.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.613+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.doamXPNodDTPSS8dxMsrQnJ1wZWb2xE_0 2024-04-03T05:14:08.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14499859953095834827', time=2024-04-03T06:28:17.568655+0000, chain.objs.size()=1 2024-04-03T05:14:08.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XgYNwg_6pNYY5qUcIDoyqvzMpq_3vn7_0 2024-04-03T05:14:08.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14521427568584198126', time=2024-04-03T06:28:18.678706+0000, chain.objs.size()=1 2024-04-03T05:14:08.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.KVkRxRQNh9EDUzFV418RFUTF3Yn98It_0 2024-04-03T05:14:08.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15237529816222255491', time=2024-04-03T06:28:18.779969+0000, chain.objs.size()=1 2024-04-03T05:14:08.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3_vNZRQ8RDXHULmY5JWb3-Ad3qE-um-_0 2024-04-03T05:14:08.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17513029781134717452', time=2024-04-03T06:28:18.781338+0000, chain.objs.size()=1 2024-04-03T05:14:08.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.D40KS2EMyxTtcMPJqZPyb8DZDElenli_0 2024-04-03T05:14:08.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11919081642505864452', time=2024-04-03T06:28:19.918932+0000, chain.objs.size()=1 2024-04-03T05:14:08.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yA3yZXjqtTbGrG6Is01OvINF_rpgGBV_0 2024-04-03T05:14:08.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16310111572758969674', time=2024-04-03T06:28:19.921872+0000, chain.objs.size()=1 2024-04-03T05:14:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7faUURP64gFwHryANOplt7pMLQBl_q1_0 2024-04-03T05:14:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14835084816779680819', time=2024-04-03T06:28:20.114640+0000, chain.objs.size()=1 2024-04-03T05:14:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5CzcziBQa69R4ycDaRh0FUE9C24-fqg_0 2024-04-03T05:14:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11533178995821290209', time=2024-04-03T06:28:20.930972+0000, chain.objs.size()=1 2024-04-03T05:14:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4VbpbB91_wNvEfoxNIW6R08ZN5eTP_T_0 2024-04-03T05:14:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9931731774406769426', time=2024-04-03T06:28:20.950860+0000, chain.objs.size()=1 2024-04-03T05:14:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.473AAduPSZedxbRGeKLP8-BIMbZSLsh_0 2024-04-03T05:14:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11283677690150481485', time=2024-04-03T06:28:21.105636+0000, chain.objs.size()=1 2024-04-03T05:14:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7sxl-aAUIUgCuFqFZmvbxd-XMhlkD2x_0 2024-04-03T05:14:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17618554407878343053', time=2024-04-03T06:28:50.665917+0000, chain.objs.size()=1 2024-04-03T05:14:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.245__shadow_.uq64B1-kPO7CIAEC2tHMrza_nfSIxfN_0 2024-04-03T05:14:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16563478250395386502', time=2024-04-03T06:29:20.386952+0000, chain.objs.size()=1 2024-04-03T05:14:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.258__shadow_.MLeGul0StaQ17D85FxZg2wegaLx_aYk_0 2024-04-03T05:14:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8263829698347484201', time=2024-04-03T06:29:30.522530+0000, chain.objs.size()=1 2024-04-03T05:14:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.trrP5m5EHy-bNtVJZ1h_m0-mrLL_WI1_0 2024-04-03T05:14:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14048546124101752261', time=2024-04-03T06:29:35.918748+0000, chain.objs.size()=1 2024-04-03T05:14:08.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.cbahYJP2x39R2MXos2-Sfp2fa6CFnNT_0 2024-04-03T05:14:08.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15807968600637213705', time=2024-04-03T06:29:42.929543+0000, chain.objs.size()=1 2024-04-03T05:14:08.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.265__shadow_.-3cuVAJajslR1g7ZCtsCA5_tDa9Sy-t_0 2024-04-03T05:14:08.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4022693409922556415', time=2024-04-03T06:30:00.756624+0000, chain.objs.size()=1 2024-04-03T05:14:08.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.273__shadow_.zdEID8-lQ4pZ3DRkBKYSvvHbjoUXfpT_0 2024-04-03T05:14:08.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14260061191912297305', time=2024-04-03T06:32:25.193048+0000, chain.objs.size()=1 2024-04-03T05:14:08.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.JqIuPPH1p4p4q1qptJyuY-Wh0JCmghW_0 2024-04-03T05:14:08.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15690953774866589399', time=2024-04-03T06:32:26.034778+0000, chain.objs.size()=1 2024-04-03T05:14:08.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FFzlpKb5mnT_8pnRbZbeZEQ82vYSvGN_0 2024-04-03T05:14:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5251272064705273257', time=2024-04-03T06:32:26.531644+0000, chain.objs.size()=1 2024-04-03T05:14:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-fBtv8T4CwzeHG2KsLeA5Cay7EnHVXm_0 2024-04-03T05:14:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13528136038528035370', time=2024-04-03T06:32:27.075600+0000, chain.objs.size()=1 2024-04-03T05:14:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RAi46k5Kk1iInIvBOPx8vqDuF2dVjqc_0 2024-04-03T05:14:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3820672226865250475', time=2024-04-03T06:32:28.208148+0000, chain.objs.size()=1 2024-04-03T05:14:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.67_3flZ0Sf00spmma6wSYQIGhxVxHhh_0 2024-04-03T05:14:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16793359549541300682', time=2024-04-03T06:32:28.687028+0000, chain.objs.size()=1 2024-04-03T05:14:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.jnX1xr6S9rOC7aJck2wlhEhamwjBrnc_0 2024-04-03T05:14:08.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.637+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8509716260388069898', time=2024-04-03T06:32:28.747431+0000, chain.objs.size()=1 2024-04-03T05:14:08.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.637+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lBoWrDp-GMqiscyWX_wwpHTcv_2SzPE_0 2024-04-03T05:14:08.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.637+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.482697033393596599', time=2024-04-03T06:32:29.538330+0000, chain.objs.size()=1 2024-04-03T05:14:08.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.637+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0hpQ6DC_JUuB5S455rYZlNcf64CGz0A_0 2024-04-03T05:14:08.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7881070380288674525', time=2024-04-03T06:32:29.648136+0000, chain.objs.size()=1 2024-04-03T05:14:08.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.haU4PQfS_vsZx8-RK_oHz79ysQmPExl_0 2024-04-03T05:14:08.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5228863342009450742', time=2024-04-03T06:32:30.490641+0000, chain.objs.size()=1 2024-04-03T05:14:08.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DwZYiQul4s0qUOgzJ2vpX5DLEQrJnhe_0 2024-04-03T05:14:08.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12358618402919952020', time=2024-04-03T06:32:32.930671+0000, chain.objs.size()=1 2024-04-03T05:14:08.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CHZn0JFlplOA0jKO0UwsYVvQt5N42lJ_0 2024-04-03T05:14:08.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5784644976266679490', time=2024-04-03T06:32:32.932669+0000, chain.objs.size()=1 2024-04-03T05:14:08.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.aPH09peELhfKQTuhsQFfXx_T-MT_PmZ_0 2024-04-03T05:14:08.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11308775446341221423', time=2024-04-03T06:32:33.720961+0000, chain.objs.size()=1 2024-04-03T05:14:08.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.d_D3jAXS1IF57DA3g4_Rc5BpLYBUiye_0 2024-04-03T05:14:08.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12617042068310923887', time=2024-04-03T06:32:36.640963+0000, chain.objs.size()=1 2024-04-03T05:14:08.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._-uKJ3u-DvnRXhmChd3uuDBTrEcqPaO_0 2024-04-03T05:14:08.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3858978126610444564', time=2024-04-03T06:32:36.822251+0000, chain.objs.size()=1 2024-04-03T05:14:08.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.47AjQTeG9O_rSApEJK8GdMAgWkpnJN-_0 2024-04-03T05:14:08.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13078249975210197078', time=2024-04-03T06:32:37.195770+0000, chain.objs.size()=1 2024-04-03T05:14:08.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FHVEXRxvU-fHFQCDHmkp4VwDhkCyEjP_0 2024-04-03T05:14:08.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15662007319903775255', time=2024-04-03T06:32:38.247224+0000, chain.objs.size()=1 2024-04-03T05:14:08.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gik6l76W6Q6xn83s8SSXs5Tb8YUfDWT_0 2024-04-03T05:14:08.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.645+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13741247090020359502', time=2024-04-03T06:32:38.452926+0000, chain.objs.size()=1 2024-04-03T05:14:08.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.645+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dQ6sJZRI8ajpMbJ_BbJhWDFZ1LzLa2Q_0 2024-04-03T05:14:08.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.645+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12161414950296697871', time=2024-04-03T06:32:39.861931+0000, chain.objs.size()=1 2024-04-03T05:14:08.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.645+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.PqHGoaUS7s231UNKoV_NLHZYwdldvAv_0 2024-04-03T05:14:08.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17044079853779332544', time=2024-04-03T06:32:40.022977+0000, chain.objs.size()=1 2024-04-03T05:14:08.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OsresCaa_Bv1QAUWrKrs2kQPP2IVEo9_0 2024-04-03T05:14:08.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8241010126602445573', time=2024-04-03T06:32:40.026345+0000, chain.objs.size()=1 2024-04-03T05:14:08.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.oB_NNSxGFdCrif7okm8_mo57yIBAjF__0 2024-04-03T05:14:08.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6274586426343871399', time=2024-04-03T06:32:41.154057+0000, chain.objs.size()=1 2024-04-03T05:14:08.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OsZ5cxqYxTQiTU3JgDQ3rSjn3owzbdQ_0 2024-04-03T05:14:08.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4026247355667454559', time=2024-04-03T06:32:43.198745+0000, chain.objs.size()=1 2024-04-03T05:14:08.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8cQsv50l02u2CyuTo4gmUCL3WlRBGgD_0 2024-04-03T05:14:08.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5755862068495864467', time=2024-04-03T06:32:43.509891+0000, chain.objs.size()=1 2024-04-03T05:14:08.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qM1vWdulfTL8i2J-LHM5rSg7xX7od01_0 2024-04-03T05:14:08.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18228074436339615965', time=2024-04-03T06:32:43.885567+0000, chain.objs.size()=1 2024-04-03T05:14:08.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dedVEFduSaTmH3ihGNFpQTbf053dTbr_0 2024-04-03T05:14:08.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10169807226606686296', time=2024-04-03T06:32:43.887711+0000, chain.objs.size()=1 2024-04-03T05:14:08.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.JTOKC6mY4UKCJDUkTEtvomIH6hoTOYG_0 2024-04-03T05:14:08.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14670445552070111223', time=2024-04-03T06:32:44.014071+0000, chain.objs.size()=1 2024-04-03T05:14:08.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ovySW4jQOGn_me5VtXWCz_cFUqS4XsZ_0 2024-04-03T05:14:08.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15399777727507234777', time=2024-04-03T06:32:44.255928+0000, chain.objs.size()=1 2024-04-03T05:14:08.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pGmyivnOvY7oe2WqOTB3zv8dZGxAn9x_0 2024-04-03T05:14:08.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7255209346564390817', time=2024-04-03T06:32:44.266304+0000, chain.objs.size()=1 2024-04-03T05:14:08.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tf_VnZXfkHQ9xl823jdzgSt39zd-eK8_0 2024-04-03T05:14:08.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2639812086573840301', time=2024-04-03T06:32:44.884260+0000, chain.objs.size()=1 2024-04-03T05:14:08.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ZOqR_B_uWO4SMNECOiWsE3Q8mlwD1kn_0 2024-04-03T05:14:08.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12754496811984430843', time=2024-04-03T06:32:44.981696+0000, chain.objs.size()=1 2024-04-03T05:14:08.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FU_O_AgNIuQc59G2GCwwZi-pIL4vEet_0 2024-04-03T05:14:08.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4724129453540991273', time=2024-04-03T06:32:44.984271+0000, chain.objs.size()=1 2024-04-03T05:14:08.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.D8p3ZUg6gQKUYZWxasXHVx_5yG5_JgC_0 2024-04-03T05:14:08.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6198894789995118726', time=2024-04-03T06:32:45.190664+0000, chain.objs.size()=1 2024-04-03T05:14:08.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Nzchg3xvITMkP6oHPTsyHsyjDONt7V0_0 2024-04-03T05:14:08.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8686979612953874429', time=2024-04-03T06:32:45.614697+0000, chain.objs.size()=1 2024-04-03T05:14:08.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9TLWX2333CRhR3_oOnwcHHsnsrCv5vN_0 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9534623502570275738', time=2024-04-03T06:32:48.247699+0000, chain.objs.size()=1 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4fT39dbo8WNEmOhGSkLIb-7I7CYQeC2_0 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1118872793116820472', time=2024-04-03T06:32:50.143000+0000, chain.objs.size()=1 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.m5mHxCUud6BPckgiSgqXzfFRJzXYNzs_0 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9222311888896212333', time=2024-04-03T06:32:50.146246+0000, chain.objs.size()=1 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ogxXv8rAAFpopICpCEIPialFSKyKocx_0 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14490185927414579465', time=2024-04-03T06:32:50.715128+0000, chain.objs.size()=1 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vkqa0oCWnSbr0mI7yeLuZq-Aq01Buap_0 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7718497429777596906', time=2024-04-03T06:32:51.825930+0000, chain.objs.size()=1 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ihlFg94PkbVCuICxAVNfvJwA3n-XxZk_0 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2153748798974971370', time=2024-04-03T06:32:51.860070+0000, chain.objs.size()=1 2024-04-03T05:14:08.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9Flo-Hfy0bRZ8MSDnxnSJ3NQ5VCM-ph_0 2024-04-03T05:14:08.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7592934779103348534', time=2024-04-03T06:32:52.054747+0000, chain.objs.size()=1 2024-04-03T05:14:08.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8H01xPmF75HTQ3cEQYoeWRE9ZZ0HLnR_0 2024-04-03T05:14:08.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12612617446424795558', time=2024-04-03T06:34:28.638194+0000, chain.objs.size()=1 2024-04-03T05:14:08.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2sQE_LIdiQ79bi9Uhqmq2QSvsoHKrHj_0 2024-04-03T05:14:08.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9750691475354009519', time=2024-04-03T06:34:29.119566+0000, chain.objs.size()=1 2024-04-03T05:14:08.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3HLuQF8-4C3vQaLw2ixbY5X3E7keh78_0 2024-04-03T05:14:08.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5110338028845115796', time=2024-04-03T06:34:29.233178+0000, chain.objs.size()=1 2024-04-03T05:14:08.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.EquuKI55AALshH1lWfoIq1G_fV2wpdX_0 2024-04-03T05:14:08.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1137335286159978527', time=2024-04-03T06:34:29.642957+0000, chain.objs.size()=1 2024-04-03T05:14:08.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rL-WaviuiO0QF2mKp333rrcPPImQy_J_0 2024-04-03T05:14:08.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.665+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13404653263517656476', time=2024-04-03T06:34:29.792655+0000, chain.objs.size()=1 2024-04-03T05:14:08.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.665+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nIyfCgoPX_a_3cyfXF3ko1aWkMK9UGp_0 2024-04-03T05:14:08.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.665+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6964533836463137788', time=2024-04-03T06:34:30.317392+0000, chain.objs.size()=1 2024-04-03T05:14:08.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.665+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4O5J3yG6zID4sbi5hqyku12EALQ4ho9_0 2024-04-03T05:14:08.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/56711 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=54, truncated=0, next_marker='' 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16664306209895514540', time=2024-04-03T06:34:31.288850+0000, chain.objs.size()=1 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dx-BePMWV1YCrQpOy0l4Qqku269BB9K_0 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4925108083110827526', time=2024-04-03T06:34:32.962703+0000, chain.objs.size()=1 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Gt1u4OaOejo6R_BYXyV3uOFTF1_1K61_0 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10165651559824825752', time=2024-04-03T06:34:33.078640+0000, chain.objs.size()=1 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IfxBiSLs3v36hN2D_Df2hNmYsLTkCuX_0 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18234011321602312759', time=2024-04-03T06:34:33.080742+0000, chain.objs.size()=1 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5v2y3glwk0IUfKTpSQWZiQtOtdjQu8Y_0 2024-04-03T05:14:08.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18253336231499958761', time=2024-04-03T06:34:34.837115+0000, chain.objs.size()=1 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kXjqQtgBsCQ1anmmIHDyXxj0jzbjp0J_0 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7380611151602193136', time=2024-04-03T06:34:34.998545+0000, chain.objs.size()=1 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vune7R8tw4bcoJR_mve2HuN_csb8Xgc_0 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1219871667883001874', time=2024-04-03T06:34:36.356724+0000, chain.objs.size()=1 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.O8I8z3ZrHG7mub7Z1uZA7gO4iMYlIA1_0 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15852803492322555713', time=2024-04-03T06:34:36.841986+0000, chain.objs.size()=1 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BdlrIiArshUfLKSc2ehsRIFkw00bsM1_0 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7141113319657151310', time=2024-04-03T06:34:37.018954+0000, chain.objs.size()=1 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SMDsZIgg4lXTWcXY6IHYTW8Nzp0DqXS_0 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14213694945571326050', time=2024-04-03T06:34:37.254834+0000, chain.objs.size()=1 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cs4Y7h4MdwwEjmtAQls9OZ0t3n6aj2X_0 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14811580982670268283', time=2024-04-03T06:34:38.257004+0000, chain.objs.size()=1 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yjYhHUsLR5A5ROnaX6F7wYJ4CFPT3cz_0 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11059630275703053666', time=2024-04-03T06:34:41.160992+0000, chain.objs.size()=1 2024-04-03T05:14:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.681+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4Bw4VgY1qZomgeZpNTTG4Z86kwLeVau_0 2024-04-03T05:14:08.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11304861963922947954', time=2024-04-03T06:34:41.257637+0000, chain.objs.size()=1 2024-04-03T05:14:08.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.RLUkyYoXZkkVhJBwdtE8edMzYES6CEd_0 2024-04-03T05:14:08.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8505346805641095492', time=2024-04-03T06:34:41.474013+0000, chain.objs.size()=1 2024-04-03T05:14:08.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xtDycPfuRerskHbbqNt09grF5DdP4tP_0 2024-04-03T05:14:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.772900241572670467', time=2024-04-03T06:34:42.378535+0000, chain.objs.size()=1 2024-04-03T05:14:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vTLhwCmCrEm2eaYgmYQocX6NKF2VZxY_0 2024-04-03T05:14:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15109113274885831051', time=2024-04-03T06:34:42.641709+0000, chain.objs.size()=1 2024-04-03T05:14:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pXr0s9f2a0No9nvCrsRgbCE3incnJj4_0 2024-04-03T05:14:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6084667108425107601', time=2024-04-03T06:34:43.781087+0000, chain.objs.size()=1 2024-04-03T05:14:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kmby6oueofjLN-rsmKO8VSk3Z2SVSw1_0 2024-04-03T05:14:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.896188805232081853', time=2024-04-03T06:34:44.188732+0000, chain.objs.size()=1 2024-04-03T05:14:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.c7MuiErmY588ftsjkYkVJ0aRCvr836K_0 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16362363576671852699', time=2024-04-03T06:34:44.543640+0000, chain.objs.size()=1 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.z3e6_iLj00If2HfQjkEcSrJ1jC1K5vC_0 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16442395880524007313', time=2024-04-03T06:34:44.550852+0000, chain.objs.size()=1 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KguUq9fzcOQhmm5KPgjKNBg0iFAeQWQ_0 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6506594270633482847', time=2024-04-03T06:34:44.828653+0000, chain.objs.size()=1 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5SRMeI5kHhaeEW5ugS4XAs_XNy6jL9I_0 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10176688500963662500', time=2024-04-03T06:34:45.124570+0000, chain.objs.size()=1 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-m6rC_VsXnAZOT7h_-hSRz3XbbXXY4L_0 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.354981988112681392', time=2024-04-03T06:34:45.704450+0000, chain.objs.size()=1 2024-04-03T05:14:08.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.689+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-du48VSkGYtotw3uxzAvd0xpe2ijfdH_0 2024-04-03T05:14:08.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.693+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4842512387425292319', time=2024-04-03T06:34:45.772133+0000, chain.objs.size()=1 2024-04-03T05:14:08.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.py45o5IIXi-8Ap78T1dOKawrzJCKpwz_0 2024-04-03T05:14:08.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.622523107197470093', time=2024-04-03T06:34:45.861287+0000, chain.objs.size()=1 2024-04-03T05:14:08.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2PK94CePbyq7qazl7H7kWjMSm8p7x2F_0 2024-04-03T05:14:08.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17262086194832069015', time=2024-04-03T06:34:46.479947+0000, chain.objs.size()=1 2024-04-03T05:14:08.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.AlJJlGGH1o1ogbCRPGq_qNLY6K_6shX_0 2024-04-03T05:14:08.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4016332831410450921', time=2024-04-03T06:34:48.505661+0000, chain.objs.size()=1 2024-04-03T05:14:08.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YKpJDha3bS-L-QS0RUr_dGQbzdhDqdD_0 2024-04-03T05:14:08.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15810973157783688606', time=2024-04-03T06:34:49.904786+0000, chain.objs.size()=1 2024-04-03T05:14:08.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nP3A5eEuv-qXcJyNKwUn3Ouo26X2-yx_0 2024-04-03T05:14:08.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16035442918997741094', time=2024-04-03T06:34:49.906899+0000, chain.objs.size()=1 2024-04-03T05:14:08.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Copq4Z75cX3KF5woTreVtPq8y2mTtAA_0 2024-04-03T05:14:08.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10325933687850019350', time=2024-04-03T06:34:51.149644+0000, chain.objs.size()=1 2024-04-03T05:14:08.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TMX8qU_yqWSV7ovbAyxC844NQx42mmZ_0 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14826532091280023007', time=2024-04-03T06:34:51.772381+0000, chain.objs.size()=1 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BCgesxdUm2zrlwM_4qq63V0H4d_-IU9_0 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9236775401085578437', time=2024-04-03T06:34:52.896598+0000, chain.objs.size()=1 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kbTol7OXUThxcNvdrdsuUcmemyNPVms_0 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4196070394410823861', time=2024-04-03T06:34:53.295386+0000, chain.objs.size()=1 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.83tNRUZExlxQllVYGtgWZMy_uCcJ-KW_0 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11252908438950543752', time=2024-04-03T06:34:54.664881+0000, chain.objs.size()=1 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.o5lGZmnDGn_6dHcSh4elu67zu0NoB34_0 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.630521992330265593', time=2024-04-03T06:34:55.396431+0000, chain.objs.size()=1 2024-04-03T05:14:08.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.697+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4cT2w4N4SHNMKE5jdIjMSb6Fi3aQSk1_0 2024-04-03T05:14:08.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14892745790213883748', time=2024-04-03T06:34:55.398120+0000, chain.objs.size()=1 2024-04-03T05:14:08.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.HoTysggp23Eeho7G6Ytl1Hj4XoWoIA4_0 2024-04-03T05:14:08.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17168492799283474729', time=2024-04-03T06:34:55.399961+0000, chain.objs.size()=1 2024-04-03T05:14:08.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DkIlHA_rbqJpZbL_DvcuQRM7QFnTQOV_0 2024-04-03T05:14:08.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1246424336303229265', time=2024-04-03T06:34:55.452291+0000, chain.objs.size()=1 2024-04-03T05:14:08.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.WnprM6b_RH-jvtg1EaCVq5EsEEqI7s7_0 2024-04-03T05:14:08.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3200693746642202661', time=2024-04-03T06:34:56.308623+0000, chain.objs.size()=1 2024-04-03T05:14:08.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GVqWXZtHwZLwhHxbbmdQjA5BpS6LSx8_0 2024-04-03T05:14:08.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15180103616127576334', time=2024-04-03T06:36:27.182196+0000, chain.objs.size()=1 2024-04-03T05:14:08.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.342__shadow_.w1QwnLl9GlFnNhriOX3cTJkpBwLtHce_0 2024-04-03T05:14:08.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12027667501080436883', time=2024-04-03T06:36:33.965969+0000, chain.objs.size()=1 2024-04-03T05:14:08.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.345__shadow_.rBOiYfqFumzp-vWC6oNKMii0hgz3Dbs_0 2024-04-03T05:14:08.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16289052427395398156', time=2024-04-03T06:39:37.751271+0000, chain.objs.size()=1 2024-04-03T05:14:08.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.432__shadow_.Jndag7Vnuhr148ELPUeA7eC2WM7VLmW_0 2024-04-03T05:14:08.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6844495495412056303', time=2024-04-03T06:39:48.420158+0000, chain.objs.size()=1 2024-04-03T05:14:08.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.436__shadow_.mrsD7QW1oIzVEONfsYyTyEVyXO9LVVV_0 2024-04-03T05:14:08.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2_748b2697d3e6e8dd1c13693326207818', time=2024-04-03T06:41:45.304188+0000, chain.objs.size()=6 2024-04-03T05:14:08.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.1 2024-04-03T05:14:08.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2 2024-04-03T05:14:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.3 2024-04-03T05:14:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.4 2024-04-03T05:14:08.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.5 2024-04-03T05:14:08.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.6 2024-04-03T05:14:08.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5426249441693732994', time=2024-04-03T06:48:01.338736+0000, chain.objs.size()=2 2024-04-03T05:14:08.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~U_Kd2c71aOAwc6i2ftSgAMBThikRUW6.1 2024-04-03T05:14:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~U_Kd2c71aOAwc6i2ftSgAMBThikRUW6.2 2024-04-03T05:14:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7646709259904988104', time=2024-04-03T06:48:53.588531+0000, chain.objs.size()=7 2024-04-03T05:14:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.497__multipart_mymultipart.2~EKqxYQrtIBC9f5eLr3dxPvsTa-8iK_q.1 2024-04-03T05:14:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.497__shadow_mymultipart.2~EKqxYQrtIBC9f5eLr3dxPvsTa-8iK_q.1_1 2024-04-03T05:14:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.497__multipart_mymultipart.2~EKqxYQrtIBC9f5eLr3dxPvsTa-8iK_q.2 2024-04-03T05:14:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.497__shadow_mymultipart.2~EKqxYQrtIBC9f5eLr3dxPvsTa-8iK_q.2_1 2024-04-03T05:14:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.497__multipart_mymultipart.2~EKqxYQrtIBC9f5eLr3dxPvsTa-8iK_q.3 2024-04-03T05:14:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.497__shadow_mymultipart.2~EKqxYQrtIBC9f5eLr3dxPvsTa-8iK_q.3_1 2024-04-03T05:14:08.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.497__multipart_mymultipart.2~EKqxYQrtIBC9f5eLr3dxPvsTa-8iK_q.4 2024-04-03T05:14:08.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15069358804479970412', time=2024-04-03T06:51:34.674493+0000, chain.objs.size()=2 2024-04-03T05:14:08.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.524__shadow_.K8CETKBzUb4xi8s8xYmQMSf04jHQXVo_0 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.524__shadow_.K8CETKBzUb4xi8s8xYmQMSf04jHQXVo_1 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17717435166440105212', time=2024-04-03T06:52:03.096515+0000, chain.objs.size()=1 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.527__shadow_.NpomFkVKUtrp4baVrtFhHo_xc9r4mcB_0 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2221164773890010932', time=2024-04-03T06:53:55.223990+0000, chain.objs.size()=1 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:lnJBhAugD0MXK0cvS8OsrjXaR094Az7_.iQbnRuDrdFL8kS6FbDYJSknTNJQ3vqI_0 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2450627720620159829', time=2024-04-03T06:54:07.461208+0000, chain.objs.size()=1 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:ZFi52k.qo61QFQZiLYWUeTElqJmILY2_.yNfHOindZ3q-I0U7X59eNgdGKUTJdh0_0 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.631__shadow_.in7Y0hD9ONs3rlNvpTnd_iy0KzTo4SD_1_aa38acd2aac746289a0c8c8dd79be34b', time=2024-04-03T07:03:46.880434+0000, chain.objs.size()=1 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.631__shadow_.in7Y0hD9ONs3rlNvpTnd_iy0KzTo4SD_0 2024-04-03T05:14:08.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15306464890007839029', time=2024-04-03T07:03:49.688508+0000, chain.objs.size()=1 2024-04-03T05:14:08.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.633__shadow_.cxIXsewHsTC10uLd5iZ5xzORPLr_MvW_0 2024-04-03T05:14:08.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13708035194495012007', time=2024-04-03T07:03:52.307240+0000, chain.objs.size()=1 2024-04-03T05:14:08.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.635__shadow_.Gq7b5YHmUqLsvuQSz26OPqLCnOyWOHH_0 2024-04-03T05:14:08.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17362117738756648414', time=2024-04-03T07:04:31.987746+0000, chain.objs.size()=1 2024-04-03T05:14:08.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.658__shadow:snBi5wozoLojztml2vmh64.MUmVNljR_.oJF28oC62YtRDbhfMLNaTVuZKrQAIkQ_0 2024-04-03T05:14:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.725+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:08.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-03T05:14:08.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:08.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:08.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55071' 2024-04-03T05:14:08.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13789026733112060814', time=2024-04-03T06:25:48.717538+0000, chain.objs.size()=1 2024-04-03T05:14:08.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.217__shadow_.p4xnG9YGAnLKJYEZwItwk3F88qIrFbV_0 2024-04-03T05:14:08.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10509390551982670981', time=2024-04-03T06:26:14.827166+0000, chain.objs.size()=1 2024-04-03T05:14:08.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.229__shadow_.rl4F5D1SSId7GnQ_D_uerPj98gva1DX_0 2024-04-03T05:14:08.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8024552814134049733', time=2024-04-03T06:27:52.563117+0000, chain.objs.size()=1 2024-04-03T05:14:08.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.A9xKsijPPrS126-A5E-lYjilqPMj1U6_0 2024-04-03T05:14:08.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16157056973473808994', time=2024-04-03T06:27:52.754737+0000, chain.objs.size()=1 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lnaMBA74W8hQUPLfzhcj1YvBfZCMIZ0_0 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.251889491532230859', time=2024-04-03T06:27:53.590888+0000, chain.objs.size()=1 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1W1nEStYWh333D94FMa8QNPdLeEHwMt_0 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8890813355113644507', time=2024-04-03T06:27:56.310201+0000, chain.objs.size()=1 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GvNY9mqXwYB2jpSRpuy_tO5p1cPYITv_0 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10085086753170309834', time=2024-04-03T06:27:56.528995+0000, chain.objs.size()=1 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QdeINoBU2VcRraQJEkCjTzmlE1vl6OI_0 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10709931624040173966', time=2024-04-03T06:27:56.751326+0000, chain.objs.size()=1 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.biQkpFO116349P0OihD6IUS0IC-Sevt_0 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12597887684981766062', time=2024-04-03T06:27:57.700766+0000, chain.objs.size()=1 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.e3cxHRNIMYD0761SwEJgII0_UcZ_Ub4_0 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12685839721395002696', time=2024-04-03T06:27:58.272258+0000, chain.objs.size()=1 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QBBsLlhGYwb641QsN2sjBI3PHrXkf5u_0 2024-04-03T05:14:08.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6621685913110807626', time=2024-04-03T06:28:00.073327+0000, chain.objs.size()=1 2024-04-03T05:14:08.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.kpjVI_qTonJbPYpNuY-Opnaa---vvDU_0 2024-04-03T05:14:08.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.105087030576300985', time=2024-04-03T06:28:00.216643+0000, chain.objs.size()=1 2024-04-03T05:14:08.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.aEJxGTDtNXlxBuTyjFqFMyR1VuznFp9_0 2024-04-03T05:14:08.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4429148136311189851', time=2024-04-03T06:28:00.804726+0000, chain.objs.size()=1 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cnuBMKU4pbRTev2XzEPziUsWgPlTmK__0 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7493905855895348899', time=2024-04-03T06:28:02.194097+0000, chain.objs.size()=1 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7wd-yHdY9MMx0yVM0RHDc-95PeH0up-_0 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9567788825253299022', time=2024-04-03T06:28:02.374616+0000, chain.objs.size()=1 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ZHoPnxWzHu6AvD4dYi4FnyIj7JuvTDT_0 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1619202884011061159', time=2024-04-03T06:28:02.542734+0000, chain.objs.size()=1 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.PPQ1Gu8eEV2_21QcRK1mMBydpGlU2Oi_0 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2145935161526252556', time=2024-04-03T06:28:04.066930+0000, chain.objs.size()=1 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.O9tWDDFA6nZ_KdoxSS6EApO2sCri3XX_0 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8078430890357558829', time=2024-04-03T06:28:04.671094+0000, chain.objs.size()=1 2024-04-03T05:14:08.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7llkTwQcypLFv4W0RD1wmzI-kEt3JfS_0 2024-04-03T05:14:08.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.145552564152205778', time=2024-04-03T06:28:04.791269+0000, chain.objs.size()=1 2024-04-03T05:14:08.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qw2D9ifHoRhoRgbFtsCT2cEMAeGg0Eo_0 2024-04-03T05:14:08.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14436852568976025143', time=2024-04-03T06:28:06.123894+0000, chain.objs.size()=1 2024-04-03T05:14:08.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eS-zGklNRyLKP-6klafeFSHZ_SYcB6-_0 2024-04-03T05:14:08.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9491667149791299034', time=2024-04-03T06:28:06.518808+0000, chain.objs.size()=1 2024-04-03T05:14:08.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UP5UeAer9eiWItWEdMyPQ1agVBWAQ6b_0 2024-04-03T05:14:08.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10469299606910816590', time=2024-04-03T06:28:06.587601+0000, chain.objs.size()=1 2024-04-03T05:14:08.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Q0Z_1Mk8e6HoLV_yuOOyNPv66diN0BE_0 2024-04-03T05:14:08.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11312643180557327827', time=2024-04-03T06:28:06.697022+0000, chain.objs.size()=1 2024-04-03T05:14:08.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-ZGYG4-OvgS_X_hYDq6MBveyxVeJgGW_0 2024-04-03T05:14:08.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.745+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6468177924939974162', time=2024-04-03T06:28:09.607358+0000, chain.objs.size()=1 2024-04-03T05:14:08.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.745+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mmUQgxWJQQg-OMInd8QmeHly00jG594_0 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7257723702372427608', time=2024-04-03T06:28:12.003572+0000, chain.objs.size()=1 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6k_Eo3ehTo18KXDwETx_I0pVTcC5LwI_0 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6928938378644860273', time=2024-04-03T06:28:12.373132+0000, chain.objs.size()=1 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0MC4tiO2qRa89YrGFeG6OiQp1FY18Jg_0 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13204015412204738593', time=2024-04-03T06:28:12.374922+0000, chain.objs.size()=1 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cr2XMJtGJoGWvrTgCJw1zCLYoNr9Q-6_0 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3479751086016962262', time=2024-04-03T06:28:13.178583+0000, chain.objs.size()=1 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.IILxcNi1uXyqje0O9YQvZ4hyKtQvNVa_0 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14935400172216645051', time=2024-04-03T06:28:13.599317+0000, chain.objs.size()=1 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gV3cTKc1P-jqKTNT5L7sPbuBNtNKzyw_0 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11635103084650206184', time=2024-04-03T06:28:14.227128+0000, chain.objs.size()=1 2024-04-03T05:14:08.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qIqSUcMRwk8tvuUBFE5PLoVlpbCkOxR_0 2024-04-03T05:14:08.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10221107595758778295', time=2024-04-03T06:28:14.251201+0000, chain.objs.size()=1 2024-04-03T05:14:08.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.39WJj88jYpkSvxwjasb0qN9JMW-0KCJ_0 2024-04-03T05:14:08.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.745614551790283803', time=2024-04-03T06:28:16.796978+0000, chain.objs.size()=1 2024-04-03T05:14:08.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rZyCEonrDm7wQrPBYfSW0u-GsyIukM3_0 2024-04-03T05:14:08.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15957551039584728293', time=2024-04-03T06:28:16.889612+0000, chain.objs.size()=1 2024-04-03T05:14:08.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3PZiv08oWoDIV60GxeCAPuiN8y9V5WR_0 2024-04-03T05:14:08.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13256013869329120914', time=2024-04-03T06:28:20.515046+0000, chain.objs.size()=1 2024-04-03T05:14:08.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XtzxDeoYcWG2RnqUhI_702g944XXyDA_0 2024-04-03T05:14:08.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9596851367648117793', time=2024-04-03T06:28:20.889118+0000, chain.objs.size()=1 2024-04-03T05:14:08.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nsDgS599d5Tqk08DqHIH6MTirkrdNgY_0 2024-04-03T05:14:08.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7585059237806588348', time=2024-04-03T06:28:21.069545+0000, chain.objs.size()=1 2024-04-03T05:14:08.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.axIjxuQvGouCCCql-uY_exYkyyfcSmy_0 2024-04-03T05:14:08.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1463596940370044410', time=2024-04-03T06:28:42.160868+0000, chain.objs.size()=1 2024-04-03T05:14:08.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.241__shadow_.d3NJnAMZAnAZxM5en-yYlF0SoyywJSx_0 2024-04-03T05:14:08.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8006050493547490340', time=2024-04-03T06:28:55.092138+0000, chain.objs.size()=1 2024-04-03T05:14:08.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.247__shadow_.oRfjPHWKg1BgEuaHWGsgb6ZonzS9Wat_0 2024-04-03T05:14:08.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13935873168434783576', time=2024-04-03T06:29:18.224112+0000, chain.objs.size()=1 2024-04-03T05:14:08.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.257__shadow_.VgspMMbt_-rtBkMep0ftgseCYF4VWzP_0 2024-04-03T05:14:08.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4880222220502216757', time=2024-04-03T06:29:36.204774+0000, chain.objs.size()=1 2024-04-03T05:14:08.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.HzUOcUTn6IjWHnlK8xsTGfzAVxSkXml_0 2024-04-03T05:14:08.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13111019449134702066', time=2024-04-03T06:29:40.608891+0000, chain.objs.size()=1 2024-04-03T05:14:08.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.264__shadow_.gApSivITkQRo-cjiFbgEo90WpufOA7f_0 2024-04-03T05:14:08.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1457323537491344804', time=2024-04-03T06:29:40.635354+0000, chain.objs.size()=1 2024-04-03T05:14:08.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.264__shadow_.SSPx31C0O8zwqkjC3BCTQp9hC81TV5o_0 2024-04-03T05:14:08.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15702005926751134746', time=2024-04-03T06:30:41.543176+0000, chain.objs.size()=1 2024-04-03T05:14:08.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.288__shadow:Pb35n5DWFBQUs-J5yDiemZ69Lxwd5KQ_.F3FYiC-wGM_TbpVfrnfgF2kouSZ9xFs_0 2024-04-03T05:14:08.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5606204776272560111', time=2024-04-03T06:32:24.933109+0000, chain.objs.size()=1 2024-04-03T05:14:08.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.B7KPtfivJtsXohQ6l31agoTSe7ip_2r_0 2024-04-03T05:14:08.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18153319086565916727', time=2024-04-03T06:32:25.898910+0000, chain.objs.size()=1 2024-04-03T05:14:08.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.m_dT7-UCMNR-B3tKH_6rPgbXepD-FT5_0 2024-04-03T05:14:08.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13095532665864416957', time=2024-04-03T06:32:26.714396+0000, chain.objs.size()=1 2024-04-03T05:14:08.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uL-Pl8Ns7XxJmLloQCFshxMn1ieT_6D_0 2024-04-03T05:14:08.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9406250602738057164', time=2024-04-03T06:32:27.036099+0000, chain.objs.size()=1 2024-04-03T05:14:08.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AcEql9JxNAOn3rejYRovgOigNld9a2M_0 2024-04-03T05:14:08.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9469574678749704370', time=2024-04-03T06:32:28.071758+0000, chain.objs.size()=1 2024-04-03T05:14:08.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.WL2k_vbJQHE-aBPH_bHtiq1iAnnrzAF_0 2024-04-03T05:14:08.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7336943589623158280', time=2024-04-03T06:32:28.450648+0000, chain.objs.size()=1 2024-04-03T05:14:08.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OM55_zEQtrqZtu7GrpxqDOjMkJ-O-za_0 2024-04-03T05:14:08.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13188144535593414910', time=2024-04-03T06:32:28.531416+0000, chain.objs.size()=1 2024-04-03T05:14:08.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ZfZU7vMZGG4dhqs7uVhcQUv3GCXZoPo_0 2024-04-03T05:14:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9950557905849168036', time=2024-04-03T06:32:28.653035+0000, chain.objs.size()=1 2024-04-03T05:14:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.3ViHP5LVY5PG_BXkhJWybeQWG_di0kR_0 2024-04-03T05:14:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3988314240525913546', time=2024-04-03T06:32:29.124739+0000, chain.objs.size()=1 2024-04-03T05:14:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9ZzYdAdxqyNG6asCJdcjdYdM4ZlXpSz_0 2024-04-03T05:14:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10985330397890466622', time=2024-04-03T06:32:29.870853+0000, chain.objs.size()=1 2024-04-03T05:14:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.761+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5w71RmkBcThzPuj_BYiJeqI8_72aIVL_0 2024-04-03T05:14:08.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16153609124988791315', time=2024-04-03T06:32:30.166943+0000, chain.objs.size()=1 2024-04-03T05:14:08.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-KHGHSDCDIPjPFHionA4aOZAZ1577Df_0 2024-04-03T05:14:08.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1883926905558918235', time=2024-04-03T06:32:30.753373+0000, chain.objs.size()=1 2024-04-03T05:14:08.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.A0d5zIxSdmfvG2KCPN9BhrXECwedYIo_0 2024-04-03T05:14:08.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7492692007034212055', time=2024-04-03T06:32:31.698881+0000, chain.objs.size()=1 2024-04-03T05:14:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VjsuvQ3-IiD4SAeAzqVDyH9F1nR6H8E_0 2024-04-03T05:14:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7284078609623421876', time=2024-04-03T06:32:32.248439+0000, chain.objs.size()=1 2024-04-03T05:14:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5fsKATjwmM-GytavIvNyUJ4wiWEfulm_0 2024-04-03T05:14:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1666667615488817292', time=2024-04-03T06:32:32.671073+0000, chain.objs.size()=1 2024-04-03T05:14:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.bcSUdgj6nx6XyWX2tuRfo5FkjYRmDkN_0 2024-04-03T05:14:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3963364938894005851', time=2024-04-03T06:32:33.531648+0000, chain.objs.size()=1 2024-04-03T05:14:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.az6X3jHLQk97L9sK4OUYVTnJjaX_aNw_0 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12218273512334087385', time=2024-04-03T06:32:36.026599+0000, chain.objs.size()=1 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.m6UzCJJImMkgCppEDOw8dV1KTEnTg6Z_0 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2776095763890268691', time=2024-04-03T06:32:37.652816+0000, chain.objs.size()=1 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UXlsjWZWvD9ET1nJSui3ZA7FQ_-k-86_0 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6946139477166852064', time=2024-04-03T06:32:40.262384+0000, chain.objs.size()=1 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qO-TeRQYp_ykyXnJGPwsyl1xduwahKJ_0 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4180236121944721563', time=2024-04-03T06:32:40.492476+0000, chain.objs.size()=1 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HhKJu0fTNPxA1UFNwP9Z_TvKAKmFCuj_0 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.923644559870359299', time=2024-04-03T06:32:40.727830+0000, chain.objs.size()=1 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YMUCQylsSHGrTZKJqmXbXrKBfuVhV_v_0 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9498101153491409857', time=2024-04-03T06:32:41.464935+0000, chain.objs.size()=1 2024-04-03T05:14:08.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HfaSRf-wNw8N5yXx0Rteo6896k02v6N_0 2024-04-03T05:14:08.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4153957820329886711', time=2024-04-03T06:32:41.466510+0000, chain.objs.size()=1 2024-04-03T05:14:08.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.X-owx-yGWDEutsKRiFgj8RdQIuQkEmp_0 2024-04-03T05:14:08.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5862514390677453458', time=2024-04-03T06:32:41.501286+0000, chain.objs.size()=1 2024-04-03T05:14:08.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.w1jYdPCPplDhVryNdiT0-OapUtc46By_0 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14092660239472501196', time=2024-04-03T06:32:41.684713+0000, chain.objs.size()=1 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.QFOq6f33QJEze17oYYXd8phOnPvHNHS_0 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7642527836002694278', time=2024-04-03T06:32:41.686723+0000, chain.objs.size()=1 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.bhJJAV3jsLTsOvzRAPbgL527E-OIRbG_0 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1552535832699035335', time=2024-04-03T06:32:42.017810+0000, chain.objs.size()=1 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.st0aTZIOj6-Ex-d9wckG2aRaRWpXENL_0 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1930883353744421998', time=2024-04-03T06:32:42.019713+0000, chain.objs.size()=1 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7CnZtGuIS1P2YEb_L428EvLDmoMOL0t_0 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11916347176491380167', time=2024-04-03T06:32:42.978876+0000, chain.objs.size()=1 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.f05z47JCUMFqpo0g6NuOZyiq14t_6pO_0 2024-04-03T05:14:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8102239106886195485', time=2024-04-03T06:32:43.007280+0000, chain.objs.size()=1 2024-04-03T05:14:08.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.JbUXE9AIDA7rqg7eNCzge6VBM0fNwBn_0 2024-04-03T05:14:08.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16650377360893965459', time=2024-04-03T06:32:43.617891+0000, chain.objs.size()=1 2024-04-03T05:14:08.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cYe_Tqpb6c0nlacIexRcI2Y_BxRBy2b_0 2024-04-03T05:14:08.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7243008449442441774', time=2024-04-03T06:32:43.731565+0000, chain.objs.size()=1 2024-04-03T05:14:08.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Y2TFh26WXSUaMwHzMYJcwYbiFmZUvDd_0 2024-04-03T05:14:08.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10295557854438087117', time=2024-04-03T06:32:43.789368+0000, chain.objs.size()=1 2024-04-03T05:14:08.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.KIqQNoN5YjjvcKLeRmb9yeg8FKZcuZM_0 2024-04-03T05:14:08.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.892625913000296511', time=2024-04-03T06:32:43.828265+0000, chain.objs.size()=1 2024-04-03T05:14:08.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Xy4mW_OuyRYPiHLOHNE1IhyBg3D6G7g_0 2024-04-03T05:14:08.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13481750217720435020', time=2024-04-03T06:32:44.070714+0000, chain.objs.size()=1 2024-04-03T05:14:08.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.KUvH1iXD33x2ibnWzSiY9eAotkdqs3r_0 2024-04-03T05:14:08.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17057317218372467472', time=2024-04-03T06:32:44.452982+0000, chain.objs.size()=1 2024-04-03T05:14:08.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pJxPHcrEDtjc7v1LqDlOfoZIdlKzr6q_0 2024-04-03T05:14:08.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17792481193285120718', time=2024-04-03T06:32:44.579870+0000, chain.objs.size()=1 2024-04-03T05:14:08.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8SzCbYIFPLPiJFFy4Suc1adFehZ2c4L_0 2024-04-03T05:14:08.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13026724483585617089', time=2024-04-03T06:32:44.797667+0000, chain.objs.size()=1 2024-04-03T05:14:08.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.iF4Llhb23UDvjnTG_liN9RKl-oGs5gq_0 2024-04-03T05:14:08.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5453473672160655251', time=2024-04-03T06:32:48.083735+0000, chain.objs.size()=1 2024-04-03T05:14:08.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7KQoINDq_tUX-zdfhybdgd7r6q_jq8S_0 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14313421379074027762', time=2024-04-03T06:32:48.378336+0000, chain.objs.size()=1 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AsUPLMFuKX28dqp6p7oVJMx4G6grfyA_0 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8758250679749853584', time=2024-04-03T06:32:49.138493+0000, chain.objs.size()=1 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.T1qymHe0sLILkCDXutR08vbZc7XGc9X_0 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11768373123040743936', time=2024-04-03T06:32:49.964768+0000, chain.objs.size()=1 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BrnwhCuFe-ClpO3kzSZ3Ehx8g48Z-cQ_0 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4191851881028189466', time=2024-04-03T06:32:50.066312+0000, chain.objs.size()=1 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lj4f3wHbvqwkYOnAhd14t9GY-ZV6zMl_0 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13007906549152447580', time=2024-04-03T06:32:50.069967+0000, chain.objs.size()=1 2024-04-03T05:14:08.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cnAu2mXwZlBjdsxT5mIRm6boyHsPqm__0 2024-04-03T05:14:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13440893278564449188', time=2024-04-03T06:32:51.545848+0000, chain.objs.size()=1 2024-04-03T05:14:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.le8PbC6KR23OZAhruJb8cKa_Qjwgk2c_0 2024-04-03T05:14:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5260854473722202733', time=2024-04-03T06:32:52.107083+0000, chain.objs.size()=1 2024-04-03T05:14:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7b5LLC9g-3rtbtGHj-L2x8_-WtKIJZp_0 2024-04-03T05:14:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2419769803421501826', time=2024-04-03T06:34:28.532167+0000, chain.objs.size()=1 2024-04-03T05:14:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0dq2rOioNUsZi4Z__6VNI-9tr-Kxzyw_0 2024-04-03T05:14:08.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1302859862226365503', time=2024-04-03T06:34:29.023466+0000, chain.objs.size()=1 2024-04-03T05:14:08.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xeqmybr7_x3xbn5qvEO9OEZggOHYgjm_0 2024-04-03T05:14:08.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5652907059189432706', time=2024-04-03T06:34:30.512755+0000, chain.objs.size()=1 2024-04-03T05:14:08.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dLuCpISfEWohokZiznqNOgc85DJ7JT3_0 2024-04-03T05:14:08.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13729923247115969248', time=2024-04-03T06:34:34.145228+0000, chain.objs.size()=1 2024-04-03T05:14:08.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kk2Ic2l0HSAT0L_5XBHKOU8Vwsclyla_0 2024-04-03T05:14:08.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.735048213900734281', time=2024-04-03T06:34:34.347078+0000, chain.objs.size()=1 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.k0KYJYvs9TQ0xBPQOVwPcW6bcK0sWPr_0 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.903375484218497805', time=2024-04-03T06:34:37.188091+0000, chain.objs.size()=1 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LMrBRtrz8Y-JXo5zAabDdAZi0Psiu81_0 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3350757414671262725', time=2024-04-03T06:34:37.471923+0000, chain.objs.size()=1 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zNl3iPeCwM4dSp6lDEATqyHjDwfObXl_0 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6752497623980127357', time=2024-04-03T06:34:37.509035+0000, chain.objs.size()=1 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.51GuVhlIYONSBWB1qxEIOYUhlvqT8Fh_0 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1026183611224014066', time=2024-04-03T06:34:40.954457+0000, chain.objs.size()=1 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cgA0BWS63caoOijsffGemLm64lrzV-T_0 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.870209188717769312', time=2024-04-03T06:34:41.083145+0000, chain.objs.size()=1 2024-04-03T05:14:08.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.l5KdtDaq_sRHF31eVhsie4bYjHC6gFw_0 2024-04-03T05:14:08.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9497503645850336243', time=2024-04-03T06:34:41.268900+0000, chain.objs.size()=1 2024-04-03T05:14:08.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7zfbXvYqX9L4-iWcjkVL2jDUgHXO-C7_0 2024-04-03T05:14:08.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/55071 2024-04-03T05:14:08.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-04-03T05:14:08.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9412324122717092889', time=2024-04-03T06:34:43.753020+0000, chain.objs.size()=1 2024-04-03T05:14:08.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0dg4PnAviwEgSlluVvzwPPY6RE7S2Lj_0 2024-04-03T05:14:08.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17950027427208028786', time=2024-04-03T06:34:44.103275+0000, chain.objs.size()=1 2024-04-03T05:14:08.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.UxW7p6-4v8lTLW8IvbWgtH4rqgbqNxZ_0 2024-04-03T05:14:08.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9477330550583721131', time=2024-04-03T06:34:46.141442+0000, chain.objs.size()=1 2024-04-03T05:14:08.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.S-tnzSEKPsbNXxUKN1wGToYJnupumpD_0 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13414397280533676014', time=2024-04-03T06:34:47.517166+0000, chain.objs.size()=1 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dNcl82cRb9Hvz9aI8pnOVUT8FCnrPbc_0 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6422156614416798285', time=2024-04-03T06:34:48.605007+0000, chain.objs.size()=1 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LY5qFxnAOuy3dwsO00n-PybDnKHnO01_0 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2578900396606220087', time=2024-04-03T06:34:49.367440+0000, chain.objs.size()=1 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.eL_mi9CpyQGTjCS5cu-M4N6lcPR4QmR_0 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18110660063814693297', time=2024-04-03T06:34:49.429956+0000, chain.objs.size()=1 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QmodD4-fb_UQ1eoIUgQIayjcXhvAAch_0 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2727798749284397913', time=2024-04-03T06:34:51.789501+0000, chain.objs.size()=1 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CXSJ3jsMW7_s6jtNctXSZZZXR4S05rR_0 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11351260381968205602', time=2024-04-03T06:34:52.376189+0000, chain.objs.size()=1 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.llqnox8_k5RfOhBILgsR04ylFDCS24F_0 2024-04-03T05:14:08.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10512180253856306879', time=2024-04-03T06:34:53.405761+0000, chain.objs.size()=1 2024-04-03T05:14:08.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.l03-W0p45OIa35tL0IzAcqi6Ksi0e6r_0 2024-04-03T05:14:08.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1127328221813454213', time=2024-04-03T06:34:53.551904+0000, chain.objs.size()=1 2024-04-03T05:14:08.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hpCycVKnPOae1fe-eaZKYvk9VAz7FYF_0 2024-04-03T05:14:08.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9278890088306961339', time=2024-04-03T06:34:54.515831+0000, chain.objs.size()=1 2024-04-03T05:14:08.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IFUsQSrVPx-9U573XxySsnY7_EJ1fJ__0 2024-04-03T05:14:08.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16410937283826106615', time=2024-04-03T06:34:54.990102+0000, chain.objs.size()=1 2024-04-03T05:14:08.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Sk2lUqzxOXK-9T_nuWlNIi0PWJXk_HA_0 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13243994103132896962', time=2024-04-03T06:34:55.177598+0000, chain.objs.size()=1 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vY3GUO-D59dwwt9VNEBeaU6pv8dJjpi_0 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11796872346001684047', time=2024-04-03T06:34:55.379190+0000, chain.objs.size()=1 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KMjnb_eqHqTnqJnUHJxQKLD5f5MZVw8_0 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.768161043082684433', time=2024-04-03T06:34:56.579627+0000, chain.objs.size()=1 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.HDDMHrizN522lNri_bNbAxK4mq4y_7I_0 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7525865651281490714', time=2024-04-03T06:37:10.986823+0000, chain.objs.size()=1 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.363__shadow:IiosM8vpAegwpQk3iZ6SEGAlP1ZjqN-_.L_xljtfvIUQ6SSklCOsRqnL-i59WQFv_0 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12136461265616365603', time=2024-04-03T06:39:04.434370+0000, chain.objs.size()=1 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.419__shadow_.VPBLf_QBkWKh_p616h75kYBOJqKSyms_0 2024-04-03T05:14:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9217252221061091950', time=2024-04-03T06:40:44.167540+0000, chain.objs.size()=1 2024-04-03T05:14:08.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.465__shadow_.zp0-638skNtfHlIlb2aqBlBLgh6px6Q_0 2024-04-03T05:14:08.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16853957562707736192', time=2024-04-03T06:41:49.512661+0000, chain.objs.size()=1 2024-04-03T05:14:08.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.481__multipart_mymultipart.2~xf7ct-qhF7x-igDE1LRl1UHg28raQ9C.1 2024-04-03T05:14:08.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~ZETzMmfaXBIQTykh7-KVVA3o0o7s28g', time=2024-04-03T06:49:45.865382+0000, chain.objs.size()=1 2024-04-03T05:14:08.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.505__multipart_mymultipart.2~ZETzMmfaXBIQTykh7-KVVA3o0o7s28g.3 2024-04-03T05:14:08.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~87wATaQ1IZhS3cXaaKudN6DNhppmGKt', time=2024-04-03T06:52:13.997455+0000, chain.objs.size()=1 2024-04-03T05:14:08.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.530__multipart_mymultipart.2~87wATaQ1IZhS3cXaaKudN6DNhppmGKt.1 2024-04-03T05:14:08.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4756105503358078651', time=2024-04-03T06:53:32.023208+0000, chain.objs.size()=1 2024-04-03T05:14:08.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:7H0GkmlUr-4kZIvvlhIVHZNpppcjZxW_.YwZ4yyTnMteHSjDdAvNjBXIrFLNVEqm_0 2024-04-03T05:14:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4581216835318314631', time=2024-04-03T06:54:13.793669+0000, chain.objs.size()=1 2024-04-03T05:14:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:qZK0Y5lc6aMAM6VYWebvVSBEdtRLWfk_.znGvn3TGPYbHuAbC5BGX8O-cV5iyBxn_0 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7827172922873577104', time=2024-04-03T06:55:47.952392+0000, chain.objs.size()=1 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.556__shadow:5Wb.3hpoNXRL1NKj0soM5b1v3Y-W2iE_.OlhObz5lqd2AtMN2UJwzEmbrh_yQ_Qv_0 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4091788904139496312', time=2024-04-03T06:56:28.048888+0000, chain.objs.size()=1 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.577__shadow_.lArHFJvWsVgXld8jGNIKGsLrW4xfHqy_0 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9260766599685330670', time=2024-04-03T07:01:13.904147+0000, chain.objs.size()=1 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.600__shadow_.JeWcNgRuAZWHc5sUeY7uziUqTWiho7s_0 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9437495061428270161', time=2024-04-03T07:02:03.893930+0000, chain.objs.size()=1 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.613__shadow_.OSIuKudcRREoB52BTMte4scN61bAq2q_0 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18251225348077048416', time=2024-04-03T07:04:36.020644+0000, chain.objs.size()=1 2024-04-03T05:14:08.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.660__shadow_.J6CNq8TNQQqnXicSN23r6g_Iz34rONY_0 2024-04-03T05:14:08.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.684__shadow_.TxNcvPu96Ikfo8bNl6qAGOYr_af9vPt_1_20d6838891f13ce12cceeeb988f62893', time=2024-04-03T07:05:43.401270+0000, chain.objs.size()=1 2024-04-03T05:14:08.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.813+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.684__shadow_.TxNcvPu96Ikfo8bNl6qAGOYr_af9vPt_0 2024-04-03T05:14:08.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.825+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:08.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-03T05:14:08.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:08.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:08.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49780' 2024-04-03T05:14:08.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2876897483082344716', time=2024-04-03T06:22:12.641305+0000, chain.objs.size()=5 2024-04-03T05:14:08.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__multipart_foo-STANDARD.2~FyIvp-MYflyTtv25oBlgICfCCD4N-wS.1 2024-04-03T05:14:08.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_foo-STANDARD.2~FyIvp-MYflyTtv25oBlgICfCCD4N-wS.1_1 2024-04-03T05:14:08.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__multipart_foo-STANDARD.2~FyIvp-MYflyTtv25oBlgICfCCD4N-wS.2 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_foo-STANDARD.2~FyIvp-MYflyTtv25oBlgICfCCD4N-wS.2_1 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__multipart_foo-STANDARD.2~FyIvp-MYflyTtv25oBlgICfCCD4N-wS.3 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_PrjEzDP8Wp0GwiSnUL4cnmKOGFtmCFZ', time=2024-04-03T06:22:41.093828+0000, chain.objs.size()=3 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.zJJzzokCU0bYcV2scN0o_22N3nOJwKY_0 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.zJJzzokCU0bYcV2scN0o_22N3nOJwKY_1 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.zJJzzokCU0bYcV2scN0o_22N3nOJwKY_2 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16842320118164677089', time=2024-04-03T06:25:16.929706+0000, chain.objs.size()=1 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.205__shadow_.ANcIArViirBQrx53TaJo5fGp-6hcx_U_0 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18202689110510698444', time=2024-04-03T06:25:24.426751+0000, chain.objs.size()=1 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.207__shadow_.4eiTjCk5Th26wTimnzEbN4tUwwjBliK_0 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8499305650641386930', time=2024-04-03T06:25:32.435607+0000, chain.objs.size()=1 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.211__shadow_.9eWKkivq-1fXs3C4ChNGGbg8PcPz2SJ_0 2024-04-03T05:14:08.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4805256933231732692', time=2024-04-03T06:25:46.513697+0000, chain.objs.size()=1 2024-04-03T05:14:08.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.216__shadow_.gTNH-Xo9DiOgo1mP7_GtjX8y6k-HVH__0 2024-04-03T05:14:08.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7469159241798696703', time=2024-04-03T06:27:52.393088+0000, chain.objs.size()=1 2024-04-03T05:14:08.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.x4QtoqDP3-4AsMqj3VsuNCmQFsibmOU_0 2024-04-03T05:14:08.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5461002147319204295', time=2024-04-03T06:27:53.938029+0000, chain.objs.size()=1 2024-04-03T05:14:08.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7Y7AsBJbX6BFExZb-F1zNtTc9RdxTOw_0 2024-04-03T05:14:08.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13754287679146969234', time=2024-04-03T06:27:54.852041+0000, chain.objs.size()=1 2024-04-03T05:14:08.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.YWCbo4BQxYWhP1YHLfxMefNbwZsYSzz_0 2024-04-03T05:14:08.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13181066971105015888', time=2024-04-03T06:27:56.356164+0000, chain.objs.size()=1 2024-04-03T05:14:08.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ykoQuxZmzI8CZI_EgWh6Kh3lt1Bftpf_0 2024-04-03T05:14:08.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11443863900067941838', time=2024-04-03T06:27:56.687912+0000, chain.objs.size()=1 2024-04-03T05:14:08.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4NSnuRkebnbgUaeXaWS48-zvv_hWtRl_0 2024-04-03T05:14:08.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.136977573367851262', time=2024-04-03T06:27:57.047539+0000, chain.objs.size()=1 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.VSshGSTv55yBrBIRo85X_kFIdiui2Z2_0 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8424098748094919029', time=2024-04-03T06:27:58.291264+0000, chain.objs.size()=1 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.IApTVO9_G81Y-QZxO-Yj8kfJArpP83m_0 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16658156591090409501', time=2024-04-03T06:27:59.030831+0000, chain.objs.size()=1 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7JKVs0nQJUGbPYiysHfZeEgjUZWgtVm_0 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16962718582156757568', time=2024-04-03T06:28:00.943473+0000, chain.objs.size()=1 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7Pg-sPZgB4q6I7XlQZAG9lJDvUOheni_0 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1615020420718531275', time=2024-04-03T06:28:01.645767+0000, chain.objs.size()=1 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.50NYOHb7tebb6xtZWT7oJhiypzLrY28_0 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6405932783221004528', time=2024-04-03T06:28:02.142231+0000, chain.objs.size()=1 2024-04-03T05:14:08.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sQEp12ylWBsqYll0mfo5-CDhZwPX-Df_0 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11482058883562238930', time=2024-04-03T06:28:02.388445+0000, chain.objs.size()=1 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.li2hMLbIgomiIGS8TPqLh7qoDLkfuSH_0 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10701703199026441849', time=2024-04-03T06:28:02.492613+0000, chain.objs.size()=1 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xqeMYDqNO6NAPyjekfKA2mGyEYu2tDK_0 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8360732881724456443', time=2024-04-03T06:28:02.736851+0000, chain.objs.size()=1 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Ctm3NAtfxuPfqSuYh8026UjIWBwuvO9_0 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6687961393485200724', time=2024-04-03T06:28:05.840469+0000, chain.objs.size()=1 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cMdTff5IKid7Dz30HWSv9oNqXmP1WsD_0 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5261957552362456578', time=2024-04-03T06:28:05.844094+0000, chain.objs.size()=1 2024-04-03T05:14:08.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UoO0xZAwdDgAScUC62dnP9nzArzSsVd_0 2024-04-03T05:14:08.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8596705928833251412', time=2024-04-03T06:28:06.041849+0000, chain.objs.size()=1 2024-04-03T05:14:08.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-r7lWRfQXuTLLAQywzOxx0oJJnNHGs6_0 2024-04-03T05:14:08.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2983244492977013438', time=2024-04-03T06:28:06.529283+0000, chain.objs.size()=1 2024-04-03T05:14:08.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OmqKT8jjIdY-ul9C1Jljry4IufQ5sJ4_0 2024-04-03T05:14:08.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14689225437090237672', time=2024-04-03T06:28:06.633348+0000, chain.objs.size()=1 2024-04-03T05:14:08.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0fvcKamnZ_YXrAxGIkgMBUkbilWJRMT_0 2024-04-03T05:14:08.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2785356692089367261', time=2024-04-03T06:28:08.560039+0000, chain.objs.size()=1 2024-04-03T05:14:08.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.a7nScohAMAZsls58WYUd89EZ-BY4owm_0 2024-04-03T05:14:08.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4653930678818754949', time=2024-04-03T06:28:08.635377+0000, chain.objs.size()=1 2024-04-03T05:14:08.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UDo7P5EOl7WWTPg5xYP0Rm5ImGD6Izu_0 2024-04-03T05:14:08.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5097893871461835919', time=2024-04-03T06:28:08.880963+0000, chain.objs.size()=1 2024-04-03T05:14:08.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.G2wmfhuOAAe-CQFCCf2O_6JznL_weeq_0 2024-04-03T05:14:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9473823495511214242', time=2024-04-03T06:28:09.193453+0000, chain.objs.size()=1 2024-04-03T05:14:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jClXtUY88jjh8qK1UsfuUd_9PEuGRgR_0 2024-04-03T05:14:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6810726113064077302', time=2024-04-03T06:28:10.201490+0000, chain.objs.size()=1 2024-04-03T05:14:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WMpb-wczYRj4NyKFRqv6bNMQVYX_8ap_0 2024-04-03T05:14:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7104456350217371412', time=2024-04-03T06:28:10.388264+0000, chain.objs.size()=1 2024-04-03T05:14:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0IrS3cf6nKwjZ9pd0Cg7MGMJdUXGS3T_0 2024-04-03T05:14:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5402556084226841849', time=2024-04-03T06:28:10.520671+0000, chain.objs.size()=1 2024-04-03T05:14:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.zCedbnCh4abqkuqPZq-hsViVenZ5C3t_0 2024-04-03T05:14:08.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3552119102486919206', time=2024-04-03T06:28:10.778262+0000, chain.objs.size()=1 2024-04-03T05:14:08.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DzWkZkl5heeQ81gFTpFacamRcS5SJCy_0 2024-04-03T05:14:08.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4417403346810487090', time=2024-04-03T06:28:11.561873+0000, chain.objs.size()=1 2024-04-03T05:14:08.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ts_5rmA63MbfPZllANIAgJ769E1f8W0_0 2024-04-03T05:14:08.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16006568789702666731', time=2024-04-03T06:28:11.640349+0000, chain.objs.size()=1 2024-04-03T05:14:08.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oVFUwZ1GZCcsQoyS5ENT8HdpyOXTJ9u_0 2024-04-03T05:14:08.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5237215961269380755', time=2024-04-03T06:28:12.249297+0000, chain.objs.size()=1 2024-04-03T05:14:08.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.SogC8jETZkkKFyblqhHoqQfj7Gk6WhJ_0 2024-04-03T05:14:08.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7504020065481974742', time=2024-04-03T06:28:15.462806+0000, chain.objs.size()=1 2024-04-03T05:14:08.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BNvQPZi_lraCRL0qS7DoK299BS9iFqe_0 2024-04-03T05:14:08.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6887718393799758914', time=2024-04-03T06:28:15.907824+0000, chain.objs.size()=1 2024-04-03T05:14:08.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Q1AEBFag21xRf0wAZHh8XA6B9ZKsWfa_0 2024-04-03T05:14:08.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15714072246462178832', time=2024-04-03T06:28:15.952318+0000, chain.objs.size()=1 2024-04-03T05:14:08.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.51FIqq5jhAopeGQfhrbg6cKAjZjenLH_0 2024-04-03T05:14:08.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17644125017898844961', time=2024-04-03T06:28:16.011804+0000, chain.objs.size()=1 2024-04-03T05:14:08.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oyNJmyGhW_h1gIari734nOO7L9T1N_S_0 2024-04-03T05:14:08.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2431236616168550555', time=2024-04-03T06:28:16.191210+0000, chain.objs.size()=1 2024-04-03T05:14:08.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ykhFDIgnX7rpARgeF35rq_DT6ClyWNe_0 2024-04-03T05:14:08.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3520716433143332793', time=2024-04-03T06:28:16.817035+0000, chain.objs.size()=1 2024-04-03T05:14:08.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3LVn7wPX9r3g9etLQOc7B7DnE3XVy2Y_0 2024-04-03T05:14:08.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15400651446656590057', time=2024-04-03T06:28:16.857234+0000, chain.objs.size()=1 2024-04-03T05:14:08.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.O5MEA-MVMUKNnX9pmdm_y6-xgr2ryNp_0 2024-04-03T05:14:08.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16307983764884989236', time=2024-04-03T06:28:17.887390+0000, chain.objs.size()=1 2024-04-03T05:14:08.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dxSkpWnk2DkjdpNbVMSZOJX6CyM5qjE_0 2024-04-03T05:14:08.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2175670960345640416', time=2024-04-03T06:28:20.574011+0000, chain.objs.size()=1 2024-04-03T05:14:08.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jTKf1fzBPHeKm35GtaKFyqfo7hdOmxg_0 2024-04-03T05:14:08.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12148956752555473086', time=2024-04-03T06:29:11.491229+0000, chain.objs.size()=1 2024-04-03T05:14:08.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.254__shadow_.YCxJtXQG6lp9HYmXd1WbvKdWe23gSse_0 2024-04-03T05:14:08.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7369270328411721011', time=2024-04-03T06:29:30.643686+0000, chain.objs.size()=1 2024-04-03T05:14:08.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.k0Suu7s_dIuWXluUIO3VglfHJnqQB52_0 2024-04-03T05:14:08.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.533124357711458754', time=2024-04-03T06:29:51.954291+0000, chain.objs.size()=1 2024-04-03T05:14:08.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.269__shadow_.FI1iJV_kB_01QyUO84hHXDc4kkQqx7K_0 2024-04-03T05:14:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17574501146227930779', time=2024-04-03T06:29:56.325313+0000, chain.objs.size()=1 2024-04-03T05:14:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.271__shadow_.NFk4QyliNw3L7lDAIzwtByyAGLLHrv1_0 2024-04-03T05:14:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6883922562193836662', time=2024-04-03T06:30:47.544031+0000, chain.objs.size()=1 2024-04-03T05:14:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.291__shadow_.5VTuS7qkM5GKXUJv-CWECn6aevKRBtS_0 2024-04-03T05:14:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4568299755385258288', time=2024-04-03T06:32:24.621072+0000, chain.objs.size()=1 2024-04-03T05:14:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gnLllLAMoBO4CV9JS4eukfAhmagSTFC_0 2024-04-03T05:14:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11595809508644101564', time=2024-04-03T06:32:25.089358+0000, chain.objs.size()=1 2024-04-03T05:14:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yap0peET2bCvfAgYqP0Lqa1UkFqgvp0_0 2024-04-03T05:14:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2162450054195960474', time=2024-04-03T06:32:25.561736+0000, chain.objs.size()=1 2024-04-03T05:14:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FMXvv4brtCkCr92JNm_0nI54cZKxez7_0 2024-04-03T05:14:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3275403932333874856', time=2024-04-03T06:32:25.699410+0000, chain.objs.size()=1 2024-04-03T05:14:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.C7DSnJC7fInjV9Pe__TZLtUW5kn_r0l_0 2024-04-03T05:14:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1524106790052882458', time=2024-04-03T06:32:26.275819+0000, chain.objs.size()=1 2024-04-03T05:14:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.oTCxABi71CPIeARNAEpcqXCdOn7j1Xl_0 2024-04-03T05:14:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14780900970851671771', time=2024-04-03T06:32:27.092756+0000, chain.objs.size()=1 2024-04-03T05:14:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.w00iXyUDg_RzdChQ9kQtXkH5F3R2BRC_0 2024-04-03T05:14:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2269497275940884341', time=2024-04-03T06:32:30.354511+0000, chain.objs.size()=1 2024-04-03T05:14:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2m79eTZunTj6GrjxK-2j0Vw6gtnRPdj_0 2024-04-03T05:14:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16441044490701357178', time=2024-04-03T06:32:30.786898+0000, chain.objs.size()=1 2024-04-03T05:14:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.frbDow3Luh6FtrLFjDe7CQG0_Z5w5nB_0 2024-04-03T05:14:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12615870239591150894', time=2024-04-03T06:32:31.696826+0000, chain.objs.size()=1 2024-04-03T05:14:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.f9-UsiNc1JjlQr_m0AuQiDVu7YvrVlo_0 2024-04-03T05:14:08.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9698911500630731318', time=2024-04-03T06:32:31.936683+0000, chain.objs.size()=1 2024-04-03T05:14:08.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.KU8SRiCXEVwD4Jtl4LukIU_2MX85A_x_0 2024-04-03T05:14:08.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1609674259142977068', time=2024-04-03T06:32:33.401843+0000, chain.objs.size()=1 2024-04-03T05:14:08.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8V8YZzfrTzRHp9RygmQeorEJ02H4uCk_0 2024-04-03T05:14:08.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3169848675791271310', time=2024-04-03T06:32:33.546759+0000, chain.objs.size()=1 2024-04-03T05:14:08.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pL2M877qg5TRnPtUBgkwRXpgMdBLCLB_0 2024-04-03T05:14:08.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8898861916226918803', time=2024-04-03T06:32:34.293012+0000, chain.objs.size()=1 2024-04-03T05:14:08.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.D3YbGyHTzWXEMd2TLozf42xuEH9nKRR_0 2024-04-03T05:14:08.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6023776874134513310', time=2024-04-03T06:32:35.636456+0000, chain.objs.size()=1 2024-04-03T05:14:08.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tQP-sPuDzZuzFXorOoSXzRqMNuB9fP3_0 2024-04-03T05:14:08.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18119243346098296846', time=2024-04-03T06:32:35.638589+0000, chain.objs.size()=1 2024-04-03T05:14:08.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1hnhOiC6MNClTbIf5kng-J6Ar78eQGY_0 2024-04-03T05:14:08.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16271610387912547965', time=2024-04-03T06:32:35.640708+0000, chain.objs.size()=1 2024-04-03T05:14:08.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tIp7a_yP8EQ1MKnVED4-p6zsyGjNAAm_0 2024-04-03T05:14:08.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3164057071081720419', time=2024-04-03T06:32:36.091287+0000, chain.objs.size()=1 2024-04-03T05:14:08.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.SA1V-RRIwRnucjNV3sZMSFtx00ZrUHe_0 2024-04-03T05:14:08.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12434131023630925807', time=2024-04-03T06:32:36.276731+0000, chain.objs.size()=1 2024-04-03T05:14:08.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.bAPe3nnqeBLKdWe1yvAMGqLMnRk4vG6_0 2024-04-03T05:14:08.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14829144828378812634', time=2024-04-03T06:32:37.549110+0000, chain.objs.size()=1 2024-04-03T05:14:08.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XLc1A7yqGf9-907hfIJYFxWcYS32siX_0 2024-04-03T05:14:08.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16920894941376802462', time=2024-04-03T06:32:38.105714+0000, chain.objs.size()=1 2024-04-03T05:14:08.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.PsIb3RaU_VEsz6NQBUK9hpQ-qwiRh5t_0 2024-04-03T05:14:08.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15086381052721735004', time=2024-04-03T06:32:40.758928+0000, chain.objs.size()=1 2024-04-03T05:14:08.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.nMRF8YaqbxQQ6KCX5eK_aY3MTmvHGvg_0 2024-04-03T05:14:08.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17551574016922703646', time=2024-04-03T06:32:41.206092+0000, chain.objs.size()=1 2024-04-03T05:14:08.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.aI6XPacM3yFsTeU0wXG95vi1oU6eDrI_0 2024-04-03T05:14:08.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12929380901553212260', time=2024-04-03T06:32:41.289408+0000, chain.objs.size()=1 2024-04-03T05:14:08.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HCYphTfE54powkIBQRBkonN18d8hvmx_0 2024-04-03T05:14:08.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17939687124478693391', time=2024-04-03T06:32:44.973515+0000, chain.objs.size()=1 2024-04-03T05:14:08.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.v20N61yLT3_iqE1o3mDpD78UXiNFIaU_0 2024-04-03T05:14:08.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4361907489775634568', time=2024-04-03T06:32:45.062880+0000, chain.objs.size()=1 2024-04-03T05:14:08.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.E5eZBY8kNpDwFIWuvUu54cnkbnCb76B_0 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4843436257152726508', time=2024-04-03T06:32:45.697828+0000, chain.objs.size()=1 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.SVJIb6LG7KjXE75kKcT_jfuAU_LoNJM_0 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16488702583119918237', time=2024-04-03T06:32:46.439006+0000, chain.objs.size()=1 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Toi_tvXnzF-PeQ2XQJjmOrWiHIs0wVR_0 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.884237907227885158', time=2024-04-03T06:32:47.652334+0000, chain.objs.size()=1 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UUFYSbRcguygKi2ci6GTJEFo8IAWUt-_0 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1000902909469683058', time=2024-04-03T06:32:49.291937+0000, chain.objs.size()=1 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ZTZhWPFXPKzBb76R6Ma5o4okL0QHZ_l_0 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4408261188271458944', time=2024-04-03T06:32:50.052289+0000, chain.objs.size()=1 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0Ez0mAreIM9a4g1q1j63Neq-1y7bUgZ_0 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18183639364141129850', time=2024-04-03T06:32:50.369336+0000, chain.objs.size()=1 2024-04-03T05:14:08.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tdtTQdy0exPKxsyu3ZwsxYFRp6-wblG_0 2024-04-03T05:14:08.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15927640417048462609', time=2024-04-03T06:32:50.924456+0000, chain.objs.size()=1 2024-04-03T05:14:08.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mRuNZEblBKYWaXfakaQlmDFJrZwgDuE_0 2024-04-03T05:14:08.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11731467599751016559', time=2024-04-03T06:32:51.252099+0000, chain.objs.size()=1 2024-04-03T05:14:08.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uvMHQAWmWGrGH7K0FW02uaPw4f4zVcg_0 2024-04-03T05:14:08.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11677046197322879845', time=2024-04-03T06:32:52.055462+0000, chain.objs.size()=1 2024-04-03T05:14:08.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.iv2A-1zyEuem-MYgxHOmSKD2VX49mH__0 2024-04-03T05:14:08.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3827487923000893418', time=2024-04-03T06:32:52.203253+0000, chain.objs.size()=1 2024-04-03T05:14:08.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.R0a1yeV2JZtpcjNzydaVboRS1aScgP0_0 2024-04-03T05:14:08.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10649459280452764369', time=2024-04-03T06:32:52.205259+0000, chain.objs.size()=1 2024-04-03T05:14:08.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.77VADYdsTM0NzNHyGoIopOw_SrSRdsJ_0 2024-04-03T05:14:08.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18082707626681610587', time=2024-04-03T06:34:28.634139+0000, chain.objs.size()=1 2024-04-03T05:14:08.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8DckblWuZ4FfMAn06KqQHL6jFNDrlbY_0 2024-04-03T05:14:08.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15315863743571031977', time=2024-04-03T06:34:29.359542+0000, chain.objs.size()=1 2024-04-03T05:14:08.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.t1LKstaJWOfKPHBCVPtM0EV0fdvhy8d_0 2024-04-03T05:14:08.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9526798992326763385', time=2024-04-03T06:34:29.361434+0000, chain.objs.size()=1 2024-04-03T05:14:08.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xDGrHLB7KCF699IoCSCcBcVZzcWtC15_0 2024-04-03T05:14:08.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7773301776634046645', time=2024-04-03T06:34:31.344504+0000, chain.objs.size()=1 2024-04-03T05:14:08.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Sp72O8uml22R17hEI6TTh1bSirMx6HP_0 2024-04-03T05:14:08.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18368643410007749338', time=2024-04-03T06:34:31.430099+0000, chain.objs.size()=1 2024-04-03T05:14:08.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.X-yDQKQz5stZ0zDSTl9RqGfd6vD-zd5_0 2024-04-03T05:14:08.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1954396331910763408', time=2024-04-03T06:34:32.588254+0000, chain.objs.size()=1 2024-04-03T05:14:08.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ltrwNKp4H3iw3wOOHoiynrw_sj88iNA_0 2024-04-03T05:14:08.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4715194898165772349', time=2024-04-03T06:34:32.838153+0000, chain.objs.size()=1 2024-04-03T05:14:08.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.uhKkILSZeT03SMts_b7ktp10wjwduKO_0 2024-04-03T05:14:08.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4069834334839491043', time=2024-04-03T06:34:32.895511+0000, chain.objs.size()=1 2024-04-03T05:14:08.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.AwuSJAsw5JE6GWu_dvYMZLCxtxJdBTI_0 2024-04-03T05:14:08.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10148891843513440410', time=2024-04-03T06:34:34.673209+0000, chain.objs.size()=1 2024-04-03T05:14:08.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.aJIuhrtNXU9fBjUGQGWNn066M6dot6k_0 2024-04-03T05:14:08.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13373002302319177850', time=2024-04-03T06:34:36.607812+0000, chain.objs.size()=1 2024-04-03T05:14:08.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8Hkvdg1ZxPs1BO37gw7iYGWB0ycTlrz_0 2024-04-03T05:14:08.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6778963221994471057', time=2024-04-03T06:34:37.514937+0000, chain.objs.size()=1 2024-04-03T05:14:08.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.A7z-MXxt7_N8lvOkiFfDyBrxkukBDuj_0 2024-04-03T05:14:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13360572874641505100', time=2024-04-03T06:34:38.042377+0000, chain.objs.size()=1 2024-04-03T05:14:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.HyCDHcuXcxELl7UNYTqsJn8Zvo0COoE_0 2024-04-03T05:14:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5693292486703422887', time=2024-04-03T06:34:41.793519+0000, chain.objs.size()=1 2024-04-03T05:14:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pyNE6SSKf91DTiypvjKH7XW4zk0HDAC_0 2024-04-03T05:14:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.897+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2562423710117071492', time=2024-04-03T06:34:42.099324+0000, chain.objs.size()=1 2024-04-03T05:14:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.EwF2g_MPks3IfuwAmDqb89Wb6l4v2pS_0 2024-04-03T05:14:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/49780 2024-04-03T05:14:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-04-03T05:14:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12397708550503128050', time=2024-04-03T06:34:42.698441+0000, chain.objs.size()=1 2024-04-03T05:14:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.u_-VFPSJtuUCulExUI3W-XHXGoB0OHt_0 2024-04-03T05:14:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1573333017367314489', time=2024-04-03T06:34:43.741954+0000, chain.objs.size()=1 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.70S8DcBZbVOVSPfIpnppvrn4bHaER1X_0 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13930584761736412351', time=2024-04-03T06:34:44.038888+0000, chain.objs.size()=1 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QP8sAR-0TN5Og8viP54QGrsI-YheDEi_0 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16637029305537464293', time=2024-04-03T06:34:44.897583+0000, chain.objs.size()=1 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.jvo5BW0qE9y-v7WmTV1AWkdtxU4HlX9_0 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3618929759301737593', time=2024-04-03T06:34:45.642437+0000, chain.objs.size()=1 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XoiZIzuxGVvv45SOYGtsWacIWHB2Qft_0 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17778748198472402496', time=2024-04-03T06:34:45.856519+0000, chain.objs.size()=1 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wlYnXaidvSNZAVrMHVSzYkYGmy0ZNUO_0 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1836222747108139873', time=2024-04-03T06:34:46.207684+0000, chain.objs.size()=1 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._37pu4ggOdu1ZZiXSeMkbmycOxE32rJ_0 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14547055684371830468', time=2024-04-03T06:34:47.295055+0000, chain.objs.size()=1 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.T14NFqJRTPY_0PGJXHqUl0-fwBrcdpG_0 2024-04-03T05:14:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11241925219683039252', time=2024-04-03T06:34:47.725302+0000, chain.objs.size()=1 2024-04-03T05:14:08.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cXz9ojsC9z4hu3nRYDZabObqt1g8ItW_0 2024-04-03T05:14:08.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8545096351828417402', time=2024-04-03T06:34:48.888429+0000, chain.objs.size()=1 2024-04-03T05:14:08.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.UGD0XKX6xwBqcfMkI02oOMMx4A6Nbv2_0 2024-04-03T05:14:08.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6581721419308127234', time=2024-04-03T06:34:48.988482+0000, chain.objs.size()=1 2024-04-03T05:14:08.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ghpA0knskdAWc_ZAN92ITRqHWWzy25b_0 2024-04-03T05:14:08.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3316260630969793146', time=2024-04-03T06:34:49.663948+0000, chain.objs.size()=1 2024-04-03T05:14:08.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8sXtTVS0dJ2NiYQJnVeupY_PHP2HTNP_0 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8629756959394648777', time=2024-04-03T06:34:51.233876+0000, chain.objs.size()=1 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.WRrnFaW_6EtWz2rC-hJAsSVGHgdQesP_0 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3706138146373073057', time=2024-04-03T06:34:51.785445+0000, chain.objs.size()=1 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.h4NXPRwolvx8A8_qnpQ2CAUqFL0FGLD_0 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6639375784883436282', time=2024-04-03T06:34:52.010528+0000, chain.objs.size()=1 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7Yslwz3Yl54y-qJ36RrVGt-J0yN6d0w_0 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6319770898890488624', time=2024-04-03T06:34:52.402518+0000, chain.objs.size()=1 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.MB1aYc00l-fkNQL7-p4hE1RPoIBPm2Y_0 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17143840093234148576', time=2024-04-03T06:34:52.781254+0000, chain.objs.size()=1 2024-04-03T05:14:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xrTRimabuYKwQw-Ho0fcnYNPtQ99Q42_0 2024-04-03T05:14:08.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8254094174695739472', time=2024-04-03T06:34:54.650278+0000, chain.objs.size()=1 2024-04-03T05:14:08.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Zfm5xiZbhtRkST_tSdLiYpTrjNx7RaP_0 2024-04-03T05:14:08.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15973854905974904907', time=2024-04-03T06:34:56.429612+0000, chain.objs.size()=1 2024-04-03T05:14:08.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.tJZmn1Mtq1JZThAw27rdAhTLPbWvuYC_0 2024-04-03T05:14:08.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6798172143245133270', time=2024-04-03T06:35:05.485842+0000, chain.objs.size()=1 2024-04-03T05:14:08.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.298__shadow_.noTXC3Gc4NU_cDjiKUMBMezetrnZLF6_0 2024-04-03T05:14:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5670562470022308877', time=2024-04-03T06:38:46.426925+0000, chain.objs.size()=1 2024-04-03T05:14:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.412__shadow_.OH2IS1bgXAtyDJcOV5vsWzPQJX45rhz_0 2024-04-03T05:14:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16629493168097315751', time=2024-04-03T06:39:43.442201+0000, chain.objs.size()=1 2024-04-03T05:14:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.434__shadow_.KpELy3mmZSyN-CAhcV01tEFC7SRZNs-_0 2024-04-03T05:14:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5841077343216649365', time=2024-04-03T06:40:16.911270+0000, chain.objs.size()=1 2024-04-03T05:14:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.454__shadow_.XpsET0_l-2ju-OmiOqLHmc41iGKIGiV_0 2024-04-03T05:14:08.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14759938093638407337', time=2024-04-03T06:43:57.364653+0000, chain.objs.size()=1 2024-04-03T05:14:08.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.490__shadow:3uZSTBMsAzLYsr-FSNoQjGCGOZuBZgS_.YRp1mmXtfFxSAFRa6omBFH9oSB94wr5_0 2024-04-03T05:14:08.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk', time=2024-04-03T06:44:17.956364+0000, chain.objs.size()=2 2024-04-03T05:14:08.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.1 2024-04-03T05:14:08.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.1_1 2024-04-03T05:14:08.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4627870973422548226', time=2024-04-03T06:52:05.148153+0000, chain.objs.size()=1 2024-04-03T05:14:08.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.527__shadow_.XyRGp3VDEGzlHoIMy1SOjLSU7bIyWAK_0 2024-04-03T05:14:08.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17842356646494052768', time=2024-04-03T06:53:20.592291+0000, chain.objs.size()=1 2024-04-03T05:14:08.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow:WaMIWp7-.t7HAdAwP3n9kd2wvnymBND_._cmTtf1dtxCyofO3mFh-c1-XFJF1FYi_0 2024-04-03T05:14:08.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12137255443496442216', time=2024-04-03T06:54:17.330321+0000, chain.objs.size()=1 2024-04-03T05:14:08.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:zI4cK5eU77DJyp5375BxsPNlCVrnkYo_.-tauJcqhu3Ek2ChP5NdT6tVejLMYcLo_0 2024-04-03T05:14:08.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:E805VAtBd6H9pogkcGWg0Ox9sR19zt4_.0O0CQJKG3ukovqFPK5FwlFnQY-v3Pny_1_f69ba1db84f719d0d2a8fcc2d98ebc75', time=2024-04-03T06:55:28.966613+0000, chain.objs.size()=1 2024-04-03T05:14:08.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:E805VAtBd6H9pogkcGWg0Ox9sR19zt4_.0O0CQJKG3ukovqFPK5FwlFnQY-v3Pny_0 2024-04-03T05:14:08.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7385793068048100997', time=2024-04-03T06:55:44.237563+0000, chain.objs.size()=1 2024-04-03T05:14:08.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.555__shadow:ftTA2Z.8fYwDWZGuaXALcVU6pbrkjmU_.7WWqCt8miYZN1xmhWgirRNuIZw-LR-X_0 2024-04-03T05:14:08.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14449174361783476274', time=2024-04-03T07:01:57.849401+0000, chain.objs.size()=1 2024-04-03T05:14:08.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.612__shadow_.udIc8XTL971sxvuDpbljbmjyXuIrQt__0 2024-04-03T05:14:08.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.925+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9070359315976083528', time=2024-04-03T07:04:39.912704+0000, chain.objs.size()=1 2024-04-03T05:14:08.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.662__shadow:h7XLBIDx-Mqr99jGNlhK.rdsJeyS9Xa_.oB6GC3K7Ib60FCl1VRz-KMpDOz-JH3Z_0 2024-04-03T05:14:08.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.933+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-03T05:14:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:08.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50755' 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7921031603448148192', time=2024-04-03T06:23:39.594595+0000, chain.objs.size()=1 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.168__shadow_.DGcvYNguqPtHcFN9PAZfQB3HSET_nP2_0 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.177892722671116112', time=2024-04-03T06:25:20.712438+0000, chain.objs.size()=1 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.206__shadow_.rjgj3XebbgFwwFei0w92PAX5jN45mxF_0 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17420698879627504560', time=2024-04-03T06:26:06.274182+0000, chain.objs.size()=1 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.225__shadow_.cN_5RP_73BsGZixoL_QnvSqBTxqaCla_0 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14170242730642733934', time=2024-04-03T06:27:52.159243+0000, chain.objs.size()=1 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5jYyN3VNBQMkiiZR5srETlVkkp6gIBY_0 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9994589898655093798', time=2024-04-03T06:27:53.162240+0000, chain.objs.size()=1 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.x0Pd2BC8mS_uJrmIg6eSG-luaLctbJF_0 2024-04-03T05:14:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3675479590231502468', time=2024-04-03T06:27:53.698177+0000, chain.objs.size()=1 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mKHz1vaKbPdce969rtfPLYzHV_gnALJ_0 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.227187994272612546', time=2024-04-03T06:27:56.290291+0000, chain.objs.size()=1 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.uUl2DIlNAqjbgFIZH3s0mSoZXUsV6cp_0 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5551309113401847906', time=2024-04-03T06:28:01.340190+0000, chain.objs.size()=1 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.g0pxPtUeHJqkboq3QIQUxPtZp2Gz6f__0 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12984817575623080555', time=2024-04-03T06:28:01.518685+0000, chain.objs.size()=1 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8FoIbRik7r6OIVB4Cq90e0kwUw_BDNK_0 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10595186656856011495', time=2024-04-03T06:28:02.390179+0000, chain.objs.size()=1 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.bld0OFZpL9XtOCsWcnWvDVm3yX7SV7T_0 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17980632033843235915', time=2024-04-03T06:28:04.159151+0000, chain.objs.size()=1 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.hRg6x4EA04wbzNvEHUDOEUHJ4rOtZD8_0 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7335906518704328296', time=2024-04-03T06:28:04.364767+0000, chain.objs.size()=1 2024-04-03T05:14:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.woDgZZXSI29cn0MPEx7K2_UOXKU9UBq_0 2024-04-03T05:14:08.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17231268738689462791', time=2024-04-03T06:28:04.519317+0000, chain.objs.size()=1 2024-04-03T05:14:08.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3uzpZxaCYm5XXuUw4HdKXdK1a3XZpUo_0 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8195078588040706455', time=2024-04-03T06:28:05.718464+0000, chain.objs.size()=1 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Prk1cpMRL0uQGXKRLpxyDvrryrC-6NG_0 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10266482869425643664', time=2024-04-03T06:28:08.804264+0000, chain.objs.size()=1 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.E_5B6vDkdGGHjEqShxJwBldxUVZsh-O_0 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8608468544735214526', time=2024-04-03T06:28:09.533936+0000, chain.objs.size()=1 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jYz7RadJ_wUApFOIgJTtEsLygwO3l4H_0 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16882507687871930568', time=2024-04-03T06:28:10.170603+0000, chain.objs.size()=1 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.udebD_jIcXim6CQ0JOQf29tHhCNteAN_0 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17418194995031676597', time=2024-04-03T06:28:12.493811+0000, chain.objs.size()=1 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.B8hPc-K0QCC3yXvcqFNRmqznSQjy9Yq_0 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9460302156195660053', time=2024-04-03T06:28:12.988468+0000, chain.objs.size()=1 2024-04-03T05:14:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.47Giy5eIThtiXyosgFw7iOCrGUXVU9i_0 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2193989295978372681', time=2024-04-03T06:28:13.164932+0000, chain.objs.size()=1 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.agKKfgSb3VcenM3pZCYbPHM7qHu01SP_0 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11062855741926127771', time=2024-04-03T06:28:13.341242+0000, chain.objs.size()=1 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.M61P2fhHkicAViGNJAxCLMOFuWaC2Nl_0 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4056231897316812956', time=2024-04-03T06:28:15.240680+0000, chain.objs.size()=1 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.IxShGKVZCwj073vFO_mJWvpK-tbwBVj_0 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5595454051846615556', time=2024-04-03T06:28:15.650037+0000, chain.objs.size()=1 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0XDUPG0j5Ezo2cOk-_VcPS02Dpd_bl2_0 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9001004863269501367', time=2024-04-03T06:28:15.818670+0000, chain.objs.size()=1 2024-04-03T05:14:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.SLFF7ChD5jfqGkEAcORK5NAylj-Qrir_0 2024-04-03T05:14:08.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7665626028751506032', time=2024-04-03T06:28:15.927783+0000, chain.objs.size()=1 2024-04-03T05:14:08.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.KPw3rsUi8D0i6qOCt8i9Sx_zO1NbT48_0 2024-04-03T05:14:08.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9701584279694686372', time=2024-04-03T06:28:16.390386+0000, chain.objs.size()=1 2024-04-03T05:14:08.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.AjbUfxmbZTH8TjYQ7Y0Sob_tCHrSApP_0 2024-04-03T05:14:08.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8640237511083585502', time=2024-04-03T06:28:19.561454+0000, chain.objs.size()=1 2024-04-03T05:14:08.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.m-hK_QTxgLgQ_TF8tEfq83AvfO2mhX__0 2024-04-03T05:14:08.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12032709866504390639', time=2024-04-03T06:28:21.086721+0000, chain.objs.size()=1 2024-04-03T05:14:08.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5f4r0Hu2-X0x3B7g-sGMnQwXsDLlUK1_0 2024-04-03T05:14:08.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5048642310084559847', time=2024-04-03T06:28:59.511170+0000, chain.objs.size()=1 2024-04-03T05:14:08.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.249__shadow_.XuoD697uKyikpfGIaHv3U_SfqWNIaM9_0 2024-04-03T05:14:08.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.219253276453369492', time=2024-04-03T06:29:30.570223+0000, chain.objs.size()=1 2024-04-03T05:14:08.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.dnUnsxIsR1liavu-WN4dyOtyvHyplo-_0 2024-04-03T05:14:08.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3112579281884686113', time=2024-04-03T06:29:30.910196+0000, chain.objs.size()=1 2024-04-03T05:14:08.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.MJAn8nz44ZVYGMYpg8Q5sX14a2QafHl_0 2024-04-03T05:14:08.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15065963941273629602', time=2024-04-03T06:29:49.808645+0000, chain.objs.size()=1 2024-04-03T05:14:08.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.268__shadow_.mAIXpjNPUvtURetmO4BNa8nZJh-8LMv_0 2024-04-03T05:14:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7620349647480501313', time=2024-04-03T06:29:54.121537+0000, chain.objs.size()=1 2024-04-03T05:14:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.270__shadow_.d--RGZSY9KN46VbE-u3t3eywKWbwfEQ_0 2024-04-03T05:14:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9972831550766496851', time=2024-04-03T06:29:58.616472+0000, chain.objs.size()=1 2024-04-03T05:14:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.272__shadow_.pmleRqUSmoAjheL53_etXnp3OzlF07K_0 2024-04-03T05:14:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17168831024162337676', time=2024-04-03T06:32:24.210140+0000, chain.objs.size()=1 2024-04-03T05:14:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ciG0S99h88wjwkwbq50ijs8VqWbHLe__0 2024-04-03T05:14:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18424312175189092414', time=2024-04-03T06:32:25.183269+0000, chain.objs.size()=1 2024-04-03T05:14:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.p_lOyQYwbDLjzoKdx4Qz_Kk_qRZJopR_0 2024-04-03T05:14:08.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9633446544909846263', time=2024-04-03T06:32:25.185787+0000, chain.objs.size()=1 2024-04-03T05:14:08.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9K5wNeDhtcXPJfRZV_WphRI2SnYUZvS_0 2024-04-03T05:14:08.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2423187000632553836', time=2024-04-03T06:32:25.842644+0000, chain.objs.size()=1 2024-04-03T05:14:08.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.WFaGnqjd4-JiAll1ef74aVYhRiBjyMT_0 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11235244019353284052', time=2024-04-03T06:32:26.275862+0000, chain.objs.size()=1 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rJ3jAMtd9egbprKMAUPS4RviEeo5IDf_0 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8739100739599149822', time=2024-04-03T06:32:28.454079+0000, chain.objs.size()=1 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rxUlhq9fO1En2-0ZZSA7e50C1VQdcGI_0 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1002048871546482860', time=2024-04-03T06:32:28.716137+0000, chain.objs.size()=1 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XQHAFlPfrRtlYm4J5QywEapJh1xEG-w_0 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7241820349111753206', time=2024-04-03T06:32:28.939593+0000, chain.objs.size()=1 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cy3emAAeJQm1rU8IML0SVG9PTd40YCg_0 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10001315986039334410', time=2024-04-03T06:32:29.046303+0000, chain.objs.size()=1 2024-04-03T05:14:08.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VJ7dyzLHW-Tm8yhuEH1zl12MXlgW5MC_0 2024-04-03T05:14:08.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6353541808111289708', time=2024-04-03T06:32:29.713997+0000, chain.objs.size()=1 2024-04-03T05:14:08.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yID-nOpEM7KcuBJBR-Mwu8PmH98Or45_0 2024-04-03T05:14:08.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9757111863901248322', time=2024-04-03T06:32:30.421343+0000, chain.objs.size()=1 2024-04-03T05:14:08.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7cZrHyf2avMAgOdrmS66RJcSg-EM6MZ_0 2024-04-03T05:14:08.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5388211060374970021', time=2024-04-03T06:32:34.016247+0000, chain.objs.size()=1 2024-04-03T05:14:08.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cIliWm6wnu-_CUnqRZR5CmML-3x7uC6_0 2024-04-03T05:14:08.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16174932258288066023', time=2024-04-03T06:32:36.623203+0000, chain.objs.size()=1 2024-04-03T05:14:08.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4m2YkI3Yz0ZOLH7WkQPde4qGPd8zMpK_0 2024-04-03T05:14:08.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.961+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13154797914479631201', time=2024-04-03T06:32:36.910231+0000, chain.objs.size()=1 2024-04-03T05:14:08.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.961+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Ja16gZMVrrC_HkRARqxeRSFus22UOJo_0 2024-04-03T05:14:08.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8333368413035435121', time=2024-04-03T06:32:37.549119+0000, chain.objs.size()=1 2024-04-03T05:14:08.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UYU7CZ25vvDH3ox6YKxncy73g1z4ZW7_0 2024-04-03T05:14:08.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11936494510342544285', time=2024-04-03T06:32:37.935388+0000, chain.objs.size()=1 2024-04-03T05:14:08.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rVAmu-IMlI0MuphVaHwkKBJfZdHxXvD_0 2024-04-03T05:14:08.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2996146512489392892', time=2024-04-03T06:32:38.138315+0000, chain.objs.size()=1 2024-04-03T05:14:08.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0ZsTzBOGXG2_R3Nhegj8qpwG1yXUMaL_0 2024-04-03T05:14:08.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9017649988956697823', time=2024-04-03T06:32:41.826668+0000, chain.objs.size()=1 2024-04-03T05:14:08.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.t6ImjEoEd0kfKGf9mgL5wWej2dIt-FW_0 2024-04-03T05:14:08.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1102164981891400946', time=2024-04-03T06:32:41.827971+0000, chain.objs.size()=1 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xtXJPEglf80v7sUKiR_XZi9DwxUlLFw_0 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5161291314678976223', time=2024-04-03T06:32:44.247567+0000, chain.objs.size()=1 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.aKjiccv2C8r1O7i-VNiZlvj7T-2z53z_0 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7663591823979787311', time=2024-04-03T06:32:44.396667+0000, chain.objs.size()=1 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VkQ_URuoQ1DAGL-eqUcg48Al11UqN2O_0 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11985206735571034413', time=2024-04-03T06:32:47.091783+0000, chain.objs.size()=1 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cbi_klaegb0SUMDaD0C9o_tv2pdactF_0 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5300217607267996829', time=2024-04-03T06:32:47.657047+0000, chain.objs.size()=1 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.a6b2qGjQUaEMG_7EZ0O4tjQJkGt3DVp_0 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7016395033948566161', time=2024-04-03T06:32:48.382257+0000, chain.objs.size()=1 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EWO8DUgCLE2T7nJnaJJIIsA8lZUTlBg_0 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11033008232280692110', time=2024-04-03T06:32:48.608798+0000, chain.objs.size()=1 2024-04-03T05:14:08.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Bw8FDeN7ijYGQBC_egNfLJZSm-B1UEN_0 2024-04-03T05:14:08.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8953619237118431942', time=2024-04-03T06:32:50.494352+0000, chain.objs.size()=1 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ESuJ3LG1ij3nZRSlRQPmZK4zBbXcAvc_0 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.755064683369293485', time=2024-04-03T06:32:51.908256+0000, chain.objs.size()=1 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.kz2sfQiyxwh80kD7wptS7sjmZlegTyq_0 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7098569452322719099', time=2024-04-03T06:34:28.487084+0000, chain.objs.size()=1 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1UUmj9ng-gD2l58n_F73qr2X1zyxPMi_0 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4114594603031591754', time=2024-04-03T06:34:28.989954+0000, chain.objs.size()=1 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cM5STAijBTqb4L4i-XFnFlrJWHa5xd9_0 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13214148195522799239', time=2024-04-03T06:34:30.053719+0000, chain.objs.size()=1 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._NZ9YYBD2KjM2JbkUwvNpKF0V1lJ7YR_0 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16012892452681985155', time=2024-04-03T06:34:30.226832+0000, chain.objs.size()=1 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3s6fAcX8vPdH-1IOmfoDSO4ax3F1RQ5_0 2024-04-03T05:14:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14450756479054796729', time=2024-04-03T06:34:32.841450+0000, chain.objs.size()=1 2024-04-03T05:14:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3uChGur5X2EGkTmYv8PtnfvsE1jtjj-_0 2024-04-03T05:14:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12920161858202949002', time=2024-04-03T06:34:34.118852+0000, chain.objs.size()=1 2024-04-03T05:14:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pS6-uSp6wXvlgczclokt57gVATO2i22_0 2024-04-03T05:14:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11308091080896808965', time=2024-04-03T06:34:34.195774+0000, chain.objs.size()=1 2024-04-03T05:14:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ZIqDlGYvyQmgJsvpD0JvfuVwPT7FFNQ_0 2024-04-03T05:14:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11235685667853963479', time=2024-04-03T06:34:34.617517+0000, chain.objs.size()=1 2024-04-03T05:14:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.R5Yd8QBqp9NVSEE4wCxFCtyUbjV5Dbd_0 2024-04-03T05:14:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12458649089991833866', time=2024-04-03T06:34:34.750129+0000, chain.objs.size()=1 2024-04-03T05:14:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.OKNlXqSC4Ql0SLml4PYFA2ZwmIBMhk5_0 2024-04-03T05:14:08.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16665945888768977207', time=2024-04-03T06:34:38.353390+0000, chain.objs.size()=1 2024-04-03T05:14:08.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9EWr0R9CdbK1UnRx4i7X5dLBMr4-enS_0 2024-04-03T05:14:08.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11582644772516287096', time=2024-04-03T06:34:40.358226+0000, chain.objs.size()=1 2024-04-03T05:14:08.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QRUwQz9uYSt7RxvwNtgK2ftHVp0XrC3_0 2024-04-03T05:14:08.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.571902084781231891', time=2024-04-03T06:34:40.758846+0000, chain.objs.size()=1 2024-04-03T05:14:08.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SeKUbRi6Mi7vlcHz_HV-Z0ALhmRwVbg_0 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10252530239004078061', time=2024-04-03T06:34:45.094287+0000, chain.objs.size()=1 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ygQ1TQAvod9dc7npU3hPTiSLGe47Bbb_0 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10418670406812853364', time=2024-04-03T06:34:46.290373+0000, chain.objs.size()=1 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.jaKXz2Sf_ZWDDAjFmuT9vV_xJr-KeO6_0 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17721087985253359929', time=2024-04-03T06:34:47.512792+0000, chain.objs.size()=1 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GtGLCuBSQfDqC9x--7zs9H5uPfbxc8O_0 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3468091011114146251', time=2024-04-03T06:34:47.629259+0000, chain.objs.size()=1 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IOMFPzt-fn921PhT1Nr0hj8tDU-pMzq_0 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.161122606015053697', time=2024-04-03T06:34:47.726425+0000, chain.objs.size()=1 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KIClbZGJd2fU4Koz3JH38b7ar-qqLiL_0 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11318651079365021231', time=2024-04-03T06:34:48.264028+0000, chain.objs.size()=1 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fB0Z2K6LfyhWZyr237Vb2z5O_ubP4LK_0 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13691603465927846967', time=2024-04-03T06:34:48.265761+0000, chain.objs.size()=1 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cp3iBCCNh2D9yQAdbVmVca0ZA1wbSnQ_0 2024-04-03T05:14:08.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15240026693524105315', time=2024-04-03T06:34:48.380058+0000, chain.objs.size()=1 2024-04-03T05:14:08.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JzPd9F_vJAeL80jVQmORws2iBWFemRe_0 2024-04-03T05:14:09.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.630269847859560698', time=2024-04-03T06:34:49.346540+0000, chain.objs.size()=1 2024-04-03T05:14:09.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xO2CCKh3pk-ucN2y9PqEB18p2FUCo6f_0 2024-04-03T05:14:09.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13101227789821115917', time=2024-04-03T06:34:49.779088+0000, chain.objs.size()=1 2024-04-03T05:14:09.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-quvCm_BDxThyj6Bma89X8iwuBsZK8V_0 2024-04-03T05:14:09.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15015491092093664300', time=2024-04-03T06:34:49.937112+0000, chain.objs.size()=1 2024-04-03T05:14:09.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.UYYC3cVgjvjxSVPw1-UccJ7s0QDRcr8_0 2024-04-03T05:14:09.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.930051105629661258', time=2024-04-03T06:34:52.626540+0000, chain.objs.size()=1 2024-04-03T05:14:09.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QLqcQmZNvLJqjB7KEQ7QBzANT3QuUyH_0 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16735849811678999825', time=2024-04-03T06:34:53.407078+0000, chain.objs.size()=1 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.A-QOgsf4WPcUnL70EQEn9dBidbu9YaI_0 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14686939175895332629', time=2024-04-03T06:34:54.398183+0000, chain.objs.size()=1 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cdps1stnrBERlBdFVUScRzeK6cio8wf_0 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15122729540163909199', time=2024-04-03T06:34:54.654085+0000, chain.objs.size()=1 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ez5xxfxLuGCE2ocdOhxgvnoJ0Xn4V10_0 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4429096272027749448', time=2024-04-03T06:34:56.109769+0000, chain.objs.size()=1 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.V-Lq_5U2N7az6-oXogbJO-DnQtozYd__0 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1319622436860836982', time=2024-04-03T06:34:56.249907+0000, chain.objs.size()=1 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.__73VyscsoXWqGP6V401NO0WubvtUWm_0 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11324963309051927883', time=2024-04-03T06:34:56.383082+0000, chain.objs.size()=1 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.FoIVH0r5cGWT1EjZb8rKOu0mYzI1_Bq_0 2024-04-03T05:14:09.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4200937959740404776', time=2024-04-03T06:36:40.245342+0000, chain.objs.size()=1 2024-04-03T05:14:09.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.348__shadow_.jvAwSmnP0jiDKwES6kgSfjd_qCUcwS0_0 2024-04-03T05:14:09.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.174881295670692064', time=2024-04-03T06:39:08.964051+0000, chain.objs.size()=1 2024-04-03T05:14:09.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.421__shadow_.I2xrlu7A_yiu-Sit-93vt6x1kZ1g4Sy_0 2024-04-03T05:14:09.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10465018425169979555', time=2024-04-03T06:39:15.151731+0000, chain.objs.size()=1 2024-04-03T05:14:09.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.424__shadow_.8vfLaOI7f0_F5aD2_nrp87vvcURSb5d_0 2024-04-03T05:14:09.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8967397269310667286', time=2024-04-03T06:40:14.357960+0000, chain.objs.size()=1 2024-04-03T05:14:09.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:08.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.tP_hZOZesiGMPBv1vYKn0tRmxQOUnEt_0 2024-04-03T05:14:09.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16899196356278312052', time=2024-04-03T06:42:25.433555+0000, chain.objs.size()=1 2024-04-03T05:14:09.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.488__multipart_mymultipart.2~-g-uObbYFiW2YTRzAfBQOfUh3Icbxq7.1 2024-04-03T05:14:09.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN', time=2024-04-03T06:46:19.998220+0000, chain.objs.size()=2 2024-04-03T05:14:09.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.2 2024-04-03T05:14:09.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.2_1 2024-04-03T05:14:09.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN', time=2024-04-03T06:46:20.009325+0000, chain.objs.size()=2 2024-04-03T05:14:09.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.3 2024-04-03T05:14:09.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.3_1 2024-04-03T05:14:09.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2790282349453702279', time=2024-04-03T06:52:46.337317+0000, chain.objs.size()=1 2024-04-03T05:14:09.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:a7MMPCkFLdEHzAmbG4njCGL-.1krq7Q_.ILySPU7W0SdCMVByibxQ6p5-h6zwFGA_0 2024-04-03T05:14:09.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4370173635634823630', time=2024-04-03T06:54:05.748699+0000, chain.objs.size()=1 2024-04-03T05:14:09.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.001+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:YMoBmRfou6M3xSZDfQuo80azXOc15KW_.nzB773ypF7JWp693jx7tNNHheUp9Oph_0 2024-04-03T05:14:09.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/50755 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.226893404455454106', time=2024-04-03T06:54:10.468277+0000, chain.objs.size()=1 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:V8x7D1F3J0y7Z9KcC5aodoUOPcq8vTH_.Ja7VMRlK6b08uI018F7mNR6ZW-g4dMY_0 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6149581741384855552', time=2024-04-03T06:55:34.850559+0000, chain.objs.size()=1 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.552__shadow:F1auqZW0t94YRtIYOU3Fgv0twbDaAVU_.CFYfun_9mY1jSQVdx3uZzItigCbgjE3_0 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~NlCJox87tiCxERnv5tU0-eWadlCERdz', time=2024-04-03T07:00:57.376223+0000, chain.objs.size()=12 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__multipart_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.1 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__shadow_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.1_1 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__multipart_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.2 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__shadow_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.2_1 2024-04-03T05:14:09.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__multipart_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.3 2024-04-03T05:14:09.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__shadow_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.3_1 2024-04-03T05:14:09.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__multipart_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.4 2024-04-03T05:14:09.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__shadow_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.4_1 2024-04-03T05:14:09.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__multipart_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.5 2024-04-03T05:14:09.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__shadow_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.5_1 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__multipart_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.6 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592__shadow_multipart_enc.2~NlCJox87tiCxERnv5tU0-eWadlCERdz.6_1 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.820060640023712899', time=2024-04-03T07:00:59.241314+0000, chain.objs.size()=1 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.593__shadow_.FFRWXfgBJM_fUpdzCadXnaJl__5ueT6_0 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7867603501584591610', time=2024-04-03T07:03:43.107789+0000, chain.objs.size()=1 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.630__shadow_.voK3ACsO2Ylv0n9HuVPNMCD27WuQSE2_0 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6737298964403136705', time=2024-04-03T07:03:46.309904+0000, chain.objs.size()=1 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.631__shadow_.in7Y0hD9ONs3rlNvpTnd_iy0KzTo4SD_0 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12729629922829924282', time=2024-04-03T07:05:14.553194+0000, chain.objs.size()=1 2024-04-03T05:14:09.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.679__shadow:BjuOi9WNAkc9.f.gGB-cqcQIYIq6ONo_.QfHvxvhteOb1LsFiCg02ep1yifsHQPd_0 2024-04-03T05:14:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.029+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-03T05:14:09.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41394' 2024-04-03T05:14:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_jYhrLl9bfvIk-U2bZw7f5wTuBQxp8RC', time=2024-04-03T06:22:41.165761+0000, chain.objs.size()=3 2024-04-03T05:14:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.12o2S3pCJ8cCcyOW59ogew1HAyaQsxH_0 2024-04-03T05:14:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.12o2S3pCJ8cCcyOW59ogew1HAyaQsxH_1 2024-04-03T05:14:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.12o2S3pCJ8cCcyOW59ogew1HAyaQsxH_2 2024-04-03T05:14:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5423795452123430033', time=2024-04-03T06:24:49.305326+0000, chain.objs.size()=1 2024-04-03T05:14:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.192__shadow_.txmbrxfTQwIVdkOe8Hy18cJO6tJCPJ4_0 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14128861612396142626', time=2024-04-03T06:25:24.426577+0000, chain.objs.size()=1 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.207__shadow_.mzOfBFxyXPxB4ZzLKfSb9kwNhLu1DwO_0 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13281261813111541860', time=2024-04-03T06:25:55.277364+0000, chain.objs.size()=1 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.220__shadow_.Re735D-M5Mvaend0DiPsItKuXIZUu0L_0 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6367601626722965900', time=2024-04-03T06:25:55.279302+0000, chain.objs.size()=1 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.220__shadow_.rfjtKc7SMJKcrJhYDYjosHhYYrn4g7q_0 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1524287328268482521', time=2024-04-03T06:27:52.916051+0000, chain.objs.size()=1 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lYUNOiE-pPriVxgFbrnY5TSah_0ilnc_0 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3674880216412518391', time=2024-04-03T06:27:53.597734+0000, chain.objs.size()=1 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MR_U2rHpoUl5zG0jG3gPnL50hTl1XLQ_0 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10260281343387089162', time=2024-04-03T06:27:54.761010+0000, chain.objs.size()=1 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.HvE1A1no_Z9IuOzhpyKOt8Z9btPNrkB_0 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6825513839839350980', time=2024-04-03T06:27:56.215863+0000, chain.objs.size()=1 2024-04-03T05:14:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.E5NLFaOcwZarGWdErZl-3_My5sj1IMI_0 2024-04-03T05:14:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16817809999702945583', time=2024-04-03T06:27:56.962079+0000, chain.objs.size()=1 2024-04-03T05:14:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.zFzkZEtIOlg_L8YQOscaMYeM0qNkeTQ_0 2024-04-03T05:14:09.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6774143131457404613', time=2024-04-03T06:27:57.586287+0000, chain.objs.size()=1 2024-04-03T05:14:09.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Zh-ECYXsW3ya6VSHYvr25EjsGsIEWqr_0 2024-04-03T05:14:09.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3162847841494057978', time=2024-04-03T06:27:57.943782+0000, chain.objs.size()=1 2024-04-03T05:14:09.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ILQTOXYqFitxCYMUpTyWa522_mywEZx_0 2024-04-03T05:14:09.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10328020965947933513', time=2024-04-03T06:27:58.570513+0000, chain.objs.size()=1 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.2WRHRC0UrfuKhEPiVyIGGV5P_zrX6yL_0 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3576937967088795328', time=2024-04-03T06:27:58.596073+0000, chain.objs.size()=1 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ucNm6bSe3-kFBM2UBNgUrVA2mrdSAmM_0 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7404075422310743247', time=2024-04-03T06:28:00.226352+0000, chain.objs.size()=1 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rwsP_XtvrFTTXkWtNtFCo69rSyZ28TX_0 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15280038825329334606', time=2024-04-03T06:28:00.237680+0000, chain.objs.size()=1 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7SEHXvSbQR5AqMIr7MjVfASWDZfnTnC_0 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17769300278818859404', time=2024-04-03T06:28:01.870141+0000, chain.objs.size()=1 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LHumcOlqr5iSuUBMCi54dFkp6_u9_Pq_0 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3400781410486528785', time=2024-04-03T06:28:04.054393+0000, chain.objs.size()=1 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ZPekQEcO-JVshVFattocAkz_tvS7jxi_0 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17734439182403023834', time=2024-04-03T06:28:04.729397+0000, chain.objs.size()=1 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xLtiNgfyuD2Qzd9f9Bl8InvuBp4MmNq_0 2024-04-03T05:14:09.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1652940891377421830', time=2024-04-03T06:28:05.485995+0000, chain.objs.size()=1 2024-04-03T05:14:09.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cg8jjv62DLQ4-e4b1NnMpH642msqPAt_0 2024-04-03T05:14:09.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2170526925807723475', time=2024-04-03T06:28:05.522964+0000, chain.objs.size()=1 2024-04-03T05:14:09.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_._DaYyQgqLSSGHbOXJa8kgpFRORlFtB9_0 2024-04-03T05:14:09.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11896924735713160717', time=2024-04-03T06:28:05.650742+0000, chain.objs.size()=1 2024-04-03T05:14:09.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Cdhiwaz8vQ9oOwxxRwTqDPrj7tpvZqC_0 2024-04-03T05:14:09.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13831520138480848431', time=2024-04-03T06:28:05.718735+0000, chain.objs.size()=1 2024-04-03T05:14:09.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lRH9XcpeJWLYCYsv4q3P9k74yr2fWMr_0 2024-04-03T05:14:09.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.433923718219719980', time=2024-04-03T06:28:06.865473+0000, chain.objs.size()=1 2024-04-03T05:14:09.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.k7v_GfuQvwesHJamHLOZLhA1Hwzzb41_0 2024-04-03T05:14:09.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15019230040707587488', time=2024-04-03T06:28:08.423887+0000, chain.objs.size()=1 2024-04-03T05:14:09.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3XGw2WubE3c4jMcIW1myTI2kEahc8UK_0 2024-04-03T05:14:09.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2953919208196754217', time=2024-04-03T06:28:09.816293+0000, chain.objs.size()=1 2024-04-03T05:14:09.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.kv2WD0m-rkSntAQjmlg-0iXgz51kiAD_0 2024-04-03T05:14:09.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18039962699617249445', time=2024-04-03T06:28:10.448298+0000, chain.objs.size()=1 2024-04-03T05:14:09.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LGcynJsFL0niedqRDowwiH6Hcb7UPK5_0 2024-04-03T05:14:09.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2385796346252957882', time=2024-04-03T06:28:11.564524+0000, chain.objs.size()=1 2024-04-03T05:14:09.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Ww33pEQU42gjJMEif87NsL0N3ncmCvf_0 2024-04-03T05:14:09.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17861969053014844145', time=2024-04-03T06:28:11.810010+0000, chain.objs.size()=1 2024-04-03T05:14:09.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.SqvzY7pTmoz5ecc8KOylIF8mVOjkIw7_0 2024-04-03T05:14:09.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9535526146403232475', time=2024-04-03T06:28:12.027866+0000, chain.objs.size()=1 2024-04-03T05:14:09.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GHgwnCoFfEVKSeyr2n1AMaBQ0u27Xo4_0 2024-04-03T05:14:09.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7298632381256827569', time=2024-04-03T06:28:12.933246+0000, chain.objs.size()=1 2024-04-03T05:14:09.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.l51zvCpplzBdJ2freMzPgqbwvmVuA-T_0 2024-04-03T05:14:09.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10071158690153926551', time=2024-04-03T06:28:13.209286+0000, chain.objs.size()=1 2024-04-03T05:14:09.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.bbiMf0-ZDms-MHSjTyn_83nt6aDlGVt_0 2024-04-03T05:14:09.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15503339824454260985', time=2024-04-03T06:28:13.947284+0000, chain.objs.size()=1 2024-04-03T05:14:09.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1QhGbxChS7YO3FMvPNntiP9RhZiiq64_0 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14128447123333692290', time=2024-04-03T06:28:15.108535+0000, chain.objs.size()=1 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.plkLBzNYTTkW1qgt1rk5WBID0YBXVu2_0 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5139562984551694504', time=2024-04-03T06:28:17.674231+0000, chain.objs.size()=1 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9GJEpBnp7_BFoAEFmIP2WVpWeqBf0n__0 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10969860519743747529', time=2024-04-03T06:28:18.838168+0000, chain.objs.size()=1 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lYJYg6GQ1Yx6Ra2g3mpal_kqUkukDe7_0 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10824169010164749004', time=2024-04-03T06:28:20.305346+0000, chain.objs.size()=1 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.esLoqQRRbAQB2AlacYSyOMkc_U9L53U_0 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13689882553554715057', time=2024-04-03T06:28:20.492744+0000, chain.objs.size()=1 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.awJFn4GsWnpN2Iq6FJJJx5x4eYzZq89_0 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3739878902540013568', time=2024-04-03T06:28:20.574332+0000, chain.objs.size()=1 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.bZfN9TMs-TuO9-2ohtYB0kFhYIsJfNN_0 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.530877324907328662', time=2024-04-03T06:28:21.121572+0000, chain.objs.size()=1 2024-04-03T05:14:09.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.y9fZydyWQbJv-A_Px0faFo2KzNQlKHn_0 2024-04-03T05:14:09.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9828445128752864522', time=2024-04-03T06:28:35.919667+0000, chain.objs.size()=1 2024-04-03T05:14:09.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.238__shadow_.-IBBVgo5Ae-b4pJF2ANL7oiFAGk6vTD_0 2024-04-03T05:14:09.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5977046847659271602', time=2024-04-03T06:28:37.931130+0000, chain.objs.size()=1 2024-04-03T05:14:09.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.239__shadow_.gGubZNXujoCHuCx4o0sqDfFu5yBcR61_0 2024-04-03T05:14:09.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9199494503306634859', time=2024-04-03T06:28:44.224160+0000, chain.objs.size()=1 2024-04-03T05:14:09.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.242__shadow_.akxypn8fYa3xQNByUCzUsZupR8ou6UH_0 2024-04-03T05:14:09.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11634101589223880598', time=2024-04-03T06:28:52.898156+0000, chain.objs.size()=1 2024-04-03T05:14:09.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.246__shadow_.eXbhgYOtRTxiahH3pU9e0czE7JF1QtE_0 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9413472290276857922', time=2024-04-03T06:28:55.086233+0000, chain.objs.size()=1 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.247__shadow_.Y2w_oF2NhARMdd2DXmHrXQ2zkfzz-EU_0 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14231662860670139587', time=2024-04-03T06:29:30.512988+0000, chain.objs.size()=1 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_._whMGHTBkQ0hLIMJDLl7bDSGetg8z13_0 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6508335796863463104', time=2024-04-03T06:29:30.643764+0000, chain.objs.size()=1 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.YkaKeL8IcWr3CTxV2Wh_kPJwYO90yMw_0 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11072857854136624273', time=2024-04-03T06:29:30.843773+0000, chain.objs.size()=1 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.n1PA7anG0dZS2QECoWRzrTiEpC0UmVq_0 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6885859508817539466', time=2024-04-03T06:29:36.108757+0000, chain.objs.size()=1 2024-04-03T05:14:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_._vZJ8EIBv4aytJZFVmARRgkccsmfwjm_0 2024-04-03T05:14:09.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2340439474517474270', time=2024-04-03T06:30:08.964685+0000, chain.objs.size()=1 2024-04-03T05:14:09.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.276__shadow:fJyKr798C5X-3G2OK0d1i-f3zzbDUjs_.Pfd3O_uqoTs-1sgbRY1KFhNMwMW9FLK_0 2024-04-03T05:14:09.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8136826079164189705', time=2024-04-03T06:30:45.139840+0000, chain.objs.size()=1 2024-04-03T05:14:09.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.290__shadow_.zhrevHlKDz7erkJG4x-Iq3BUL119DtR_0 2024-04-03T05:14:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10606398451776749215', time=2024-04-03T06:32:24.694423+0000, chain.objs.size()=1 2024-04-03T05:14:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dIqNm6RWzS7UiW4g8_uMr5FKNpExTVv_0 2024-04-03T05:14:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5930486327689819702', time=2024-04-03T06:32:24.995117+0000, chain.objs.size()=1 2024-04-03T05:14:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Al6mTdQt9GBiWNtgpNLf8sEAqgoyPs5_0 2024-04-03T05:14:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3858261419809226732', time=2024-04-03T06:32:26.050565+0000, chain.objs.size()=1 2024-04-03T05:14:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FQREHu3glBK3Qdx5C14E1f-F04O3fjO_0 2024-04-03T05:14:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9645740336458890727', time=2024-04-03T06:32:26.600478+0000, chain.objs.size()=1 2024-04-03T05:14:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.H4cZlX9Uor-dVnpSfIuRty4Fk8AsPxf_0 2024-04-03T05:14:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7667756866748625653', time=2024-04-03T06:32:28.716867+0000, chain.objs.size()=1 2024-04-03T05:14:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2-KsV7dafw65c4YARRU7Ak6QBbRqVF4_0 2024-04-03T05:14:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4808566744682615631', time=2024-04-03T06:32:29.046354+0000, chain.objs.size()=1 2024-04-03T05:14:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7c4Andv-n47hthTpSmyjwIIxKRo5Edj_0 2024-04-03T05:14:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16545562440100080910', time=2024-04-03T06:32:32.621534+0000, chain.objs.size()=1 2024-04-03T05:14:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.iBiOnOHsS-wseAB7QG2hjAB2_1zLTml_0 2024-04-03T05:14:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12259239413515574790', time=2024-04-03T06:32:32.792331+0000, chain.objs.size()=1 2024-04-03T05:14:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vMFIJLy0Y_yWPe3QNoTdm-25WAICf-t_0 2024-04-03T05:14:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2275508093201676566', time=2024-04-03T06:32:33.131025+0000, chain.objs.size()=1 2024-04-03T05:14:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mcXWOUjdPRJv6d1rrF9AQnRYPdqo0Ql_0 2024-04-03T05:14:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6616612593615307522', time=2024-04-03T06:32:33.384638+0000, chain.objs.size()=1 2024-04-03T05:14:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.diY0j5_KpHVRa4HRtHsg85UdANy8Flw_0 2024-04-03T05:14:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12699644913025467131', time=2024-04-03T06:32:34.229498+0000, chain.objs.size()=1 2024-04-03T05:14:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.JIE9hQte-AjYlrkrbWBVDIMs9VY5JJT_0 2024-04-03T05:14:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7270969944732435238', time=2024-04-03T06:32:34.528752+0000, chain.objs.size()=1 2024-04-03T05:14:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.3FgMSY1Jy6LI3L1c9ILxvDuP9T8gulw_0 2024-04-03T05:14:09.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16695709422556715562', time=2024-04-03T06:32:36.808426+0000, chain.objs.size()=1 2024-04-03T05:14:09.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Mv3dYK10pGoravqlSReGTWqDgQx4BMS_0 2024-04-03T05:14:09.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1832637364104110262', time=2024-04-03T06:32:37.895738+0000, chain.objs.size()=1 2024-04-03T05:14:09.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RMzFtJCk9sgXJAXYv8LJRlwH9GJ5vFX_0 2024-04-03T05:14:09.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7782138579936145462', time=2024-04-03T06:32:37.903904+0000, chain.objs.size()=1 2024-04-03T05:14:09.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uyWVCG2sVrXCLA6lI86-KvuH_uNqreI_0 2024-04-03T05:14:09.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7158875856402624933', time=2024-04-03T06:32:39.427487+0000, chain.objs.size()=1 2024-04-03T05:14:09.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.bdap0rkMFcIhg5rUIT7sAoN0zKbJYDq_0 2024-04-03T05:14:09.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6673160850427223542', time=2024-04-03T06:32:39.678475+0000, chain.objs.size()=1 2024-04-03T05:14:09.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.I4ZvnV368iv6PlOJARrcMgjyueDciXx_0 2024-04-03T05:14:09.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17732556056435674116', time=2024-04-03T06:32:40.893212+0000, chain.objs.size()=1 2024-04-03T05:14:09.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.V9fwuE6lNoyqJ8KB8_87GAYEhmATVde_0 2024-04-03T05:14:09.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15141509491756566497', time=2024-04-03T06:32:41.800701+0000, chain.objs.size()=1 2024-04-03T05:14:09.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Vht4BVCDcKJZ_IxsjIKrUh1RJO0waLT_0 2024-04-03T05:14:09.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1677878489131843869', time=2024-04-03T06:32:41.805059+0000, chain.objs.size()=1 2024-04-03T05:14:09.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1C_YuJqv9nRtWbFR6zaPQELjkYjEbCv_0 2024-04-03T05:14:09.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12791554876526352522', time=2024-04-03T06:32:43.137679+0000, chain.objs.size()=1 2024-04-03T05:14:09.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VSaXPVpCW7Cktmu4BsUfkmN79Az_nkn_0 2024-04-03T05:14:09.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1662260858658974276', time=2024-04-03T06:32:44.516788+0000, chain.objs.size()=1 2024-04-03T05:14:09.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FITsTo8HNE8rEuADbQr9HaYwSino3eO_0 2024-04-03T05:14:09.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16883833956234281509', time=2024-04-03T06:32:45.403694+0000, chain.objs.size()=1 2024-04-03T05:14:09.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.3dqMUEb4UHZKTn4_G0u6p6ZBvqDgMfm_0 2024-04-03T05:14:09.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5312096875394566903', time=2024-04-03T06:32:48.775154+0000, chain.objs.size()=1 2024-04-03T05:14:09.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.X-MdxDbm8iVsAS5N0L-i0yJuMPO-1dQ_0 2024-04-03T05:14:09.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16729972152331296318', time=2024-04-03T06:34:29.238723+0000, chain.objs.size()=1 2024-04-03T05:14:09.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Qz8SEZJKNinGaTHmGI_Xm4EFlZktVqI_0 2024-04-03T05:14:09.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17597650249769981804', time=2024-04-03T06:34:30.053722+0000, chain.objs.size()=1 2024-04-03T05:14:09.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.jZLN_kjUN_EBPAjgQgWT_SJ8kkEkunK_0 2024-04-03T05:14:09.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11918205604056019932', time=2024-04-03T06:34:30.688371+0000, chain.objs.size()=1 2024-04-03T05:14:09.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.UMeBF-Zb2aoUS1U59Y4dZccRLZ9pdSu_0 2024-04-03T05:14:09.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2607898090929859617', time=2024-04-03T06:34:31.079779+0000, chain.objs.size()=1 2024-04-03T05:14:09.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kaN4DjofUNpioWtW62cHwzT3R7TO8uI_0 2024-04-03T05:14:09.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14958638916722605202', time=2024-04-03T06:34:31.365876+0000, chain.objs.size()=1 2024-04-03T05:14:09.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VmnhtgLa09xDEKKAqUeMYCUia-Ax36Q_0 2024-04-03T05:14:09.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1473534889562006178', time=2024-04-03T06:34:32.895281+0000, chain.objs.size()=1 2024-04-03T05:14:09.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2J0Q9C9rn7WWD_1cvw41agyTKK0Am0v_0 2024-04-03T05:14:09.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5614124006318552935', time=2024-04-03T06:34:34.006837+0000, chain.objs.size()=1 2024-04-03T05:14:09.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.bRD36k3dmK0Kv-fHj9_6T8zJ9tq62Go_0 2024-04-03T05:14:09.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8596542551293771272', time=2024-04-03T06:34:34.120112+0000, chain.objs.size()=1 2024-04-03T05:14:09.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.sTYXFvUcI7mZKKKZzjBjxJHMFDHdtO2_0 2024-04-03T05:14:09.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10861016948229812380', time=2024-04-03T06:34:34.456020+0000, chain.objs.size()=1 2024-04-03T05:14:09.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.P8luD9CaXYWEKEXAwmoZUiKCSn78xTY_0 2024-04-03T05:14:09.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12016175474530569481', time=2024-04-03T06:34:35.237412+0000, chain.objs.size()=1 2024-04-03T05:14:09.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.COQFt7uQSGEbr5QsSwH2mEI0eRGXYeh_0 2024-04-03T05:14:09.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11268018383136303715', time=2024-04-03T06:34:35.274457+0000, chain.objs.size()=1 2024-04-03T05:14:09.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.uLPRFJtKGemoP2HcCaR5nW44q79MFD0_0 2024-04-03T05:14:09.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11027659012664476025', time=2024-04-03T06:34:37.102707+0000, chain.objs.size()=1 2024-04-03T05:14:09.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-Vf-LPYaQjSHK2C8zDQUiVp4B444Rn5_0 2024-04-03T05:14:09.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13985792413472953202', time=2024-04-03T06:34:37.125952+0000, chain.objs.size()=1 2024-04-03T05:14:09.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IYatZIwWrt4XUpV8oDA-9ucuef0HpQB_0 2024-04-03T05:14:09.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16077389504178647256', time=2024-04-03T06:34:37.761973+0000, chain.objs.size()=1 2024-04-03T05:14:09.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1eLl_-WUxxGRM-F3ttf0JlVvVEOwIg0_0 2024-04-03T05:14:09.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18184115454254074491', time=2024-04-03T06:34:40.030514+0000, chain.objs.size()=1 2024-04-03T05:14:09.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.l7L8v-XlYw0iCZCE8M_5i-fyqPfWHMG_0 2024-04-03T05:14:09.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7111485467095550754', time=2024-04-03T06:34:40.161296+0000, chain.objs.size()=1 2024-04-03T05:14:09.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.khVwyGKLWACZJfura0wSxUoETUm7xda_0 2024-04-03T05:14:09.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3016597998977232659', time=2024-04-03T06:34:40.836007+0000, chain.objs.size()=1 2024-04-03T05:14:09.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.O6mvQyEGesQ3uMJeTjCrcmckx1M9meT_0 2024-04-03T05:14:09.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5105490903424846535', time=2024-04-03T06:34:41.502807+0000, chain.objs.size()=1 2024-04-03T05:14:09.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DO1rDaOdVhMjDFxUGXcy56rC2u3X82d_0 2024-04-03T05:14:09.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10083576008076528028', time=2024-04-03T06:34:41.600782+0000, chain.objs.size()=1 2024-04-03T05:14:09.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.C6CWh8YuJ0wJe8JQW2Sdl67SQF5wWWv_0 2024-04-03T05:14:09.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7099887523675840939', time=2024-04-03T06:34:42.670953+0000, chain.objs.size()=1 2024-04-03T05:14:09.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.qrYewmAKOszfR0atdjxwSd_RIpvm9sb_0 2024-04-03T05:14:09.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1417979428652063835', time=2024-04-03T06:34:42.724569+0000, chain.objs.size()=1 2024-04-03T05:14:09.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cZdfP8xyJZ75f5K1bW19l23rcblm00A_0 2024-04-03T05:14:09.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17134265844718940500', time=2024-04-03T06:34:44.001446+0000, chain.objs.size()=1 2024-04-03T05:14:09.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.FjMMTsEAooZ3LVKTgXYwFf5OJk3sfxc_0 2024-04-03T05:14:09.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.093+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15211112438183066647', time=2024-04-03T06:34:44.137332+0000, chain.objs.size()=1 2024-04-03T05:14:09.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.093+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-WZ4qm_RVTRJzocTk7IzCqiC-kx_GV1_0 2024-04-03T05:14:09.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.093+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9277125521544620845', time=2024-04-03T06:34:44.538545+0000, chain.objs.size()=1 2024-04-03T05:14:09.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.093+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ASbJ6s02AEWK8Fj4vWTpRaAzcjZ0DFk_0 2024-04-03T05:14:09.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.093+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12914971925137850092', time=2024-04-03T06:34:44.902049+0000, chain.objs.size()=1 2024-04-03T05:14:09.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.093+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SsGzyw-JR9xHg6snf_5xGTXoh0_9ii__0 2024-04-03T05:14:09.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/41394 2024-04-03T05:14:09.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17302170637272551722', time=2024-04-03T06:34:44.903447+0000, chain.objs.size()=1 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cZQldzDMvpYGt9QSKVBLHA1xg87Jg21_0 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18060375473114422981', time=2024-04-03T06:34:45.125640+0000, chain.objs.size()=1 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LfDqvVoMVrqYjtFo1mzqCyK-BXte4h6_0 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15541350178744611855', time=2024-04-03T06:34:45.586410+0000, chain.objs.size()=1 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CeZi2ScNJEWhyTkHtJ55U88_awu-Swj_0 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5984916083894718586', time=2024-04-03T06:34:47.295017+0000, chain.objs.size()=1 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.RHkKpW4KOdx4_VzceB4Ckpd1hJ0sg0f_0 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10767848899505958798', time=2024-04-03T06:34:47.726539+0000, chain.objs.size()=1 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.A_d9zk7JnLEo55K_-aLYcFpU17aF0xt_0 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.815061617601402042', time=2024-04-03T06:34:48.035617+0000, chain.objs.size()=1 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pBIjqAwN2Zn9KRHHPGUkwkwJcEfzjHu_0 2024-04-03T05:14:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11380193513838226140', time=2024-04-03T06:34:48.680104+0000, chain.objs.size()=1 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dSVT5K2fGibJFg3wRIqTMUQ_45ZHnsE_0 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7149628736631439153', time=2024-04-03T06:34:49.059633+0000, chain.objs.size()=1 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.r0LVPRqTywp8PhOOqOHYMddQULUTwda_0 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1970279788579740765', time=2024-04-03T06:34:49.375729+0000, chain.objs.size()=1 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.C8b7v5uM2PZa75kN0AMwm4R4ks6W_Bo_0 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5189965155196767476', time=2024-04-03T06:34:50.030432+0000, chain.objs.size()=1 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6aHk-nAzYyX27zfL5_jdBORUBPZVXkz_0 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12491973276168385084', time=2024-04-03T06:34:50.938748+0000, chain.objs.size()=1 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8kDABp8nAVjI89y6AY_lETarU-LLhgP_0 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12609620332514890755', time=2024-04-03T06:34:51.891705+0000, chain.objs.size()=1 2024-04-03T05:14:09.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TiSH5VnfOB486cGJfOp_fjelOZP5FRM_0 2024-04-03T05:14:09.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14822048666536507438', time=2024-04-03T06:34:52.280210+0000, chain.objs.size()=1 2024-04-03T05:14:09.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.R2W6mk1zSuOwG4LwK-rrx4oy7P3sX_a_0 2024-04-03T05:14:09.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9848596134829803270', time=2024-04-03T06:34:52.372653+0000, chain.objs.size()=1 2024-04-03T05:14:09.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wCidwrRvBHy5pt1Jlt50ICG2OBUeAHe_0 2024-04-03T05:14:09.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3248835499112821992', time=2024-04-03T06:34:52.376110+0000, chain.objs.size()=1 2024-04-03T05:14:09.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ID0N0741DE2pW9oVXsPcd7KlNG9Qw7F_0 2024-04-03T05:14:09.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3636354943053532187', time=2024-04-03T06:34:52.556911+0000, chain.objs.size()=1 2024-04-03T05:14:09.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lRTxCcnb129xqRLKTBa1px0AV8vCkDK_0 2024-04-03T05:14:09.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7699144928794147566', time=2024-04-03T06:34:53.279817+0000, chain.objs.size()=1 2024-04-03T05:14:09.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XH5WEvXqJ967cecbvPjUZ0t9m7hI_jL_0 2024-04-03T05:14:09.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17190022111953741514', time=2024-04-03T06:34:56.306248+0000, chain.objs.size()=1 2024-04-03T05:14:09.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.MK9pYJQtncof1SX2e7FO1t8GEjhjsrj_0 2024-04-03T05:14:09.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17478773465943989807', time=2024-04-03T06:36:44.171885+0000, chain.objs.size()=1 2024-04-03T05:14:09.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.350__shadow_.PzFV7Vis10SlXUV0uyt_tgYmg5UtF7N_0 2024-04-03T05:14:09.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.203987187509655093', time=2024-04-03T06:37:02.606330+0000, chain.objs.size()=1 2024-04-03T05:14:09.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.359__shadow_.jJv7KKhtr9-I9yVUpGOk2r8bGqI9gae_0 2024-04-03T05:14:09.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11534970971131912342', time=2024-04-03T06:39:43.424359+0000, chain.objs.size()=1 2024-04-03T05:14:09.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.434__shadow_.rbdIigWcWWDAbxW7YdW-H77i2JIoj71_0 2024-04-03T05:14:09.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18185892624696573642', time=2024-04-03T06:40:18.386296+0000, chain.objs.size()=1 2024-04-03T05:14:09.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.455__shadow_.24WbsaQdRPqG_P4UpTxKi0Y6FhpooHf_0 2024-04-03T05:14:09.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12004768031581044390', time=2024-04-03T06:42:27.173205+0000, chain.objs.size()=1 2024-04-03T05:14:09.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.487__shadow_.B5Mh3CL0Kqf3oUVABDSM_RxbKDPiMQP_0 2024-04-03T05:14:09.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11661399543381371151', time=2024-04-03T06:51:04.461864+0000, chain.objs.size()=2 2024-04-03T05:14:09.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.521__shadow_.jiDYd3Dh_cFmgxsfmY6NPoJFzN8_rxB_0 2024-04-03T05:14:09.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.521__shadow_.jiDYd3Dh_cFmgxsfmY6NPoJFzN8_rxB_1 2024-04-03T05:14:09.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5348685077574824029', time=2024-04-03T06:53:29.655761+0000, chain.objs.size()=1 2024-04-03T05:14:09.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:bf9xCAkPjlGhynJmolTUfIA0KSqtXZb_.T1AcHu1gJ20xM8s0tG-CdF8BaRJY_iy_0 2024-04-03T05:14:09.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.294032222962029488', time=2024-04-03T06:53:56.012711+0000, chain.objs.size()=1 2024-04-03T05:14:09.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:BlUzoewyWBeXEZTxoPd2qUWRxENTQkf_.f3OfTIiayrSTBV2lX9Jbt8vFdA8ujL0_0 2024-04-03T05:14:09.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8991495220157921343', time=2024-04-03T06:54:16.875727+0000, chain.objs.size()=1 2024-04-03T05:14:09.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:kuPDhG8yiBHa2DDX3JkHQ19sN.TnSII_.lIS-s4OeCfdJiwIAEFbySREGqC5NIZk_0 2024-04-03T05:14:09.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17984072529286685716', time=2024-04-03T06:55:41.045824+0000, chain.objs.size()=1 2024-04-03T05:14:09.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.554__shadow:Q6H802zEvSSQQCfIgpT39L1KJy6w.wS_.oaT46x8Lw85_1_YDq4IQfwOrCW-GtDr_0 2024-04-03T05:14:09.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.406804225644891439', time=2024-04-03T06:56:22.276674+0000, chain.objs.size()=1 2024-04-03T05:14:09.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.574__shadow_.dheaxRbJGnErar2yL5-DT6cO0XpMJrY_0 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10773530223624746780', time=2024-04-03T07:01:41.436284+0000, chain.objs.size()=1 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.609__shadow_.UdCFdWz9ggBTZd7qhH7hGiJ3kfdE5cw_0 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4265032958349706252', time=2024-04-03T07:03:37.404989+0000, chain.objs.size()=1 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.628__shadow_.XkhBVHV1SNIDC5AKfBOVB26Rs6LEmm2_0 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10629389282387913687', time=2024-04-03T07:03:49.687092+0000, chain.objs.size()=1 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.633__shadow_.K_qiXrD6AXeAitXjmpvIYTJVokKdNlZ_0 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9434821897961717214', time=2024-04-03T07:04:26.319159+0000, chain.objs.size()=1 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.655__shadow:DyG4svTbiofONUxYlKWIzRHUbx-YirF_.-HK8VUXgI2-81-kD51ZWGgRApfdX01D_0 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.373814901361510576', time=2024-04-03T07:04:54.683006+0000, chain.objs.size()=1 2024-04-03T05:14:09.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.669__shadow:gyOjdUVvOgoTb37deJrhvFsm9uevxUK_.JZyVaHYxTkhwBFAdCL7P-U0Nx8pufq7_0 2024-04-03T05:14:09.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16157809180605032175', time=2024-04-03T07:05:41.263125+0000, chain.objs.size()=1 2024-04-03T05:14:09.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.683__shadow_.83wnpTlBpVb3u0OFrb4nfP0PP20Pqps_0 2024-04-03T05:14:09.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7302325070563492684', time=2024-04-03T07:06:47.783978+0000, chain.objs.size()=1 2024-04-03T05:14:09.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.703__shadow_.YNiMZF0uiz2KaaNaFlYXhxowQ7XjUcM_0 2024-04-03T05:14:09.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-03T05:14:09.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42201' 2024-04-03T05:14:09.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4849306099598781095', time=2024-04-03T06:25:03.999871+0000, chain.objs.size()=1 2024-04-03T05:14:09.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.199__shadow_.1HuHNURj3JQW7TQ3JFjfb1UsSVLVlXt_0 2024-04-03T05:14:09.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14169039301453811852', time=2024-04-03T06:25:20.705066+0000, chain.objs.size()=1 2024-04-03T05:14:09.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.206__shadow_.YziltwG92hmVUQZDQLvkz8mHuuEwnrf_0 2024-04-03T05:14:09.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9341914076900290425', time=2024-04-03T06:25:30.214190+0000, chain.objs.size()=1 2024-04-03T05:14:09.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.210__shadow_.CQRbVbzDrhuJdp3SSMSqAH5-e3FMrH8_0 2024-04-03T05:14:09.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10215715445461006287', time=2024-04-03T06:25:30.227166+0000, chain.objs.size()=1 2024-04-03T05:14:09.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.210__shadow_.KmYbgu3xGVV0CXxhmWpYBQkhAw6V_tm_0 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8161679460540846896', time=2024-04-03T06:25:39.935512+0000, chain.objs.size()=1 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.213__shadow_.4hbHk83V9s-_nVglv0TQDeAbJbsy_gP_0 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7631375241226961215', time=2024-04-03T06:25:44.297678+0000, chain.objs.size()=1 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.215__shadow_.5iyUYhTNd1hLFr7kaK5IxGDZB-JFKtq_0 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16586609512503674003', time=2024-04-03T06:25:50.929518+0000, chain.objs.size()=1 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.218__shadow_.kFF4-dKyjn4jO_zEKqfBrecPV_9xUf7_0 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6667008369004031460', time=2024-04-03T06:25:59.681428+0000, chain.objs.size()=1 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.222__shadow_.qnMAn5ec8g1jSyYiJ8yawoGBVvPDMhj_0 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11811511324010580227', time=2024-04-03T06:27:52.274615+0000, chain.objs.size()=1 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.e6dSgx_ebPOp2hEFSa_0B8sHpi_bjEv_0 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2007578136947348614', time=2024-04-03T06:27:52.276524+0000, chain.objs.size()=1 2024-04-03T05:14:09.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.C4dixsnrQbSg9sYPlJoitg2jAht3o6d_0 2024-04-03T05:14:09.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12798201225071255985', time=2024-04-03T06:27:53.155868+0000, chain.objs.size()=1 2024-04-03T05:14:09.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UXwO8-ET_mnDTwSgOKIUfwwI89F9Vze_0 2024-04-03T05:14:09.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4634191299186179494', time=2024-04-03T06:27:53.441511+0000, chain.objs.size()=1 2024-04-03T05:14:09.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.YH3YQ_RTbDM4ruFsBa1bGurHcTXmYF__0 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9332247765040645433', time=2024-04-03T06:27:54.078874+0000, chain.objs.size()=1 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.loxUp8vZSldknEJwpC2leLiWrSHfH3z_0 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13357355150157564060', time=2024-04-03T06:27:54.218206+0000, chain.objs.size()=1 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mwbPLSntyF07m_i9il7emBWYsgHYl0__0 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.592838970796496860', time=2024-04-03T06:27:54.722632+0000, chain.objs.size()=1 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.47P93s8bGwcHLO3e3av73odRKMiLIKR_0 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8369769771938778982', time=2024-04-03T06:27:56.980077+0000, chain.objs.size()=1 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.X_rV1S34dUsWe_vB2jiK29eh8Mde8hm_0 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7749296801818888417', time=2024-04-03T06:27:57.053268+0000, chain.objs.size()=1 2024-04-03T05:14:09.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9wyrcNv-nFkuAe4ETTtLAaYwAMmcmoo_0 2024-04-03T05:14:09.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13998726518806054', time=2024-04-03T06:27:57.415005+0000, chain.objs.size()=1 2024-04-03T05:14:09.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.v_BYCUPsjas0TeTZszCOMOpmiUt3nIe_0 2024-04-03T05:14:09.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17764536442056159295', time=2024-04-03T06:27:58.053681+0000, chain.objs.size()=1 2024-04-03T05:14:09.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rAQdtyj_YYpD0OEH_UwPPtBDAN7Mmjs_0 2024-04-03T05:14:09.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3075653041658105451', time=2024-04-03T06:27:59.034674+0000, chain.objs.size()=1 2024-04-03T05:14:09.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.HdMiCFAg9lo1ZQ0EIO9o0b62x2ST9Ig_0 2024-04-03T05:14:09.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17939265308144680613', time=2024-04-03T06:28:00.026508+0000, chain.objs.size()=1 2024-04-03T05:14:09.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.y0HtxMoEN0pf141JVJEik7MthzLc7yP_0 2024-04-03T05:14:09.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11704618533318249302', time=2024-04-03T06:28:00.069654+0000, chain.objs.size()=1 2024-04-03T05:14:09.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lc5egYUZG4F-BA66sS99PwIhIJBCeyG_0 2024-04-03T05:14:09.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8445195807578971456', time=2024-04-03T06:28:00.153585+0000, chain.objs.size()=1 2024-04-03T05:14:09.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8I1bi9NpBL5RpSy9HtWa3eI8I4lGeHc_0 2024-04-03T05:14:09.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.729455188558089106', time=2024-04-03T06:28:01.692681+0000, chain.objs.size()=1 2024-04-03T05:14:09.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7-7BEKCGmTCzJnNBj_o1gPXzaRe45y-_0 2024-04-03T05:14:09.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12267270414517644905', time=2024-04-03T06:28:01.829847+0000, chain.objs.size()=1 2024-04-03T05:14:09.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.IxEPLuCDUzhRb6wk8iAgaN0SsoP6rHT_0 2024-04-03T05:14:09.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11614787773313591600', time=2024-04-03T06:28:02.479037+0000, chain.objs.size()=1 2024-04-03T05:14:09.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GuORCO7LkYm6Q1QCZcHYfuJ_WoCdMLZ_0 2024-04-03T05:14:09.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11135927977482185158', time=2024-04-03T06:28:02.735366+0000, chain.objs.size()=1 2024-04-03T05:14:09.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Sdn4xPa2KX-qgtL3lk1quOvaEIoZpJ5_0 2024-04-03T05:14:09.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15680027524491102083', time=2024-04-03T06:28:02.863125+0000, chain.objs.size()=1 2024-04-03T05:14:09.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ABYzHDlcWQ62Gtq2ZvhMAXlti3uc0cJ_0 2024-04-03T05:14:09.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12647975644098024727', time=2024-04-03T06:28:02.945684+0000, chain.objs.size()=1 2024-04-03T05:14:09.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.145+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.FDSBrWn35cSF_E7uuGDILvo6YpcbHZN_0 2024-04-03T05:14:09.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6053346928868921824', time=2024-04-03T06:28:06.859614+0000, chain.objs.size()=1 2024-04-03T05:14:09.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UkiheryW3hIaEs3Kjb8sS-CSIyqGrzc_0 2024-04-03T05:14:09.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18229532745914820064', time=2024-04-03T06:28:08.575838+0000, chain.objs.size()=1 2024-04-03T05:14:09.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QpMU3BN-LQr-4oX9WixAQDVdqExL_Al_0 2024-04-03T05:14:09.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13051940369481258845', time=2024-04-03T06:28:10.690550+0000, chain.objs.size()=1 2024-04-03T05:14:09.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.v5NIHHKNIKI5rJA1gavwtWLNSE2E874_0 2024-04-03T05:14:09.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3259807972288059680', time=2024-04-03T06:28:11.543427+0000, chain.objs.size()=1 2024-04-03T05:14:09.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JgSMg9siL8J-G3xNwGjZEo3jrFhkrq-_0 2024-04-03T05:14:09.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4734652036108810920', time=2024-04-03T06:28:11.989963+0000, chain.objs.size()=1 2024-04-03T05:14:09.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sahR1yahfQLddhgpLyS5LjCnbBK57kD_0 2024-04-03T05:14:09.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18261681731795887079', time=2024-04-03T06:28:15.387456+0000, chain.objs.size()=1 2024-04-03T05:14:09.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TIb1Lu1ATgaCKjgbXfsLwysWr2vZlum_0 2024-04-03T05:14:09.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3506222666967584826', time=2024-04-03T06:28:16.145034+0000, chain.objs.size()=1 2024-04-03T05:14:09.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vARdJIm2PggemEgWv6fraR5n4nowRfd_0 2024-04-03T05:14:09.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2643849675190793093', time=2024-04-03T06:28:16.272619+0000, chain.objs.size()=1 2024-04-03T05:14:09.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7OO1nNX6T8TBZuFkKFss6f6hHOGWmco_0 2024-04-03T05:14:09.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12134433295038461941', time=2024-04-03T06:28:18.686033+0000, chain.objs.size()=1 2024-04-03T05:14:09.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.a8VU-qmEMA4SelFvSol5CTcxImlqbq8_0 2024-04-03T05:14:09.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10156516329122242178', time=2024-04-03T06:28:19.137782+0000, chain.objs.size()=1 2024-04-03T05:14:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.D2z8ARml2tubZ2XYSzFS34VGACWthyD_0 2024-04-03T05:14:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11803343321069593718', time=2024-04-03T06:28:20.893147+0000, chain.objs.size()=1 2024-04-03T05:14:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OWuvPQRNPnbvY7jsOYQdH6YR9ewXkpy_0 2024-04-03T05:14:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10695439603782294288', time=2024-04-03T06:29:11.469994+0000, chain.objs.size()=1 2024-04-03T05:14:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.254__shadow_.stvaa-Tadz_lOXTZQZxgwsOaunwlD_I_0 2024-04-03T05:14:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7394959899219833660', time=2024-04-03T06:29:51.926347+0000, chain.objs.size()=1 2024-04-03T05:14:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.269__shadow_.DpYecuxibfRjhUc1LmJuMYMmzLGw_hl_0 2024-04-03T05:14:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6452248582628817554', time=2024-04-03T06:30:20.780838+0000, chain.objs.size()=1 2024-04-03T05:14:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.282__shadow_.1cLLkFpmJEEq5q93HBfh8_dih9EtL6j_0 2024-04-03T05:14:09.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7873125167634700854', time=2024-04-03T06:32:24.211230+0000, chain.objs.size()=1 2024-04-03T05:14:09.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.wnvedDvOjH7Go0MZUK-N5zH47RG7WCh_0 2024-04-03T05:14:09.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17022170534461372438', time=2024-04-03T06:32:24.815405+0000, chain.objs.size()=1 2024-04-03T05:14:09.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vXTnOUrLZzSeTRU0kmlp3QUWXvTms48_0 2024-04-03T05:14:09.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9886336254105633173', time=2024-04-03T06:32:26.457344+0000, chain.objs.size()=1 2024-04-03T05:14:09.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ScfJN4AvyoA4r5LZ8RWrApoDztFDsEb_0 2024-04-03T05:14:09.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12858160335377869047', time=2024-04-03T06:32:27.075366+0000, chain.objs.size()=1 2024-04-03T05:14:09.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.F-PXo7DcKsOG7MhCCrk4pvglyAq4zHF_0 2024-04-03T05:14:09.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12901243991983699591', time=2024-04-03T06:32:29.264367+0000, chain.objs.size()=1 2024-04-03T05:14:09.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.wAXSikC-00ypdEeMARu0sCBVrSI65OV_0 2024-04-03T05:14:09.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12323573937882919333', time=2024-04-03T06:32:29.930339+0000, chain.objs.size()=1 2024-04-03T05:14:09.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FjyhcW7ZZuP3g1C49hYgfYwIosCzCt9_0 2024-04-03T05:14:09.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18059813884565926245', time=2024-04-03T06:32:30.637458+0000, chain.objs.size()=1 2024-04-03T05:14:09.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.31m7zc_8HBYoU3IDtUrxMzY1J0VjjNi_0 2024-04-03T05:14:09.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12262248274252940697', time=2024-04-03T06:32:32.580645+0000, chain.objs.size()=1 2024-04-03T05:14:09.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.fHj46IRsLKpPx3L8kBGFb7MJGfoEe4j_0 2024-04-03T05:14:09.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18098628827818549872', time=2024-04-03T06:32:32.826483+0000, chain.objs.size()=1 2024-04-03T05:14:09.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._16MZZOQLbCBXEDj3szQXaA63FO87Y6_0 2024-04-03T05:14:09.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18148655933214471876', time=2024-04-03T06:32:33.814388+0000, chain.objs.size()=1 2024-04-03T05:14:09.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2LL5_mpwBw-IkNdLUT3i_ttLMu6lVAL_0 2024-04-03T05:14:09.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477658348785402479', time=2024-04-03T06:32:34.490650+0000, chain.objs.size()=1 2024-04-03T05:14:09.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XpZa7dSbVvMacuof_trUirYmOKPzmXh_0 2024-04-03T05:14:09.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4683483740382078874', time=2024-04-03T06:32:36.153101+0000, chain.objs.size()=1 2024-04-03T05:14:09.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.daXceAfPkWkLIy9azW_Ws447nA0LCXM_0 2024-04-03T05:14:09.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11071416872742575431', time=2024-04-03T06:32:36.363430+0000, chain.objs.size()=1 2024-04-03T05:14:09.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.L8FJcRdpkjflQUTqPbduzEP2c2TLAIV_0 2024-04-03T05:14:09.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3267973664518541955', time=2024-04-03T06:32:37.655630+0000, chain.objs.size()=1 2024-04-03T05:14:09.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7jlJveenl67pyDAry1BvZ9fZjTnXLAe_0 2024-04-03T05:14:09.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17800369722664637454', time=2024-04-03T06:32:38.060634+0000, chain.objs.size()=1 2024-04-03T05:14:09.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UhxSXESNmNo0PvIG4qsoc5E4BcmJtFd_0 2024-04-03T05:14:09.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8162234179235394485', time=2024-04-03T06:32:41.795212+0000, chain.objs.size()=1 2024-04-03T05:14:09.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2dCbGH1onyUT8D0UzGlFSs8boIEML7p_0 2024-04-03T05:14:09.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5987033637454035949', time=2024-04-03T06:32:43.727924+0000, chain.objs.size()=1 2024-04-03T05:14:09.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.14H_j5jRPnX2BpbIWNxS9_kDBXsU81g_0 2024-04-03T05:14:09.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2020696557932893231', time=2024-04-03T06:32:45.198756+0000, chain.objs.size()=1 2024-04-03T05:14:09.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.g9q4Hoz4MSSoyab--67mrMGZ4btboOP_0 2024-04-03T05:14:09.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14779227765201103256', time=2024-04-03T06:32:45.349513+0000, chain.objs.size()=1 2024-04-03T05:14:09.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UcBHa8KWfojfj8sWTnIpDO8hxMVWvc2_0 2024-04-03T05:14:09.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6121967651538178416', time=2024-04-03T06:32:45.404979+0000, chain.objs.size()=1 2024-04-03T05:14:09.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.iOwyx_nvKsYRVgXqDMQ-FuMgLG71-N0_0 2024-04-03T05:14:09.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7063914067122776852', time=2024-04-03T06:32:46.434273+0000, chain.objs.size()=1 2024-04-03T05:14:09.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.11ZOciJKm-bxLoST-i1K_pIefJeHEez_0 2024-04-03T05:14:09.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3023232134687059911', time=2024-04-03T06:32:46.501483+0000, chain.objs.size()=1 2024-04-03T05:14:09.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BydEfV9oWE7cHaPpca_YOrzpNzQUzCN_0 2024-04-03T05:14:09.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1158891431848422353', time=2024-04-03T06:32:46.833550+0000, chain.objs.size()=1 2024-04-03T05:14:09.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2O49adKyrFqMourIo_uZv3aU6aKp_o2_0 2024-04-03T05:14:09.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10569233690822320684', time=2024-04-03T06:32:46.955299+0000, chain.objs.size()=1 2024-04-03T05:14:09.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CkIjm1aQjDKi1Ox-JtEIWINB37NFdsy_0 2024-04-03T05:14:09.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4077345780319430991', time=2024-04-03T06:32:47.227131+0000, chain.objs.size()=1 2024-04-03T05:14:09.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vMFDvPen9ice66_zps2l7yVScFBMKp-_0 2024-04-03T05:14:09.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13403259683901106703', time=2024-04-03T06:32:47.334020+0000, chain.objs.size()=1 2024-04-03T05:14:09.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.J1GPVZpIUrckCAga1Mtqaydx5ZwFReb_0 2024-04-03T05:14:09.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8358972453195488880', time=2024-04-03T06:32:47.922538+0000, chain.objs.size()=1 2024-04-03T05:14:09.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UBzUN35_l5FlPuQretZy9su7iyZk7D-_0 2024-04-03T05:14:09.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7477723284625758631', time=2024-04-03T06:32:48.377003+0000, chain.objs.size()=1 2024-04-03T05:14:09.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.W11A-eScEUtghtjk1w0g4KNYmDDZbdS_0 2024-04-03T05:14:09.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13281962329906861331', time=2024-04-03T06:32:49.315201+0000, chain.objs.size()=1 2024-04-03T05:14:09.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.63GpH3pOEv-FCrbtsIzGUAHOKgxvxq4_0 2024-04-03T05:14:09.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14480555886837602449', time=2024-04-03T06:32:51.372173+0000, chain.objs.size()=1 2024-04-03T05:14:09.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.J99r_tAs1VPam4MN7APFRz5qcoDSvY6_0 2024-04-03T05:14:09.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13447213756800595813', time=2024-04-03T06:34:29.409715+0000, chain.objs.size()=1 2024-04-03T05:14:09.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CWuUDvgaRBlyujRcfq0pHX5XOyyEzMe_0 2024-04-03T05:14:09.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17261344280670517063', time=2024-04-03T06:34:30.904703+0000, chain.objs.size()=1 2024-04-03T05:14:09.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rV5gLRLSmCgdfH4mMWg88fseJt9aInY_0 2024-04-03T05:14:09.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11276758190285441881', time=2024-04-03T06:34:34.265015+0000, chain.objs.size()=1 2024-04-03T05:14:09.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.OyRZDb913dzbuKrJIGPzg2J3MhPWQQy_0 2024-04-03T05:14:09.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2143221826916225791', time=2024-04-03T06:34:35.232315+0000, chain.objs.size()=1 2024-04-03T05:14:09.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dK3nblYA7-WOMGSaUdVMzcxEHMzR6KU_0 2024-04-03T05:14:09.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16632639715826242559', time=2024-04-03T06:34:37.099339+0000, chain.objs.size()=1 2024-04-03T05:14:09.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kapxshtC21YpNXdHtoAcTbwYIiURjQ7_0 2024-04-03T05:14:09.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17695665213459043447', time=2024-04-03T06:34:37.638870+0000, chain.objs.size()=1 2024-04-03T05:14:09.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.thwWHpjYH3EOo_nFdKz7xaI414R90T6_0 2024-04-03T05:14:09.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9576975492886716046', time=2024-04-03T06:34:38.264965+0000, chain.objs.size()=1 2024-04-03T05:14:09.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7L8hkwM_cQeH5yIZpWfh3CO0zIbZ5F7_0 2024-04-03T05:14:09.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12441789669529433446', time=2024-04-03T06:34:39.071182+0000, chain.objs.size()=1 2024-04-03T05:14:09.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gCZBQUZEG8JRwe7djveDonaxodUW8gg_0 2024-04-03T05:14:09.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8424300301749935344', time=2024-04-03T06:34:40.069553+0000, chain.objs.size()=1 2024-04-03T05:14:09.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.so1AF-OQCuA1ectv9M5cOskX-4Kn3LV_0 2024-04-03T05:14:09.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15006021375310506452', time=2024-04-03T06:34:40.590390+0000, chain.objs.size()=1 2024-04-03T05:14:09.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.B7j6NbOlOBTYHKDG40qbEKpxqsfQXxh_0 2024-04-03T05:14:09.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3510803081421559687', time=2024-04-03T06:34:40.818922+0000, chain.objs.size()=1 2024-04-03T05:14:09.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CvIHH84VJhQaLz6zKEvFBmcGBKixadM_0 2024-04-03T05:14:09.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3854276711243428612', time=2024-04-03T06:34:41.266680+0000, chain.objs.size()=1 2024-04-03T05:14:09.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.48mSOXg7aFC9IBHFgFXn3FpnzdgeEmP_0 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9496655531348865276', time=2024-04-03T06:34:41.372882+0000, chain.objs.size()=1 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.aIao7Id48VuzQK78IpfMIODWmds6AKC_0 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13844881738122706669', time=2024-04-03T06:34:44.079799+0000, chain.objs.size()=1 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KOafPNvH2FwYSNntr_U8wwija-3r6WL_0 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4996586355783032098', time=2024-04-03T06:34:44.692917+0000, chain.objs.size()=1 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JyfEBUq3-1jdPgCSckt_U19RoUe2uV8_0 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8845119083139455094', time=2024-04-03T06:34:44.839093+0000, chain.objs.size()=1 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8MBW6E_XjKZqYwQVooV8Np7cuAIzytk_0 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6600115385611830059', time=2024-04-03T06:34:44.840909+0000, chain.objs.size()=1 2024-04-03T05:14:09.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.181+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xOkdCJlB_58KiPZdixXlPDLm4Z25zGH_0 2024-04-03T05:14:09.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6008873540967336477', time=2024-04-03T06:34:45.136456+0000, chain.objs.size()=1 2024-04-03T05:14:09.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GkkX3HKvzxoLQ9nxJKkPOCmEJM1HBaI_0 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.442654200921891220', time=2024-04-03T06:34:45.251813+0000, chain.objs.size()=1 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9tiTaRQPy9p-55PKaN1eOlpsytHi51D_0 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1678000374815071596', time=2024-04-03T06:34:46.508841+0000, chain.objs.size()=1 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pcluoahT3R46vXEINX-oqpgYbnUndR8_0 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6468607702058166211', time=2024-04-03T06:34:48.451531+0000, chain.objs.size()=1 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.l4JOpqhoO1500k1E2fL3zTAQjxSxAib_0 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18219776563308717475', time=2024-04-03T06:34:49.438964+0000, chain.objs.size()=1 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6tE5enM_RgTNbfxGMS1dJwIUuv8OmXX_0 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16336949787871931116', time=2024-04-03T06:34:49.824247+0000, chain.objs.size()=1 2024-04-03T05:14:09.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YNcbkMb9uFhcUmr2rANWTXF1Y6mPCRz_0 2024-04-03T05:14:09.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12750584824226489468', time=2024-04-03T06:34:51.185678+0000, chain.objs.size()=1 2024-04-03T05:14:09.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hH8sV-xgTyRc2by4QZMQIY5o9UVQTXM_0 2024-04-03T05:14:09.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13490972901083966113', time=2024-04-03T06:34:51.318253+0000, chain.objs.size()=1 2024-04-03T05:14:09.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8_hDdF4fFNPSixw60XN-1vgG4RuyfU-_0 2024-04-03T05:14:09.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2533472829155823715', time=2024-04-03T06:34:51.647310+0000, chain.objs.size()=1 2024-04-03T05:14:09.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2p492elGFBkbz3h-tY7Ld2azOBdM1wW_0 2024-04-03T05:14:09.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.764228203095344428', time=2024-04-03T06:34:52.006487+0000, chain.objs.size()=1 2024-04-03T05:14:09.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.185+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dgMqW1EPaVH8UtGxZH0LVglRV9nyvA3_0 2024-04-03T05:14:09.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/42201 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9848539052120262077', time=2024-04-03T06:34:53.620697+0000, chain.objs.size()=1 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zYZ4VpeBtj13r10x41t9BCy62aH1zUz_0 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1818578056597541884', time=2024-04-03T06:34:54.506672+0000, chain.objs.size()=1 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Il8oa1HrXGbl8OCYu3CwrLmFjRR9IcB_0 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11042961830308438083', time=2024-04-03T06:34:54.854608+0000, chain.objs.size()=1 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.tApLrhrUp_Qi6yxpeS1rdIWmwKyZejm_0 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3710770547518030948', time=2024-04-03T06:34:55.065397+0000, chain.objs.size()=1 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KckJgDK5P7yGgD7sYNhG1KKuQpUcT_E_0 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2900332839844812441', time=2024-04-03T06:34:55.193408+0000, chain.objs.size()=1 2024-04-03T05:14:09.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.N6NHfDoXOg_QssMyAYwBL8oKT3uBpxb_0 2024-04-03T05:14:09.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5473687853405937159', time=2024-04-03T06:34:55.527767+0000, chain.objs.size()=1 2024-04-03T05:14:09.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nahDOrXYCwgHSNuTf6E2mFb1RD68q2e_0 2024-04-03T05:14:09.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11775158992542578356', time=2024-04-03T06:34:56.038995+0000, chain.objs.size()=1 2024-04-03T05:14:09.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.NiyzJfV1scY7Xaq-t3sCGWa2T3eOs1m_0 2024-04-03T05:14:09.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6663819178358592625', time=2024-04-03T06:34:56.638972+0000, chain.objs.size()=1 2024-04-03T05:14:09.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._T76BYtSbQCVLgX41RJttHn1cheN7bj_0 2024-04-03T05:14:09.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15630851529359766175', time=2024-04-03T06:35:32.440170+0000, chain.objs.size()=1 2024-04-03T05:14:09.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.311__shadow_.tEBnMQz91BG3Uy0AJ_kaQx4mesVackS_0 2024-04-03T05:14:09.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8121833485140683927', time=2024-04-03T06:36:38.181517+0000, chain.objs.size()=1 2024-04-03T05:14:09.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.347__shadow_.Qmh7LM8sOGf8LcxsMGmQ6yt-ZIn2Kko_0 2024-04-03T05:14:09.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8548183978587415249', time=2024-04-03T06:39:34.852756+0000, chain.objs.size()=1 2024-04-03T05:14:09.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.431__shadow_.LSleV1K1mnmXZt7tlR4GbFwN-tM9rRl_0 2024-04-03T05:14:09.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.457__shadow_.dgSc11ObR_EHND-FJlCteNiaoddR55x_1_cb75bb27b131c8f94495ea109e697471', time=2024-04-03T06:40:30.167001+0000, chain.objs.size()=1 2024-04-03T05:14:09.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.457__shadow_.dgSc11ObR_EHND-FJlCteNiaoddR55x_0 2024-04-03T05:14:09.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.469__shadow_.dQ1DlPyktVaUcDTm53ZOpxOfGzuUxWV_1_90fb46a4db035fec014fa5b2e270ae64', time=2024-04-03T06:40:53.717610+0000, chain.objs.size()=1 2024-04-03T05:14:09.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.469__shadow_.dQ1DlPyktVaUcDTm53ZOpxOfGzuUxWV_0 2024-04-03T05:14:09.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5747949113446212115', time=2024-04-03T06:43:43.098643+0000, chain.objs.size()=3 2024-04-03T05:14:09.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__multipart_mymultipart.2~eNLTbiohouIfiad5Xv4kJfQMm9D3cnK.1 2024-04-03T05:14:09.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__multipart_mymultipart.2~eNLTbiohouIfiad5Xv4kJfQMm9D3cnK.2 2024-04-03T05:14:09.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__multipart_mymultipart.2~eNLTbiohouIfiad5Xv4kJfQMm9D3cnK.3 2024-04-03T05:14:09.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6506252734308921374', time=2024-04-03T06:49:02.994845+0000, chain.objs.size()=1 2024-04-03T05:14:09.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.498__shadow_.DiSVHSdS41y4ZAdShtNPVZ0UMquHBDe_0 2024-04-03T05:14:09.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4240004100416016719', time=2024-04-03T06:51:10.813066+0000, chain.objs.size()=1 2024-04-03T05:14:09.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.522__shadow_.XHSyMttv981XYJVX6JvTHffEq-6ub-V_0 2024-04-03T05:14:09.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1761885266562637605', time=2024-04-03T06:52:59.568086+0000, chain.objs.size()=1 2024-04-03T05:14:09.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:jOENUwE6cnT70RI.GlRhOdxeTR1NO8b_.i1XeIVrh5x00xv807X0a8O48c_kRVNe_0 2024-04-03T05:14:09.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10024499088808557331', time=2024-04-03T06:53:10.972935+0000, chain.objs.size()=1 2024-04-03T05:14:09.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.542__shadow_.IYBF_82fc331DV1Fw_QLue1n38TPJz1_0 2024-04-03T05:14:09.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9134582065092349874', time=2024-04-03T06:53:49.609718+0000, chain.objs.size()=1 2024-04-03T05:14:09.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:citBMtbkMxAHQPn5PvEYo6bgO2B2c9M_.169Q0939OoKyi-owxMBYNCpYl6GCvGy_0 2024-04-03T05:14:09.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11248412633866916638', time=2024-04-03T06:55:48.900289+0000, chain.objs.size()=1 2024-04-03T05:14:09.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.556__shadow:SgZT26XTOQVVU72GEKwoZgNRVViRW9l_.e3Hv-_PDb2Am_thJ4PPdB2GlTuYsJoS_0 2024-04-03T05:14:09.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2086014618180274921', time=2024-04-03T06:56:15.557642+0000, chain.objs.size()=1 2024-04-03T05:14:09.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.571__shadow_.xKMDXzVBnZzaGtEcticcJf5TesTU35P_0 2024-04-03T05:14:09.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15286909695046616025', time=2024-04-03T07:06:07.475924+0000, chain.objs.size()=1 2024-04-03T05:14:09.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.697__shadow_.RAtaBuEw5Ix_c--X_rMfHe0FBDf9I0T_0 2024-04-03T05:14:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.205+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-03T05:14:09.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45592' 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_wttN7L3NnUggdLiBDmm870VmzaFiyjZ', time=2024-04-03T06:21:52.336049+0000, chain.objs.size()=3 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.Bw-WFk-aicxFwCSPmz97tS3z6lvz_RZ_0 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.Bw-WFk-aicxFwCSPmz97tS3z6lvz_RZ_1 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.Bw-WFk-aicxFwCSPmz97tS3z6lvz_RZ_2 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6192363285479440797', time=2024-04-03T06:23:35.654443+0000, chain.objs.size()=1 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.166__shadow_.bdFMC8fTHcZ6IcOW-n993v7_QSNMLg3_0 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6354622907084407098', time=2024-04-03T06:25:03.981920+0000, chain.objs.size()=1 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.199__shadow_.YWKYiPNdB8RgcMn2ojs7Ck_G98Bu9ln_0 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.761145341639834982', time=2024-04-03T06:25:10.446340+0000, chain.objs.size()=1 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.202__shadow_.Mg7eJtiGUS3umdoWOzTiHV_vdH8RP4J_0 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6428499802470235385', time=2024-04-03T06:25:32.410348+0000, chain.objs.size()=1 2024-04-03T05:14:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.211__shadow_.-jzNHDO-QskiW6FMkLusKySdXVVPham_0 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7472674171755364743', time=2024-04-03T06:25:46.499246+0000, chain.objs.size()=1 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.216__shadow_.Hka5r54MyytaZgtmMmA6fweD6ful6d7_0 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5640804335050709364', time=2024-04-03T06:25:59.665558+0000, chain.objs.size()=1 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.222__shadow_.xt977mvSRkAmviMfWi-ZOwCw4OiAo5w_0 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10963633084112244388', time=2024-04-03T06:26:04.111428+0000, chain.objs.size()=1 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.224__shadow_.rsjPKJKm_TKyy4NhT6OM8T7TUazlDGp_0 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5362228387967529667', time=2024-04-03T06:27:52.383893+0000, chain.objs.size()=1 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BvrjPkqrowld2ISj2fwGEzEOSu9RGAp_0 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9217264096738597040', time=2024-04-03T06:27:52.516836+0000, chain.objs.size()=1 2024-04-03T05:14:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.arnzog_o3Vx2GVl7ljWho10RWAcwnez_0 2024-04-03T05:14:09.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3782837306181922887', time=2024-04-03T06:27:52.862209+0000, chain.objs.size()=1 2024-04-03T05:14:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XKt66kxaDZhQAtYiSBVgXMRXkpM2_bC_0 2024-04-03T05:14:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16233211254435170075', time=2024-04-03T06:27:54.483255+0000, chain.objs.size()=1 2024-04-03T05:14:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1zbNhr3XT0gK7V_sMb_aE1pms0L8oba_0 2024-04-03T05:14:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17031334548112510765', time=2024-04-03T06:27:57.316643+0000, chain.objs.size()=1 2024-04-03T05:14:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qt4Y0HieknpXNIwCTMVSP25fv6qRaEa_0 2024-04-03T05:14:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7260215711290750481', time=2024-04-03T06:27:58.705437+0000, chain.objs.size()=1 2024-04-03T05:14:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.C6JlUkhQPF1WJya13NsPZzzDA1575qW_0 2024-04-03T05:14:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16495912158756164075', time=2024-04-03T06:27:58.946689+0000, chain.objs.size()=1 2024-04-03T05:14:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.d5crYRBTlMw2ya9VlnZh6u5jl82uxa3_0 2024-04-03T05:14:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16697483328798509347', time=2024-04-03T06:27:59.089700+0000, chain.objs.size()=1 2024-04-03T05:14:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.U72ysxy0CUpVsBSbTtkinBL-dkUsIbP_0 2024-04-03T05:14:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16919270917781625359', time=2024-04-03T06:28:00.898160+0000, chain.objs.size()=1 2024-04-03T05:14:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fnVJ821zvYWlEjL0KKrhoS2Y7GuFDOx_0 2024-04-03T05:14:09.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4620463748287092821', time=2024-04-03T06:28:01.883619+0000, chain.objs.size()=1 2024-04-03T05:14:09.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.datuz6q6CimuLCjKkEPPvFfGzBk9pZU_0 2024-04-03T05:14:09.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.505345687725047798', time=2024-04-03T06:28:04.255280+0000, chain.objs.size()=1 2024-04-03T05:14:09.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TBlmz_LTlhqY7NH0wr9rbsGoJQWlYOe_0 2024-04-03T05:14:09.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12773889262918824148', time=2024-04-03T06:28:04.729250+0000, chain.objs.size()=1 2024-04-03T05:14:09.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DxraYDLit4LWSizrRrNKxld4EWSkAPC_0 2024-04-03T05:14:09.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15574718700068015258', time=2024-04-03T06:28:06.119453+0000, chain.objs.size()=1 2024-04-03T05:14:09.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.urIRfk7N9QmMRUgJ3OJ1mCQ2TUShMYn_0 2024-04-03T05:14:09.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15916381894665368062', time=2024-04-03T06:28:07.789637+0000, chain.objs.size()=1 2024-04-03T05:14:09.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dqG-ZcC8CgBsHCPBVOkzd-y6Jnyv6EO_0 2024-04-03T05:14:09.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16245236655672582699', time=2024-04-03T06:28:09.748334+0000, chain.objs.size()=1 2024-04-03T05:14:09.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Nk9oyIyfTYtmRDdEsL031bqC3POk-6Y_0 2024-04-03T05:14:09.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1220405678230681184', time=2024-04-03T06:28:10.269898+0000, chain.objs.size()=1 2024-04-03T05:14:09.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gz62dOAoKcilYkeswuSmvftneI5J26l_0 2024-04-03T05:14:09.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11155693088465205265', time=2024-04-03T06:28:13.978037+0000, chain.objs.size()=1 2024-04-03T05:14:09.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.C_Ke9w5a2hHiG3mbw1_-PZu7bIsliwI_0 2024-04-03T05:14:09.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2429373363170392899', time=2024-04-03T06:28:14.311606+0000, chain.objs.size()=1 2024-04-03T05:14:09.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TajC9hwQ-30xpBBmrmro9vKCdoG9U_D_0 2024-04-03T05:14:09.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11788384767075785249', time=2024-04-03T06:28:15.197289+0000, chain.objs.size()=1 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QWORbwZPoAfKACT8q5lxQesSh-GQ7ZB_0 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12328577311141147968', time=2024-04-03T06:28:17.555198+0000, chain.objs.size()=1 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DoP7dIp7QEGsOQHwVA2dJX63jkRcojf_0 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15343813769061105968', time=2024-04-03T06:28:17.558224+0000, chain.objs.size()=1 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QPvE7lYGbsvo19zj_V2riuSZWAL2n-t_0 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13153171971019049116', time=2024-04-03T06:28:18.667308+0000, chain.objs.size()=1 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tzeqNdOb9pE2MBd_yLX8BF0KMx03aCf_0 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7541102815541603656', time=2024-04-03T06:28:19.146551+0000, chain.objs.size()=1 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qvrHsF4WzXzcHbAKPXGqvSTZV5ySbwz_0 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15575856613313117216', time=2024-04-03T06:28:21.059406+0000, chain.objs.size()=1 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sJ19EXCd1okNkvPq6rAPM9zG53dKKYu_0 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7291221909100687228', time=2024-04-03T06:28:33.809606+0000, chain.objs.size()=1 2024-04-03T05:14:09.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.237__shadow_.YxQ-0SRvH2t7kIkJ5CauNdfcWgGPNDS_0 2024-04-03T05:14:09.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10713798823528667573', time=2024-04-03T06:28:57.361774+0000, chain.objs.size()=1 2024-04-03T05:14:09.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.248__shadow_.AtqHg0qjAI3EsdN49RIbxcU0H8GuAgS_0 2024-04-03T05:14:09.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9245252012726680570', time=2024-04-03T06:29:08.902161+0000, chain.objs.size()=1 2024-04-03T05:14:09.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.253__shadow_.7rdw-G5HF9QihO1jiLK8cOQj_yXJnxw_0 2024-04-03T05:14:09.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5380703055190755779', time=2024-04-03T06:29:13.819466+0000, chain.objs.size()=1 2024-04-03T05:14:09.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.255__shadow_.aDs2l_CK_PXinCDhpMH-tYHkFBM7KO3_0 2024-04-03T05:14:09.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8840386312118324889', time=2024-04-03T06:29:22.638428+0000, chain.objs.size()=1 2024-04-03T05:14:09.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.259__shadow_.95HyFzRAEzvTrb5VXzVA74eooAT8ByI_0 2024-04-03T05:14:09.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13863624394074996716', time=2024-04-03T06:29:35.942231+0000, chain.objs.size()=1 2024-04-03T05:14:09.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.tOexTqhlEDJNXszZp69iTHB9fYUaIeV_0 2024-04-03T05:14:09.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10065425108759115267', time=2024-04-03T06:32:26.050662+0000, chain.objs.size()=1 2024-04-03T05:14:09.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.r_K_79JptNnC057QvAbVz_3RwSLWnx5_0 2024-04-03T05:14:09.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13780108232450211712', time=2024-04-03T06:32:26.438782+0000, chain.objs.size()=1 2024-04-03T05:14:09.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EeTKe08klQMExjdCTkK-N6IzPbJiQox_0 2024-04-03T05:14:09.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4225177757287597195', time=2024-04-03T06:32:28.424220+0000, chain.objs.size()=1 2024-04-03T05:14:09.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pxf1F1eSIcQkc_J-ZfEwG-ampmZhqNn_0 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3904275330045841571', time=2024-04-03T06:32:30.137166+0000, chain.objs.size()=1 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2naLOSDF_YG1trQrQTNPMZ3l5Jad_qL_0 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10365609553296782024', time=2024-04-03T06:32:31.784376+0000, chain.objs.size()=1 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.42-xuvOBXTqviCaA6LryWpHP4N7Ln3s_0 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14498360319169413649', time=2024-04-03T06:32:33.768393+0000, chain.objs.size()=1 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.O9CnxdnE0LON6V2GWwhbkoVB00cDJ7l_0 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2101799485250938695', time=2024-04-03T06:32:34.528940+0000, chain.objs.size()=1 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xxKPqwoxBw0w_CXOZUntM8KP7J2zUbu_0 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10485769760703587159', time=2024-04-03T06:32:36.382597+0000, chain.objs.size()=1 2024-04-03T05:14:09.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UxLM1Qx6mVQ-Uw5uQ8nQt0vpWnxsJW4_0 2024-04-03T05:14:09.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2715654900511999621', time=2024-04-03T06:32:37.068584+0000, chain.objs.size()=1 2024-04-03T05:14:09.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9drdsjzlQlDEiea4Qv39zSsw5ej2IhY_0 2024-04-03T05:14:09.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6562032684178718072', time=2024-04-03T06:32:37.306668+0000, chain.objs.size()=1 2024-04-03T05:14:09.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Yx2M62TrQ5waluuF2_gWYcN3nZut0eZ_0 2024-04-03T05:14:09.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11325006645611069423', time=2024-04-03T06:32:37.664662+0000, chain.objs.size()=1 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lzBb1zEHdlxlJ5slXGnDCMC_PlJVaIZ_0 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1772977276055590632', time=2024-04-03T06:32:39.427367+0000, chain.objs.size()=1 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.895S5epROLYZW3tmg4Eb2r5f3pt5p_8_0 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3144480405410951515', time=2024-04-03T06:32:40.102424+0000, chain.objs.size()=1 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.NB5ae97lRemP1X9PsiX-2Rt3BN-VAPn_0 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17827522467136480247', time=2024-04-03T06:32:40.104688+0000, chain.objs.size()=1 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FI0YgYWxHHjRzwDcxOQuCLiJZl9oPh6_0 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17496968996763317267', time=2024-04-03T06:32:40.419659+0000, chain.objs.size()=1 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.N7gIzVCaRkiQu8YDevJoA14PVOH4rQi_0 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9806031428150975147', time=2024-04-03T06:32:40.425656+0000, chain.objs.size()=1 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.l0l95tgzO7znBxdC3duQEi4TS19Aavu_0 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2101338288053635609', time=2024-04-03T06:32:43.072607+0000, chain.objs.size()=1 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9NBzp5JBxaqmmIjmFp4eUN4LPyAnWvZ_0 2024-04-03T05:14:09.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8531706306395558727', time=2024-04-03T06:32:43.378714+0000, chain.objs.size()=1 2024-04-03T05:14:09.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sZXk6CcDh_YIjQGM9K5ZSkToo4M5o2I_0 2024-04-03T05:14:09.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17461239953679344081', time=2024-04-03T06:32:43.734738+0000, chain.objs.size()=1 2024-04-03T05:14:09.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gHxHBl9xeW5sxkdjgB7mWyJleOTX55o_0 2024-04-03T05:14:09.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18110091830899794979', time=2024-04-03T06:32:44.791027+0000, chain.objs.size()=1 2024-04-03T05:14:09.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BPW2PwDrPNvgQ0fj_MAJjtjFWlsZngk_0 2024-04-03T05:14:09.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5373415956935657094', time=2024-04-03T06:32:46.783407+0000, chain.objs.size()=1 2024-04-03T05:14:09.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dAXTbvMNTqgY5qfr0sNVZcewaQ_f8lq_0 2024-04-03T05:14:09.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4770651077982255243', time=2024-04-03T06:32:47.571445+0000, chain.objs.size()=1 2024-04-03T05:14:09.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OFKw0OFoIFDTip3Qk4JnZ8YsHBKG9No_0 2024-04-03T05:14:09.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3431431578491346762', time=2024-04-03T06:32:48.121147+0000, chain.objs.size()=1 2024-04-03T05:14:09.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GX0zD_Yy_R2AJkrgwBcgGwyplGQPjyR_0 2024-04-03T05:14:09.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14808792919339478024', time=2024-04-03T06:32:50.747777+0000, chain.objs.size()=1 2024-04-03T05:14:09.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VKWk6WwxU8t6lel-3taS7TuxdNaNi4C_0 2024-04-03T05:14:09.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6309549419508701366', time=2024-04-03T06:32:50.923178+0000, chain.objs.size()=1 2024-04-03T05:14:09.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Gko1H3dbkleKvMxSjSFhMc267-iNcMk_0 2024-04-03T05:14:09.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7526837612134086191', time=2024-04-03T06:32:50.924870+0000, chain.objs.size()=1 2024-04-03T05:14:09.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ohbQUOOv5Ibz26d9e3h5NuE9R_G63sY_0 2024-04-03T05:14:09.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16799488406312009311', time=2024-04-03T06:32:51.908183+0000, chain.objs.size()=1 2024-04-03T05:14:09.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tXS6myFh-1RbeoOCd-CbWqZ7z9r8tBJ_0 2024-04-03T05:14:09.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.245+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5457166827474935473', time=2024-04-03T06:34:28.858626+0000, chain.objs.size()=1 2024-04-03T05:14:09.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.245+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ExCDMr7RmkoDUaRjVuSjnF5AlOqCQqL_0 2024-04-03T05:14:09.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.245+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10895205816873795848', time=2024-04-03T06:34:30.443983+0000, chain.objs.size()=1 2024-04-03T05:14:09.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.245+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QeCrDhJMbHXg9PcVdoTs625wgaB8FXg_0 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17117543814893021661', time=2024-04-03T06:34:30.581203+0000, chain.objs.size()=1 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XMF_Gp-tQ960Q1e41A-mZrnl_mK7fqq_0 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1142867406242292975', time=2024-04-03T06:34:33.856702+0000, chain.objs.size()=1 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zy32okxPO7DUbxLBskabrT-QngmpoCl_0 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13157929586472936884', time=2024-04-03T06:34:34.196696+0000, chain.objs.size()=1 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QV5C8KfdipewT1MHS0JNdA4Dagw0uH0_0 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9321004751905822452', time=2024-04-03T06:34:34.198660+0000, chain.objs.size()=1 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.M66GwCm9_7Ccl9JNY74zWAkIuABF86Z_0 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14018246185503329501', time=2024-04-03T06:34:35.075364+0000, chain.objs.size()=1 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.AGTq7mOYjg9r5t3uWLSp8urAd92H9Ne_0 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.306717312716132341', time=2024-04-03T06:34:37.199147+0000, chain.objs.size()=1 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zA2kErlx3yaMysXM0QE4alzV_qSEkfc_0 2024-04-03T05:14:09.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15123142062115961393', time=2024-04-03T06:34:40.832256+0000, chain.objs.size()=1 2024-04-03T05:14:09.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.M4vDHVy2jYm2bm1YCwlEVm0_LSJ46pY_0 2024-04-03T05:14:09.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15002744197276507301', time=2024-04-03T06:34:42.347837+0000, chain.objs.size()=1 2024-04-03T05:14:09.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3SPONfeaCIskZcdCc445_Z8VHecRo_X_0 2024-04-03T05:14:09.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10385201187045708338', time=2024-04-03T06:34:44.108673+0000, chain.objs.size()=1 2024-04-03T05:14:09.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.o_hTRzIclK1YGBwIHACyPggM64rVRup_0 2024-04-03T05:14:09.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11219592971625848520', time=2024-04-03T06:34:44.366981+0000, chain.objs.size()=1 2024-04-03T05:14:09.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gi8Br_TicrXshPrY815-cpOS7C01AkS_0 2024-04-03T05:14:09.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4406701520969857345', time=2024-04-03T06:34:44.441471+0000, chain.objs.size()=1 2024-04-03T05:14:09.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CvyglP1HmS9gyPKXeU3mKArGK0UCVwx_0 2024-04-03T05:14:09.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14916136073089326650', time=2024-04-03T06:34:46.206609+0000, chain.objs.size()=1 2024-04-03T05:14:09.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Sbss-ujN-feul9uT6wpbE79UU6XMVcG_0 2024-04-03T05:14:09.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8597645917699085819', time=2024-04-03T06:34:47.360946+0000, chain.objs.size()=1 2024-04-03T05:14:09.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ElBTbV1sLo7ENihsfLfwqC3jO73niDF_0 2024-04-03T05:14:09.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16245240433125879526', time=2024-04-03T06:34:47.726345+0000, chain.objs.size()=1 2024-04-03T05:14:09.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.epi48xmH2vXOszNokWNXKtpBslQcgLX_0 2024-04-03T05:14:09.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8385674654219775920', time=2024-04-03T06:34:48.888501+0000, chain.objs.size()=1 2024-04-03T05:14:09.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YnxRz3BT1m0IfdcBi8QsmFC3FgK-3bL_0 2024-04-03T05:14:09.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1675791958364087350', time=2024-04-03T06:34:49.708300+0000, chain.objs.size()=1 2024-04-03T05:14:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Md4SfpWzEoY7zlz6q5pABWfZHFgUsoi_0 2024-04-03T05:14:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.844560317338241919', time=2024-04-03T06:34:50.031355+0000, chain.objs.size()=1 2024-04-03T05:14:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ogmHK4KDQkBoDzo1NTnT4w_NrAC8V3S_0 2024-04-03T05:14:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.705264444216244113', time=2024-04-03T06:34:50.803198+0000, chain.objs.size()=1 2024-04-03T05:14:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BhSjDUoAx2Hi43VUb7UOp0606DVtcaQ_0 2024-04-03T05:14:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7610807044531985451', time=2024-04-03T06:34:51.316123+0000, chain.objs.size()=1 2024-04-03T05:14:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.aGwJ1QCReonlLLE3lfT6_GgH3eqjEI4_0 2024-04-03T05:14:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12394396039644175690', time=2024-04-03T06:34:51.718060+0000, chain.objs.size()=1 2024-04-03T05:14:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.UGxb3IlSgqf0V1u18vrCozl3djTLpzU_0 2024-04-03T05:14:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3561794998641069131', time=2024-04-03T06:34:52.369193+0000, chain.objs.size()=1 2024-04-03T05:14:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.qD_g4r22LrBdtK2MJjgDBfM3bvzVdiu_0 2024-04-03T05:14:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14333724103910487313', time=2024-04-03T06:34:52.842578+0000, chain.objs.size()=1 2024-04-03T05:14:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.253+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KkeiPFcDg5uK8fXDtOTzx7j818F_IAP_0 2024-04-03T05:14:09.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6021876986926127927', time=2024-04-03T06:34:53.310161+0000, chain.objs.size()=1 2024-04-03T05:14:09.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vS9T7nA9aoH0LNIsQr3C37g_8ZUfLTW_0 2024-04-03T05:14:09.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14658284385854059939', time=2024-04-03T06:34:53.636852+0000, chain.objs.size()=1 2024-04-03T05:14:09.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7icT7jHljrFp1SZphtGbq12GUZDnE7s_0 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.447736073911678817', time=2024-04-03T06:34:54.938976+0000, chain.objs.size()=1 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GHaNQu-m3CMSCjSVZEml5Rxy_a_vgo7_0 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14942941227432830963', time=2024-04-03T06:34:55.437645+0000, chain.objs.size()=1 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.eb8zcP_ycPCCrO-X9bbToyLgNoX3onG_0 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9035864314699989939', time=2024-04-03T06:34:55.576726+0000, chain.objs.size()=1 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9oAJBE3wO4dxf5QM5GOMm0U1HHdBWK__0 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17581940523740168500', time=2024-04-03T06:34:55.797884+0000, chain.objs.size()=1 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.bfJOd8ESFAQWQ_7hYd41V5-KlFtjarR_0 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6172787538938882583', time=2024-04-03T06:35:13.703660+0000, chain.objs.size()=1 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.302__shadow_.2euRJwZ2vaq_CCnOSU84k4vO6bxkzrl_0 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2050002592519091760', time=2024-04-03T06:36:46.290123+0000, chain.objs.size()=1 2024-04-03T05:14:09.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.351__shadow_.Jw9Z5hQRHar-F-zqUeEm0r42ZIJ-HKs_0 2024-04-03T05:14:09.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13214246662713570195', time=2024-04-03T06:40:14.365032+0000, chain.objs.size()=1 2024-04-03T05:14:09.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.uZCj-K_f4Hx-18iNW4tPVD2ylHPRSTk_0 2024-04-03T05:14:09.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_1_d5693ec0afd7da85788b131d714a5e90', time=2024-04-03T06:41:02.011841+0000, chain.objs.size()=1 2024-04-03T05:14:09.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_0 2024-04-03T05:14:09.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13210298893303080934', time=2024-04-03T06:41:57.207823+0000, chain.objs.size()=1 2024-04-03T05:14:09.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.482__shadow_.h_RKuoFlPP0KYS_g6GPo8WTxoPH0g40_0 2024-04-03T05:14:09.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/45592 2024-04-03T05:14:09.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-04-03T05:14:09.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y', time=2024-04-03T06:47:12.328662+0000, chain.objs.size()=1 2024-04-03T05:14:09.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y.1 2024-04-03T05:14:09.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y', time=2024-04-03T06:47:12.338165+0000, chain.objs.size()=1 2024-04-03T05:14:09.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y.2 2024-04-03T05:14:09.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y', time=2024-04-03T06:47:12.348319+0000, chain.objs.size()=1 2024-04-03T05:14:09.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y.3 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y', time=2024-04-03T06:47:12.358638+0000, chain.objs.size()=1 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y.4 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y', time=2024-04-03T06:47:12.368055+0000, chain.objs.size()=1 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y.5 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y', time=2024-04-03T06:47:12.377120+0000, chain.objs.size()=1 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~Wu0_VmbmjFwSdpuVZU7CB3dYlfqWd2Y.6 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5988946229275101280', time=2024-04-03T06:48:20.980452+0000, chain.objs.size()=2 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~FKbum3LOx32aBAwx7P4zqeygMb73awx.1 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~FKbum3LOx32aBAwx7P4zqeygMb73awx.2 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8753283929964350411', time=2024-04-03T06:48:36.365575+0000, chain.objs.size()=2 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~YmpEzxG0AAPG8f0oZZfobQ6wvBFSQRB.1 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~YmpEzxG0AAPG8f0oZZfobQ6wvBFSQRB.2 2024-04-03T05:14:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16465084126173810020', time=2024-04-03T06:51:49.683967+0000, chain.objs.size()=1 2024-04-03T05:14:09.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.526__shadow_.TAcYYmu9RUpVFbXt6dr2KryIm_mT6PY_0 2024-04-03T05:14:09.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1871574972582609249', time=2024-04-03T06:52:11.755541+0000, chain.objs.size()=1 2024-04-03T05:14:09.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.529__shadow_.4NkYr5fCG8ITLOhnpIxFwoLPbp8vyI9_0 2024-04-03T05:14:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8749323842491262742', time=2024-04-03T06:52:42.738906+0000, chain.objs.size()=1 2024-04-03T05:14:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:1ReifqstKotjXHDKBOH2Dl2gFCAbWUt_.r9ZufD0KgRqQc0-ROqNFIt1j9WjPZV3_0 2024-04-03T05:14:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4386338666120713794', time=2024-04-03T06:52:48.827406+0000, chain.objs.size()=1 2024-04-03T05:14:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:QY-At5IVMML9x.KE0HWRxNt2hhurpE1_.9gdOX5Unvw-fHi14TdldfTn12uCqPD__0 2024-04-03T05:14:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5538167870928989258', time=2024-04-03T06:52:58.489595+0000, chain.objs.size()=1 2024-04-03T05:14:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:jrck3bEyGTSkVR8HgyjMl.RblspNNkV_.5tiSKlQFGpzvvr_O41KWak1j852ctd9_0 2024-04-03T05:14:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:ixjAryEww69RyeDNyYe3btJWQjo0FgI_.wb0MbNkn7Ea1fIWKA8IVb0vtDY6aKS5_1_894850a56853743a9e53aed653147336', time=2024-04-03T06:55:29.900638+0000, chain.objs.size()=1 2024-04-03T05:14:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:ixjAryEww69RyeDNyYe3btJWQjo0FgI_.wb0MbNkn7Ea1fIWKA8IVb0vtDY6aKS5_0 2024-04-03T05:14:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1702297085419269421', time=2024-04-03T06:55:40.958842+0000, chain.objs.size()=1 2024-04-03T05:14:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.554__shadow:Y1bc0N0R4L2WgeP745BK-.vZKxnLWm2_.H3jA9IwdcnwQbejSht3RQkdSwsF9KSV_0 2024-04-03T05:14:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.137826763767032376', time=2024-04-03T06:55:48.787533+0000, chain.objs.size()=1 2024-04-03T05:14:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.556__shadow:u79T2YYkcQzelNADV7ugb2JlhAkVeU1_.FUfvjDQw7-CVPxoNfU6rQ-EAo1KdaWO_0 2024-04-03T05:14:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5578277746217336844', time=2024-04-03T07:02:09.701683+0000, chain.objs.size()=2 2024-04-03T05:14:09.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.614__shadow_.jH0anJdaYXrRL8VIFDdOWLJreuziLvO_0 2024-04-03T05:14:09.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.614__shadow_.jH0anJdaYXrRL8VIFDdOWLJreuziLvO_1 2024-04-03T05:14:09.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.429426478605790262', time=2024-04-03T07:04:33.921880+0000, chain.objs.size()=1 2024-04-03T05:14:09.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.659__shadow:Yipz6GaqQzk5zZInJm3hL-L2hfcElxC_.XVdo7AbFK1-RTw5YLrb-2Obd4wm_pnQ_0 2024-04-03T05:14:09.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15493836656056563562', time=2024-04-03T07:04:50.213832+0000, chain.objs.size()=1 2024-04-03T05:14:09.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.667__multipart_file1.2~QYV4HOGWGc6UPtBP2RmpaN11SBFrgBf.1 2024-04-03T05:14:09.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-03T05:14:09.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58999' 2024-04-03T05:14:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8860295503201737672', time=2024-04-03T06:20:55.418232+0000, chain.objs.size()=1 2024-04-03T05:14:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.146__shadow:8HAJUEAi9uncOVHmOnI2IfH9ogwEGc1_.ydE1Yu3cBQjKnnVEYoqx62N4yl6GZ7D_0 2024-04-03T05:14:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1137343738721761535', time=2024-04-03T06:21:34.482627+0000, chain.objs.size()=3 2024-04-03T05:14:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__multipart_mymultipart-STANDARD.2~ie9DqDh-1pfjluT3v58LRVuBvQA-Ch_.1 2024-04-03T05:14:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__multipart_mymultipart-STANDARD.2~ie9DqDh-1pfjluT3v58LRVuBvQA-Ch_.2 2024-04-03T05:14:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__multipart_mymultipart-STANDARD.2~ie9DqDh-1pfjluT3v58LRVuBvQA-Ch_.3 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.312663279758261678', time=2024-04-03T06:25:48.735149+0000, chain.objs.size()=1 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.217__shadow_.H4d7nFjhprMlvgAZgPCeuypx0oRR8dk_0 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3237408677119209029', time=2024-04-03T06:25:50.929310+0000, chain.objs.size()=1 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.218__shadow_.GseqjaGxygE63EieCVrhbixyahyNme-_0 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9974176545332797952', time=2024-04-03T06:26:14.803555+0000, chain.objs.size()=1 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.229__shadow_.mMi_6ovojwOlsS1hqJ27okpp1Yc5F47_0 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6700315508321969958', time=2024-04-03T06:27:52.396061+0000, chain.objs.size()=1 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.W-YeE53xbk05aMpkF_oDvFXIP0YWMmF_0 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18321721278879484515', time=2024-04-03T06:27:52.688771+0000, chain.objs.size()=1 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.REk1P6YvE3GNf-2ZtTNg7W1y64uSZcv_0 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5678626795936408646', time=2024-04-03T06:27:52.760906+0000, chain.objs.size()=1 2024-04-03T05:14:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1Bc2jNkL0ZOyGhnIT0tvxqAHzGw-hHO_0 2024-04-03T05:14:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4213317477360032547', time=2024-04-03T06:27:55.051180+0000, chain.objs.size()=1 2024-04-03T05:14:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-AZJsoyBvqvusncdFBWwXv6coI4YKce_0 2024-04-03T05:14:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16390050430276395640', time=2024-04-03T06:27:56.408410+0000, chain.objs.size()=1 2024-04-03T05:14:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Ei9J1227OZ-wEKzCqz191qgKI0Bj3wo_0 2024-04-03T05:14:09.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4599195217334336090', time=2024-04-03T06:27:56.653089+0000, chain.objs.size()=1 2024-04-03T05:14:09.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Hq_MUnUMG5xOZCVw_TOJ7afPSlyuLCY_0 2024-04-03T05:14:09.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4786035507085932660', time=2024-04-03T06:27:57.364212+0000, chain.objs.size()=1 2024-04-03T05:14:09.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wq8PXQiQuAyLAGpcuBhAaFNJdbjA66Y_0 2024-04-03T05:14:09.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14219663989653323325', time=2024-04-03T06:27:58.423503+0000, chain.objs.size()=1 2024-04-03T05:14:09.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.r2wbP8Z-16D3R6P4v08Cvj3eUURkKDy_0 2024-04-03T05:14:09.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9884129590015018575', time=2024-04-03T06:27:59.084726+0000, chain.objs.size()=1 2024-04-03T05:14:09.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rzAQVCJqO9pflqG8ZA2QbxJB4U5nCSW_0 2024-04-03T05:14:09.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18431294485147381362', time=2024-04-03T06:27:59.109282+0000, chain.objs.size()=1 2024-04-03T05:14:09.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.hfXJymbnJ-mc8_IyGWtfO2WnM6b7jZb_0 2024-04-03T05:14:09.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15702280942101664091', time=2024-04-03T06:28:04.034135+0000, chain.objs.size()=1 2024-04-03T05:14:09.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cEuVd8yB_QBy1YMQsP9mjY-1XM_RAfc_0 2024-04-03T05:14:09.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17183732538396630818', time=2024-04-03T06:28:04.036354+0000, chain.objs.size()=1 2024-04-03T05:14:09.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.FAsmaI5h8S7yrVWNfN-tgYUwMogtd9k_0 2024-04-03T05:14:09.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9965681868917885183', time=2024-04-03T06:28:04.155513+0000, chain.objs.size()=1 2024-04-03T05:14:09.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.U7q-ZuQebC3tlhKU2z7X2T7i2oUYw82_0 2024-04-03T05:14:09.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4149724257264094498', time=2024-04-03T06:28:04.792534+0000, chain.objs.size()=1 2024-04-03T05:14:09.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XHlKkao7_25GjMc9VUjPZFt4hHfoCSc_0 2024-04-03T05:14:09.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16931857209629887494', time=2024-04-03T06:28:05.136756+0000, chain.objs.size()=1 2024-04-03T05:14:09.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cGM01ujfXmmJpNdoyydeFH3G36xnZqN_0 2024-04-03T05:14:09.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16565486567049144308', time=2024-04-03T06:28:06.866137+0000, chain.objs.size()=1 2024-04-03T05:14:09.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Kl_zuJkEvUnCTrChftKwENzDSCit7nb_0 2024-04-03T05:14:09.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1643083522844974787', time=2024-04-03T06:28:07.899412+0000, chain.objs.size()=1 2024-04-03T05:14:09.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BIZLBhi0O_xhCBebBXTHWzaq2v9-n5p_0 2024-04-03T05:14:09.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14409976660935095839', time=2024-04-03T06:28:09.186536+0000, chain.objs.size()=1 2024-04-03T05:14:09.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dc6Z5LfT4N-6X-x8LOFHnOiTiadz874_0 2024-04-03T05:14:09.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5952215059399669326', time=2024-04-03T06:28:09.495681+0000, chain.objs.size()=1 2024-04-03T05:14:09.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UJh1HuwlKtOBVR6BgW6lhsfjEh0gSYI_0 2024-04-03T05:14:09.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9040483214509599819', time=2024-04-03T06:28:10.026692+0000, chain.objs.size()=1 2024-04-03T05:14:09.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0kGabVS4_r2aN2GeVUdRkoXel_YVSja_0 2024-04-03T05:14:09.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6590899239239694704', time=2024-04-03T06:28:10.373872+0000, chain.objs.size()=1 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0NyW9GBPkOZY5soe-6md0L6mQrVWHwu_0 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12941857975823418915', time=2024-04-03T06:28:11.524610+0000, chain.objs.size()=1 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.42w3ap5N8OLKrlK0xnpCOqqorofs5Qs_0 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16383400746663288668', time=2024-04-03T06:28:11.890170+0000, chain.objs.size()=1 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5UPBQaMa9FsziHX8dsSj2uHGQmXmrus_0 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15676554938948383103', time=2024-04-03T06:28:13.083350+0000, chain.objs.size()=1 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jmEui0OPn9R6BSVxMTT8u_fjJw2Ay5I_0 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3078573532751830408', time=2024-04-03T06:28:13.638394+0000, chain.objs.size()=1 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Qc3m2wHAHCAMLcv960dLfWayERu9VDr_0 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15490848681908586727', time=2024-04-03T06:28:13.691523+0000, chain.objs.size()=1 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5cHI2X2EEILZ18PGH4AkYDV5c1iVhIn_0 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14808572897180549103', time=2024-04-03T06:28:13.878099+0000, chain.objs.size()=1 2024-04-03T05:14:09.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.n5_HxLNMtlsFvq7PfoF_ITZTWCCdMt2_0 2024-04-03T05:14:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11470748696613246109', time=2024-04-03T06:28:14.151578+0000, chain.objs.size()=1 2024-04-03T05:14:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.E8XWcU0pGHt46dMiJ3RIKJvl4ePg1Jp_0 2024-04-03T05:14:09.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2458169624099024676', time=2024-04-03T06:28:15.550380+0000, chain.objs.size()=1 2024-04-03T05:14:09.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gO-dgw6I_Om5IAPt0tjh3eXOchNNdOK_0 2024-04-03T05:14:09.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15803248605096261591', time=2024-04-03T06:28:16.012621+0000, chain.objs.size()=1 2024-04-03T05:14:09.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7-wP8enwCxaflPOdJfdaAhh1x6m71Qk_0 2024-04-03T05:14:09.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10710811639660857442', time=2024-04-03T06:28:16.206870+0000, chain.objs.size()=1 2024-04-03T05:14:09.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tf_k_l7iYb4G33hlDeOFvn2HX0YZAH9_0 2024-04-03T05:14:09.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14326119147670805127', time=2024-04-03T06:28:17.323393+0000, chain.objs.size()=1 2024-04-03T05:14:09.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4eEj07qus5lFAul1iXnzpVVDKqvkuTF_0 2024-04-03T05:14:09.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4693346688120702811', time=2024-04-03T06:28:17.821253+0000, chain.objs.size()=1 2024-04-03T05:14:09.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qe_TN5ieXGdlFb8iJ6OoTAceBSaCAtB_0 2024-04-03T05:14:09.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16110450527059652430', time=2024-04-03T06:28:19.142383+0000, chain.objs.size()=1 2024-04-03T05:14:09.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rNYxiA_a2wb9gUT6fuDH7qATkxMkBNG_0 2024-04-03T05:14:09.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14571973993277200467', time=2024-04-03T06:28:19.190112+0000, chain.objs.size()=1 2024-04-03T05:14:09.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GB0ickV0T8Ho7PS3pJn2JZZwx0XSKwL_0 2024-04-03T05:14:09.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12119190538687169387', time=2024-04-03T06:28:20.376587+0000, chain.objs.size()=1 2024-04-03T05:14:09.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.np7zYc9bozx2xJfNVLrWubq7CQNYARP_0 2024-04-03T05:14:09.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10952590763484772875', time=2024-04-03T06:28:29.666666+0000, chain.objs.size()=1 2024-04-03T05:14:09.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.235__shadow_.1mCRZDHlZ3mOdGaaqbJj1hZrrS62Fbp_0 2024-04-03T05:14:09.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15685242405068963494', time=2024-04-03T06:28:33.807445+0000, chain.objs.size()=1 2024-04-03T05:14:09.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.237__shadow_.l5X81ZyTzUQQ-J7qnXfpeGBE5XIZEb5_0 2024-04-03T05:14:09.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10183247141295064537', time=2024-04-03T06:28:35.918462+0000, chain.objs.size()=1 2024-04-03T05:14:09.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.238__shadow_.-6BlKM1fEy5NILZ8hpTcq8vBLhdMhcs_0 2024-04-03T05:14:09.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9200732646840396492', time=2024-04-03T06:28:37.920757+0000, chain.objs.size()=1 2024-04-03T05:14:09.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.239__shadow_.Kfzjdnl68jrktk5anTtJfDFRF-XQEsf_0 2024-04-03T05:14:09.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17202969031405609098', time=2024-04-03T06:28:37.922532+0000, chain.objs.size()=1 2024-04-03T05:14:09.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.239__shadow_.0lBMAhDvFeOKAEoMCWXK6gsfgvegsD9_0 2024-04-03T05:14:09.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17133083864764542982', time=2024-04-03T06:28:48.462373+0000, chain.objs.size()=1 2024-04-03T05:14:09.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.244__shadow_.eHIUt3ZiiP15vhYWw-aK4Rf18IYo126_0 2024-04-03T05:14:09.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6182574136593901011', time=2024-04-03T06:29:03.949715+0000, chain.objs.size()=1 2024-04-03T05:14:09.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.251__shadow_.dgkRFwB3DImnsk3pbD4UXOM5QqhevWi_0 2024-04-03T05:14:09.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17797994975861050193', time=2024-04-03T06:29:36.199481+0000, chain.objs.size()=1 2024-04-03T05:14:09.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.5nPD5o7_-eGs9JYYgNlHkZC36ShOTsh_0 2024-04-03T05:14:09.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7048827754032018507', time=2024-04-03T06:30:05.588740+0000, chain.objs.size()=1 2024-04-03T05:14:09.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.275__shadow_.9VnWVV_k43y7yE92kkYmKJoMPBHNJPg_0 2024-04-03T05:14:09.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8592982541007593856', time=2024-04-03T06:32:24.619084+0000, chain.objs.size()=1 2024-04-03T05:14:09.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rIsbsAllZFWok3jrl4KFAL2qeZ0C1Vr_0 2024-04-03T05:14:09.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18046305531185611347', time=2024-04-03T06:32:25.305767+0000, chain.objs.size()=1 2024-04-03T05:14:09.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.TzfgnG4q9olgQib5r_MjTg7fTcM6kjH_0 2024-04-03T05:14:09.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5132584202936649835', time=2024-04-03T06:32:25.508464+0000, chain.objs.size()=1 2024-04-03T05:14:09.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.WlxO8_WhXphRiAGmamFwLL4g3z6x8fI_0 2024-04-03T05:14:09.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9012445051305933802', time=2024-04-03T06:32:26.721370+0000, chain.objs.size()=1 2024-04-03T05:14:09.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.M5F0GJ29VsZftcyTCcp0gYBjQPg6Yl7_0 2024-04-03T05:14:09.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9456989376899151068', time=2024-04-03T06:32:28.667305+0000, chain.objs.size()=1 2024-04-03T05:14:09.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.eTi2yQ1J7iE0N3cXXLtmniVygRCQxOy_0 2024-04-03T05:14:09.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15807559400868362302', time=2024-04-03T06:32:30.162219+0000, chain.objs.size()=1 2024-04-03T05:14:09.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2cjRBzLLLtD_oAOFTNpgVrT-2PM0DlT_0 2024-04-03T05:14:09.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12341046959354804955', time=2024-04-03T06:32:32.262738+0000, chain.objs.size()=1 2024-04-03T05:14:09.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1uhkcYSPQ6wOHVx8M5sVWZrx6XPnHSQ_0 2024-04-03T05:14:09.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12016053264574773351', time=2024-04-03T06:32:32.373075+0000, chain.objs.size()=1 2024-04-03T05:14:09.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lfezSZzHg6x0L30ec-XlGuKgXO52Ub3_0 2024-04-03T05:14:09.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9359421091156829778', time=2024-04-03T06:32:32.512826+0000, chain.objs.size()=1 2024-04-03T05:14:09.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uiczz449MRhMTpcQksWQdwoc2QrAvue_0 2024-04-03T05:14:09.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8868123047863390114', time=2024-04-03T06:32:33.454177+0000, chain.objs.size()=1 2024-04-03T05:14:09.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ThgR81Qc3xKkOCXGludp4yrWPMlGGHs_0 2024-04-03T05:14:09.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14373684229697229497', time=2024-04-03T06:32:34.244331+0000, chain.objs.size()=1 2024-04-03T05:14:09.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.khX996E-xA-kwhx3E5URvKUXVgHSSod_0 2024-04-03T05:14:09.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13108405773578197672', time=2024-04-03T06:32:34.332894+0000, chain.objs.size()=1 2024-04-03T05:14:09.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hGsa6hW_cosC50arbBHxhVd6eLlI21j_0 2024-04-03T05:14:09.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8926180787038804770', time=2024-04-03T06:32:34.334573+0000, chain.objs.size()=1 2024-04-03T05:14:09.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lOrxgZftb4qy2ZDK78ul8xQa3GUUCYP_0 2024-04-03T05:14:09.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7533438472324394208', time=2024-04-03T06:32:35.569498+0000, chain.objs.size()=1 2024-04-03T05:14:09.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.3e6vguF1EDQ26SwY6W6HZ-mW3RVftnc_0 2024-04-03T05:14:09.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2676905786738262256', time=2024-04-03T06:32:37.600564+0000, chain.objs.size()=1 2024-04-03T05:14:09.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rKVI_RHXbAGkz7qeBBClWWyu6aKQqGr_0 2024-04-03T05:14:09.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6341885811311817138', time=2024-04-03T06:32:37.927543+0000, chain.objs.size()=1 2024-04-03T05:14:09.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.048E0jn_zbOCgrRh3l_JXZ3gtjt4IHR_0 2024-04-03T05:14:09.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7919858619373148291', time=2024-04-03T06:32:38.236810+0000, chain.objs.size()=1 2024-04-03T05:14:09.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sBQIn3y60c2CrJF0VfClm1fil3QhP9v_0 2024-04-03T05:14:09.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1928217100934343611', time=2024-04-03T06:32:39.845155+0000, chain.objs.size()=1 2024-04-03T05:14:09.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.etNus9QmK5A4xQSJurS7UC8XFBe-FI9_0 2024-04-03T05:14:09.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3730727473241529821', time=2024-04-03T06:32:40.145491+0000, chain.objs.size()=1 2024-04-03T05:14:09.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Sf1rxPZG6X4Bfy3l4Ztd_vBgIVnndsy_0 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17075162244905341731', time=2024-04-03T06:32:40.801119+0000, chain.objs.size()=1 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7Kr1malUgUSCpPpAo1ntPmAjUKzjcW1_0 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3623316282382312443', time=2024-04-03T06:32:41.082035+0000, chain.objs.size()=1 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.W-cKaRDo72eqByf5Z2Iucz6oap7eLFr_0 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17041491044130573437', time=2024-04-03T06:32:41.457988+0000, chain.objs.size()=1 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EyKc2q3OiqkaaVsGlsCJT6J9yxrIeBc_0 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12877629965331042719', time=2024-04-03T06:32:42.004086+0000, chain.objs.size()=1 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-uVRI0XSdcAkmkVdW4Dtkd2ppU6Vqw7_0 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1610642736749820973', time=2024-04-03T06:32:42.088779+0000, chain.objs.size()=1 2024-04-03T05:14:09.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AaytBbhEG4X2smq7CU6Vbb-r9Hg3soM_0 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2964158599879803142', time=2024-04-03T06:32:42.107417+0000, chain.objs.size()=1 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yHCTB0R0RoGNjhdV0Fclnvyp7AvRdQG_0 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6412920285835388830', time=2024-04-03T06:32:43.811221+0000, chain.objs.size()=1 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gWilcrI55H7PjoZ18ki8a-4ziYahiaI_0 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10075588100966048264', time=2024-04-03T06:32:43.940217+0000, chain.objs.size()=1 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.v4DTBP9A5TA-BsWdRDvWSvEN1Gw3zJp_0 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14186967011049127517', time=2024-04-03T06:32:46.766935+0000, chain.objs.size()=1 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tjWPGdThyUHzQWLfkCJYpv41QaiSJpF_0 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7959137538688661186', time=2024-04-03T06:32:46.873659+0000, chain.objs.size()=1 2024-04-03T05:14:09.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.fm3io5RYWH4kwhXJwm0jlywC6i2cHfC_0 2024-04-03T05:14:09.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13916604503721518903', time=2024-04-03T06:32:47.653117+0000, chain.objs.size()=1 2024-04-03T05:14:09.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lowzZnTdtKRl1IqbvTPCjHwmGOfmdGX_0 2024-04-03T05:14:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10881582713954275348', time=2024-04-03T06:32:48.836729+0000, chain.objs.size()=1 2024-04-03T05:14:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UGPqQIkXLXi-7-e4WXEFAY9fH-EfRMj_0 2024-04-03T05:14:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7125674945342094533', time=2024-04-03T06:32:49.223402+0000, chain.objs.size()=1 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gSr_BswcCLVFI0O4Vi70ryJ3Wh0_Dgh_0 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15049347639337530118', time=2024-04-03T06:32:49.960235+0000, chain.objs.size()=1 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.LR_h3YetpbJKHvRx3BpWMygyX7dYJvK_0 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8002521875422934878', time=2024-04-03T06:32:50.074376+0000, chain.objs.size()=1 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.X7DTIrnKoEgZlZS2B3zsHkAEsF3BTOn_0 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.199930213406113070', time=2024-04-03T06:34:28.661759+0000, chain.objs.size()=1 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KXKbEYmYBmfVDO52E_EUEF6M9Q7LR4G_0 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12623610982284476270', time=2024-04-03T06:34:30.767378+0000, chain.objs.size()=1 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.j_0t-r0zwyRqfcNohj1Nced2mmf2-dS_0 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17961141545218162254', time=2024-04-03T06:34:33.445647+0000, chain.objs.size()=1 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.AwjRbi8k8qo9pLfXx2qhbtr126Gs0_A_0 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2308034205932329429', time=2024-04-03T06:34:34.023771+0000, chain.objs.size()=1 2024-04-03T05:14:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fuuXYQ6aqJU8oAVfgoEvDiA0Lf-7jnl_0 2024-04-03T05:14:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8531484128146174994', time=2024-04-03T06:34:34.916134+0000, chain.objs.size()=1 2024-04-03T05:14:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.l4ZlHg9pbFVx_1iFDhkGvxENo4zNS-__0 2024-04-03T05:14:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6028350974937156351', time=2024-04-03T06:34:38.173318+0000, chain.objs.size()=1 2024-04-03T05:14:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._zYpDjcdsR8Rpax6WAlWeMVbY8v2YJq_0 2024-04-03T05:14:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8910357234894980654', time=2024-04-03T06:34:38.356938+0000, chain.objs.size()=1 2024-04-03T05:14:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ZIHCwfjx-0_nMXdLJRTqNRHpmopY0_I_0 2024-04-03T05:14:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.325+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4644695612967628664', time=2024-04-03T06:34:38.841266+0000, chain.objs.size()=1 2024-04-03T05:14:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.325+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.paYsWfgCzW0DpwVc8KiTkZvspXsffo7_0 2024-04-03T05:14:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11659982208114810292', time=2024-04-03T06:34:40.168378+0000, chain.objs.size()=1 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yKsT4d_i9tf1udkITV1LioBu5juf4wf_0 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13187653924082390277', time=2024-04-03T06:34:40.840044+0000, chain.objs.size()=1 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nOgp0UePntdKh4hpqV8QnEvWEmZEwUl_0 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13092614186978616461', time=2024-04-03T06:34:41.915676+0000, chain.objs.size()=1 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VZKVST61NvEArKuZJj2Nl651RkR1ca9_0 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6768816656018503057', time=2024-04-03T06:34:42.292910+0000, chain.objs.size()=1 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.g_cpEUOEZ-1VaJvPYWVn6fo6_vmxfp4_0 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9747765759391682413', time=2024-04-03T06:34:44.499089+0000, chain.objs.size()=1 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.bRqCBE5D5xyXACv-Zw_9tPgQ7CSY_l7_0 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10247770364379730543', time=2024-04-03T06:34:45.696277+0000, chain.objs.size()=1 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.bpLReKCqqyIlfEGNkBLWM1ksda0sTOD_0 2024-04-03T05:14:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1324076271195610664', time=2024-04-03T06:34:46.323691+0000, chain.objs.size()=1 2024-04-03T05:14:09.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YjAGDZEy5sMBxk3IrC0ww7Pk60PvZ9k_0 2024-04-03T05:14:09.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5916138617314881171', time=2024-04-03T06:34:47.767251+0000, chain.objs.size()=1 2024-04-03T05:14:09.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.reF-YI5x0mKEcXKGie4apP2hzurlIJh_0 2024-04-03T05:14:09.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/58999 2024-04-03T05:14:09.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-04-03T05:14:09.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2904702144266755137', time=2024-04-03T06:34:48.200580+0000, chain.objs.size()=1 2024-04-03T05:14:09.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.iQJi4DXax-SZZAUN-mCjYiT6RIEsoFK_0 2024-04-03T05:14:09.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2236555922522605786', time=2024-04-03T06:34:48.400317+0000, chain.objs.size()=1 2024-04-03T05:14:09.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SXW5aHIu4mAe7Ux-jArAZtOKkxhM1Gx_0 2024-04-03T05:14:09.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1835398398994199063', time=2024-04-03T06:34:49.248078+0000, chain.objs.size()=1 2024-04-03T05:14:09.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.H05i0ny0nBRxKKQlkgNuRuT6kbQTOv-_0 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4441737370235072596', time=2024-04-03T06:34:49.468945+0000, chain.objs.size()=1 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kllwfTnkGVapnlR10FQ33eBViEP11pD_0 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7016668329151232653', time=2024-04-03T06:34:49.906316+0000, chain.objs.size()=1 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.N29wHs3sxz6xWGCGaH60CyCKFDxYamO_0 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8300858788813260392', time=2024-04-03T06:34:50.980915+0000, chain.objs.size()=1 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.v0j8LBgFzYEaEqQEH5O1esvxD0y_3RS_0 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3970076758285219925', time=2024-04-03T06:34:51.542837+0000, chain.objs.size()=1 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.g7YvD6zc9dfU-QS2Q47rhVnqZgHO4pG_0 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15210637432557850771', time=2024-04-03T06:34:52.136520+0000, chain.objs.size()=1 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VsFUncfkNRB434tcBiAf0N5gAqYjG6w_0 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5403431044631458963', time=2024-04-03T06:34:52.448932+0000, chain.objs.size()=1 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DBgM_Tf7ynr0jCD-sSbigDgVHMYI5Ry_0 2024-04-03T05:14:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10028283311027047471', time=2024-04-03T06:34:53.403775+0000, chain.objs.size()=1 2024-04-03T05:14:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lyCAJtuAQMQldMz9q1bw-TEvbJItYVZ_0 2024-04-03T05:14:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2419651843369118989', time=2024-04-03T06:34:53.545326+0000, chain.objs.size()=1 2024-04-03T05:14:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wlC6PYpw_45WqplEne147A_8BuOb_rO_0 2024-04-03T05:14:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17634724293862757450', time=2024-04-03T06:34:54.520763+0000, chain.objs.size()=1 2024-04-03T05:14:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pucyPpdfutN3uXTm54DVaguSb6CGsYf_0 2024-04-03T05:14:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1588140561276768451', time=2024-04-03T06:34:54.523686+0000, chain.objs.size()=1 2024-04-03T05:14:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-73VF0JxDGycu4D8nKysqABKbpIktSD_0 2024-04-03T05:14:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.395913089049311126', time=2024-04-03T06:34:55.263817+0000, chain.objs.size()=1 2024-04-03T05:14:09.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.uRVNAbLgTfn3lKlK3vtygTV7MfFaQuI_0 2024-04-03T05:14:09.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9916816930637181319', time=2024-04-03T06:34:55.481720+0000, chain.objs.size()=1 2024-04-03T05:14:09.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Knc8aFDhO_9erhkkms59eK3DyAqK5mS_0 2024-04-03T05:14:09.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14075974916871842292', time=2024-04-03T06:34:55.775182+0000, chain.objs.size()=1 2024-04-03T05:14:09.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JbJTW0P48XIpm8u7PrWZW48KxgSKfLt_0 2024-04-03T05:14:09.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3988987904975551899', time=2024-04-03T06:34:56.000091+0000, chain.objs.size()=1 2024-04-03T05:14:09.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xtGYtUt8hW5eT21eyJb7kBSSbzu1Fk-_0 2024-04-03T05:14:09.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9755067744119921294', time=2024-04-03T06:34:56.262873+0000, chain.objs.size()=1 2024-04-03T05:14:09.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lhVD8Fa2BOuHQAAON6bd8cOzNYAoUnH_0 2024-04-03T05:14:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7096041038976716970', time=2024-04-03T06:35:00.263914+0000, chain.objs.size()=1 2024-04-03T05:14:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.295__shadow_.DEHNf7jY2rcf5mUuRmG53KFxy12uFo9_0 2024-04-03T05:14:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12584939580109665228', time=2024-04-03T06:35:11.789454+0000, chain.objs.size()=1 2024-04-03T05:14:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.301__shadow_.n5HGzDFmUj_NY159ZOp7kEXNKibmVl3_0 2024-04-03T05:14:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9356513104958242640', time=2024-04-03T06:35:15.603413+0000, chain.objs.size()=1 2024-04-03T05:14:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.303__shadow_.-4ggRf8IggQM004WRX_-ZXKNL24ibEx_0 2024-04-03T05:14:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3446102305146940094', time=2024-04-03T06:35:51.689775+0000, chain.objs.size()=1 2024-04-03T05:14:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.322__shadow_.b-MFFffzaZ9RcVxlZOWArSnup_GKTKX_0 2024-04-03T05:14:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.736061621512072658', time=2024-04-03T06:36:21.605650+0000, chain.objs.size()=1 2024-04-03T05:14:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.339__shadow_.RwUJllAZFldg6JobdLZSioJPMty-USm_0 2024-04-03T05:14:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14142385112097169339', time=2024-04-03T06:36:25.298958+0000, chain.objs.size()=1 2024-04-03T05:14:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.341__shadow_.kFv2SLzUlXz5vePgGvyCPOHQM2DTadk_0 2024-04-03T05:14:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17313151176459490878', time=2024-04-03T06:37:35.593329+0000, chain.objs.size()=1 2024-04-03T05:14:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.376__shadow_.8a3zzS9H6O-gWHT8lIVqlDUex0r6_Ei_0 2024-04-03T05:14:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.513014171323130630', time=2024-04-03T06:38:44.413281+0000, chain.objs.size()=1 2024-04-03T05:14:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.411__shadow_.K80dXl_rQbHn1nIgKkNUopHkuKtPjgq_0 2024-04-03T05:14:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8336484446930425252', time=2024-04-03T06:39:29.164586+0000, chain.objs.size()=1 2024-04-03T05:14:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.429__shadow_.9ObEjnRuGuqDOXI9jI7A2HavXa1_LSy_0 2024-04-03T05:14:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3178520495223551143', time=2024-04-03T06:39:29.171142+0000, chain.objs.size()=1 2024-04-03T05:14:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.429__shadow_.5dpOu3DBWOfSCK8_hvnEqd228n4C8J2_0 2024-04-03T05:14:09.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1019308109348255526', time=2024-04-03T06:40:14.334430+0000, chain.objs.size()=1 2024-04-03T05:14:09.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.uFgzcTH3YfxsnI_Kp1X0CPsSits7d0C_0 2024-04-03T05:14:09.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG', time=2024-04-03T06:45:36.249687+0000, chain.objs.size()=2 2024-04-03T05:14:09.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.3 2024-04-03T05:14:09.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~JfVmXXzCDXRqhR0eFLYKG4rRmFOcBOG.3_1 2024-04-03T05:14:09.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~em8pHYsLQDX56rJZtZPpiPnc96gdJ8B', time=2024-04-03T06:49:12.463793+0000, chain.objs.size()=2 2024-04-03T05:14:09.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.499__multipart_mymultipart.2~em8pHYsLQDX56rJZtZPpiPnc96gdJ8B.1 2024-04-03T05:14:09.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.499__multipart_mymultipart.2~em8pHYsLQDX56rJZtZPpiPnc96gdJ8B.2 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1776859523079758410', time=2024-04-03T06:52:45.301811+0000, chain.objs.size()=1 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:QovEYVDXxF2FqNPNXh.7KBB8gptpWTH_.X3n6xjspD4NSumUINY0fVnJKEayVDW8_0 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12032038976625337562', time=2024-04-03T06:52:54.956529+0000, chain.objs.size()=1 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:ElRwxDTFBAEvMTuz3Pb8S7s.xlM.urC_.hxFjri6_kryZ-7ox5yh2ojVKgUxbaln_0 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9362190827718754135', time=2024-04-03T06:53:21.159626+0000, chain.objs.size()=1 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow:kTBCev4csgSyaKmBp1WuAdoOEWMtvXj_.s3BcoBzSddasNZwslmE3Tx7JTJSn8R__0 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9990738708782477306', time=2024-04-03T06:53:24.413244+0000, chain.objs.size()=1 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.544__shadow_.ywH5hrDcIanc-CNfaFmbyA-iWQU_L_H_0 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15469138326360113424', time=2024-04-03T06:53:34.685816+0000, chain.objs.size()=1 2024-04-03T05:14:09.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:v5NIcFxIGjtscFuFuzRaXPijnFDyo2O_.k3e6nOQ1-NCCjlZJFzcw-y8Xq2bgA-y_0 2024-04-03T05:14:09.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:rWJ4oB2Trp8PCi23coUzRivhsnYYYCl_.4P-xbcO_DZegdwcAnZKsKSHKHO_0CzH_1_26467e6f3e59dffc766a27d01e2ac0ab', time=2024-04-03T06:55:29.108825+0000, chain.objs.size()=1 2024-04-03T05:14:09.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:rWJ4oB2Trp8PCi23coUzRivhsnYYYCl_.4P-xbcO_DZegdwcAnZKsKSHKHO_0CzH_0 2024-04-03T05:14:09.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14787091235397833935', time=2024-04-03T06:55:44.103959+0000, chain.objs.size()=1 2024-04-03T05:14:09.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.555__shadow:SKSHv1unpcZymGMFpnyYg7ZJ7Ut9l46_.8rxRckRIgQX1z6AvrGhJyj62qSNh8yl_0 2024-04-03T05:14:09.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16613845442553081010', time=2024-04-03T06:55:47.994261+0000, chain.objs.size()=1 2024-04-03T05:14:09.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.556__shadow:RGmHR7OzVCGPloyFIMCmcf5-RSP.ADw_.D4_IdVjxcKTYTqmAVkUr2Bd67Ixdbpj_0 2024-04-03T05:14:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-03T05:14:09.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/59112' 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_8d-87Iw11AB8wyDtnHMTR5fI21gh-rr', time=2024-04-03T06:21:42.806085+0000, chain.objs.size()=3 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.0agC7dwonp0960N_x2nturqAbqe7O7Q_0 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.0agC7dwonp0960N_x2nturqAbqe7O7Q_1 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.0agC7dwonp0960N_x2nturqAbqe7O7Q_2 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10002325631229862325', time=2024-04-03T06:22:24.656113+0000, chain.objs.size()=5 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__multipart_foo-LUKEWARM.2~3laCPg6V4wmnZ6A-HtBCw6qYta8qzW6.1 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_foo-LUKEWARM.2~3laCPg6V4wmnZ6A-HtBCw6qYta8qzW6.1_1 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__multipart_foo-LUKEWARM.2~3laCPg6V4wmnZ6A-HtBCw6qYta8qzW6.2 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_foo-LUKEWARM.2~3laCPg6V4wmnZ6A-HtBCw6qYta8qzW6.2_1 2024-04-03T05:14:09.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__multipart_foo-LUKEWARM.2~3laCPg6V4wmnZ6A-HtBCw6qYta8qzW6.3 2024-04-03T05:14:09.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16686092397979984179', time=2024-04-03T06:25:14.782752+0000, chain.objs.size()=1 2024-04-03T05:14:09.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.204__shadow_.1gWbIbT_wDyV4qvxcQztbQHf2KDY2zx_0 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3971073653765575185', time=2024-04-03T06:26:14.804189+0000, chain.objs.size()=1 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.229__shadow_.ZLNT2YsFOSwUxClBgZTQN5dV7rjZjEI_0 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7763254382228998185', time=2024-04-03T06:27:56.216225+0000, chain.objs.size()=1 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ET6KbzjRR8JWzTDV1bmeh-EEubyLHQ6_0 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6932741322772282861', time=2024-04-03T06:27:58.077452+0000, chain.objs.size()=1 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MH9Hr06qYS9KomiVWUZMJbRF_Snfvpw_0 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10585867501329630283', time=2024-04-03T06:27:58.818816+0000, chain.objs.size()=1 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cQvaYEzIcGgVYoG4oYHkmixCWHHSyQu_0 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2261152836510162999', time=2024-04-03T06:28:01.329911+0000, chain.objs.size()=1 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-ldhpzmzFuukRTLsvz0JALUm62IvGjg_0 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12021241228381956860', time=2024-04-03T06:28:01.825671+0000, chain.objs.size()=1 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.X5eFhELf5RDtiw-EpkiGKr0tl2AS1nB_0 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10355489936303998721', time=2024-04-03T06:28:04.010518+0000, chain.objs.size()=1 2024-04-03T05:14:09.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.zd5WXUojpVEG17ufM4HSE_YaAbwwma0_0 2024-04-03T05:14:09.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2460851426959900042', time=2024-04-03T06:28:04.463815+0000, chain.objs.size()=1 2024-04-03T05:14:09.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.a5dJmMLhC9TmNkzSpEouV9OwjLbj6xZ_0 2024-04-03T05:14:09.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6093098577459170415', time=2024-04-03T06:28:04.504848+0000, chain.objs.size()=1 2024-04-03T05:14:09.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sWxkX0OYgQQE97f_CDy74Gdw7BQvEgv_0 2024-04-03T05:14:09.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.674806838282062546', time=2024-04-03T06:28:05.473020+0000, chain.objs.size()=1 2024-04-03T05:14:09.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.P-1h7-4l7_pWqJ0sDiekkiB5AKjCQ2y_0 2024-04-03T05:14:09.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9299758877082861678', time=2024-04-03T06:28:06.697029+0000, chain.objs.size()=1 2024-04-03T05:14:09.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3llx7X3x8-cMdUiXNsIBE__X120RqxO_0 2024-04-03T05:14:09.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8069329867189707898', time=2024-04-03T06:28:07.762528+0000, chain.objs.size()=1 2024-04-03T05:14:09.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.98fOPy_7XFUF9N8Uly07JS7zgs5ABqz_0 2024-04-03T05:14:09.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11988631771158723067', time=2024-04-03T06:28:07.819937+0000, chain.objs.size()=1 2024-04-03T05:14:09.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XnOjXxCas9PhY47ynIANopwQWhOcKaA_0 2024-04-03T05:14:09.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9269068862207138286', time=2024-04-03T06:28:08.406169+0000, chain.objs.size()=1 2024-04-03T05:14:09.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tksYgiJP9xnMM-ONZHNVstvYlcIbbtY_0 2024-04-03T05:14:09.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6496762326358915677', time=2024-04-03T06:28:09.191484+0000, chain.objs.size()=1 2024-04-03T05:14:09.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.frt7iZl3UnkRpM4trWnsQJFMc0T_rAB_0 2024-04-03T05:14:09.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.465262791484891251', time=2024-04-03T06:28:09.936696+0000, chain.objs.size()=1 2024-04-03T05:14:09.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5uloGd15r__aFMx7wDZN9TsZA8Hc_Jq_0 2024-04-03T05:14:09.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5990329928242066800', time=2024-04-03T06:28:11.898706+0000, chain.objs.size()=1 2024-04-03T05:14:09.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3jUNBtafMdCgatQT8NaJCsltbPhZe4D_0 2024-04-03T05:14:09.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15493077686446413884', time=2024-04-03T06:28:13.730026+0000, chain.objs.size()=1 2024-04-03T05:14:09.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_._L2nv3TIsZVpSEolGyt55xrvfIJ3ru9_0 2024-04-03T05:14:09.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3716547216361931224', time=2024-04-03T06:28:17.811647+0000, chain.objs.size()=1 2024-04-03T05:14:09.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GFh4D23hqBcrCNluE5UnQt2lWsc0Jfr_0 2024-04-03T05:14:09.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18297222250110092301', time=2024-04-03T06:28:19.992525+0000, chain.objs.size()=1 2024-04-03T05:14:09.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4AqkTalfLb73iTPje2eKjo5kVMZuIfG_0 2024-04-03T05:14:09.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.552967369273428242', time=2024-04-03T06:28:23.329458+0000, chain.objs.size()=1 2024-04-03T05:14:09.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.232__shadow_.Kk87bT7uNe9j5GgC3HjcO2Skb-3uRH__0 2024-04-03T05:14:09.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10546985714977906578', time=2024-04-03T06:29:01.708833+0000, chain.objs.size()=1 2024-04-03T05:14:09.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.250__shadow_.uzJrvbquSWTAjbq7N3WhLv1EISV0Gij_0 2024-04-03T05:14:09.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11783266017208201930', time=2024-04-03T06:29:06.456528+0000, chain.objs.size()=1 2024-04-03T05:14:09.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.252__shadow_.NyC0GPx9RyqB4b6XNm9708NotVSNbUr_0 2024-04-03T05:14:09.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18250887153263191811', time=2024-04-03T06:29:35.793598+0000, chain.objs.size()=1 2024-04-03T05:14:09.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.sHEOxA61ZdCRW2TlSdHegoPTi35JbQ7_0 2024-04-03T05:14:09.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5412621732385724003', time=2024-04-03T06:29:35.827460+0000, chain.objs.size()=1 2024-04-03T05:14:09.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_._XMXp2TuIT9gFMqk6lw7-oqnXyDlS9n_0 2024-04-03T05:14:09.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10169688495601624026', time=2024-04-03T06:30:02.994321+0000, chain.objs.size()=1 2024-04-03T05:14:09.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.274__shadow_.kglaifZCJFVTEYbq-iDGlz4ISMqo9e9_0 2024-04-03T05:14:09.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.286409938541192045', time=2024-04-03T06:32:25.425952+0000, chain.objs.size()=1 2024-04-03T05:14:09.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OFmFa63E6cGoJoWgxgPtrAcwpiY97SW_0 2024-04-03T05:14:09.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1655235905784173301', time=2024-04-03T06:32:28.392376+0000, chain.objs.size()=1 2024-04-03T05:14:09.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BEcxpfWyc5WsmPZSj81p3ZE35JBJsy6_0 2024-04-03T05:14:09.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8018795863639308903', time=2024-04-03T06:32:29.026156+0000, chain.objs.size()=1 2024-04-03T05:14:09.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.iAm99Q16tDkRnMLjYAEnQSQtbn979wd_0 2024-04-03T05:14:09.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6565863309586996636', time=2024-04-03T06:32:29.123210+0000, chain.objs.size()=1 2024-04-03T05:14:09.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lEEaPsVAfKlU00ZBPFEZFsLEHSw0EEo_0 2024-04-03T05:14:09.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5366409880589837989', time=2024-04-03T06:32:29.312081+0000, chain.objs.size()=1 2024-04-03T05:14:09.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.LnOXd1EMIdD72p0Edj810rh5KbrwW72_0 2024-04-03T05:14:09.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7749812560560217680', time=2024-04-03T06:32:29.481288+0000, chain.objs.size()=1 2024-04-03T05:14:09.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9JEn1Y3GGfq89XUNa4srex1Zx6CK1GA_0 2024-04-03T05:14:09.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11754817239032885983', time=2024-04-03T06:32:29.821071+0000, chain.objs.size()=1 2024-04-03T05:14:09.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4tsBkBA9lRv3083fuePUhYBXmp6fw5G_0 2024-04-03T05:14:09.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12503386038476515450', time=2024-04-03T06:32:30.262188+0000, chain.objs.size()=1 2024-04-03T05:14:09.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9qm91S_PIkKDhTKGwnbgzOn6b9K-JGp_0 2024-04-03T05:14:09.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5342619224172405514', time=2024-04-03T06:32:31.943523+0000, chain.objs.size()=1 2024-04-03T05:14:09.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RgXj7CvsU0kvxV-VLgUrMIeNMyvTEEw_0 2024-04-03T05:14:09.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12292668346174204730', time=2024-04-03T06:32:32.502672+0000, chain.objs.size()=1 2024-04-03T05:14:09.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.QbF7Tc8srrEb8FreXAEJ1sTLu62WYxb_0 2024-04-03T05:14:09.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2055164045433166178', time=2024-04-03T06:32:32.831329+0000, chain.objs.size()=1 2024-04-03T05:14:09.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.afQq_KCBAD01wYCIUGHyjjc8R0Vb5yH_0 2024-04-03T05:14:09.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5736983011904818478', time=2024-04-03T06:32:32.880174+0000, chain.objs.size()=1 2024-04-03T05:14:09.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Z52pgDwTnKHCKZQgD6XSSgs6Dw1A2C5_0 2024-04-03T05:14:09.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16416343399319324482', time=2024-04-03T06:32:33.193642+0000, chain.objs.size()=1 2024-04-03T05:14:09.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XcR7BUO__jxiJQWHQtIQgAApaOGIAsF_0 2024-04-03T05:14:09.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8115058071818538358', time=2024-04-03T06:32:33.452411+0000, chain.objs.size()=1 2024-04-03T05:14:09.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Z3JsTCB3Y7CfvI3xCAByWiMxsyl7KYk_0 2024-04-03T05:14:09.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4251656246747160254', time=2024-04-03T06:32:33.986495+0000, chain.objs.size()=1 2024-04-03T05:14:09.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.f_RCawG3__LMQp7gdL-r2buyaIcGInI_0 2024-04-03T05:14:09.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.793794407361423907', time=2024-04-03T06:32:33.988076+0000, chain.objs.size()=1 2024-04-03T05:14:09.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Uc8MYu6r8KvCupCx9W0w_7Sfzx8F6z3_0 2024-04-03T05:14:09.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7369706021893661075', time=2024-04-03T06:32:34.048493+0000, chain.objs.size()=1 2024-04-03T05:14:09.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6pGysannL8tBXrVQ0nUJMSBVJKLSKnk_0 2024-04-03T05:14:09.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10764097763826964835', time=2024-04-03T06:32:34.107195+0000, chain.objs.size()=1 2024-04-03T05:14:09.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vk2qUpoSfu-0PKGcSe8heQy7qJLNz8i_0 2024-04-03T05:14:09.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12733658964395074134', time=2024-04-03T06:32:34.566275+0000, chain.objs.size()=1 2024-04-03T05:14:09.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.iH1htyCPfG9biZfMkMjwa30KEV-vIBN_0 2024-04-03T05:14:09.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17866895215041785618', time=2024-04-03T06:32:35.581426+0000, chain.objs.size()=1 2024-04-03T05:14:09.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.msBX_1vepajxCzqpZcJGuVWQf7-3qAK_0 2024-04-03T05:14:09.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14977853142299386325', time=2024-04-03T06:32:35.901653+0000, chain.objs.size()=1 2024-04-03T05:14:09.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5g8X05GYVNO9Jwm7ILgytei3YOj_h3J_0 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5877280691840707555', time=2024-04-03T06:32:36.802107+0000, chain.objs.size()=1 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hAaaJJ6lJWwWkHWigQrHL79s3RM7wfi_0 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8685890684194105401', time=2024-04-03T06:32:37.237079+0000, chain.objs.size()=1 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.b2WyEWtKcyNNkBWuCYC5RB8bP1n_VRM_0 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.650450049205174787', time=2024-04-03T06:32:37.498139+0000, chain.objs.size()=1 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.I_e-eFLaBQcWZlzlVjz5szIeuFUOxLV_0 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7382461626972638636', time=2024-04-03T06:32:40.527364+0000, chain.objs.size()=1 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.bomjp2Tr1QME32tBYbMK1Ve_NGdUpY__0 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2045529080637650433', time=2024-04-03T06:32:40.953255+0000, chain.objs.size()=1 2024-04-03T05:14:09.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OaE7f7jXut98Hjzj-7jJgq12R1VS_a1_0 2024-04-03T05:14:09.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8556724864917075672', time=2024-04-03T06:32:41.125395+0000, chain.objs.size()=1 2024-04-03T05:14:09.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.R_hhOgBftxNZ83YXdhVPB7VbS-NTGF-_0 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6387568918431151404', time=2024-04-03T06:32:41.501322+0000, chain.objs.size()=1 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4z3xrkPVF4kZaSu6kmV08UfXDfKf6uP_0 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10774210800878343340', time=2024-04-03T06:32:43.367672+0000, chain.objs.size()=1 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dTbqZywHJIvQUJkuLWk79_Vvj8fko71_0 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1927514870433662646', time=2024-04-03T06:32:44.406476+0000, chain.objs.size()=1 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XlcHMf2EDZOk6NYhyL69J-brBgv9-OJ_0 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10505787933140005592', time=2024-04-03T06:32:45.391818+0000, chain.objs.size()=1 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VbitEsBwz5Ux4D864h8oRLigRtLhPwS_0 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6248982341086308127', time=2024-04-03T06:32:45.758950+0000, chain.objs.size()=1 2024-04-03T05:14:09.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.JkmYpWq0NKZADZt5goSNlWyNfD1nQjT_0 2024-04-03T05:14:09.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13761776627412163554', time=2024-04-03T06:32:48.206945+0000, chain.objs.size()=1 2024-04-03T05:14:09.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CCHa2mPwQevSWDX7F1gjOEUX3AdSZ1b_0 2024-04-03T05:14:09.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15412216146769287432', time=2024-04-03T06:32:48.436153+0000, chain.objs.size()=1 2024-04-03T05:14:09.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.apxGcUMtMKh6vOL5mCxVOOomZbG5akA_0 2024-04-03T05:14:09.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15965709803978765996', time=2024-04-03T06:32:49.250283+0000, chain.objs.size()=1 2024-04-03T05:14:09.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4pifYF51C4_BHE-10eS65wYbLYlq-Lc_0 2024-04-03T05:14:09.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16178232489739428129', time=2024-04-03T06:32:49.998678+0000, chain.objs.size()=1 2024-04-03T05:14:09.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DCtu0W47ptjGhzq83mjIEUlXc-MH4bz_0 2024-04-03T05:14:09.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.246757697746912824', time=2024-04-03T06:32:50.371842+0000, chain.objs.size()=1 2024-04-03T05:14:09.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FvLp7NMZR9gkg-jvZVia3kxw6PQJRLD_0 2024-04-03T05:14:09.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6148707042975293704', time=2024-04-03T06:32:51.550063+0000, chain.objs.size()=1 2024-04-03T05:14:09.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YFXeqTEd7tBUcvbzDn9wUFbz47vx8xC_0 2024-04-03T05:14:09.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3454358714239075254', time=2024-04-03T06:32:51.957854+0000, chain.objs.size()=1 2024-04-03T05:14:09.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rVV54uYVMLr1Gx1pKguq8-CDLAMpahi_0 2024-04-03T05:14:09.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5487858487336005863', time=2024-04-03T06:34:29.107886+0000, chain.objs.size()=1 2024-04-03T05:14:09.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pfXJIrgQjasLYZHn8iTtRS-JNBqv9sq_0 2024-04-03T05:14:09.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10290306732642580878', time=2024-04-03T06:34:29.873015+0000, chain.objs.size()=1 2024-04-03T05:14:09.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kIZnK605CPlVgIKZ65rzTiYRySPuh4P_0 2024-04-03T05:14:09.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3177056118959567319', time=2024-04-03T06:34:30.698722+0000, chain.objs.size()=1 2024-04-03T05:14:09.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9GrYCez8ToAMPFYcRrd2uOfCwZXnfBW_0 2024-04-03T05:14:09.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7579270034002543911', time=2024-04-03T06:34:31.024799+0000, chain.objs.size()=1 2024-04-03T05:14:09.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.mL_PoRyDzexUobBgZUppid3M3BTA_62_0 2024-04-03T05:14:09.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15240567754115771824', time=2024-04-03T06:34:31.392807+0000, chain.objs.size()=1 2024-04-03T05:14:09.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hfHZnn_11cfcNb4ongGU_8tJJay48IN_0 2024-04-03T05:14:09.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6803140102073391482', time=2024-04-03T06:34:32.995060+0000, chain.objs.size()=1 2024-04-03T05:14:09.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-BlxDppjoamSNEw0B4QGi8EY_9-yYTX_0 2024-04-03T05:14:09.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17357515452010542942', time=2024-04-03T06:34:33.141467+0000, chain.objs.size()=1 2024-04-03T05:14:09.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.mkctOi666dHzawwP5VPoi2J3G9kT-9o_0 2024-04-03T05:14:09.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9399769029755411938', time=2024-04-03T06:34:34.219996+0000, chain.objs.size()=1 2024-04-03T05:14:09.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.PjkS_tjMAuTxTMU0Y9qNiyP9h8N0FK__0 2024-04-03T05:14:09.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3525826870036645743', time=2024-04-03T06:34:36.827309+0000, chain.objs.size()=1 2024-04-03T05:14:09.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.FouPi46rHFjeswlJjJfwZEUzu0HsnFH_0 2024-04-03T05:14:09.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9958250164424766031', time=2024-04-03T06:34:37.753017+0000, chain.objs.size()=1 2024-04-03T05:14:09.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YvQIupfA-NoX5rCJxs4bXtkYg-26u1k_0 2024-04-03T05:14:09.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13106596016963841505', time=2024-04-03T06:34:37.972885+0000, chain.objs.size()=1 2024-04-03T05:14:09.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Dw6r_SeRiDJ-gxcLFlY5hQ9P1AzsnuY_0 2024-04-03T05:14:09.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9154318775381879056', time=2024-04-03T06:34:38.412825+0000, chain.objs.size()=1 2024-04-03T05:14:09.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3GOHF7MuTYY69jS27z74j_n_tkK3imC_0 2024-04-03T05:14:09.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14559020014991360678', time=2024-04-03T06:34:40.499288+0000, chain.objs.size()=1 2024-04-03T05:14:09.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ODtjL1JyNBWJk53y4Soh7qbu0bNPD3S_0 2024-04-03T05:14:09.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5728267465068297853', time=2024-04-03T06:34:43.753016+0000, chain.objs.size()=1 2024-04-03T05:14:09.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.s8QGaDvs_bU3Drqe35ZYaFbji90UMKj_0 2024-04-03T05:14:09.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11423859274064380929', time=2024-04-03T06:34:45.260738+0000, chain.objs.size()=1 2024-04-03T05:14:09.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.oeB6QmHIYJRQX0PdboaIn654-HszYKs_0 2024-04-03T05:14:09.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10152428160427119877', time=2024-04-03T06:34:45.992874+0000, chain.objs.size()=1 2024-04-03T05:14:09.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.H79m0SE0ryIG7KUmjlNIytUlxfv5IOK_0 2024-04-03T05:14:09.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15438984591740048163', time=2024-04-03T06:34:46.203148+0000, chain.objs.size()=1 2024-04-03T05:14:09.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.MV_kXOaGDhfaNDD5o67Fr2ELhwngSdT_0 2024-04-03T05:14:09.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12758829980416250908', time=2024-04-03T06:34:46.322915+0000, chain.objs.size()=1 2024-04-03T05:14:09.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.O__Q7s-yejxswhdYw-vNBBgZxqW5M0M_0 2024-04-03T05:14:09.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17400599351283924675', time=2024-04-03T06:34:46.462229+0000, chain.objs.size()=1 2024-04-03T05:14:09.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wR4XLHYUeC-t_WVx5MbhrzvbWB9nSmg_0 2024-04-03T05:14:09.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4557806879191221796', time=2024-04-03T06:34:47.656535+0000, chain.objs.size()=1 2024-04-03T05:14:09.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.eidQcxljpkhwEyfw5NNl6_g4P7yuF_O_0 2024-04-03T05:14:09.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9512597687795241741', time=2024-04-03T06:34:48.263351+0000, chain.objs.size()=1 2024-04-03T05:14:09.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.B7EAzFxCEt_ob1AcvJnQVNmrjpfVgkM_0 2024-04-03T05:14:09.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5813012598252376114', time=2024-04-03T06:34:48.572803+0000, chain.objs.size()=1 2024-04-03T05:14:09.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.a743kG5EhbTOKDbN035gjf81g6_asK4_0 2024-04-03T05:14:09.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3449637340002832314', time=2024-04-03T06:34:48.724959+0000, chain.objs.size()=1 2024-04-03T05:14:09.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.y5m9ckUqWoYWF9F6gbc9TDGxvAm1ily_0 2024-04-03T05:14:09.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15705452284870838043', time=2024-04-03T06:34:52.848833+0000, chain.objs.size()=1 2024-04-03T05:14:09.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Z5J7IJ7TWkY60LNAzsKIgzK6Y7i6pIJ_0 2024-04-03T05:14:09.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14538221735097833688', time=2024-04-03T06:34:55.379073+0000, chain.objs.size()=1 2024-04-03T05:14:09.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rwwQci76Jnrk9P6ZDvXofZEWVCBDp9I_0 2024-04-03T05:14:09.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17788980009478852331', time=2024-04-03T06:34:56.185957+0000, chain.objs.size()=1 2024-04-03T05:14:09.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ESu3Qvd828RbdbB0j1DmL1-Qo13pOYe_0 2024-04-03T05:14:09.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10863703701079231911', time=2024-04-03T06:40:14.352115+0000, chain.objs.size()=1 2024-04-03T05:14:09.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.5ojpfp9ayW2jGsUyE4vRpK_yk6037qm_0 2024-04-03T05:14:09.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2_803f54f1ad4bf1a58cf02d758c3a1785', time=2024-04-03T06:41:44.613383+0000, chain.objs.size()=6 2024-04-03T05:14:09.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.1 2024-04-03T05:14:09.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2 2024-04-03T05:14:09.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.3 2024-04-03T05:14:09.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.4 2024-04-03T05:14:09.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.5 2024-04-03T05:14:09.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.6 2024-04-03T05:14:09.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2162841438301053789', time=2024-04-03T06:48:26.274754+0000, chain.objs.size()=3 2024-04-03T05:14:09.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~n8Q0cs-Xz1t2LDa4e5OkyiQeoekUVqK.1 2024-04-03T05:14:09.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~n8Q0cs-Xz1t2LDa4e5OkyiQeoekUVqK.2 2024-04-03T05:14:09.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~n8Q0cs-Xz1t2LDa4e5OkyiQeoekUVqK.3 2024-04-03T05:14:09.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5203806740517392096', time=2024-04-03T06:48:32.141874+0000, chain.objs.size()=3 2024-04-03T05:14:09.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~_Ta0W44xCCXlp3DpOOdw3NCWJRi5ARA.1 2024-04-03T05:14:09.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~_Ta0W44xCCXlp3DpOOdw3NCWJRi5ARA.2 2024-04-03T05:14:09.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~_Ta0W44xCCXlp3DpOOdw3NCWJRi5ARA.3 2024-04-03T05:14:09.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7758551813654238972', time=2024-04-03T06:52:09.558830+0000, chain.objs.size()=1 2024-04-03T05:14:09.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.528__shadow_.KvdSsegCV279hKd6CkVp5UA7LN-ADBs_0 2024-04-03T05:14:09.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2835027544340123383', time=2024-04-03T06:52:43.533749+0000, chain.objs.size()=1 2024-04-03T05:14:09.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:lwhit0IeSKQ00WQIwOvhYMaHJ7qSXsR_.ycrVmn-TIpH1d0U02P8z_ZPRi1NJ0Lk_0 2024-04-03T05:14:09.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.421+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/59112 2024-04-03T05:14:09.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-04-03T05:14:09.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9720223277947593756', time=2024-04-03T06:52:57.026941+0000, chain.objs.size()=1 2024-04-03T05:14:09.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:wqCI8BvXGamnQ-Yv5yPcZ0cX7LQuEym_.qgj-yYdmHoFITGcnlWk1oNW2YC-YyEU_0 2024-04-03T05:14:09.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13737525759500135920', time=2024-04-03T06:53:35.945331+0000, chain.objs.size()=1 2024-04-03T05:14:09.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:dMnRhpXsZg1S4edsA6.doQxF6ESfNJs_.wUlIIY3idKcwoodTcPwIbyLogeZTsTm_0 2024-04-03T05:14:09.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16755630681020344046', time=2024-04-03T06:53:46.303496+0000, chain.objs.size()=1 2024-04-03T05:14:09.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:5PC-6Z0uGvv1wufsI0L8-O.l07iaR4G_.dyUDaqQblx5QHLNVDxERdT6JLAcZZ5F_0 2024-04-03T05:14:09.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5901944274979828153', time=2024-04-03T06:53:54.289280+0000, chain.objs.size()=1 2024-04-03T05:14:09.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:DM69K98cmjsvQhYBGEMuCYMmm7sfjRW_.1i77PRidtq_ZJLSgapSdVOxr6ysPDi7_0 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3639115664408554850', time=2024-04-03T07:01:03.040792+0000, chain.objs.size()=1 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.595__shadow_.OeD7Ck1JudQKTQO-sSDiDy4-nMVETdD_0 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8968363434059523310', time=2024-04-03T07:01:16.204409+0000, chain.objs.size()=1 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.601__shadow_.YM_2jlPFnlvWiN_mFkeCHw5M_C69sTh_0 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11398019090459497578', time=2024-04-03T07:02:27.122301+0000, chain.objs.size()=1 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.619__shadow_.KyR47x6kkXlLpe248Q5RTi50UApcA7Y_0 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14066475216687359658', time=2024-04-03T07:03:33.939732+0000, chain.objs.size()=12 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__multipart_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.1 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__shadow_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.1_1 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__multipart_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.2 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__shadow_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.2_1 2024-04-03T05:14:09.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__multipart_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.3 2024-04-03T05:14:09.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__shadow_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.3_1 2024-04-03T05:14:09.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__multipart_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.4 2024-04-03T05:14:09.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__shadow_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.4_1 2024-04-03T05:14:09.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__multipart_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.5 2024-04-03T05:14:09.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__shadow_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.5_1 2024-04-03T05:14:09.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__multipart_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.6 2024-04-03T05:14:09.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626__shadow_baz.2~Eeo8S4sEQK3YbibobwfBbCxxoQgR7Bs.6_1 2024-04-03T05:14:09.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.433+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-03T05:14:09.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/40640' 2024-04-03T05:14:09.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8799576388189756586', time=2024-04-03T06:25:10.449782+0000, chain.objs.size()=1 2024-04-03T05:14:09.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.202__shadow_.M6XKEKU1TKn-AdtVwOLj12o9a2acMEc_0 2024-04-03T05:14:09.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15111765931870541495', time=2024-04-03T06:25:57.450308+0000, chain.objs.size()=1 2024-04-03T05:14:09.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.221__shadow_.FPPPMuHwE75O85Ytg1PVuFYHb3OJEO3_0 2024-04-03T05:14:09.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17831211359662344458', time=2024-04-03T06:27:53.052526+0000, chain.objs.size()=1 2024-04-03T05:14:09.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nbWsSPRpWlPwHqg6ugbvsszehL7dQNd_0 2024-04-03T05:14:09.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12264856226720737846', time=2024-04-03T06:27:54.856632+0000, chain.objs.size()=1 2024-04-03T05:14:09.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8zxROF2L09VBzCTI4KJGL11u-n8WZr9_0 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7305178959078185105', time=2024-04-03T06:27:55.136816+0000, chain.objs.size()=1 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nh2WI4eoD_glfEM-Tm4qjkyPoMt6vkm_0 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7158622165731593878', time=2024-04-03T06:27:56.436052+0000, chain.objs.size()=1 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BrrSi8gSijYjh3vrfxH1UmTdbJdmEP6_0 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16157537624877732613', time=2024-04-03T06:27:56.650252+0000, chain.objs.size()=1 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.SXXZm8lfbUGUC37bHC8SRh_At-z75LT_0 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16476757601479469557', time=2024-04-03T06:27:57.720605+0000, chain.objs.size()=1 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qLsnJ4RrcYZXoVkCNIb66x_0WGLpiMr_0 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14556761561779821532', time=2024-04-03T06:27:58.440167+0000, chain.objs.size()=1 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TiM4P6WVFH4XJstfYQFufg7vaHUMdnh_0 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8766683231124161516', time=2024-04-03T06:27:59.123165+0000, chain.objs.size()=1 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Cq5_6waXlZfm4klUz44De-hE1zYa0c2_0 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3606551165107304612', time=2024-04-03T06:28:00.875950+0000, chain.objs.size()=1 2024-04-03T05:14:09.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.iuri5eSZJsaBamxJQ6pocdntHz5xeC3_0 2024-04-03T05:14:09.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7156317223430231382', time=2024-04-03T06:28:02.223853+0000, chain.objs.size()=1 2024-04-03T05:14:09.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ad1kTm7GLzjmt6u7pIhW_XRt9ibY-gW_0 2024-04-03T05:14:09.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3035025814183075670', time=2024-04-03T06:28:02.739057+0000, chain.objs.size()=1 2024-04-03T05:14:09.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WEEiLaWUFqv_pCabyaN67jepXoktHsd_0 2024-04-03T05:14:09.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3135803305275057755', time=2024-04-03T06:28:02.946907+0000, chain.objs.size()=1 2024-04-03T05:14:09.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6eVm8y3WTs8T4mYLGCl86P9WC03vFtW_0 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17253849235651536676', time=2024-04-03T06:28:04.872376+0000, chain.objs.size()=1 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.d_WJ1W8NC1z15UPFo0kHUonb52e8tA7_0 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8332436745733856089', time=2024-04-03T06:28:05.582490+0000, chain.objs.size()=1 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JqJWu9XMY0bGzP8D_5jWqr_9oGTlNdS_0 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11368822956356481777', time=2024-04-03T06:28:07.831106+0000, chain.objs.size()=1 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cxO0hKza-HDHJIV3h8uVt-QPdzukj0T_0 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6826600393463618990', time=2024-04-03T06:28:07.965892+0000, chain.objs.size()=1 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.EShCKNPFJWDmXc__5m0m9qDulvBFFSx_0 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8524210683698939677', time=2024-04-03T06:28:08.185534+0000, chain.objs.size()=1 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1T3rADBQcgS5r3VM-_sY0BLwizYGP-o_0 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3650679447538558794', time=2024-04-03T06:28:08.377226+0000, chain.objs.size()=1 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.PLwAryfJT3czHE1-oERrg8wSjei-jdn_0 2024-04-03T05:14:09.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11787609515117200925', time=2024-04-03T06:28:09.373424+0000, chain.objs.size()=1 2024-04-03T05:14:09.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BmCSZiVS6To8z29KOgTf7OGBEVdfiTc_0 2024-04-03T05:14:09.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11606956917206240632', time=2024-04-03T06:28:12.760966+0000, chain.objs.size()=1 2024-04-03T05:14:09.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.scaj9PblkQxtBD4rxTT51A_Np-LltiR_0 2024-04-03T05:14:09.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3077747750107586994', time=2024-04-03T06:28:12.769228+0000, chain.objs.size()=1 2024-04-03T05:14:09.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.zgLEe8xKv19HZUE-g5j68PrAyvb99ih_0 2024-04-03T05:14:09.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.445+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5985094289924826691', time=2024-04-03T06:28:13.530516+0000, chain.objs.size()=1 2024-04-03T05:14:09.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.445+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WY8WONe4j0qmn7kja3_MGT1ebZcIP_8_0 2024-04-03T05:14:09.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4061868912058754189', time=2024-04-03T06:28:13.645268+0000, chain.objs.size()=1 2024-04-03T05:14:09.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6-ocfi4OK_9p5eAsWgI_Fs4d4BTQeJa_0 2024-04-03T05:14:09.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6722229771185972870', time=2024-04-03T06:28:14.271037+0000, chain.objs.size()=1 2024-04-03T05:14:09.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XOicPGwCTfd73hIqwa-AcLPGTtM8wP2_0 2024-04-03T05:14:09.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16434552987676617280', time=2024-04-03T06:28:14.292544+0000, chain.objs.size()=1 2024-04-03T05:14:09.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Pp4AP08_BbyqVbng8vOm0dr6_krgbMv_0 2024-04-03T05:14:09.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16881663136073727934', time=2024-04-03T06:28:15.107761+0000, chain.objs.size()=1 2024-04-03T05:14:09.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.hAALu5pzMAoKjv-AV43nQaUL2J2yKRQ_0 2024-04-03T05:14:09.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14464645202010381505', time=2024-04-03T06:28:15.109972+0000, chain.objs.size()=1 2024-04-03T05:14:09.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.NgfGvr-zsiavaooYDEvV47jViUtIM2f_0 2024-04-03T05:14:09.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9667095136799845373', time=2024-04-03T06:28:15.716796+0000, chain.objs.size()=1 2024-04-03T05:14:09.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lV6Br3iZK9bXG5ybw5HMtIFVK7eknEv_0 2024-04-03T05:14:09.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7105242062650662299', time=2024-04-03T06:28:16.328990+0000, chain.objs.size()=1 2024-04-03T05:14:09.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JoYxP4tNPwOGqrXCSag6D_euxESc4eF_0 2024-04-03T05:14:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10170302607716217042', time=2024-04-03T06:28:17.920694+0000, chain.objs.size()=1 2024-04-03T05:14:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BjPRK8BppFGpgG95qC8YE0KtsyTFTZR_0 2024-04-03T05:14:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4831214207151332221', time=2024-04-03T06:28:17.922031+0000, chain.objs.size()=1 2024-04-03T05:14:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WrXyEB19Np-Z6C44uu3OnJrOLxJEFi7_0 2024-04-03T05:14:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14007361502146610453', time=2024-04-03T06:28:19.715442+0000, chain.objs.size()=1 2024-04-03T05:14:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OCHns9J_FFUtzsE5dwQvOUF3Kiv2gry_0 2024-04-03T05:14:09.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2104174798994645548', time=2024-04-03T06:28:19.949603+0000, chain.objs.size()=1 2024-04-03T05:14:09.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.hew7d_TDXmAcmJspz5Qx0zMPUhz3DcP_0 2024-04-03T05:14:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8074923317737442767', time=2024-04-03T06:28:20.892564+0000, chain.objs.size()=1 2024-04-03T05:14:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BB2i_BskCGTRSV1N7SR5j8H5fOMZRp-_0 2024-04-03T05:14:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7971778456505946282', time=2024-04-03T06:28:44.241774+0000, chain.objs.size()=1 2024-04-03T05:14:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.242__shadow_.olxaqYZ0Faw47_Jly_wwqPwDppa-54g_0 2024-04-03T05:14:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4951067835245933011', time=2024-04-03T06:28:55.087457+0000, chain.objs.size()=1 2024-04-03T05:14:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.247__shadow_.1uxXl3oBKk0z0BKbJR4mBc6ie3sol_X_0 2024-04-03T05:14:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10775090552356487903', time=2024-04-03T06:29:08.900986+0000, chain.objs.size()=1 2024-04-03T05:14:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.253__shadow_.BwOf_TxDAc6PAyXRrlawUkNYm8VBqJB_0 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4176040041351836012', time=2024-04-03T06:29:11.487625+0000, chain.objs.size()=1 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.254__shadow_.lqONiQK121fFcj6nSdiIySUdW_TAnUX_0 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17809055518029865411', time=2024-04-03T06:29:13.832747+0000, chain.objs.size()=1 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.255__shadow_.VnrJttSI-SUL8kLixglyBhpy3jaAbsu_0 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14114264527826100376', time=2024-04-03T06:29:30.729985+0000, chain.objs.size()=1 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.aNymvlljsui5dbwOu78ImVB5xQPYIUU_0 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7785551952448873873', time=2024-04-03T06:29:35.953533+0000, chain.objs.size()=1 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.2Kk6DI6WMeVvMJv70JogcAXtilIGag9_0 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5662938849856189668', time=2024-04-03T06:32:24.140245+0000, chain.objs.size()=1 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ua7TmEyyOT2TLdT_IJMbf0DnddqeBMH_0 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2188725050807598159', time=2024-04-03T06:32:24.161801+0000, chain.objs.size()=1 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UG2wXKbbf6NKxNqLRRBKDxm7VjPUVML_0 2024-04-03T05:14:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14473725716548906286', time=2024-04-03T06:32:24.281251+0000, chain.objs.size()=1 2024-04-03T05:14:09.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FjTEZy3huVIkl4AB5rVbYYMfLlMMnCK_0 2024-04-03T05:14:09.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2847778805025684525', time=2024-04-03T06:32:25.329519+0000, chain.objs.size()=1 2024-04-03T05:14:09.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.eIaGrLmHeZ8Hz0G-igUutyBoJ0hiM7q_0 2024-04-03T05:14:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13425541508647660995', time=2024-04-03T06:32:29.903499+0000, chain.objs.size()=1 2024-04-03T05:14:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-8i8pTH7vlIk_UtP_mEris4n1fMR7F9_0 2024-04-03T05:14:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18103720512737907226', time=2024-04-03T06:32:30.436676+0000, chain.objs.size()=1 2024-04-03T05:14:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cJ2vn07nCD5ypAD7MT0eBtYGpcWhaWw_0 2024-04-03T05:14:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6240729357257378696', time=2024-04-03T06:32:30.555884+0000, chain.objs.size()=1 2024-04-03T05:14:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lkvaDQ4-TTzecR8EIhNXhsw75u6PZV6_0 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18372669404269756383', time=2024-04-03T06:32:32.362394+0000, chain.objs.size()=1 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sYSrM8C0SNwVmq1g6DZrAPpC-JoU1ZJ_0 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17333665874623181506', time=2024-04-03T06:32:33.231257+0000, chain.objs.size()=1 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.KamOF620RPpiQQJscqb2wTfIxtOn7r5_0 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6908240679082549991', time=2024-04-03T06:32:33.714062+0000, chain.objs.size()=1 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BOfj3oY6J4PaXk8n8kRmOyROMyomXSU_0 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3845938972014137436', time=2024-04-03T06:32:34.458023+0000, chain.objs.size()=1 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.LrUEePSXQ67tDEw9glv6uP9wCfVthpQ_0 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.579692797662598124', time=2024-04-03T06:32:35.968762+0000, chain.objs.size()=1 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yDqnHw57s0mkGJ5UtG8Pa2orzdRRGJr_0 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4053447145431721223', time=2024-04-03T06:32:35.970335+0000, chain.objs.size()=1 2024-04-03T05:14:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0mXhJ9WuBwFbkfyA97cYlm66rDLmXKv_0 2024-04-03T05:14:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10901455455512499362', time=2024-04-03T06:32:37.283813+0000, chain.objs.size()=1 2024-04-03T05:14:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0Ww0Jom4k0kXNw-6BozZxlTVi0W6tCB_0 2024-04-03T05:14:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16818174449857340566', time=2024-04-03T06:32:37.724395+0000, chain.objs.size()=1 2024-04-03T05:14:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7h-2dbINlA3kVY39g7rj_UzytlceuJ__0 2024-04-03T05:14:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3783340216428041851', time=2024-04-03T06:32:38.382580+0000, chain.objs.size()=1 2024-04-03T05:14:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.o4dWkpAHt3IGwRwcZMGTea7nn5S_oIc_0 2024-04-03T05:14:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3527632978047749069', time=2024-04-03T06:32:39.414472+0000, chain.objs.size()=1 2024-04-03T05:14:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BqMoPFvxxFehWFeLKUoB0ZCjDB6vHbr_0 2024-04-03T05:14:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17438669474806883441', time=2024-04-03T06:32:40.264370+0000, chain.objs.size()=1 2024-04-03T05:14:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.A-h-FXDiM7q-sH0NaR-VivCSCtack6X_0 2024-04-03T05:14:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4548209459146125850', time=2024-04-03T06:32:40.653886+0000, chain.objs.size()=1 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Q67amqEfmqpBZzZC8xE23DGjFnYCPm0_0 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5432580833527181765', time=2024-04-03T06:32:40.767554+0000, chain.objs.size()=1 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qsLBJhf638cuCxbwCx2JIL5MIIeJEko_0 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13063289570070998123', time=2024-04-03T06:32:40.838099+0000, chain.objs.size()=1 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AV-zCc0RE--pBFby0W3drUIJLkXzih4_0 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6167055834459467221', time=2024-04-03T06:32:44.788765+0000, chain.objs.size()=1 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Qtsa4ObJZvB7zLYlfJFtWOHBAui_LQ5_0 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9368929836613220448', time=2024-04-03T06:32:45.291332+0000, chain.objs.size()=1 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rLu1MJYO0uevW0W_HAhfM6ku_p5tZu4_0 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13039402130103149844', time=2024-04-03T06:32:48.403206+0000, chain.objs.size()=1 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8-4MFk7vDmPbPq3eq1HfCs9ra2_Hkz8_0 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1482834908711850707', time=2024-04-03T06:32:50.953399+0000, chain.objs.size()=1 2024-04-03T05:14:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1RHzH5Vm0K_ixQQZSbHjbmljgi2rT_K_0 2024-04-03T05:14:09.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6399616587100761185', time=2024-04-03T06:34:29.004231+0000, chain.objs.size()=1 2024-04-03T05:14:09.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IO2CQUg-I1lwq6ckZg6361Qb3z_ktgn_0 2024-04-03T05:14:09.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14101424446521786348', time=2024-04-03T06:34:30.121114+0000, chain.objs.size()=1 2024-04-03T05:14:09.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ioiEjjc8ht16zA4QDk4JRCdJneKQQiz_0 2024-04-03T05:14:09.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13654286683416350566', time=2024-04-03T06:34:33.276411+0000, chain.objs.size()=1 2024-04-03T05:14:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6c8ssNiYfPCMXReZrGSEJYco-OZy_us_0 2024-04-03T05:14:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9994947524053049147', time=2024-04-03T06:34:33.679045+0000, chain.objs.size()=1 2024-04-03T05:14:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.oAVfEoTW71KjNFoOS-y2VbkYNvsWoK3_0 2024-04-03T05:14:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1016825676134452580', time=2024-04-03T06:34:34.110830+0000, chain.objs.size()=1 2024-04-03T05:14:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1eIxeolYWm895qP7o5jKmsBDrDfFfM1_0 2024-04-03T05:14:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6893648239555987580', time=2024-04-03T06:34:35.003276+0000, chain.objs.size()=1 2024-04-03T05:14:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9C_70aWlpJb-bKPVgA8-J4YuRYYqq4E_0 2024-04-03T05:14:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293977098772901431', time=2024-04-03T06:34:35.189435+0000, chain.objs.size()=1 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5PNCb54KiEN3zp39sPwxk36I8zn58W6_0 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13744798529632228995', time=2024-04-03T06:34:36.342532+0000, chain.objs.size()=1 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VD83MM39rYraLEq-8STncAHwHtVOVMx_0 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13748183750561519029', time=2024-04-03T06:34:36.730396+0000, chain.objs.size()=1 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7G8giGxzJirf-IHEBeD5WhINi2NtZK5_0 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2094477247445927571', time=2024-04-03T06:34:37.790087+0000, chain.objs.size()=1 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gwKL5MbDelHOK38FQNFiOZ_gf-tr0xf_0 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18096731208370642857', time=2024-04-03T06:34:37.868869+0000, chain.objs.size()=1 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xtrK3ArPaR6S9Vs1gXHsvhB43v2w0vF_0 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1736948119783293890', time=2024-04-03T06:34:37.966767+0000, chain.objs.size()=1 2024-04-03T05:14:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7GPifNHIxuTapUJm5N3jmu6SfaGALoL_0 2024-04-03T05:14:09.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5908653800840558423', time=2024-04-03T06:34:38.070898+0000, chain.objs.size()=1 2024-04-03T05:14:09.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ymNmiGlX0soeIR8kj8Et_rRrcp2RAWt_0 2024-04-03T05:14:09.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16612013259591477358', time=2024-04-03T06:34:40.498738+0000, chain.objs.size()=1 2024-04-03T05:14:09.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9W5PWTAXODE9Zc3u8dMc2qMTvFRKNWp_0 2024-04-03T05:14:09.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7514036769958049379', time=2024-04-03T06:34:40.500792+0000, chain.objs.size()=1 2024-04-03T05:14:09.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0xB7afLLozm4DKJLG1wpmM7qLsgquTF_0 2024-04-03T05:14:09.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13814175026430944395', time=2024-04-03T06:34:42.173236+0000, chain.objs.size()=1 2024-04-03T05:14:09.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.d4eFGFEa17ajkQXPqlcoCDvQ1ALT3C3_0 2024-04-03T05:14:09.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5260866959289836475', time=2024-04-03T06:34:45.158151+0000, chain.objs.size()=1 2024-04-03T05:14:09.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.iUp-w0zVMDqVWkqIJWrrJvzlNsTAFY1_0 2024-04-03T05:14:09.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16304556087871726586', time=2024-04-03T06:34:45.422312+0000, chain.objs.size()=1 2024-04-03T05:14:09.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3ff1IFGRvMu1aJwVoEa2PWyEZzjBXPg_0 2024-04-03T05:14:09.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1450071089156038468', time=2024-04-03T06:34:45.518821+0000, chain.objs.size()=1 2024-04-03T05:14:09.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wIE0ZG-kysy33C0CC0_DRkFXLPI44jg_0 2024-04-03T05:14:09.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11206329869239767581', time=2024-04-03T06:34:45.791919+0000, chain.objs.size()=1 2024-04-03T05:14:09.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.sNGtUvig8PQjnEsK7425TB1QFT-FVBG_0 2024-04-03T05:14:09.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6077621384925925210', time=2024-04-03T06:34:45.878713+0000, chain.objs.size()=1 2024-04-03T05:14:09.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cLTT25iGvKY3KkAktbduJcLYcuT8b9F_0 2024-04-03T05:14:09.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10584208144909499971', time=2024-04-03T06:34:46.162825+0000, chain.objs.size()=1 2024-04-03T05:14:09.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TOLsmFbPKELq1ENNq-eJ92_1NyiAmp3_0 2024-04-03T05:14:09.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14037207669604279795', time=2024-04-03T06:34:48.390489+0000, chain.objs.size()=1 2024-04-03T05:14:09.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8u4ZrWLTUJUx6NtLX5_6UFSCz7LHc-x_0 2024-04-03T05:14:09.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.493+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12441821199131084392', time=2024-04-03T06:34:49.968298+0000, chain.objs.size()=1 2024-04-03T05:14:09.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.493+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.iMHvKqWdJ3iGgKBilq5vsRvFpbhehO-_0 2024-04-03T05:14:09.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.493+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9172351152001790294', time=2024-04-03T06:34:50.952235+0000, chain.objs.size()=1 2024-04-03T05:14:09.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.493+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lrSp3utHOy9W0XxM5l4h-UL7wU_Trju_0 2024-04-03T05:14:09.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.493+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1517978538877301575', time=2024-04-03T06:34:51.437438+0000, chain.objs.size()=1 2024-04-03T05:14:09.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.493+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2dTRwbr3rKyANFICc--4ixz0oF7hlkW_0 2024-04-03T05:14:09.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11744827367574988387', time=2024-04-03T06:34:51.566603+0000, chain.objs.size()=1 2024-04-03T05:14:09.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.oHLHCB2YxMh1MgoaH3rVJd2VxwslPLZ_0 2024-04-03T05:14:09.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13352502576528645538', time=2024-04-03T06:34:52.755413+0000, chain.objs.size()=1 2024-04-03T05:14:09.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TjZXxJ-lisM8Wlee0eCfLmG2LiYoEyO_0 2024-04-03T05:14:09.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12145455349704158493', time=2024-04-03T06:34:55.890286+0000, chain.objs.size()=1 2024-04-03T05:14:09.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.uOAO1spmCUub1jlO7UoLg3wznX3gZCL_0 2024-04-03T05:14:09.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7177436380693961985', time=2024-04-03T06:35:05.676515+0000, chain.objs.size()=1 2024-04-03T05:14:09.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.298__shadow_.ctDsYCVkZ5C9UHJAoas-OrZIQBcsobh_0 2024-04-03T05:14:09.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2938284344032732493', time=2024-04-03T06:35:07.767181+0000, chain.objs.size()=1 2024-04-03T05:14:09.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.299__shadow_.nThulf1ZVprSYjYrnldOdpm9-GYERZA_0 2024-04-03T05:14:09.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12901685133674288916', time=2024-04-03T06:38:42.298009+0000, chain.objs.size()=1 2024-04-03T05:14:09.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.410__shadow_.sRaaALM9CveDj4BZJ5YYD0huNn_xtOl_0 2024-04-03T05:14:09.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.505+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/40640 2024-04-03T05:14:09.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-04-03T05:14:09.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5399826905358472850', time=2024-04-03T06:40:14.301404+0000, chain.objs.size()=1 2024-04-03T05:14:09.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.Bvy7Kd3m3lmnahdhUU2dzDx3evnkaRJ_0 2024-04-03T05:14:09.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16188802972304851941', time=2024-04-03T06:40:14.384410+0000, chain.objs.size()=1 2024-04-03T05:14:09.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.wl2RxM9Gugil6UKfha9LZtNnT9ZQb81_0 2024-04-03T05:14:09.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10252932912519052797', time=2024-04-03T06:43:57.276146+0000, chain.objs.size()=1 2024-04-03T05:14:09.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.490__shadow:YXFl-fbKvOHVg4yEDijon5zuwW5z4UI_.G32Lcz92HQh0iTvop2hpv8qMba7MjHE_0 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8766166475942622061', time=2024-04-03T06:52:14.772150+0000, chain.objs.size()=1 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.530__multipart_mymultipart.meaPvbeliycjiWv5TXTM1yd5vezBV_4P.1 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13045762715057756697', time=2024-04-03T06:52:48.365283+0000, chain.objs.size()=1 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:Mashbf7FLZhpkkt2ODgL80RABePjB9q_.qkeEHRadWV3bndCp3RTpq2MusWIz25L_0 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1589580486100611223', time=2024-04-03T06:53:43.561800+0000, chain.objs.size()=1 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:YnitZ4yARpZKGsj6rxSkdl1Squyed0V_.QWgY3PjP1o5jgojKhLxAQm9mFkz5J9-_0 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3655990424466707855', time=2024-04-03T06:54:11.679497+0000, chain.objs.size()=1 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:KeM.C5W0QIfQG.MWUj4c.Q1x3P0eVp4_.1G3euNJsKFzjRGLNhahx0j-H64cywTp_0 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15603421924834504910', time=2024-04-03T06:55:34.784640+0000, chain.objs.size()=1 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.552__shadow:mgXZnO6WzjeDJgk-3k0u8a1YHqQOk83_.omqowvEiOnLgr3rDOVs5iaYg0Ld9ArN_0 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7743936316415312700', time=2024-04-03T06:55:48.676097+0000, chain.objs.size()=1 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.556__shadow:M2BKBx5WDH.svR0lcFZnu7uuKQc4BzD_.lkAx0m8TVFbTO16A9SghxoQEwbiXZt-_0 2024-04-03T05:14:09.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15003789091539487564', time=2024-04-03T07:01:07.894498+0000, chain.objs.size()=1 2024-04-03T05:14:09.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.597__shadow_.gmvS2AnMapCsYXJD6Ou6YUn3TKeUhj9_0 2024-04-03T05:14:09.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2525300537656432565', time=2024-04-03T07:02:19.553872+0000, chain.objs.size()=1 2024-04-03T05:14:09.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.617__shadow_.EuI1LcGOBY4QT12WNIPw7HrRd3EPArz_0 2024-04-03T05:14:09.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15919281428302172192', time=2024-04-03T07:02:21.549883+0000, chain.objs.size()=1 2024-04-03T05:14:09.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.618__shadow_.lfAOS6paLmoRfiai8F8hWv31PLVrIqT_0 2024-04-03T05:14:09.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1370141955520663686', time=2024-04-03T07:03:34.550536+0000, chain.objs.size()=6 2024-04-03T05:14:09.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.627__multipart_foo.2~athOaFGggE6muR28fn1nzq7a6S1Elu7.1 2024-04-03T05:14:09.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.627__multipart_foo.2~athOaFGggE6muR28fn1nzq7a6S1Elu7.2 2024-04-03T05:14:09.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.627__multipart_foo.2~athOaFGggE6muR28fn1nzq7a6S1Elu7.3 2024-04-03T05:14:09.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.627__multipart_foo.2~athOaFGggE6muR28fn1nzq7a6S1Elu7.4 2024-04-03T05:14:09.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.627__multipart_foo.2~athOaFGggE6muR28fn1nzq7a6S1Elu7.5 2024-04-03T05:14:09.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.627__multipart_foo.2~athOaFGggE6muR28fn1nzq7a6S1Elu7.6 2024-04-03T05:14:09.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16082008949453355392', time=2024-04-03T07:04:08.668713+0000, chain.objs.size()=1 2024-04-03T05:14:09.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.644__shadow_.lKYfw8epBoJ1kzy6FnSzo-RsyhA8g1p_0 2024-04-03T05:14:09.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5173828207574301193', time=2024-04-03T07:05:08.903637+0000, chain.objs.size()=1 2024-04-03T05:14:09.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.513+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.676__multipart_file1.2~FOhvy-Wl5NA28zecpnis3EY0m2-OWJu.1 2024-04-03T05:14:09.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-03T05:14:09.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49240' 2024-04-03T05:14:09.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_HYMN-8GC-paKG4NQYX53jCTtZXq3Jow', time=2024-04-03T06:22:39.129407+0000, chain.objs.size()=3 2024-04-03T05:14:09.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.07Rt9ItB_py_cbZvIhxIWlYPriYRJYp_0 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.07Rt9ItB_py_cbZvIhxIWlYPriYRJYp_1 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.07Rt9ItB_py_cbZvIhxIWlYPriYRJYp_2 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16190608079580727363', time=2024-04-03T06:25:12.633717+0000, chain.objs.size()=1 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.203__shadow_.5jmOftAJusN7XSzkApq8BlOAiaaNUGO_0 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9677251944205473730', time=2024-04-03T06:25:39.947648+0000, chain.objs.size()=1 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.213__shadow_.D05ZJ77DsqkFHcXoGIsM_HHaPbyhfLU_0 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17901298936811124442', time=2024-04-03T06:25:42.078251+0000, chain.objs.size()=1 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.214__shadow_.VMEioAazUaEGioQH2FwYzGBnwo4O3T4_0 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5138279552380896360', time=2024-04-03T06:26:01.871838+0000, chain.objs.size()=1 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.223__shadow_.10yzi5frYekYACtghdZmexwQfsupncH_0 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1650768737619086942', time=2024-04-03T06:26:08.374376+0000, chain.objs.size()=1 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.226__shadow_.4BZ_b0Z9epm5IwQJEmJwx1ZvMutxO5U_0 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8670713070121554149', time=2024-04-03T06:27:53.162311+0000, chain.objs.size()=1 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1hlCN6XoJf62mKeeIxJ5GoVHLdolGBN_0 2024-04-03T05:14:09.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11475193318171076421', time=2024-04-03T06:27:53.890152+0000, chain.objs.size()=1 2024-04-03T05:14:09.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1MmxsJ6g7n5nMRDt0-HAeVf4tPOiQq6_0 2024-04-03T05:14:09.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6419423582932616604', time=2024-04-03T06:27:54.127520+0000, chain.objs.size()=1 2024-04-03T05:14:09.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Mv_im4hK_ykxjKoFUmHLeIrN4XnT3lr_0 2024-04-03T05:14:09.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16114261554378796916', time=2024-04-03T06:27:54.415199+0000, chain.objs.size()=1 2024-04-03T05:14:09.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yiPGdNgCC-HCbjLItel2PNseXN5nZLB_0 2024-04-03T05:14:09.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.248344032709139777', time=2024-04-03T06:27:57.316687+0000, chain.objs.size()=1 2024-04-03T05:14:09.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tEBA8ELDcBVtbw6A1YUMCs8wSQnPLwN_0 2024-04-03T05:14:09.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13787714178687602731', time=2024-04-03T06:27:57.942345+0000, chain.objs.size()=1 2024-04-03T05:14:09.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cOUqJRTcVchg5ooY-ZJI0Fs59UV12ty_0 2024-04-03T05:14:09.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8200232683618245701', time=2024-04-03T06:27:58.069541+0000, chain.objs.size()=1 2024-04-03T05:14:09.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.e24ebz9QZMv78XlU-DwG4y4p7h1bD1A_0 2024-04-03T05:14:09.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5769068058107397871', time=2024-04-03T06:27:58.705434+0000, chain.objs.size()=1 2024-04-03T05:14:09.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.M_mnMpNb3XUNabKgXRde9H_yD12dW7X_0 2024-04-03T05:14:09.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6086067774793152274', time=2024-04-03T06:28:01.436079+0000, chain.objs.size()=1 2024-04-03T05:14:09.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6XX9LSUfALPSAN5dt12HarmRgfFDO9y_0 2024-04-03T05:14:09.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5532213801367650752', time=2024-04-03T06:28:01.645490+0000, chain.objs.size()=1 2024-04-03T05:14:09.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OkDcvqYfW7_zSpsvSKyU6pC2bd9Drby_0 2024-04-03T05:14:09.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13754734990606360028', time=2024-04-03T06:28:06.224057+0000, chain.objs.size()=1 2024-04-03T05:14:09.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Qp1xqOJZn7WePGhaHcnvMNNtz0OQg5E_0 2024-04-03T05:14:09.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6751758065626572346', time=2024-04-03T06:28:06.230623+0000, chain.objs.size()=1 2024-04-03T05:14:09.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5Z9EJuEwY-83OuV7M66LVYUXULOTRpB_0 2024-04-03T05:14:09.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12864965266093741101', time=2024-04-03T06:28:06.354143+0000, chain.objs.size()=1 2024-04-03T05:14:09.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.27oglIz2m8xKfrtn8bSC7_9vOxjNlQV_0 2024-04-03T05:14:09.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14979457548477925273', time=2024-04-03T06:28:06.633446+0000, chain.objs.size()=1 2024-04-03T05:14:09.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.FikGLID6iHswxUdy7pqbVy6tK59baUs_0 2024-04-03T05:14:09.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11507364713219370491', time=2024-04-03T06:28:06.863666+0000, chain.objs.size()=1 2024-04-03T05:14:09.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.bBmfI1fuFOhuWOKKHHzc6E5TDUDKuMA_0 2024-04-03T05:14:09.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.533+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1325748250623403710', time=2024-04-03T06:28:10.446543+0000, chain.objs.size()=1 2024-04-03T05:14:09.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.533+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JvWfAK_FT0sJKjQSuBWVTLx9o8iLKC7_0 2024-04-03T05:14:09.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.533+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3646862735785715217', time=2024-04-03T06:28:10.663229+0000, chain.objs.size()=1 2024-04-03T05:14:09.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.533+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fcoJAVQGh8i23_FqHXK0ReTm5SRE_iL_0 2024-04-03T05:14:09.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3015693534063891778', time=2024-04-03T06:28:11.889075+0000, chain.objs.size()=1 2024-04-03T05:14:09.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nShXSA-h6Ito5p4hw4EGjtNppuvoKn4_0 2024-04-03T05:14:09.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3019636585415885798', time=2024-04-03T06:28:11.898496+0000, chain.objs.size()=1 2024-04-03T05:14:09.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_._UCOboCSR2U2mxLVDmzvV2XscKDCGf4_0 2024-04-03T05:14:09.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17921705845484560835', time=2024-04-03T06:28:12.853537+0000, chain.objs.size()=1 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.CWwB3y5vReXAATH474_khUqI1n5UjWg_0 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10697449307721361538', time=2024-04-03T06:28:13.337906+0000, chain.objs.size()=1 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.23ofVbXKo5l_Ic2hYkUw9fnfaygzh33_0 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5719382295760979764', time=2024-04-03T06:28:13.440264+0000, chain.objs.size()=1 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9LmbzV83_8WOYLnjltbt4w6m473kyi4_0 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11596590346251364141', time=2024-04-03T06:28:15.574082+0000, chain.objs.size()=1 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.G-CGqxB7D3xAmwEsJmzxSPk0gt_Wx4S_0 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14561488560319734073', time=2024-04-03T06:28:16.559539+0000, chain.objs.size()=1 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.O-M-998DcFmnhK2WczIJ1hCjVG5I1Mf_0 2024-04-03T05:14:09.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12933042671148355081', time=2024-04-03T06:28:18.675559+0000, chain.objs.size()=1 2024-04-03T05:14:09.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.RHwVIfDXsyJ7cs2o-LPNnZ1koihOB43_0 2024-04-03T05:14:09.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.542484131061424814', time=2024-04-03T06:28:18.722785+0000, chain.objs.size()=1 2024-04-03T05:14:09.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.h9ltePAcroxR3UldS4WDGjnHDxEHEyX_0 2024-04-03T05:14:09.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17332112703510450232', time=2024-04-03T06:28:19.741260+0000, chain.objs.size()=1 2024-04-03T05:14:09.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qeSsDcX2GrMCtAyAootH-VKLbcr_Rcf_0 2024-04-03T05:14:09.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5943733261544973198', time=2024-04-03T06:28:19.890800+0000, chain.objs.size()=1 2024-04-03T05:14:09.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UMZ3J4GSGdmQ3-Mg0ohxluIgtSDUGP0_0 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15980304101093220252', time=2024-04-03T06:28:20.073914+0000, chain.objs.size()=1 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.RUARkscU1WcdkrvSfzb5d6hWMf8xXe2_0 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12023988927294232531', time=2024-04-03T06:28:20.553177+0000, chain.objs.size()=1 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QOjwzXq3clPe7h_kd5oboUW67brF2go_0 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15791220470090789104', time=2024-04-03T06:28:20.766740+0000, chain.objs.size()=1 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BZQnKg4CO6TUR84wPX8HVWhuKPmVubV_0 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1048262503620261217', time=2024-04-03T06:28:40.027044+0000, chain.objs.size()=1 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.240__shadow_.jaopcBrCSc0_BQEyhB98v-eea5faZNj_0 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12827535417683394250', time=2024-04-03T06:29:06.451958+0000, chain.objs.size()=1 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.252__shadow_.P9Oh_GB01j0b5XUh6teepvfHdGoyfBZ_0 2024-04-03T05:14:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13420380929766254142', time=2024-04-03T06:29:16.055763+0000, chain.objs.size()=1 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.256__shadow_.z5vbNC6TW8sV29A2V1hnRrcIdBw231d_0 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4069909263277796666', time=2024-04-03T06:29:30.563149+0000, chain.objs.size()=1 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.2V9ybB0aZTt4xqCcd_f-E26skP8bOK3_0 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3482734584773995045', time=2024-04-03T06:29:30.645769+0000, chain.objs.size()=1 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.GloN140_9kS4_6Y0l5CinU2KDTImuqB_0 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3655762185971045756', time=2024-04-03T06:29:40.617382+0000, chain.objs.size()=1 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.264__shadow_.3yKyOZUeWEjTxx1Vps3kgFyrHuXUoQE_0 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7457139142739919342', time=2024-04-03T06:29:42.936546+0000, chain.objs.size()=1 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.265__shadow_.gNymKb2_9PZ4CPzsFfgtSjxwv6qcO3Q_0 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.108624775577781697', time=2024-04-03T06:29:45.148614+0000, chain.objs.size()=1 2024-04-03T05:14:09.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.266__shadow_.FsruEPn2x0U8c-DiIkFzf-acOlFOsvD_0 2024-04-03T05:14:09.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10656266468191612526', time=2024-04-03T06:29:49.822073+0000, chain.objs.size()=1 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.268__shadow_.IBMX9QSsr5-P_UGxjEt99EHt-bqwKDF_0 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3837422938707219582', time=2024-04-03T06:32:24.593678+0000, chain.objs.size()=1 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pQTWL6YtuT1FA6GPAtyZimrYYx9wMj0_0 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16057508623593689566', time=2024-04-03T06:32:25.630580+0000, chain.objs.size()=1 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Y5mYETLguTo9sQvtJ2M8CtWXEBBV7X5_0 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7555941227622569040', time=2024-04-03T06:32:27.045822+0000, chain.objs.size()=1 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.s9sdFks0ohbx7rM0GHOW9z6oyalRl5y_0 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6940301514365022262', time=2024-04-03T06:32:28.068443+0000, chain.objs.size()=1 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.aKAohgdk2kWVNs6yg5-0Iox_8SS4-hH_0 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.861606849515145841', time=2024-04-03T06:32:28.164321+0000, chain.objs.size()=1 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.oDajwTllXnij4mYwo5VyVjYMwSZsoO7_0 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8217517261925363767', time=2024-04-03T06:32:28.166467+0000, chain.objs.size()=1 2024-04-03T05:14:09.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._2_MTAutGg5tTw5Rgs_oGRxRJ5xpMAv_0 2024-04-03T05:14:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3273570271891959540', time=2024-04-03T06:32:29.328757+0000, chain.objs.size()=1 2024-04-03T05:14:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Atfvfy0xm07bPxkdQo58Q_0R-XomB-X_0 2024-04-03T05:14:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16656741749071874575', time=2024-04-03T06:32:29.824106+0000, chain.objs.size()=1 2024-04-03T05:14:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GBUBUCtOnKtrAKJf-O7sL7g-RtfNeFy_0 2024-04-03T05:14:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17538667290089331216', time=2024-04-03T06:32:29.829086+0000, chain.objs.size()=1 2024-04-03T05:14:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Wm7DsVLkMj_Pn-9DwWv0qhs-j0TpyHx_0 2024-04-03T05:14:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1130766520363957401', time=2024-04-03T06:32:30.492742+0000, chain.objs.size()=1 2024-04-03T05:14:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5rsJHWlFH4oDYdn-zgmdg83r6_Wb38C_0 2024-04-03T05:14:09.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14971264312406616014', time=2024-04-03T06:32:32.479592+0000, chain.objs.size()=1 2024-04-03T05:14:09.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UDDDMv7PTCW0rjG1zuERGJ6ZSoaOwnC_0 2024-04-03T05:14:09.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14612688168750571312', time=2024-04-03T06:32:32.794309+0000, chain.objs.size()=1 2024-04-03T05:14:09.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4yaB64zx7BgQUsLNAH4fHbw2xyp9cfz_0 2024-04-03T05:14:09.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1551105775639774098', time=2024-04-03T06:32:33.768491+0000, chain.objs.size()=1 2024-04-03T05:14:09.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sJTBmDjtppHnWoqUFYjMuewlxoBH3XM_0 2024-04-03T05:14:09.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16766902206518681508', time=2024-04-03T06:32:34.372208+0000, chain.objs.size()=1 2024-04-03T05:14:09.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mgBzfSmnIvfNlupQ91uFswbtWwt7aQG_0 2024-04-03T05:14:09.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4805560080838196337', time=2024-04-03T06:32:34.572911+0000, chain.objs.size()=1 2024-04-03T05:14:09.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.wEvMQdGauE4VTJXWJvzjw9__FgaoLq-_0 2024-04-03T05:14:09.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5355323942080665593', time=2024-04-03T06:32:36.091366+0000, chain.objs.size()=1 2024-04-03T05:14:09.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.46vHCW-Pzyf_cQDEyLzBdHkcCV--W4U_0 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5615374401342382127', time=2024-04-03T06:32:36.757926+0000, chain.objs.size()=1 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tLvUExqLTiT-JM4cU3EZ-wHjkEkFBin_0 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3897039958634154297', time=2024-04-03T06:32:37.170027+0000, chain.objs.size()=1 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MMr14kDrznva4nfgSC5u8nmO6C1wUS9_0 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7791298910624006894', time=2024-04-03T06:32:41.509168+0000, chain.objs.size()=1 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.90i5GevyzOba7uCxK4a9iWhCBBUP4o3_0 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14340631079552885021', time=2024-04-03T06:32:43.378697+0000, chain.objs.size()=1 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XMU8c-nZL8MMK0_Bp3Z6_2Q82zirxL0_0 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18009146577072424534', time=2024-04-03T06:32:44.247850+0000, chain.objs.size()=1 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.oGnttEkZPzJbSyJuDnfySwyABn9jp8w_0 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4556453743450703372', time=2024-04-03T06:32:44.970506+0000, chain.objs.size()=1 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-oMKNAM4HjvuZwEXU1rYNS9zmGFmUjK_0 2024-04-03T05:14:09.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13696251739248652981', time=2024-04-03T06:32:45.114633+0000, chain.objs.size()=1 2024-04-03T05:14:09.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FPj-D55xR2KxoGT-NOwgRUQz6mcsBIV_0 2024-04-03T05:14:09.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12658903159351278860', time=2024-04-03T06:32:45.310486+0000, chain.objs.size()=1 2024-04-03T05:14:09.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mYRbmIGkQAzYaKzbyXJW0W7rCmvMtJM_0 2024-04-03T05:14:09.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1967430091985949406', time=2024-04-03T06:32:45.736034+0000, chain.objs.size()=1 2024-04-03T05:14:09.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mx_asyDUuxEw25aWT0947muzB8jAfND_0 2024-04-03T05:14:09.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8327844369702341212', time=2024-04-03T06:32:45.737820+0000, chain.objs.size()=1 2024-04-03T05:14:09.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hdQjjk4UQoZj0TgoD9TC1hz56kBIaTd_0 2024-04-03T05:14:09.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18363105053584136184', time=2024-04-03T06:32:48.048160+0000, chain.objs.size()=1 2024-04-03T05:14:09.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sTzyzWcxF_4ybVNDXXVQkatRQ4fifVV_0 2024-04-03T05:14:09.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14123647524245948372', time=2024-04-03T06:32:48.049939+0000, chain.objs.size()=1 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.l480dG34uVD_dcZaV8cOmskSkoxnPHt_0 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8743449120924162133', time=2024-04-03T06:32:49.091117+0000, chain.objs.size()=1 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mTxXTI7pq9uTpzbub97lk39mv-ki1bv_0 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15415555952359014228', time=2024-04-03T06:32:50.661599+0000, chain.objs.size()=1 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9FO7lqvk6ATXDWNLFo-2VBAJW4saIGB_0 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4796259494748232216', time=2024-04-03T06:34:29.648491+0000, chain.objs.size()=1 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fQ_kWTRbCvPvGJ46Z0h9ppPhWXR4Ses_0 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9637044177256459786', time=2024-04-03T06:34:33.456133+0000, chain.objs.size()=1 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KFD0YOC_n2zSfvrsId_M0t1E0O0rK3S_0 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5203919456373685513', time=2024-04-03T06:34:34.328873+0000, chain.objs.size()=1 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.A4p3azHFWsBAYUqUOYqzOB8lWAhh123_0 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3363697017589070132', time=2024-04-03T06:34:34.901559+0000, chain.objs.size()=1 2024-04-03T05:14:09.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xcbllv7PZJfxmaimAGc7cyi2adRxONp_0 2024-04-03T05:14:09.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15490348245582989619', time=2024-04-03T06:34:36.247409+0000, chain.objs.size()=1 2024-04-03T05:14:09.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ani2WSx7UujKUDCWXaFgrdlLoh2mn_O_0 2024-04-03T05:14:09.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18440086182349965367', time=2024-04-03T06:34:36.277910+0000, chain.objs.size()=1 2024-04-03T05:14:09.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._wgMC1nwXhfZOurtIqzpdrlJv4YOfR1_0 2024-04-03T05:14:09.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14416696522715506398', time=2024-04-03T06:34:36.756161+0000, chain.objs.size()=1 2024-04-03T05:14:09.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.y14K3bkkPo9D77ubtIGkhWCwt4bBBUw_0 2024-04-03T05:14:09.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.713079960727842496', time=2024-04-03T06:34:36.819534+0000, chain.objs.size()=1 2024-04-03T05:14:09.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gPSzULyMZ3kri4wYndjvgvSryfWlC5L_0 2024-04-03T05:14:09.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8298595746393253185', time=2024-04-03T06:34:38.292399+0000, chain.objs.size()=1 2024-04-03T05:14:09.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4itnbsWXX-5tih3v_ynQZJaZlUwpDIy_0 2024-04-03T05:14:09.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11643541326900714566', time=2024-04-03T06:34:38.645982+0000, chain.objs.size()=1 2024-04-03T05:14:09.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7Q6-F_m5NIErrFEAAt188TWTKYRjrF1_0 2024-04-03T05:14:09.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6262286301815991038', time=2024-04-03T06:34:39.051200+0000, chain.objs.size()=1 2024-04-03T05:14:09.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VVmWPLK__9OM4yG6g01bhPkCAlRa9XK_0 2024-04-03T05:14:09.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13020999941020212482', time=2024-04-03T06:34:40.112487+0000, chain.objs.size()=1 2024-04-03T05:14:09.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cRE75JnPaC-JFvEm7knarA68cjVgntE_0 2024-04-03T05:14:09.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17162412235502953164', time=2024-04-03T06:34:41.168504+0000, chain.objs.size()=1 2024-04-03T05:14:09.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.knyH70qqofqWV1YwMg4vd-ts1_d22PT_0 2024-04-03T05:14:09.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7345242106904175864', time=2024-04-03T06:34:42.664659+0000, chain.objs.size()=1 2024-04-03T05:14:09.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0DsfC1PEVtnpU7HT2mQswoYEdYh7HLa_0 2024-04-03T05:14:09.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13968739501072220223', time=2024-04-03T06:34:42.698420+0000, chain.objs.size()=1 2024-04-03T05:14:09.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YnlKpbj6Hz51g4wytlXKXUVNfTPoStU_0 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8753753315580897592', time=2024-04-03T06:34:43.661468+0000, chain.objs.size()=1 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.j7oLXvy15r8f1Kzk_iOePcaxULpCbWN_0 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.198523529741799091', time=2024-04-03T06:34:43.663250+0000, chain.objs.size()=1 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ZvCYmVdCsDfTsC4nSZuyZAQwQSI_F_n_0 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12738832305871656360', time=2024-04-03T06:34:44.749047+0000, chain.objs.size()=1 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.l5C3m_0SegPMIiB9OtjpA5w1QjO7fRU_0 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11445484483367393235', time=2024-04-03T06:34:46.070027+0000, chain.objs.size()=1 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.jR4C3yqXYzAa8Z6M7Dvk6PpiheGA8It_0 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14201231555174005911', time=2024-04-03T06:34:46.071927+0000, chain.objs.size()=1 2024-04-03T05:14:09.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1Pv7fQDbKcLuAtX2uuU7c8LYBWrhkQX_0 2024-04-03T05:14:09.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.577+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2316800038639457502', time=2024-04-03T06:34:46.207451+0000, chain.objs.size()=1 2024-04-03T05:14:09.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.577+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rI4k9Z2Odkmx3eucSvogu_Cbx82FRV6_0 2024-04-03T05:14:09.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.577+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10814542480750995837', time=2024-04-03T06:34:47.360953+0000, chain.objs.size()=1 2024-04-03T05:14:09.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.577+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DLe0NoknREJ37RNKAPLtkFm_dEc3GOp_0 2024-04-03T05:14:09.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.577+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1392326653116729694', time=2024-04-03T06:34:47.410630+0000, chain.objs.size()=1 2024-04-03T05:14:09.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.577+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.slBCNSK6dizW3m35gyCPvUwbPZbBYuY_0 2024-04-03T05:14:09.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.577+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15289497435240132732', time=2024-04-03T06:34:49.641935+0000, chain.objs.size()=1 2024-04-03T05:14:09.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.577+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.23r8TwA6Rbin6dXjl3Xe_2BFgDICmNe_0 2024-04-03T05:14:09.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.581+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/49240 2024-04-03T05:14:09.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4681530616637463621', time=2024-04-03T06:34:51.423558+0000, chain.objs.size()=1 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.FOKjscXn7zV1OXqcfLokYyvrKI2f9SI_0 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16443056211143332989', time=2024-04-03T06:34:53.200369+0000, chain.objs.size()=1 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.poI6SLhQXk1r6QO9cCuuRRhEw1Y4P7O_0 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15492161934270692035', time=2024-04-03T06:34:53.538111+0000, chain.objs.size()=1 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JvMMBPhw4VjS5cFRNlUERwOK3HDIts-_0 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8989753541455425729', time=2024-04-03T06:34:55.135436+0000, chain.objs.size()=1 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kuBS6qObjVoPQDXgVxXh5zXtNtGr1wk_0 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4453806077966620418', time=2024-04-03T06:35:03.873168+0000, chain.objs.size()=1 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.297__shadow_.qfAQn4Z9muNwIFsm6wSfpyMHZYU777R_0 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8020808123103915223', time=2024-04-03T06:38:20.086292+0000, chain.objs.size()=1 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.399__shadow_.g7f7mBgyJzuclQyjFniySpGxhQ1CcWr_0 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6574977788992702871', time=2024-04-03T06:40:14.360938+0000, chain.objs.size()=1 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.dsvoslujzYKnFr-rImuNBr8Aor2_4Yu_0 2024-04-03T05:14:09.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.247401608577774862', time=2024-04-03T06:40:36.224260+0000, chain.objs.size()=1 2024-04-03T05:14:09.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.460__shadow_.8BK3ELDRVJBTmErNOHB1gmF4CKusxIq_0 2024-04-03T05:14:09.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16627891517161858002', time=2024-04-03T06:41:43.938668+0000, chain.objs.size()=6 2024-04-03T05:14:09.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.1 2024-04-03T05:14:09.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2 2024-04-03T05:14:09.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.3 2024-04-03T05:14:09.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.4 2024-04-03T05:14:09.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.585+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.5 2024-04-03T05:14:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.6 2024-04-03T05:14:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15639975623124983685', time=2024-04-03T06:43:07.627984+0000, chain.objs.size()=12 2024-04-03T05:14:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__multipart_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.1 2024-04-03T05:14:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__shadow_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.1_1 2024-04-03T05:14:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__multipart_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.2 2024-04-03T05:14:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__shadow_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.2_1 2024-04-03T05:14:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__multipart_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.3 2024-04-03T05:14:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__shadow_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.3_1 2024-04-03T05:14:09.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__multipart_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.4 2024-04-03T05:14:09.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__shadow_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.4_1 2024-04-03T05:14:09.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__multipart_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.5 2024-04-03T05:14:09.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__shadow_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.5_1 2024-04-03T05:14:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__multipart_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.6 2024-04-03T05:14:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.589+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.489__shadow_mymultipart.2~LyPaZx1Ps9nPuosRJFyDnidnhnjcr7a.6_1 2024-04-03T05:14:09.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5017089940631878451', time=2024-04-03T06:51:20.602375+0000, chain.objs.size()=1 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.523__shadow_.snAP3yzb72RJ4e3QtAF1_ig2YWUwm_o_0 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17803774698450594635', time=2024-04-03T06:52:40.681499+0000, chain.objs.size()=1 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:bFErv4jYcQT62HaX.fgrB9mwVy9MuOr_.9lX4Qzi29rKub3Fa1KXhs_sdcARhd3f_0 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11023150988303271341', time=2024-04-03T06:53:21.617511+0000, chain.objs.size()=1 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow:zdlF7D5ucP7CLwCyLjlGfylQ0I-4IPb_.B-9lA5ueeSeFh3pbZXmIrB_yCuQ3rSo_0 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1846446782015466201', time=2024-04-03T06:53:33.021426+0000, chain.objs.size()=1 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:EmLtr-Ddp.D8OiuWbVf5JHWjyY-1wGo_.UkVPopLDzK-LtTv9lihGz2f_4SDQiw5_0 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso', time=2024-04-03T07:00:37.644429+0000, chain.objs.size()=12 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__multipart_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.1 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__shadow_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.1_1 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__multipart_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.2 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__shadow_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.2_1 2024-04-03T05:14:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.593+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__multipart_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.3 2024-04-03T05:14:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__shadow_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.3_1 2024-04-03T05:14:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__multipart_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.4 2024-04-03T05:14:09.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__shadow_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.4_1 2024-04-03T05:14:09.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__multipart_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.5 2024-04-03T05:14:09.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__shadow_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.5_1 2024-04-03T05:14:09.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__multipart_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.6 2024-04-03T05:14:09.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.591__shadow_multipart_enc.2~EfJoFd1qZoG3vujuR8OQEj7pJxBtcso.6_1 2024-04-03T05:14:09.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10874312087027634367', time=2024-04-03T07:03:54.912775+0000, chain.objs.size()=1 2024-04-03T05:14:09.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.636__shadow_.R0MVhWtSU3zGM7uvESF9OKzbtgCG3Vo_0 2024-04-03T05:14:09.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8695182972342319130', time=2024-04-03T07:04:43.967814+0000, chain.objs.size()=1 2024-04-03T05:14:09.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.597+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.664__shadow:rEUKyaTTCXon0C2Ra.1F1jDNWJYXw8X_.hPF6m3NPZLIcQ_w-sJSmWuvjEowc6ib_0 2024-04-03T05:14:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.605+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-03T05:14:09.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46296' 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2572875998552546284', time=2024-04-03T06:23:33.700867+0000, chain.objs.size()=1 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.165__shadow_.l8bNBavdXlS6nQ0NtZ_UGfurgwhQIaJ_0 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17278102472256563969', time=2024-04-03T06:23:44.973989+0000, chain.objs.size()=1 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.171__shadow_.JjKFwa8YbFCANfO8skXa8gAleUFPBz3_0 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13454846813083705504', time=2024-04-03T06:27:53.429864+0000, chain.objs.size()=1 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.T3BXC4u-DQpiIvyB_ACWsrgNae0nd2Z_0 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12894959095682558723', time=2024-04-03T06:27:54.306617+0000, chain.objs.size()=1 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Kw4fq9V4PuNL-kTVf4Ac2-M27iLcoxC_0 2024-04-03T05:14:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6927159966947099288', time=2024-04-03T06:27:54.628913+0000, chain.objs.size()=1 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0ak1alkiX15aAa8zKIZizCZQa-NutEK_0 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2925535185750098032', time=2024-04-03T06:27:56.741325+0000, chain.objs.size()=1 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.F87s5RqLONoVaNZLUC8sI73RZRweymQ_0 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8127851906700597031', time=2024-04-03T06:27:56.977396+0000, chain.objs.size()=1 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Nvx1F7E7uyT6fU1i_45j2Voxa81Gp7u_0 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17851057680522512019', time=2024-04-03T06:27:57.182961+0000, chain.objs.size()=1 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eidTV3GUYpkEZAU8Dln1mYAkOEiK-t__0 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7410057338510455804', time=2024-04-03T06:27:57.841095+0000, chain.objs.size()=1 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fqEoN9livegxmpDGKkY6kTwvmiMH2L3_0 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5031345027164761833', time=2024-04-03T06:28:00.540957+0000, chain.objs.size()=1 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.G54e04v9yRth00JhrHDQoQAuTAKQcSs_0 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9964772239265938031', time=2024-04-03T06:28:01.142798+0000, chain.objs.size()=1 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1L6VnsWIsNUFvAA882w36PLOJJ-2jt4_0 2024-04-03T05:14:09.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3709455794053108993', time=2024-04-03T06:28:01.145032+0000, chain.objs.size()=1 2024-04-03T05:14:09.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.609+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tWgpOFIP5jwx3ifSCvttaDMTmcF072n_0 2024-04-03T05:14:09.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.613+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3846192787240194765', time=2024-04-03T06:28:01.490385+0000, chain.objs.size()=1 2024-04-03T05:14:09.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.613+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.K6yqeNykhzPe7tXuCbZ_HG8vevx6nBQ_0 2024-04-03T05:14:09.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14464672986371242419', time=2024-04-03T06:28:02.018750+0000, chain.objs.size()=1 2024-04-03T05:14:09.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dJSu5iNsYYiUmiWfsvDea2js43KREtb_0 2024-04-03T05:14:09.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17743912889242006550', time=2024-04-03T06:28:02.337009+0000, chain.objs.size()=1 2024-04-03T05:14:09.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.iTKOL5r_bqBOWzoHIxThJVEZ6uGqsfg_0 2024-04-03T05:14:09.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9405624140348375751', time=2024-04-03T06:28:02.610529+0000, chain.objs.size()=1 2024-04-03T05:14:09.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gGYRxBJqOGCBRhD-DCuw8OhWQ5cQ_yB_0 2024-04-03T05:14:09.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5207864638046128909', time=2024-04-03T06:28:05.136757+0000, chain.objs.size()=1 2024-04-03T05:14:09.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.L5LBTNgJbPnBCtrIcgL-YKzBPFA84GB_0 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14410550062883584528', time=2024-04-03T06:28:06.203139+0000, chain.objs.size()=1 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.soPBc4EES1pHfv8HhdJuleRTTeAoWjZ_0 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17539619751637813453', time=2024-04-03T06:28:06.866032+0000, chain.objs.size()=1 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.R8clQI_x4wzh-vRk8dPjQNuLIi0-8uP_0 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13928308744118651312', time=2024-04-03T06:28:08.286349+0000, chain.objs.size()=1 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.p-wdDUtDaV9ynMxmQjaCGehPO72_4dB_0 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1736620248004114856', time=2024-04-03T06:28:11.989450+0000, chain.objs.size()=1 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LZz6d8_kDTvspCf8X9kU1qIrz38Xx-A_0 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4192437448566761206', time=2024-04-03T06:28:13.796575+0000, chain.objs.size()=1 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.btRBl9prvYpWArfl98EW4Jv6aMvWddE_0 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18099104310188883120', time=2024-04-03T06:28:14.076732+0000, chain.objs.size()=1 2024-04-03T05:14:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.APimLgDimQdjcGfMG8nxzvsnvcCvhDL_0 2024-04-03T05:14:09.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2274981996393183367', time=2024-04-03T06:28:15.272671+0000, chain.objs.size()=1 2024-04-03T05:14:09.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rS7y2RQ8ffpceluCORwNFNQmOfFwvj9_0 2024-04-03T05:14:09.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1199025799379436404', time=2024-04-03T06:28:16.012267+0000, chain.objs.size()=1 2024-04-03T05:14:09.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.617+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rhSI9mZG9VQajXv_JYFpIXqEAHiktkq_0 2024-04-03T05:14:09.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6247033651930111513', time=2024-04-03T06:28:17.198089+0000, chain.objs.size()=1 2024-04-03T05:14:09.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Ryp30FBd6f6nCeUcFjDEiN12bNhmu3T_0 2024-04-03T05:14:09.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11153685858446659871', time=2024-04-03T06:28:20.586345+0000, chain.objs.size()=1 2024-04-03T05:14:09.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.t1Iwf673hteJ6MJl_3TR9CalPS5gjOa_0 2024-04-03T05:14:09.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13991540312253284637', time=2024-04-03T06:28:20.747687+0000, chain.objs.size()=1 2024-04-03T05:14:09.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.XXF0ZOmXVF38SmLayCNPJzjaJVsYUKl_0 2024-04-03T05:14:09.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13611559398068210819', time=2024-04-03T06:29:30.685136+0000, chain.objs.size()=1 2024-04-03T05:14:09.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.ASPmNqx87Enxt2KJuzIQjjxohBUx878_0 2024-04-03T05:14:09.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15038686336830448483', time=2024-04-03T06:29:30.687424+0000, chain.objs.size()=1 2024-04-03T05:14:09.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.I5TqFIiMnp5bVwjaPDqxRCHU16ngaSl_0 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4898795296933718400', time=2024-04-03T06:29:40.637320+0000, chain.objs.size()=1 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.264__shadow_.NaogywnlCvor9WDc-pymhk9RYpxiOjY_0 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10854446071440829149', time=2024-04-03T06:29:42.927793+0000, chain.objs.size()=1 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.265__shadow_.JUvbiZcD4hlzUp0JqeXIgdYz1HNgjrA_0 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15001158652594447052', time=2024-04-03T06:29:56.323545+0000, chain.objs.size()=1 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.271__shadow_.Pwg02eU0YtTa3etvhM6jHu14fGns3Fw_0 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14387460709246637322', time=2024-04-03T06:30:41.578006+0000, chain.objs.size()=1 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.288__shadow:uJj1gIhEVPMcoklVXrOhkRfRa5ScbDJ_.xOncDJE2ZqGXMF-aH1T1uk4LMxs0zRH_0 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12491080708407537017', time=2024-04-03T06:32:24.482723+0000, chain.objs.size()=1 2024-04-03T05:14:09.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qD-MgDJSHFlCyYbkqcUCEa-xnKSTFYW_0 2024-04-03T05:14:09.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17735697722896071255', time=2024-04-03T06:32:24.664543+0000, chain.objs.size()=1 2024-04-03T05:14:09.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.jwNWssJlpsU2_2be_HGB9DGE8MiYYFv_0 2024-04-03T05:14:09.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2746527205963675918', time=2024-04-03T06:32:24.859733+0000, chain.objs.size()=1 2024-04-03T05:14:09.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.621+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lccPR35czVgMF3sq7MUqcWeF16mJZc3_0 2024-04-03T05:14:09.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16882702391000501813', time=2024-04-03T06:32:25.305627+0000, chain.objs.size()=1 2024-04-03T05:14:09.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.NLy8vCT0lQ6XiDJnU9II-j8zg1U-7Fc_0 2024-04-03T05:14:09.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9311368309629995043', time=2024-04-03T06:32:26.974211+0000, chain.objs.size()=1 2024-04-03T05:14:09.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.NbaHiUVi336plAlSNrbyl42VpFjne58_0 2024-04-03T05:14:09.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10772556211909218688', time=2024-04-03T06:32:29.558120+0000, chain.objs.size()=1 2024-04-03T05:14:09.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YGlfFqLoKC71VomfXlv2KIKWk5wh2vb_0 2024-04-03T05:14:09.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15139158283705444569', time=2024-04-03T06:32:30.162026+0000, chain.objs.size()=1 2024-04-03T05:14:09.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CGk2dxXIe61WDUQK5Qiw-dALRbhaNln_0 2024-04-03T05:14:09.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.626098615994416810', time=2024-04-03T06:32:30.443631+0000, chain.objs.size()=1 2024-04-03T05:14:09.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AsI0DIRMO1ryUa3oHqVlHknCfayWq5K_0 2024-04-03T05:14:09.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6178901558628961435', time=2024-04-03T06:32:32.690875+0000, chain.objs.size()=1 2024-04-03T05:14:09.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.bU9_kV6ElpffDg0aXE8QD4iQpfLUyZ-_0 2024-04-03T05:14:09.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5753880930607839829', time=2024-04-03T06:32:32.970033+0000, chain.objs.size()=1 2024-04-03T05:14:09.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YaNgmaV5Ce4v0d8yuVyEaYEmOnm24DR_0 2024-04-03T05:14:09.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3206423125378627424', time=2024-04-03T06:32:33.072355+0000, chain.objs.size()=1 2024-04-03T05:14:09.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Gn4Umo4_HI2UpwfeXoXyxpNSSdKmEpe_0 2024-04-03T05:14:09.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.195367844398444768', time=2024-04-03T06:32:33.617598+0000, chain.objs.size()=1 2024-04-03T05:14:09.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.s0xP2J6X4EuJAhZKZmGZrZ-HiqT2EqA_0 2024-04-03T05:14:09.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10724892832344559149', time=2024-04-03T06:32:33.619540+0000, chain.objs.size()=1 2024-04-03T05:14:09.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.625+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0FAeac7IOq_-umIZywpcBgbW7wiv3n6_0 2024-04-03T05:14:09.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17010242614712022843', time=2024-04-03T06:32:36.050478+0000, chain.objs.size()=1 2024-04-03T05:14:09.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.669yU_Kq8iYLpS9Moh44y8ZOBwrwjjJ_0 2024-04-03T05:14:09.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2066267915571137930', time=2024-04-03T06:32:36.410564+0000, chain.objs.size()=1 2024-04-03T05:14:09.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.E1hf0JGV7U62o0hFaWYXPCVjQPE02Ge_0 2024-04-03T05:14:09.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10262687383567277539', time=2024-04-03T06:32:37.007041+0000, chain.objs.size()=1 2024-04-03T05:14:09.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.u9Rq8iHCdh_ZMq0-wyZnfZMUT6lkd_H_0 2024-04-03T05:14:09.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14384308578016515908', time=2024-04-03T06:32:37.508457+0000, chain.objs.size()=1 2024-04-03T05:14:09.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.TCaTRHYx_4apSIOBnuupRPJZ-6Pk5ZK_0 2024-04-03T05:14:09.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15311021415666791524', time=2024-04-03T06:32:38.135493+0000, chain.objs.size()=1 2024-04-03T05:14:09.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.baaAcFFJwBSuctSSVNoJBwrH0QkMH8o_0 2024-04-03T05:14:09.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12138826992918050264', time=2024-04-03T06:32:38.137780+0000, chain.objs.size()=1 2024-04-03T05:14:09.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BQuOY1TYTyz71pMlHgFYfmUsGJVRWI-_0 2024-04-03T05:14:09.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16834016781892642973', time=2024-04-03T06:32:39.341334+0000, chain.objs.size()=1 2024-04-03T05:14:09.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.46MBol_UtnqfRFkibNyfAD-J0yODov4_0 2024-04-03T05:14:09.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3860060037338733188', time=2024-04-03T06:32:39.445210+0000, chain.objs.size()=1 2024-04-03T05:14:09.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sdMkSsjFdsrN2hEdfx_V8UPOQHeJNv4_0 2024-04-03T05:14:09.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5163163028828901893', time=2024-04-03T06:32:40.282728+0000, chain.objs.size()=1 2024-04-03T05:14:09.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.629+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ab29geYJoyjjoHH5l5D7_i0VbWjmvV9_0 2024-04-03T05:14:09.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2508777871035084787', time=2024-04-03T06:32:41.082171+0000, chain.objs.size()=1 2024-04-03T05:14:09.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.3FkotObjKWOnw679Btygqg4he714oqm_0 2024-04-03T05:14:09.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7553679896760406068', time=2024-04-03T06:32:41.844010+0000, chain.objs.size()=1 2024-04-03T05:14:09.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7DvvLF6S36fvxrxlMjh5IbxjLWVerdP_0 2024-04-03T05:14:09.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6775717829114676759', time=2024-04-03T06:32:42.003898+0000, chain.objs.size()=1 2024-04-03T05:14:09.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.h1zAwkLhMNMW9dUWlwxgnOFlCIfK3i-_0 2024-04-03T05:14:09.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6870964428494603512', time=2024-04-03T06:32:42.975890+0000, chain.objs.size()=1 2024-04-03T05:14:09.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VIgHAu_OcT1PwnjEhePkZtpNYSf1udl_0 2024-04-03T05:14:09.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18414292483539887654', time=2024-04-03T06:32:43.285225+0000, chain.objs.size()=1 2024-04-03T05:14:09.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EIy50U1R8LO5BCI2XO7eI-c-nwIkwRB_0 2024-04-03T05:14:09.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1291790102985589203', time=2024-04-03T06:32:44.716429+0000, chain.objs.size()=1 2024-04-03T05:14:09.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Op12Zc0IculM8gv_r6wkYvWurBgx6m1_0 2024-04-03T05:14:09.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10593187018251584262', time=2024-04-03T06:32:46.502587+0000, chain.objs.size()=1 2024-04-03T05:14:09.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Pqo0g4pYbmX6nfiiux3hEKLIDnjsPHc_0 2024-04-03T05:14:09.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14681275660997801376', time=2024-04-03T06:32:47.653336+0000, chain.objs.size()=1 2024-04-03T05:14:09.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1j5mZbLFt-KBLKhzsSJHFIDcFwpNIjV_0 2024-04-03T05:14:09.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7353335986719509819', time=2024-04-03T06:32:48.672621+0000, chain.objs.size()=1 2024-04-03T05:14:09.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9w8cKaOllcEdqiOg6t_nRfeNGBfQiNg_0 2024-04-03T05:14:09.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16762780513193987424', time=2024-04-03T06:32:48.705302+0000, chain.objs.size()=1 2024-04-03T05:14:09.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.NbeeY-f0pryXgM6g5d8LMm29ptmNSCN_0 2024-04-03T05:14:09.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17049141243909799427', time=2024-04-03T06:32:49.017120+0000, chain.objs.size()=1 2024-04-03T05:14:09.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.633+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.69Rp56WUlWsbyL6HMYKJ7gD8_7U5mKS_0 2024-04-03T05:14:09.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.637+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6363893741703078551', time=2024-04-03T06:32:50.344417+0000, chain.objs.size()=1 2024-04-03T05:14:09.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.637+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Fyv5gdIbFm4v-upF7_Auug2Hjc365L2_0 2024-04-03T05:14:09.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.637+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9650258464809726776', time=2024-04-03T06:32:50.471976+0000, chain.objs.size()=1 2024-04-03T05:14:09.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.637+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zKYaFPEZPxMvhQET5N0gLe5tVaR9LGA_0 2024-04-03T05:14:09.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.637+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18067687136627220339', time=2024-04-03T06:32:51.247050+0000, chain.objs.size()=1 2024-04-03T05:14:09.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.637+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-3poX-8N59Ixrph6C24RA_b1oNZRO8A_0 2024-04-03T05:14:09.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.637+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10783775561736550062', time=2024-04-03T06:32:51.728928+0000, chain.objs.size()=1 2024-04-03T05:14:09.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.637+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.n1r2aD_nASa7Ubwd0rxLapgosLOZtfX_0 2024-04-03T05:14:09.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8785554195933517407', time=2024-04-03T06:34:29.797980+0000, chain.objs.size()=1 2024-04-03T05:14:09.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.l_EiZo7-x1rym40dFVVRTb6RLGueqrK_0 2024-04-03T05:14:09.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15048819270473540839', time=2024-04-03T06:34:31.305374+0000, chain.objs.size()=1 2024-04-03T05:14:09.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.skhaBDELVR8lypmKqrFqoMCHTFng0eY_0 2024-04-03T05:14:09.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7056272255480337086', time=2024-04-03T06:34:33.777865+0000, chain.objs.size()=1 2024-04-03T05:14:09.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KYsXp6DBboHKghvxlC_eJPGBNM0T_Xu_0 2024-04-03T05:14:09.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13681549102883828522', time=2024-04-03T06:34:34.374183+0000, chain.objs.size()=1 2024-04-03T05:14:09.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.L5EA_kY0L_CDSoVE_hps0ZBhiISWgpu_0 2024-04-03T05:14:09.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10996560556087577945', time=2024-04-03T06:34:36.636670+0000, chain.objs.size()=1 2024-04-03T05:14:09.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.x2hmGaepFfz6Vdv9uthzqhfULsnwTZ0_0 2024-04-03T05:14:09.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15745237232603127658', time=2024-04-03T06:34:37.462544+0000, chain.objs.size()=1 2024-04-03T05:14:09.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wPJyhytp53QLPj5AXtscgkWMZI0OjKM_0 2024-04-03T05:14:09.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2441146196879511387', time=2024-04-03T06:34:38.910113+0000, chain.objs.size()=1 2024-04-03T05:14:09.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gwiA-ycmLjEL5CjU-yeRiyaJswdoUs1_0 2024-04-03T05:14:09.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7439630178552951859', time=2024-04-03T06:34:40.168371+0000, chain.objs.size()=1 2024-04-03T05:14:09.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.L-jFCJSExES0xmTgwl696fhLGGwqEKH_0 2024-04-03T05:14:09.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4197115993053952708', time=2024-04-03T06:34:40.758432+0000, chain.objs.size()=1 2024-04-03T05:14:09.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yRg7qp85lX4sLrCTo5TIxkqunTb1tuh_0 2024-04-03T05:14:09.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14675581400336301328', time=2024-04-03T06:34:41.599455+0000, chain.objs.size()=1 2024-04-03T05:14:09.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.qaR9coIUrwWqW850CoqxrknPhpFEPds_0 2024-04-03T05:14:09.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10656731816507291261', time=2024-04-03T06:34:42.109806+0000, chain.objs.size()=1 2024-04-03T05:14:09.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.641+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.sD9A90qx1Mj9E-Fv2cU9Ke1y3jrNDPw_0 2024-04-03T05:14:09.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16150525550563148279', time=2024-04-03T06:34:45.246040+0000, chain.objs.size()=1 2024-04-03T05:14:09.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.eTtgjSpK9g1AVi7DZwioDtH_6MtoNOL_0 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.71679117652105009', time=2024-04-03T06:34:45.615074+0000, chain.objs.size()=1 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ho12llS3OKA_RNqIVMxjoxDZxULz4Rg_0 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17758809481405244610', time=2024-04-03T06:34:45.903585+0000, chain.objs.size()=1 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cfGbfALMQvg3PC-uBrXZXHLxjkGf0PW_0 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13948191426456489069', time=2024-04-03T06:34:47.425399+0000, chain.objs.size()=1 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Fyfb8lvxyqZW5qPL6EAFrKs8CPG79Lo_0 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14501391307751464074', time=2024-04-03T06:34:48.980733+0000, chain.objs.size()=1 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Df2YEaVIeXrit5brOaPjWEyZXXpG3-D_0 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.755662820227999828', time=2024-04-03T06:34:49.168812+0000, chain.objs.size()=1 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.MOjZfQsD9cYS-PONmUXiqkcgCBh8xUE_0 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8846914438615790249', time=2024-04-03T06:34:51.097428+0000, chain.objs.size()=1 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fhhwHHijqW9VyTjjSeC3zbsyFH8EEQL_0 2024-04-03T05:14:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18347997123753801135', time=2024-04-03T06:34:52.529938+0000, chain.objs.size()=1 2024-04-03T05:14:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2TGopQrfFF5NDP1bNTyOGC0uDOuXW3t_0 2024-04-03T05:14:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12967666896116707492', time=2024-04-03T06:34:54.961222+0000, chain.objs.size()=1 2024-04-03T05:14:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zuhoULkf5afqRbJ_7a5N6LvfgDHmaCq_0 2024-04-03T05:14:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3980278536497834555', time=2024-04-03T06:34:56.573099+0000, chain.objs.size()=1 2024-04-03T05:14:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QRchzvP0d1OW5cuQxQdGT2_w1WnDvdl_0 2024-04-03T05:14:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5050485153238412191', time=2024-04-03T06:35:02.023646+0000, chain.objs.size()=1 2024-04-03T05:14:09.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.649+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.296__shadow_.foIY5ImZbmSeT2Vs-im78f33K5ahLqe_0 2024-04-03T05:14:09.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1882130407612358890', time=2024-04-03T06:35:17.574047+0000, chain.objs.size()=1 2024-04-03T05:14:09.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.304__shadow_.CLgf2HZZny5mH7-yO7k2H0t1qQKP1MG_0 2024-04-03T05:14:09.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.581273068083545805', time=2024-04-03T06:36:30.185127+0000, chain.objs.size()=1 2024-04-03T05:14:09.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.343__shadow_.M5YPtzjvYggGwPQ5X2iR1BS8-GauSro_0 2024-04-03T05:14:09.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10097983114018995633', time=2024-04-03T06:40:16.882168+0000, chain.objs.size()=1 2024-04-03T05:14:09.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.454__shadow_.m6KqqgaKmCU-SFzd4RNqu9dvJ5t0Mh-_0 2024-04-03T05:14:09.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.456__shadow_.gplNOSUViTKkpzZjS31ijZFZzQPYXvs_1_d958b8b4f919d9fd2c067e6ab5747497', time=2024-04-03T06:40:27.951180+0000, chain.objs.size()=1 2024-04-03T05:14:09.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.456__shadow_.gplNOSUViTKkpzZjS31ijZFZzQPYXvs_0 2024-04-03T05:14:09.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9930290838110230097', time=2024-04-03T06:40:49.996333+0000, chain.objs.size()=1 2024-04-03T05:14:09.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.467__shadow_.5AZmldNZ7OmZ1M90OdRUSAM_4BXMCLL_0 2024-04-03T05:14:09.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17393008328027181553', time=2024-04-03T06:43:57.227690+0000, chain.objs.size()=1 2024-04-03T05:14:09.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.490__shadow:Mgk9nQJb12IcaAkm5xDJ9ror8wemxrK_.GDmx3W1EJ0rBVk9NQdnOvE5G5gL719Q_0 2024-04-03T05:14:09.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11356286443568736988', time=2024-04-03T06:43:57.961335+0000, chain.objs.size()=6 2024-04-03T05:14:09.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__multipart_mymultipart.2~wUtKgYPGSXqDGxNa5WOFisNGNc8GCPe.1 2024-04-03T05:14:09.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__shadow_mymultipart.2~wUtKgYPGSXqDGxNa5WOFisNGNc8GCPe.1_1 2024-04-03T05:14:09.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__multipart_mymultipart.2~wUtKgYPGSXqDGxNa5WOFisNGNc8GCPe.2 2024-04-03T05:14:09.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__shadow_mymultipart.2~wUtKgYPGSXqDGxNa5WOFisNGNc8GCPe.2_1 2024-04-03T05:14:09.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.653+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__multipart_mymultipart.2~wUtKgYPGSXqDGxNa5WOFisNGNc8GCPe.3 2024-04-03T05:14:09.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.657+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.491__shadow_mymultipart.2~wUtKgYPGSXqDGxNa5WOFisNGNc8GCPe.3_1 2024-04-03T05:14:09.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/46296 2024-04-03T05:14:09.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13841693311987445908', time=2024-04-03T06:47:12.446273+0000, chain.objs.size()=12 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.1 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.1_1 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.TWzlHBJLnWGVUaIaqPaashXuNvmB_nf3.2 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.TWzlHBJLnWGVUaIaqPaashXuNvmB_nf3.2_1 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.uSm94OBDeTQHAAJ8bfyRyF8dchgmvN7w.3 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.uSm94OBDeTQHAAJ8bfyRyF8dchgmvN7w.3_1 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.4 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.4_1 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.5 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.5_1 2024-04-03T05:14:09.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.6 2024-04-03T05:14:09.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.661+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~-E5KD_7kcRVy1v0ZDcdxXvcz9af4ioN.6_1 2024-04-03T05:14:09.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.665+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~8NngyDnbXsAjiXBJR_mEshZOX5Drkjo', time=2024-04-03T06:49:25.525284+0000, chain.objs.size()=1 2024-04-03T05:14:09.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.665+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.501__multipart_mymultipart2.2~8NngyDnbXsAjiXBJR_mEshZOX5Drkjo.1 2024-04-03T05:14:09.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.665+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8593882478989979813', time=2024-04-03T06:50:53.114319+0000, chain.objs.size()=1 2024-04-03T05:14:09.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.665+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.520__shadow_.Xos__YwKLWTr-IKOnmTS4nYkYnfJj-X_0 2024-04-03T05:14:09.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.665+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6125675850093115097', time=2024-04-03T06:51:36.459371+0000, chain.objs.size()=1 2024-04-03T05:14:09.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.665+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.524__shadow_.H57bfddvX3_Tr_WCCILLJ7omlDaFrUP_0 2024-04-03T05:14:09.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.669+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10168439436323076600', time=2024-04-03T06:52:39.208208+0000, chain.objs.size()=1 2024-04-03T05:14:09.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.669+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:NOizCEj4ScLfZMpVUsliaT6ySbcJAPE_.fWB_8euxtFivNft0P9kgjsUqgZbMZiX_0 2024-04-03T05:14:09.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.669+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15981692799441240356', time=2024-04-03T06:53:19.895583+0000, chain.objs.size()=1 2024-04-03T05:14:09.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.669+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow:P-JXspeb97mzqp.gOxbK1H-LIVSPvH8_.9OQd-E8WIfcnDYu7hHUyVx4jOSnb1OT_0 2024-04-03T05:14:09.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.673+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12821177931571924270', time=2024-04-03T06:55:18.303402+0000, chain.objs.size()=7 2024-04-03T05:14:09.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~YEsZsQbcf0sh9yjcA4VPnZILKkktyGZ.1 2024-04-03T05:14:09.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__shadow_testobj.2~YEsZsQbcf0sh9yjcA4VPnZILKkktyGZ.1_1 2024-04-03T05:14:09.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~YEsZsQbcf0sh9yjcA4VPnZILKkktyGZ.2 2024-04-03T05:14:09.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__shadow_testobj.2~YEsZsQbcf0sh9yjcA4VPnZILKkktyGZ.2_1 2024-04-03T05:14:09.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~YEsZsQbcf0sh9yjcA4VPnZILKkktyGZ.3 2024-04-03T05:14:09.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.673+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__shadow_testobj.2~YEsZsQbcf0sh9yjcA4VPnZILKkktyGZ.3_1 2024-04-03T05:14:09.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~YEsZsQbcf0sh9yjcA4VPnZILKkktyGZ.4 2024-04-03T05:14:09.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15834454670773375854', time=2024-04-03T06:59:19.079599+0000, chain.objs.size()=1 2024-04-03T05:14:09.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.585__shadow_.YQSytG2ORzMaiP2wtP1d0Gp5tLlVZWV_0 2024-04-03T05:14:09.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17049360847306140013', time=2024-04-03T07:03:33.353662+0000, chain.objs.size()=6 2024-04-03T05:14:09.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.625__multipart_bar.2~pcBZA2v_aaFub9gYvTEiDGishifpv4Z.1 2024-04-03T05:14:09.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.625__multipart_bar.2~pcBZA2v_aaFub9gYvTEiDGishifpv4Z.2 2024-04-03T05:14:09.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.625__multipart_bar.2~pcBZA2v_aaFub9gYvTEiDGishifpv4Z.3 2024-04-03T05:14:09.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.625__multipart_bar.2~pcBZA2v_aaFub9gYvTEiDGishifpv4Z.4 2024-04-03T05:14:09.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.625__multipart_bar.2~pcBZA2v_aaFub9gYvTEiDGishifpv4Z.5 2024-04-03T05:14:09.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.625__multipart_bar.2~pcBZA2v_aaFub9gYvTEiDGishifpv4Z.6 2024-04-03T05:14:09.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4263372298396800969', time=2024-04-03T07:04:54.520685+0000, chain.objs.size()=1 2024-04-03T05:14:09.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.669__shadow:CHnRKiPn0QeKKur.nPgHbMIx2ottOAb_.UabVaLuZnKEsGrm_MZHVqatfwqIvQJe_0 2024-04-03T05:14:09.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3268817703064153128', time=2024-04-03T07:05:10.439639+0000, chain.objs.size()=1 2024-04-03T05:14:09.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.677__shadow:3zJY6CDziCgxEmT7cIcIeImzSD4oU4V_.vS8yweyRQoGhpAfwhCy6_6XTrTWh-Z8_0 2024-04-03T05:14:09.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11209651693808184602', time=2024-04-03T07:05:26.227597+0000, chain.objs.size()=1 2024-04-03T05:14:09.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.677+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.680__shadow:jnZDzt9AfheqQRVIxNP61DrbLaIVdhK_.Rb7_VrQxe7tM7dEMM7KQHfzTJQx8NYH_0 2024-04-03T05:14:09.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16060346418739970399', time=2024-04-03T07:06:35.075652+0000, chain.objs.size()=10 2024-04-03T05:14:09.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.1 2024-04-03T05:14:09.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.2 2024-04-03T05:14:09.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.3 2024-04-03T05:14:09.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.4 2024-04-03T05:14:09.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.5 2024-04-03T05:14:09.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.6 2024-04-03T05:14:09.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.7 2024-04-03T05:14:09.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.8 2024-04-03T05:14:09.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.9 2024-04-03T05:14:09.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.685+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.698__multipart_foo.2~5Jph8Z2CnQvJdWpbU90N6XAy_tN9UoB.10 2024-04-03T05:14:09.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.693+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-03T05:14:09.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.697+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54049' 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_7oxB-AqrYLLORM0KM0WshMsD2qmBVNI', time=2024-04-03T06:22:03.437058+0000, chain.objs.size()=3 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.dSDy_HXVZ5TDUDPrY5i93zc454HQg64_0 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.dSDy_HXVZ5TDUDPrY5i93zc454HQg64_1 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.dSDy_HXVZ5TDUDPrY5i93zc454HQg64_2 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2164098763308844812', time=2024-04-03T06:23:43.214742+0000, chain.objs.size()=1 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.170__shadow_.1GHMn7J2VJhWouiwMbQYmzjugzgaBxq_0 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5948114100191848957', time=2024-04-03T06:25:10.431557+0000, chain.objs.size()=1 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.202__shadow_.Ynjljy1OcLw8nX7KR9jU0-A-WTICEH4_0 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6325486248006437132', time=2024-04-03T06:25:20.737557+0000, chain.objs.size()=1 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.206__shadow_.amIovAn-Py6RKoao2DpQ2T9kMK52v1Z_0 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7296139494010819419', time=2024-04-03T06:25:39.916764+0000, chain.objs.size()=1 2024-04-03T05:14:09.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.213__shadow_.WvU7FgAEuVo4l_iI9Ou6yL0p0vC_C4e_0 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7220411539134405610', time=2024-04-03T06:26:06.269682+0000, chain.objs.size()=1 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.225__shadow_.NhqvCq-24QRcYIEjXZookF9Gp4Ft8vN_0 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12487755306103365298', time=2024-04-03T06:26:16.971560+0000, chain.objs.size()=1 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.230__shadow_.InMQ2qRqGV_OCcTLArUKRjN4Lfvf0Aj_0 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9328374986345974932', time=2024-04-03T06:27:52.795429+0000, chain.objs.size()=1 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.50GLjknF51vuy5xHksGgpwMXg83FwfJ_0 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17683825311163277316', time=2024-04-03T06:27:53.159374+0000, chain.objs.size()=1 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.J0624z78GG8K3dLiSoynfLMD7b62Buz_0 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7989079025101437386', time=2024-04-03T06:27:53.401593+0000, chain.objs.size()=1 2024-04-03T05:14:09.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vj9uv7Fj29OetRZPPpCb6XjQyZM16-t_0 2024-04-03T05:14:09.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17862536725432124230', time=2024-04-03T06:27:54.600865+0000, chain.objs.size()=1 2024-04-03T05:14:09.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xN-fE21mHxhEI0VqH7RLaFVrT-rosF2_0 2024-04-03T05:14:09.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17105280666027957860', time=2024-04-03T06:27:54.733809+0000, chain.objs.size()=1 2024-04-03T05:14:09.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.2JH6mxb732QEzK3CO3dZLkc1DaYv117_0 2024-04-03T05:14:09.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12500575651878516256', time=2024-04-03T06:27:57.164328+0000, chain.objs.size()=1 2024-04-03T05:14:09.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.701+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sAcM9olmv5PZDyZdE0olUefoS3Fe60H_0 2024-04-03T05:14:09.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11573124943810058493', time=2024-04-03T06:27:57.334086+0000, chain.objs.size()=1 2024-04-03T05:14:09.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.I_XdvHxFBeYoU-0v7BUYdFtcYEWnirX_0 2024-04-03T05:14:09.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10624172370274623738', time=2024-04-03T06:27:57.899213+0000, chain.objs.size()=1 2024-04-03T05:14:09.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rV0glOIvdCUS5xK9fqkRoHoJ7r3h6oe_0 2024-04-03T05:14:09.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16742751145837707502', time=2024-04-03T06:27:57.981881+0000, chain.objs.size()=1 2024-04-03T05:14:09.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vCogvChlzIaK3vy6soliVwVIDnS-gJx_0 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5002295631767716328', time=2024-04-03T06:27:58.241215+0000, chain.objs.size()=1 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.A28mLZTiupI74JChugGkZwdAtmTHvkO_0 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.923756298613929795', time=2024-04-03T06:28:00.677708+0000, chain.objs.size()=1 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ttfu9ul4FfcmAvIbqXxtMWfl-ZwFK08_0 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11281740861639303596', time=2024-04-03T06:28:00.935860+0000, chain.objs.size()=1 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.790i9mQx16_m_VTAXHyEUC74WC_KcE6_0 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15507695833700899158', time=2024-04-03T06:28:01.354840+0000, chain.objs.size()=1 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.89JjZM3RytXs9nO5c2FDNQpPP3S-Bd8_0 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12458320664157537958', time=2024-04-03T06:28:02.950600+0000, chain.objs.size()=1 2024-04-03T05:14:09.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sj4IRpU3gVeb5JJfg9y48uQL9nYlI4r_0 2024-04-03T05:14:09.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12315120478444200993', time=2024-04-03T06:28:06.089102+0000, chain.objs.size()=1 2024-04-03T05:14:09.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.705+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.AXU2v3504vryWGjw0_YBngzED7MEOz0_0 2024-04-03T05:14:09.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5149365484447567397', time=2024-04-03T06:28:06.090456+0000, chain.objs.size()=1 2024-04-03T05:14:09.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.2ARF8m_v0tjXyAlVAY9IL4H3WgSHE9o_0 2024-04-03T05:14:09.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.709+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17860301542535493792', time=2024-04-03T06:28:06.317144+0000, chain.objs.size()=1 2024-04-03T05:14:09.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.709+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.L6AqsS6huPVsLGjMiW6nlSPNqAiTG0D_0 2024-04-03T05:14:09.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15808798036179727672', time=2024-04-03T06:28:08.703104+0000, chain.objs.size()=1 2024-04-03T05:14:09.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nsUMBf73Y_4GjPkOBcDK0VIyztegemL_0 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10473679928010083176', time=2024-04-03T06:28:09.833959+0000, chain.objs.size()=1 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ovs2w_pO19JVwtEGkFFTeqc8wLSaLhC_0 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8454065998070629870', time=2024-04-03T06:28:10.582833+0000, chain.objs.size()=1 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cU_wKiOy7sGnqN0_TXiSRNHzZt0c0cA_0 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18154334663152712634', time=2024-04-03T06:28:11.649545+0000, chain.objs.size()=1 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.z9aQtl6TgFQPKmVKTpP3KTSo21pfFKc_0 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8963850229927225990', time=2024-04-03T06:28:13.641224+0000, chain.objs.size()=1 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6wg65KmwCBjU50rmTT7xkYnPe6WovN7_0 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6819453018030493844', time=2024-04-03T06:28:13.950483+0000, chain.objs.size()=1 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.VF1ZXSW3CBYub5JU6i-WEDhPjowswMm_0 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8894263387606606081', time=2024-04-03T06:28:15.229657+0000, chain.objs.size()=1 2024-04-03T05:14:09.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vUr73A35zQBbd56HgXiq7JPVtECPwOJ_0 2024-04-03T05:14:09.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5529174933606438270', time=2024-04-03T06:28:15.714833+0000, chain.objs.size()=1 2024-04-03T05:14:09.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JvajDCK2WPsd1kDEqEUQ6jr37jnxJLq_0 2024-04-03T05:14:09.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.411369390698166353', time=2024-04-03T06:28:16.557757+0000, chain.objs.size()=1 2024-04-03T05:14:09.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OQJu8OfbSOQBYBNR2iQWoZ266-5bHTb_0 2024-04-03T05:14:09.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14398856059621094764', time=2024-04-03T06:28:16.561806+0000, chain.objs.size()=1 2024-04-03T05:14:09.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oqxtSsoa0azI9V01H25BSxsjxfmyrl9_0 2024-04-03T05:14:09.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14596386741920892500', time=2024-04-03T06:28:17.236261+0000, chain.objs.size()=1 2024-04-03T05:14:09.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.713+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cvtGgnpDRV_xTjHdueLF8_teHdRShtP_0 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7918041221952163544', time=2024-04-03T06:28:17.609926+0000, chain.objs.size()=1 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.I6zk3e5MFStwZg0-krQYdpJJ9N294lV_0 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4100934616791774173', time=2024-04-03T06:28:17.682066+0000, chain.objs.size()=1 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Rpd72kQj8AsP0UrkfgI7iuVzDd_iV0y_0 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9863758271866572945', time=2024-04-03T06:28:19.568056+0000, chain.objs.size()=1 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sy7v5z57CdmljroMLj0vnhRKRol6fX5_0 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12859817054667443075', time=2024-04-03T06:28:20.658725+0000, chain.objs.size()=1 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3QFBTbFb1AsaRsr8QFDIeVv9_FVV-Gf_0 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5020910773438091335', time=2024-04-03T06:28:20.803778+0000, chain.objs.size()=1 2024-04-03T05:14:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cm-Z2g9YnHmM1TGqJAfDApa2axiWvHp_0 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10933710504293456400', time=2024-04-03T06:28:21.100741+0000, chain.objs.size()=1 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oVw_EJKWm-G8S9Xw-rCWBMpvvebuKyI_0 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16013739495580730075', time=2024-04-03T06:28:50.682842+0000, chain.objs.size()=1 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.245__shadow_.dyKOETU5BwraU93AD-GgtGZd8aQOK99_0 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11312418060232323484', time=2024-04-03T06:29:30.908562+0000, chain.objs.size()=1 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.t5BrsNn2CV0nKSvor-Ou5Lzq6INZfV7_0 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4702885105590852582', time=2024-04-03T06:29:35.889874+0000, chain.objs.size()=1 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.MvIW4pzE2Honh2rOfycVRb4zjxR1rKU_0 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6834214751460267604', time=2024-04-03T06:29:36.112456+0000, chain.objs.size()=1 2024-04-03T05:14:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.tp6bemWNjOnpnUo8Wi1yE5zyiR_r3xX_0 2024-04-03T05:14:09.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13654871349004715240', time=2024-04-03T06:29:47.431537+0000, chain.objs.size()=1 2024-04-03T05:14:09.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.717+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.267__shadow_.uo4itPzHAtjrvtDfiU1eHIyZjbQq__f_0 2024-04-03T05:14:09.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6052543755109447594', time=2024-04-03T06:29:54.130293+0000, chain.objs.size()=1 2024-04-03T05:14:09.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.270__shadow_.HiYZ_amFTJNMHOiNz9URTHDbnUAGp8O_0 2024-04-03T05:14:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6349925035093121790', time=2024-04-03T06:30:02.972271+0000, chain.objs.size()=1 2024-04-03T05:14:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.274__shadow_.0K6_vU9FqRPfbOBNUxLzdOcbOV8mz0D_0 2024-04-03T05:14:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11034078640996554466', time=2024-04-03T06:30:41.757649+0000, chain.objs.size()=1 2024-04-03T05:14:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.288__shadow:Yv1yld.sI5c0bjOz7XDev8lmzyU8DnH_.m2IJoIddyFhSmBaA_bOkaUAsPlRzFVR_0 2024-04-03T05:14:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11261645909619189054', time=2024-04-03T06:32:24.832965+0000, chain.objs.size()=1 2024-04-03T05:14:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Pr3tOcI7LDjdXZj_hY-lvAgCYvJkMV5_0 2024-04-03T05:14:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4868172556804686139', time=2024-04-03T06:32:25.577817+0000, chain.objs.size()=1 2024-04-03T05:14:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.T8ymmGtl94dYcDkadXxeAqyYVdE5zTU_0 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6546005304176881108', time=2024-04-03T06:32:26.289937+0000, chain.objs.size()=1 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BPaeapTF_5ISVtGQGrAelcflXnDQCYZ_0 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2052039939083973220', time=2024-04-03T06:32:26.414564+0000, chain.objs.size()=1 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.QlGfRf4g2R_Cn1_T22U7A3ZO-VtunIy_0 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5774951309546280990', time=2024-04-03T06:32:28.933687+0000, chain.objs.size()=1 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.M4G81bU3Beof35_IOMhSrQSRoEzScVX_0 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3911442844738231757', time=2024-04-03T06:32:29.343385+0000, chain.objs.size()=1 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.kAGH2XWZ4m9md_m6UoomFmdQGPbZyMf_0 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9864363394544269703', time=2024-04-03T06:32:30.339545+0000, chain.objs.size()=1 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.kDZDxf4sdzVvEEsv_ipq4m7VKGO2GQw_0 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4115303394146139828', time=2024-04-03T06:32:32.403108+0000, chain.objs.size()=1 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.h-QWl2uZUJGTUDZV40oe1nqdl96lfFq_0 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4008497922969745142', time=2024-04-03T06:32:33.120017+0000, chain.objs.size()=1 2024-04-03T05:14:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.721+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-ZVz7kZYKxY_6jkaxgnA7qNHkb1oL6O_0 2024-04-03T05:14:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.725+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18242248736052941134', time=2024-04-03T06:32:33.303527+0000, chain.objs.size()=1 2024-04-03T05:14:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.725+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.phkJPDgIjkNM3YCvXn-jhgoTtmAOI1i_0 2024-04-03T05:14:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.725+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12801100994933109945', time=2024-04-03T06:32:33.894894+0000, chain.objs.size()=1 2024-04-03T05:14:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.725+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6dmME59VXyi_w_yUM_Ebg1oFtimZ_LK_0 2024-04-03T05:14:09.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.725+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2087862735595239833', time=2024-04-03T06:32:34.146116+0000, chain.objs.size()=1 2024-04-03T05:14:09.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.725+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.fpqzuMzZl_E7ZSAQpKGETnwTEzpPQHw_0 2024-04-03T05:14:09.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.725+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15844593469240205353', time=2024-04-03T06:32:34.355024+0000, chain.objs.size()=1 2024-04-03T05:14:09.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.725+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.PTBUydTEtxkUqmvV_jLo9OeD4MT-hjh_0 2024-04-03T05:14:09.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15829870940578684755', time=2024-04-03T06:32:36.038850+0000, chain.objs.size()=1 2024-04-03T05:14:09.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cIrhVsoFI2mHuD5oKPfVRhorVU__cQR_0 2024-04-03T05:14:09.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14448695787012490706', time=2024-04-03T06:32:36.723947+0000, chain.objs.size()=1 2024-04-03T05:14:09.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2pbjBCkg5jeF4ky8Tx2YJbtz8IA0Gg5_0 2024-04-03T05:14:09.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7938222327395468346', time=2024-04-03T06:32:39.711607+0000, chain.objs.size()=1 2024-04-03T05:14:09.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BfasUzsqSlLyQq-VKmF3kw7SMATPbYr_0 2024-04-03T05:14:09.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9246845754417969920', time=2024-04-03T06:32:40.181101+0000, chain.objs.size()=1 2024-04-03T05:14:09.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Wy5mXjhZajzbaKcbWWFqtM3HPD-Ng-9_0 2024-04-03T05:14:09.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15839090694751597956', time=2024-04-03T06:32:41.834119+0000, chain.objs.size()=1 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1bHuOVWWbLTBgcFSfIXauTLHtjDIcJy_0 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12965785866109799902', time=2024-04-03T06:32:42.081147+0000, chain.objs.size()=1 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0VnY9V5HCuq1n3a3t_XYFrF0ncaMDzs_0 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7408281523140759302', time=2024-04-03T06:32:44.287665+0000, chain.objs.size()=1 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Oo_eOCuwLK_610t3ysw9JXp3eSgdxmC_0 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14377557933964612047', time=2024-04-03T06:32:44.689403+0000, chain.objs.size()=1 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Zp-1Sy3JpmPpfsPfufG7iFCiit5725G_0 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13766388021707690199', time=2024-04-03T06:32:45.636516+0000, chain.objs.size()=1 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-fC2jmI4FqEjWmOcx1KefWFtLOSjwS7_0 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4887762463963248241', time=2024-04-03T06:32:45.640161+0000, chain.objs.size()=1 2024-04-03T05:14:09.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EBObbjc3hc-mQ8nMz48bND7_PIdWOKu_0 2024-04-03T05:14:09.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.132525549375942653', time=2024-04-03T06:32:46.518845+0000, chain.objs.size()=1 2024-04-03T05:14:09.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.729+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lqejTyd04Mc5qZn76crep6ZoY_JCEZI_0 2024-04-03T05:14:09.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5667034393067867571', time=2024-04-03T06:32:50.383703+0000, chain.objs.size()=1 2024-04-03T05:14:09.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.C-onrrpA6Anl8xnmsVihVcUtff80-qQ_0 2024-04-03T05:14:09.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11338057862717421052', time=2024-04-03T06:32:51.209966+0000, chain.objs.size()=1 2024-04-03T05:14:09.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qXz88ObZy-bLYkS4w1bA1q6Ng9xgejV_0 2024-04-03T05:14:09.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7458516963998145001', time=2024-04-03T06:32:52.213450+0000, chain.objs.size()=1 2024-04-03T05:14:09.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gNXa4kHoNztVLZPFJioc48KfldlpSj9_0 2024-04-03T05:14:09.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11330448952929421699', time=2024-04-03T06:34:28.810615+0000, chain.objs.size()=1 2024-04-03T05:14:09.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.WxFogkSFE_anbdW_X_g5w3MMrMoTY6S_0 2024-04-03T05:14:09.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.772872263936768783', time=2024-04-03T06:34:29.265721+0000, chain.objs.size()=1 2024-04-03T05:14:09.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.RH_m2_r7olu7eg2tG3rxc47bp3Ij1L-_0 2024-04-03T05:14:09.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9388911254579385786', time=2024-04-03T06:34:33.450808+0000, chain.objs.size()=1 2024-04-03T05:14:09.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KJ37BKLQaIQKwuGDU3U3EBVL0Bv_6jC_0 2024-04-03T05:14:09.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10096673246117604253', time=2024-04-03T06:34:35.272728+0000, chain.objs.size()=1 2024-04-03T05:14:09.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5nbOhpMWE_dCI8p59gPpX3PExc0hGUN_0 2024-04-03T05:14:09.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17119719428274586332', time=2024-04-03T06:34:40.859363+0000, chain.objs.size()=1 2024-04-03T05:14:09.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.A53YMJATRs1sYAZ4_jM5p7zdTwE3aWK_0 2024-04-03T05:14:09.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18057309989232596017', time=2024-04-03T06:34:41.455263+0000, chain.objs.size()=1 2024-04-03T05:14:09.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VZasNu526uaPBvblZrP_c6kgjiVcaL6_0 2024-04-03T05:14:09.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6287259024087839151', time=2024-04-03T06:34:41.530323+0000, chain.objs.size()=1 2024-04-03T05:14:09.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Invis-Jwy1sdJ3vxqc2dDz_E3lliN7H_0 2024-04-03T05:14:09.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10549565423519745871', time=2024-04-03T06:34:41.936848+0000, chain.objs.size()=1 2024-04-03T05:14:09.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.733+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.jNWLJs-WydV0EkMofmJQh91ixGGIbbk_0 2024-04-03T05:14:09.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.83850057142717896', time=2024-04-03T06:34:41.952719+0000, chain.objs.size()=1 2024-04-03T05:14:09.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.u8DP4nZ7jeXSHnPCyEh3bVZ-n5y5gze_0 2024-04-03T05:14:09.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2682091117709890387', time=2024-04-03T06:34:42.579339+0000, chain.objs.size()=1 2024-04-03T05:14:09.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nn0ZVV-QNQpNZn9LxSTJXXIN_uDn8E5_0 2024-04-03T05:14:09.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12773310281764158565', time=2024-04-03T06:34:44.606420+0000, chain.objs.size()=1 2024-04-03T05:14:09.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zKmxEtPWegIv2kKwtYE2KDPSB9lSQZx_0 2024-04-03T05:14:09.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9082969165904315073', time=2024-04-03T06:34:45.352240+0000, chain.objs.size()=1 2024-04-03T05:14:09.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.iYPDYPOY8qR8-1pkEg5sYXD9sbjD6EL_0 2024-04-03T05:14:09.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1047554120530782407', time=2024-04-03T06:34:46.376831+0000, chain.objs.size()=1 2024-04-03T05:14:09.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vprRqW7mzzBItbNaRZy7lDdC0ZWvTvu_0 2024-04-03T05:14:09.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4865608069746074516', time=2024-04-03T06:34:46.521744+0000, chain.objs.size()=1 2024-04-03T05:14:09.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.77m3M-3rSrvDLzjv2T78JGL5MI254T5_0 2024-04-03T05:14:09.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.535224245932049739', time=2024-04-03T06:34:47.952147+0000, chain.objs.size()=1 2024-04-03T05:14:09.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.i06wKrUKEIZSKMtDPTk1O_4pQqlD1wI_0 2024-04-03T05:14:09.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3947582206438775553', time=2024-04-03T06:34:48.581448+0000, chain.objs.size()=1 2024-04-03T05:14:09.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.L2HRD1zDbf4Y6XQyOlQ6WTX9pFz4M3y_0 2024-04-03T05:14:09.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14860763733838046135', time=2024-04-03T06:34:50.801157+0000, chain.objs.size()=1 2024-04-03T05:14:09.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.737+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.RCNaaaw9NO_qCqLrbm4C5VJq5WD6Omm_0 2024-04-03T05:14:09.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1926665617756968395', time=2024-04-03T06:34:50.974719+0000, chain.objs.size()=1 2024-04-03T05:14:09.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IpgrqWotNXzIDtx2UG5z8mhOX9jfrOo_0 2024-04-03T05:14:09.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8372311220612530821', time=2024-04-03T06:34:52.076917+0000, chain.objs.size()=1 2024-04-03T05:14:09.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.NOX3JptAXsBQNMwUeaWOvAC-snhKxII_0 2024-04-03T05:14:09.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17573049800996678953', time=2024-04-03T06:34:54.745345+0000, chain.objs.size()=1 2024-04-03T05:14:09.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2_tVSgeQUhDsqPltSn7rvS-ULEwI28B_0 2024-04-03T05:14:09.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8065050414186718722', time=2024-04-03T06:34:55.695707+0000, chain.objs.size()=1 2024-04-03T05:14:09.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.FzciQRX9yS4G0CN9VnqXB70P74qV-x0_0 2024-04-03T05:14:09.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4902709492322125459', time=2024-04-03T06:34:56.593211+0000, chain.objs.size()=1 2024-04-03T05:14:09.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.oHcZg8iKNijiotZqDKFBFygUYywDhiz_0 2024-04-03T05:14:09.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11578172482562603526', time=2024-04-03T06:35:11.316033+0000, chain.objs.size()=1 2024-04-03T05:14:09.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.301__shadow_.h1z8CDOi6l6x5FhI9Fk-cdCVklLCLff_0 2024-04-03T05:14:09.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6994030601302086318', time=2024-04-03T06:35:30.397291+0000, chain.objs.size()=1 2024-04-03T05:14:09.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.741+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.310__shadow_.X6djg-ogJAtwvq4ylFK45GQvj_Hq5am_0 2024-04-03T05:14:09.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/54049 2024-04-03T05:14:09.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-04-03T05:14:09.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15956654797450621949', time=2024-04-03T06:35:37.982240+0000, chain.objs.size()=1 2024-04-03T05:14:09.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.314__shadow_.I1WVqDNSHx0ObT8k-9_cqhrQ4zhJoSM_0 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.249353254842078451', time=2024-04-03T06:36:48.160952+0000, chain.objs.size()=1 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.352__shadow_.IoTJK-zE1LUwWSpJMbqw19tqXezSsX4_0 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13438404729269356098', time=2024-04-03T06:38:38.152820+0000, chain.objs.size()=1 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.408__shadow_.Fq5QLVNkx1DeawuhexqlrPgWJo4eEWH_0 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7846092142018111905', time=2024-04-03T06:47:32.551478+0000, chain.objs.size()=6 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.5Ud1fMwyWhzGzc2Str-zbehFcDJ_D_WH.1 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.H1fAIX_spuVVbBBVCIlsuKUtsVv0Reci.2 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.lj4gD5TR2dHrSNpJcqlzft6kAk_HaeWQ.3 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.n7YS4-rv6BwkfBXrir7cYtsiG4sqs-_B.4 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.UEUFsmVmRqmaMfPCj3ZPFcJaMQMNLwXl.5 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart._O4a3P1cLCpKd6sTohulSwEqFOP1rG1d.6 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4511929917205995220', time=2024-04-03T06:50:51.914864+0000, chain.objs.size()=1 2024-04-03T05:14:09.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.520__shadow_.Gm_9M6xRl_8oKETXk3zwNsCG7ALLZnS_0 2024-04-03T05:14:09.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7235131576695383922', time=2024-04-03T06:51:39.883440+0000, chain.objs.size()=1 2024-04-03T05:14:09.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.525__shadow_.EqIx7_L3_a6y0yzU1EhpfgqqJAF7MUz_0 2024-04-03T05:14:09.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1957364602742083968', time=2024-04-03T06:52:50.709540+0000, chain.objs.size()=1 2024-04-03T05:14:09.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.749+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:3h00jtLepbkhqHzGveacesx.6QsVbb4_.FlW8TOhLOeX9ni27fzAJ6aOPkmofs42_0 2024-04-03T05:14:09.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15943370943767663671', time=2024-04-03T06:53:03.036352+0000, chain.objs.size()=1 2024-04-03T05:14:09.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.539__shadow:CCvvg4mE9iV8XMsJDckH3HFOE6QZuYF_.LO5Yw94HrY2snwxKBDD9IZUBy_0zdrK_0 2024-04-03T05:14:09.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15601447532245403145', time=2024-04-03T06:54:04.940045+0000, chain.objs.size()=1 2024-04-03T05:14:09.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:c8USycqdxJwRYOlxcVKEsg0DwpE0z2K_.Cahx4eg_MludpqPQphV3apUf-y5XMN1_0 2024-04-03T05:14:09.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11782867651579135912', time=2024-04-03T06:55:48.953070+0000, chain.objs.size()=1 2024-04-03T05:14:09.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.556__shadow:Wx6y6h9Ysv92PNR0A1sH-MtxxfzuIAq_.1lbUiCpdVPUe51Wx5QrfiHPODHRUmx1_0 2024-04-03T05:14:09.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.645913920505524886', time=2024-04-03T06:56:26.109576+0000, chain.objs.size()=1 2024-04-03T05:14:09.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.576__shadow_.a1BwQvGvj7jvIxBAO3UA_7asy0FVUjT_0 2024-04-03T05:14:09.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.683__shadow_.83wnpTlBpVb3u0OFrb4nfP0PP20Pqps_1_2a1c2f6ff0af5c5a7e89dfa9d05b8633', time=2024-04-03T07:05:41.252985+0000, chain.objs.size()=1 2024-04-03T05:14:09.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.753+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.683__shadow_.83wnpTlBpVb3u0OFrb4nfP0PP20Pqps_0 2024-04-03T05:14:09.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.757+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.761+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-03T05:14:09.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44259' 2024-04-03T05:14:09.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_pbWKCymHRwgROhKZR8ji2w8TSbUOLOc', time=2024-04-03T06:22:14.785161+0000, chain.objs.size()=3 2024-04-03T05:14:09.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.lVDR6ix-eQXXhDhD9oitvqzvnUXIG4h_0 2024-04-03T05:14:09.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.lVDR6ix-eQXXhDhD9oitvqzvnUXIG4h_1 2024-04-03T05:14:09.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.lVDR6ix-eQXXhDhD9oitvqzvnUXIG4h_2 2024-04-03T05:14:09.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_jEQtf6ZIXnLI8-RJ4-gwS1JwHTx_BVS', time=2024-04-03T06:22:26.623980+0000, chain.objs.size()=3 2024-04-03T05:14:09.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.ilHsoL2yBRIHVbd9A8GW01tfjUP85Ws_0 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.ilHsoL2yBRIHVbd9A8GW01tfjUP85Ws_1 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.ilHsoL2yBRIHVbd9A8GW01tfjUP85Ws_2 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6220898350222958284', time=2024-04-03T06:23:20.403343+0000, chain.objs.size()=1 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.160__shadow_.WUxuDsxyDfW61CmG_C_7GqPohgAvLbw_0 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1627655024884484551', time=2024-04-03T06:25:24.397462+0000, chain.objs.size()=1 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.207__shadow_.rU25GeIAx2KWKtSax6rAZSjD3eJ2r_3_0 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6695313612544052987', time=2024-04-03T06:25:36.138234+0000, chain.objs.size()=1 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.212__shadow_.AAPeBw0b48gpy9lCYlJcK0goFJywmJ4_0 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4356121172212198963', time=2024-04-03T06:25:36.170388+0000, chain.objs.size()=1 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.212__shadow_.sUkI8BTS_RMEWIYpK7nTkEl-mS15vLl_0 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7522715974644403885', time=2024-04-03T06:26:16.977322+0000, chain.objs.size()=1 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.230__shadow_.0lBw_aIP23hsOcGUZMfhGGsV-eClh1F_0 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16822580964019632393', time=2024-04-03T06:27:53.695415+0000, chain.objs.size()=1 2024-04-03T05:14:09.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.765+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4ckAnXGXuRnwGw10i47Yj-NSFa1oRrc_0 2024-04-03T05:14:09.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4297160106298666710', time=2024-04-03T06:27:54.187227+0000, chain.objs.size()=1 2024-04-03T05:14:09.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DGwcBu2C3N03jtumYjV_qXe7t3tJs-v_0 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1802425674889319890', time=2024-04-03T06:27:55.018139+0000, chain.objs.size()=1 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yAh_PZHmX-gqE7_5I2OZlLwmCm_5D9J_0 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17572746129400104776', time=2024-04-03T06:27:57.357740+0000, chain.objs.size()=1 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eeGcF1-sI-K-tT54v_USAvzl7TI1CXk_0 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14942919129653169593', time=2024-04-03T06:27:58.433722+0000, chain.objs.size()=1 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BUwEJErcYpUGAjGjKk60FduT8xj_AAI_0 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8472692396938379503', time=2024-04-03T06:28:01.003668+0000, chain.objs.size()=1 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.r1M5HxCxyDq6rC9xA6Pu8FS7c3jJZtO_0 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2184273984600908394', time=2024-04-03T06:28:01.997718+0000, chain.objs.size()=1 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.d3Sxodp2pnK5_s-rp2GvSMhEuWm4VCb_0 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6035723852950366474', time=2024-04-03T06:28:01.999251+0000, chain.objs.size()=1 2024-04-03T05:14:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ODjtI0wdCgZRWU27DSMjlXTrx1ZMVDe_0 2024-04-03T05:14:09.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5740853439086492944', time=2024-04-03T06:28:02.468356+0000, chain.objs.size()=1 2024-04-03T05:14:09.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jFzczhihIFfzV3GKjjwmlI3t7qEUKb2_0 2024-04-03T05:14:09.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13013693259708466084', time=2024-04-03T06:28:02.583470+0000, chain.objs.size()=1 2024-04-03T05:14:09.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7E8s8buU8d61DK_bjTGVxP2plEo2IOG_0 2024-04-03T05:14:09.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7371975944905119694', time=2024-04-03T06:28:05.573278+0000, chain.objs.size()=1 2024-04-03T05:14:09.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.EUAYxuN3s4Azaj0FGAA0wjsZ_D4a3HK_0 2024-04-03T05:14:09.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7670392865572338982', time=2024-04-03T06:28:05.600691+0000, chain.objs.size()=1 2024-04-03T05:14:09.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.769+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4bagVCK2J_aPhvQut1D0KR4fBNVf2YZ_0 2024-04-03T05:14:09.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2152711816103659959', time=2024-04-03T06:28:05.824141+0000, chain.objs.size()=1 2024-04-03T05:14:09.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dO0OvN6FB_n5ltbxcY8GBZJLDDMYBPh_0 2024-04-03T05:14:09.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16294565000928572592', time=2024-04-03T06:28:06.854711+0000, chain.objs.size()=1 2024-04-03T05:14:09.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ikTGzgfNTQGS7gCXg0NzcAumwZk_01S_0 2024-04-03T05:14:09.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11226105827247575791', time=2024-04-03T06:28:08.408136+0000, chain.objs.size()=1 2024-04-03T05:14:09.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.m8L3CFCfbvAS1S049Rq_xDXmRO6ZzJZ_0 2024-04-03T05:14:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16572265433552018301', time=2024-04-03T06:28:09.757362+0000, chain.objs.size()=1 2024-04-03T05:14:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ZUDvI_tpSX04zRebm9IxOsGzNJ_uceb_0 2024-04-03T05:14:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12802494014052041485', time=2024-04-03T06:28:09.759085+0000, chain.objs.size()=1 2024-04-03T05:14:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.HS4tPxTVj41Q_DsW_MPTkvRpoMIOcZd_0 2024-04-03T05:14:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4906452104571838271', time=2024-04-03T06:28:09.938709+0000, chain.objs.size()=1 2024-04-03T05:14:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xsMOQNn0SXOFayXSfowkAsK8ZFamxel_0 2024-04-03T05:14:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11148037122647262970', time=2024-04-03T06:28:11.489171+0000, chain.objs.size()=1 2024-04-03T05:14:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oMm9MKF0XvfUZmWtxZS27odFir2OrJs_0 2024-04-03T05:14:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9753548499219363320', time=2024-04-03T06:28:11.854777+0000, chain.objs.size()=1 2024-04-03T05:14:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.I7-vIEVK96chtMPFNi_lVkiNVdk7H0Y_0 2024-04-03T05:14:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7153067492599522024', time=2024-04-03T06:28:12.244442+0000, chain.objs.size()=1 2024-04-03T05:14:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BYvtg9gcVbQhyPcxgIOfHFEaMq3bW9P_0 2024-04-03T05:14:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11341793139105586416', time=2024-04-03T06:28:13.178394+0000, chain.objs.size()=1 2024-04-03T05:14:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.hExZUNKRoRXFxlV4YnUNjKL3JbHgz_D_0 2024-04-03T05:14:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18139841483244588336', time=2024-04-03T06:28:13.560141+0000, chain.objs.size()=1 2024-04-03T05:14:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.773+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Z_OOm8HFRJm-kT5s3dSXP_Ai8DZp9d0_0 2024-04-03T05:14:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9008816930895389038', time=2024-04-03T06:28:13.879156+0000, chain.objs.size()=1 2024-04-03T05:14:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.NvOg-JRhLsl1npJnvT2GN37idzIXtRk_0 2024-04-03T05:14:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1241190555573881001', time=2024-04-03T06:28:13.882222+0000, chain.objs.size()=1 2024-04-03T05:14:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lBITtbUc8ak2on8ScpLTbKpFWNC-NAM_0 2024-04-03T05:14:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.777+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13463758229141543353', time=2024-04-03T06:28:15.096296+0000, chain.objs.size()=1 2024-04-03T05:14:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.777+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6LlX6Xa3HC_vulBOFzL7INUfMAc_TXz_0 2024-04-03T05:14:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7844095488439314342', time=2024-04-03T06:28:15.113594+0000, chain.objs.size()=1 2024-04-03T05:14:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.PnWZUF4AWO2AEevke4QGlGPhGkAd6F9_0 2024-04-03T05:14:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9720095151628066417', time=2024-04-03T06:28:15.156112+0000, chain.objs.size()=1 2024-04-03T05:14:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.YuoISRiVoBcxcscfVYUKGzHzOt_QPx7_0 2024-04-03T05:14:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11799699704295780106', time=2024-04-03T06:28:16.566421+0000, chain.objs.size()=1 2024-04-03T05:14:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DUzt81OYoZDbutLeSttZfSa2zcRRCfF_0 2024-04-03T05:14:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12434740162134452869', time=2024-04-03T06:28:16.567624+0000, chain.objs.size()=1 2024-04-03T05:14:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.uKU3RymoL6X8XjV5JcJH5siSwFuvqUf_0 2024-04-03T05:14:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11998908829999734418', time=2024-04-03T06:28:16.889604+0000, chain.objs.size()=1 2024-04-03T05:14:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tv-SWp8c5HAPZrm4aYZRdI5IMP9N-aw_0 2024-04-03T05:14:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17148461505619288466', time=2024-04-03T06:28:17.912004+0000, chain.objs.size()=1 2024-04-03T05:14:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.KUhX5Kwdpp2Djf0Dg-Ucf3JuosClspW_0 2024-04-03T05:14:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18323907640500816451', time=2024-04-03T06:28:18.694190+0000, chain.objs.size()=1 2024-04-03T05:14:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.j7yxzic6qy1l6h8zznDk_tvqVqdp3Uk_0 2024-04-03T05:14:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13979344558394920529', time=2024-04-03T06:28:19.028948+0000, chain.objs.size()=1 2024-04-03T05:14:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.puJwCgLFBLdkZFEAr0Bg87_X6d2lpTB_0 2024-04-03T05:14:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14812582533931605647', time=2024-04-03T06:28:20.054670+0000, chain.objs.size()=1 2024-04-03T05:14:09.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6aySf41ZtVYZBhkOhE77GLe_ZBaFS_v_0 2024-04-03T05:14:09.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8459208230855666744', time=2024-04-03T06:28:20.089479+0000, chain.objs.size()=1 2024-04-03T05:14:09.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QCbImrwJQf3Wl8VNfBBDxhMMbCz2H9P_0 2024-04-03T05:14:09.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1871233874348140188', time=2024-04-03T06:28:57.345350+0000, chain.objs.size()=1 2024-04-03T05:14:09.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.781+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.248__shadow_.5h1woJSWTwd9Ky7BKYcA-grMCi-Xjfs_0 2024-04-03T05:14:09.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9484955753457674201', time=2024-04-03T06:29:01.723039+0000, chain.objs.size()=1 2024-04-03T05:14:09.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.250__shadow_.6O988W5im2b1f9ueKGmqrT2OFXAdevB_0 2024-04-03T05:14:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17999851396241100614', time=2024-04-03T06:29:18.201745+0000, chain.objs.size()=1 2024-04-03T05:14:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.257__shadow_.R5-kR5KBP_YcIocfp9NFEtz7z7YrTtt_0 2024-04-03T05:14:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.785+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13301371056747187923', time=2024-04-03T06:29:30.631224+0000, chain.objs.size()=1 2024-04-03T05:14:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.785+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_._te66d29ritl41VXyOOVFSqLKW1scev_0 2024-04-03T05:14:09.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8802565908538059581', time=2024-04-03T06:29:35.941151+0000, chain.objs.size()=1 2024-04-03T05:14:09.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.lBr0eoABg4hEY2nA4XUpj7RyO8uKitF_0 2024-04-03T05:14:09.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11062793797275560986', time=2024-04-03T06:29:45.145629+0000, chain.objs.size()=1 2024-04-03T05:14:09.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.266__shadow_.sbmlQ9qTGZKxrP6_zthkZkANk4SePbL_0 2024-04-03T05:14:09.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17831062797728506371', time=2024-04-03T06:30:45.130533+0000, chain.objs.size()=1 2024-04-03T05:14:09.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.290__shadow_.EvsvmIdmge9CGPevZgoS-zG71Em8gOm_0 2024-04-03T05:14:09.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13476385980633551106', time=2024-04-03T06:32:25.263093+0000, chain.objs.size()=1 2024-04-03T05:14:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.J05J9vlqnzKUp82WcYaKIuENB5nV19t_0 2024-04-03T05:14:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8420335975110953453', time=2024-04-03T06:32:26.762194+0000, chain.objs.size()=1 2024-04-03T05:14:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zWRswOQKqzc_ySkXM8yIPuJgnoJO3kT_0 2024-04-03T05:14:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4309890463214835156', time=2024-04-03T06:32:26.831003+0000, chain.objs.size()=1 2024-04-03T05:14:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CRV74IG54wp5n1i6NqoAVrHUilOzZYB_0 2024-04-03T05:14:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8092870749976918784', time=2024-04-03T06:32:28.085462+0000, chain.objs.size()=1 2024-04-03T05:14:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7muxVsq3wRSJZLQvY8P5km_RXD3CRBK_0 2024-04-03T05:14:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2514559912925118469', time=2024-04-03T06:32:28.394787+0000, chain.objs.size()=1 2024-04-03T05:14:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.789+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ec8GcNXhOxy_cKMO0LQubWrNkE8m1Vb_0 2024-04-03T05:14:09.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9785720493420283777', time=2024-04-03T06:32:28.961225+0000, chain.objs.size()=1 2024-04-03T05:14:09.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.J7d0ZP7mXGifFwkqUdtcsNM031t2n4q_0 2024-04-03T05:14:09.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3312168379876309692', time=2024-04-03T06:32:30.751464+0000, chain.objs.size()=1 2024-04-03T05:14:09.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.47ebn6kwjwcF1tssDRqTSEFAA4Jj3E8_0 2024-04-03T05:14:09.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10719221893537961875', time=2024-04-03T06:32:31.644842+0000, chain.objs.size()=1 2024-04-03T05:14:09.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2sH4pBtS4_SXYVvCtw-vBLI4fUb9Fge_0 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11604770731679945842', time=2024-04-03T06:32:34.221322+0000, chain.objs.size()=1 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9T0gzkXAwVO2AM7pc49jmkKcZlYrR_9_0 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17880041244293154003', time=2024-04-03T06:32:37.652724+0000, chain.objs.size()=1 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RwzpnMdNAi4WxXnmVNDbPry-0wh0xnS_0 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4508878557434647637', time=2024-04-03T06:32:38.336526+0000, chain.objs.size()=1 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BNyfk3WIl6V3GIKjZ525KxqwdIjn6pf_0 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.113985333996389622', time=2024-04-03T06:32:38.378383+0000, chain.objs.size()=1 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cHoPxRvzi63BGKqx0jyUTvE8pQ0fp4K_0 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12949436848522598963', time=2024-04-03T06:32:41.082695+0000, chain.objs.size()=1 2024-04-03T05:14:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.LqYxxDs-gWVT4fG1F1GGr01XroVhqUn_0 2024-04-03T05:14:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17274829161870897477', time=2024-04-03T06:32:41.416103+0000, chain.objs.size()=1 2024-04-03T05:14:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zYqGUEXzjqYS4ComCupkjJQIk1zgrzf_0 2024-04-03T05:14:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14009788836941290778', time=2024-04-03T06:32:41.793750+0000, chain.objs.size()=1 2024-04-03T05:14:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.3y2rHGF6M4m9_ZT8UOiXmAEk4yCPTsn_0 2024-04-03T05:14:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14860511402534801829', time=2024-04-03T06:32:43.871095+0000, chain.objs.size()=1 2024-04-03T05:14:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.793+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uEDqgY0NZHoFOPLuusrxEfTmYgs_FnL_0 2024-04-03T05:14:09.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15826787359710540360', time=2024-04-03T06:32:44.635085+0000, chain.objs.size()=1 2024-04-03T05:14:09.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OI_cqidy1kCgvRXzwAOsogWkyit8GFF_0 2024-04-03T05:14:09.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2828175375056786688', time=2024-04-03T06:32:46.429607+0000, chain.objs.size()=1 2024-04-03T05:14:09.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6y32nArl5Dm8HtY7r1zXgmZcT0gtxYn_0 2024-04-03T05:14:09.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.797+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5734625176667298592', time=2024-04-03T06:32:46.834794+0000, chain.objs.size()=1 2024-04-03T05:14:09.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.797+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uiYrG0AxGFcS_-JTT5Pn4OwyqSR7vb0_0 2024-04-03T05:14:09.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5891350434051977060', time=2024-04-03T06:32:46.883086+0000, chain.objs.size()=1 2024-04-03T05:14:09.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DlUOGQdLtlAgqu6xg9B5gZh6UvkhNPZ_0 2024-04-03T05:14:09.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17261932210459587103', time=2024-04-03T06:32:47.226515+0000, chain.objs.size()=1 2024-04-03T05:14:09.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cErI0Emh5cLA5PaJBBZvFYUMhZrBb9O_0 2024-04-03T05:14:09.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12523680098148647146', time=2024-04-03T06:32:48.011318+0000, chain.objs.size()=1 2024-04-03T05:14:09.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XNBYqwOdefeHPcIhLTAaPWri8kuaQOW_0 2024-04-03T05:14:09.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9603293321394888816', time=2024-04-03T06:32:48.746828+0000, chain.objs.size()=1 2024-04-03T05:14:09.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.H7YTfHJ-60XQRRPKwmVF1pGNNrUcd0e_0 2024-04-03T05:14:09.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3402756374310767854', time=2024-04-03T06:32:50.593841+0000, chain.objs.size()=1 2024-04-03T05:14:09.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pjaL9mx9qp2eGEkso-GuDacIRFKvJEh_0 2024-04-03T05:14:09.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15527020550323504390', time=2024-04-03T06:32:51.473225+0000, chain.objs.size()=1 2024-04-03T05:14:09.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5gXStuMSl1El1moawegolfCRDwPk5R0_0 2024-04-03T05:14:09.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9722934928917265369', time=2024-04-03T06:32:51.545759+0000, chain.objs.size()=1 2024-04-03T05:14:09.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.QS7VSOk0Al_HiBgpccxOzNVb7DQpNGU_0 2024-04-03T05:14:09.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18298144311642145064', time=2024-04-03T06:32:51.548170+0000, chain.objs.size()=1 2024-04-03T05:14:09.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5h1DcqOkXy_yJ5MrSq6ojDUh1fncvaG_0 2024-04-03T05:14:09.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7661451792533228397', time=2024-04-03T06:32:51.624210+0000, chain.objs.size()=1 2024-04-03T05:14:09.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.QDUux7w1BCbLS6x8yn0oYy9zcrOE7NT_0 2024-04-03T05:14:09.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14849455999334553834', time=2024-04-03T06:32:52.045240+0000, chain.objs.size()=1 2024-04-03T05:14:09.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1_nou_98nRYgmyNNwLZqLfEgey8jzAb_0 2024-04-03T05:14:09.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18255283687990878547', time=2024-04-03T06:32:52.048099+0000, chain.objs.size()=1 2024-04-03T05:14:09.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.801+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5eS846gmBGEZF5O-hoqYUE9KDVvklQ-_0 2024-04-03T05:14:09.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1359854573644974764', time=2024-04-03T06:34:30.993488+0000, chain.objs.size()=1 2024-04-03T05:14:09.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ccbXOWAzzSQIADnuz01xANbhCdI4tQ2_0 2024-04-03T05:14:09.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15784031611391396551', time=2024-04-03T06:34:33.143932+0000, chain.objs.size()=1 2024-04-03T05:14:09.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.e3jpdewaFJmk1t5yaTT2FhzoQ_uOv20_0 2024-04-03T05:14:09.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2102099104514158061', time=2024-04-03T06:34:33.456696+0000, chain.objs.size()=1 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.As4HMy-CDFlXeNz4wLo2hKVysaiwhWd_0 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4448008028608210074', time=2024-04-03T06:34:34.589188+0000, chain.objs.size()=1 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cBXkEdy_tMX_wC0itJUzr7bu_a4I4s7_0 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5319160427442510100', time=2024-04-03T06:34:34.927924+0000, chain.objs.size()=1 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.POmRnx0D_6kHhYigl7YoPHmvETGA3S1_0 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16575150546723297342', time=2024-04-03T06:34:36.632919+0000, chain.objs.size()=1 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vApBMCl5sp8dL8VkuAWMJXB7Ht2zuyj_0 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6430184336185676669', time=2024-04-03T06:34:37.903433+0000, chain.objs.size()=1 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nQZmmTarOZzop0O7iYT5aC_GE2iqoIy_0 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12689643891745200753', time=2024-04-03T06:34:37.971136+0000, chain.objs.size()=1 2024-04-03T05:14:09.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hlOEgVTW0XkfUkl1X2kZOoaN_PZHZ34_0 2024-04-03T05:14:09.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6238575197405356301', time=2024-04-03T06:34:38.514446+0000, chain.objs.size()=1 2024-04-03T05:14:09.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.J73cK0_K2tlzQl4YpZfeoyUDvKsFfyk_0 2024-04-03T05:14:09.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4255362536174211024', time=2024-04-03T06:34:40.058145+0000, chain.objs.size()=1 2024-04-03T05:14:09.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CJu27NRrEHlJho5s95pZbgQpXIJOHrE_0 2024-04-03T05:14:09.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16489728036061280685', time=2024-04-03T06:34:40.114567+0000, chain.objs.size()=1 2024-04-03T05:14:09.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Uy9BPL50iIBBNykGQbSW0SRkExfWe66_0 2024-04-03T05:14:09.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17931909773345128918', time=2024-04-03T06:34:40.743218+0000, chain.objs.size()=1 2024-04-03T05:14:09.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.805+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YjzaFoujL0ORRVc7gXvY4BMgOUyXLhq_0 2024-04-03T05:14:09.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7507648426412587048', time=2024-04-03T06:34:40.879853+0000, chain.objs.size()=1 2024-04-03T05:14:09.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VNuCjX4xl6sAwcS4ORV5X0ZJ4n4xBC1_0 2024-04-03T05:14:09.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12176872594133319417', time=2024-04-03T06:34:40.954671+0000, chain.objs.size()=1 2024-04-03T05:14:09.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.els_wcyuBktV5oTJwVMWeP4iYYpLQH7_0 2024-04-03T05:14:09.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8649057072104547182', time=2024-04-03T06:34:40.956555+0000, chain.objs.size()=1 2024-04-03T05:14:09.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XhGCivg3OxXlEogifRcIhKtyMUPj_Zz_0 2024-04-03T05:14:09.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5076143838694992988', time=2024-04-03T06:34:41.268596+0000, chain.objs.size()=1 2024-04-03T05:14:09.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6eOQi-v9rINlCHL11XkPp2XV1htQOIV_0 2024-04-03T05:14:09.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8261943039741889298', time=2024-04-03T06:34:41.798751+0000, chain.objs.size()=1 2024-04-03T05:14:09.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BRqngcIevIePpNNTHa4e0kgWFwAEkPx_0 2024-04-03T05:14:09.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11575029276344381586', time=2024-04-03T06:34:42.730074+0000, chain.objs.size()=1 2024-04-03T05:14:09.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2yPXDs44vTkP73gxrVJXk7nPgk9n1zB_0 2024-04-03T05:14:09.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13955951445113880573', time=2024-04-03T06:34:45.334835+0000, chain.objs.size()=1 2024-04-03T05:14:09.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.okj5BBRK2ja6xcCCk-vOkf2eMduD1kP_0 2024-04-03T05:14:09.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3687164445142045646', time=2024-04-03T06:34:46.460119+0000, chain.objs.size()=1 2024-04-03T05:14:09.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.809+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2TTrno67Sun7-qLTJNCR9xKKrQm9to1_0 2024-04-03T05:14:09.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.813+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/44259 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5284694730957598149', time=2024-04-03T06:34:47.340700+0000, chain.objs.size()=1 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TIXXC4pKQ-CwMhgWvbFaEqTv0cSsi15_0 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3051260732923725072', time=2024-04-03T06:34:48.304085+0000, chain.objs.size()=1 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LXqPAhDITKYd73j0aTEgANJYgX3z9ti_0 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15937649693320453513', time=2024-04-03T06:34:49.134121+0000, chain.objs.size()=1 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ZYoT-kSc4E_b3tOcdhAkXI9o8-WLI_z_0 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14761461107402277132', time=2024-04-03T06:34:50.029402+0000, chain.objs.size()=1 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Gk-m3rfRbvrko-ztKJ_QOvdRLNOz6y6_0 2024-04-03T05:14:09.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1872218052330812782', time=2024-04-03T06:34:52.977032+0000, chain.objs.size()=1 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pltcQQH0XRhIVXMC-k8yPEhBiYl8YOP_0 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9845177232503408384', time=2024-04-03T06:34:53.640861+0000, chain.objs.size()=1 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4DhhDBfPvwsb_tuYfmncaDqxyUlX0_7_0 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15130040604524080170', time=2024-04-03T06:34:55.061913+0000, chain.objs.size()=1 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.aEwMEZIXxEu98H8qU3vbojuz9P_d0Ct_0 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.43869480709144987', time=2024-04-03T06:34:56.551417+0000, chain.objs.size()=1 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pBekDSJIdDTxt9NV13aZjAkoownIxhX_0 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10865305566764718154', time=2024-04-03T06:38:40.174480+0000, chain.objs.size()=1 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.409__shadow_.zyUJ-ErrPOVWFxnYjGRE8Lcvoj2tDfx_0 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3307471302460208800', time=2024-04-03T06:39:46.241900+0000, chain.objs.size()=1 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.435__shadow_.hiZChYTIhDepTZkaK5lvENRb9c4AcIH_0 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6176314286590543482', time=2024-04-03T06:40:08.813977+0000, chain.objs.size()=1 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.451__shadow_.ZEcZd818YenCZPcwTNnTM0Q9Bn00Pyf_0 2024-04-03T05:14:09.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16272548162705432135', time=2024-04-03T06:40:27.948136+0000, chain.objs.size()=1 2024-04-03T05:14:09.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.456__shadow_.gplNOSUViTKkpzZjS31ijZFZzQPYXvs_0 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7732660309083529827', time=2024-04-03T06:42:14.906629+0000, chain.objs.size()=1 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.488__multipart_mymultipart.2~seu3mbQQATHFUHXeIR0sY7qzb4JpeG4.1 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14114898626727392657', time=2024-04-03T06:51:48.387127+0000, chain.objs.size()=1 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.526__shadow_.U152Ek0FZBBkkgLU3tgpATDeFNsNJi0_0 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15183463588894057253', time=2024-04-03T06:53:02.905862+0000, chain.objs.size()=1 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.539__shadow:-tl1OWMawclhMRLwlP9GMPeGg5HUAjK_.340n0vnXHG_Zsl1EiCZAGLWxvLVyfU2_0 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:ixjAryEww69RyeDNyYe3btJWQjo0FgI_.wb0MbNkn7Ea1fIWKA8IVb0vtDY6aKS5_1_75e8f39e973fb850a1e1f01362ff86c4', time=2024-04-03T06:55:29.054799+0000, chain.objs.size()=1 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:ixjAryEww69RyeDNyYe3btJWQjo0FgI_.wb0MbNkn7Ea1fIWKA8IVb0vtDY6aKS5_0 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1601944661977002762', time=2024-04-03T06:55:31.944241+0000, chain.objs.size()=1 2024-04-03T05:14:09.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.551__shadow:ruSLMolWLrIGbV8bJSapRBJMu-tW7sc_.K0BW6Vqo_9Q8_f654ZhPhrqM6rrXr0r_0 2024-04-03T05:14:09.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.633__shadow_.K_qiXrD6AXeAitXjmpvIYTJVokKdNlZ_1_2e519986af6b04114b6ddc2242a5a156', time=2024-04-03T07:03:50.305613+0000, chain.objs.size()=1 2024-04-03T05:14:09.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.633__shadow_.K_qiXrD6AXeAitXjmpvIYTJVokKdNlZ_0 2024-04-03T05:14:09.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10976476844084834405', time=2024-04-03T07:04:30.281272+0000, chain.objs.size()=1 2024-04-03T05:14:09.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.817+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.657__shadow:-hEuKhYtH5dyex6j3BesTL440w8P1NO_.F0anek1pmMy-ygs80R1-wwhuMXoo4ns_0 2024-04-03T05:14:09.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.821+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-03T05:14:09.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.825+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44607' 2024-04-03T05:14:09.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.624247223641277879', time=2024-04-03T06:20:40.902562+0000, chain.objs.size()=1 2024-04-03T05:14:09.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.136__shadow_.xOqc5R4AXGeI2v6l-GS27w9U31X6Vao_0 2024-04-03T05:14:09.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16067310399781909798', time=2024-04-03T06:23:46.808073+0000, chain.objs.size()=1 2024-04-03T05:14:09.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.172__shadow_.GrTZX7COkBKKMcDZ7PWrc2M4ze7PcsQ_0 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11910893418700612495', time=2024-04-03T06:25:12.655218+0000, chain.objs.size()=1 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.203__shadow_.IW4H7RX_4tjKLwK0D-UnyqlGJuHLUQD_0 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7264772449552247823', time=2024-04-03T06:25:14.768812+0000, chain.objs.size()=1 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.204__shadow_.FJNFH1ZdwPaveqfQLpDT78PXE0YOOOS_0 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9930048879234173781', time=2024-04-03T06:25:24.427318+0000, chain.objs.size()=1 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.207__shadow_.TogwlWySGsHcZ-LlpeT4ANbtqZl_TeB_0 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17527265587408533800', time=2024-04-03T06:25:32.425771+0000, chain.objs.size()=1 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.211__shadow_.CV1SENy9d21M27n2zh4fI9OrdhFp3Cw_0 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17265188521231667647', time=2024-04-03T06:26:10.476703+0000, chain.objs.size()=1 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.227__shadow_.w7fZzjJwBD9sFjRv87a25EO9iOVYd0k_0 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7098580037352451936', time=2024-04-03T06:27:53.733281+0000, chain.objs.size()=1 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.iZY2-pyLAb_8tG2lG21LyAdFPhpmQey_0 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7591247457932319256', time=2024-04-03T06:27:54.934597+0000, chain.objs.size()=1 2024-04-03T05:14:09.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Fk_na8Dy5SY0cYXJMOcXnjo84NFDVLS_0 2024-04-03T05:14:09.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16735175125019145844', time=2024-04-03T06:27:56.829573+0000, chain.objs.size()=1 2024-04-03T05:14:09.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mdYKVm-3dbxMuVXJPtKgB2XcW2_jIRB_0 2024-04-03T05:14:09.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4229640319064211869', time=2024-04-03T06:27:57.164225+0000, chain.objs.size()=1 2024-04-03T05:14:09.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wQWy71sDOlOndMbopi56YB6r-YpYbuS_0 2024-04-03T05:14:09.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10887631941408186737', time=2024-04-03T06:27:57.435511+0000, chain.objs.size()=1 2024-04-03T05:14:09.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.829+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.uueFOENCIf9AP7RG2T2xlr8v7mGGYpU_0 2024-04-03T05:14:09.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16802620327415367542', time=2024-04-03T06:27:58.244419+0000, chain.objs.size()=1 2024-04-03T05:14:09.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4UJ6ChpjGfwwlo4mon4cQ7-aFnF366r_0 2024-04-03T05:14:09.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15658366814858101234', time=2024-04-03T06:27:58.961594+0000, chain.objs.size()=1 2024-04-03T05:14:09.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oESfeH2W7keeATkwh8W6Wy8UA6EgZAI_0 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4291382116741987839', time=2024-04-03T06:28:00.482919+0000, chain.objs.size()=1 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mhbRM901i_friyHFMoSyP5VU4ViA4LJ_0 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9018548082236194653', time=2024-04-03T06:28:00.685539+0000, chain.objs.size()=1 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_._TcrtP6d4yduPApDzpmA5Dz19mNKlSL_0 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4488796627857280087', time=2024-04-03T06:28:00.935210+0000, chain.objs.size()=1 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5Hvvv5BnUqKg4-oLeizG6gBM1vUQ-dc_0 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10770714788253182583', time=2024-04-03T06:28:01.132665+0000, chain.objs.size()=1 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.kylcY4WEY2BZQ69PksUdBgUFOb8aX4T_0 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10189804402931175748', time=2024-04-03T06:28:02.029997+0000, chain.objs.size()=1 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.IrHxj1wEAyOGnHcSUIXTakXhbQJ2xeb_0 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1905503330094139740', time=2024-04-03T06:28:02.043547+0000, chain.objs.size()=1 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.E998-UrOQm3rCmFOXAjOguMcMy3yPy4_0 2024-04-03T05:14:09.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17696241819478208012', time=2024-04-03T06:28:02.862706+0000, chain.objs.size()=1 2024-04-03T05:14:09.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-2WVfEjCHFHrMmIjCqcepSJ34Ccx7n0_0 2024-04-03T05:14:09.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17235647313870861088', time=2024-04-03T06:28:05.640289+0000, chain.objs.size()=1 2024-04-03T05:14:09.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.FatdufZpihINyp6X6ChxcQhq9cz03mb_0 2024-04-03T05:14:09.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4390325075506870690', time=2024-04-03T06:28:06.823045+0000, chain.objs.size()=1 2024-04-03T05:14:09.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.833+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.b9lxgduvlIbBgm-IrGclFWTQhpZhH_7_0 2024-04-03T05:14:09.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.837+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13404145285170468432', time=2024-04-03T06:28:06.896906+0000, chain.objs.size()=1 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.837+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.M3M0G1NCmTqaNq0VUFXne-_OzCN_qHv_0 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.837+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9076738839737185388', time=2024-04-03T06:28:07.826636+0000, chain.objs.size()=1 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.837+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Y-a3ALzlMcGvN28I5wd5zV78rPGCjyG_0 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.795497042358200334', time=2024-04-03T06:28:08.427857+0000, chain.objs.size()=1 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.d_BIN0ffq-MgOchIdVlrJSVhMIO48k-_0 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8434902719794595719', time=2024-04-03T06:28:10.127069+0000, chain.objs.size()=1 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TEvUnfqVKrs-jsB0l3OXyXYRDFKaS4I_0 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1015753888723299398', time=2024-04-03T06:28:10.296775+0000, chain.objs.size()=1 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TtlLG7qFl7zIhvIAtAzenJkPI2yg5EG_0 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14313979089236706380', time=2024-04-03T06:28:10.733513+0000, chain.objs.size()=1 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.I7L4OfpoJpqpEaz-hEahWE79qaNf4kI_0 2024-04-03T05:14:09.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14255757525841717360', time=2024-04-03T06:28:11.541084+0000, chain.objs.size()=1 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.aQmkBlKU0YcIjc_A_Ainmy5zD5XHOqU_0 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4811633420427194010', time=2024-04-03T06:28:12.767016+0000, chain.objs.size()=1 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eg5IuUo_TiQ-eFsOSeDngeYFVcmXRWo_0 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2993155652100807225', time=2024-04-03T06:28:12.824227+0000, chain.objs.size()=1 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6oZSx6eXnspb0I9CuU4KHQWCpRucrIe_0 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2529622317893350371', time=2024-04-03T06:28:12.938104+0000, chain.objs.size()=1 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3Y5SNLsNfIeOepJYBdZz0632IcmlRQF_0 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16574997157208424105', time=2024-04-03T06:28:13.341746+0000, chain.objs.size()=1 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.G_CQs05MihDOPjlN_qN4ugcVw-7cKYz_0 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9451064917074058526', time=2024-04-03T06:28:13.658324+0000, chain.objs.size()=1 2024-04-03T05:14:09.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.AthHGTy-PxY2TcEHQ-4vd6U1QHaFmwU_0 2024-04-03T05:14:09.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14679220361329132836', time=2024-04-03T06:28:14.145678+0000, chain.objs.size()=1 2024-04-03T05:14:09.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.841+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LAJDXP3AV3K-NO6Q2r4mtzvlmUUopKn_0 2024-04-03T05:14:09.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12023026801993728600', time=2024-04-03T06:28:17.232734+0000, chain.objs.size()=1 2024-04-03T05:14:09.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DrFaZBZP8gSPWLa0mTgtjvMpNrMKnKe_0 2024-04-03T05:14:09.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16036593592690534778', time=2024-04-03T06:28:17.237572+0000, chain.objs.size()=1 2024-04-03T05:14:09.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OdGnfb3p4QIj6Rge4lWyZwxxmx2ZlpK_0 2024-04-03T05:14:09.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1422024759008149692', time=2024-04-03T06:28:17.581111+0000, chain.objs.size()=1 2024-04-03T05:14:09.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fmrdoCeYcZeCfCdc-SQHKkDqtPQnK0__0 2024-04-03T05:14:09.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18099574864045659927', time=2024-04-03T06:28:19.267335+0000, chain.objs.size()=1 2024-04-03T05:14:09.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wbArWWrpW_pSJvAi7SUnxX9pX3FlAF6_0 2024-04-03T05:14:09.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7154259885783632945', time=2024-04-03T06:28:19.568008+0000, chain.objs.size()=1 2024-04-03T05:14:09.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rDfJAwA5nrUDclOA6K_acV0My7NAIlM_0 2024-04-03T05:14:09.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17389261431514081812', time=2024-04-03T06:28:19.591463+0000, chain.objs.size()=1 2024-04-03T05:14:09.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.uzGq1grpyTNURRdcf58g3GAo0yIg-QZ_0 2024-04-03T05:14:09.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1078569855390230927', time=2024-04-03T06:28:23.334723+0000, chain.objs.size()=1 2024-04-03T05:14:09.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.232__shadow_.cX5zJKdO10K7X3GVj_7sYYH5YVjy0q__0 2024-04-03T05:14:09.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.920413654028620939', time=2024-04-03T06:28:25.405083+0000, chain.objs.size()=1 2024-04-03T05:14:09.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.233__shadow_.QM71jfvGs7aZoW2pOZ67nlYnzRVRykd_0 2024-04-03T05:14:09.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1024035767170823944', time=2024-04-03T06:28:40.018867+0000, chain.objs.size()=1 2024-04-03T05:14:09.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.240__shadow_.4KHBI3Du09S-S6C6TmGjWqVZtxM6y8F_0 2024-04-03T05:14:09.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15644316015748327642', time=2024-04-03T06:29:35.835135+0000, chain.objs.size()=1 2024-04-03T05:14:09.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.IL4nhO0x6Ph8O-Gvjhzo6qQrY3BVeQw_0 2024-04-03T05:14:09.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3271559975242767262', time=2024-04-03T06:29:36.109266+0000, chain.objs.size()=1 2024-04-03T05:14:09.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.845+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.08hS6w8L4VV7CK5rli5iQG1SK1NxXzG_0 2024-04-03T05:14:09.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3199652616947516507', time=2024-04-03T06:29:36.205901+0000, chain.objs.size()=1 2024-04-03T05:14:09.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.HEidmQLT8aM1HGUrkLuyqqPL6kgKpWQ_0 2024-04-03T05:14:09.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.67287401915434805', time=2024-04-03T06:32:24.314068+0000, chain.objs.size()=1 2024-04-03T05:14:09.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.C8XQwB4MnMKEcJWdz-inPwr7DUDuZkg_0 2024-04-03T05:14:09.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12219551556426265758', time=2024-04-03T06:32:25.098185+0000, chain.objs.size()=1 2024-04-03T05:14:09.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XzQwNczeC1XKwc0XypAB1Z4D-yZYAXD_0 2024-04-03T05:14:09.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12715830888083275404', time=2024-04-03T06:32:25.793443+0000, chain.objs.size()=1 2024-04-03T05:14:09.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.fzv1JZNfwMMpYr6A43nkQo6CAm-vi6Z_0 2024-04-03T05:14:09.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6192649646074863341', time=2024-04-03T06:32:26.137865+0000, chain.objs.size()=1 2024-04-03T05:14:09.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vV_HrWhm7Q6So2eqC0-vidcWG4rJ858_0 2024-04-03T05:14:09.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12079220652510851512', time=2024-04-03T06:32:26.562637+0000, chain.objs.size()=1 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gd6wppumlpS4DYWAfFGtuFOiGh6CwNr_0 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2221757840500164548', time=2024-04-03T06:32:29.727227+0000, chain.objs.size()=1 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.203xIXUpQsAnjDio4sfcLfV5TvhLo-C_0 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17262843824401936021', time=2024-04-03T06:32:30.419911+0000, chain.objs.size()=1 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tjcZ4us2gGx5koDLbd16DAI4uVbxuzN_0 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7252320050062229332', time=2024-04-03T06:32:30.657205+0000, chain.objs.size()=1 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.5qY28JR8uo2gQ-k7XmTIrSakk21ueNY_0 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10094193636866897002', time=2024-04-03T06:32:32.259723+0000, chain.objs.size()=1 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.I_KFqwisIM8CR3vUO0WkwLA467KBJMf_0 2024-04-03T05:14:09.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14925477420885389164', time=2024-04-03T06:32:32.798854+0000, chain.objs.size()=1 2024-04-03T05:14:09.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.849+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.B7TqrmhiIHeuHdwgFuxFLQhCclR3Up9_0 2024-04-03T05:14:09.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4633426750369852922', time=2024-04-03T06:32:33.334757+0000, chain.objs.size()=1 2024-04-03T05:14:09.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sgjmBINfjanWUfGELi0NndpFm6FGp-2_0 2024-04-03T05:14:09.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7618563927838715575', time=2024-04-03T06:32:33.599226+0000, chain.objs.size()=1 2024-04-03T05:14:09.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6tO_d0_FDFrHQwzqN7jtC3MesxaUaVd_0 2024-04-03T05:14:09.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12627915926117842556', time=2024-04-03T06:32:33.602762+0000, chain.objs.size()=1 2024-04-03T05:14:09.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xjGOwTOcPwzTil-eVUs1UX3HoxynxWx_0 2024-04-03T05:14:09.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7909588915721188465', time=2024-04-03T06:32:34.105974+0000, chain.objs.size()=1 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Umssh2tn3mkf6TOyX_-oF86xr8YKYbP_0 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8373246497862371346', time=2024-04-03T06:32:35.972035+0000, chain.objs.size()=1 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sIXiZJaodKhdAy25Nr_7I20bt42Aayr_0 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4371413754869002023', time=2024-04-03T06:32:37.601737+0000, chain.objs.size()=1 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.n71kqoGt2Qv4emOm_NDd8byFSNQRtFa_0 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9052456210293457884', time=2024-04-03T06:32:39.808848+0000, chain.objs.size()=1 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MwKw7WOkf27NW5eJNVLhjkXaOeCAoKk_0 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4195939283065650046', time=2024-04-03T06:32:40.062964+0000, chain.objs.size()=1 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zWx12gyE7cGLWahHsgJqNJeQY3IXH-L_0 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.30784988083274123', time=2024-04-03T06:32:40.081764+0000, chain.objs.size()=1 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BBsD0LM22A-DqMo1n-hbzmoofMwcOgz_0 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11648969991148672127', time=2024-04-03T06:32:40.547932+0000, chain.objs.size()=1 2024-04-03T05:14:09.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4rli7utaSXa8akTIWPE_tqUYb_qr68U_0 2024-04-03T05:14:09.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3555288108775600294', time=2024-04-03T06:32:43.397800+0000, chain.objs.size()=1 2024-04-03T05:14:09.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.853+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cFa2tUk0IJJ8ZqchZAfMcAl58xZe6f9_0 2024-04-03T05:14:09.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6494050514326710089', time=2024-04-03T06:32:43.502993+0000, chain.objs.size()=1 2024-04-03T05:14:09.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.96Yw70uZ0kwghfrTrTzPl8tfUGL0Sii_0 2024-04-03T05:14:09.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12870402567588537434', time=2024-04-03T06:32:44.571000+0000, chain.objs.size()=1 2024-04-03T05:14:09.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.h-oE1ZOzcVfh6rNH6FvDwzFAYuhx8bJ_0 2024-04-03T05:14:09.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5737839855995614084', time=2024-04-03T06:32:44.656658+0000, chain.objs.size()=1 2024-04-03T05:14:09.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.d-OCE6EwISxrCd3Pi5RfslmhPSTFWwJ_0 2024-04-03T05:14:09.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17895824956008590869', time=2024-04-03T06:32:46.547876+0000, chain.objs.size()=1 2024-04-03T05:14:09.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Vnf1fkVwXpRyc0sqtZTfP4i77FidT9p_0 2024-04-03T05:14:09.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16631965130098909869', time=2024-04-03T06:32:47.799718+0000, chain.objs.size()=1 2024-04-03T05:14:09.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.857+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.WKK9x0IqLq0wwGRolC7Vs6X8Mi4_Yl4_0 2024-04-03T05:14:09.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9014891086534558851', time=2024-04-03T06:32:48.049584+0000, chain.objs.size()=1 2024-04-03T05:14:09.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.__0xN7iK1G7dKOaVXOb1YHima4sXwoS_0 2024-04-03T05:14:09.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15303841333801750382', time=2024-04-03T06:32:50.629228+0000, chain.objs.size()=1 2024-04-03T05:14:09.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uDOe5g3hpM9pZ2TmH4pG8nsz48F2Hr6_0 2024-04-03T05:14:09.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18036382797034375890', time=2024-04-03T06:32:50.945508+0000, chain.objs.size()=1 2024-04-03T05:14:09.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.31sjxrQYc9KxdewheLR2YYW9yfdqmS4_0 2024-04-03T05:14:09.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7991473045721590322', time=2024-04-03T06:32:52.147262+0000, chain.objs.size()=1 2024-04-03T05:14:09.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.X9BoPsMs9ZX5XdHg2AxGX3JvOEKS_bH_0 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2667232452552152760', time=2024-04-03T06:34:29.001630+0000, chain.objs.size()=1 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kdGbNw7v6AmgTMlFug10skUT2tpxWWe_0 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.893712430117056820', time=2024-04-03T06:34:29.006347+0000, chain.objs.size()=1 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0sJB3Ad_7oQoifKamBhMXQFCZw36ve8_0 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8689012782630374804', time=2024-04-03T06:34:29.538776+0000, chain.objs.size()=1 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.j1umx9EINJZ8fjRPlJTQatf4haFP3CR_0 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18444793930695817216', time=2024-04-03T06:34:30.223746+0000, chain.objs.size()=1 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LNLM9cBLxt7f_KhoXn0z0hnWmzqq85s_0 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3260966344769977369', time=2024-04-03T06:34:30.228319+0000, chain.objs.size()=1 2024-04-03T05:14:09.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.861+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lwPP_3Su9H-Z6Ba6b_kronQVYXeOsW-_0 2024-04-03T05:14:09.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3127556547049958377', time=2024-04-03T06:34:30.309793+0000, chain.objs.size()=1 2024-04-03T05:14:09.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.FW3tRPDMF1ba21Z-IGFUXXbO2rd_oSt_0 2024-04-03T05:14:09.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8778497245301966732', time=2024-04-03T06:34:31.082927+0000, chain.objs.size()=1 2024-04-03T05:14:09.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.am1eWIdtzsTPNlx6F8A8vBMkjfngxJT_0 2024-04-03T05:14:09.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16117166143231667408', time=2024-04-03T06:34:31.368456+0000, chain.objs.size()=1 2024-04-03T05:14:09.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zt8d1-VE-UZo4-AO3-NEimOqo8ZzmKn_0 2024-04-03T05:14:09.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11952002270397254298', time=2024-04-03T06:34:31.426403+0000, chain.objs.size()=1 2024-04-03T05:14:09.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.edn9I32mO-aMjAYqFlg_zg57zuSIrax_0 2024-04-03T05:14:09.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1962643103020865504', time=2024-04-03T06:34:32.609134+0000, chain.objs.size()=1 2024-04-03T05:14:09.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.eSzETTbfNUJM86bHjxmfjyWpJHDTlLb_0 2024-04-03T05:14:09.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.438297523802612164', time=2024-04-03T06:34:33.108016+0000, chain.objs.size()=1 2024-04-03T05:14:09.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.865+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.x66t43jL5EsvrVyuISdtCa9SAD5axnP_0 2024-04-03T05:14:09.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14600590295815354491', time=2024-04-03T06:34:33.759638+0000, chain.objs.size()=1 2024-04-03T05:14:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ycO6-bkhlDzjV3vZdJ5Sp16pDWKfmZe_0 2024-04-03T05:14:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17240853129849310386', time=2024-04-03T06:34:34.555835+0000, chain.objs.size()=1 2024-04-03T05:14:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xAKsez88wwvAHuSXcdTW5S7-HcTlyFK_0 2024-04-03T05:14:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7915094305865364422', time=2024-04-03T06:34:36.336897+0000, chain.objs.size()=1 2024-04-03T05:14:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.se-LDpLrLBmZdSm-cy3Cp7jFpHOS7eV_0 2024-04-03T05:14:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17497282836774536399', time=2024-04-03T06:34:36.640606+0000, chain.objs.size()=1 2024-04-03T05:14:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.WaB6eSkMa0lNKvXpM03migyrth1ytbi_0 2024-04-03T05:14:09.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5139263421123486916', time=2024-04-03T06:34:37.091865+0000, chain.objs.size()=1 2024-04-03T05:14:09.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.djFAE8ViWa0CnJGIFwSmswdc_vVWsMP_0 2024-04-03T05:14:09.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8049250078670275183', time=2024-04-03T06:34:37.096506+0000, chain.objs.size()=1 2024-04-03T05:14:09.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9e7LxtO4fmBN4AL-jT6ppzDVvNIOJco_0 2024-04-03T05:14:09.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12620375293959245885', time=2024-04-03T06:34:37.207981+0000, chain.objs.size()=1 2024-04-03T05:14:09.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.N0w1qkJpWlD6rdA67KVgAuS11WavYhH_0 2024-04-03T05:14:09.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4151361316187021311', time=2024-04-03T06:34:37.435022+0000, chain.objs.size()=1 2024-04-03T05:14:09.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.eX7jQjqRJAeSIPnmjrJqfo3RDooEV5x_0 2024-04-03T05:14:09.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4294836461415875843', time=2024-04-03T06:34:37.436881+0000, chain.objs.size()=1 2024-04-03T05:14:09.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.869+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.G0tk2i7XW-VO525Rbwy31Mr80DfrNNc_0 2024-04-03T05:14:09.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3582813405921047239', time=2024-04-03T06:34:38.368838+0000, chain.objs.size()=1 2024-04-03T05:14:09.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.r1d62Xw-yPyHFQEhDO8wenebsumpv5b_0 2024-04-03T05:14:09.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.873+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11659155770482928713', time=2024-04-03T06:34:39.061294+0000, chain.objs.size()=1 2024-04-03T05:14:09.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.873+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VymIpJeU71NlKbWWwMJfgbcVKaH0rT8_0 2024-04-03T05:14:09.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.877+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/44607 2024-04-03T05:14:09.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-04-03T05:14:09.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15245149946700121769', time=2024-04-03T06:34:40.059456+0000, chain.objs.size()=1 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XZ1NnWCfmidozUbZxyLO6xqpEyEIqZ3_0 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16413843485451834116', time=2024-04-03T06:34:41.455388+0000, chain.objs.size()=1 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5-lYPD35TG9EyPJ4CJocJc6Kq7Dq23s_0 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9174993423674310030', time=2024-04-03T06:34:41.702647+0000, chain.objs.size()=1 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LAuNBczWA7Yw7svfTXpTFXnjjQ360WT_0 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5292146301977408004', time=2024-04-03T06:34:41.751458+0000, chain.objs.size()=1 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YZymDmoKS-L6WdgHC1z1fzUf0wiHPXk_0 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4619912033945678979', time=2024-04-03T06:34:43.662841+0000, chain.objs.size()=1 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.la8EftZn0D6nryphIQiW-m2_DTgvSzC_0 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.56160235692548909', time=2024-04-03T06:34:44.834625+0000, chain.objs.size()=1 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GZsUhv4msujYSVfdCLRa7kqSMUzF4wI_0 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3645974821658365607', time=2024-04-03T06:34:45.013568+0000, chain.objs.size()=1 2024-04-03T05:14:09.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xd07Ib2DHYPmmMZA2sIgqFoI8vmZUpC_0 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16909786832072936488', time=2024-04-03T06:34:45.094957+0000, chain.objs.size()=1 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.uwlLHTd57SENIeMOK3dZcJj12ZoSr8G_0 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.257626867560342594', time=2024-04-03T06:34:49.844055+0000, chain.objs.size()=1 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.J7AGwYN13M6b4o-OHd8MrLMtCFuL248_0 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11303254085236176505', time=2024-04-03T06:34:50.150039+0000, chain.objs.size()=1 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.uNWfrh_8J3c-QaPuWRmPfL4GWsHiyQw_0 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9297177897220754209', time=2024-04-03T06:34:50.955283+0000, chain.objs.size()=1 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.m3yZtMHumlYiV519qb8f6dE3Uew9Z8e_0 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15365796870052129795', time=2024-04-03T06:34:52.195182+0000, chain.objs.size()=1 2024-04-03T05:14:09.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.881+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.76NLoPQWQTmKfDu0TpJfrJq0fcjkeVW_0 2024-04-03T05:14:09.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.130916096571355961', time=2024-04-03T06:34:55.990551+0000, chain.objs.size()=1 2024-04-03T05:14:09.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CN_XFYe4i5OQfUmCvrbtxenfCYIReBR_0 2024-04-03T05:14:09.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7946678542077267885', time=2024-04-03T06:34:56.645486+0000, chain.objs.size()=1 2024-04-03T05:14:09.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.j7Ij_ZLOMguR-sBgKPF9TFh8sNON4Ox_0 2024-04-03T05:14:09.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9572821048032613259', time=2024-04-03T06:35:21.456785+0000, chain.objs.size()=1 2024-04-03T05:14:09.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.306__shadow_._kQJqzoClvj1wFxj2A5kik9PLyDtNf__0 2024-04-03T05:14:09.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18328960857244559216', time=2024-04-03T06:36:35.519047+0000, chain.objs.size()=1 2024-04-03T05:14:09.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.346__shadow_.dqN5nwKLbylWN8JpZgi5IS3Heax6iru_0 2024-04-03T05:14:09.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5298658899899097721', time=2024-04-03T06:38:29.438458+0000, chain.objs.size()=1 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.404__shadow_.EgAPKmu5XTT5ff2ll9pgTQTAag3A9n3_0 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3013620165326394890', time=2024-04-03T06:39:20.695326+0000, chain.objs.size()=1 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.426__shadow_.3Se6iz4D2scA6KbElv6a2YCGVMfEcWI_0 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9704932327391151782', time=2024-04-03T06:39:34.850641+0000, chain.objs.size()=1 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.431__shadow_.WtjMUBmzaikepz9ZSypNwNDw4PwspBc_0 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3590929727116115044', time=2024-04-03T06:40:16.892141+0000, chain.objs.size()=1 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.454__shadow_.PjuHbY5_iABduur9DZxgJpYm-Kq6nfS_0 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4265271114002460305', time=2024-04-03T06:40:30.153032+0000, chain.objs.size()=1 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.457__shadow_.dgSc11ObR_EHND-FJlCteNiaoddR55x_0 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13541325902558650391', time=2024-04-03T06:40:38.487070+0000, chain.objs.size()=1 2024-04-03T05:14:09.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.885+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.461__shadow_.ouZ10vky4o-B3mzJwjMFVZjNmHsUfja_0 2024-04-03T05:14:09.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.467__shadow_.5AZmldNZ7OmZ1M90OdRUSAM_4BXMCLL_1_a6b0233a72e7306278325d12c1f57bce', time=2024-04-03T06:40:49.998172+0000, chain.objs.size()=1 2024-04-03T05:14:09.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.467__shadow_.5AZmldNZ7OmZ1M90OdRUSAM_4BXMCLL_0 2024-04-03T05:14:09.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3753926815409178328', time=2024-04-03T06:47:49.679174+0000, chain.objs.size()=2 2024-04-03T05:14:09.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~k32L7kDf2QGDOHkWr6XWgm8n81_gDCE.1 2024-04-03T05:14:09.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~k32L7kDf2QGDOHkWr6XWgm8n81_gDCE.2 2024-04-03T05:14:09.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17252812295730234325', time=2024-04-03T06:52:51.953539+0000, chain.objs.size()=1 2024-04-03T05:14:09.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:yWZHsoR-hSBdvW76oQGtW6Pr2PGjRvO_.0B3GW3KxSnT14nVoMfqCodljFY67kyK_0 2024-04-03T05:14:09.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1559601162877336810', time=2024-04-03T06:52:52.418347+0000, chain.objs.size()=1 2024-04-03T05:14:09.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:oVU4WL-g.8r7LTPNjLmwngkGnxEnEVb_.Ddq-dawObWwMWyngDNVzYS-T6eGTP-H_0 2024-04-03T05:14:09.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5909126347577772420', time=2024-04-03T06:52:55.523561+0000, chain.objs.size()=1 2024-04-03T05:14:09.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.889+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:XgnQ0hS1Ksiu2avEW5PHmRojP7kAZLB_.8r5xF13jXy63YsEjxidQH5MJSFwWhOA_0 2024-04-03T05:14:09.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11495724953670839860', time=2024-04-03T06:53:14.775888+0000, chain.objs.size()=1 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow_.QuMBrTAI6N8OIwPpmZ7FJ6A8JxFgvlN_0 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5870408486378144370', time=2024-04-03T06:53:17.178142+0000, chain.objs.size()=1 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow:cdbGJQ4jddco9yuMEmQHEZ3xjG0axUl_.x2nilkaXIERfj_lpG1_pADMPVvHCYw6_0 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5086384699268368571', time=2024-04-03T06:53:39.899171+0000, chain.objs.size()=1 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:Q-s.qTE7NVVRf5nZ5VrcdBVQA5e.QHL_.b601uBd6TtTv2YJodWtOlNopxw0dJ82_0 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12271836167986027135', time=2024-04-03T06:55:23.395648+0000, chain.objs.size()=1 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:AphAxrguy1S3Hi75Yhfp2p6XaEUymE6_.ylJw02xQYdPs0Y7baY9vPYClUTzwitd_0 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1737827038031245883', time=2024-04-03T06:55:24.083294+0000, chain.objs.size()=1 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:fA.onNKfafmPWgpj5FbvZtDUoBJYYE7_.yY_PoaNBRRDAKnXrYNVDqJzhAH1Kqfn_0 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:rWJ4oB2Trp8PCi23coUzRivhsnYYYCl_.4P-xbcO_DZegdwcAnZKsKSHKHO_0CzH_1_5b204c3528cab98c160dff41af6efa7a', time=2024-04-03T06:55:29.887926+0000, chain.objs.size()=1 2024-04-03T05:14:09.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:rWJ4oB2Trp8PCi23coUzRivhsnYYYCl_.4P-xbcO_DZegdwcAnZKsKSHKHO_0CzH_0 2024-04-03T05:14:09.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2597010901440111918', time=2024-04-03T07:01:05.877220+0000, chain.objs.size()=1 2024-04-03T05:14:09.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.596__shadow_.Sl_TOewFt2dQXhIzmOjqAHtM1vEB8ma_0 2024-04-03T05:14:09.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1650971513201861014', time=2024-04-03T07:02:15.547287+0000, chain.objs.size()=1 2024-04-03T05:14:09.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.615__shadow_.e-w_I4uzZ6vj1OA06wIC9FI4yWFIRXb_0 2024-04-03T05:14:09.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.631__shadow_.XxqU3MVC8HSga8eGK_FT-P2FJX0pWaG_1_27c515b95aa03ee80b0f1d6c07dacded', time=2024-04-03T07:03:46.891012+0000, chain.objs.size()=1 2024-04-03T05:14:09.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.631__shadow_.XxqU3MVC8HSga8eGK_FT-P2FJX0pWaG_0 2024-04-03T05:14:09.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1b50e640 0 -- 172.21.15.104:0/4071443380 >> [v2:172.21.15.104:6824/1648728207,v1:172.21.15.104:6825/1648728207] conn(0x55fadd883870 msgr2=0x55fadd885d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-03T05:14:09.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5722635767537478248', time=2024-04-03T07:04:56.983457+0000, chain.objs.size()=1 2024-04-03T05:14:09.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.670__shadow:ROgIR3bAMEh6.SWoV9aAjHvFRiUAerh_.wUPyICDqiGajoJrAfvyvr6V0-mF0qGZ_0 2024-04-03T05:14:09.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17428649409492599859', time=2024-04-03T07:05:06.623363+0000, chain.objs.size()=1 2024-04-03T05:14:09.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.893+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.675__shadow:Nmb87H8StS.4XRNr6jTkM5eLi0KM54m_.0aKk7OFUVPPL7m6RkHEmM7_ol8zlfyA_0 2024-04-03T05:14:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.897+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-03T05:14:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42966' 2024-04-03T05:14:09.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16406842283932043321', time=2024-04-03T06:23:37.592966+0000, chain.objs.size()=1 2024-04-03T05:14:09.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.167__shadow_.DmK0LW1v5KZZJ721mKwhKCZhlBNcYG3_0 2024-04-03T05:14:09.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5215343780824254831', time=2024-04-03T06:25:06.127647+0000, chain.objs.size()=1 2024-04-03T05:14:09.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.200__shadow_.5XtDuY2DQpV4HCtMHStUO--Uf7fT3-X_0 2024-04-03T05:14:09.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6673845546586705762', time=2024-04-03T06:26:12.538301+0000, chain.objs.size()=1 2024-04-03T05:14:09.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.228__shadow_.jx2RNnDQPunKomKsJ2NLdDWAzUqL54__0 2024-04-03T05:14:09.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17684648076569384265', time=2024-04-03T06:26:16.995657+0000, chain.objs.size()=1 2024-04-03T05:14:09.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.230__shadow_.i17KwcyBXjRPRdBIDrsowFyvqDJT512_0 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13005206063037631114', time=2024-04-03T06:27:52.624995+0000, chain.objs.size()=1 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.alt5HLTbdjhQFtXfyVfQY3rCTKC3HXJ_0 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5111125369083750057', time=2024-04-03T06:27:57.547397+0000, chain.objs.size()=1 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8AX9BeDryXtY9kvQmz5A4df9XOdh440_0 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16714856697659373957', time=2024-04-03T06:28:01.235431+0000, chain.objs.size()=1 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.2Cpskv9B9wtJKO40KhCbeJRKG5FkKDp_0 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.901+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4832678177537730428', time=2024-04-03T06:28:01.704504+0000, chain.objs.size()=1 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cs-FBHabpmfGCVO0wqhHjJmmvFWo_u8_0 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4091070067017812298', time=2024-04-03T06:28:02.043365+0000, chain.objs.size()=1 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Bh6VDmdIc1YLuA1uUUIsv8UZV8_mCZZ_0 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3633503975139472652', time=2024-04-03T06:28:02.105089+0000, chain.objs.size()=1 2024-04-03T05:14:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.uqajErVAC6qWqW1Cm8Mxhc9jLwj6oFd_0 2024-04-03T05:14:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2861077489346771221', time=2024-04-03T06:28:05.233722+0000, chain.objs.size()=1 2024-04-03T05:14:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BLL2nfXnC_qh86H_tFQE6dOmXLKOw0u_0 2024-04-03T05:14:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.905+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5326205109403972786', time=2024-04-03T06:28:05.489867+0000, chain.objs.size()=1 2024-04-03T05:14:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.905+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OxmRwEpw1uN3sgzhfcNkuXfw9gxFJmV_0 2024-04-03T05:14:09.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1ad0d640 0 -- 172.21.15.104:0/4071443380 >> [v2:172.21.15.130:6805/2542797043,v1:172.21.15.130:6808/2542797043] conn(0x7efe140f3040 msgr2=0x7efce407bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14803230201670726038', time=2024-04-03T06:28:05.492138+0000, chain.objs.size()=1 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wYLX-fsQeozejn2uvTp8B_m1guIxxYV_0 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15686671364755493248', time=2024-04-03T06:28:05.786348+0000, chain.objs.size()=1 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.S3GiolbZ89o7gb7sVXMoJIMPs_HXNjB_0 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14648414289086427965', time=2024-04-03T06:28:06.265934+0000, chain.objs.size()=1 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LCqJOT9nW8j2uFSOzRlb1jpaRxkadXY_0 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2577008208186958709', time=2024-04-03T06:28:07.716870+0000, chain.objs.size()=1 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6FFnwoDS8ezFWuRviR2WPBQ7ZO28Th9_0 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15777182901731289639', time=2024-04-03T06:28:08.132881+0000, chain.objs.size()=1 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JOoxIh0x8jCDMPQxxlhdEvAuhPjjoq8_0 2024-04-03T05:14:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3747480940326580127', time=2024-04-03T06:28:10.582630+0000, chain.objs.size()=1 2024-04-03T05:14:09.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WZ_vFeNjaGDDjsJk39LJE81ipJ1504D_0 2024-04-03T05:14:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12949932154469613854', time=2024-04-03T06:28:11.918120+0000, chain.objs.size()=1 2024-04-03T05:14:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wrhN1OVjlU6e1fN-TvffHNfxfutTzQG_0 2024-04-03T05:14:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9574565151263120310', time=2024-04-03T06:28:12.263298+0000, chain.objs.size()=1 2024-04-03T05:14:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7XdIKuMSodkVlslWXxKmBLlGx_z3ERN_0 2024-04-03T05:14:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10208492130116862155', time=2024-04-03T06:28:16.328548+0000, chain.objs.size()=1 2024-04-03T05:14:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.LJsLj62BSCbuSJXgp9qqkghSaF2Qx4t_0 2024-04-03T05:14:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13904692423935510636', time=2024-04-03T06:28:16.532778+0000, chain.objs.size()=1 2024-04-03T05:14:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OxsJvZGdW_1bsHyPRiNS8R42XLRpcwd_0 2024-04-03T05:14:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8504895740350912854', time=2024-04-03T06:28:16.539402+0000, chain.objs.size()=1 2024-04-03T05:14:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.909+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Yj-RGtWdpzzM3tjwLZVUWtMMlFkX00v_0 2024-04-03T05:14:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12836374989113576984', time=2024-04-03T06:28:17.349244+0000, chain.objs.size()=1 2024-04-03T05:14:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WQeaigSn8fCFLqa_qKTu8ddmyGlndt9_0 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1bd0f640 0 -- 172.21.15.104:0/4071443380 >> [v2:172.21.15.104:6800/3577269254,v1:172.21.15.104:6801/3577269254] conn(0x55fadd88b400 msgr2=0x55fadd88d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17383671487834569886', time=2024-04-03T06:28:18.792228+0000, chain.objs.size()=1 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.herDN1bZtR8D7nnvC-IJhwe9CpZNsFJ_0 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16739837056442832938', time=2024-04-03T06:28:18.981133+0000, chain.objs.size()=1 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MdK3rnSS4VAjMlmCXnYFl0Pnx1x_FJW_0 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5022450767488043001', time=2024-04-03T06:28:19.056349+0000, chain.objs.size()=1 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oVQ2Z9Tcpvpz-YffFVMTXBQwJpvIcL3_0 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16261347577737059075', time=2024-04-03T06:28:19.572412+0000, chain.objs.size()=1 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Mylv8cZoEVkNka6gCf6BSqf7JlavzsD_0 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12339632652063882826', time=2024-04-03T06:28:19.950166+0000, chain.objs.size()=1 2024-04-03T05:14:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-G56FNcNrSE0G-a1af-ViyCyXput_3E_0 2024-04-03T05:14:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12632933842249138907', time=2024-04-03T06:28:31.762111+0000, chain.objs.size()=1 2024-04-03T05:14:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.236__shadow_.vPlfoF8LA8izJMWN8QPxW51zrcrgmXR_0 2024-04-03T05:14:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15171740031730333303', time=2024-04-03T06:29:11.471331+0000, chain.objs.size()=1 2024-04-03T05:14:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.913+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.254__shadow_.zb9uuuGzYsrREO8u2Evmm3uMlFwrnhW_0 2024-04-03T05:14:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5473502603574343214', time=2024-04-03T06:32:24.273649+0000, chain.objs.size()=1 2024-04-03T05:14:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0NxXUlkgYjfJP9Ge0QppzE_XvecB_Sd_0 2024-04-03T05:14:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9037170884040685511', time=2024-04-03T06:32:24.559735+0000, chain.objs.size()=1 2024-04-03T05:14:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GCMTeYMQzx1ASI0beUlc40p1e4LNe1f_0 2024-04-03T05:14:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14774540817544639165', time=2024-04-03T06:32:24.819767+0000, chain.objs.size()=1 2024-04-03T05:14:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.nWggrQAFOwOD_Qemy0VwuiKApqUWFde_0 2024-04-03T05:14:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5924036752463924176', time=2024-04-03T06:32:26.970555+0000, chain.objs.size()=1 2024-04-03T05:14:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ECp2SWOXqt1795JyusnDFW0awhgH7Jf_0 2024-04-03T05:14:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5479636768966188465', time=2024-04-03T06:32:29.020319+0000, chain.objs.size()=1 2024-04-03T05:14:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lWBBMka_ibDeB7b9FkGEluxBPRGoY0-_0 2024-04-03T05:14:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5138714897967746232', time=2024-04-03T06:32:29.730538+0000, chain.objs.size()=1 2024-04-03T05:14:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.917+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._9wuFvUkFwqXP1Y7pRjt7v56-CDkMJ8_0 2024-04-03T05:14:09.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18403571725335264261', time=2024-04-03T06:32:29.826366+0000, chain.objs.size()=1 2024-04-03T05:14:09.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zT9-3NwhiLI7A3_1ZRN3evETRfO4SSa_0 2024-04-03T05:14:09.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6142879770430718936', time=2024-04-03T06:32:32.158182+0000, chain.objs.size()=1 2024-04-03T05:14:09.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vizUVfotvwwhU1HTS9P_kEfsUHQsCBm_0 2024-04-03T05:14:09.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9516891928486333469', time=2024-04-03T06:32:32.161642+0000, chain.objs.size()=1 2024-04-03T05:14:09.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OAJ5emO_3tlq5gqihbaLCUj-rihBFXV_0 2024-04-03T05:14:09.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13696484055847658521', time=2024-04-03T06:32:33.825177+0000, chain.objs.size()=1 2024-04-03T05:14:09.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hKHKARpvqc7Mn3WEsX7ctaCouVAUYAO_0 2024-04-03T05:14:09.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16448079244768208839', time=2024-04-03T06:32:37.256785+0000, chain.objs.size()=1 2024-04-03T05:14:09.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._mLFTDZJGg0aMOwzQeNicnPR5zf1ztQ_0 2024-04-03T05:14:09.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9893723805989438645', time=2024-04-03T06:32:38.450607+0000, chain.objs.size()=1 2024-04-03T05:14:09.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ATLPZrmUvThzl3fGjO_-JvT0NxvTiOG_0 2024-04-03T05:14:09.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13381022836404040043', time=2024-04-03T06:32:40.062799+0000, chain.objs.size()=1 2024-04-03T05:14:09.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mE6aEDqgpjLENkZlfKUBVpGfw1HGIZD_0 2024-04-03T05:14:09.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3249632494513492941', time=2024-04-03T06:32:41.155119+0000, chain.objs.size()=1 2024-04-03T05:14:09.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-LsECjUfUnOfL2KiwCI0gKyqcrfU28g_0 2024-04-03T05:14:09.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15312135360659337549', time=2024-04-03T06:32:42.078523+0000, chain.objs.size()=1 2024-04-03T05:14:09.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.TQghYsy8Ur6hzTli7oSt-VZpCoKSvCt_0 2024-04-03T05:14:09.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6270354330020871779', time=2024-04-03T06:32:43.006696+0000, chain.objs.size()=1 2024-04-03T05:14:09.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.bCXNh9dxz-aR07wALnMVo8iboQCf8Cm_0 2024-04-03T05:14:09.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.290748941731742911', time=2024-04-03T06:32:43.481364+0000, chain.objs.size()=1 2024-04-03T05:14:09.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.921+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ba6XVqy91cA3zqg5Fya_wKT2J-BkjYk_0 2024-04-03T05:14:09.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.438847275328611964', time=2024-04-03T06:32:44.137085+0000, chain.objs.size()=1 2024-04-03T05:14:09.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Y4NFgUpfI7KTdUbzSLRvWsQkIxxY1Wo_0 2024-04-03T05:14:09.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.114768490904141439', time=2024-04-03T06:32:44.789213+0000, chain.objs.size()=1 2024-04-03T05:14:09.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.63c2h4meAmO_-jNI3Rx_dOpQLOzXiSU_0 2024-04-03T05:14:09.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6135655471531367330', time=2024-04-03T06:32:44.878181+0000, chain.objs.size()=1 2024-04-03T05:14:09.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ZJSNI2U6dKiPa5OdzDXqZ8Zfj7imAoC_0 2024-04-03T05:14:09.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.712651996100049585', time=2024-04-03T06:32:45.640037+0000, chain.objs.size()=1 2024-04-03T05:14:09.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9W6uKmJ-KIAjAVatI3Cysz-HEBa-E6K_0 2024-04-03T05:14:09.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18385979466048226267', time=2024-04-03T06:32:47.390360+0000, chain.objs.size()=1 2024-04-03T05:14:09.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FLvBCbkq-KMGpilDzBvlAhqSWtm-UZg_0 2024-04-03T05:14:09.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5985717037138724414', time=2024-04-03T06:32:47.968931+0000, chain.objs.size()=1 2024-04-03T05:14:09.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cmm7vS7z7nJfb5sBdVkhur7V5v3ihpi_0 2024-04-03T05:14:09.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3146578889166246238', time=2024-04-03T06:32:48.119470+0000, chain.objs.size()=1 2024-04-03T05:14:09.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.eoAiDdmuEYzvkpEtA-5GKfLzFHgnkaI_0 2024-04-03T05:14:09.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13507997406348706808', time=2024-04-03T06:32:48.384713+0000, chain.objs.size()=1 2024-04-03T05:14:09.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.925+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DC_o3g1fn7As2en18JQ-6c4DrGnESjK_0 2024-04-03T05:14:09.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17799895157276997637', time=2024-04-03T06:32:48.528139+0000, chain.objs.size()=1 2024-04-03T05:14:09.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4LMIUHgbpsDoiXeGceBwWmgZv3w6_yQ_0 2024-04-03T05:14:09.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1030511350774688947', time=2024-04-03T06:32:49.021043+0000, chain.objs.size()=1 2024-04-03T05:14:09.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gAUGLNBb-WUwXWzxgGhaqGFv7lvtNXg_0 2024-04-03T05:14:09.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13012865314531266499', time=2024-04-03T06:32:49.198603+0000, chain.objs.size()=1 2024-04-03T05:14:09.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OxDkOlg4t4EgoFH2ms86rtgO01hr_wy_0 2024-04-03T05:14:09.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10869912105561720566', time=2024-04-03T06:32:50.956496+0000, chain.objs.size()=1 2024-04-03T05:14:09.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.0vGHQpMsutdV-uf7lg1WUG1LnlyGQL4_0 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9628902579981043365', time=2024-04-03T06:32:51.547143+0000, chain.objs.size()=1 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7bT-LuCisW0OgjPnlQ6qCBpSsmH7t1e_0 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16149111717869826263', time=2024-04-03T06:32:51.646795+0000, chain.objs.size()=1 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.JzSVMLk6hgPDGnAsN-uBpI_upEnxkBt_0 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18299394874171009590', time=2024-04-03T06:32:51.648733+0000, chain.objs.size()=1 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.KuA5QQ3U4mbx04pkNpZhKXNhQDAt9Cs_0 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7577491510634759370', time=2024-04-03T06:34:29.371674+0000, chain.objs.size()=1 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Sa0yDeiWuKQvpnI4Ququ4ZzE0IY8wc3_0 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1127724358337033211', time=2024-04-03T06:34:29.424682+0000, chain.objs.size()=1 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SHCBDjcPbXchOGZNNjdSU8dj1SEFVqg_0 2024-04-03T05:14:09.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16731634332714522325', time=2024-04-03T06:34:29.691106+0000, chain.objs.size()=1 2024-04-03T05:14:09.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.RjQNNd3AM-F5_X_c4Sjiy9arVEhg6eb_0 2024-04-03T05:14:09.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11235201339929264324', time=2024-04-03T06:34:30.240313+0000, chain.objs.size()=1 2024-04-03T05:14:09.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.929+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.aGuT6eGza7bdf_0RQP-XGpwzHo6INDO_0 2024-04-03T05:14:09.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9007413092669158478', time=2024-04-03T06:34:30.376527+0000, chain.objs.size()=1 2024-04-03T05:14:09.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ENS2vlEpUDk1T41kY0yGGV06K-CBTx7_0 2024-04-03T05:14:09.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13401661761026435362', time=2024-04-03T06:34:31.030488+0000, chain.objs.size()=1 2024-04-03T05:14:09.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XMPTGhGRKag9jscimop85tkYF0s5cro_0 2024-04-03T05:14:09.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5738730319206001405', time=2024-04-03T06:34:31.083171+0000, chain.objs.size()=1 2024-04-03T05:14:09.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BcV_cG7kG9o7Kl09eyNsO4oTbVffkAf_0 2024-04-03T05:14:09.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2858154313877463208', time=2024-04-03T06:34:32.482457+0000, chain.objs.size()=1 2024-04-03T05:14:09.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KxvXApaS0q7ZFxs0exPRomELyBUnlTM_0 2024-04-03T05:14:09.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18201905579937867805', time=2024-04-03T06:34:32.607715+0000, chain.objs.size()=1 2024-04-03T05:14:09.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-ayD099noYojRCkFDgY_7XmT_56urvp_0 2024-04-03T05:14:09.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15579005828237606650', time=2024-04-03T06:34:33.467767+0000, chain.objs.size()=1 2024-04-03T05:14:09.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TD121OL3FcwlEKgjhS75uPSR5jl90eo_0 2024-04-03T05:14:09.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5831046125932513354', time=2024-04-03T06:34:33.761653+0000, chain.objs.size()=1 2024-04-03T05:14:09.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2T4LLNa_XajjgglF3LR4j_IZhtQG60E_0 2024-04-03T05:14:09.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14044557693917669092', time=2024-04-03T06:34:34.110865+0000, chain.objs.size()=1 2024-04-03T05:14:09.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.933+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VBpSU-1Oo6AbpaPedZaUSm9tHWnYSLD_0 2024-04-03T05:14:09.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12125377734455201020', time=2024-04-03T06:34:34.554097+0000, chain.objs.size()=1 2024-04-03T05:14:09.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gviT7wMZRWU4PL2RCboH8QS51REBgpO_0 2024-04-03T05:14:09.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18110482575049736494', time=2024-04-03T06:34:36.945606+0000, chain.objs.size()=1 2024-04-03T05:14:09.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CCcVu9e92jiRgMe1HdSaSfwV_YrJ8X2_0 2024-04-03T05:14:09.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18157023935020163534', time=2024-04-03T06:34:37.367433+0000, chain.objs.size()=1 2024-04-03T05:14:09.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Oii_3eNHagcfBbULtL--lVDkchuWqTZ_0 2024-04-03T05:14:09.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11565934094377762815', time=2024-04-03T06:34:38.719058+0000, chain.objs.size()=1 2024-04-03T05:14:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2l4495R8Uwlm0HUZfKaoCcn5xWa__7Q_0 2024-04-03T05:14:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6587841954514580488', time=2024-04-03T06:34:38.721267+0000, chain.objs.size()=1 2024-04-03T05:14:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6FajHURXKYaF3fwte1TLVAUfdz2t-UK_0 2024-04-03T05:14:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8903397666966472170', time=2024-04-03T06:34:38.858952+0000, chain.objs.size()=1 2024-04-03T05:14:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rHZZ7su5kuYIL7Vp7Z7Lr99KErk2-7B_0 2024-04-03T05:14:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.905839970771015030', time=2024-04-03T06:34:40.497665+0000, chain.objs.size()=1 2024-04-03T05:14:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.937+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ZgMsnILwD5ItEA-BqahCupwqQEijZcy_0 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5388648523397283357', time=2024-04-03T06:34:41.336818+0000, chain.objs.size()=1 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CeuXhY5bJ_c6sx-XeFC8gw_pf-cNZM7_0 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6754941672770816575', time=2024-04-03T06:34:42.114984+0000, chain.objs.size()=1 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8l9RwQXk2MuMlunljzpprc9gjRbXdoA_0 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3414772004421102522', time=2024-04-03T06:34:42.439456+0000, chain.objs.size()=1 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VvoH7U_NPkUox0GudmUkk2ifNLybLE3_0 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15362967327750089841', time=2024-04-03T06:34:43.662847+0000, chain.objs.size()=1 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ORACcjoIr0eNSL4Y9eIIASjzM5VmXIB_0 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13650829166884293481', time=2024-04-03T06:34:43.748107+0000, chain.objs.size()=1 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.MU_szkusLaJjfifEH7B-2XdFbZMSN4Z_0 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9020873831669446266', time=2024-04-03T06:34:44.156108+0000, chain.objs.size()=1 2024-04-03T05:14:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.O2v-IfJoYzWQGtutSva4VtVCz6lhVjR_0 2024-04-03T05:14:09.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17092405095131157554', time=2024-04-03T06:34:45.252444+0000, chain.objs.size()=1 2024-04-03T05:14:09.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._aVnOEtUDAReVyracW3tGzVwc6MLJV4_0 2024-04-03T05:14:09.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.857982508705381551', time=2024-04-03T06:34:46.461602+0000, chain.objs.size()=1 2024-04-03T05:14:09.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.NQqJbDwEXzfwLOgcu8543JvI8wPU1vu_0 2024-04-03T05:14:09.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7864501686290100792', time=2024-04-03T06:34:47.940877+0000, chain.objs.size()=1 2024-04-03T05:14:09.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KrYwOZr8s6WrDh7PBrDl76mQdeQ9LFg_0 2024-04-03T05:14:09.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11394984506961688831', time=2024-04-03T06:34:47.951450+0000, chain.objs.size()=1 2024-04-03T05:14:09.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XzLM8n0XOU_uqQidd0Bzjc2KCugnghE_0 2024-04-03T05:14:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11365997253785251787', time=2024-04-03T06:34:48.095910+0000, chain.objs.size()=1 2024-04-03T05:14:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.11CUV6pftkDp6izhR_thuLYje3UMzA5_0 2024-04-03T05:14:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5526911556176360395', time=2024-04-03T06:34:49.761619+0000, chain.objs.size()=1 2024-04-03T05:14:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.941+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SLyw9Od-V7Dvr5N360vytj8PLM0lqq5_0 2024-04-03T05:14:09.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3111005980102708417', time=2024-04-03T06:34:50.875311+0000, chain.objs.size()=1 2024-04-03T05:14:09.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.O7DlwPDpS12G_PYCWp99sjYDdQ-BS-C_0 2024-04-03T05:14:09.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17698380517326985613', time=2024-04-03T06:34:52.479589+0000, chain.objs.size()=1 2024-04-03T05:14:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.WkIoHYrcBw6RGatpAj3HHcBEQUnLXPs_0 2024-04-03T05:14:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7201919893772581274', time=2024-04-03T06:34:53.194106+0000, chain.objs.size()=1 2024-04-03T05:14:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cES8UulEbwwcPaCoHrpFzQXmKqvM2hy_0 2024-04-03T05:14:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1050623040413334171', time=2024-04-03T06:34:54.350952+0000, chain.objs.size()=1 2024-04-03T05:14:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.t8h0Asg1GLX8O9Oxr7jH_S8E9pzW5vS_0 2024-04-03T05:14:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18017033994046689810', time=2024-04-03T06:34:54.406340+0000, chain.objs.size()=1 2024-04-03T05:14:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.WGRsKzm6tBOBWaJDqMFtizgVQ4WZe3O_0 2024-04-03T05:14:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11626285198679597844', time=2024-04-03T06:37:39.255219+0000, chain.objs.size()=1 2024-04-03T05:14:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.945+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.378__shadow_.lXx3CKGjAliYDt7jWPgrpXtH9yhsoC0_0 2024-04-03T05:14:09.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.949+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/42966 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1524369457275807053', time=2024-04-03T06:39:43.434087+0000, chain.objs.size()=1 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.434__shadow_.-mHgHLozYS0OoKt7L6CsMpFtJVP9OBN_0 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4818294990455308337', time=2024-04-03T06:39:45.390614+0000, chain.objs.size()=1 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.435__shadow_.TGh16T5om-r94_XX6bymJhWII7OaItL_0 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1644693100204587753', time=2024-04-03T06:40:14.272725+0000, chain.objs.size()=1 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.ZWhSEo3LFin1QDY9Tko617ML-uUVppN_0 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2952815618451392558', time=2024-04-03T06:40:50.558768+0000, chain.objs.size()=1 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.468__shadow_.y9lpsO-pGEHJeGZrNYXi8IjJ_emTRrm_0 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_1_911c486c56c2bcec57e79257cb95c286', time=2024-04-03T06:41:03.286693+0000, chain.objs.size()=1 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_0 2024-04-03T05:14:09.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2_14713f5a7e38b1c1b4bafc3df20fb55a', time=2024-04-03T06:41:43.951174+0000, chain.objs.size()=6 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.1 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.2 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.3 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.4 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.5 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477__multipart_srcmultipart.2~9-Nor70nQSWePkZsdouEqRc4V4ApdcU.6 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7861509191653670392', time=2024-04-03T06:51:06.062485+0000, chain.objs.size()=1 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.521__shadow_.4mZseUjqevHM_AzWId6YNCvnRN-Lmn0_0 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10920423721419880230', time=2024-04-03T06:51:40.773179+0000, chain.objs.size()=1 2024-04-03T05:14:09.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.953+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.525__shadow_.XtFZ0K3uOwK-foXEr4NLV7_oBMt006i_0 2024-04-03T05:14:09.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7160930226203597324', time=2024-04-03T06:52:03.451648+0000, chain.objs.size()=2 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.527__shadow_.DBiHu9KciU_MBlHN9ndFLC1ObcvTAGt_0 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.527__shadow_.DBiHu9KciU_MBlHN9ndFLC1ObcvTAGt_1 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7111251426053664649', time=2024-04-03T06:52:54.282247+0000, chain.objs.size()=1 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:KCaPrbUvfehO3htSHP2lKxJs36P3Man_.AaAmujBCw3Llkphw3Lzw1jY6Eh-S7bF_0 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16099469171822541134', time=2024-04-03T06:52:55.993309+0000, chain.objs.size()=1 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:4QhpeA9DT2DnGILt5m7E6rN2kxUU9fK_.gyMDOalzqaspFX9VlbXjLb7l4-w6cWK_0 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16320414167527850842', time=2024-04-03T06:52:59.060610+0000, chain.objs.size()=1 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:7Fw4jCJ1cKTfPqUTdqGEbje8nZ7-Hih_.MHjkLVldLzzhPIlUE_az8g4P1RHqqiE_0 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10404816728917161095', time=2024-04-03T06:53:18.172498+0000, chain.objs.size()=1 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow:Ejd6bsVwanxqzFIiHzoOSI-jxqL3cJ5_.6GL-MptrItAPSnhINeqeEZ-tNSV5QCG_0 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3721836823513072482', time=2024-04-03T06:53:24.949618+0000, chain.objs.size()=1 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.544__shadow:TM2.fD1skZX5ZRhV4eTMa.4PW5KuVT6_.2FiGP-RWhvffroiEbQA2XI5_Svx7fO1_0 2024-04-03T05:14:09.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13665342425921653329', time=2024-04-03T06:54:16.272406+0000, chain.objs.size()=1 2024-04-03T05:14:09.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:FVdaozx7H7tupbbSDEBQhG2m0QLf7Cs_.zfrV9mrrP6k8yk00ZANTh6GyQaxnsYA_0 2024-04-03T05:14:09.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13205869828238515348', time=2024-04-03T06:55:48.604116+0000, chain.objs.size()=1 2024-04-03T05:14:09.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.556__shadow:q.CZOin8KNF.7fQW0MR53PnLia5quKS_.6c7-1HXBSlZBhS2_5_aJF12HAsmu2jZ_0 2024-04-03T05:14:09.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5513751855937108212', time=2024-04-03T07:05:39.211298+0000, chain.objs.size()=1 2024-04-03T05:14:09.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.957+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.682__shadow:-omaZArshOVyIb855zq60ykPWi1jpO3_.GS_WIz6kXXgATUxgTs81RPocqdOvRn7_0 2024-04-03T05:14:09.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.965+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:09.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-03T05:14:09.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:09.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42556' 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5579660828851672353', time=2024-04-03T06:24:35.096020+0000, chain.objs.size()=1 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.188__shadow_.F_C5XzsTlXrck-PQ792fFVlMlRkdUxj_0 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5763579963931887182', time=2024-04-03T06:25:42.098044+0000, chain.objs.size()=1 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.214__shadow_.nXWfVNzsJvwivEJ0LqdEpfodjdy2ZgO_0 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12446618607768349444', time=2024-04-03T06:25:44.311727+0000, chain.objs.size()=1 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.215__shadow_.E3-beWmO3TK9AFRWIqTYDoT6vvGsnXh_0 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.476015117946173744', time=2024-04-03T06:26:12.561980+0000, chain.objs.size()=1 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.228__shadow_.IMobrwqsq199CqPlRJ4-cybMeEFCRxJ_0 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17749749855603626160', time=2024-04-03T06:27:52.053250+0000, chain.objs.size()=1 2024-04-03T05:14:09.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wYdN1QszFltPX5iT6rTzZYvAGmPM5vB_0 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7120212153016921090', time=2024-04-03T06:27:52.276110+0000, chain.objs.size()=1 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.PT03kL-c3GeRNjGr7_qGFdej94mr8J0_0 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4634019357414892790', time=2024-04-03T06:27:52.393950+0000, chain.objs.size()=1 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ToUKZhELaFNz-oFZi6nL6e_I1QJzz9L_0 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5898622892796504450', time=2024-04-03T06:27:52.981691+0000, chain.objs.size()=1 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yAJwN0mIuKW6OCbw27VHLPMBy5ueybX_0 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8161852218362305740', time=2024-04-03T06:27:54.849471+0000, chain.objs.size()=1 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9M-A2kX5q9leXihrWpXbfWtjnt_VTKn_0 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4800019244051559968', time=2024-04-03T06:27:57.350248+0000, chain.objs.size()=1 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.21w9k21YlsTnMpxYOd0RnQbifNmBvjj_0 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5349465633859527263', time=2024-04-03T06:27:57.539516+0000, chain.objs.size()=1 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.D4FPBIfrBboFMqRhwTHoUfyZSKdEmaU_0 2024-04-03T05:14:09.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2236248067595149165', time=2024-04-03T06:27:57.945725+0000, chain.objs.size()=1 2024-04-03T05:14:09.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.969+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Qt872tOVLh69eWQsF3vFcCa_aQTy6Ck_0 2024-04-03T05:14:09.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15304621703253914205', time=2024-04-03T06:27:58.591906+0000, chain.objs.size()=1 2024-04-03T05:14:09.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.p4Ze_SFSma_l0GGo8EHDMrNQRsS-FZs_0 2024-04-03T05:14:09.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10025832269974866479', time=2024-04-03T06:27:58.936919+0000, chain.objs.size()=1 2024-04-03T05:14:09.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yhT5HcAr32hjSIVNpMvxRhE9Dhj0jEj_0 2024-04-03T05:14:09.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17591417754627394589', time=2024-04-03T06:28:01.558068+0000, chain.objs.size()=1 2024-04-03T05:14:09.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.4es1EQb863BQ1sCm3avvCrjspdla8_j_0 2024-04-03T05:14:09.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15327713906623962542', time=2024-04-03T06:28:01.560047+0000, chain.objs.size()=1 2024-04-03T05:14:09.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.W_BuK51YPxSAsSV5LBilNHWwyAose9-_0 2024-04-03T05:14:09.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3479523165351367207', time=2024-04-03T06:28:02.593320+0000, chain.objs.size()=1 2024-04-03T05:14:09.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.kM4NB_M4nSLjzGy-ro9XkFLqScQW9nP_0 2024-04-03T05:14:09.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10199912496436511447', time=2024-04-03T06:28:02.945944+0000, chain.objs.size()=1 2024-04-03T05:14:09.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nbhjOBWXH8o88tL-8y5f6hfGJk6mhHu_0 2024-04-03T05:14:09.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10046873767179715243', time=2024-04-03T06:28:04.409974+0000, chain.objs.size()=1 2024-04-03T05:14:09.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.973+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jFmmQCIYaFIHHE7tarXeztl0JQBpTEz_0 2024-04-03T05:14:09.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.259214201110280192', time=2024-04-03T06:28:05.230665+0000, chain.objs.size()=1 2024-04-03T05:14:09.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dgh9MURhYcKqQEGGPPTU5zX6UNmngZp_0 2024-04-03T05:14:09.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10952104670314701354', time=2024-04-03T06:28:05.232280+0000, chain.objs.size()=1 2024-04-03T05:14:09.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.NSUrD36v1MmW8PALaH-oScv-VtDflvE_0 2024-04-03T05:14:09.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8132218488091965323', time=2024-04-03T06:28:06.207404+0000, chain.objs.size()=1 2024-04-03T05:14:09.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.kV1eguaaSKQLkXkmwFikUvYydth8JTr_0 2024-04-03T05:14:09.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18071844641669468651', time=2024-04-03T06:28:06.310446+0000, chain.objs.size()=1 2024-04-03T05:14:09.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0xpR3PPC46RJP9VdhA08iEKeTu3iGBD_0 2024-04-03T05:14:09.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4908452859876501064', time=2024-04-03T06:28:08.665265+0000, chain.objs.size()=1 2024-04-03T05:14:09.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mMX7hvpfc0H-0aHq1C3jWD-r3s8ChNQ_0 2024-04-03T05:14:09.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14446795725856568630', time=2024-04-03T06:28:09.271207+0000, chain.objs.size()=1 2024-04-03T05:14:09.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QBchvAwfYTvVpBHoUqqvMkg9IqgTRwf_0 2024-04-03T05:14:09.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12059105778129034489', time=2024-04-03T06:28:10.139096+0000, chain.objs.size()=1 2024-04-03T05:14:09.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.k-d5Y61OwocTt5KH95DBjmcB6S4k-Xo_0 2024-04-03T05:14:09.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17245799072502924442', time=2024-04-03T06:28:10.724330+0000, chain.objs.size()=1 2024-04-03T05:14:09.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MonQkv53aOo82oyMW8KGArpRCa6KxUh_0 2024-04-03T05:14:09.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7587320721141266677', time=2024-04-03T06:28:10.776000+0000, chain.objs.size()=1 2024-04-03T05:14:09.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.U1_q7X_d4ukvb3vc9ycbU_j4V0IAN-Z_0 2024-04-03T05:14:09.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.822419173198880010', time=2024-04-03T06:28:12.241581+0000, chain.objs.size()=1 2024-04-03T05:14:09.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ZHU3dnHBDBEmCCzKu4R1UCAGtWRKg84_0 2024-04-03T05:14:09.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4401477595120087898', time=2024-04-03T06:28:12.623541+0000, chain.objs.size()=1 2024-04-03T05:14:09.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5mYEPOX3Sez0XC-pYfH1vec4RIUj5IB_0 2024-04-03T05:14:09.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.654951708375036779', time=2024-04-03T06:28:13.043081+0000, chain.objs.size()=1 2024-04-03T05:14:09.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nsmbx0AUkwy8HIdql6hv50KANNz5Ed7_0 2024-04-03T05:14:09.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18220350787749879663', time=2024-04-03T06:28:14.271820+0000, chain.objs.size()=1 2024-04-03T05:14:09.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fO2IUchki_j0vczTOKS_y3vp7GNSZsu_0 2024-04-03T05:14:09.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12865967279067675860', time=2024-04-03T06:28:15.559654+0000, chain.objs.size()=1 2024-04-03T05:14:09.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.q2KEMpNk-sGGmJa-3fxXlz5Y9h42fyR_0 2024-04-03T05:14:09.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.80458316402052554', time=2024-04-03T06:28:16.272610+0000, chain.objs.size()=1 2024-04-03T05:14:09.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.977+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UC3FbjIqUPJWv_KlPMcVA3-sW8IOEtF_0 2024-04-03T05:14:09.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11300746567069582066', time=2024-04-03T06:28:17.451504+0000, chain.objs.size()=1 2024-04-03T05:14:09.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.n-TypjIYYISJhsUaZfV6-Y644jiv0P6_0 2024-04-03T05:14:09.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.981+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2347059945681919083', time=2024-04-03T06:28:17.953532+0000, chain.objs.size()=1 2024-04-03T05:14:09.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.981+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_._3WUcAmXTedNhVZ-2TFVtvaOTTkBRVS_0 2024-04-03T05:14:09.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8714590704889919177', time=2024-04-03T06:28:19.136031+0000, chain.objs.size()=1 2024-04-03T05:14:09.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.KiUR6WgnY6jG0kZVmprkBCkTWC6Mq9L_0 2024-04-03T05:14:09.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8443459141142533144', time=2024-04-03T06:28:19.231712+0000, chain.objs.size()=1 2024-04-03T05:14:09.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.n2U04Ih4mVsJuM6jxrPRsxRUgHgrcYh_0 2024-04-03T05:14:09.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15998787184370721671', time=2024-04-03T06:28:19.233754+0000, chain.objs.size()=1 2024-04-03T05:14:09.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9tB30r06r95MnPjOwwit1Gow3Mc0bH5_0 2024-04-03T05:14:09.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15393721754754400515', time=2024-04-03T06:28:20.244937+0000, chain.objs.size()=1 2024-04-03T05:14:09.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wBk9a2BkcR25QP1M5S_MHCWE6QaOiiS_0 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4166299037278935227', time=2024-04-03T06:28:20.276027+0000, chain.objs.size()=1 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.E6GnGCxyZrkbihkZHEYaXIqRtdwzqZx_0 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16065318820746682674', time=2024-04-03T06:28:20.630885+0000, chain.objs.size()=1 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gKvBub7BNRSbz_NW4dMzonKN3F0yy8-_0 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11193750372082938738', time=2024-04-03T06:28:21.167184+0000, chain.objs.size()=1 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.rBi9vl9fKL4gdWYUHjv4VCUSwiOXvye_0 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1944388009128973636', time=2024-04-03T06:28:35.902361+0000, chain.objs.size()=1 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.238__shadow_.hfJoc1B6o80OT2COaAMNonHAmaFEnUD_0 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1772984133024537061', time=2024-04-03T06:28:55.066930+0000, chain.objs.size()=1 2024-04-03T05:14:09.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.247__shadow_.J1m_pgOHcQhayo8wUxd3ML4Lfau_Keo_0 2024-04-03T05:14:09.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1282758972367481610', time=2024-04-03T06:29:03.952242+0000, chain.objs.size()=1 2024-04-03T05:14:09.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.251__shadow_.aSk9lfGzixGz3hOaLFD2jkHehrxo11u_0 2024-04-03T05:14:09.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7255034705385034692', time=2024-04-03T06:29:06.464044+0000, chain.objs.size()=1 2024-04-03T05:14:09.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.252__shadow_.-IEM-SvhGwPsElmwmPDh8O1aO46P25K_0 2024-04-03T05:14:09.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5405450500370066480', time=2024-04-03T06:29:30.863982+0000, chain.objs.size()=1 2024-04-03T05:14:09.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.Te1jYUmfrC7mo2AbGEfv7o3-BtGh03p_0 2024-04-03T05:14:09.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2762769559350876800', time=2024-04-03T06:29:35.922306+0000, chain.objs.size()=1 2024-04-03T05:14:09.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.985+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.ieju88BSAFMaSvHRH5WcFV1_5YjL1rh_0 2024-04-03T05:14:09.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12809832325897960120', time=2024-04-03T06:29:54.144736+0000, chain.objs.size()=1 2024-04-03T05:14:09.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.270__shadow_.h8uFyLWyULSSJXQoxcgxOh9iD0nf_Od_0 2024-04-03T05:14:09.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7836859240847425438', time=2024-04-03T06:30:47.559640+0000, chain.objs.size()=1 2024-04-03T05:14:09.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.291__shadow_.vPxzcNd8WUmej80mUE_vSV-XOeaFrPk_0 2024-04-03T05:14:09.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7173357774818356893', time=2024-04-03T06:32:24.211072+0000, chain.objs.size()=1 2024-04-03T05:14:09.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tZkeHYtbvv4fQfbh4Nhf_4PvJdAsAtt_0 2024-04-03T05:14:09.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8952300272405138460', time=2024-04-03T06:32:24.729440+0000, chain.objs.size()=1 2024-04-03T05:14:09.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.fqFTGCGVfqBbO6LSWZQrCUYDDu_k04T_0 2024-04-03T05:14:09.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13996418917882694425', time=2024-04-03T06:32:24.920810+0000, chain.objs.size()=1 2024-04-03T05:14:09.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.fVgsUrpTtHhU7hvncUsEE4uAdkKyP5z_0 2024-04-03T05:14:09.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2512578321914481442', time=2024-04-03T06:32:25.082361+0000, chain.objs.size()=1 2024-04-03T05:14:09.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-g3orAK7UvOeeIAmepJHDNWp2noimNm_0 2024-04-03T05:14:09.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13589963568718896006', time=2024-04-03T06:32:26.452303+0000, chain.objs.size()=1 2024-04-03T05:14:09.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.h9H-8NgTy2cwzjWzB6NQv8gtRBj8IAo_0 2024-04-03T05:14:09.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4882969827071972949', time=2024-04-03T06:32:29.429754+0000, chain.objs.size()=1 2024-04-03T05:14:09.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.m5lyR3TLX2ZXam6v0dLYlYUUYnIkgWQ_0 2024-04-03T05:14:09.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13151583600226409525', time=2024-04-03T06:32:29.930350+0000, chain.objs.size()=1 2024-04-03T05:14:09.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gxfRVOwanthTxy_8aFLciugI3aJ1vtW_0 2024-04-03T05:14:09.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3816378044156654172', time=2024-04-03T06:32:30.033469+0000, chain.objs.size()=1 2024-04-03T05:14:09.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.199UVCqAaJVDgQQxY6iaAmVfq0kM465_0 2024-04-03T05:14:09.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15247094265692896528', time=2024-04-03T06:32:32.242320+0000, chain.objs.size()=1 2024-04-03T05:14:09.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.989+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yQp6AouMQXN_dZ2ZrYn4vgn0liVFxOW_0 2024-04-03T05:14:09.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7742747281921910271', time=2024-04-03T06:32:32.970840+0000, chain.objs.size()=1 2024-04-03T05:14:09.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._Tg5zd576nRV5Psjfet-JeWs5TBYj15_0 2024-04-03T05:14:09.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13977965976921534508', time=2024-04-03T06:32:33.100280+0000, chain.objs.size()=1 2024-04-03T05:14:09.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.LBBSh-_kJ2YNPIlDKjLZNQSa9q4BCxZ_0 2024-04-03T05:14:09.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.157549878231193615', time=2024-04-03T06:32:34.097633+0000, chain.objs.size()=1 2024-04-03T05:14:09.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.boMLmLCVVGfiYfP55wTcETtBqLCNJ1n_0 2024-04-03T05:14:09.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7277577930329246309', time=2024-04-03T06:32:36.707309+0000, chain.objs.size()=1 2024-04-03T05:14:09.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DZb0qyrcXUmlAoW6jpcr7c2RD-BbvZR_0 2024-04-03T05:14:09.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9113727819189517251', time=2024-04-03T06:32:36.989930+0000, chain.objs.size()=1 2024-04-03T05:14:09.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.PcY7WLc1oe6RoKKFlSYviI2-CfWvFv2_0 2024-04-03T05:14:10.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9965215811927040152', time=2024-04-03T06:32:37.844178+0000, chain.objs.size()=1 2024-04-03T05:14:10.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Kcz_bAv-3g414yD3RIRBqypv7-PWV_1_0 2024-04-03T05:14:10.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4885270903872520045', time=2024-04-03T06:32:39.408836+0000, chain.objs.size()=1 2024-04-03T05:14:10.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Wl0F6bI8uivIGMtwXHMYWTgFzoeKLP0_0 2024-04-03T05:14:10.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9659407372942695507', time=2024-04-03T06:32:39.733711+0000, chain.objs.size()=1 2024-04-03T05:14:10.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qSI_u-aX2wAaRbDpVcuDW0U63t1dEDX_0 2024-04-03T05:14:10.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4911710676046415967', time=2024-04-03T06:32:41.059450+0000, chain.objs.size()=1 2024-04-03T05:14:10.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.kv-yU8yQmDoWyvpp4iy5H4uhWPx5Y7E_0 2024-04-03T05:14:10.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3770639537968133865', time=2024-04-03T06:32:43.369076+0000, chain.objs.size()=1 2024-04-03T05:14:10.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.oHthTp5zYJNd56AMw6jZRotq-wWQuN9_0 2024-04-03T05:14:10.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3256998897812820463', time=2024-04-03T06:32:43.864568+0000, chain.objs.size()=1 2024-04-03T05:14:10.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.993+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qDRdFtbZtn4ABMT1Sy4Jkh99yij9qiP_0 2024-04-03T05:14:10.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13959756568954279762', time=2024-04-03T06:32:44.154795+0000, chain.objs.size()=1 2024-04-03T05:14:10.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.u_f3VryL-HPILUrzf1jFDAx3LdBONgS_0 2024-04-03T05:14:10.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15389236085872911561', time=2024-04-03T06:32:44.284971+0000, chain.objs.size()=1 2024-04-03T05:14:10.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.V-6wVwNW1npTicJJd0fZCqeN75ZAJ2s_0 2024-04-03T05:14:10.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14304042104272464815', time=2024-04-03T06:32:44.513448+0000, chain.objs.size()=1 2024-04-03T05:14:10.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-q7jBccCKXYTsfF-VvbhSy4K_YSEa-Z_0 2024-04-03T05:14:10.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10812215107807418562', time=2024-04-03T06:32:45.614864+0000, chain.objs.size()=1 2024-04-03T05:14:10.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4ljRCUFh64nXHW47kLJ6VBRP6xHTohV_0 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2515654558331093383', time=2024-04-03T06:32:46.833268+0000, chain.objs.size()=1 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.U4wH7pxtklq7M5xehE3f2AeaciCXZcq_0 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2234748004168637387', time=2024-04-03T06:32:46.955293+0000, chain.objs.size()=1 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FL_g-8i0vInVSAAJQYsn5czO2L7V6Nk_0 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4937608365418429752', time=2024-04-03T06:32:47.227406+0000, chain.objs.size()=1 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yKrjCR71tLaD7kLuoBLMHhrPFtl-Hf__0 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13231575314172485180', time=2024-04-03T06:32:48.423185+0000, chain.objs.size()=1 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9lxFu2dTfZhyPRlGtc71UErn0i3AB27_0 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7824286467514531744', time=2024-04-03T06:32:48.847758+0000, chain.objs.size()=1 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VNk9f3OEu5TtP_jqP1Vn8eZgudZcukQ_0 2024-04-03T05:14:10.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6961818158930116800', time=2024-04-03T06:32:49.921369+0000, chain.objs.size()=1 2024-04-03T05:14:10.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uAAC0oFcRIpdkQSDddnKG1YCjv7y2sg_0 2024-04-03T05:14:10.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18247251480093537040', time=2024-04-03T06:32:50.296061+0000, chain.objs.size()=1 2024-04-03T05:14:10.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:09.997+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6UXpoHFYLjIOkpVG6dtlQIBIvc9ak9O_0 2024-04-03T05:14:10.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.001+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3372664260068700975', time=2024-04-03T06:32:51.074787+0000, chain.objs.size()=1 2024-04-03T05:14:10.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.001+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Z3FbpEsqviFAdOuBewr2UyF0dLNFkgx_0 2024-04-03T05:14:10.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12382367183078534189', time=2024-04-03T06:32:51.295463+0000, chain.objs.size()=1 2024-04-03T05:14:10.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.X60Q8FHALPHikaX6pzbMM5u2gfK-WZt_0 2024-04-03T05:14:10.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10630736931264774696', time=2024-04-03T06:32:51.297342+0000, chain.objs.size()=1 2024-04-03T05:14:10.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pts0fkFGqGdKaN76U8X2m3DF3yDSJmQ_0 2024-04-03T05:14:10.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8295972836584817697', time=2024-04-03T06:32:51.838366+0000, chain.objs.size()=1 2024-04-03T05:14:10.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.n9N74thfBEdhOH7M_f5rSEAJmrgeYQc_0 2024-04-03T05:14:10.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2962365649603992153', time=2024-04-03T06:34:28.629561+0000, chain.objs.size()=1 2024-04-03T05:14:10.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3k7SP-aT1AEdmxBYWdxnww5DopXl0wK_0 2024-04-03T05:14:10.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13951708993543713393', time=2024-04-03T06:34:29.127813+0000, chain.objs.size()=1 2024-04-03T05:14:10.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.mIYfpkbqzvQ-b7dy5QWC9VVfwAG0c93_0 2024-04-03T05:14:10.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16792651683999431045', time=2024-04-03T06:34:29.409725+0000, chain.objs.size()=1 2024-04-03T05:14:10.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Bl7LyGwUiRrfQ5uEuFEI4qGiysIZWyT_0 2024-04-03T05:14:10.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3764954827241148308', time=2024-04-03T06:34:29.581767+0000, chain.objs.size()=1 2024-04-03T05:14:10.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4TPGdelJPvLW4BXsRHckOf8y_l5LDis_0 2024-04-03T05:14:10.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13485844938439439424', time=2024-04-03T06:34:29.794750+0000, chain.objs.size()=1 2024-04-03T05:14:10.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vhjFxvRt4c7aAsH_9ZC0dMP7RMst0Kn_0 2024-04-03T05:14:10.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3893858367992818629', time=2024-04-03T06:34:30.965399+0000, chain.objs.size()=1 2024-04-03T05:14:10.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.EpuYdRrBUP-HshUI13k3HWzbD3MDz-t_0 2024-04-03T05:14:10.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11824667158749017010', time=2024-04-03T06:34:31.297302+0000, chain.objs.size()=1 2024-04-03T05:14:10.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.stfjyHZa4cv5e-CxOeL4aZdqKsqnMl9_0 2024-04-03T05:14:10.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16548188442309168718', time=2024-04-03T06:34:33.683655+0000, chain.objs.size()=1 2024-04-03T05:14:10.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.mllpa7f0wao-fpiDlaqVlWhxNOZoImq_0 2024-04-03T05:14:10.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5793437764399493619', time=2024-04-03T06:34:33.757570+0000, chain.objs.size()=1 2024-04-03T05:14:10.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.005+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ZbHpucmQROqwJdHPtzyllMoYTZj67MD_0 2024-04-03T05:14:10.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6662650757722055349', time=2024-04-03T06:34:34.944422+0000, chain.objs.size()=1 2024-04-03T05:14:10.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6EoHCkikScTEUDKU4Eq7OTfreztoZbD_0 2024-04-03T05:14:10.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17886350832554503465', time=2024-04-03T06:34:35.030734+0000, chain.objs.size()=1 2024-04-03T05:14:10.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YhnmtHN6Q_Nxj_iHBbsYinmQ1nnT4tr_0 2024-04-03T05:14:10.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1978877171351318712', time=2024-04-03T06:34:36.735345+0000, chain.objs.size()=1 2024-04-03T05:14:10.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2ldB6Ai8JfTFLs0Q3Ri2mM2t8QfLIia_0 2024-04-03T05:14:10.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2946235496672959162', time=2024-04-03T06:34:37.638736+0000, chain.objs.size()=1 2024-04-03T05:14:10.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dAZXI4Sohev86IpzDsxiD1UB-_HAk_T_0 2024-04-03T05:14:10.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16154848333682777636', time=2024-04-03T06:34:37.803803+0000, chain.objs.size()=1 2024-04-03T05:14:10.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.009+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zQ_H1MENvdxho2ZC_YvfVOsl6XG9FC5_0 2024-04-03T05:14:10.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.013+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/42556 2024-04-03T05:14:10.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4402437306630099463', time=2024-04-03T06:34:38.359069+0000, chain.objs.size()=1 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ugB-TosSYf2DAlhDZsUt1LlNjzIXthX_0 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.184829576487316409', time=2024-04-03T06:34:38.420548+0000, chain.objs.size()=1 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.mO3jBi82Enr2zaeZMKh1tdn4uQ18aEl_0 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14551343104601500274', time=2024-04-03T06:34:40.059905+0000, chain.objs.size()=1 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CFMbaxli_Icq1kS4s3pMbX-mwzsi4tF_0 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7213241410933980929', time=2024-04-03T06:34:41.266726+0000, chain.objs.size()=1 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7f8PkkKPULJrmM_HD41OSX9H19ASKI0_0 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10550703929474972857', time=2024-04-03T06:34:41.792918+0000, chain.objs.size()=1 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DUltSV9WQ6a5f1so6ONIYHPVD2cOcCN_0 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5856670479299368846', time=2024-04-03T06:34:42.656404+0000, chain.objs.size()=1 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-bzFiUZTzfylPI-3uVVLzHd7LJeaB12_0 2024-04-03T05:14:10.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.806913202012047346', time=2024-04-03T06:34:44.079553+0000, chain.objs.size()=1 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wuQouIzQjEoA-bc1k1vBaLBR_DSo1_n_0 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18243353324386013438', time=2024-04-03T06:34:45.588455+0000, chain.objs.size()=1 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4lvjI57xTtc8UMygh0iRjzVxmUzEc5F_0 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16738145977146010910', time=2024-04-03T06:34:48.778471+0000, chain.objs.size()=1 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wG06ymjM4-yJiz-U15NcdIm4xw2Vx-D_0 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17722581073598400363', time=2024-04-03T06:34:48.966905+0000, chain.objs.size()=1 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.z8DWVxy0aZBPMkQy0Av8iaF8PxQafaV_0 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10511023184907164161', time=2024-04-03T06:34:49.169365+0000, chain.objs.size()=1 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.--AdoV7GFnEGM12KyZui1IkZTv2-kGP_0 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10049244027854839381', time=2024-04-03T06:34:50.032333+0000, chain.objs.size()=1 2024-04-03T05:14:10.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.017+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DZrC_LK85QrCAez7PyYakQxpdDtfqVz_0 2024-04-03T05:14:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6273069109898703413', time=2024-04-03T06:34:51.790437+0000, chain.objs.size()=1 2024-04-03T05:14:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.RyTYIW-lnooPJqucetX1_2REDx3cev6_0 2024-04-03T05:14:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17456011060661026845', time=2024-04-03T06:34:53.600787+0000, chain.objs.size()=1 2024-04-03T05:14:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.PyKxtP9F0pOgkLVH8ttzzelqw4_0Cad_0 2024-04-03T05:14:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2472691230470645335', time=2024-04-03T06:41:57.774282+0000, chain.objs.size()=1 2024-04-03T05:14:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.483__multipart_mymultipart.2~YiNwihtURxUZwkrmcqtVJcFtfKwYmSo.1 2024-04-03T05:14:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11799000609145760521', time=2024-04-03T06:52:47.120025+0000, chain.objs.size()=1 2024-04-03T05:14:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:G4pAccvtvF4lLS0OmEqZXrHrqUzaMsl_.IdLO6fFsJAf1vvjYvcu4Noxun3TpIht_0 2024-04-03T05:14:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2651103658988906518', time=2024-04-03T06:53:02.170026+0000, chain.objs.size()=1 2024-04-03T05:14:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.539__shadow:iWR4PF29xu-Yk4dEZYZEvtC1pEM6vsP_.DpCHwNFBnpzkRnpW_klv8f9Zm9o6zdu_0 2024-04-03T05:14:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6152712970993067917', time=2024-04-03T06:53:30.922434+0000, chain.objs.size()=1 2024-04-03T05:14:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:TGgFiYWedB97cH.aSNYyTqOrV-yzK-1_.Bhbkf2Nq1TpaHCOUqPlRGm990TIUdOG_0 2024-04-03T05:14:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15041124138542336730', time=2024-04-03T06:56:05.290569+0000, chain.objs.size()=1 2024-04-03T05:14:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.565__shadow_.yN_XS4IZwh-OTMoVio3kON3-fwxSCb__0 2024-04-03T05:14:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14327044817003635736', time=2024-04-03T07:01:11.869973+0000, chain.objs.size()=1 2024-04-03T05:14:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.599__shadow_.4ykk7USvFX6twzuB1qWwhmEFGVd4me9_0 2024-04-03T05:14:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8809439716035960704', time=2024-04-03T07:04:08.690786+0000, chain.objs.size()=1 2024-04-03T05:14:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.021+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.644__shadow_.AntlSANKOIJjMkq3eGMAR0V2SqTXMm0_0 2024-04-03T05:14:10.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.025+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:10.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.029+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-03T05:14:10.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.029+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:10.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.029+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50822' 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9691546029346583592', time=2024-04-03T06:21:34.329901+0000, chain.objs.size()=5 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__multipart_mymultipart-FROZEN.2~moIhKkIeA6CSZaEDQHwPBS__2fudGVl.1 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__shadow_mymultipart-FROZEN.2~moIhKkIeA6CSZaEDQHwPBS__2fudGVl.1_1 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__multipart_mymultipart-FROZEN.2~moIhKkIeA6CSZaEDQHwPBS__2fudGVl.2 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__shadow_mymultipart-FROZEN.2~moIhKkIeA6CSZaEDQHwPBS__2fudGVl.2_1 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.148__multipart_mymultipart-FROZEN.2~moIhKkIeA6CSZaEDQHwPBS__2fudGVl.3 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14968860726819462222', time=2024-04-03T06:23:55.658062+0000, chain.objs.size()=1 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.177__shadow_.tuJ2kcf3QJrNdAlgZDtpu-j44GNgh2l_0 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11276320160323008953', time=2024-04-03T06:25:14.791034+0000, chain.objs.size()=1 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.204__shadow_.QLzCj2z20NX6ph36HiWNtA5uTsA9sVZ_0 2024-04-03T05:14:10.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16555012528729081532', time=2024-04-03T06:25:20.712446+0000, chain.objs.size()=1 2024-04-03T05:14:10.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.206__shadow_.V9SlpaXGd_cb2eGB_bHLBshqCHeDrRj_0 2024-04-03T05:14:10.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.572678833547631956', time=2024-04-03T06:25:39.901652+0000, chain.objs.size()=1 2024-04-03T05:14:10.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.213__shadow_.sKxH-h5UhZbtjHjTECVcX92NsAtvu1o_0 2024-04-03T05:14:10.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8064337978763885101', time=2024-04-03T06:25:42.098118+0000, chain.objs.size()=1 2024-04-03T05:14:10.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.214__shadow_.uhRbOwgeClnr9ZsEVD4zrKVvEQZY4Ei_0 2024-04-03T05:14:10.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5758700784919856443', time=2024-04-03T06:25:46.513599+0000, chain.objs.size()=1 2024-04-03T05:14:10.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.216__shadow_.apsFAuGGqFfReYjiAey06l4exyzKZvg_0 2024-04-03T05:14:10.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9988710207771961753', time=2024-04-03T06:26:06.291258+0000, chain.objs.size()=1 2024-04-03T05:14:10.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.033+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.225__shadow_.pJSYAV-slWamT8IA2FjKTe8uNcmJCRZ_0 2024-04-03T05:14:10.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6134035523892050021', time=2024-04-03T06:26:08.353952+0000, chain.objs.size()=1 2024-04-03T05:14:10.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.226__shadow_.d-hebJ45UbbtcdOOTVkwP-_ujA0KjB6_0 2024-04-03T05:14:10.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16233591185920347541', time=2024-04-03T06:27:52.163229+0000, chain.objs.size()=1 2024-04-03T05:14:10.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5UxZW9Sb-E_Fht4BQOVsMXR4Kzi4Dwk_0 2024-04-03T05:14:10.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15190975938471687914', time=2024-04-03T06:27:53.685638+0000, chain.objs.size()=1 2024-04-03T05:14:10.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.J4ETlsvlsmIZHj9ImTQllUwSBvQHU5S_0 2024-04-03T05:14:10.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4124541344090391298', time=2024-04-03T06:27:54.230453+0000, chain.objs.size()=1 2024-04-03T05:14:10.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.i3P6boiy8HvCVycHflkVLyVw5F4oB7B_0 2024-04-03T05:14:10.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12714596292220262127', time=2024-04-03T06:27:54.415156+0000, chain.objs.size()=1 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.h9tZECSR2eQ3LnbhcatTcqjamgsMEby_0 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4939185805433780379', time=2024-04-03T06:27:54.483246+0000, chain.objs.size()=1 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.B-0_mTha_ciOj1KfIrT1ZeGCxSbySK5_0 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6621080876333145794', time=2024-04-03T06:27:55.164968+0000, chain.objs.size()=1 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.W_rXQuXYPeghLpbkT1P3AW7c5IqYMYZ_0 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7080477188357675050', time=2024-04-03T06:27:56.198270+0000, chain.objs.size()=1 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7FYntF0bAcgLko637eQ1V5ZbQ00SaRC_0 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8863624502569168166', time=2024-04-03T06:27:56.357617+0000, chain.objs.size()=1 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6kfMJflFADpH8Jq_mStVQPm26T_vBKP_0 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14659464695053105023', time=2024-04-03T06:27:56.359243+0000, chain.objs.size()=1 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.swrCORc1IM3hdyRl7PPFUkVLR_EJ270_0 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5947956009798484103', time=2024-04-03T06:27:56.823565+0000, chain.objs.size()=1 2024-04-03T05:14:10.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gB5Eftls7NQoh0XA60O1jSF9rCJYbBc_0 2024-04-03T05:14:10.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10309062449692609265', time=2024-04-03T06:27:57.810302+0000, chain.objs.size()=1 2024-04-03T05:14:10.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.037+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ddKBMAVDDlE67ccXRZnYpcZD0Xb6SUo_0 2024-04-03T05:14:10.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18288576769770851707', time=2024-04-03T06:27:59.028070+0000, chain.objs.size()=1 2024-04-03T05:14:10.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yViGAaiRXqJp_bmFf7uNlkumIgTxvN9_0 2024-04-03T05:14:10.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14058407446182516471', time=2024-04-03T06:28:00.875878+0000, chain.objs.size()=1 2024-04-03T05:14:10.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qRXLkqCIp9PcmAiMur5wU7jSLyhwkvp_0 2024-04-03T05:14:10.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9352822462219492428', time=2024-04-03T06:28:02.142368+0000, chain.objs.size()=1 2024-04-03T05:14:10.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Go3v_uYZ33dLlAQ9b8pGlI5JDDIXGfx_0 2024-04-03T05:14:10.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2726272200734782480', time=2024-04-03T06:28:02.491425+0000, chain.objs.size()=1 2024-04-03T05:14:10.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yGFbVxsKZOnH_877CZWe3owfo7-1AoS_0 2024-04-03T05:14:10.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.601120557183942992', time=2024-04-03T06:28:03.988418+0000, chain.objs.size()=1 2024-04-03T05:14:10.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QjhGefWeM90upstNbyo3CP5AflLXdBN_0 2024-04-03T05:14:10.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5371252468341650061', time=2024-04-03T06:28:04.159227+0000, chain.objs.size()=1 2024-04-03T05:14:10.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tXSuulcqps8G3HZ4rnEVFZallAkQKGk_0 2024-04-03T05:14:10.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11641309983734894092', time=2024-04-03T06:28:05.097068+0000, chain.objs.size()=1 2024-04-03T05:14:10.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nYyfqCzB_DfL2WbWjMwhu_y4tjRRycQ_0 2024-04-03T05:14:10.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15422508659023558571', time=2024-04-03T06:28:05.098830+0000, chain.objs.size()=1 2024-04-03T05:14:10.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6Kt9HwvyQovGxGMnZm_A3AThBL24rET_0 2024-04-03T05:14:10.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10319730671446150466', time=2024-04-03T06:28:07.789796+0000, chain.objs.size()=1 2024-04-03T05:14:10.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wauL1d6AMrAkKuvEOwYMzV97xsI4hxw_0 2024-04-03T05:14:10.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3976326646033975987', time=2024-04-03T06:28:09.875078+0000, chain.objs.size()=1 2024-04-03T05:14:10.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.041+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.KQ1nObhctl5Jq_rcKXh1_1RkT6iCWZ7_0 2024-04-03T05:14:10.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16585507050196050169', time=2024-04-03T06:28:13.440093+0000, chain.objs.size()=1 2024-04-03T05:14:10.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.bU23hz-qxfHrlGniop0pyVLD2_HWmUG_0 2024-04-03T05:14:10.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16179963907684759309', time=2024-04-03T06:28:13.920636+0000, chain.objs.size()=1 2024-04-03T05:14:10.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3r3YLJR8CJyuNDVtyi3VBp70KFSorO7_0 2024-04-03T05:14:10.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9368823241133234887', time=2024-04-03T06:28:15.907877+0000, chain.objs.size()=1 2024-04-03T05:14:10.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.YPeRIAl_Dqg_VdKZYJ0Kwfb83vTfric_0 2024-04-03T05:14:10.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13935162846152395707', time=2024-04-03T06:28:16.191146+0000, chain.objs.size()=1 2024-04-03T05:14:10.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jgQtyxsB4-EJ02D_ZmDoXnUDWimImMM_0 2024-04-03T05:14:10.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2342509957014362326', time=2024-04-03T06:28:16.392275+0000, chain.objs.size()=1 2024-04-03T05:14:10.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dhBLiKNz5u4xao6tUCVt8wYneVVTS5T_0 2024-04-03T05:14:10.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10860090986836920163', time=2024-04-03T06:28:17.570489+0000, chain.objs.size()=1 2024-04-03T05:14:10.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sctMKgrjbXaeQuuPeyxzK3lQhCT5una_0 2024-04-03T05:14:10.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12514655437949404442', time=2024-04-03T06:28:17.991830+0000, chain.objs.size()=1 2024-04-03T05:14:10.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eCKGJ25iFwIkhZcTr5NIhOwyqh8ih9K_0 2024-04-03T05:14:10.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13691924055532989878', time=2024-04-03T06:28:42.146659+0000, chain.objs.size()=1 2024-04-03T05:14:10.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.241__shadow_.-JsnnGK194j7lAqm8C62DZ9QPt_4C6__0 2024-04-03T05:14:10.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1529051710496280886', time=2024-04-03T06:28:48.477426+0000, chain.objs.size()=1 2024-04-03T05:14:10.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.244__shadow_.iov4C9nnvpSf3KVzzdH8JptXTXuID5T_0 2024-04-03T05:14:10.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17839300880051775629', time=2024-04-03T06:29:54.127548+0000, chain.objs.size()=1 2024-04-03T05:14:10.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.270__shadow_.WzD-eyomgTH7B6iO5xKPFHziNtR00S6_0 2024-04-03T05:14:10.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11193560157230314263', time=2024-04-03T06:30:00.753476+0000, chain.objs.size()=1 2024-04-03T05:14:10.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.045+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.273__shadow_.DooPw7nIHnYkNybN87BSrI5FJcelHfX_0 2024-04-03T05:14:10.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.477061408084448457', time=2024-04-03T06:30:45.128731+0000, chain.objs.size()=1 2024-04-03T05:14:10.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.290__shadow_.kapKXia0QDV2JWC2Q7vKH3Da3h3rK8Q_0 2024-04-03T05:14:10.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10542093388968102573', time=2024-04-03T06:32:24.210043+0000, chain.objs.size()=1 2024-04-03T05:14:10.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.sOhgS0o5plAUNrRun4yy003joUou5Lk_0 2024-04-03T05:14:10.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17226213722340323606', time=2024-04-03T06:32:24.545064+0000, chain.objs.size()=1 2024-04-03T05:14:10.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._3vZtUX2Yb1pgoI0s53wL81hog6ns0n_0 2024-04-03T05:14:10.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14581501364005020006', time=2024-04-03T06:32:24.802598+0000, chain.objs.size()=1 2024-04-03T05:14:10.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.oVF7qfArdojSq9XUFFx28HLO-6xqAnz_0 2024-04-03T05:14:10.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13797272999559556455', time=2024-04-03T06:32:24.839867+0000, chain.objs.size()=1 2024-04-03T05:14:10.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gSS3k5UYsWPVFo1t8qbdprdtrJur4O0_0 2024-04-03T05:14:10.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13239251831569762685', time=2024-04-03T06:32:26.274724+0000, chain.objs.size()=1 2024-04-03T05:14:10.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.nNuUcfLsNLrMwlp26ck4hZU2Jd6PJ5Z_0 2024-04-03T05:14:10.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3021776180919852753', time=2024-04-03T06:32:26.952813+0000, chain.objs.size()=1 2024-04-03T05:14:10.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BJi2s2KkhXvm0rS58HaUj_9zl7zlYST_0 2024-04-03T05:14:10.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9729806472949689030', time=2024-04-03T06:32:26.956667+0000, chain.objs.size()=1 2024-04-03T05:14:10.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.eG5DybJf72mCHg30uWNowspJaj-qnfd_0 2024-04-03T05:14:10.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2431228717661884421', time=2024-04-03T06:32:30.492938+0000, chain.objs.size()=1 2024-04-03T05:14:10.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.049+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4CcXwDTW0L9zbmJK-3kYwAuW2d_Kgzl_0 2024-04-03T05:14:10.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5275127045203774441', time=2024-04-03T06:32:30.742383+0000, chain.objs.size()=1 2024-04-03T05:14:10.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.a58mrRcV9zn_vLGChP0p3ixZ_pT68p2_0 2024-04-03T05:14:10.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8309262926609074681', time=2024-04-03T06:32:30.786960+0000, chain.objs.size()=1 2024-04-03T05:14:10.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.v27LHDNBHE7ADpehIVNEIewMumniD-Z_0 2024-04-03T05:14:10.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6190593760138571132', time=2024-04-03T06:32:31.844073+0000, chain.objs.size()=1 2024-04-03T05:14:10.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XIZ_AMAiNt2omkuUWu9M8mjZ-46IgcM_0 2024-04-03T05:14:10.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3154159782663352559', time=2024-04-03T06:32:33.272748+0000, chain.objs.size()=1 2024-04-03T05:14:10.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1mTe1EaHrNg014ZtRzuW1d-WdsiHD8b_0 2024-04-03T05:14:10.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16207221355688705376', time=2024-04-03T06:32:33.892085+0000, chain.objs.size()=1 2024-04-03T05:14:10.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.G311H7s0yIQXUItGoaTzd9twZrw3H8e_0 2024-04-03T05:14:10.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5585047114325707218', time=2024-04-03T06:32:38.443972+0000, chain.objs.size()=1 2024-04-03T05:14:10.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.053+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.JNiU03Djr9kD5zzE4dB-4zX7lPain0u_0 2024-04-03T05:14:10.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18281056478736545852', time=2024-04-03T06:32:39.724058+0000, chain.objs.size()=1 2024-04-03T05:14:10.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pX_8cwFHolSI8Lor9uFyCXjR1BQdGK9_0 2024-04-03T05:14:10.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4175934165284485400', time=2024-04-03T06:32:40.601254+0000, chain.objs.size()=1 2024-04-03T05:14:10.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HiX6x6stpYWC7gN05btEx7sBRSl6pHq_0 2024-04-03T05:14:10.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.057+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13520358571429463241', time=2024-04-03T06:32:40.894121+0000, chain.objs.size()=1 2024-04-03T05:14:10.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.057+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GfsNXCxQX14lJ0IqxgmSUDN0av79pG__0 2024-04-03T05:14:10.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4239235911586422312', time=2024-04-03T06:32:41.412039+0000, chain.objs.size()=1 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.IxqbeGdcD6fVq6yRoLDIx3L1fW3ca6O_0 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3212444132529085940', time=2024-04-03T06:32:41.804957+0000, chain.objs.size()=1 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pPOluwbayYdgUv_LVpwO8IwlFgdARzK_0 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18324888734672821731', time=2024-04-03T06:32:42.850755+0000, chain.objs.size()=1 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2DdPdB3WsFV6BcRFRxYmJb9kv-_4-3l_0 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15368199250891546260', time=2024-04-03T06:32:44.069613+0000, chain.objs.size()=1 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Uji5_dCVlv_0QMOjMa99oVnzKsHm5am_0 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15230055662087665082', time=2024-04-03T06:32:45.152144+0000, chain.objs.size()=1 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Hco0UNCUKeDrQgPHMlcHj-OqaKgJk4A_0 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12936226319095124723', time=2024-04-03T06:32:47.243057+0000, chain.objs.size()=1 2024-04-03T05:14:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.SdC0eRC4cMcnqtrqJmE7fherLHe5KBu_0 2024-04-03T05:14:10.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13965529883402472452', time=2024-04-03T06:32:47.656604+0000, chain.objs.size()=1 2024-04-03T05:14:10.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RJ5hwF-pmAl0ghEKvfdv2glXoU_7Jb8_0 2024-04-03T05:14:10.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.878240763102460378', time=2024-04-03T06:32:48.321964+0000, chain.objs.size()=1 2024-04-03T05:14:10.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6NsHOSBxXoe9_0sSgVaJhEqeR_o4mGg_0 2024-04-03T05:14:10.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1591020226239398231', time=2024-04-03T06:32:49.278184+0000, chain.objs.size()=1 2024-04-03T05:14:10.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.tEk6nS73nBieE4X957b4suBUyv8jckV_0 2024-04-03T05:14:10.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7874553500251081526', time=2024-04-03T06:32:49.969774+0000, chain.objs.size()=1 2024-04-03T05:14:10.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Si8LsKz0H_5mnlM561udo-8R9iPBGhm_0 2024-04-03T05:14:10.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2257255191907747211', time=2024-04-03T06:34:29.874413+0000, chain.objs.size()=1 2024-04-03T05:14:10.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.061+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.MrvMHAvkJfK_vYUmoCpZyTW-voE03q-_0 2024-04-03T05:14:10.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2040309033173699104', time=2024-04-03T06:34:29.975527+0000, chain.objs.size()=1 2024-04-03T05:14:10.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.G6nzG20D7sZHNG55JCJE0uhaWFNs2W8_0 2024-04-03T05:14:10.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11392122153000210684', time=2024-04-03T06:34:30.869826+0000, chain.objs.size()=1 2024-04-03T05:14:10.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Xg3lAaPuqtsw3SzN1prluse1guptE39_0 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15147580462652564511', time=2024-04-03T06:34:32.512756+0000, chain.objs.size()=1 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.g5VCRMw7ESwglJtw_XaHfAZWvem9xdj_0 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5847393356799354203', time=2024-04-03T06:34:32.590464+0000, chain.objs.size()=1 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TSAdqkFykOhN98bA8EGPEzJ9ky6n9L-_0 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.957050664599173849', time=2024-04-03T06:34:34.792485+0000, chain.objs.size()=1 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3uu9JlW51Z-j3VK-9xZ7sanYJCBprNF_0 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8823312772975740845', time=2024-04-03T06:34:35.012124+0000, chain.objs.size()=1 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yY-1p-Gmb79PDzgt0Wrioi57sQ2hDgL_0 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10863963363949022759', time=2024-04-03T06:34:35.237330+0000, chain.objs.size()=1 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TqdPge5zDjru9S13yRgveNq86dGDb0T_0 2024-04-03T05:14:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10225015520445862594', time=2024-04-03T06:34:36.334549+0000, chain.objs.size()=1 2024-04-03T05:14:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.iH8596N7EtQ093_57Bk5O_B76Z500XL_0 2024-04-03T05:14:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7816407861734608321', time=2024-04-03T06:34:38.646208+0000, chain.objs.size()=1 2024-04-03T05:14:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.HG6WHI_3rbs8k8RQvMtMcQ-zKLcxLUq_0 2024-04-03T05:14:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4147618965932363765', time=2024-04-03T06:34:40.385233+0000, chain.objs.size()=1 2024-04-03T05:14:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5dXkfsvjzoJvDCFmd7pNtPoNSXoRp1m_0 2024-04-03T05:14:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12089004763360345366', time=2024-04-03T06:34:42.271698+0000, chain.objs.size()=1 2024-04-03T05:14:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.065+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TVPL8HsHj2gT8vz0yxPSTdt73vLbsJ6_0 2024-04-03T05:14:10.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14314653140236426273', time=2024-04-03T06:34:42.696242+0000, chain.objs.size()=1 2024-04-03T05:14:10.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.payG1-1uQIgL6gh2RyrCqginnQciumc_0 2024-04-03T05:14:10.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.069+0000 7efe1ad0d640 0 -- 172.21.15.104:0/4071443380 >> [v2:172.21.15.130:6800/1404666531,v1:172.21.15.130:6801/1404666531] conn(0x7efe0c00e070 msgr2=0x7efe0c041170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-03T05:14:10.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.069+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16972114169371761503', time=2024-04-03T06:34:44.260630+0000, chain.objs.size()=1 2024-04-03T05:14:10.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.069+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XnBwx45rxc5Fk-NgxE1Djmq66W90URe_0 2024-04-03T05:14:10.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10468188518093873055', time=2024-04-03T06:34:44.262339+0000, chain.objs.size()=1 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dEbMWYb9LH5aiCjV2a0VP8BCWAuxGk9_0 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11738399372581145058', time=2024-04-03T06:34:44.402996+0000, chain.objs.size()=1 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.S0f2_5Hftcf3qv-ZKT_4TTKHuvhuT1J_0 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11257420509202601888', time=2024-04-03T06:34:44.441447+0000, chain.objs.size()=1 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.EciYUopoXK-cbWxdCP2UibhRgFH3aA7_0 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13363794286383740747', time=2024-04-03T06:34:45.888198+0000, chain.objs.size()=1 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.HCx_mXTklHX6WDwO_Ofg3b2UFyTTPmb_0 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14365733235972053156', time=2024-04-03T06:34:46.370086+0000, chain.objs.size()=1 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Z2nxJhJNXqZ5xuyGAJoctd-ze7vEATC_0 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7734105671378502789', time=2024-04-03T06:34:47.727007+0000, chain.objs.size()=1 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Y7IAJAdo0_ebVMoJBi8gL4F0T3ptDrE_0 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14932569927681940160', time=2024-04-03T06:34:48.063495+0000, chain.objs.size()=1 2024-04-03T05:14:10.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BBDZqmTJfzllb645sSggwa7HPmVXFBR_0 2024-04-03T05:14:10.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18205059755588420475', time=2024-04-03T06:34:52.010523+0000, chain.objs.size()=1 2024-04-03T05:14:10.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.02l1WSzQfHNjPBbCqhlqUQ0GowaLrGi_0 2024-04-03T05:14:10.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3526457863652282986', time=2024-04-03T06:34:52.743556+0000, chain.objs.size()=1 2024-04-03T05:14:10.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6GlZaPHrIeEuyriFwEMwNOxzPQm5oJB_0 2024-04-03T05:14:10.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4537412213417867956', time=2024-04-03T06:34:54.733878+0000, chain.objs.size()=1 2024-04-03T05:14:10.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GtOPZpIHx1zxFLeL31Si2f9E4uhqnGK_0 2024-04-03T05:14:10.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1001472652077399835', time=2024-04-03T06:34:56.110312+0000, chain.objs.size()=1 2024-04-03T05:14:10.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pcFC2OvidzNE15lzR8FoPwWqGTOLXbu_0 2024-04-03T05:14:10.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16510606961039319184', time=2024-04-03T06:35:19.639363+0000, chain.objs.size()=1 2024-04-03T05:14:10.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.073+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.305__shadow_.TITlw6WlNyQUOWtaHHzzXqcaoqjOzmB_0 2024-04-03T05:14:10.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14348095466855398380', time=2024-04-03T06:36:36.066494+0000, chain.objs.size()=1 2024-04-03T05:14:10.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.346__shadow_.DghLOqDoaDaVmkhr870xoWwF9sop7Za_0 2024-04-03T05:14:10.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11499120821907375868', time=2024-04-03T06:39:26.353629+0000, chain.objs.size()=1 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.428__shadow_.YVSO4ijGKcUhbdKuhxvGA1bD98BKkpN_0 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2847197798778091763', time=2024-04-03T06:40:14.269338+0000, chain.objs.size()=1 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.RRqwtdikUyFn5RVZ6720tzVWHKc0vwP_0 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4261393093259184031', time=2024-04-03T06:48:16.725515+0000, chain.objs.size()=2 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~Ucz9PulEk6j2Xy39674upBUcHOAcqmw.1 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~Ucz9PulEk6j2Xy39674upBUcHOAcqmw.2 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5242417026976828017', time=2024-04-03T06:50:01.538206+0000, chain.objs.size()=4 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.505__multipart_mymultipart.2~ZETzMmfaXBIQTykh7-KVVA3o0o7s28g.1 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.505__multipart_mymultipart.2~ZETzMmfaXBIQTykh7-KVVA3o0o7s28g.2 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.505__multipart_mymultipart._8cSyTIEKwJUaCpFA63olUbOpq8gqvPc.3 2024-04-03T05:14:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.077+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.505__multipart_mymultipart.2~ZETzMmfaXBIQTykh7-KVVA3o0o7s28g.4 2024-04-03T05:14:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.081+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/50822 2024-04-03T05:14:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-04-03T05:14:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13130700317969951889', time=2024-04-03T06:52:08.683794+0000, chain.objs.size()=1 2024-04-03T05:14:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.528__shadow_.9X2OvVyOjgOabUHdmGAcj7Pvv499lY__0 2024-04-03T05:14:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8891522152670693940', time=2024-04-03T06:52:44.824740+0000, chain.objs.size()=1 2024-04-03T05:14:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:9TDtl936jbpYgn9dAAGedyZT4SikM9-_.wmSiKd9q2IN0l-1qVL67D90YfZZ_9nc_0 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1083118040157423970', time=2024-04-03T06:52:47.793423+0000, chain.objs.size()=1 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:mkWQNZ8z99JIAJwKtcPtkRrUK7M5d4D_.XCvV-eCqqLL6ebs1BbRQrBqekPaeR1r_0 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10197907776846012416', time=2024-04-03T06:52:49.926940+0000, chain.objs.size()=1 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:NRTADbq4ebJBJhMsuYqPEaq8o4vxl4z_._jWg_qy4E-SThg0SEnaXsoabPLw7jGl_0 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4283833306901666144', time=2024-04-03T06:53:08.223747+0000, chain.objs.size()=1 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.541__shadow_.a-GQOVdE5fZ2mGA7J5ii6j6bkaJn5Wq_0 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1191145857854248021', time=2024-04-03T06:53:53.293017+0000, chain.objs.size()=1 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:E2er3XmjsB-bYYTujviwhWAHjolY4vz_.bBiBFKUfu5zwZ-zPGSvt1fvZEnypiQV_0 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4873710333403176983', time=2024-04-03T06:54:07.000706+0000, chain.objs.size()=1 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:j705TWJehkIzNMPRFcfG.9QHwVkCT8i_.2t5pRQC_5z2Q-vlbU0Gk9iCH0f_nUaH_0 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3149431521393156848', time=2024-04-03T06:59:17.103356+0000, chain.objs.size()=12 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__multipart_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.1 2024-04-03T05:14:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__shadow_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.1_1 2024-04-03T05:14:10.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__multipart_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.2 2024-04-03T05:14:10.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__shadow_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.2_1 2024-04-03T05:14:10.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.085+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__multipart_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.3 2024-04-03T05:14:10.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__shadow_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.3_1 2024-04-03T05:14:10.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__multipart_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.4 2024-04-03T05:14:10.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__shadow_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.4_1 2024-04-03T05:14:10.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__multipart_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.5 2024-04-03T05:14:10.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__shadow_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.5_1 2024-04-03T05:14:10.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__multipart_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.6 2024-04-03T05:14:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.584__shadow_multipart_enc.2~_o3tRb9DxKF7Y3aGVvO-qhD8pz0Pc-U.6_1 2024-04-03T05:14:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3191170187727704003', time=2024-04-03T06:59:21.184714+0000, chain.objs.size()=1 2024-04-03T05:14:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.586__shadow_.41eDJLEpJw-ZTBSqV64z0ItJGJfxLBJ_0 2024-04-03T05:14:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6748050586484270614', time=2024-04-03T07:01:30.616986+0000, chain.objs.size()=1 2024-04-03T05:14:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.607__shadow_.0QjJkLLU1ZrfMpIVWLmbHlt2-eC562v_0 2024-04-03T05:14:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16987392668720593789', time=2024-04-03T07:01:52.446829+0000, chain.objs.size()=1 2024-04-03T05:14:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.089+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.611__shadow_.OEX4FTxx4zIJImii9kO8HcHZvIDbi2a_0 2024-04-03T05:14:10.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.097+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:10.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.101+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-03T05:14:10.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:10.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46477' 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5020041211849613063', time=2024-04-03T06:20:41.727106+0000, chain.objs.size()=1 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.137__shadow_.Xw9aJLJvqXd9MysjBoM3I79P-jczb9J_0 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_CWUuE8_Plo1cAdlqwg6OSzQtGjC75L_', time=2024-04-03T06:22:01.671830+0000, chain.objs.size()=3 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.QrkFZxsxw2iWEE5YjRbUO_Rk0r_BU1J_0 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.QrkFZxsxw2iWEE5YjRbUO_Rk0r_BU1J_1 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.QrkFZxsxw2iWEE5YjRbUO_Rk0r_BU1J_2 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_Ae9VSPPiK88IQIfPv9d0l7ul0hL39AB', time=2024-04-03T06:22:51.910121+0000, chain.objs.size()=1 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.152__shadow_.c6mPyl6gylW1bs0Kl9T9RMUGydjR6f9_0 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15644060836859482658', time=2024-04-03T06:23:18.810442+0000, chain.objs.size()=1 2024-04-03T05:14:10.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.159__shadow_.rIk_DxFwmE0IQ-Xl3HGTpz9OE7Fo7dz_0 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8379077421157733020', time=2024-04-03T06:25:50.925771+0000, chain.objs.size()=1 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.218__shadow_.qTsxKFQ9VKw-Wlz89axxTMuUYpcFSKQ_0 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5547777265436611132', time=2024-04-03T06:25:50.932573+0000, chain.objs.size()=1 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.218__shadow_.vSkEs3BofYfkA0ikHLPHf2pC9EPdQ_2_0 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7538710558019322633', time=2024-04-03T06:25:55.277877+0000, chain.objs.size()=1 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.220__shadow_.z7quxL2Cj4ZjAqZefMmLwcNEwbqfm1H_0 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.931367181954862261', time=2024-04-03T06:25:59.681276+0000, chain.objs.size()=1 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.222__shadow_.Nwa4I_jteWOcuTp8mFjQvejp0pLnbwp_0 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5388861158154653958', time=2024-04-03T06:26:01.850451+0000, chain.objs.size()=1 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.223__shadow_.mJxqQpbha6x-DRwGCm0xUi9ZTWeYvv-_0 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7807654652035142982', time=2024-04-03T06:27:52.274464+0000, chain.objs.size()=1 2024-04-03T05:14:10.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.105+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Eb9TwwcDg2-kaN01OUrnOKKXY7GdvAI_0 2024-04-03T05:14:10.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2002958264320033525', time=2024-04-03T06:27:52.281144+0000, chain.objs.size()=1 2024-04-03T05:14:10.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6vSjOwnFlR_XzLL3xtcizGhvDbkVv45_0 2024-04-03T05:14:10.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14348459659309755809', time=2024-04-03T06:27:52.608658+0000, chain.objs.size()=1 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xdibjuY_hMAUrV4Kx79fIuHNawJRuDr_0 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10773420473466595762', time=2024-04-03T06:27:53.154377+0000, chain.objs.size()=1 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jGPysbRxbYBvUZUyOQiQyDKxc_WNDUh_0 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2481142420001384854', time=2024-04-03T06:27:53.881770+0000, chain.objs.size()=1 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dp-RpFTOWLvKQ9me-wCD_ixd48Vc-jk_0 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10939621059053098961', time=2024-04-03T06:27:56.170848+0000, chain.objs.size()=1 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.n_H7KsRUdbXeim_EC5150yc4AMCHxy5_0 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9430794114831832820', time=2024-04-03T06:27:56.758741+0000, chain.objs.size()=1 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.limKMqEUhQnXykZEx3mH5s4uOL1KDgm_0 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14377895978453436942', time=2024-04-03T06:27:57.641588+0000, chain.objs.size()=1 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qe5GIMJnTm3I0iGmuWL5hFuuXKjbnWE_0 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6059591737779089735', time=2024-04-03T06:27:58.847130+0000, chain.objs.size()=1 2024-04-03T05:14:10.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9nH80arjoluZZEy1koP3MPsMKljqO69_0 2024-04-03T05:14:10.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13578124357918275741', time=2024-04-03T06:27:59.083626+0000, chain.objs.size()=1 2024-04-03T05:14:10.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.w4sIbmnkhCYaPhlojxrARgln2NoguIP_0 2024-04-03T05:14:10.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7211712867356444659', time=2024-04-03T06:28:00.069833+0000, chain.objs.size()=1 2024-04-03T05:14:10.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BwLyP3ANnbgGsYR4XoTdLVNKqtoSx11_0 2024-04-03T05:14:10.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14934076534542349035', time=2024-04-03T06:28:00.533556+0000, chain.objs.size()=1 2024-04-03T05:14:10.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.109+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.T2HjGC30-J_8lKUo0xrOahhFPuI4f-K_0 2024-04-03T05:14:10.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15584827714851045294', time=2024-04-03T06:28:00.535621+0000, chain.objs.size()=1 2024-04-03T05:14:10.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5MxvYzvWI7tkamWfypgcrb9MIDhPUXF_0 2024-04-03T05:14:10.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13019351219022325426', time=2024-04-03T06:28:00.664300+0000, chain.objs.size()=1 2024-04-03T05:14:10.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.gCdKNO13w5dPR3tzx-lL7JvoZDPIGD7_0 2024-04-03T05:14:10.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16950949624685956745', time=2024-04-03T06:28:05.094088+0000, chain.objs.size()=1 2024-04-03T05:14:10.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.grrzLZQSz-_etz-5YTL7qW-Utube7_O_0 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14662512769148759516', time=2024-04-03T06:28:05.145423+0000, chain.objs.size()=1 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oOKxQCvOdaYYdPUb7e9fWymfwCLm__Q_0 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.714920317076170266', time=2024-04-03T06:28:05.611549+0000, chain.objs.size()=1 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GOhTphdoM9OQAY15YvjdCzBkJVNblep_0 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13722162107463341278', time=2024-04-03T06:28:05.930053+0000, chain.objs.size()=1 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TwUrzaAXZaIV9tMXdruYe6oYnPsar_V_0 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4747872590068399764', time=2024-04-03T06:28:06.207542+0000, chain.objs.size()=1 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.HKtAdfq1gAUFwXoWzrrKyaB3EOABViL_0 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11904076356754681444', time=2024-04-03T06:28:07.881267+0000, chain.objs.size()=1 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.c6G9meuFyvuC0TFPmg_n3fGIjtabXhz_0 2024-04-03T05:14:10.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4914830631277233276', time=2024-04-03T06:28:08.071849+0000, chain.objs.size()=1 2024-04-03T05:14:10.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.pyPsD53KaDfzt4mDQ0uqKmB22d7yiax_0 2024-04-03T05:14:10.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11487089927363804470', time=2024-04-03T06:28:08.289645+0000, chain.objs.size()=1 2024-04-03T05:14:10.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Tp7NHotz6ZxjMjcf3NgcA3IiGCUxjRO_0 2024-04-03T05:14:10.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3858784389857077169', time=2024-04-03T06:28:09.521410+0000, chain.objs.size()=1 2024-04-03T05:14:10.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.113+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.35jT6jCzja2QU-14fO8ccaDndp32jhj_0 2024-04-03T05:14:10.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2194153981345628698', time=2024-04-03T06:28:09.654511+0000, chain.objs.size()=1 2024-04-03T05:14:10.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.bRcGR5dZZoTZMGn9rd5EngpMbJyZXiL_0 2024-04-03T05:14:10.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13569825329532150343', time=2024-04-03T06:28:11.446898+0000, chain.objs.size()=1 2024-04-03T05:14:10.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MLBi7AyzWQYlgGGCvfSSx6uFGBDAPJ1_0 2024-04-03T05:14:10.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3482024865939251275', time=2024-04-03T06:28:11.542604+0000, chain.objs.size()=1 2024-04-03T05:14:10.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Xws3P2bURTisnJD8nVJ_pvqRM_J7ag9_0 2024-04-03T05:14:10.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8770845911642501558', time=2024-04-03T06:28:12.377273+0000, chain.objs.size()=1 2024-04-03T05:14:10.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.KPlAx81lmHaKgIvJlQsAmghHgDLtklO_0 2024-04-03T05:14:10.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3387727169699539332', time=2024-04-03T06:28:12.739703+0000, chain.objs.size()=1 2024-04-03T05:14:10.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qkYwbC6CLc1WdMrhsor70u2HMcJhJQT_0 2024-04-03T05:14:10.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1993980780410742325', time=2024-04-03T06:28:13.807025+0000, chain.objs.size()=1 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-sV0pmVYczi8wszd3JcZasVdwgJEihS_0 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8799790874092517673', time=2024-04-03T06:28:14.271700+0000, chain.objs.size()=1 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.REVv3Ox_VQtkYipKstxnHa1tK2gMjjx_0 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11651664075564638200', time=2024-04-03T06:28:15.241067+0000, chain.objs.size()=1 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GhI3xEpuBk_qKd0j6sEkfjgv-p3rc-l_0 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5991403334868561544', time=2024-04-03T06:28:15.879110+0000, chain.objs.size()=1 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.2INlOLwaBZyL_iFLrp8CHUwnETJcJ62_0 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17168874006383904471', time=2024-04-03T06:28:16.895454+0000, chain.objs.size()=1 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vRVb-tpDnOgUcORju9QGdE1pOSQpfu0_0 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4811786567274516058', time=2024-04-03T06:28:17.326557+0000, chain.objs.size()=1 2024-04-03T05:14:10.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.117+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eK_KVbAJr6_BbB71chyJu10fN1e3iSp_0 2024-04-03T05:14:10.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8443583444911270949', time=2024-04-03T06:28:18.763383+0000, chain.objs.size()=1 2024-04-03T05:14:10.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dQmZ7jMBPui9EmkyE3nzvbqpo53p7aS_0 2024-04-03T05:14:10.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2785424327616134496', time=2024-04-03T06:28:19.483824+0000, chain.objs.size()=1 2024-04-03T05:14:10.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fGT9KsRzbmNvVWLmeYt5HRylELmg_P3_0 2024-04-03T05:14:10.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11923583071893177973', time=2024-04-03T06:28:19.558306+0000, chain.objs.size()=1 2024-04-03T05:14:10.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.OBomZlNFso2WS5yEKAQWETR6YH3_DK2_0 2024-04-03T05:14:10.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.121+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5796618545433158506', time=2024-04-03T06:28:19.796055+0000, chain.objs.size()=1 2024-04-03T05:14:10.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.121+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.k6pxPHEIjafhCZNVtl6IZ8QxUeWc8EH_0 2024-04-03T05:14:10.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13486680651125777510', time=2024-04-03T06:28:20.893324+0000, chain.objs.size()=1 2024-04-03T05:14:10.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5rnOgEl1XDrqpW_lit5MyTe9ppchXLH_0 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9791033428868829168', time=2024-04-03T06:28:23.333699+0000, chain.objs.size()=1 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.232__shadow_.xs67bJdNlY_I3xX16ez_ruZznzKXj0v_0 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1891012974149111137', time=2024-04-03T06:28:44.245196+0000, chain.objs.size()=1 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.242__shadow_.mluQHVTili3JulAp78ELCTo3HHzZaTU_0 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1721635739319814623', time=2024-04-03T06:28:52.900204+0000, chain.objs.size()=1 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.246__shadow_.HFlZWRvAh-JFIG5xPpyNvPKopve6TsP_0 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18308564153493275479', time=2024-04-03T06:29:18.222866+0000, chain.objs.size()=1 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.257__shadow_.fbWWRhxCZ-T86BTcaHFUbG92ULgRDx1_0 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16693005968596273050', time=2024-04-03T06:29:35.937185+0000, chain.objs.size()=1 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.dS9DoKKuWVMeDWd_VI3zfA1qACmJn_-_0 2024-04-03T05:14:10.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4578644456195538233', time=2024-04-03T06:29:36.249023+0000, chain.objs.size()=1 2024-04-03T05:14:10.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.q3p5_1WYjNmoobtelzyz0jtKOq23UIJ_0 2024-04-03T05:14:10.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1978715743742266702', time=2024-04-03T06:29:38.371232+0000, chain.objs.size()=1 2024-04-03T05:14:10.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.263__shadow_.POQGbaoaRobd9_OIiTv-6WAlQeyuwMO_0 2024-04-03T05:14:10.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.925763698284994170', time=2024-04-03T06:29:58.571989+0000, chain.objs.size()=1 2024-04-03T05:14:10.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.125+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.272__shadow_.eHo6U1Db1-rIa7ASwYw-OgaZOHWFhpf_0 2024-04-03T05:14:10.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17619669443801119202', time=2024-04-03T06:32:25.082491+0000, chain.objs.size()=1 2024-04-03T05:14:10.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.50EWGAI-kdA-p8SiUCwk8Lqycj6UvOo_0 2024-04-03T05:14:10.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17033351523488095067', time=2024-04-03T06:32:25.209120+0000, chain.objs.size()=1 2024-04-03T05:14:10.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4n5vYnM1EAaG273WtpkcPoupjjVMuJ7_0 2024-04-03T05:14:10.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11760617919079351252', time=2024-04-03T06:32:25.549139+0000, chain.objs.size()=1 2024-04-03T05:14:10.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-m974neXRNgY6MsMh0NEKd1un2CKgrE_0 2024-04-03T05:14:10.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.481667785818916894', time=2024-04-03T06:32:25.824518+0000, chain.objs.size()=1 2024-04-03T05:14:10.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.t1TaG_1jVhoYkQ54amm2O9ho9gzDbZa_0 2024-04-03T05:14:10.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8124792910417638580', time=2024-04-03T06:32:26.563730+0000, chain.objs.size()=1 2024-04-03T05:14:10.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AXSPcl0oPoKw_GM-JM1fcpL_i35nFDe_0 2024-04-03T05:14:10.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16918154142383482280', time=2024-04-03T06:32:28.031316+0000, chain.objs.size()=1 2024-04-03T05:14:10.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.KOIublYUOlutZi6Eq0DMiCjbx_TrfAh_0 2024-04-03T05:14:10.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.171012139809285774', time=2024-04-03T06:32:28.678577+0000, chain.objs.size()=1 2024-04-03T05:14:10.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Z48EyiSrOJFAaqT09SdHGbq3M4shsSP_0 2024-04-03T05:14:10.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5448236693803132470', time=2024-04-03T06:32:28.947311+0000, chain.objs.size()=1 2024-04-03T05:14:10.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ToPQHRDJj-l5WaSsYatACgTuPbpG2k7_0 2024-04-03T05:14:10.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9505786417658032431', time=2024-04-03T06:32:29.539663+0000, chain.objs.size()=1 2024-04-03T05:14:10.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1dnsgyeRCXAf9iawiFcEDa8GJjJiGVv_0 2024-04-03T05:14:10.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15578194695841453602', time=2024-04-03T06:32:32.139273+0000, chain.objs.size()=1 2024-04-03T05:14:10.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AJfuD3006xB7dAJrlXD2ZltKNRvhAd3_0 2024-04-03T05:14:10.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11793192049920133195', time=2024-04-03T06:32:32.244230+0000, chain.objs.size()=1 2024-04-03T05:14:10.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.129+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GnQ3ha6dehElII0WE3yCCIrZ8Wa8_jv_0 2024-04-03T05:14:10.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12684036572639540410', time=2024-04-03T06:32:36.363446+0000, chain.objs.size()=1 2024-04-03T05:14:10.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.jnxYsdu9GqP7bIyvB2wbxUMtcAO1_8r_0 2024-04-03T05:14:10.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4028007891571427966', time=2024-04-03T06:32:36.707351+0000, chain.objs.size()=1 2024-04-03T05:14:10.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rSR02PI96fiCWw6d4y1tRuTAcsTpoDE_0 2024-04-03T05:14:10.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11516756701223632004', time=2024-04-03T06:32:36.910648+0000, chain.objs.size()=1 2024-04-03T05:14:10.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YEG3cqQ7fQPv9g23wfc0YShDFXnhzvP_0 2024-04-03T05:14:10.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13649998696246561168', time=2024-04-03T06:32:37.126624+0000, chain.objs.size()=1 2024-04-03T05:14:10.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.svUYOoEqduCn5s8F3G2c_d-Ab7NuzG8_0 2024-04-03T05:14:10.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17499831245497273217', time=2024-04-03T06:32:37.415186+0000, chain.objs.size()=1 2024-04-03T05:14:10.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vBjMA-Ds3aP0YJsGmKPFaa3XCAw3hax_0 2024-04-03T05:14:10.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14595591584780609319', time=2024-04-03T06:32:37.612195+0000, chain.objs.size()=1 2024-04-03T05:14:10.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YzyHQArjYitIGattDlYU1qSVJgz3UIi_0 2024-04-03T05:14:10.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1611561529786201076', time=2024-04-03T06:32:37.934364+0000, chain.objs.size()=1 2024-04-03T05:14:10.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.b2lZ-3kGqBn7SioiW9Itr3gn7ZMvCQu_0 2024-04-03T05:14:10.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7544033986155081382', time=2024-04-03T06:32:43.670470+0000, chain.objs.size()=1 2024-04-03T05:14:10.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Li-ZnwBGQfxaNR8Wpw7YlXtKO4_aP2m_0 2024-04-03T05:14:10.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17156995560750007896', time=2024-04-03T06:32:45.064496+0000, chain.objs.size()=1 2024-04-03T05:14:10.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yJqy5rpYGAgjK7_g_Prh3JZ-EcLL_mz_0 2024-04-03T05:14:10.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16974189569644686929', time=2024-04-03T06:32:45.349440+0000, chain.objs.size()=1 2024-04-03T05:14:10.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Bt3atIp1c4WTEyuImNCzxSltW257NX1_0 2024-04-03T05:14:10.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5951204557356443858', time=2024-04-03T06:32:46.501483+0000, chain.objs.size()=1 2024-04-03T05:14:10.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.133+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.jQbe8PlLhl9Wj8mZW_0MX5yyuPJw1zd_0 2024-04-03T05:14:10.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7422530098452252382', time=2024-04-03T06:32:46.833333+0000, chain.objs.size()=1 2024-04-03T05:14:10.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.iitQLa2SXlGBJ7TZ1ocfzuKeHmUWvJo_0 2024-04-03T05:14:10.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14670218934937291139', time=2024-04-03T06:32:47.280896+0000, chain.objs.size()=1 2024-04-03T05:14:10.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.o2l5QJNxPogYqueKbdNVLYPKACmyCEW_0 2024-04-03T05:14:10.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4673909174036803754', time=2024-04-03T06:32:47.665847+0000, chain.objs.size()=1 2024-04-03T05:14:10.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GIsCHIzRYiKVdAix75k54bydA5sVmq2_0 2024-04-03T05:14:10.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10033185442523919874', time=2024-04-03T06:32:47.814966+0000, chain.objs.size()=1 2024-04-03T05:14:10.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.c3Da7EwYHObewM3IecxOw6FxEYVTFyv_0 2024-04-03T05:14:10.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7810050586078199541', time=2024-04-03T06:32:48.027480+0000, chain.objs.size()=1 2024-04-03T05:14:10.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qT5kKoV8EdvLUXzgIFgtkcgl5pPxHFC_0 2024-04-03T05:14:10.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.338423627886304301', time=2024-04-03T06:32:49.324873+0000, chain.objs.size()=1 2024-04-03T05:14:10.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.jjBkVC15DdeWBjHOSQDjDOyzcuIbDR1_0 2024-04-03T05:14:10.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13217777288751049212', time=2024-04-03T06:32:51.074783+0000, chain.objs.size()=1 2024-04-03T05:14:10.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7E4K6UpZGNtGt0e4s_hwS3f5YHt2G9x_0 2024-04-03T05:14:10.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14101925866402590930', time=2024-04-03T06:34:28.486181+0000, chain.objs.size()=1 2024-04-03T05:14:10.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.137+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Zba5Z9sKacH6-ycwf9BlQPZZv5zQhYf_0 2024-04-03T05:14:10.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18272995565200649094', time=2024-04-03T06:34:29.127850+0000, chain.objs.size()=1 2024-04-03T05:14:10.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.qDSswebxITdOTeyqOOMWaIrp6qNfL_8_0 2024-04-03T05:14:10.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1454369268362977804', time=2024-04-03T06:34:30.646936+0000, chain.objs.size()=1 2024-04-03T05:14:10.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.bRBUZ9i75W8TsHsV8S_t14eUFDh4HUm_0 2024-04-03T05:14:10.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7223540969137221555', time=2024-04-03T06:34:31.425573+0000, chain.objs.size()=1 2024-04-03T05:14:10.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.j9iH23fwMTpCPFhtYPLEiI2yoNvv3Rf_0 2024-04-03T05:14:10.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14915642049200099006', time=2024-04-03T06:34:32.490254+0000, chain.objs.size()=1 2024-04-03T05:14:10.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.edCpbV9fCFTobuP3Wi7vxapfpLTjSSk_0 2024-04-03T05:14:10.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9647211026374206371', time=2024-04-03T06:34:35.030773+0000, chain.objs.size()=1 2024-04-03T05:14:10.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7faHea008CNZIag1V4WlVLJO4CeBPH-_0 2024-04-03T05:14:10.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8581769848431666782', time=2024-04-03T06:34:35.032547+0000, chain.objs.size()=1 2024-04-03T05:14:10.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.X0ADdSBuXhWU24YPaoBns_SJZ2kDyFv_0 2024-04-03T05:14:10.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15125894805506801161', time=2024-04-03T06:34:36.407914+0000, chain.objs.size()=1 2024-04-03T05:14:10.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.AM0ZL-ttTN17Y_UoI4KPGil0MMcvIEM_0 2024-04-03T05:14:10.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3172049698398195877', time=2024-04-03T06:34:38.263739+0000, chain.objs.size()=1 2024-04-03T05:14:10.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.OhVu0G_e7f1o0wrDP8B3gALa9X79G80_0 2024-04-03T05:14:10.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16105378204004379324', time=2024-04-03T06:34:38.968897+0000, chain.objs.size()=1 2024-04-03T05:14:10.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hckIkha9JJqrBFU_vrXQ30vaza9WOu3_0 2024-04-03T05:14:10.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9800219976242237630', time=2024-04-03T06:34:39.097511+0000, chain.objs.size()=1 2024-04-03T05:14:10.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IRf3gtrTgNhAH9U8XRHcRKs2CDkyKZ8_0 2024-04-03T05:14:10.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6823378015346179493', time=2024-04-03T06:34:40.922781+0000, chain.objs.size()=1 2024-04-03T05:14:10.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.141+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cHz9fd2H7DzIWuxu06HqhWLibRAGCIh_0 2024-04-03T05:14:10.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.792860040651775454', time=2024-04-03T06:34:41.648970+0000, chain.objs.size()=1 2024-04-03T05:14:10.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.145+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vFY9GMGBnNkQUsOTzG98TJvTVpuolgf_0 2024-04-03T05:14:10.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9742001329152863784', time=2024-04-03T06:34:41.900101+0000, chain.objs.size()=1 2024-04-03T05:14:10.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.145+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.uzHKieaP-i9eHrcb6hIWs9kyQSJyXyG_0 2024-04-03T05:14:10.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.145+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3123379257086019770', time=2024-04-03T06:34:41.995224+0000, chain.objs.size()=1 2024-04-03T05:14:10.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.145+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XyjY6DbxiWSzg5_QUmV9Mj9V2jS2kUB_0 2024-04-03T05:14:10.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.149+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/46477 2024-04-03T05:14:10.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-04-03T05:14:10.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17911615763065507641', time=2024-04-03T06:34:42.401572+0000, chain.objs.size()=1 2024-04-03T05:14:10.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9MKbuiK-KdcRvD8kGxwarY4ex92idIc_0 2024-04-03T05:14:10.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8497393657972947986', time=2024-04-03T06:34:45.459048+0000, chain.objs.size()=1 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hztzapE7e33bpY3oUAE7HooI_dIrEDT_0 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4573229134367878355', time=2024-04-03T06:34:51.318049+0000, chain.objs.size()=1 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.T2Nl6DNbsv_GY95PBYadF_VzZ1XWNB6_0 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8077977256656834403', time=2024-04-03T06:34:52.044022+0000, chain.objs.size()=1 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.g2tnSTZHQcbYKESxGs233btn_PPrZkb_0 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2266293928972459330', time=2024-04-03T06:34:54.506586+0000, chain.objs.size()=1 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.O6Nf-bfiSl7h3138Wsl7YcKqjo7wlVf_0 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5883421877411516857', time=2024-04-03T06:34:55.692838+0000, chain.objs.size()=1 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2unWEBP2rHNmnghPHt4WkgC307YAysi_0 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2969038938542078501', time=2024-04-03T06:34:56.639119+0000, chain.objs.size()=1 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.PYk4q0-2z9-3ntgLOI8Mps3IuB_JzhM_0 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.110394322393672698', time=2024-04-03T06:35:09.588961+0000, chain.objs.size()=1 2024-04-03T05:14:10.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.300__shadow_.dz-kKkfZqUW-QSa-BM3n4HrscdCi1iG_0 2024-04-03T05:14:10.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2247335324669616509', time=2024-04-03T06:35:13.242563+0000, chain.objs.size()=1 2024-04-03T05:14:10.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.302__shadow_.HaoM291gRDbd7Za6AHoX1GrebPZmAWm_0 2024-04-03T05:14:10.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6265650228130789124', time=2024-04-03T06:35:39.962675+0000, chain.objs.size()=1 2024-04-03T05:14:10.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.315__shadow_.AL0ku9hn24oQWcZwVauydI6-kSSMfdx_0 2024-04-03T05:14:10.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7399889870912578755', time=2024-04-03T06:36:43.666633+0000, chain.objs.size()=1 2024-04-03T05:14:10.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.350__shadow_.jiUcEvL5K_vom4rKkhyT_BgEOTlIXCq_0 2024-04-03T05:14:10.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5798247800339439117', time=2024-04-03T06:38:24.008066+0000, chain.objs.size()=1 2024-04-03T05:14:10.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.401__shadow_.t5WcYd_G4MQ9rkDNwsKlVuqD_29XXGQ_0 2024-04-03T05:14:10.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10819317265471005340', time=2024-04-03T06:39:49.087876+0000, chain.objs.size()=1 2024-04-03T05:14:10.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.436__shadow_.Sv4DdEnXPpZ_ikxmFS-SQb6fBVwe8jc_0 2024-04-03T05:14:10.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6262048339438277755', time=2024-04-03T06:40:16.919066+0000, chain.objs.size()=1 2024-04-03T05:14:10.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.153+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.454__shadow_.rv65KiVXAX8X2wRy7nHr6wZDLn1SBY-_0 2024-04-03T05:14:10.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.466__shadow_.IA7DjHEEtP0qOt1ydtdbATHAq5WhFsY_1_3373273eaa161cf5ddeebb1b04835dc7', time=2024-04-03T06:40:46.568976+0000, chain.objs.size()=1 2024-04-03T05:14:10.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.466__shadow_.IA7DjHEEtP0qOt1ydtdbATHAq5WhFsY_0 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.347584905621865506', time=2024-04-03T06:44:57.592339+0000, chain.objs.size()=12 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.YaW6L5C_l-QoV4Ekf6h29loG1esowlkt.1 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.YaW6L5C_l-QoV4Ekf6h29loG1esowlkt.1_1 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.2 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.2_1 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.3 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.3_1 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.4 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.4_1 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.5 2024-04-03T05:14:10.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.157+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.5_1 2024-04-03T05:14:10.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.161+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.6 2024-04-03T05:14:10.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__shadow_mymultipart.2~KAJDUUIz-ABqTwvvX384lXwHH7LIWfk.6_1 2024-04-03T05:14:10.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13362025272147978896', time=2024-04-03T06:48:00.913359+0000, chain.objs.size()=3 2024-04-03T05:14:10.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~MRi-rs24mUnr511oHH_7z3gNp4wzWD1.1 2024-04-03T05:14:10.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~MRi-rs24mUnr511oHH_7z3gNp4wzWD1.2 2024-04-03T05:14:10.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~MRi-rs24mUnr511oHH_7z3gNp4wzWD1.3 2024-04-03T05:14:10.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~Dg7rok48fBB91cS6wCSSjb92dSb-ayT', time=2024-04-03T06:49:25.344319+0000, chain.objs.size()=1 2024-04-03T05:14:10.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.501__multipart_mymultipart.2~Dg7rok48fBB91cS6wCSSjb92dSb-ayT.1 2024-04-03T05:14:10.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5898661947239742708', time=2024-04-03T06:52:41.249789+0000, chain.objs.size()=1 2024-04-03T05:14:10.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:guRf1dRY2eN7dnxvtaJgdMr4c8-nPtZ_.soqemFHrfYlF2tNsBTT8nmTWlzRuNdE_0 2024-04-03T05:14:10.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11896968128107314035', time=2024-04-03T06:53:44.567865+0000, chain.objs.size()=1 2024-04-03T05:14:10.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:V386X6p2ZYGSjcmfQhxVV0Aq3azWfFh_.Y0fBo3BY8wtmnHdBn2BMUzt6AM7ExLy_0 2024-04-03T05:14:10.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10235442573603514183', time=2024-04-03T06:53:56.686882+0000, chain.objs.size()=1 2024-04-03T05:14:10.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:K2O3I.QVn2QG41XzHDDQT.-YZNQ9Eg._.r-UsrawuQlrdyquh-I8cuHWlkc-zl9P_0 2024-04-03T05:14:10.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1388169800914619094', time=2024-04-03T06:57:45.166296+0000, chain.objs.size()=12 2024-04-03T05:14:10.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__multipart_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.1 2024-04-03T05:14:10.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__shadow_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.1_1 2024-04-03T05:14:10.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.165+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__multipart_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.2 2024-04-03T05:14:10.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__shadow_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.2_1 2024-04-03T05:14:10.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__multipart_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.3 2024-04-03T05:14:10.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__shadow_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.3_1 2024-04-03T05:14:10.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.169+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__multipart_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.4 2024-04-03T05:14:10.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__shadow_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.4_1 2024-04-03T05:14:10.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__multipart_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.5 2024-04-03T05:14:10.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__shadow_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.5_1 2024-04-03T05:14:10.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__multipart_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.6 2024-04-03T05:14:10.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.582__shadow_multipart_enc.2~JVEzoY-TNR2rWY9WU6uxh8GiIrOq89e.6_1 2024-04-03T05:14:10.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11745690907572196447', time=2024-04-03T07:01:24.601971+0000, chain.objs.size()=1 2024-04-03T05:14:10.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.605__shadow_.SMcHJSomYzQiTiKV5MY4nA0_Jx6Jb-p_0 2024-04-03T05:14:10.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16397545425902865608', time=2024-04-03T07:03:43.110237+0000, chain.objs.size()=1 2024-04-03T05:14:10.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.630__shadow_.1IzJCix3KXbqYdesXez4XbUwgKnoQf8_0 2024-04-03T05:14:10.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4863314513492130632', time=2024-04-03T07:04:28.394459+0000, chain.objs.size()=1 2024-04-03T05:14:10.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.173+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.656__shadow_.hycQJfKtQxo6lx2NL3nPBu85oz5qNem_0 2024-04-03T05:14:10.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.177+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10240856325608342918', time=2024-04-03T07:05:43.407829+0000, chain.objs.size()=1 2024-04-03T05:14:10.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.177+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.684__shadow_.TxNcvPu96Ikfo8bNl6qAGOYr_af9vPt_0 2024-04-03T05:14:10.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.181+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:10.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.189+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-03T05:14:10.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.189+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:10.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:10.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48400' 2024-04-03T05:14:10.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13856054010445107377', time=2024-04-03T06:21:41.069427+0000, chain.objs.size()=3 2024-04-03T05:14:10.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.gZxq3AhLdU3VAe8xTu_8mRsQag14slN_0 2024-04-03T05:14:10.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.gZxq3AhLdU3VAe8xTu_8mRsQag14slN_1 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.gZxq3AhLdU3VAe8xTu_8mRsQag14slN_2 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1055523314322314729', time=2024-04-03T06:22:51.405673+0000, chain.objs.size()=1 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.151__shadow_.E2zlN01txo7oaiNYeYhj95MlOTVP5xb_0 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15260545594346182464', time=2024-04-03T06:25:48.731935+0000, chain.objs.size()=1 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.217__shadow_.vkKsP6kwzAmezjc1YYbfmi8P8VlyMiS_0 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7085132741705016734', time=2024-04-03T06:27:52.187412+0000, chain.objs.size()=1 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fBr8t3WwV97oGiPg1I5wzg4yHnoYVvP_0 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7484892491548488975', time=2024-04-03T06:27:52.688696+0000, chain.objs.size()=1 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dtrSe3Fhr7GKbHEQsNPJfRYDdoX7HDX_0 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3106618172816862673', time=2024-04-03T06:27:52.972741+0000, chain.objs.size()=1 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.RdqDBKUNF5ooYlhXooCPG9__bVZQ3mH_0 2024-04-03T05:14:10.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17195002723854685608', time=2024-04-03T06:27:53.936184+0000, chain.objs.size()=1 2024-04-03T05:14:10.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.HIpBDrvZp-tic0OIKhbtaCDeOmq4o5K_0 2024-04-03T05:14:10.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11999591906943858270', time=2024-04-03T06:27:54.008667+0000, chain.objs.size()=1 2024-04-03T05:14:10.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9MFAe6Wop4lERKj--kF5CH6MG2gOh1Z_0 2024-04-03T05:14:10.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11856216536733567377', time=2024-04-03T06:27:54.752597+0000, chain.objs.size()=1 2024-04-03T05:14:10.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JXihJGHrwA2dk5Uh1qqOOh4TSW52-Es_0 2024-04-03T05:14:10.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11297255678380502167', time=2024-04-03T06:27:56.554342+0000, chain.objs.size()=1 2024-04-03T05:14:10.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.193+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.oOEvI7V7NyktUlE1QMQYVVGqbFaV0aY_0 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14738253701370410804', time=2024-04-03T06:27:56.741068+0000, chain.objs.size()=1 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6lMdoWwPn4Lu8A3Yr-3EFmNwwSDh9wB_0 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8060982006790764927', time=2024-04-03T06:27:57.182604+0000, chain.objs.size()=1 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wieyp1SWR4o_K9PfZD6kskxWMKwnrW2_0 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15937206642501978277', time=2024-04-03T06:27:57.841014+0000, chain.objs.size()=1 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.COeeJOHQVnM_m8spilpclAYuYVstG8N_0 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12514417922251802189', time=2024-04-03T06:27:58.416402+0000, chain.objs.size()=1 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BbvH-kjW7WSXdtUCvuRFSdevYMbc7VB_0 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13890669271746568966', time=2024-04-03T06:28:00.019915+0000, chain.objs.size()=1 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.N5QIEcGnuELMdqf-DLsBOgwaA4sQmdX_0 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6870670182277517552', time=2024-04-03T06:28:00.539631+0000, chain.objs.size()=1 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.0wJn0EExAy6228LFvm3f-WmlbAM6-yN_0 2024-04-03T05:14:10.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14705651307276166928', time=2024-04-03T06:28:00.666762+0000, chain.objs.size()=1 2024-04-03T05:14:10.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.WM8aWwwelDYjT63oW9GD6MUdPyrARjQ_0 2024-04-03T05:14:10.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14746450596782491975', time=2024-04-03T06:28:01.334742+0000, chain.objs.size()=1 2024-04-03T05:14:10.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.l9JX6Tg2oXgnV1s_z26nJxc6pdOE6Dv_0 2024-04-03T05:14:10.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4485934218060790162', time=2024-04-03T06:28:01.431391+0000, chain.objs.size()=1 2024-04-03T05:14:10.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.m1C6HKf_BEIu7n5lHi_jC5ygRXmjGZ7_0 2024-04-03T05:14:10.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2302017156625205792', time=2024-04-03T06:28:01.899590+0000, chain.objs.size()=1 2024-04-03T05:14:10.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.APadmaGq-nlpDdq0ExOweuFu2uZAx6Z_0 2024-04-03T05:14:10.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18158304755830410830', time=2024-04-03T06:28:01.901865+0000, chain.objs.size()=1 2024-04-03T05:14:10.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.197+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vhMLoNSF_H_Y0XhPdCzxjJJSRYAA_Vv_0 2024-04-03T05:14:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15531049731476166881', time=2024-04-03T06:28:02.984781+0000, chain.objs.size()=1 2024-04-03T05:14:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.FDKfFKrBGH9Le58mVN3915POCT7MqBS_0 2024-04-03T05:14:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3934137623084412490', time=2024-04-03T06:28:03.017410+0000, chain.objs.size()=1 2024-04-03T05:14:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.NaN8-wH3FkIUriUKhIVCiM0QqtBz0hY_0 2024-04-03T05:14:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16471506410963948822', time=2024-04-03T06:28:04.793208+0000, chain.objs.size()=1 2024-04-03T05:14:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.FOjLDeWkpclSQ7vJDoVdpidhejNjplD_0 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9903896041038321354', time=2024-04-03T06:28:05.136711+0000, chain.objs.size()=1 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mWjuFThdL8gv2Wm2TLg42InLqPjwTCG_0 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1459267497851527106', time=2024-04-03T06:28:05.443088+0000, chain.objs.size()=1 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.M2EfWiXwaXVk9d0ks4h95kamRGbQJK1_0 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5011965804833159008', time=2024-04-03T06:28:06.731620+0000, chain.objs.size()=1 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jm5NddGE20gUTK1utCApnUXhmM2Apin_0 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8923797025028332621', time=2024-04-03T06:28:07.863029+0000, chain.objs.size()=1 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.JPloHQ7OdsOY8G3dQ0DQVyQlFKIdYfh_0 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2732256846407570800', time=2024-04-03T06:28:07.864993+0000, chain.objs.size()=1 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.F77O9EUVLTH7-H99iJ3DKRWSz8NvQFW_0 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1771774531919313057', time=2024-04-03T06:28:08.956131+0000, chain.objs.size()=1 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yf_Tqrp4-q4i6It1eS4HjFI3K7Q45nE_0 2024-04-03T05:14:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4371703388255114939', time=2024-04-03T06:28:14.151558+0000, chain.objs.size()=1 2024-04-03T05:14:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.adlHRnti6W7OHBHgu2WyqPuuAMLi3bI_0 2024-04-03T05:14:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12667412168184214951', time=2024-04-03T06:28:14.321454+0000, chain.objs.size()=1 2024-04-03T05:14:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.201+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.I40pGDaE3yufexXYjhY7a4ByhJbdR6n_0 2024-04-03T05:14:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9703965909237225498', time=2024-04-03T06:28:15.272633+0000, chain.objs.size()=1 2024-04-03T05:14:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.e8vAjhkG77af0RjTUambcMQ5xAes6Cd_0 2024-04-03T05:14:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7326604094353976407', time=2024-04-03T06:28:15.575894+0000, chain.objs.size()=1 2024-04-03T05:14:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.aEnSrV6i6fwwaaWhjGJiJ4pIALq0rZ-_0 2024-04-03T05:14:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7496525643238125725', time=2024-04-03T06:28:15.577719+0000, chain.objs.size()=1 2024-04-03T05:14:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5r1aY6nlBvTaVfjmcJgW4xpCK-iz2ym_0 2024-04-03T05:14:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9596150041245127541', time=2024-04-03T06:28:16.012746+0000, chain.objs.size()=1 2024-04-03T05:14:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.EevAQiqc5x-ZVQvTETvT36DT8JXb09c_0 2024-04-03T05:14:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9914943206426814835', time=2024-04-03T06:28:19.477537+0000, chain.objs.size()=1 2024-04-03T05:14:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1wECoJHjGsu4WKSh4nJDHWNzpbjOFi-_0 2024-04-03T05:14:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15407977597207443353', time=2024-04-03T06:28:19.540558+0000, chain.objs.size()=1 2024-04-03T05:14:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.205+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yRmT1nzA0vDJuXgTFP-buVbhrK1o5Q7_0 2024-04-03T05:14:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6393738051572856048', time=2024-04-03T06:28:19.839061+0000, chain.objs.size()=1 2024-04-03T05:14:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Ki78almV2B1mS-_2GoMYRS68ioolV3U_0 2024-04-03T05:14:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.84588842396109827', time=2024-04-03T06:28:20.376237+0000, chain.objs.size()=1 2024-04-03T05:14:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MPxOA9_c6-ya2f57UAWPerZVck9kWC9_0 2024-04-03T05:14:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17821831524363163278', time=2024-04-03T06:28:20.378491+0000, chain.objs.size()=1 2024-04-03T05:14:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wMl1F8dDBcIjoCWHq4mJHv9lYrTnTQa_0 2024-04-03T05:14:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8564804732291953802', time=2024-04-03T06:28:20.990762+0000, chain.objs.size()=1 2024-04-03T05:14:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.d9LyZADCz-RvxUJlT3nG9yp3mEnXbmw_0 2024-04-03T05:14:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17917209179253252068', time=2024-04-03T06:29:03.949709+0000, chain.objs.size()=1 2024-04-03T05:14:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.251__shadow_.tg7eEFYBSJk2EDtMTRNgcGaPgT8B6uS_0 2024-04-03T05:14:10.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9852349649939315963', time=2024-04-03T06:29:18.219020+0000, chain.objs.size()=1 2024-04-03T05:14:10.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.257__shadow_.UNiv9joyn-un8bTJnil0-Xq8Dejyfiy_0 2024-04-03T05:14:10.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9020299959418341564', time=2024-04-03T06:29:20.422251+0000, chain.objs.size()=1 2024-04-03T05:14:10.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.258__shadow_.SaBrP5J6dRvoAOFDplVKGeh1N7IMP-Z_0 2024-04-03T05:14:10.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14034100549983670067', time=2024-04-03T06:29:30.558933+0000, chain.objs.size()=1 2024-04-03T05:14:10.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.8iHSZJHH_6rVfCNHwzsth5d6JBIqA2l_0 2024-04-03T05:14:10.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15460845961667893685', time=2024-04-03T06:29:30.685492+0000, chain.objs.size()=1 2024-04-03T05:14:10.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.bpg5fTZmyXAL_Og7cfZguVc5XqMzTai_0 2024-04-03T05:14:10.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1591581533465335624', time=2024-04-03T06:29:38.367416+0000, chain.objs.size()=1 2024-04-03T05:14:10.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.263__shadow_._M9W4tXhcNfhZSweEcBKlWnBzjEOrXE_0 2024-04-03T05:14:10.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2170523030241901733', time=2024-04-03T06:29:56.323738+0000, chain.objs.size()=1 2024-04-03T05:14:10.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.271__shadow_.3B-GfUia9GdUAIeu5CrbjCyMh-zS1ln_0 2024-04-03T05:14:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12413144369292645757', time=2024-04-03T06:30:08.965762+0000, chain.objs.size()=1 2024-04-03T05:14:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.209+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.276__shadow:1HN5nEpUaEh-i7VIoM0uhApTUXr8EoO_.fNciocPKY20QlsJxox-d9ymYLgz724L_0 2024-04-03T05:14:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10473996347169346361', time=2024-04-03T06:32:24.133893+0000, chain.objs.size()=1 2024-04-03T05:14:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1ySBqH9T-OYyKe7amw1RKWsVm8OsgVc_0 2024-04-03T05:14:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4524120461228243544', time=2024-04-03T06:32:26.278237+0000, chain.objs.size()=1 2024-04-03T05:14:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.T0ZcTmy9OysmqKvWfxAecWtKlXjVhny_0 2024-04-03T05:14:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8041175554276524117', time=2024-04-03T06:32:28.263085+0000, chain.objs.size()=1 2024-04-03T05:14:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.U1CtGfvUW_Uk7J_l68yEBC6AqVmbqmn_0 2024-04-03T05:14:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4138509153045158705', time=2024-04-03T06:32:28.459703+0000, chain.objs.size()=1 2024-04-03T05:14:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Te6U5iEinmJvor7IfLv5ETGIrjAXWsL_0 2024-04-03T05:14:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1248678425793847915', time=2024-04-03T06:32:29.063791+0000, chain.objs.size()=1 2024-04-03T05:14:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.b4N9jEKU1zHsH4YWtdadNNZ7pE-NhZq_0 2024-04-03T05:14:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17308411224196845841', time=2024-04-03T06:32:29.831091+0000, chain.objs.size()=1 2024-04-03T05:14:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.IWV7DLSuHW7HE_-GinIU8S9UIijI4Ja_0 2024-04-03T05:14:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.990099972865224714', time=2024-04-03T06:32:30.048733+0000, chain.objs.size()=1 2024-04-03T05:14:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EOOAAGF7ZbMg25H-Y2-_48_LbeCOoiP_0 2024-04-03T05:14:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14784120814918559922', time=2024-04-03T06:32:30.162215+0000, chain.objs.size()=1 2024-04-03T05:14:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vTZG6VN_uxaBQs8Mgp9cFmxRtFypI2w_0 2024-04-03T05:14:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16252847414458488891', time=2024-04-03T06:32:30.670192+0000, chain.objs.size()=1 2024-04-03T05:14:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ChZ4q4-Q2MDU1KEMLNAzuidyZywbGl6_0 2024-04-03T05:14:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5353325757334028235', time=2024-04-03T06:32:31.710081+0000, chain.objs.size()=1 2024-04-03T05:14:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.2eT8TnQDodNpExnX-cm53WM7CKNavDl_0 2024-04-03T05:14:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16903977138967069978', time=2024-04-03T06:32:32.127433+0000, chain.objs.size()=1 2024-04-03T05:14:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.213+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VKoUHl1k5-dzAo6974SxRNi5_18X-3e_0 2024-04-03T05:14:10.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16828234117227477921', time=2024-04-03T06:32:36.266312+0000, chain.objs.size()=1 2024-04-03T05:14:10.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1NFIxNgWLS5NRss1t8zovm9TJ_8YBmU_0 2024-04-03T05:14:10.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5328887451287445049', time=2024-04-03T06:32:36.502950+0000, chain.objs.size()=1 2024-04-03T05:14:10.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zYjxw-g1JdN3HnohY9UPMm718DaGtq4_0 2024-04-03T05:14:10.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9915851416580945748', time=2024-04-03T06:32:37.288090+0000, chain.objs.size()=1 2024-04-03T05:14:10.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HFF934fQk9BHCqDJxcciq4joFI38ywn_0 2024-04-03T05:14:10.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2884113584972467221', time=2024-04-03T06:32:37.974035+0000, chain.objs.size()=1 2024-04-03T05:14:10.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uH5ZIdFEgl2H9wM8u_UbCpOa0astQps_0 2024-04-03T05:14:10.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16168921318619731171', time=2024-04-03T06:32:39.341066+0000, chain.objs.size()=1 2024-04-03T05:14:10.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6HfniS8pKm82DolNPcATYswelBtnWSx_0 2024-04-03T05:14:10.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.116847677220348698', time=2024-04-03T06:32:39.845158+0000, chain.objs.size()=1 2024-04-03T05:14:10.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.IRdn_-3FybQOrnhQb4rta9bt-CilXDP_0 2024-04-03T05:14:10.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2274336056174376438', time=2024-04-03T06:32:41.081870+0000, chain.objs.size()=1 2024-04-03T05:14:10.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1mTpTjbEbvozNWOmCzPEEl0V_H3uppd_0 2024-04-03T05:14:10.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4448534733159348278', time=2024-04-03T06:32:42.088548+0000, chain.objs.size()=1 2024-04-03T05:14:10.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ShUPn_DP5MUP8GDVw-W1yi63FTlsVJl_0 2024-04-03T05:14:10.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.920775598049987271', time=2024-04-03T06:32:42.975801+0000, chain.objs.size()=1 2024-04-03T05:14:10.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.a164xu_7apVfoYgKUjyrjEM0VGDtm5k_0 2024-04-03T05:14:10.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8616993810146579827', time=2024-04-03T06:32:43.039606+0000, chain.objs.size()=1 2024-04-03T05:14:10.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.57M42LGljwWRPVF5zQkW7oWE7gRc9P9_0 2024-04-03T05:14:10.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10533083462769484708', time=2024-04-03T06:32:44.035671+0000, chain.objs.size()=1 2024-04-03T05:14:10.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.217+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.QUGvpGYi8EF4kFgtDEYLGLCFxilmTzm_0 2024-04-03T05:14:10.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6508588091659199709', time=2024-04-03T06:32:44.544847+0000, chain.objs.size()=1 2024-04-03T05:14:10.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6Blx4aGVNco4ky0pJCe63uvP9p6JHnD_0 2024-04-03T05:14:10.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15883971046874046327', time=2024-04-03T06:32:46.823085+0000, chain.objs.size()=1 2024-04-03T05:14:10.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gAOaijpgf1PAWaVjsPNfI2Us6eKLV_w_0 2024-04-03T05:14:10.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10456319229401908072', time=2024-04-03T06:32:47.653134+0000, chain.objs.size()=1 2024-04-03T05:14:10.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GWuyhZXL2UN2M7-A3ukID3XvXxO5z2c_0 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1884281960398848149', time=2024-04-03T06:32:47.655392+0000, chain.objs.size()=1 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.suSGMOWnZ2bVK2f4MxBZUdJeA8n-pU8_0 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9239753172458903069', time=2024-04-03T06:32:50.608885+0000, chain.objs.size()=1 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.3GdLGFwghXtSQ16-GNMB4dNK_fXaSN2_0 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3166807770052128931', time=2024-04-03T06:32:52.209636+0000, chain.objs.size()=1 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GMfXjNmcxUNONnNayDhWp_yRUX-Ulv3_0 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17097105743840511785', time=2024-04-03T06:34:32.615572+0000, chain.objs.size()=1 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yPfhqhj2DYRYZzW9qB1Q3ItnVXw-5t3_0 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12536275254878779265', time=2024-04-03T06:34:33.361634+0000, chain.objs.size()=1 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.an9Cm0swSIK4prOrF2djBr6kBi-99QB_0 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.731596834924988676', time=2024-04-03T06:34:33.445584+0000, chain.objs.size()=1 2024-04-03T05:14:10.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.PKsbWrQhBH3l-6W1ic-vcoHH4hBD3a6_0 2024-04-03T05:14:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16018592676952259990', time=2024-04-03T06:34:33.809446+0000, chain.objs.size()=1 2024-04-03T05:14:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.muThSWArrd5q_PyhkDhuHDXKB89jE6J_0 2024-04-03T05:14:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10372030583946656274', time=2024-04-03T06:34:34.676380+0000, chain.objs.size()=1 2024-04-03T05:14:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.221+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-37ZUDv2qleDsG66t_IoJ66w7F9uHLw_0 2024-04-03T05:14:10.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17648114375803123826', time=2024-04-03T06:34:35.176323+0000, chain.objs.size()=1 2024-04-03T05:14:10.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.un-1jiba726yzbmCOUKqkoC24GPoZ_J_0 2024-04-03T05:14:10.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16751636334472529668', time=2024-04-03T06:34:36.377169+0000, chain.objs.size()=1 2024-04-03T05:14:10.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._Wm7rgymDD3oU9WYyKJUyB6CVcPJlnM_0 2024-04-03T05:14:10.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.225+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2803620726025644968', time=2024-04-03T06:34:37.016041+0000, chain.objs.size()=1 2024-04-03T05:14:10.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.225+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lJhskUHHO-uNtocHRkT_QTr77ulda2M_0 2024-04-03T05:14:10.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9228250659664323668', time=2024-04-03T06:34:38.083075+0000, chain.objs.size()=1 2024-04-03T05:14:10.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.e3XQTpLybsufIRRbaQ8XjnhFD10qfff_0 2024-04-03T05:14:10.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5771065514851364856', time=2024-04-03T06:34:41.925484+0000, chain.objs.size()=1 2024-04-03T05:14:10.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3xElc50orJhBLpxioHbXDX6keGcUstr_0 2024-04-03T05:14:10.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.20550548536253010', time=2024-04-03T06:34:42.403537+0000, chain.objs.size()=1 2024-04-03T05:14:10.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DrT2icJxGXkWyDBSy-D5IjPcC0AuT3K_0 2024-04-03T05:14:10.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16676899167585165981', time=2024-04-03T06:34:43.693260+0000, chain.objs.size()=1 2024-04-03T05:14:10.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.AYNLSZU6RB589szBMFfvFIzrlfgm9G0_0 2024-04-03T05:14:10.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9132141851737452908', time=2024-04-03T06:34:44.149721+0000, chain.objs.size()=1 2024-04-03T05:14:10.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.CiFXSRzsnOrTHVd05C-aXufs2FVFXUm_0 2024-04-03T05:14:10.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2767851934855787205', time=2024-04-03T06:34:46.206217+0000, chain.objs.size()=1 2024-04-03T05:14:10.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.AfiuPPBkmkeS9zpivMJpEVEXZmKzJOF_0 2024-04-03T05:14:10.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5328368282315396422', time=2024-04-03T06:34:48.015392+0000, chain.objs.size()=1 2024-04-03T05:14:10.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gvrJyhxXPcLFVLOny5CjRuAtp29Ri4k_0 2024-04-03T05:14:10.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10964575349328558975', time=2024-04-03T06:34:48.200744+0000, chain.objs.size()=1 2024-04-03T05:14:10.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.yWVKCvvi6aLn6qPd-mf3n2p48w2usFp_0 2024-04-03T05:14:10.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15233134522749830589', time=2024-04-03T06:34:49.168627+0000, chain.objs.size()=1 2024-04-03T05:14:10.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dgfFpH3kI3aapa01PiN6NSHSTw9IZOz_0 2024-04-03T05:14:10.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4890205700998783031', time=2024-04-03T06:34:49.546204+0000, chain.objs.size()=1 2024-04-03T05:14:10.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.sV8NJTsmAJd-8kO_6Nnrt87sPsSHj05_0 2024-04-03T05:14:10.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3649374716458250990', time=2024-04-03T06:34:50.038160+0000, chain.objs.size()=1 2024-04-03T05:14:10.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.229+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.1JsrFyDXY6tjuOy0XFHyh4fS1JdRmgH_0 2024-04-03T05:14:10.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.233+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7309987962070395904', time=2024-04-03T06:34:51.456332+0000, chain.objs.size()=1 2024-04-03T05:14:10.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.233+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IwvfxgS6xDANJAHpAVDcCiQw3tbhyZd_0 2024-04-03T05:14:10.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.233+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3366070948342485253', time=2024-04-03T06:34:52.529938+0000, chain.objs.size()=1 2024-04-03T05:14:10.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.233+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.u4zHfgmo9bYtlALC9Yl_lmT0npiDuHR_0 2024-04-03T05:14:10.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.233+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13378808823566875279', time=2024-04-03T06:34:52.817002+0000, chain.objs.size()=1 2024-04-03T05:14:10.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.233+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DdEqQtwNYrYnOQcU-eCcpW1zHdQrXi6_0 2024-04-03T05:14:10.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/48400 2024-04-03T05:14:10.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-04-03T05:14:10.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6602281687431430522', time=2024-04-03T06:34:54.967552+0000, chain.objs.size()=1 2024-04-03T05:14:10.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QU7s0U8idSRtbkLsFlGU7hS-nbdOcXE_0 2024-04-03T05:14:10.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5711348277520773184', time=2024-04-03T06:34:55.201959+0000, chain.objs.size()=1 2024-04-03T05:14:10.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.4l_rxkNZ3kMpWbJzVAC3X1arnyFO8-0_0 2024-04-03T05:14:10.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9662085731212827455', time=2024-04-03T06:34:56.436341+0000, chain.objs.size()=1 2024-04-03T05:14:10.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wQgnDkJOXCRAKAMuXlNMpxl1rADYBQI_0 2024-04-03T05:14:10.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12567556691379292469', time=2024-04-03T06:35:34.225622+0000, chain.objs.size()=1 2024-04-03T05:14:10.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.312__shadow_.NuijocUNbF2enoXgcNk1mDbGE3Th-pG_0 2024-04-03T05:14:10.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12003043408327146502', time=2024-04-03T06:35:36.023740+0000, chain.objs.size()=1 2024-04-03T05:14:10.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.313__shadow_.G0PjB6Vs0ZD27_0X0w1GGBFzQD2LvoJ_0 2024-04-03T05:14:10.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13288529409915043658', time=2024-04-03T06:38:27.424274+0000, chain.objs.size()=1 2024-04-03T05:14:10.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.403__shadow_._pd82pQr6kh6KzNuLeTsPRkRtfnBlyD_0 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17892484080963655285', time=2024-04-03T06:39:31.948673+0000, chain.objs.size()=1 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.430__shadow_.UckXnKg2xM4vU4vt6n01q9lz4gxtg1y_0 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18225902050651232153', time=2024-04-03T06:39:37.747447+0000, chain.objs.size()=1 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.432__shadow_.OdBSrzvGw_AXWJb3unmYi-dmDHyTKrj_0 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.468__shadow_.y9lpsO-pGEHJeGZrNYXi8IjJ_emTRrm_1_1b2a68b7418e57d04de036326d82e83d', time=2024-04-03T06:40:50.548977+0000, chain.objs.size()=1 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.468__shadow_.y9lpsO-pGEHJeGZrNYXi8IjJ_emTRrm_0 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10156986936666547116', time=2024-04-03T06:42:27.149896+0000, chain.objs.size()=2 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.487__shadow_.M6XJBg37tExA2DUKonkzPY1ghEbJSND_0 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.487__shadow_.M6XJBg37tExA2DUKonkzPY1ghEbJSND_1 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1629810834016871656', time=2024-04-03T06:52:13.411928+0000, chain.objs.size()=1 2024-04-03T05:14:10.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.237+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.530__multipart_mymultipart.2~Xqk83OjyWPwVlPlEfUzAvmbKgBkMSeg.1 2024-04-03T05:14:10.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13968466585977133912', time=2024-04-03T06:52:53.441061+0000, chain.objs.size()=1 2024-04-03T05:14:10.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:VLdglcNZcdEUooLHUDaHy0n0a7TO5-i_.3NCeRm8duRPluqd0lH9n7KDYC65v4Zp_0 2024-04-03T05:14:10.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6603034822282849399', time=2024-04-03T06:53:02.775005+0000, chain.objs.size()=1 2024-04-03T05:14:10.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.539__shadow:5Ua6LwKfqFhp.kRHw3pua09ImDNIijC_.D6L_qb7mlzGhzYLktke5S1bsN2C3Wcz_0 2024-04-03T05:14:10.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3845159618329687882', time=2024-04-03T06:55:24.062902+0000, chain.objs.size()=1 2024-04-03T05:14:10.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:XkBgzqWL3I9oH5MfyhGlwkDfq8qjlGJ_.5oyY2ocHShrNseT7GZ7l5GCSXscQwKt_0 2024-04-03T05:14:10.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.241+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5092987348326553937', time=2024-04-03T06:55:31.983327+0000, chain.objs.size()=1 2024-04-03T05:14:10.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.241+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.551__shadow:wT3tzIdLEH4y1QSuDd4bXY3Af5dVV5I_.0Cqrpwaq8ELDHqo8yFYqgGwIeb6-AuN_0 2024-04-03T05:14:10.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.245+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18243911846303863290', time=2024-04-03T07:01:21.767314+0000, chain.objs.size()=1 2024-04-03T05:14:10.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.245+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.604__shadow_.wrWkzGZAANNgzVVzZ8Vm1suVuY_zxgC_0 2024-04-03T05:14:10.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.245+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.909242053873862020', time=2024-04-03T07:04:42.025115+0000, chain.objs.size()=1 2024-04-03T05:14:10.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.245+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.663__shadow:f8uDW6WoeTX5C-MJReV87m2c1Fcv-PK_.gsXy5KgMbLgiDjTK_QMtB2f2C6XdnIJ_0 2024-04-03T05:14:10.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.245+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4850489030895896098', time=2024-04-03T07:07:36.994174+0000, chain.objs.size()=1 2024-04-03T05:14:10.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.245+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.704__shadow_.mdai4a4QAVaTqJHzzzLtil_oVNVhiUt_0 2024-04-03T05:14:10.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.249+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:10.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-03T05:14:10.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.253+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:10.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:10.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45080' 2024-04-03T05:14:10.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_B4GwftWDnkHfPv4Nb7mICPcbKsMapAt', time=2024-04-03T06:22:03.362832+0000, chain.objs.size()=3 2024-04-03T05:14:10.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.i5anj2ShIsKQQueC050rTy0vRAUvXcT_0 2024-04-03T05:14:10.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.i5anj2ShIsKQQueC050rTy0vRAUvXcT_1 2024-04-03T05:14:10.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.i5anj2ShIsKQQueC050rTy0vRAUvXcT_2 2024-04-03T05:14:10.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2971514098171847136', time=2024-04-03T06:22:36.858541+0000, chain.objs.size()=5 2024-04-03T05:14:10.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__multipart_foo-FROZEN.2~PRsLd4dLk_oZaPyID_audejnqNrV-Me.1 2024-04-03T05:14:10.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_foo-FROZEN.2~PRsLd4dLk_oZaPyID_audejnqNrV-Me.1_1 2024-04-03T05:14:10.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__multipart_foo-FROZEN.2~PRsLd4dLk_oZaPyID_audejnqNrV-Me.2 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_foo-FROZEN.2~PRsLd4dLk_oZaPyID_audejnqNrV-Me.2_1 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__multipart_foo-FROZEN.2~PRsLd4dLk_oZaPyID_audejnqNrV-Me.3 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18065216858265981373', time=2024-04-03T06:23:04.683484+0000, chain.objs.size()=1 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.155__shadow_.lvidD8ihj0LKMWyhV-aytozMKzo5iQS_0 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15368816307229243533', time=2024-04-03T06:25:44.328452+0000, chain.objs.size()=1 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.215__shadow_.CNMCGwYasgxzVbXR5UM_-u1VcXM-q4z_0 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3514105357293353049', time=2024-04-03T06:25:53.116222+0000, chain.objs.size()=1 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.219__shadow_.DmzETzyHPRjNgwcend06qGGsyxN34-h_0 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6978977726940864830', time=2024-04-03T06:26:10.456137+0000, chain.objs.size()=1 2024-04-03T05:14:10.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.257+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.227__shadow_.Cn_iAUBCsXRsEpk27POKKtk4buF8EQL_0 2024-04-03T05:14:10.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5632071670488077876', time=2024-04-03T06:27:53.248750+0000, chain.objs.size()=1 2024-04-03T05:14:10.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ztoLPf5DMh4tV4sfSlMCP3VwLsss7Ca_0 2024-04-03T05:14:10.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13938712503338889210', time=2024-04-03T06:27:53.507161+0000, chain.objs.size()=1 2024-04-03T05:14:10.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.hlin4UqRNYVbhCBmwtwA9IglNzpbxtB_0 2024-04-03T05:14:10.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14430337346808781860', time=2024-04-03T06:27:53.590165+0000, chain.objs.size()=1 2024-04-03T05:14:10.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.PJJXdFnPTcgD-QTrL9sgWGCPRYb6g_T_0 2024-04-03T05:14:10.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16758823724281595563', time=2024-04-03T06:27:54.589905+0000, chain.objs.size()=1 2024-04-03T05:14:10.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1yeTOWiTNA6jrSNmJoOiu3LGI2CfERC_0 2024-04-03T05:14:10.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6020245382654351734', time=2024-04-03T06:27:54.634882+0000, chain.objs.size()=1 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1qhv44xg7hT7I95fPHtK--iKSaGMIuH_0 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10367797740293499010', time=2024-04-03T06:27:56.637138+0000, chain.objs.size()=1 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lDrNlWLZq-B-nES0gRWi5XTkUp9_jJX_0 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1689505361530172853', time=2024-04-03T06:27:57.314496+0000, chain.objs.size()=1 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fuePk3NN4wyTIRqpYxNV-L-p1sSo_fJ_0 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7805328075814233770', time=2024-04-03T06:27:57.539397+0000, chain.objs.size()=1 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tDKHzXbTgMFLpw8WIqqwh34mWjllsf9_0 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3832452018475836683', time=2024-04-03T06:27:58.053583+0000, chain.objs.size()=1 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Tud9YLtArR3CMXHByeN8NieRW8mrGhN_0 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14718001494334607625', time=2024-04-03T06:27:58.560971+0000, chain.objs.size()=1 2024-04-03T05:14:10.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fUviyqN1raEhCErdvLQdMZsMrH4Zo1t_0 2024-04-03T05:14:10.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14347748995574795913', time=2024-04-03T06:28:02.040342+0000, chain.objs.size()=1 2024-04-03T05:14:10.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.261+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fzQP8SNwQ5yz5x7DS0nijqZHtuPd_ND_0 2024-04-03T05:14:10.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7586784765158176949', time=2024-04-03T06:28:04.077709+0000, chain.objs.size()=1 2024-04-03T05:14:10.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xtDEB96M2aT2CQUj7t02HuwRIzm3dX2_0 2024-04-03T05:14:10.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11372963491850167289', time=2024-04-03T06:28:05.418475+0000, chain.objs.size()=1 2024-04-03T05:14:10.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.zv8F90ppmpbrngsoMLtXIkOiI2zStBe_0 2024-04-03T05:14:10.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.771985286119616681', time=2024-04-03T06:28:05.849712+0000, chain.objs.size()=1 2024-04-03T05:14:10.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.zlvausiCqdskF3vdQV0zaffGSVZ5Qku_0 2024-04-03T05:14:10.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13297283916704782609', time=2024-04-03T06:28:05.930138+0000, chain.objs.size()=1 2024-04-03T05:14:10.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6UbOMKonQbnTOjnMKuABTFGevHMIOnj_0 2024-04-03T05:14:10.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17219726194338939017', time=2024-04-03T06:28:08.713018+0000, chain.objs.size()=1 2024-04-03T05:14:10.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9yaIjqWgNxQMS1L7TAuwGYeoTk6L6KL_0 2024-04-03T05:14:10.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16929062435360164804', time=2024-04-03T06:28:08.739646+0000, chain.objs.size()=1 2024-04-03T05:14:10.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.HvvoG3zVGlXTuxKNJcroSuUGPsIuDuU_0 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14233916071833072960', time=2024-04-03T06:28:12.241765+0000, chain.objs.size()=1 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Wv3d4FcbGUp0YIYYBDGG4PiXAmJjktU_0 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16538481553428481097', time=2024-04-03T06:28:13.246710+0000, chain.objs.size()=1 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.y-uwdJHhy6J0ep9mPUxad5c-a5m-1Hu_0 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15623659488064719082', time=2024-04-03T06:28:13.885734+0000, chain.objs.size()=1 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5MDH0Q9obOJUuWRKpkpOeX9P5DrOsUO_0 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6053898250217752767', time=2024-04-03T06:28:15.092753+0000, chain.objs.size()=1 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mpl_pKLt5QuH8DkZ8rSFvDYRfQYlEWS_0 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18392466618237048387', time=2024-04-03T06:28:16.027960+0000, chain.objs.size()=1 2024-04-03T05:14:10.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.265+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.uPZY1TnE84AEWOCbogWGDsiKNLUtcP2_0 2024-04-03T05:14:10.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17075173540757724511', time=2024-04-03T06:28:16.722287+0000, chain.objs.size()=1 2024-04-03T05:14:10.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ETuEivjpZe0DLzfHAwQjytiMPcMAOBl_0 2024-04-03T05:14:10.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7972479117183796104', time=2024-04-03T06:28:16.895712+0000, chain.objs.size()=1 2024-04-03T05:14:10.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tLLz7vWKOgzPCWXMOF60pAvxIY856gx_0 2024-04-03T05:14:10.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3818201656443949901', time=2024-04-03T06:28:17.669546+0000, chain.objs.size()=1 2024-04-03T05:14:10.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.D_Zb83ZSf0SRqY4hJwpwJyjffkgSPjT_0 2024-04-03T05:14:10.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13506114692701444066', time=2024-04-03T06:28:18.763439+0000, chain.objs.size()=1 2024-04-03T05:14:10.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.pvkvFXbb8p8UEuubc_e1CuUDVUpqoeV_0 2024-04-03T05:14:10.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9893185537148361036', time=2024-04-03T06:28:27.587923+0000, chain.objs.size()=1 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.234__shadow_.71f9QWBNaqzz0MOKW7wziFvx6PWgmwF_0 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1866643493344546148', time=2024-04-03T06:28:27.599166+0000, chain.objs.size()=1 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.234__shadow_.SWSNMLT9f2w934IrPWIgrHjsRZLjLv6_0 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2564049741625172150', time=2024-04-03T06:29:35.922350+0000, chain.objs.size()=1 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.nViSySA8cl_xhT_9r2opDAJunbPyWhM_0 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12536667442149042002', time=2024-04-03T06:29:36.101122+0000, chain.objs.size()=1 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.269+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.gnnHwnGiArNu0kicYZ2EFbjVlcyGKWu_0 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8669127293509461782', time=2024-04-03T06:29:36.248871+0000, chain.objs.size()=1 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.O9-4HI-jdDVXnMfTGTbTnbgDqcmQ2c8_0 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2236834339513869489', time=2024-04-03T06:29:47.458576+0000, chain.objs.size()=1 2024-04-03T05:14:10.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.267__shadow_.MG7VId6vJCZdZE1jeS8_g-BLW6rCFYi_0 2024-04-03T05:14:10.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12786307927324209656', time=2024-04-03T06:29:51.939323+0000, chain.objs.size()=1 2024-04-03T05:14:10.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.269__shadow_.VIvYDoHBUDmsYxHkwLmSmj6-GZpFEqT_0 2024-04-03T05:14:10.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.647965240855870823', time=2024-04-03T06:30:47.559608+0000, chain.objs.size()=1 2024-04-03T05:14:10.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.291__shadow_.8h4AFicJ1VRyK4f5wC6j3yyS8vkjOZd_0 2024-04-03T05:14:10.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11330883164636032387', time=2024-04-03T06:32:24.487230+0000, chain.objs.size()=1 2024-04-03T05:14:10.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rPik8NMVv1gFC9n9WpU6zQ8VnkdRQ4q_0 2024-04-03T05:14:10.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15410994882589103185', time=2024-04-03T06:32:25.404787+0000, chain.objs.size()=1 2024-04-03T05:14:10.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dKyehitV7BV142ceRHy-4WPWV1Kkomy_0 2024-04-03T05:14:10.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15760411176597387927', time=2024-04-03T06:32:25.699856+0000, chain.objs.size()=1 2024-04-03T05:14:10.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-VggFeX4Genq5jDft42Ajen8BkDZNeP_0 2024-04-03T05:14:10.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9945758867259042351', time=2024-04-03T06:32:26.617811+0000, chain.objs.size()=1 2024-04-03T05:14:10.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yXmqmVwFUxqmudF_p7mJwIeL0ZqnN3B_0 2024-04-03T05:14:10.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4872456199581059118', time=2024-04-03T06:32:26.957276+0000, chain.objs.size()=1 2024-04-03T05:14:10.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.q0QeNJQ0zHncn0-_X5RXnzo-sdsQ5Pe_0 2024-04-03T05:14:10.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4204987469132355365', time=2024-04-03T06:32:28.674895+0000, chain.objs.size()=1 2024-04-03T05:14:10.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.i2BvwC8QUYddBBIxmL0o8J1Fo4s1Yim_0 2024-04-03T05:14:10.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4160656909338432207', time=2024-04-03T06:32:28.734978+0000, chain.objs.size()=1 2024-04-03T05:14:10.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.L7HEpPZ9tH3_K-yAK2S0C5XofqvcZav_0 2024-04-03T05:14:10.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3629845972260107587', time=2024-04-03T06:32:29.155278+0000, chain.objs.size()=1 2024-04-03T05:14:10.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YPsYQrKfYYWaG76OK-hbXmArgvAwsPN_0 2024-04-03T05:14:10.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9010426937755092604', time=2024-04-03T06:32:29.931033+0000, chain.objs.size()=1 2024-04-03T05:14:10.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.273+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CkhcIv7UP4w7VHLLzBuI6zX5M7MjXr-_0 2024-04-03T05:14:10.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8257855811651965411', time=2024-04-03T06:32:30.521346+0000, chain.objs.size()=1 2024-04-03T05:14:10.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ueu3Akjjl15COOTAvRE4dfXevAD84Xd_0 2024-04-03T05:14:10.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9695684136017239955', time=2024-04-03T06:32:31.712864+0000, chain.objs.size()=1 2024-04-03T05:14:10.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xgiskzmhKH03BA0hBZnO_KgdpzJjopg_0 2024-04-03T05:14:10.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.520890782075133216', time=2024-04-03T06:32:33.196327+0000, chain.objs.size()=1 2024-04-03T05:14:10.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.fGhJhHcYk_sqY94NPJJWAwCNJPq8j1O_0 2024-04-03T05:14:10.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3356572070650676118', time=2024-04-03T06:32:35.650174+0000, chain.objs.size()=1 2024-04-03T05:14:10.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MUxVCmX1bNM1xIGSCk4gQUL8qRt9sD6_0 2024-04-03T05:14:10.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15173888161401100480', time=2024-04-03T06:32:35.652331+0000, chain.objs.size()=1 2024-04-03T05:14:10.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VzIoo9OPcMwtY1PWOhMZVu9olM49ciS_0 2024-04-03T05:14:10.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11237229714237269956', time=2024-04-03T06:32:35.895484+0000, chain.objs.size()=1 2024-04-03T05:14:10.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BxHI4v2zd5R7WwBLXzu3Fs8jrVUMUtg_0 2024-04-03T05:14:10.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9331885395814189407', time=2024-04-03T06:32:36.426618+0000, chain.objs.size()=1 2024-04-03T05:14:10.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.UTsRezSsYPlTLldE70f5fllDCK_nnRb_0 2024-04-03T05:14:10.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10689057911045734898', time=2024-04-03T06:32:36.707311+0000, chain.objs.size()=1 2024-04-03T05:14:10.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.wFmZKYdUBNYZvVZrOibPngCuikHJPUX_0 2024-04-03T05:14:10.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6005951821503352404', time=2024-04-03T06:32:38.441511+0000, chain.objs.size()=1 2024-04-03T05:14:10.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9sbO_ghyxBD7VAUSvykX8InGUC4-Sid_0 2024-04-03T05:14:10.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17727982350773097621', time=2024-04-03T06:32:39.408778+0000, chain.objs.size()=1 2024-04-03T05:14:10.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EiffAG7bADb58dMKDnFOOqXuW2brCQx_0 2024-04-03T05:14:10.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15766750342382476558', time=2024-04-03T06:32:39.726919+0000, chain.objs.size()=1 2024-04-03T05:14:10.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.277+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.esEdRAj_aRJaUJ_XuFgpB0l9esjQxIJ_0 2024-04-03T05:14:10.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7751508153902991914', time=2024-04-03T06:32:42.965849+0000, chain.objs.size()=1 2024-04-03T05:14:10.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.OHUvqkeeTYmX5ScA8VbJFzY0TH0iY94_0 2024-04-03T05:14:10.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9087489020845515334', time=2024-04-03T06:32:44.844667+0000, chain.objs.size()=1 2024-04-03T05:14:10.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HzLKF77bqv3LH75YmpavLDlZFxgujhD_0 2024-04-03T05:14:10.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6512683628428376253', time=2024-04-03T06:32:45.164255+0000, chain.objs.size()=1 2024-04-03T05:14:10.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Wah0qOyUcbBkCJ6Dk9RUyp7caw1oYbG_0 2024-04-03T05:14:10.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3688615249203166510', time=2024-04-03T06:32:45.581357+0000, chain.objs.size()=1 2024-04-03T05:14:10.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.3-gtuqeuTpguxQnnkaQv8G8f8MNyIvW_0 2024-04-03T05:14:10.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1644802075115092044', time=2024-04-03T06:32:46.389967+0000, chain.objs.size()=1 2024-04-03T05:14:10.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.x5pbrhfeZE6fxjYe3yoEaXLGhsqtynf_0 2024-04-03T05:14:10.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2144291151144359382', time=2024-04-03T06:32:46.955159+0000, chain.objs.size()=1 2024-04-03T05:14:10.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.281+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MHIc55lek77zQkEhTXusERaYCTNE-4J_0 2024-04-03T05:14:10.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12693617304458616093', time=2024-04-03T06:32:49.019418+0000, chain.objs.size()=1 2024-04-03T05:14:10.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6lPqKZyWD8jlvw0at0qEgxY12xm1lJ9_0 2024-04-03T05:14:10.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17756074386173127596', time=2024-04-03T06:32:49.180071+0000, chain.objs.size()=1 2024-04-03T05:14:10.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4kaw1m6oiDFv7dxP-tYXrwXSn26GS43_0 2024-04-03T05:14:10.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11363266840104122313', time=2024-04-03T06:32:49.906135+0000, chain.objs.size()=1 2024-04-03T05:14:10.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.EBlsNhcbgaa5SCLXNErBcoCY12Zz-VI_0 2024-04-03T05:14:10.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17895038726027690809', time=2024-04-03T06:32:50.490896+0000, chain.objs.size()=1 2024-04-03T05:14:10.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.G3bO3mhHE3PfMjmOGd0Vjkxlsvyqrll_0 2024-04-03T05:14:10.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4845326308809037151', time=2024-04-03T06:32:50.527686+0000, chain.objs.size()=1 2024-04-03T05:14:10.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vjNdYVyi8Oaz02_I74BV_wRg1nsijoR_0 2024-04-03T05:14:10.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2546834387995156539', time=2024-04-03T06:32:51.207571+0000, chain.objs.size()=1 2024-04-03T05:14:10.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.KD5-L3rx6rNfQjtHbGH739fzZuWF_od_0 2024-04-03T05:14:10.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14104176191324915471', time=2024-04-03T06:34:28.521961+0000, chain.objs.size()=1 2024-04-03T05:14:10.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5DIGa_LWA-gWNxyq_OfmgHFciiI1EwE_0 2024-04-03T05:14:10.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3303980177546079071', time=2024-04-03T06:34:28.840062+0000, chain.objs.size()=1 2024-04-03T05:14:10.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cEyNFUfG6jUjJP4YA0iIUYLq39CzElb_0 2024-04-03T05:14:10.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8198996728387445675', time=2024-04-03T06:34:29.794442+0000, chain.objs.size()=1 2024-04-03T05:14:10.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gncKsds5zADJk98itGC3h4y-QRgVO6A_0 2024-04-03T05:14:10.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10533991741643630117', time=2024-04-03T06:34:30.211985+0000, chain.objs.size()=1 2024-04-03T05:14:10.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.285+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hCXqT0d6FOGN8hu9hPTgbYvFfXBXaWs_0 2024-04-03T05:14:10.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17962945948113889092', time=2024-04-03T06:34:30.538190+0000, chain.objs.size()=1 2024-04-03T05:14:10.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._At9rhZlpa0bBrQxVgOQq85dksWAkBM_0 2024-04-03T05:14:10.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1807891527402638858', time=2024-04-03T06:34:32.458960+0000, chain.objs.size()=1 2024-04-03T05:14:10.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-J-hih5CWwC9iDytyVAueaHvOTeaw17_0 2024-04-03T05:14:10.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2462540998711404064', time=2024-04-03T06:34:32.584553+0000, chain.objs.size()=1 2024-04-03T05:14:10.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.beWC4DtnXs81vhthXZjIqe0UGwDkHVb_0 2024-04-03T05:14:10.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17007858663721510830', time=2024-04-03T06:34:34.895084+0000, chain.objs.size()=1 2024-04-03T05:14:10.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.f_6ty5X_rWbgqjA94BlMo3eGcgM_wdR_0 2024-04-03T05:14:10.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10891944925483249055', time=2024-04-03T06:34:36.387244+0000, chain.objs.size()=1 2024-04-03T05:14:10.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.--r0eRcpIn14O3uQEI_bOGcqghVMQNC_0 2024-04-03T05:14:10.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5122160764022260645', time=2024-04-03T06:34:36.407950+0000, chain.objs.size()=1 2024-04-03T05:14:10.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Ajq9v82vlYUTbHJc5e95F7seSU11T6J_0 2024-04-03T05:14:10.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4376419932762822276', time=2024-04-03T06:34:36.737868+0000, chain.objs.size()=1 2024-04-03T05:14:10.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ypcOSjXfB3nLpiyZoCUbXanbr429xMY_0 2024-04-03T05:14:10.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6634444679310452003', time=2024-04-03T06:34:36.740351+0000, chain.objs.size()=1 2024-04-03T05:14:10.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.KERKjLnNXMAywiih-x_x4rsYmyrutDG_0 2024-04-03T05:14:10.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3260200823135945588', time=2024-04-03T06:34:37.417293+0000, chain.objs.size()=1 2024-04-03T05:14:10.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.RH8UaYGlSjoiOSkZ4hfgGdfL9Y906NP_0 2024-04-03T05:14:10.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10270672204719606342', time=2024-04-03T06:34:40.027204+0000, chain.objs.size()=1 2024-04-03T05:14:10.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.0k24TMytt_b5rCv3f-4O9CDxz6uSHAQ_0 2024-04-03T05:14:10.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7989384348125859920', time=2024-04-03T06:34:41.163851+0000, chain.objs.size()=1 2024-04-03T05:14:10.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.289+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LLuCnC8wRL4kdJWXqusjT0mwv53TtGi_0 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15146933734301108137', time=2024-04-03T06:34:41.792550+0000, chain.objs.size()=1 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Npzl7RaH7zNPIxuLCre5RP7VQ1QOTG-_0 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8143453177515032476', time=2024-04-03T06:34:43.743140+0000, chain.objs.size()=1 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hE788l4jvb6i5XXnE9hMxlz4Rse0yTq_0 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14156516536963950363', time=2024-04-03T06:34:44.079604+0000, chain.objs.size()=1 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._NwQj2mAqwGbkwgJA24fROyLOaF5RsW_0 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3445897729958769602', time=2024-04-03T06:34:45.981281+0000, chain.objs.size()=1 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.bbpRf4G2MFGYAm9sV8xhBSbJPiyxG1I_0 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3121412170293459111', time=2024-04-03T06:34:46.209389+0000, chain.objs.size()=1 2024-04-03T05:14:10.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.heCLWdjoWrqdadw1Ql7o3zvcxfy0Ivl_0 2024-04-03T05:14:10.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10372107140190305271', time=2024-04-03T06:34:46.508562+0000, chain.objs.size()=1 2024-04-03T05:14:10.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9wnxmZf_8gmsd15Y2Im9BzLodm0pD0g_0 2024-04-03T05:14:10.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13934844176412657778', time=2024-04-03T06:34:47.414219+0000, chain.objs.size()=1 2024-04-03T05:14:10.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YhARXSvsOjCyGnr9ChJHQXY1wbW3ZG9_0 2024-04-03T05:14:10.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17244961489343691793', time=2024-04-03T06:34:47.729027+0000, chain.objs.size()=1 2024-04-03T05:14:10.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.OqlBpeyTOFV858W4KaWTwEY7ZQPLAGf_0 2024-04-03T05:14:10.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16052082972288850758', time=2024-04-03T06:34:48.967044+0000, chain.objs.size()=1 2024-04-03T05:14:10.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.293+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hUqECwbC6OeRDFmcjWQW31Mej12Y9iV_0 2024-04-03T05:14:10.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.297+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15862564506804677552', time=2024-04-03T06:34:50.878379+0000, chain.objs.size()=1 2024-04-03T05:14:10.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.297+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ryjZJ--WUo3IMEAsmRRM5TCAK-2o8O0_0 2024-04-03T05:14:10.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.297+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11026433378320869923', time=2024-04-03T06:34:51.647359+0000, chain.objs.size()=1 2024-04-03T05:14:10.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.297+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TTBW4rT-DS61GRYVIjdY7wYOKimXyA__0 2024-04-03T05:14:10.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.297+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13865481981966942552', time=2024-04-03T06:34:52.006487+0000, chain.objs.size()=1 2024-04-03T05:14:10.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.297+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3xxuN1ccNu9Flp-rSLnftNM0L3IEBme_0 2024-04-03T05:14:10.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.297+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10345887323602807421', time=2024-04-03T06:34:52.008493+0000, chain.objs.size()=1 2024-04-03T05:14:10.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.297+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xLcg950Uwyxe8chkb562FAUqwajzQVV_0 2024-04-03T05:14:10.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/45080 2024-04-03T05:14:10.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-04-03T05:14:10.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.797154865463007204', time=2024-04-03T06:34:54.372412+0000, chain.objs.size()=1 2024-04-03T05:14:10.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.aMVhptKr3UvnYCLgC0qR1TVissjdLF0_0 2024-04-03T05:14:10.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6660515699886545583', time=2024-04-03T06:34:55.527566+0000, chain.objs.size()=1 2024-04-03T05:14:10.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.30fGK1IgRqvGOqqQzUDSvk4puG9Au3Z_0 2024-04-03T05:14:10.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14078086539034891663', time=2024-04-03T06:34:55.924148+0000, chain.objs.size()=1 2024-04-03T05:14:10.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.PeYEwuNLqkCqPQCx2VHYYa8XVOog4-7_0 2024-04-03T05:14:10.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6960687613759069085', time=2024-04-03T06:34:55.987155+0000, chain.objs.size()=1 2024-04-03T05:14:10.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fmTQm5Qy8uydVweOUcGjY57dzp7z8M7_0 2024-04-03T05:14:10.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7799125957065554240', time=2024-04-03T06:34:56.038900+0000, chain.objs.size()=1 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.NX7V0P-31NRTTH7DQ553vV3mWeL8VoT_0 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.678490158044251222', time=2024-04-03T06:34:56.241912+0000, chain.objs.size()=1 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QFKiy0ppHdDGLcAwur3IeLKzDahfyr1_0 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12402860238732659483', time=2024-04-03T06:38:49.419731+0000, chain.objs.size()=1 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.413__shadow_.Z5xjt66j5EvwIFXIPsKZBCmy-AM5eTt_0 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15448025029625119058', time=2024-04-03T06:39:20.701904+0000, chain.objs.size()=1 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.426__shadow_.JyHSGAVDOyHanirrWy1HkE92p5-Xh1N_0 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4237907323923582131', time=2024-04-03T06:39:26.343034+0000, chain.objs.size()=1 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.428__shadow_.5nvjLy_qpmkf3qQpX8tIoNCj9mHhNDD_0 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~Y5XlLAAZcCqPAnW6fBZ2yAbwRU60gSX', time=2024-04-03T06:49:25.437046+0000, chain.objs.size()=2 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.501__multipart_mymultipart.2~Y5XlLAAZcCqPAnW6fBZ2yAbwRU60gSX.1 2024-04-03T05:14:10.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.501__multipart_mymultipart.2~Y5XlLAAZcCqPAnW6fBZ2yAbwRU60gSX.2 2024-04-03T05:14:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17849770417210888917', time=2024-04-03T06:51:39.617164+0000, chain.objs.size()=1 2024-04-03T05:14:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.301+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.525__shadow_.dFjOS2wJUhD70bfXYR-lq3WnwuRfVV8_0 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12815538807984554997', time=2024-04-03T06:51:48.045312+0000, chain.objs.size()=1 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.526__shadow_.vv4iFqPzaVlvsHAIJWLcYvTW83fTlN0_0 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15508314627366479714', time=2024-04-03T06:54:04.036276+0000, chain.objs.size()=1 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:Eq5zAxm9RHnVf12u4xC2nvWXLnR49vV_.76xJlvm7nrbYpodP90Z2fZbW0s8rVcE_0 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2963778041324510206', time=2024-04-03T06:55:05.593762+0000, chain.objs.size()=4 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~Rj-rgB-wZNGNU6RE4u4CdCiGfcSxZMw.1 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~Rj-rgB-wZNGNU6RE4u4CdCiGfcSxZMw.2 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~Rj-rgB-wZNGNU6RE4u4CdCiGfcSxZMw.3 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.547__multipart_testobj.2~Rj-rgB-wZNGNU6RE4u4CdCiGfcSxZMw.4 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4125610337603455127', time=2024-04-03T07:02:17.544459+0000, chain.objs.size()=1 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.616__shadow_.LwDnFiYhlVMxzP5JEk621onvj11EWNZ_0 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12387882294957244071', time=2024-04-03T07:03:40.344636+0000, chain.objs.size()=1 2024-04-03T05:14:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.629__shadow_.b0M7wBmL0_Rj9pAb3oXp12W3cK4V9a5_0 2024-04-03T05:14:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3543677181568134835', time=2024-04-03T07:03:46.289625+0000, chain.objs.size()=1 2024-04-03T05:14:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.305+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.631__shadow_.XxqU3MVC8HSga8eGK_FT-P2FJX0pWaG_0 2024-04-03T05:14:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13558299172757583412', time=2024-04-03T07:04:38.182046+0000, chain.objs.size()=1 2024-04-03T05:14:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.661__shadow:GdNp2.MEOf8wBJz841bYgWqDzmPWIZE_.8SEsNHY_ebQUifn7PhEnZ9xIqjG3NVa_0 2024-04-03T05:14:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.309+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13986386759993360000', time=2024-04-03T07:06:42.550939+0000, chain.objs.size()=1 2024-04-03T05:14:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.309+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.702__shadow_.Ph50POcdzn5OCXPfDODz5U1xH4cJjKs_0 2024-04-03T05:14:10.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.313+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:10.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-03T05:14:10.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:10.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41938' 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12467167878541832919', time=2024-04-03T06:21:13.930736+0000, chain.objs.size()=3 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.147__shadow_.IcwS9jr1Cgzd0HaBPhm_J3adAG6xLKR_0 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.147__shadow_.IcwS9jr1Cgzd0HaBPhm_J3adAG6xLKR_1 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.147__shadow_.IcwS9jr1Cgzd0HaBPhm_J3adAG6xLKR_2 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1445261742563755189', time=2024-04-03T06:27:55.142036+0000, chain.objs.size()=1 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fcGy1ES8qajAUoDCExyCC8An6Greymp_0 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1727016625977710646', time=2024-04-03T06:27:56.369584+0000, chain.objs.size()=1 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ImHQjcgXmVx5MA6rZMa_2qNZJAKN3WC_0 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17620491960097173603', time=2024-04-03T06:27:58.168513+0000, chain.objs.size()=1 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cgKi9jg2Bh15Y17OhkZJ4EMAfvn8dhg_0 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6988711889077305551', time=2024-04-03T06:27:58.942524+0000, chain.objs.size()=1 2024-04-03T05:14:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MzZpc4k9uJdAZGSZDxl6wv-1ZWlM9cm_0 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12785284898910858645', time=2024-04-03T06:28:00.051349+0000, chain.objs.size()=1 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.iDaQwJV1GkRTcmSwA1lPiymg2kKrVSD_0 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5147848021972385413', time=2024-04-03T06:28:00.054616+0000, chain.objs.size()=1 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nmtjTXfDLU4xvyeDdv144kDlyOYHwx0_0 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15561310239818772108', time=2024-04-03T06:28:01.512167+0000, chain.objs.size()=1 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.6reOob71fwXKHEE_-BAsczozuIZAn3I_0 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12663239875453847281', time=2024-04-03T06:28:01.603146+0000, chain.objs.size()=1 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.h4j1FWo_76eM_O_ux30w6KosglR4QvG_0 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.485726873062904669', time=2024-04-03T06:28:01.782193+0000, chain.objs.size()=1 2024-04-03T05:14:10.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.317+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UaDJdhWjYDlfBzi2aWzaNWy7gbMsbGi_0 2024-04-03T05:14:10.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15387432651499872220', time=2024-04-03T06:28:02.800126+0000, chain.objs.size()=1 2024-04-03T05:14:10.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.pB89HadpeAAQdzQR8ZW9FhRIRj6hZB1_0 2024-04-03T05:14:10.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12278853671181756653', time=2024-04-03T06:28:02.811878+0000, chain.objs.size()=1 2024-04-03T05:14:10.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.NeiAk9xeQsGTs8anTdz4ibtJ6Hns30J_0 2024-04-03T05:14:10.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3512860897960775949', time=2024-04-03T06:28:04.405625+0000, chain.objs.size()=1 2024-04-03T05:14:10.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.a0fhQ0Ohb7kefXbJ1kEEMq_95AU3WlM_0 2024-04-03T05:14:10.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2826497874405312173', time=2024-04-03T06:28:05.274988+0000, chain.objs.size()=1 2024-04-03T05:14:10.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.USkwbetSVVUuMGQoP8w-A_gfwdLLTjs_0 2024-04-03T05:14:10.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2487767162544230684', time=2024-04-03T06:28:05.836543+0000, chain.objs.size()=1 2024-04-03T05:14:10.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Wv1ZKPPnOf5Jfh9bphC9wpBQWQ3svR2_0 2024-04-03T05:14:10.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7976666244847293098', time=2024-04-03T06:28:06.585941+0000, chain.objs.size()=1 2024-04-03T05:14:10.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8OOD1E19JRkY1J6FDR9LYb7_rHyhiHd_0 2024-04-03T05:14:10.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13180467693923569002', time=2024-04-03T06:28:09.162602+0000, chain.objs.size()=1 2024-04-03T05:14:10.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-AdNU5lBkNgXoa-GL1LVyKNbwzYMD-3_0 2024-04-03T05:14:10.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9582020598521264636', time=2024-04-03T06:28:09.341318+0000, chain.objs.size()=1 2024-04-03T05:14:10.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Ld0y_M3LLc4hOFWBglhdDZSjobroovm_0 2024-04-03T05:14:10.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14610843373518807191', time=2024-04-03T06:28:10.383380+0000, chain.objs.size()=1 2024-04-03T05:14:10.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.NBmPqLhtih_ABPy38zL3kuhw32qIvPY_0 2024-04-03T05:14:10.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8288115014314278408', time=2024-04-03T06:28:11.435751+0000, chain.objs.size()=1 2024-04-03T05:14:10.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5M4WQChVAxYBsyRoEPygPdghm97eAxM_0 2024-04-03T05:14:10.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3250975128976779389', time=2024-04-03T06:28:11.863288+0000, chain.objs.size()=1 2024-04-03T05:14:10.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.321+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8oyiIXHJ0SjtjAt8MTT4BkWpqJArtS3_0 2024-04-03T05:14:10.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.325+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6439651286988234247', time=2024-04-03T06:28:14.320983+0000, chain.objs.size()=1 2024-04-03T05:14:10.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.325+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.w9UMo_r57LEAoXx4aH18C2RsrOe39Gq_0 2024-04-03T05:14:10.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5160250472749350771', time=2024-04-03T06:28:15.408511+0000, chain.objs.size()=1 2024-04-03T05:14:10.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.e11mtLXb3WvGdtgoYwqFCTIoYln_qe__0 2024-04-03T05:14:10.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9387895458947543673', time=2024-04-03T06:28:15.871424+0000, chain.objs.size()=1 2024-04-03T05:14:10.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vqfDHqa3Eao1P1x88y13ggjnUqWuEUO_0 2024-04-03T05:14:10.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6861528247078536518', time=2024-04-03T06:28:17.328152+0000, chain.objs.size()=1 2024-04-03T05:14:10.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.YcqjLuRDHlNkHbN4ux3pIItIqLeIvqv_0 2024-04-03T05:14:10.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5284848300862509438', time=2024-04-03T06:28:19.123551+0000, chain.objs.size()=1 2024-04-03T05:14:10.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.g1NzNwcFM_j7GpFgAq1frPOsrOjqYdC_0 2024-04-03T05:14:10.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6223427038449018397', time=2024-04-03T06:28:19.386817+0000, chain.objs.size()=1 2024-04-03T05:14:10.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Y2wXXrLZfsuasp6Gmpko4gSCErytn09_0 2024-04-03T05:14:10.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11405389537502194905', time=2024-04-03T06:29:08.897703+0000, chain.objs.size()=1 2024-04-03T05:14:10.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.253__shadow_.ZUHPN9KTps3LYEvZdZ41927k3Wne3oX_0 2024-04-03T05:14:10.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8056499728812491260', time=2024-04-03T06:29:30.939804+0000, chain.objs.size()=1 2024-04-03T05:14:10.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.oO-X4D4vaJ32We8ImIWczQfVQXC16ka_0 2024-04-03T05:14:10.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5714909187609640407', time=2024-04-03T06:29:45.163674+0000, chain.objs.size()=1 2024-04-03T05:14:10.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.266__shadow_.nzNSHC1lhgIINRPwOdNtWpI6eFCsYw__0 2024-04-03T05:14:10.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3270545206116158489', time=2024-04-03T06:32:24.905722+0000, chain.objs.size()=1 2024-04-03T05:14:10.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.x7c1r-Z79UaOVL50rkdaZqqvwcl2XY1_0 2024-04-03T05:14:10.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8422097284115089940', time=2024-04-03T06:32:26.282963+0000, chain.objs.size()=1 2024-04-03T05:14:10.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YMhswjbmF7yGRmw9jAa1ycaa0NRrUHR_0 2024-04-03T05:14:10.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6500280337978716966', time=2024-04-03T06:32:26.935705+0000, chain.objs.size()=1 2024-04-03T05:14:10.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.329+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.KZxKc8knDOMliOLPValjOVUGhIl2DiH_0 2024-04-03T05:14:10.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15797765529629309563', time=2024-04-03T06:32:28.087171+0000, chain.objs.size()=1 2024-04-03T05:14:10.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9btr16fIQoRopt18exdAlcooMkP3RV6_0 2024-04-03T05:14:10.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.146780137688720939', time=2024-04-03T06:32:29.540547+0000, chain.objs.size()=1 2024-04-03T05:14:10.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Og42R-eSd_PAcymVNf7hW1WjD5DFDPv_0 2024-04-03T05:14:10.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15237019181417007086', time=2024-04-03T06:32:33.436338+0000, chain.objs.size()=1 2024-04-03T05:14:10.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vTRHE969j7ITa8Fkg7K2Pj7MeHorSH7_0 2024-04-03T05:14:10.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.402637698953240074', time=2024-04-03T06:32:33.795604+0000, chain.objs.size()=1 2024-04-03T05:14:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.mq-hQmWzd8nVhIGOvneyCGUQfCbO-op_0 2024-04-03T05:14:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8855108437049743517', time=2024-04-03T06:32:34.043897+0000, chain.objs.size()=1 2024-04-03T05:14:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.IqNuLAz5ffIdIG1v8SmzouWlUuQ7H06_0 2024-04-03T05:14:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10416157558550134579', time=2024-04-03T06:32:34.206785+0000, chain.objs.size()=1 2024-04-03T05:14:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.wq4BGL9iomnCaeVy_DxewBQqePONcC__0 2024-04-03T05:14:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.302792813620551788', time=2024-04-03T06:32:35.635458+0000, chain.objs.size()=1 2024-04-03T05:14:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8SI_tWdnPvfFcfiaffG6o_GDBqqQVbI_0 2024-04-03T05:14:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8836757287610089412', time=2024-04-03T06:32:35.804313+0000, chain.objs.size()=1 2024-04-03T05:14:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.e-2SB3ou5J_YhFftY0db5177Min8NEl_0 2024-04-03T05:14:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3341373703133763880', time=2024-04-03T06:32:35.991820+0000, chain.objs.size()=1 2024-04-03T05:14:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.P926DFk5Bxuz9N1Pja_4TcX15NpiNeP_0 2024-04-03T05:14:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1994296450092364219', time=2024-04-03T06:32:36.289947+0000, chain.objs.size()=1 2024-04-03T05:14:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.BT_Ow8ZdbxHvvFkHMvBOpSpArg0_Co__0 2024-04-03T05:14:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8478043433339962020', time=2024-04-03T06:32:36.368134+0000, chain.objs.size()=1 2024-04-03T05:14:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.333+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.p4MWqEviu0NWITi1bwohaKKJE19fRMw_0 2024-04-03T05:14:10.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17695142249853694369', time=2024-04-03T06:32:38.061462+0000, chain.objs.size()=1 2024-04-03T05:14:10.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AuCDK2fI9MZq0CwLx-zUaAgpeXUsmkt_0 2024-04-03T05:14:10.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14027872729949569033', time=2024-04-03T06:32:39.443827+0000, chain.objs.size()=1 2024-04-03T05:14:10.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8h2r1HWDJb_eM1qTEa2riH81Q6B0qHg_0 2024-04-03T05:14:10.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13698627828240006561', time=2024-04-03T06:32:40.391812+0000, chain.objs.size()=1 2024-04-03T05:14:10.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vV5uQ2_-dMu-Y4qzuVt-HNMMr63UetB_0 2024-04-03T05:14:10.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15719447959791483578', time=2024-04-03T06:32:40.500466+0000, chain.objs.size()=1 2024-04-03T05:14:10.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RseRhMMQJdgXcBLKZdbbvMZJAdv-GVd_0 2024-04-03T05:14:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8304285286848774345', time=2024-04-03T06:32:40.754997+0000, chain.objs.size()=1 2024-04-03T05:14:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.y7ldBlLUdngvlq4f1qYlD3vIBMUERQY_0 2024-04-03T05:14:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9946287678508124948', time=2024-04-03T06:32:41.511681+0000, chain.objs.size()=1 2024-04-03T05:14:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.odBP-QzjHRpGGSxcpsO0xMAiAtFZnsQ_0 2024-04-03T05:14:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17928828030737372291', time=2024-04-03T06:32:41.686521+0000, chain.objs.size()=1 2024-04-03T05:14:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.337+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HSm7R23tWJEyF6CIK3kmn3haHIydujm_0 2024-04-03T05:14:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5934270388845775867', time=2024-04-03T06:32:42.917063+0000, chain.objs.size()=1 2024-04-03T05:14:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VpijzGeFEw0eHS3wH8uCTab74WOtCTc_0 2024-04-03T05:14:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8796058778152523202', time=2024-04-03T06:32:43.325010+0000, chain.objs.size()=1 2024-04-03T05:14:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.90JXMU9UhOBwpohrKiSmuwB145GPyy__0 2024-04-03T05:14:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6439587379522253420', time=2024-04-03T06:32:44.117712+0000, chain.objs.size()=1 2024-04-03T05:14:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gFhL7emZ4ki5sRlqEaVXJuOYgv66jUD_0 2024-04-03T05:14:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12722423551264354320', time=2024-04-03T06:32:44.129331+0000, chain.objs.size()=1 2024-04-03T05:14:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ZR2l3Op31Qy_AMvbJhHAFLJX8Cr9Bjo_0 2024-04-03T05:14:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16951727183060027591', time=2024-04-03T06:32:45.665416+0000, chain.objs.size()=1 2024-04-03T05:14:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.PgTvp941vgwqTjQQSioIRRwvIJ3BKil_0 2024-04-03T05:14:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7118635872651815083', time=2024-04-03T06:32:46.433813+0000, chain.objs.size()=1 2024-04-03T05:14:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.cMNOvkxG6-xOo65qRQElSotZzw78c-i_0 2024-04-03T05:14:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13767165848519317670', time=2024-04-03T06:32:47.209332+0000, chain.objs.size()=1 2024-04-03T05:14:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hCku6Ue9rF4Ml83yJo0G72JpBeg15x1_0 2024-04-03T05:14:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17454042601615676719', time=2024-04-03T06:32:47.316936+0000, chain.objs.size()=1 2024-04-03T05:14:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.WMa06CbF5ZKuVjHHhxC7wW_vSqZBqBQ_0 2024-04-03T05:14:10.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6411122699106083008', time=2024-04-03T06:32:48.907318+0000, chain.objs.size()=1 2024-04-03T05:14:10.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pFHcpqD9BXuaxgCW1xM1AVW0fJdTxWN_0 2024-04-03T05:14:10.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14739640990958133740', time=2024-04-03T06:32:49.073460+0000, chain.objs.size()=1 2024-04-03T05:14:10.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.e9PrGrrd-b1G3vl3_iqENR-rvWVxcwE_0 2024-04-03T05:14:10.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10674618944786546585', time=2024-04-03T06:32:49.147703+0000, chain.objs.size()=1 2024-04-03T05:14:10.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.341+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gIX9N1rGN5yaMTtKIojTseX3X05ux9n_0 2024-04-03T05:14:10.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16974601808126662521', time=2024-04-03T06:32:50.247305+0000, chain.objs.size()=1 2024-04-03T05:14:10.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yClqdvuER9E2hUHCsjAKNOiGeevnFKc_0 2024-04-03T05:14:10.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18128205327201817839', time=2024-04-03T06:32:50.786318+0000, chain.objs.size()=1 2024-04-03T05:14:10.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.W35uS7P6FGNkJ8y-YVjFphui3qoDL3N_0 2024-04-03T05:14:10.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14767380413226265668', time=2024-04-03T06:32:50.868411+0000, chain.objs.size()=1 2024-04-03T05:14:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RmBYEuHD4bYL4MkCAd0WTeij5TJJq1F_0 2024-04-03T05:14:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4815000170705087791', time=2024-04-03T06:34:28.517286+0000, chain.objs.size()=1 2024-04-03T05:14:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.O3lj0wBm1ASCpg0Fh9RHTQWA4rbMwMJ_0 2024-04-03T05:14:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15199760503825267506', time=2024-04-03T06:34:28.637025+0000, chain.objs.size()=1 2024-04-03T05:14:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.o6PHpg5D4iaFwThfYEMEoZXlWOAXx9o_0 2024-04-03T05:14:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7136708987355319731', time=2024-04-03T06:34:29.237008+0000, chain.objs.size()=1 2024-04-03T05:14:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6TbjREIpLdoSNa0f0F3_V9QWTopKcCK_0 2024-04-03T05:14:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6622428207379939759', time=2024-04-03T06:34:29.741851+0000, chain.objs.size()=1 2024-04-03T05:14:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.XLgtHhjcCJ3FIVp4enyHImPjmCMr45A_0 2024-04-03T05:14:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9743734342691031543', time=2024-04-03T06:34:30.047439+0000, chain.objs.size()=1 2024-04-03T05:14:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SZogm9VV6PmforZs_SYVIt8fSwM-Vae_0 2024-04-03T05:14:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14245197065660907699', time=2024-04-03T06:34:30.659447+0000, chain.objs.size()=1 2024-04-03T05:14:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rBP4EWNIONgOQyvB960jhYxWb18MEGT_0 2024-04-03T05:14:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12847674116435236855', time=2024-04-03T06:34:32.965556+0000, chain.objs.size()=1 2024-04-03T05:14:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nHQa6bw1qwy4G8_RFBuJvFr5LafzBqj_0 2024-04-03T05:14:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7309520425451755562', time=2024-04-03T06:34:32.988056+0000, chain.objs.size()=1 2024-04-03T05:14:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.345+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.es4nxEkyVJ1czHRxggAf-3YhmUkFD2z_0 2024-04-03T05:14:10.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16341722332748968140', time=2024-04-03T06:34:33.716061+0000, chain.objs.size()=1 2024-04-03T05:14:10.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7MherQvG1tOc7rTwoEce9Odsl_xxtew_0 2024-04-03T05:14:10.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9263417510752172825', time=2024-04-03T06:34:34.132562+0000, chain.objs.size()=1 2024-04-03T05:14:10.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ixncpkNtwqSq8fWl_0HTj316_NnPJH__0 2024-04-03T05:14:10.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13505890188709069734', time=2024-04-03T06:34:36.755684+0000, chain.objs.size()=1 2024-04-03T05:14:10.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Redw4v7kLPcUjvY68ZHNyVw2zZ204-k_0 2024-04-03T05:14:10.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12922034235930531455', time=2024-04-03T06:34:37.905294+0000, chain.objs.size()=1 2024-04-03T05:14:10.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.OLG03_Bw54ByLluJIqmRH7ZzUtVT4CN_0 2024-04-03T05:14:10.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1389260082599673512', time=2024-04-03T06:34:39.039862+0000, chain.objs.size()=1 2024-04-03T05:14:10.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_._5lqIBNMt-TzYq1FscG2K1NXYyH6nDg_0 2024-04-03T05:14:10.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9129176653979280591', time=2024-04-03T06:34:40.887794+0000, chain.objs.size()=1 2024-04-03T05:14:10.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.xMnefjat804yTmpEScrMP2CRQqkVO3N_0 2024-04-03T05:14:10.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6972460486123195727', time=2024-04-03T06:34:42.123927+0000, chain.objs.size()=1 2024-04-03T05:14:10.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.teAUxTiMYoHmsopS8S_iuGhuHWsI7d7_0 2024-04-03T05:14:10.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3412351792885441604', time=2024-04-03T06:34:42.696930+0000, chain.objs.size()=1 2024-04-03T05:14:10.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.349+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.eHLnBre-aRhm7Jd75_PxdOZYsGDpBs2_0 2024-04-03T05:14:10.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4952377670934817596', time=2024-04-03T06:34:43.658261+0000, chain.objs.size()=1 2024-04-03T05:14:10.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.X6ylfGWlACGAbZrLj1YMBIOsPTamn-i_0 2024-04-03T05:14:10.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9108018674202360654', time=2024-04-03T06:34:43.698983+0000, chain.objs.size()=1 2024-04-03T05:14:10.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.OJeF1su6emR4B3N2YeyAGEjMV20Q6XB_0 2024-04-03T05:14:10.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9858493872075765807', time=2024-04-03T06:34:45.625780+0000, chain.objs.size()=1 2024-04-03T05:14:10.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3QEWLMgcu5thZRyHQEnxXYyJ22u9EbC_0 2024-04-03T05:14:10.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8728708488833839551', time=2024-04-03T06:34:45.772783+0000, chain.objs.size()=1 2024-04-03T05:14:10.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SQNbGOEpIZMulxoGcaGXH3BO86ScaoX_0 2024-04-03T05:14:10.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9098780069270471019', time=2024-04-03T06:34:46.479989+0000, chain.objs.size()=1 2024-04-03T05:14:10.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7Bu_kPjA8u4s60zmHfPrExGrKiM8Ule_0 2024-04-03T05:14:10.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5117839507775453371', time=2024-04-03T06:34:47.413709+0000, chain.objs.size()=1 2024-04-03T05:14:10.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Fp7AbuqdqpaCrGE6vCro5VTCfR2EOoH_0 2024-04-03T05:14:10.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10410700751308723647', time=2024-04-03T06:34:47.535117+0000, chain.objs.size()=1 2024-04-03T05:14:10.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.353+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.plwXdQBz6JzVPho1NpsX2x5t_PLNSO__0 2024-04-03T05:14:10.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.341141019124686783', time=2024-04-03T06:34:48.517327+0000, chain.objs.size()=1 2024-04-03T05:14:10.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.U0TyKl2Vl84t7od9KGyqMOFZpe2iXON_0 2024-04-03T05:14:10.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14802203348559051428', time=2024-04-03T06:34:48.758833+0000, chain.objs.size()=1 2024-04-03T05:14:10.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.L0wjzulXmACtzX2nj3kWi37_HjSYf9W_0 2024-04-03T05:14:10.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17889536301581657251', time=2024-04-03T06:34:48.978432+0000, chain.objs.size()=1 2024-04-03T05:14:10.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.D8QDrurnmpuft2Vhd7it4ttJohbLn-L_0 2024-04-03T05:14:10.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3897674686753079307', time=2024-04-03T06:34:49.335772+0000, chain.objs.size()=1 2024-04-03T05:14:10.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ivnf4t3J5tCQpXqAKc5KIWV9v35MPc-_0 2024-04-03T05:14:10.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2910325640493327929', time=2024-04-03T06:34:50.939263+0000, chain.objs.size()=1 2024-04-03T05:14:10.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.nZ4ZeKRFo-0q-R9lXGmCbdGbGw20ota_0 2024-04-03T05:14:10.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10944281326163934980', time=2024-04-03T06:34:51.330358+0000, chain.objs.size()=1 2024-04-03T05:14:10.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wv55pM_xuq808csYdWZE0s_NDAyXgvv_0 2024-04-03T05:14:10.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8189878718491011514', time=2024-04-03T06:34:51.620749+0000, chain.objs.size()=1 2024-04-03T05:14:10.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.bE-p5eDqWvpklrHt2h_1O7Eh4Mg_VKZ_0 2024-04-03T05:14:10.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16147628585336885937', time=2024-04-03T06:34:51.625866+0000, chain.objs.size()=1 2024-04-03T05:14:10.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3qXMtagYwXJhRNxCmUmm9rAodeJdX34_0 2024-04-03T05:14:10.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3724690901007787961', time=2024-04-03T06:34:52.068899+0000, chain.objs.size()=1 2024-04-03T05:14:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7kaFdo_6uYtlS-S2h8ntyT52D7G1Mtl_0 2024-04-03T05:14:10.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.402989195384902561', time=2024-04-03T06:34:53.478310+0000, chain.objs.size()=1 2024-04-03T05:14:10.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9Or_sarmw6Lgj_sYqEYCQ8O_A_hhWNF_0 2024-04-03T05:14:10.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3441546801698203227', time=2024-04-03T06:34:55.398144+0000, chain.objs.size()=1 2024-04-03T05:14:10.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.357+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.-B2XFYfAcIo0ro6_vXixPVHsZ4AV_9O_0 2024-04-03T05:14:10.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.361+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15442866763601700086', time=2024-04-03T06:34:56.297128+0000, chain.objs.size()=1 2024-04-03T05:14:10.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.D2cq2ueD4p66_01QIInJ8MdHWJdyxkg_0 2024-04-03T05:14:10.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.361+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/41938 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1418072308046672891', time=2024-04-03T06:34:56.364435+0000, chain.objs.size()=1 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BPNXZbb6OuG-NE0iIt-uiWXDL23Eo74_0 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2549343209694525949', time=2024-04-03T06:34:56.365767+0000, chain.objs.size()=1 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6V0G1OFs1MnImRMPwIhIaCw2f9bjtPG_0 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16444565553919318986', time=2024-04-03T06:36:32.130855+0000, chain.objs.size()=1 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.344__shadow_.zqCV1nzaY1hXbSNbkyLXgmI_wjWz8P6_0 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9440521585356878799', time=2024-04-03T06:38:34.356123+0000, chain.objs.size()=1 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.406__shadow_.Zp10FuDx-70N0fmYanW3FXlufisgT2f_0 2024-04-03T05:14:10.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9620971983215169618', time=2024-04-03T06:38:57.276912+0000, chain.objs.size()=1 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.416__shadow_.N-639wCU8YVleMstTWWI97Y46_T2dPw_0 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11540808081376062303', time=2024-04-03T06:39:17.965841+0000, chain.objs.size()=1 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.425__shadow_.FyguiZjfOn8OEQrCTdlVSPrhiTbNQx5_0 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2717436325152879359', time=2024-04-03T06:39:49.089174+0000, chain.objs.size()=1 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.436__shadow_.QBd-IsYvU0zh1EAio6PSksgrNErYPqj_0 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16619874541485246430', time=2024-04-03T06:40:14.268686+0000, chain.objs.size()=1 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.LAVGKUkq9K8qUJUdmIy8HIXJOoGP83-_0 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9954788632066861836', time=2024-04-03T06:40:14.363968+0000, chain.objs.size()=1 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.453__shadow_.0ziJlU06z3E5j1rxT8bDCsyH91Xp1kU_0 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~eMRJNqtyT_3kvoBcaKAXGMhSPm_3nue', time=2024-04-03T06:44:57.519746+0000, chain.objs.size()=1 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.492__multipart_mymultipart.2~eMRJNqtyT_3kvoBcaKAXGMhSPm_3nue.2 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11308666763490778740', time=2024-04-03T06:48:13.293091+0000, chain.objs.size()=1 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.495__multipart_mymultipart.2~nfBDIxVWiMFDa3IjI7Xw1SBqUyvZoRV.1 2024-04-03T05:14:10.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13635863468156477881', time=2024-04-03T06:49:04.931725+0000, chain.objs.size()=2 2024-04-03T05:14:10.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.498__multipart_mymultipart.2~zTtPfN-qsGVRa0mm0JyJ9iHBiMkGU5z.1 2024-04-03T05:14:10.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.365+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.498__multipart_mymultipart.2~zTtPfN-qsGVRa0mm0JyJ9iHBiMkGU5z.2 2024-04-03T05:14:10.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3325066385710342489', time=2024-04-03T06:53:19.058840+0000, chain.objs.size()=1 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.543__shadow:dmrBeM-aJpbzjRGwQGEvezL7BSwz8.N_.jtrAydCrmib1B0bqvCQVgKzl_VkMcDL_0 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2188855925927722144', time=2024-04-03T06:53:28.337680+0000, chain.objs.size()=1 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:SsdSAuIBiuTdii1HqDT.vNllneNd2Dj_.so5np6DXSUhlykOaNgzFTk5w972Vq1r_0 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.403636071913906998', time=2024-04-03T06:53:45.517403+0000, chain.objs.size()=1 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:-OJ10Y8JpBFuGiNp76CIbHM2FIcy2rN_.igQbiuFWH63bx2m2Aug2mVYMFgE12dY_0 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5510596069661232598', time=2024-04-03T06:53:48.009356+0000, chain.objs.size()=1 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:ATGZ9tQ.fglnYDL.Mbr4nTc.8rqdg0p_.ElHGcWvQEGj3acR-AxbarwpuBgY19Xw_0 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12377545900678733136', time=2024-04-03T06:54:06.422411+0000, chain.objs.size()=1 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:ENhD3kkmvyKr6aY-ubqJopiPtNcDceh_.PyLDq9L529SzJjs7aVyOoOVIGchx1T__0 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15084296175529310489', time=2024-04-03T06:55:23.627791+0000, chain.objs.size()=1 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:94b5qNp2IJszK2JNyDRw0qio.a2JgAD_.GzQQUjpBkkoni8ntEoaPyrD1FIzWuFB_0 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10857228929230521336', time=2024-04-03T06:55:23.904322+0000, chain.objs.size()=1 2024-04-03T05:14:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:PreF4Js2qvPIF7y9ndkDwx1uqqYIous_.0g7cSiSzlrbSq0ofbiXAXBXsLEeoM38_0 2024-04-03T05:14:10.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:E805VAtBd6H9pogkcGWg0Ox9sR19zt4_.0O0CQJKG3ukovqFPK5FwlFnQY-v3Pny_1_a856c173d93dde004a26a672b0ce48d7', time=2024-04-03T06:55:29.887167+0000, chain.objs.size()=1 2024-04-03T05:14:10.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:E805VAtBd6H9pogkcGWg0Ox9sR19zt4_.0O0CQJKG3ukovqFPK5FwlFnQY-v3Pny_0 2024-04-03T05:14:10.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8513223038433001544', time=2024-04-03T07:03:40.357774+0000, chain.objs.size()=1 2024-04-03T05:14:10.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.629__shadow_.5lgmYcG6MWyLcno04k6eWcY691Nts9e_0 2024-04-03T05:14:10.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2992734763486990143', time=2024-04-03T07:03:43.128272+0000, chain.objs.size()=1 2024-04-03T05:14:10.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.369+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.630__shadow_.Xo94WNxhLuE9bB4F9tcmS4GmZv3eSPM_0 2024-04-03T05:14:10.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.373+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:10.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-03T05:14:10.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:10.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:10.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53385' 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8162364953422997179', time=2024-04-03T06:20:44.237235+0000, chain.objs.size()=1 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.140__shadow_.B4iskchhMqs6qnX1klc0ri85g1MHXrf_0 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_6VZCp-Dnc8mPx4rM_-apyOzM7TTXCBS', time=2024-04-03T06:23:02.734127+0000, chain.objs.size()=1 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.154__shadow_.Tpt15OCdqpfEt_OjUzq5im9qwV3DI-5_0 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10424551381901256303', time=2024-04-03T06:25:44.323375+0000, chain.objs.size()=1 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.215__shadow_.yvdnP8ceLKNKCZZPDw2GZq797wBSNZ5_0 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6215365117735425988', time=2024-04-03T06:26:01.874999+0000, chain.objs.size()=1 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.223__shadow_.QOBrSycXDigFECbPdKstDergGmaLm2e_0 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13683437975562390468', time=2024-04-03T06:26:04.112852+0000, chain.objs.size()=1 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.224__shadow_.fAIW3RJtLPECXOYqjekHATh4iDry8-7_0 2024-04-03T05:14:10.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13570026956202198866', time=2024-04-03T06:26:04.125701+0000, chain.objs.size()=1 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.224__shadow_.hq7UfNAXrlJb5B53PvzmGpJ5miCuLca_0 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9055018528376611977', time=2024-04-03T06:26:14.842597+0000, chain.objs.size()=1 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.229__shadow_.n78D98yGE5ObpbsfOQURU8j917X1WuF_0 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14430231642541484294', time=2024-04-03T06:27:53.390211+0000, chain.objs.size()=1 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vDX-0OWRuxpONSXlw_ZcATtT5VxrmJC_0 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14608737938304546107', time=2024-04-03T06:27:54.724482+0000, chain.objs.size()=1 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.377+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Hjz_QjmT4fsV9rGp6K9JihfXvuYeEB6_0 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6570998335360513242', time=2024-04-03T06:27:55.018232+0000, chain.objs.size()=1 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UZ9iEvTyMQQWQvYwoKM6De8lRWnLyz2_0 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14935491582720927449', time=2024-04-03T06:27:55.020125+0000, chain.objs.size()=1 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.NHldCdDtMO6J4bV8cJA_xQfjM3EVxw7_0 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.682448972049587068', time=2024-04-03T06:27:56.181375+0000, chain.objs.size()=1 2024-04-03T05:14:10.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7SjJKwcsPiOt5lZQXfr2FMkWr_lfn-o_0 2024-04-03T05:14:10.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10659563718912345868', time=2024-04-03T06:27:57.183531+0000, chain.objs.size()=1 2024-04-03T05:14:10.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.o4jB8BW-vMsllfducKMRC9wC24FPSsu_0 2024-04-03T05:14:10.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2102681717092106473', time=2024-04-03T06:27:57.185642+0000, chain.objs.size()=1 2024-04-03T05:14:10.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.yL5bEVf-Ge7T_rjB1gnXhi6n17F4uJG_0 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14602806688083037985', time=2024-04-03T06:27:57.810676+0000, chain.objs.size()=1 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7oRX_Hsh7REpPDriQz3fccYqrEHz8BU_0 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4459563689891500772', time=2024-04-03T06:27:58.628098+0000, chain.objs.size()=1 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.G3G-MXQ8PnZ0RETnmrV6IhPXmShlNON_0 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5692734956930782321', time=2024-04-03T06:27:58.655176+0000, chain.objs.size()=1 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1GhQcoxSTB5AcACo1i8VHTQvIjql8vC_0 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13319719912656358224', time=2024-04-03T06:27:58.731706+0000, chain.objs.size()=1 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.PGHVprzy3GAymEqaUxtZT3uZJURp-m-_0 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14618586598722656235', time=2024-04-03T06:28:00.075312+0000, chain.objs.size()=1 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.HQPRRsCrPPxwhzI0YuAFqvVUItbHCEF_0 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4238913245348341350', time=2024-04-03T06:28:00.581011+0000, chain.objs.size()=1 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.F8pCTrhddpnxeh_4gb5pv52Ccdc6oGT_0 2024-04-03T05:14:10.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3239685139269547033', time=2024-04-03T06:28:02.950872+0000, chain.objs.size()=1 2024-04-03T05:14:10.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vkna2Ghcgm9KkAp-ycnUwX8GtOFy9ie_0 2024-04-03T05:14:10.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8384599793735474495', time=2024-04-03T06:28:04.669084+0000, chain.objs.size()=1 2024-04-03T05:14:10.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ARreLH3z5hLUkM_4pS5kMrLjMMoyYE4_0 2024-04-03T05:14:10.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10629582812981237594', time=2024-04-03T06:28:05.614496+0000, chain.objs.size()=1 2024-04-03T05:14:10.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.381+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wLuouN0vnNWEYX62QZbndhsdG486MPL_0 2024-04-03T05:14:10.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14917313979235381633', time=2024-04-03T06:28:06.082278+0000, chain.objs.size()=1 2024-04-03T05:14:10.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GUWZA5oNslULG8cSk7VoQDJUIE7WQzg_0 2024-04-03T05:14:10.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16608087525683136330', time=2024-04-03T06:28:06.776400+0000, chain.objs.size()=1 2024-04-03T05:14:10.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.HRHcRk3aNxj72t9KRuvS2kOJeij64l7_0 2024-04-03T05:14:10.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16206889298431126639', time=2024-04-03T06:28:08.230175+0000, chain.objs.size()=1 2024-04-03T05:14:10.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.eYLBDmU0yz1tt2qdNoY9hACfH_eDxRQ_0 2024-04-03T05:14:10.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3165488427378738915', time=2024-04-03T06:28:08.617508+0000, chain.objs.size()=1 2024-04-03T05:14:10.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-wZzz_qFx0SxWQpe79igNsHFyiLhJuQ_0 2024-04-03T05:14:10.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17345121509630372370', time=2024-04-03T06:28:08.813297+0000, chain.objs.size()=1 2024-04-03T05:14:10.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.385+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.9BxAmazWhevHNPEaz64YeeXtlETAKop_0 2024-04-03T05:14:10.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2974782256703943687', time=2024-04-03T06:28:09.383785+0000, chain.objs.size()=1 2024-04-03T05:14:10.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.kPxyE7aAYe3OGUexWOgGQUUFg2wFgqc_0 2024-04-03T05:14:10.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15191070503654135769', time=2024-04-03T06:28:09.649187+0000, chain.objs.size()=1 2024-04-03T05:14:10.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xES3_2d37Uvk-jwy8TnxzhoAqfKSpmX_0 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6179727914655825800', time=2024-04-03T06:28:09.935390+0000, chain.objs.size()=1 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.GZQtxHV1HW96kGZ37zFbb7HX41tUM_F_0 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17867654328534465647', time=2024-04-03T06:28:12.224227+0000, chain.objs.size()=1 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.VwGoR_5SQJ9MmedQynSpyvyYGO8ddB2_0 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11454602798208891722', time=2024-04-03T06:28:13.242590+0000, chain.objs.size()=1 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dm-wN31-HNKethUQwdpTy4jumhzQ5-J_0 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2690049415084124187', time=2024-04-03T06:28:15.651509+0000, chain.objs.size()=1 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QZuxZuzj9IiSY_jEX8J6ZHNgr27Drz3_0 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13838825535587323936', time=2024-04-03T06:28:15.820447+0000, chain.objs.size()=1 2024-04-03T05:14:10.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.389+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.3CcJYNsFV9TqRUdoKdW20ryOqlFlFru_0 2024-04-03T05:14:10.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5347264735807628970', time=2024-04-03T06:28:16.097138+0000, chain.objs.size()=1 2024-04-03T05:14:10.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.YC1hJKMI-45LL9Aw1504Kc3zZBg8SPU_0 2024-04-03T05:14:10.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15440885533371155969', time=2024-04-03T06:28:17.175347+0000, chain.objs.size()=1 2024-04-03T05:14:10.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DA95uPV79AK431lioZQLFS-PKh6_yPy_0 2024-04-03T05:14:10.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11363171881929091559', time=2024-04-03T06:28:19.717121+0000, chain.objs.size()=1 2024-04-03T05:14:10.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sT520BWCLeEpozjxe7cZj-GQTrp9679_0 2024-04-03T05:14:10.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10629055797042533705', time=2024-04-03T06:28:20.201522+0000, chain.objs.size()=1 2024-04-03T05:14:10.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ZemHdjCGJ3AWFsKPi1GE40e7OBEJhHf_0 2024-04-03T05:14:10.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3642526724063295380', time=2024-04-03T06:28:20.984352+0000, chain.objs.size()=1 2024-04-03T05:14:10.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.A9Az6vdHf0uLwcc1uXh3XvzkTIdV8uu_0 2024-04-03T05:14:10.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6093952889646948740', time=2024-04-03T06:28:50.669901+0000, chain.objs.size()=1 2024-04-03T05:14:10.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.245__shadow_.8iR6Zr-tbbT72pY2a0IqvnnPzW-KT_N_0 2024-04-03T05:14:10.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18324501181708553374', time=2024-04-03T06:28:52.906786+0000, chain.objs.size()=1 2024-04-03T05:14:10.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.393+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.246__shadow_.01A-6Ipd_YihD5IFGmV1fe8cWCYfJyK_0 2024-04-03T05:14:10.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10216176771508353359', time=2024-04-03T06:29:16.067177+0000, chain.objs.size()=1 2024-04-03T05:14:10.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.256__shadow_.gMBGVORskV_MMi5vSjKoButd-UKC_KW_0 2024-04-03T05:14:10.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5983030726674398201', time=2024-04-03T06:29:22.657619+0000, chain.objs.size()=1 2024-04-03T05:14:10.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.259__shadow_.eDNcqlzgQmJ0a2HfcUwrQxUEW57oZix_0 2024-04-03T05:14:10.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3291985781920206861', time=2024-04-03T06:29:30.952565+0000, chain.objs.size()=1 2024-04-03T05:14:10.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.cVZlZMS0ePMIL_RTq5MBNrI_EkmYPLd_0 2024-04-03T05:14:10.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15522807092156936357', time=2024-04-03T06:29:35.968369+0000, chain.objs.size()=1 2024-04-03T05:14:10.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.QpNkTXMA_E7LAF5AOopotkyh6s8onq0_0 2024-04-03T05:14:10.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13051154137352875138', time=2024-04-03T06:29:38.364802+0000, chain.objs.size()=1 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.263__shadow_.gleIRnsdBWmWrBUG3F2FXE5IkbTLHLn_0 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11436925431331400885', time=2024-04-03T06:29:51.949866+0000, chain.objs.size()=1 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.269__shadow_.5D8g2_lynoBum3DKeO5Mlzsy-ZBcXpu_0 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16634596748021682272', time=2024-04-03T06:30:05.602021+0000, chain.objs.size()=1 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.275__shadow_.6kXPqdKqWedku66TO0VSo7kQ-_GmHaN_0 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8449466552467623717', time=2024-04-03T06:32:25.315154+0000, chain.objs.size()=1 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.LOGIDKhQ9LUjeNWy0e3B2Z9qKWDNLq3_0 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8590136435034559913', time=2024-04-03T06:32:28.730968+0000, chain.objs.size()=1 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.VLoqaOm5HDjsqxZ5AYCvLk31Ft7KT5G_0 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2625762603881844398', time=2024-04-03T06:32:29.123078+0000, chain.objs.size()=1 2024-04-03T05:14:10.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.397+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.XholKpjobwbvShRxFbZxD45EL9em2Bg_0 2024-04-03T05:14:10.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1023247984547096365', time=2024-04-03T06:32:29.312142+0000, chain.objs.size()=1 2024-04-03T05:14:10.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.d0LpkbBcjQZmjBMWWTzBlB2BbyaD2zG_0 2024-04-03T05:14:10.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.390998789814872025', time=2024-04-03T06:32:29.534416+0000, chain.objs.size()=1 2024-04-03T05:14:10.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zy8JjAqQpggZsUvN7S7Yr4G9IutGXeP_0 2024-04-03T05:14:10.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14057130720655633046', time=2024-04-03T06:32:30.751321+0000, chain.objs.size()=1 2024-04-03T05:14:10.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.LQ5Ze7o2FVeDenvOXaeW6_k_0IdxPOR_0 2024-04-03T05:14:10.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8967035875049400116', time=2024-04-03T06:32:32.679066+0000, chain.objs.size()=1 2024-04-03T05:14:10.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.h6tyPPwsD578B6BG_2Fnpm8Eoxwv18N_0 2024-04-03T05:14:10.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1468292737875892120', time=2024-04-03T06:32:34.486495+0000, chain.objs.size()=1 2024-04-03T05:14:10.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.W2oHqm4IWL6-ewOYqIbZMr74AbYTW3o_0 2024-04-03T05:14:10.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6186283675189120364', time=2024-04-03T06:32:34.530532+0000, chain.objs.size()=1 2024-04-03T05:14:10.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hUq158gUPKYC_LZcierTUqNfP-TX_KV_0 2024-04-03T05:14:10.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.844910359912114531', time=2024-04-03T06:32:35.639618+0000, chain.objs.size()=1 2024-04-03T05:14:10.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.PQOxHKEpuOMLdyK3hN1Gt-t7VeXgWND_0 2024-04-03T05:14:10.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18315760283629185084', time=2024-04-03T06:32:36.998458+0000, chain.objs.size()=1 2024-04-03T05:14:10.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.401+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.kMK6ukYH-H7Y7lni3qdh8zpdtO9xZFE_0 2024-04-03T05:14:10.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4492156652163755072', time=2024-04-03T06:32:37.111939+0000, chain.objs.size()=1 2024-04-03T05:14:10.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dLAwbTrqJwHjXi6pTuujwV6bXOvl26G_0 2024-04-03T05:14:10.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3480258615536555629', time=2024-04-03T06:32:39.260966+0000, chain.objs.size()=1 2024-04-03T05:14:10.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.MAC2bZ5JfsOLnWiV6AIAU1SlPEfpzV4_0 2024-04-03T05:14:10.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7060368777952221557', time=2024-04-03T06:32:40.413468+0000, chain.objs.size()=1 2024-04-03T05:14:10.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ndb_ngQHlszAUyDy977hquf51Y0nK98_0 2024-04-03T05:14:10.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12934063534881266274', time=2024-04-03T06:32:40.445918+0000, chain.objs.size()=1 2024-04-03T05:14:10.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.85YQK5-PHKQr3NcWA7yHfdLk6D3DC15_0 2024-04-03T05:14:10.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6839353406509549780', time=2024-04-03T06:32:41.203656+0000, chain.objs.size()=1 2024-04-03T05:14:10.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.iOkYECYSkZtL6N3sOv4yYDaZB3TNjl3_0 2024-04-03T05:14:10.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8049166354070114072', time=2024-04-03T06:32:43.615854+0000, chain.objs.size()=1 2024-04-03T05:14:10.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.w9IhCkR3bcB1QUjurJLB90myJSlfoVi_0 2024-04-03T05:14:10.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7715543285204256180', time=2024-04-03T06:32:44.406317+0000, chain.objs.size()=1 2024-04-03T05:14:10.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.8xnnK0mxUR4Ik-YLRP3o1nT36McyVrv_0 2024-04-03T05:14:10.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17319757298025908745', time=2024-04-03T06:32:45.431182+0000, chain.objs.size()=1 2024-04-03T05:14:10.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.zsiMcB6iHL8uD5LNubiv1eXALz06E3p_0 2024-04-03T05:14:10.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4535013249251672214', time=2024-04-03T06:32:46.834437+0000, chain.objs.size()=1 2024-04-03T05:14:10.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.rZcAaXUiXQyyldWJVMrajWzOTWKQJHJ_0 2024-04-03T05:14:10.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11394272389368922254', time=2024-04-03T06:32:47.562165+0000, chain.objs.size()=1 2024-04-03T05:14:10.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FOjYsi-HUlOcS-Z7cbxofMSsljRgeaV_0 2024-04-03T05:14:10.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6338252193300112694', time=2024-04-03T06:32:47.680869+0000, chain.objs.size()=1 2024-04-03T05:14:10.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.405+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FDcqYoEyeANKkYHMTPXVzYhukz3Siel_0 2024-04-03T05:14:10.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8122855259413787192', time=2024-04-03T06:32:48.860918+0000, chain.objs.size()=1 2024-04-03T05:14:10.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.pqEyzjs49UinhJaPq5VIk8cREZpxnC4_0 2024-04-03T05:14:10.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5508045872070618431', time=2024-04-03T06:32:49.102177+0000, chain.objs.size()=1 2024-04-03T05:14:10.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.DUv5zZ1r4v_oWKXOkMobb0g44QVQwKa_0 2024-04-03T05:14:10.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1506621938001001259', time=2024-04-03T06:32:51.598893+0000, chain.objs.size()=1 2024-04-03T05:14:10.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.AKdi4vDYJjsAl6QpGu_qNDlFpJQlCMI_0 2024-04-03T05:14:10.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17324262526341540429', time=2024-04-03T06:32:51.623972+0000, chain.objs.size()=1 2024-04-03T05:14:10.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Bx_qhOdJY1CpFQ3ARrB69cquyvrDZrA_0 2024-04-03T05:14:10.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13889070618721743605', time=2024-04-03T06:32:51.749939+0000, chain.objs.size()=1 2024-04-03T05:14:10.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.409+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Tm7OqmDNFpIl8IUMVExQYHk3_SRbgq7_0 2024-04-03T05:14:10.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12926944996084224012', time=2024-04-03T06:34:28.940578+0000, chain.objs.size()=1 2024-04-03T05:14:10.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.sf6rHDl16vcufm4rt_LqhukL3SOKpea_0 2024-04-03T05:14:10.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16726585305744146557', time=2024-04-03T06:34:30.308571+0000, chain.objs.size()=1 2024-04-03T05:14:10.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GtZ76ZBuuwA_5Mq1I85hjh1uievOS53_0 2024-04-03T05:14:10.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9255568014340906623', time=2024-04-03T06:34:32.528094+0000, chain.objs.size()=1 2024-04-03T05:14:10.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.oHL9XfmjXz1pvc-b4eF_iK2UovSXfcw_0 2024-04-03T05:14:10.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11068807779952037739', time=2024-04-03T06:34:32.994888+0000, chain.objs.size()=1 2024-04-03T05:14:10.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.OVPVmH2KpXEptblok-ww9iMk4wN9_lK_0 2024-04-03T05:14:10.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4281969693123432384', time=2024-04-03T06:34:33.456757+0000, chain.objs.size()=1 2024-04-03T05:14:10.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pPIA8-a-FG1NTASkBrZJpgb6QhypkFP_0 2024-04-03T05:14:10.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12210648689567714496', time=2024-04-03T06:34:33.561814+0000, chain.objs.size()=1 2024-04-03T05:14:10.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.eUhwzeyjm5PBDHnMHD9NBEyaT2Hm7qc_0 2024-04-03T05:14:10.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15809045679489483079', time=2024-04-03T06:34:33.616230+0000, chain.objs.size()=1 2024-04-03T05:14:10.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.qJJ0bAUAyRO8rYkINRJsmtiqcdlvn_S_0 2024-04-03T05:14:10.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4945688516263384484', time=2024-04-03T06:34:34.589709+0000, chain.objs.size()=1 2024-04-03T05:14:10.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.rmsfCR65A5wZM8VLyzFa4K3YtWviXCx_0 2024-04-03T05:14:10.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16383448865705939039', time=2024-04-03T06:34:34.660890+0000, chain.objs.size()=1 2024-04-03T05:14:10.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.tuIhPFLkaupOXKHOdpB-cgZmBQH4cL3_0 2024-04-03T05:14:10.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1970398626959808879', time=2024-04-03T06:34:34.663051+0000, chain.objs.size()=1 2024-04-03T05:14:10.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.413+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8y9z__EyEf5WUQnUwYTn_4E7qX99FrJ_0 2024-04-03T05:14:10.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8483205906316768419', time=2024-04-03T06:34:34.989576+0000, chain.objs.size()=1 2024-04-03T05:14:10.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9FqCGb0zzCY-DUsBLTCn8G4Rh5hzMw8_0 2024-04-03T05:14:10.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6737618600518078484', time=2024-04-03T06:34:35.238079+0000, chain.objs.size()=1 2024-04-03T05:14:10.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.beFtDOQLNDZSPQ1tsT1LnsExUOzcfSR_0 2024-04-03T05:14:10.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14001734453954288399', time=2024-04-03T06:34:37.469968+0000, chain.objs.size()=1 2024-04-03T05:14:10.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VirQpLmInGkRFElk1wvs7FUK22MjSYi_0 2024-04-03T05:14:10.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14650254553092219450', time=2024-04-03T06:34:37.704276+0000, chain.objs.size()=1 2024-04-03T05:14:10.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6zYdGE3RtS-HHUQ-bJnCeckFhg0pVLa_0 2024-04-03T05:14:10.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1818016362821522951', time=2024-04-03T06:34:37.971115+0000, chain.objs.size()=1 2024-04-03T05:14:10.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.A86fiYit5g79r3aUWWN6H5SZCTBDz-U_0 2024-04-03T05:14:10.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14058802221190825073', time=2024-04-03T06:34:38.163601+0000, chain.objs.size()=1 2024-04-03T05:14:10.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.icZ3h5NQKmFgaQLW7BnTuXB6wSUPQFg_0 2024-04-03T05:14:10.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12382115244767872782', time=2024-04-03T06:34:40.114790+0000, chain.objs.size()=1 2024-04-03T05:14:10.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.3vfJdqU-4KFK4YOHfkU7GbBNIY4R09t_0 2024-04-03T05:14:10.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13687415790651717652', time=2024-04-03T06:34:40.116826+0000, chain.objs.size()=1 2024-04-03T05:14:10.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.PT40vp3Tsf3CsU48jvQix5Bf0xaqh2__0 2024-04-03T05:14:10.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16934675511914556446', time=2024-04-03T06:34:40.118847+0000, chain.objs.size()=1 2024-04-03T05:14:10.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lhq77mzly7wQV-j-V8fbp6gy-1fI1n6_0 2024-04-03T05:14:10.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11281976573436542135', time=2024-04-03T06:34:40.499212+0000, chain.objs.size()=1 2024-04-03T05:14:10.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.cGIrleHw2awcLD1OQOknPwBR_KhqS9L_0 2024-04-03T05:14:10.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8448261383803334705', time=2024-04-03T06:34:43.672496+0000, chain.objs.size()=1 2024-04-03T05:14:10.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.417+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.c1TKQADeM9h5MtTMDoQKq5oOJsOhudQ_0 2024-04-03T05:14:10.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.421+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10275058016977531249', time=2024-04-03T06:34:44.631444+0000, chain.objs.size()=1 2024-04-03T05:14:10.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.421+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.vaYPLc5JQOyRrYkTjQsHtuQfZ9o1m4j_0 2024-04-03T05:14:10.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.421+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12950010967736238954', time=2024-04-03T06:34:47.603878+0000, chain.objs.size()=1 2024-04-03T05:14:10.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.421+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JJR63sAD2gFcFDE_nW2PLv34NZ9SRnf_0 2024-04-03T05:14:10.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.421+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8079373018133844424', time=2024-04-03T06:34:49.693407+0000, chain.objs.size()=1 2024-04-03T05:14:10.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.421+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2tKJYs-7-xj3oA5NzDoQlDW6dro97wB_0 2024-04-03T05:14:10.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.425+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/53385 2024-04-03T05:14:10.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-04-03T05:14:10.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5880703545567935961', time=2024-04-03T06:34:49.759201+0000, chain.objs.size()=1 2024-04-03T05:14:10.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.VW6BPPafX11jp7lMj44vk0sXLhSWbvw_0 2024-04-03T05:14:10.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2839796427728871236', time=2024-04-03T06:34:50.819295+0000, chain.objs.size()=1 2024-04-03T05:14:10.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Abid8CzBZ1Amqag3QUXwj-yhXJepVSh_0 2024-04-03T05:14:10.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18001177084778329245', time=2024-04-03T06:34:52.374263+0000, chain.objs.size()=1 2024-04-03T05:14:10.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.A7eOtnFdAiHEpxfgCsQN88Ysib3FZEn_0 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4300223204307490391', time=2024-04-03T06:34:52.849171+0000, chain.objs.size()=1 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DsFSLq0IQZvbc3Brdb6fxMtJMHNGuod_0 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11479278699410610728', time=2024-04-03T06:34:53.553075+0000, chain.objs.size()=1 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YgcPYf05nkchs-c4xhBTg7n2Bq1Y3Rm_0 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6870214289406333376', time=2024-04-03T06:34:54.326713+0000, chain.objs.size()=1 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.X5Fki736BPkC2J8hAiCNc920isTgLQx_0 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14445882428273864560', time=2024-04-03T06:34:55.885489+0000, chain.objs.size()=1 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LRw9L8wBcP9TCqOlKvQF7goXU-_woeQ_0 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5399649004273429071', time=2024-04-03T06:34:55.994310+0000, chain.objs.size()=1 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2AgDdjSTEt0_9nQIKIsS9z_vNwpkshv_0 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17407155865589878242', time=2024-04-03T06:34:56.551454+0000, chain.objs.size()=1 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GEJ8Y889WBU7Fp9nQl2RoE53l_ss7cm_0 2024-04-03T05:14:10.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15048010019287784619', time=2024-04-03T06:35:26.547352+0000, chain.objs.size()=1 2024-04-03T05:14:10.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.309__shadow_.d_k1zVXhElelhpac-sKUj9mnn34_2f-_0 2024-04-03T05:14:10.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12382134570124449329', time=2024-04-03T06:37:37.372814+0000, chain.objs.size()=1 2024-04-03T05:14:10.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.377__shadow_.cvpOKQ_-hL0yXJ8ls59sbtqxCRigFn8_0 2024-04-03T05:14:10.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8553325605777324377', time=2024-04-03T06:39:06.686469+0000, chain.objs.size()=1 2024-04-03T05:14:10.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.429+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.420__shadow_.bmYrNEO7CEBS5wHQx6HsGcD2vuNOpse_0 2024-04-03T05:14:10.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4642574363560031688', time=2024-04-03T06:39:23.536052+0000, chain.objs.size()=1 2024-04-03T05:14:10.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.427__shadow_.Jy-kj3rjteZPg7PHPfbXr4UkX_mAywP_0 2024-04-03T05:14:10.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7093702447490756417', time=2024-04-03T06:40:16.901506+0000, chain.objs.size()=1 2024-04-03T05:14:10.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.454__shadow_.AiMoWv9tXVA7CKn7WzntF70iBKvgVPh_0 2024-04-03T05:14:10.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.470__shadow_.mIBx_Q87CWFOZ0ZA6-iV97_Iv4XBdce_1_f75254097321709d1f0e78c94daa48f5', time=2024-04-03T06:40:54.320157+0000, chain.objs.size()=1 2024-04-03T05:14:10.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.470__shadow_.mIBx_Q87CWFOZ0ZA6-iV97_Iv4XBdce_0 2024-04-03T05:14:10.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14395168631690539499', time=2024-04-03T06:42:03.037857+0000, chain.objs.size()=1 2024-04-03T05:14:10.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.485__shadow_.U9zqFHPPwHgciz8sdOg687XFPD5IFxN_0 2024-04-03T05:14:10.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15352359169436718597', time=2024-04-03T06:52:26.804941+0000, chain.objs.size()=2 2024-04-03T05:14:10.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.532__shadow_.fPzvDQrpVLbNSIkL44OK1oEhbxSFROl_0 2024-04-03T05:14:10.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.433+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.532__shadow_.fPzvDQrpVLbNSIkL44OK1oEhbxSFROl_1 2024-04-03T05:14:10.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1319636150798729840', time=2024-04-03T06:53:46.985395+0000, chain.objs.size()=1 2024-04-03T05:14:10.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:OO2ZW5-kmbttgXlVY4J1FCIzXHox.Y._.ZgFnghmSIc90ippZUQe-jm913lkJ4sh_0 2024-04-03T05:14:10.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10332227086105453645', time=2024-04-03T06:54:01.917791+0000, chain.objs.size()=1 2024-04-03T05:14:10.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:57YPBChnTLPvmn73szGel8nHSriapwx_.oYnDjLlTVjJAyajsyWXrJt9SLkh9Drg_0 2024-04-03T05:14:10.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13727614937533913254', time=2024-04-03T06:55:29.039889+0000, chain.objs.size()=1 2024-04-03T05:14:10.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:rWJ4oB2Trp8PCi23coUzRivhsnYYYCl_.4P-xbcO_DZegdwcAnZKsKSHKHO_0CzH_0 2024-04-03T05:14:10.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.437+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10396839462671425946', time=2024-04-03T07:01:36.011886+0000, chain.objs.size()=1 2024-04-03T05:14:10.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.437+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.608__shadow_.nPFajETDhfjCIHtfcizZB6WyOxJ6MB4_0 2024-04-03T05:14:10.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.441+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:10.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.445+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-03T05:14:10.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:10.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42720' 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_WiV63J5igbEBmTmks_KVD-35W2pZ4-_', time=2024-04-03T06:22:41.021209+0000, chain.objs.size()=3 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.kh0VHIc-rHlp3NqlgXnouW0EmTylLDx_0 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.kh0VHIc-rHlp3NqlgXnouW0EmTylLDx_1 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.150__shadow_.kh0VHIc-rHlp3NqlgXnouW0EmTylLDx_2 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7498769864964162840', time=2024-04-03T06:25:16.925516+0000, chain.objs.size()=1 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.205__shadow_.aCJX43BHUaVnWRIyREV10pv8MJzPz-L_0 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11131893038880791368', time=2024-04-03T06:25:36.146773+0000, chain.objs.size()=1 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.212__shadow_.nmPaD3vnQHFJ8aovCgWmRme9PUasQ5Z_0 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7726295542945524177', time=2024-04-03T06:25:46.521356+0000, chain.objs.size()=1 2024-04-03T05:14:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.216__shadow_.8hYvVJRQSyxXt13cCoJSaWGgsUb0pJq_0 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15154470176686321005', time=2024-04-03T06:27:52.765812+0000, chain.objs.size()=1 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.SbzW-qAnYvtMK04SojAwIHE131xJGSO_0 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1243650124350360856', time=2024-04-03T06:27:55.134767+0000, chain.objs.size()=1 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.SV_093yboBHIVBQxnzT044BMP8mJiVZ_0 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14435106833645157006', time=2024-04-03T06:27:56.273608+0000, chain.objs.size()=1 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.8tjjpm6brjnRFNaC2wwcHCpufdVqBbn_0 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16080863973079263517', time=2024-04-03T06:27:57.165436+0000, chain.objs.size()=1 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.HARGeQDXcM7HbzZKIwAJVichpvK6vtP_0 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17948421199949105694', time=2024-04-03T06:28:00.007629+0000, chain.objs.size()=1 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.uStxgd8B-c7nGtauTZb2IZh-3vK72fi_0 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9316487907760257297', time=2024-04-03T06:28:00.761357+0000, chain.objs.size()=1 2024-04-03T05:14:10.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.449+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7Gfui8LXWV-iGF3BCe9ehE2GC3qfL0O_0 2024-04-03T05:14:10.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10869459199863666513', time=2024-04-03T06:28:01.356638+0000, chain.objs.size()=1 2024-04-03T05:14:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.7fh4nv5ei2q9AEuDuBHqCW7e5rF8vSg_0 2024-04-03T05:14:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1031618874740880502', time=2024-04-03T06:28:04.057301+0000, chain.objs.size()=1 2024-04-03T05:14:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mfUw2Wg7acXj_xtnpsBMz2pMVEIaR9a_0 2024-04-03T05:14:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5470081482879980379', time=2024-04-03T06:28:04.193103+0000, chain.objs.size()=1 2024-04-03T05:14:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cVoMSRmRqQmNOZOl2h6KZRbVCxLVLDV_0 2024-04-03T05:14:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2342625977873836104', time=2024-04-03T06:28:04.358449+0000, chain.objs.size()=1 2024-04-03T05:14:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.cM8dJjZpfsXeOax0nlOtFr-rc1gksaF_0 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2921959640445643614', time=2024-04-03T06:28:04.360117+0000, chain.objs.size()=1 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fJILFUAOirfLOjiWpzfUuzASZsh-xii_0 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10550540109550399399', time=2024-04-03T06:28:04.694327+0000, chain.objs.size()=1 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.p9xtlFG8u3YpnqTIY5ngdhGvn5iVg-w_0 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9497896273358175039', time=2024-04-03T06:28:05.109942+0000, chain.objs.size()=1 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.FUc2GNI1fTXPaJ7DIt4v7llRryz6cYu_0 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.181699910259450634', time=2024-04-03T06:28:06.524436+0000, chain.objs.size()=1 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MnZJtmaM-KzNIEp7PFIzK2GfseWqFT8_0 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13601084661810500818', time=2024-04-03T06:28:06.611761+0000, chain.objs.size()=1 2024-04-03T05:14:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.w2u8SD2DtD0SZ-aGBzwFUq2hrShsyZW_0 2024-04-03T05:14:10.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7118941172053732634', time=2024-04-03T06:28:07.828865+0000, chain.objs.size()=1 2024-04-03T05:14:10.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mxH3rpWTxMUzVP06PEPr9xWYyTl75PE_0 2024-04-03T05:14:10.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16474064358883681060', time=2024-04-03T06:28:08.632574+0000, chain.objs.size()=1 2024-04-03T05:14:10.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.453+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fBeulF6HA0Qxr8JTshs1UunhfuVJ9KM_0 2024-04-03T05:14:10.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15533318230694841967', time=2024-04-03T06:28:09.372052+0000, chain.objs.size()=1 2024-04-03T05:14:10.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.NSH1DAUGfMcaYdqAy_On9ezeSOf3Qqr_0 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9207216244915968897', time=2024-04-03T06:28:10.219237+0000, chain.objs.size()=1 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.culdMDRdYn5g2YyEf2LaT9kJhw6IdGT_0 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13473785132097269287', time=2024-04-03T06:28:11.551112+0000, chain.objs.size()=1 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-4Q1AQy0eLy_jXv3em_Q1NOjEv_Zt0K_0 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2766351880019260433', time=2024-04-03T06:28:12.263234+0000, chain.objs.size()=1 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nKY9GkXjHEtPa0vUwHQ1CgY_49GWpk3_0 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4646366297452648551', time=2024-04-03T06:28:12.372132+0000, chain.objs.size()=1 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.1XTQvWB0kWDhEeSWCsPIpBTy9VcZn11_0 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13302650662072178821', time=2024-04-03T06:28:12.764812+0000, chain.objs.size()=1 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.b2UjUG99LUANqrS38nMoAuPsNr40DQH_0 2024-04-03T05:14:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8773783524757355090', time=2024-04-03T06:28:13.648342+0000, chain.objs.size()=1 2024-04-03T05:14:10.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.qF-xrgnwrhfGfA9m_JDPNTEB0AsGFOr_0 2024-04-03T05:14:10.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8678343744826661463', time=2024-04-03T06:28:15.504516+0000, chain.objs.size()=1 2024-04-03T05:14:10.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.wPYE50Dy8_Kdn7DzWiDFgrqFz8mFbsV_0 2024-04-03T05:14:10.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2948119694243034927', time=2024-04-03T06:28:16.045101+0000, chain.objs.size()=1 2024-04-03T05:14:10.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.j8lSXatFSLR5MMwOVeUJVTxGDApX9Wu_0 2024-04-03T05:14:10.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9217828047537592076', time=2024-04-03T06:28:16.762218+0000, chain.objs.size()=1 2024-04-03T05:14:10.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.-uoedqXRNi83gOKLzwhWtUJPdi20Dbl_0 2024-04-03T05:14:10.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18231761477720089690', time=2024-04-03T06:28:17.080918+0000, chain.objs.size()=1 2024-04-03T05:14:10.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.457+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.tK23bg8vVsEXPW7nkBRSLQcU5r1Rqfb_0 2024-04-03T05:14:10.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12562216046732402019', time=2024-04-03T06:28:17.739922+0000, chain.objs.size()=1 2024-04-03T05:14:10.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dZ-ZyYbFfvOxI2EZCsJ_AD-prHMM9NG_0 2024-04-03T05:14:10.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16855282740139857009', time=2024-04-03T06:28:19.941956+0000, chain.objs.size()=1 2024-04-03T05:14:10.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.zes4PRRXZE5_KXTLujR6l9lnCi9mmM__0 2024-04-03T05:14:10.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8388385620136786220', time=2024-04-03T06:28:20.999125+0000, chain.objs.size()=1 2024-04-03T05:14:10.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.sCpQk3ABt0VxlCVUAt6WRVg6EvET470_0 2024-04-03T05:14:10.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17164801063467010746', time=2024-04-03T06:28:25.398736+0000, chain.objs.size()=1 2024-04-03T05:14:10.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.233__shadow_.QgcPv0RkuEMzHXz9SaRu8t_8yGFRPKH_0 2024-04-03T05:14:10.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3565922183124421536', time=2024-04-03T06:28:46.306772+0000, chain.objs.size()=1 2024-04-03T05:14:10.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.243__shadow_.yu45Rt5GDfhLJMXM5oy8-Vm3dEyHxhD_0 2024-04-03T05:14:10.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15968486689569698390', time=2024-04-03T06:28:50.666559+0000, chain.objs.size()=1 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.245__shadow_.xy1ilxsTxt_SU-CthWh2MS9oRmdeksk_0 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7648022905259676311', time=2024-04-03T06:28:52.927737+0000, chain.objs.size()=1 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.246__shadow_.0TV26eTJkvLIfYr_nX5KVZde2QViVkH_0 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14712687255353287263', time=2024-04-03T06:29:16.051331+0000, chain.objs.size()=1 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.256__shadow_.XhIWsKoLaUtK7zyzBiNEDjZ1l7MqR6H_0 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12361572631245793607', time=2024-04-03T06:29:22.631315+0000, chain.objs.size()=1 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.259__shadow_.Deat4xk4dhb_gMikumXksDbl0OCuHBO_0 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18379335282183779428', time=2024-04-03T06:29:30.860046+0000, chain.objs.size()=1 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.261__shadow_.NB_p_9fmsf1zy1YGHLtkLlPJ5T4iwuf_0 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2089588443336866486', time=2024-04-03T06:29:36.117525+0000, chain.objs.size()=1 2024-04-03T05:14:10.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.461+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.262__shadow_.5faLAcW5atg7tcwQraHq3LJWEdVNcVF_0 2024-04-03T05:14:10.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10545640297354016236', time=2024-04-03T06:29:49.810983+0000, chain.objs.size()=1 2024-04-03T05:14:10.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.268__shadow_.w1qPvoVW3j5wj-oFpysYwt-cli87diR_0 2024-04-03T05:14:10.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9295476937274347928', time=2024-04-03T06:30:00.726637+0000, chain.objs.size()=1 2024-04-03T05:14:10.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.273__shadow_.tdFsVaRearpOsRFNx4xKo4N7eSD9lrN_0 2024-04-03T05:14:10.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12641426798516188823', time=2024-04-03T06:32:24.625995+0000, chain.objs.size()=1 2024-04-03T05:14:10.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.V-sqQzktn4aUsVYApAf11ODy6d4Lwod_0 2024-04-03T05:14:10.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10422314914799354971', time=2024-04-03T06:32:25.952096+0000, chain.objs.size()=1 2024-04-03T05:14:10.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FJzITnhqhVV_oZqrwiMYLudvOaUPDVV_0 2024-04-03T05:14:10.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16880798144366213646', time=2024-04-03T06:32:25.958820+0000, chain.objs.size()=1 2024-04-03T05:14:10.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.w9m9Ht2ZBC4tgjcLY-XTy8CZyDTCWl6_0 2024-04-03T05:14:10.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5764593429525720984', time=2024-04-03T06:32:26.141745+0000, chain.objs.size()=1 2024-04-03T05:14:10.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.puWCzq6mp5xzJM2LE9nlfyqZgX3hGp9_0 2024-04-03T05:14:10.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9593417177265981194', time=2024-04-03T06:32:26.757763+0000, chain.objs.size()=1 2024-04-03T05:14:10.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.465+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yTBOPYQYkH7quq-3iI7RKXmOO2r_wxK_0 2024-04-03T05:14:10.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16724091763510500242', time=2024-04-03T06:32:26.967986+0000, chain.objs.size()=1 2024-04-03T05:14:10.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.gifrGU4BeeFaxsmgf1tqgf9hnDa4LQs_0 2024-04-03T05:14:10.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14029637683261991067', time=2024-04-03T06:32:27.040809+0000, chain.objs.size()=1 2024-04-03T05:14:10.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dDG11J-mC0YZOBavrKyqaHbltiX8iXP_0 2024-04-03T05:14:10.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2415611499509084998', time=2024-04-03T06:32:28.176102+0000, chain.objs.size()=1 2024-04-03T05:14:10.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9dOVr1HlMG6iW8BqcCwjR2OUEgepQov_0 2024-04-03T05:14:10.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.991360403158670775', time=2024-04-03T06:32:28.177540+0000, chain.objs.size()=1 2024-04-03T05:14:10.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6aBSB_89iFvuB5O4Hu_PQlVInofWYA3_0 2024-04-03T05:14:10.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4153693888229195299', time=2024-04-03T06:32:28.180155+0000, chain.objs.size()=1 2024-04-03T05:14:10.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.YkiIZVl-L7nw4xOK-6i9eORbNZ5Y4O5_0 2024-04-03T05:14:10.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4813226431968329340', time=2024-04-03T06:32:29.020269+0000, chain.objs.size()=1 2024-04-03T05:14:10.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GVGRjzCgJZnL_w3DQFsXDcvscS7RvCs_0 2024-04-03T05:14:10.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2995287997643244852', time=2024-04-03T06:32:29.209105+0000, chain.objs.size()=1 2024-04-03T05:14:10.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.JlaLBuGom8Xh8bC8NEcE01HYZUDwZkO_0 2024-04-03T05:14:10.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1103078644549198832', time=2024-04-03T06:32:30.805708+0000, chain.objs.size()=1 2024-04-03T05:14:10.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.469+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-Q1QS_bv1EQA45soNcobllkmx2HIPUa_0 2024-04-03T05:14:10.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3042153958749644201', time=2024-04-03T06:32:30.807406+0000, chain.objs.size()=1 2024-04-03T05:14:10.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.guzweFJNhLbdZ7PLUykLp93nd32WIfu_0 2024-04-03T05:14:10.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8297920767673337596', time=2024-04-03T06:32:32.037998+0000, chain.objs.size()=1 2024-04-03T05:14:10.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.aBleYBS6_V2MKtFcox26f3wOBqMyklu_0 2024-04-03T05:14:10.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11685074921974469780', time=2024-04-03T06:32:32.246098+0000, chain.objs.size()=1 2024-04-03T05:14:10.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9Ub9RrsVyBK4GopVah86KvUS2wcfWoj_0 2024-04-03T05:14:10.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4624841655595850235', time=2024-04-03T06:32:32.679848+0000, chain.objs.size()=1 2024-04-03T05:14:10.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.H-8jeoVa8VcBrLhKLywIKvcGGF5UPk5_0 2024-04-03T05:14:10.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1829511999319651846', time=2024-04-03T06:32:34.364507+0000, chain.objs.size()=1 2024-04-03T05:14:10.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.y_N92TCTDm60eHaMVrN36Dasi1o-OYX_0 2024-04-03T05:14:10.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10083352461869372540', time=2024-04-03T06:32:37.421341+0000, chain.objs.size()=1 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.dj-cmlGE35z2lQn71cO7pVKVtS36B9N_0 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5508283379178235678', time=2024-04-03T06:32:38.450017+0000, chain.objs.size()=1 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qDXU32aVC3vlT7bitc49lPDtrY_0O-a_0 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6244689068917903896', time=2024-04-03T06:32:39.418347+0000, chain.objs.size()=1 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.9uOlzBsbYci3ms-FxFZsArkvTokQM7U_0 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7018139721299213234', time=2024-04-03T06:32:40.080109+0000, chain.objs.size()=1 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hG3EobQOHxlYPcP8MgIRMsWqP-F-hx2_0 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6578557180470468612', time=2024-04-03T06:32:40.432603+0000, chain.objs.size()=1 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.NfGLYKYyqZEEyMUJsEAiA1CFAuzzLRy_0 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1661681493101710800', time=2024-04-03T06:32:44.860018+0000, chain.objs.size()=1 2024-04-03T05:14:10.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.473+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.LClu3fm3kYLgxLmivoL0wbZqoJmT-Ts_0 2024-04-03T05:14:10.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10953533975748787235', time=2024-04-03T06:32:46.539594+0000, chain.objs.size()=1 2024-04-03T05:14:10.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.7Hv6uguDjPgSBqC1IpvrCjpdag2hKZE_0 2024-04-03T05:14:10.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13339471795036587851', time=2024-04-03T06:32:47.202957+0000, chain.objs.size()=1 2024-04-03T05:14:10.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.1I6cLdIrAJzHqt_Iqgj_zMnpaD5oX3x_0 2024-04-03T05:14:10.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.795185304749924689', time=2024-04-03T06:32:47.389278+0000, chain.objs.size()=1 2024-04-03T05:14:10.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Eh-wGsCIOSHotv6KA6G7Qml64Nv3f5V_0 2024-04-03T05:14:10.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1943600494942802682', time=2024-04-03T06:32:47.672391+0000, chain.objs.size()=1 2024-04-03T05:14:10.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.CePM5rH1mSGp3kkMcdQCtxSbJZxjL7w_0 2024-04-03T05:14:10.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4259311046472356570', time=2024-04-03T06:32:48.401116+0000, chain.objs.size()=1 2024-04-03T05:14:10.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lxyFYfnEvZeyn2aKg95JQwHuS2H3A-u_0 2024-04-03T05:14:10.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11571931126833164039', time=2024-04-03T06:32:50.841313+0000, chain.objs.size()=1 2024-04-03T05:14:10.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.hy7b_BKH2usmc41wCgnFfYC050gg3_h_0 2024-04-03T05:14:10.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15751428517212021803', time=2024-04-03T06:32:50.952142+0000, chain.objs.size()=1 2024-04-03T05:14:10.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.64aDEx5NIMZtKMqNkrgSx80pchY2MWH_0 2024-04-03T05:14:10.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12636667265344413332', time=2024-04-03T06:32:52.243989+0000, chain.objs.size()=1 2024-04-03T05:14:10.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.IVgQYa-iz6x5i22xwlt9jSNnQY0n5Rs_0 2024-04-03T05:14:10.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5300538527588209502', time=2024-04-03T06:34:28.455618+0000, chain.objs.size()=1 2024-04-03T05:14:10.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.BIStJHlz6C0mn-5B_41iaH49YT-S3zi_0 2024-04-03T05:14:10.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9504850163295468985', time=2024-04-03T06:34:30.549543+0000, chain.objs.size()=1 2024-04-03T05:14:10.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.IKWuuLWy0yqxkkgxXIBpdk_KWETXhOM_0 2024-04-03T05:14:10.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10417029289114070381', time=2024-04-03T06:34:31.070884+0000, chain.objs.size()=1 2024-04-03T05:14:10.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.477+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.TbiPKyhWv8Y5q-n3v2CB6y-A236Pjsl_0 2024-04-03T05:14:10.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8928332949715422681', time=2024-04-03T06:34:37.633108+0000, chain.objs.size()=1 2024-04-03T05:14:10.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.r4szLj8zu8T64ie8X9bZVv1nl2Yc7ST_0 2024-04-03T05:14:10.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5686078366956218501', time=2024-04-03T06:34:40.496853+0000, chain.objs.size()=1 2024-04-03T05:14:10.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.pP4ZPwzGgZrMSDVrxsIxx6CDkL1w4V2_0 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9624848408365609313', time=2024-04-03T06:34:40.502625+0000, chain.objs.size()=1 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hW1Go85qvfhOafnEpPe2LF5WncwKrk1_0 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6792066101519237313', time=2024-04-03T06:34:42.197097+0000, chain.objs.size()=1 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dktYUFS32SIWhm6QqxNiG8eN6_i96Md_0 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16115679177410418477', time=2024-04-03T06:34:42.358198+0000, chain.objs.size()=1 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Romxs-0wcTG5RTvSWZSI5j3yOhlD_IK_0 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5901713405796111129', time=2024-04-03T06:34:42.361619+0000, chain.objs.size()=1 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5D4tIsOtdvDwEBlq3Gf0GYtBLuS_xfR_0 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17423001408138357884', time=2024-04-03T06:34:42.502549+0000, chain.objs.size()=1 2024-04-03T05:14:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.zeZUvsH6S_GWVJlrefmnQmgfZMWnCGA_0 2024-04-03T05:14:10.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.470318557311688533', time=2024-04-03T06:34:45.011472+0000, chain.objs.size()=1 2024-04-03T05:14:10.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.481+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.t_ZA1AEhiKc1v5l4JZjLGD1-PRfOcct_0 2024-04-03T05:14:10.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10166460375067990013', time=2024-04-03T06:34:47.293522+0000, chain.objs.size()=1 2024-04-03T05:14:10.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.lripRHdQB2o9sWnwxvD1gQq7yVttvks_0 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14738772782294940858', time=2024-04-03T06:34:47.326984+0000, chain.objs.size()=1 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.qKN1nM9dlXGrsrsO8fwSKqQpSckPSFI_0 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5377847961928326031', time=2024-04-03T06:34:49.318196+0000, chain.objs.size()=1 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9JZwvFo8n5nsuR013qtgFqud9lzxaNZ_0 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10320513940023925839', time=2024-04-03T06:34:49.672106+0000, chain.objs.size()=1 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.LcWOQXGpKtbDWLjK5hMH10nryR89fWV_0 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18080885485432125163', time=2024-04-03T06:34:50.948833+0000, chain.objs.size()=1 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GYeQ6zaJOCu9P6bRlRyUwbg6KyX2XzU_0 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12594026283744495555', time=2024-04-03T06:34:51.269348+0000, chain.objs.size()=1 2024-04-03T05:14:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.SDsWFwN5U7M2aAPZpdazs2P8QXMNfo8_0 2024-04-03T05:14:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10821237523868687881', time=2024-04-03T06:34:51.433891+0000, chain.objs.size()=1 2024-04-03T05:14:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dckGayMA3kOKQzy7V4NhgAZNxjO4z7j_0 2024-04-03T05:14:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17211208277674123882', time=2024-04-03T06:34:53.066542+0000, chain.objs.size()=1 2024-04-03T05:14:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.fzrR1KJphZjzsnCV2SB5XTwRJ7T6b5P_0 2024-04-03T05:14:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.790620556311737657', time=2024-04-03T06:34:54.406170+0000, chain.objs.size()=1 2024-04-03T05:14:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.B0lm5SwxzG6ekfDCj-_3t4j3XJZ8jQx_0 2024-04-03T05:14:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3922924320618356764', time=2024-04-03T06:34:54.532526+0000, chain.objs.size()=1 2024-04-03T05:14:10.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.485+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GLgMv6bcW5LZ8sBR5tIb38hrHAwvvF0_0 2024-04-03T05:14:10.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9146171169400195141', time=2024-04-03T06:34:54.834357+0000, chain.objs.size()=1 2024-04-03T05:14:10.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.wl3k91XY8LRjAapmDjU7een7HPBIjBU_0 2024-04-03T05:14:10.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.489+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12319314875396731392', time=2024-04-03T06:34:54.930290+0000, chain.objs.size()=1 2024-04-03T05:14:10.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.489+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.HOrqIlAQ6YzT34OX7HpssOab-he9lxo_0 2024-04-03T05:14:10.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/42720 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.330131145081559647', time=2024-04-03T06:34:54.941015+0000, chain.objs.size()=1 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8WktPR94zVok4HvrLblItBVBn9ydeXL_0 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12610227699330560898', time=2024-04-03T06:35:24.790722+0000, chain.objs.size()=1 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.308__shadow_.IdgKy1fiR_Yo8DYpast7NNFXeC3EWMY_0 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5378832004618453280', time=2024-04-03T06:38:25.880687+0000, chain.objs.size()=1 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.402__shadow_.N3exRGDCXmsBQA9_qPOACuz4Fu5KACW_0 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.924718621484492208', time=2024-04-03T06:39:23.542738+0000, chain.objs.size()=1 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.427__shadow_.dDezxR74oJoW3bKyMOv4bxpiUBf_u6F_0 2024-04-03T05:14:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.174642772795360548', time=2024-04-03T06:39:42.498712+0000, chain.objs.size()=1 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.434__shadow_.ar5ybxJiSs17cTs4o8S3xlPQwwzz1P4_0 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2420375495186801823', time=2024-04-03T06:39:48.143945+0000, chain.objs.size()=1 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.436__shadow_.HxPIzThzsTWOW9X93a1x-9bKyydq4T0_0 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10485663856718747464', time=2024-04-03T06:40:40.996979+0000, chain.objs.size()=1 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.463__shadow_.k2GTeV-UoWuyF1JN1aS1hv209_xJzLy_0 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16593167061904845916', time=2024-04-03T06:41:59.848003+0000, chain.objs.size()=1 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.484__shadow_.Gd5mF1rl13ewlhlfSAUE4kpQfVtWZA8_0 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13066830237820595368', time=2024-04-03T06:42:27.145528+0000, chain.objs.size()=1 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.487__shadow_.Ks4fqRuq7e9OxVTSJZ23JjTqcSrwHJQ_0 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11392690972182732671', time=2024-04-03T06:42:27.741206+0000, chain.objs.size()=1 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.488__multipart_mymultipart.2~4_BaF2GI1zotnzyKxCABxcM410GlfcH.1 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10920106421785431315', time=2024-04-03T06:47:40.531681+0000, chain.objs.size()=1 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.493__multipart_mymultipart.2~DScmCrG0hwZIZR4vLibvnc7eXrz8fbW.1 2024-04-03T05:14:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='ghlsdiwgvyz7vu122yvssnarpavgrto8', time=2024-04-03T06:53:24.704449+0000, chain.objs.size()=1 2024-04-03T05:14:10.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.497+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.544__shadow_.ywH5hrDcIanc-CNfaFmbyA-iWQU_L_H_0 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1853371094429020978', time=2024-04-03T06:53:57.719162+0000, chain.objs.size()=1 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:g.DTBbhNj6j8JGoQqWe6Ael1-XQlIzm_.4-GMG8cjcvYGaSaTOLtoVSBZ0ZeEZ8c_0 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9713345014386252658', time=2024-04-03T06:54:12.787535+0000, chain.objs.size()=1 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:i7A7g.Sv0ZKO5HdgXTLd1OE3ctuaYix_.J6AxW2pmk91YGspeaozC9OMYmPG8sHp_0 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6411268877314435071', time=2024-04-03T06:55:29.201243+0000, chain.objs.size()=1 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.549__shadow:ixjAryEww69RyeDNyYe3btJWQjo0FgI_.wb0MbNkn7Ea1fIWKA8IVb0vtDY6aKS5_0 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15344206931296557561', time=2024-04-03T06:56:05.281154+0000, chain.objs.size()=1 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.565__shadow_.m9q6aXLT9lLOV68-sWsF0h3FNLKpL4u_0 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1886865573096494190', time=2024-04-03T07:01:09.780791+0000, chain.objs.size()=1 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.598__shadow_.p2flIhRLnMuoY2f1pj2IRbae0T5uf4p_0 2024-04-03T05:14:10.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7362285250325348146', time=2024-04-03T07:01:21.200215+0000, chain.objs.size()=1 2024-04-03T05:14:10.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.505+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.603__shadow_.xvPV6Z-6lXreXCMxSAKSNkzL4PnDIWy_0 2024-04-03T05:14:10.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7071868823268763655', time=2024-04-03T07:01:46.968730+0000, chain.objs.size()=2 2024-04-03T05:14:10.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.610__shadow_.iD3GIbSMZ1YRCM_z_CusoHCxn67_Lg1_0 2024-04-03T05:14:10.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.610__shadow_.iD3GIbSMZ1YRCM_z_CusoHCxn67_Lg1_1 2024-04-03T05:14:10.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.509+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9718961202668800697', time=2024-04-03T07:03:46.297943+0000, chain.objs.size()=1 2024-04-03T05:14:10.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.631__shadow_.FqM-4DDytE9hTpr9ImJajKggruE7q2q_0 2024-04-03T05:14:10.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.509+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:10.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.513+0000 7efe1d9f3980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-03T05:14:10.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.513+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-03T05:14:10.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-03T05:14:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46090' 2024-04-03T05:14:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='_-w6TFdCCORiFec2LnHxRg-4ISRiNd14', time=2024-04-03T06:22:03.510359+0000, chain.objs.size()=3 2024-04-03T05:14:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.Xos5DxCIeXkfwJm3lEtbE_B5iD2zn2c_0 2024-04-03T05:14:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.Xos5DxCIeXkfwJm3lEtbE_B5iD2zn2c_1 2024-04-03T05:14:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.149__shadow_.Xos5DxCIeXkfwJm3lEtbE_B5iD2zn2c_2 2024-04-03T05:14:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4612995420321248207', time=2024-04-03T06:24:37.907418+0000, chain.objs.size()=1 2024-04-03T05:14:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.189__shadow_.yydE1_SJEzY9Y_KbLrtsWhJjdj4-nLW_0 2024-04-03T05:14:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='2~LGRpOIJwUn5-1n5j8ZOb3jjxH7sIbp4', time=2024-04-03T06:24:41.976440+0000, chain.objs.size()=1 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.190__multipart_mymultipart.2~LGRpOIJwUn5-1n5j8ZOb3jjxH7sIbp4.1 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1009353882102876824', time=2024-04-03T06:25:32.404553+0000, chain.objs.size()=1 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.211__shadow_.NBkcs06uRP2XXrlVs8TU5LZi6eo3fqm_0 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3983432168830772616', time=2024-04-03T06:25:48.744182+0000, chain.objs.size()=1 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.217__shadow_.fojSeTCUZrVBmvnjUBfgKt5wH78qWr5_0 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17570353539015270344', time=2024-04-03T06:26:16.976501+0000, chain.objs.size()=1 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.230__shadow_.YxJVlUwnRvcQiSXrB3bBZ8qNQh2dEc7_0 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7343275799654279644', time=2024-04-03T06:27:52.187634+0000, chain.objs.size()=1 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.A-YLE_X-C2yc-VhP6gU5jqqJr_rtM0E_0 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12030971110550011558', time=2024-04-03T06:27:52.863334+0000, chain.objs.size()=1 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.lk2p5UWIhAUkPOIqtdW0xbaG6ZCIFbb_0 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18241819618217404962', time=2024-04-03T06:27:53.608469+0000, chain.objs.size()=1 2024-04-03T05:14:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5NN5K28LBhjbh6CHDuiN8eFa0dqvuYz_0 2024-04-03T05:14:10.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14355809599870610633', time=2024-04-03T06:27:53.682590+0000, chain.objs.size()=1 2024-04-03T05:14:10.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.DWJbwEW2xp25HPf8UlwIWHVjbF3bSrG_0 2024-04-03T05:14:10.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13987673063372280611', time=2024-04-03T06:27:53.853515+0000, chain.objs.size()=1 2024-04-03T05:14:10.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.517+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.hTOIEZJktra-g10f42d1v5cJ2uMECJv_0 2024-04-03T05:14:10.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9380693850537978465', time=2024-04-03T06:27:53.935879+0000, chain.objs.size()=1 2024-04-03T05:14:10.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.BkE9fcyDoyzAOQRzQ2n4CjtIpVb45DZ_0 2024-04-03T05:14:10.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1959906025645830371', time=2024-04-03T06:27:54.628913+0000, chain.objs.size()=1 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.xVtCQ7RR2DWPWIDdQpn48UYADFLjmIN_0 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15708519808878095357', time=2024-04-03T06:27:57.593502+0000, chain.objs.size()=1 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.jvxiRS77R5nqEABlfGZgCGjASb4-L2s_0 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15671738701027129341', time=2024-04-03T06:27:57.668961+0000, chain.objs.size()=1 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.TiG9b447saxOt56VEIol5FUcue6QH6X_0 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8511212097533690172', time=2024-04-03T06:28:01.431404+0000, chain.objs.size()=1 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5Rs3GJg9TWEB6a5X2P3wlJ6Di41dpzS_0 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5580246329817713244', time=2024-04-03T06:28:02.934705+0000, chain.objs.size()=1 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.5gepJjVUbL9btEpOVs3jYe7_esNkHBH_0 2024-04-03T05:14:10.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1091558309648359984', time=2024-04-03T06:28:03.017469+0000, chain.objs.size()=1 2024-04-03T05:14:10.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.MfEVntP48vjlrVp5PyteK7Jxl1pbxLz_0 2024-04-03T05:14:10.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14618960454929035358', time=2024-04-03T06:28:04.590152+0000, chain.objs.size()=1 2024-04-03T05:14:10.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.Plx8nXVfMpaI16YFdfwOxsVxZFpCJBS_0 2024-04-03T05:14:10.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11795558249671917516', time=2024-04-03T06:28:08.140462+0000, chain.objs.size()=1 2024-04-03T05:14:10.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.nZYCsHRyg1n_vrWmTXcECaWxCoYCuaE_0 2024-04-03T05:14:10.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17618547950344480882', time=2024-04-03T06:28:09.037652+0000, chain.objs.size()=1 2024-04-03T05:14:10.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.SBJxZMsLAM-efP0c-vepXZfD8jXtnpa_0 2024-04-03T05:14:10.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14796039034408363316', time=2024-04-03T06:28:12.265924+0000, chain.objs.size()=1 2024-04-03T05:14:10.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.521+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.mf91G49kZm2qj5CaJL47FQD-dJieGbh_0 2024-04-03T05:14:10.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15396729266861498744', time=2024-04-03T06:28:12.498070+0000, chain.objs.size()=1 2024-04-03T05:14:10.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.UHXjhhBXx6jFh5xbz7T8oY1KwphPVuz_0 2024-04-03T05:14:10.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15834934005759521784', time=2024-04-03T06:28:12.602299+0000, chain.objs.size()=1 2024-04-03T05:14:10.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.dZY4IH2jZh4tirn2l9SKpjnW6SOj4Oa_0 2024-04-03T05:14:10.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5151201139917403550', time=2024-04-03T06:28:12.956968+0000, chain.objs.size()=1 2024-04-03T05:14:10.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.vazOTX0PKzb7EvnTkf9cfc1JtjcIeSq_0 2024-04-03T05:14:10.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17826679354163581123', time=2024-04-03T06:28:14.076641+0000, chain.objs.size()=1 2024-04-03T05:14:10.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.QJT8kTEGaJsXo8TaU_sGX7H8CWzb43M_0 2024-04-03T05:14:10.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3981031521024221722', time=2024-04-03T06:28:14.234703+0000, chain.objs.size()=1 2024-04-03T05:14:10.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.ub680CyHO-hjQGAw8cPcCvmX-1LZUdw_0 2024-04-03T05:14:10.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5299935485838468507', time=2024-04-03T06:28:15.664456+0000, chain.objs.size()=1 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.CfTMsOP7ajVbM_fUIDJQeGBKbN2fGzN_0 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10035954960040798025', time=2024-04-03T06:28:16.293753+0000, chain.objs.size()=1 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.fFFbmty7-ndJtysm0bCUoZOLNTEUHqI_0 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10836298913069205514', time=2024-04-03T06:28:17.959361+0000, chain.objs.size()=1 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.231__shadow_.574aneivmJvmdtuAmNEyvWLkmpHTbOF_0 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2989578335108479082', time=2024-04-03T06:28:25.386871+0000, chain.objs.size()=1 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.233__shadow_.vDbNz6nLjIjelXnlnMvH5Wc_Muze7Z2_0 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16000016243977567114', time=2024-04-03T06:28:29.653465+0000, chain.objs.size()=1 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.235__shadow_.gNUNejqNkbdH5RFZCp6DVokBZgSXUPL_0 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7603934989394453976', time=2024-04-03T06:28:31.750044+0000, chain.objs.size()=1 2024-04-03T05:14:10.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.525+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.236__shadow_.mIwVeWxtROr9RYMnLQee2z0aSMPbeaZ_0 2024-04-03T05:14:10.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4245192936108384146', time=2024-04-03T06:28:59.492167+0000, chain.objs.size()=1 2024-04-03T05:14:10.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.249__shadow_.YxGKkzoS9ghTtMN7svzRbpfMzO2VVdq_0 2024-04-03T05:14:10.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17710826248828080733', time=2024-04-03T06:29:42.927796+0000, chain.objs.size()=1 2024-04-03T05:14:10.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.265__shadow_.pkVhgdSzVNTQGSWV85zOWe-wN9sSp_8_0 2024-04-03T05:14:10.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2226642768370891162', time=2024-04-03T06:29:49.809953+0000, chain.objs.size()=1 2024-04-03T05:14:10.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.268__shadow_.IGvO_N5DOOVx6aXpnEG9pa66wr1Y3aL_0 2024-04-03T05:14:10.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2191555359767299834', time=2024-04-03T06:30:00.751081+0000, chain.objs.size()=1 2024-04-03T05:14:10.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.273__shadow_.Sl_jiPQsithsTQyfkHeL6_afvwEqnD-_0 2024-04-03T05:14:10.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14024234454009382032', time=2024-04-03T06:32:24.161991+0000, chain.objs.size()=1 2024-04-03T05:14:10.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.4uPn80hx923eeIYQ1_ycvliBZS8S4DT_0 2024-04-03T05:14:10.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4091608005143820145', time=2024-04-03T06:32:24.316048+0000, chain.objs.size()=1 2024-04-03T05:14:10.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_._CRJu6kz5Md_54rkbeqTgiQRooxUKyC_0 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7888576590162510059', time=2024-04-03T06:32:24.482717+0000, chain.objs.size()=1 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GJPiMZ_caMj1ZIxHX4DNXqqwMfDqjSF_0 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11486733899706186153', time=2024-04-03T06:32:25.749736+0000, chain.objs.size()=1 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.57n_0Qh1bj-z7DDzbVnpMrvW-R7gBm6_0 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7457493233352129053', time=2024-04-03T06:32:25.895818+0000, chain.objs.size()=1 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.IcCQIak_A49V2ToLClx-4F8gWcd9Syk_0 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5589266302023467049', time=2024-04-03T06:32:26.073206+0000, chain.objs.size()=1 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.uhbEQOJbe8L0gHAs_7qThsGrFUDT77o_0 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7859031813655933808', time=2024-04-03T06:32:26.278592+0000, chain.objs.size()=1 2024-04-03T05:14:10.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.529+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.HKadXvK1_uRA7M5EnHZvbPaBmBxzrlk_0 2024-04-03T05:14:10.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.533+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6707787654543636812', time=2024-04-03T06:32:29.366497+0000, chain.objs.size()=1 2024-04-03T05:14:10.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.533+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.02RjA1dnGYHL6YJI91eKHAXbu2nzUBf_0 2024-04-03T05:14:10.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.533+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9371110357033320224', time=2024-04-03T06:32:30.544349+0000, chain.objs.size()=1 2024-04-03T05:14:10.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.533+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.qHTEtILsstTAk0PBoiUHBDbZP8AR_RL_0 2024-04-03T05:14:10.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7160839215134399184', time=2024-04-03T06:32:31.710173+0000, chain.objs.size()=1 2024-04-03T05:14:10.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.j6wLHphA8MKL4y52AApXVg6jPByXs4L_0 2024-04-03T05:14:10.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11269229751634417344', time=2024-04-03T06:32:31.949343+0000, chain.objs.size()=1 2024-04-03T05:14:10.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.yPOtq_39fvMrFizITu_MX7A22AVCwBZ_0 2024-04-03T05:14:10.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4901751462304985399', time=2024-04-03T06:32:32.970138+0000, chain.objs.size()=1 2024-04-03T05:14:10.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.G9iHzIkJ78FTDCnKkpTCyGyDBoi8hax_0 2024-04-03T05:14:10.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15235216502964127201', time=2024-04-03T06:32:34.531528+0000, chain.objs.size()=1 2024-04-03T05:14:10.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6DtlA3y5zJHkr22bWJKwfIPBKn4_DV8_0 2024-04-03T05:14:10.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17338362827484256124', time=2024-04-03T06:32:35.541363+0000, chain.objs.size()=1 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.x6pj73jmhJZnPkADKNAw3iHJEoWBAYa_0 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4070613832406470948', time=2024-04-03T06:32:35.701300+0000, chain.objs.size()=1 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.vIA3f_TvLpcbLoq3Wz2jgDGXrv8JDLy_0 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6151323063602292774', time=2024-04-03T06:32:38.204436+0000, chain.objs.size()=1 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.Occ1QPeflZabw1yIjGYXWdzLLjbR2aL_0 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12404889420500818637', time=2024-04-03T06:32:38.206645+0000, chain.objs.size()=1 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.ZoDqL_W5BT1WHggu2KOYatSjts2bsgg_0 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4826096616933993522', time=2024-04-03T06:32:39.715718+0000, chain.objs.size()=1 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.jl0T7RegeYnvH1eXsg4Md7R0DivUp2v_0 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1529998706656093432', time=2024-04-03T06:32:40.798445+0000, chain.objs.size()=1 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.P2E5tx2QP8sFlz_mjnCkOjTqOBIsMtf_0 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17251319001225150403', time=2024-04-03T06:32:41.262960+0000, chain.objs.size()=1 2024-04-03T05:14:10.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.537+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.xJWwSm9-VZQ4l8ImmyvOqvW5wwc6--L_0 2024-04-03T05:14:10.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16911331969386473089', time=2024-04-03T06:32:41.352748+0000, chain.objs.size()=1 2024-04-03T05:14:10.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.6CTVeV36UFfWbg4kDCcFeO3PGxWRXfN_0 2024-04-03T05:14:10.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3683300823389306737', time=2024-04-03T06:32:42.092972+0000, chain.objs.size()=1 2024-04-03T05:14:10.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.PzADw3J4_06FKIIXsjqmC_p-9JukWh7_0 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.792101058156623058', time=2024-04-03T06:32:43.039752+0000, chain.objs.size()=1 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.-LZKBLk4mjsxDfUtXu5vrkEErJcrdhM_0 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3643039527844001315', time=2024-04-03T06:32:47.971198+0000, chain.objs.size()=1 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.FfLxtGoXbJrUGnOkzylpDhMfENTlAqj_0 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11044376996599541412', time=2024-04-03T06:32:48.301744+0000, chain.objs.size()=1 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.GA1AElgLopdrpq1SGB0Yhwa765pS96F_0 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8757065577329797404', time=2024-04-03T06:32:48.672541+0000, chain.objs.size()=1 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.syhNMkkrdrsOWUnMMEpgfbiDMAEhHaL_0 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1931108568559446273', time=2024-04-03T06:32:50.344563+0000, chain.objs.size()=1 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.RfOpGshcKFNY3x-0qYVniQ6MT-weZK-_0 2024-04-03T05:14:10.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12132931363286539247', time=2024-04-03T06:32:51.247041+0000, chain.objs.size()=1 2024-04-03T05:14:10.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.fikmtz8YhexqP02OTsGmpL_1wQ3zMOS_0 2024-04-03T05:14:10.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5213787944663478190', time=2024-04-03T06:32:51.399999+0000, chain.objs.size()=1 2024-04-03T05:14:10.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.N0Myp4wWepby-w0qfZIO0c3Ty4D4rHG_0 2024-04-03T05:14:10.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11743619170935043839', time=2024-04-03T06:32:51.929567+0000, chain.objs.size()=1 2024-04-03T05:14:10.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.U1hYOIjdndFQ9g68-79ILsd8oATZWyK_0 2024-04-03T05:14:10.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12094864207609206527', time=2024-04-03T06:32:52.244298+0000, chain.objs.size()=1 2024-04-03T05:14:10.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.541+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.292__shadow_.lYcqIzhyXAaS3oGGScIW-gVC5-RkPtz_0 2024-04-03T05:14:10.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6460833913627870071', time=2024-04-03T06:34:29.465030+0000, chain.objs.size()=1 2024-04-03T05:14:10.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JuJO90Vl0nq4yn69hPcT6HBF4OiupIE_0 2024-04-03T05:14:10.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.545+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13080897836826412779', time=2024-04-03T06:34:29.646072+0000, chain.objs.size()=1 2024-04-03T05:14:10.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.545+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8QGXiM8Zn78aHNY1EqWdhlAiF8DbuGH_0 2024-04-03T05:14:10.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11193829494589645876', time=2024-04-03T06:34:30.117926+0000, chain.objs.size()=1 2024-04-03T05:14:10.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.V-xtdkWeOphnCb-wlxOBos__vKLDgA-_0 2024-04-03T05:14:10.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10122897308313497684', time=2024-04-03T06:34:30.325752+0000, chain.objs.size()=1 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JZdEZNeWNRsqP5uD1xcEUlKd88tGlz9_0 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13838469918102292142', time=2024-04-03T06:34:30.695577+0000, chain.objs.size()=1 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.qwFRoFq9o3krSlnSOiUo5StQJiTjfkO_0 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4136901267915885897', time=2024-04-03T06:34:31.223957+0000, chain.objs.size()=1 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ad9-F-zG-10qob2yx71Q2dOXorzJMsP_0 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.467568880551495649', time=2024-04-03T06:34:31.305152+0000, chain.objs.size()=1 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6vcIyp8xdGBdeIkZwRSfMwmotSmkedl_0 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13151735877336031302', time=2024-04-03T06:34:32.998527+0000, chain.objs.size()=1 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Wwea9kaqwWwRYS-EUKw5_NmMf6OaVvq_0 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4442129085055235673', time=2024-04-03T06:34:33.395595+0000, chain.objs.size()=1 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.13y9p2X2Uy_iUD3GHV7VIUBQtZI-V1Y_0 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2013842243296603989', time=2024-04-03T06:34:33.777772+0000, chain.objs.size()=1 2024-04-03T05:14:10.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Odw_ZUVhr0vK_PeetKUKx7BfzM251GS_0 2024-04-03T05:14:10.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7300776870914326911', time=2024-04-03T06:34:34.544118+0000, chain.objs.size()=1 2024-04-03T05:14:10.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.EaNp4DWY35g4uZs0pEnwBSyD49eDnWI_0 2024-04-03T05:14:10.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.908298074952185939', time=2024-04-03T06:34:36.377396+0000, chain.objs.size()=1 2024-04-03T05:14:10.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.gk5hUlVuMBCbQAISPAr2OucUL8ooyeZ_0 2024-04-03T05:14:10.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10837719035791354367', time=2024-04-03T06:34:36.479441+0000, chain.objs.size()=1 2024-04-03T05:14:10.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.549+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.DuVqVHz9ufveFYLmCebKb9VmO7W5Ntk_0 2024-04-03T05:14:10.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12272456731191980963', time=2024-04-03T06:34:37.193597+0000, chain.objs.size()=1 2024-04-03T05:14:10.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Egjl4-zFfQ3R-l05rSS7x9IAsFrJoNr_0 2024-04-03T05:14:10.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17037969420414993396', time=2024-04-03T06:34:37.462490+0000, chain.objs.size()=1 2024-04-03T05:14:10.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.YhcZSa71C--6laatPFB3EDzQaNzZa7R_0 2024-04-03T05:14:10.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5125670649500364588', time=2024-04-03T06:34:38.652549+0000, chain.objs.size()=1 2024-04-03T05:14:10.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.FeE2XRcp04WoLBiaUdX_0U5eZGqqdWO_0 2024-04-03T05:14:10.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16056909962744872691', time=2024-04-03T06:34:38.910001+0000, chain.objs.size()=1 2024-04-03T05:14:10.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.5tE2HljSyMHRZPNBTGLx_OUH0dFAMWY_0 2024-04-03T05:14:10.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10943270179870590418', time=2024-04-03T06:34:40.062076+0000, chain.objs.size()=1 2024-04-03T05:14:10.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.7ItIbpeoiJuObtjKuRsfJUW-AL7p6kg_0 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16634498130505879606', time=2024-04-03T06:34:40.430594+0000, chain.objs.size()=1 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.l1Msh2Hw2OO0Z2zZsNsc4wOdFvQjLGv_0 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7034384099779341295', time=2024-04-03T06:34:41.490989+0000, chain.objs.size()=1 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.dvrgl71ljXwURWVVjpUG3hLG--9MgwW_0 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.17113129402224063700', time=2024-04-03T06:34:42.760321+0000, chain.objs.size()=1 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.hwyf1OVD6DoqTHixPxGs8DjznPA8ULt_0 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.13681141103567747152', time=2024-04-03T06:34:43.897204+0000, chain.objs.size()=1 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ktyfs4iql8hxs3LXuwbErIRlcSceVRZ_0 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15718906860544808915', time=2024-04-03T06:34:44.349160+0000, chain.objs.size()=1 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.ix6Suv_iZIr1d-mtYZIOzejj8dVKbpK_0 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16188897936922384054', time=2024-04-03T06:34:44.819949+0000, chain.objs.size()=1 2024-04-03T05:14:10.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.JGCDEEqHUqgl4W2_NE-10MjF8NhOXDu_0 2024-04-03T05:14:10.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16367748066835508856', time=2024-04-03T06:34:45.371085+0000, chain.objs.size()=1 2024-04-03T05:14:10.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.553+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.__6BEKzDnFRhn0qGLAhBXIe-oP0YL6m_0 2024-04-03T05:14:10.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.119226731909844677', time=2024-04-03T06:34:45.698493+0000, chain.objs.size()=1 2024-04-03T05:14:10.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.qCMgAAO1PH0-6m46CjcuRaF0pQ71bG9_0 2024-04-03T05:14:10.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.14171030169666389033', time=2024-04-03T06:34:48.011109+0000, chain.objs.size()=1 2024-04-03T05:14:10.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GDwWiX1cn0wCeE7gW5PGVf8YVN4HLr9_0 2024-04-03T05:14:10.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5973709039244982902', time=2024-04-03T06:34:48.398288+0000, chain.objs.size()=1 2024-04-03T05:14:10.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.QlqutK_UNoOmbuQRaMu7mFlhuKpy6vl_0 2024-04-03T05:14:10.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7691636116149746190', time=2024-04-03T06:34:48.878661+0000, chain.objs.size()=1 2024-04-03T05:14:10.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.8NmVemC2imwK1kQxBGG2o4dbGjZvvmE_0 2024-04-03T05:14:10.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7803126423989676474', time=2024-04-03T06:34:49.546217+0000, chain.objs.size()=1 2024-04-03T05:14:10.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.2zlAC_pcvnDOrdiBSul7a4yaPiqxBfB_0 2024-04-03T05:14:10.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6236182491055480601', time=2024-04-03T06:34:50.875934+0000, chain.objs.size()=1 2024-04-03T05:14:10.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.GrZIFlLuEUW2h4hFWIji1UrI3i-IoJQ_0 2024-04-03T05:14:10.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.1867134927348244280', time=2024-04-03T06:34:51.161947+0000, chain.objs.size()=1 2024-04-03T05:14:10.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.557+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.9q4GadsW3Ucwcw5m0rhqRa4L5SwSyX3_0 2024-04-03T05:14:10.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.561+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 0/46090 2024-04-03T05:14:10.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.8793548311467806794', time=2024-04-03T06:34:51.250854+0000, chain.objs.size()=1 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.tKvtUJyLKza-tKE3nrjXWnr7G1O5iND_0 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.2931228671163951353', time=2024-04-03T06:34:51.335304+0000, chain.objs.size()=1 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.6Lic5_Rl8LvOAHh5TtvLv_ft1JW1v_P_0 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16624467617601892179', time=2024-04-03T06:34:52.462269+0000, chain.objs.size()=1 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.eihpB9KRNzFb91SQTYegK748KOY45_j_0 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7036837702799562716', time=2024-04-03T06:34:52.724703+0000, chain.objs.size()=1 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.noiRE7hKacnHyPa5Lli1J5EstElTAyN_0 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.15122768936059719484', time=2024-04-03T06:34:53.186202+0000, chain.objs.size()=1 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.kZ8HmAR0MbqojBKNRO-2E_KJ_v2qGVf_0 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11971197726820076201', time=2024-04-03T06:34:53.542956+0000, chain.objs.size()=1 2024-04-03T05:14:10.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.b74jM0Ku4NwMJBa6wdDksBi-ynOpud8_0 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.10208644070068912811', time=2024-04-03T06:34:56.436578+0000, chain.objs.size()=1 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.293__shadow_.Qor-w-hdrblKu8_6lQh9l-ypFqcHVKf_0 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.11717531992565541887', time=2024-04-03T06:38:32.012463+0000, chain.objs.size()=1 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.405__shadow_.bY3BPAGOd26rHSeHWBJ0_msRigfHQDJ_0 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9966361984458884348', time=2024-04-03T06:39:17.967903+0000, chain.objs.size()=1 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.425__shadow_.-Il71tIRmvEVj4qTCSs4gBo_FqCv8pb_0 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5169179030155804466', time=2024-04-03T06:39:31.955886+0000, chain.objs.size()=1 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.430__shadow_.GiWWoi6k_GmBJoghIavGHZR0DrfJKsk_0 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.6077584855943219680', time=2024-04-03T06:39:46.240479+0000, chain.objs.size()=1 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.435__shadow_.NR53W7AWaga_49F01bHUvFNw_a4lS3n_0 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_1_07324bafd9dd1d143276de69112dbefa', time=2024-04-03T06:41:02.706307+0000, chain.objs.size()=1 2024-04-03T05:14:10.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.473__shadow:nkkMnA7eeBWXxa1fBnL9qOokSjzU8Oz_.mZ4yEN6CrY9CeYxAeW7XMs95E5q1fIM_0 2024-04-03T05:14:10.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.7282237536009942804', time=2024-04-03T06:52:32.405551+0000, chain.objs.size()=1 2024-04-03T05:14:10.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.565+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.535__shadow_.FL8kfVTVTnRag64n5A0rO2OscG_efGb_0 2024-04-03T05:14:10.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.18134468076330770112', time=2024-04-03T06:52:44.251186+0000, chain.objs.size()=1 2024-04-03T05:14:10.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.538__shadow:LNis0Jsrgq5c7VtHBagmz5YgGpJMlBr_.HzQch8pqAgO7QWSfKYW2-cEIGuCAhi__0 2024-04-03T05:14:10.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16389397542893640062', time=2024-04-03T06:53:36.408516+0000, chain.objs.size()=1 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.545__shadow:uqvbm7ESDjleE.vx3KFVkYXEgW7.hGH_.IIt2E4ple5nX55e_4BZUxIBwgDOzj8U_0 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.5989360155692432930', time=2024-04-03T06:53:41.225186+0000, chain.objs.size()=1 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:D0rwTKpj98ZiW-sF-IBAQz15cxS1WqJ_.Tv90ww0oYWigDfTZ2-wsPEI3wQI6qRq_0 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.3270069655025810745', time=2024-04-03T06:53:50.975798+0000, chain.objs.size()=1 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.546__shadow:USrQlcGIVH-epoaXwmGwGWnBiUaMfh2_.tzZplWecK0DqujwBhOwrHzvV2Trh6HO_0 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.4895048451960612725', time=2024-04-03T06:55:23.557482+0000, chain.objs.size()=1 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:1snD2uyTkUOqod.MnGlxJW4QRRYtCqa_.b7HfqxHtVdpZW0tidqWMVvb07N0qJnm_0 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.16069346069148937465', time=2024-04-03T06:55:23.767330+0000, chain.objs.size()=1 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.548__shadow:xJH53qDuE2gJiq43yxuDRPPMLTWgZfN_.q0dom5NewpyPHmm9kDs6H2akDbVMbwo_0 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.12121874811173565703', time=2024-04-03T07:00:17.600706+0000, chain.objs.size()=12 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__multipart_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.1 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__shadow_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.1_1 2024-04-03T05:14:10.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__multipart_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.2 2024-04-03T05:14:10.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.569+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__shadow_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.2_1 2024-04-03T05:14:10.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__multipart_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.3 2024-04-03T05:14:10.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__shadow_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.3_1 2024-04-03T05:14:10.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__multipart_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.4 2024-04-03T05:14:10.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__shadow_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.4_1 2024-04-03T05:14:10.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__multipart_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.5 2024-04-03T05:14:10.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__shadow_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.5_1 2024-04-03T05:14:10.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__multipart_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.6 2024-04-03T05:14:10.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.590__shadow_multipart_enc.2~9ioAqp0F30zdhraWBsfkzqWGLF7eH2E.6_1 2024-04-03T05:14:10.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 20 garbage collection: RGWGC::process iterating over entry tag='87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.9209465410188048818', time=2024-04-03T07:05:04.511882+0000, chain.objs.size()=1 2024-04-03T05:14:10.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.573+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:87e710bc-6ab8-4bc9-b5e4-c80563afdb7d.4514.674__shadow_.h2DNatFx8dD_4SYAyBEEeD2JwoAYWRT_0 2024-04-03T05:14:10.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.581+0000 7efe1d9f3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-03T05:14:10.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.585+0000 7efcd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-03T05:14:10.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.585+0000 7efe1d9f3980 20 remove_watcher() i=0 2024-04-03T05:14:10.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.585+0000 7efe1d9f3980 2 removed watcher, disabling cache 2024-04-03T05:14:10.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.589+0000 7efe1d9f3980 20 remove_watcher() i=1 2024-04-03T05:14:10.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.589+0000 7efe1d9f3980 20 remove_watcher() i=2 2024-04-03T05:14:10.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.589+0000 7efe1d9f3980 20 remove_watcher() i=3 2024-04-03T05:14:10.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.589+0000 7efe1d9f3980 20 remove_watcher() i=4 2024-04-03T05:14:10.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.593+0000 7efe1d9f3980 20 remove_watcher() i=5 2024-04-03T05:14:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.593+0000 7efe1d9f3980 20 remove_watcher() i=6 2024-04-03T05:14:10.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-04-03T05:14:10.593+0000 7efe1d9f3980 20 remove_watcher() i=7 2024-04-03T05:14:10.612 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-04-03T05:14:10.623 DEBUG:teuthology.orchestra.run.smithi104:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-04-03T05:14:10.658 DEBUG:teuthology.orchestra.run.smithi104:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-04-03T05:14:10.705 DEBUG:teuthology.orchestra.run.smithi104:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-04-03T05:14:10.754 DEBUG:teuthology.orchestra.run.smithi104:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-04-03T05:14:10.801 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-04-03T05:14:10.858 DEBUG:teuthology.orchestra.run.smithi104:> sudo update-ca-certificates 2024-04-03T05:14:10.918 INFO:teuthology.orchestra.run.smithi104.stdout:Updating certificates in /etc/ssl/certs... 2024-04-03T05:14:11.249 INFO:teuthology.orchestra.run.smithi104.stdout:0 added, 0 removed; done. 2024-04-03T05:14:11.249 INFO:teuthology.orchestra.run.smithi104.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-04-03T05:14:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:14:11.422 INFO:teuthology.orchestra.run.smithi104.stdout:done. 2024-04-03T05:14:11.422 INFO:teuthology.orchestra.run.smithi104.stdout:done. 2024-04-03T05:14:11.425 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-03T05:14:11.436 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-03T05:14:11.436 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-03T05:14:11.812 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:14:11.826 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-03T05:14:11.828 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":3138,"stamp":"2024-04-03T05:14:10.526683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":801832096,"num_objects":4124,"num_object_clones":0,"num_object_copies":11888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4124,"num_whiteouts":0,"num_read":260377,"num_read_kb":3177867,"num_write":159049,"num_write_kb":2577746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":158,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14907,"ondisk_log_size":14907,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3041380,"kb_used_data":1506188,"kb_used_omap":12,"kb_used_meta":1534771,"kb_avail":751933340,"statfs":{"total":773094113280,"available":769979740160,"internally_reserved":0,"allocated":1542336512,"data_stored":1525680243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1571606067},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-168169908,"num_objects":-906,"num_object_clones":0,"num_object_copies":-2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-906,"num_whiteouts":0,"num_read":1307,"num_read_kb":1332,"num_write":999,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009154"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.638663+0000","last_change":"2024-04-03T04:18:51.297907+0000","last_active":"2024-04-03T05:11:23.638663+0000","last_peered":"2024-04-03T05:11:23.638663+0000","last_clean":"2024-04-03T05:11:23.638663+0000","last_became_active":"2024-04-03T04:18:51.297066+0000","last_became_peered":"2024-04-03T04:18:51.297066+0000","last_unstale":"2024-04-03T05:11:23.638663+0000","last_undegraded":"2024-04-03T05:11:23.638663+0000","last_fullsized":"2024-04-03T05:11:23.638663+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:40:36.577637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"258'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831108+0000","last_change":"2024-04-03T03:55:53.275728+0000","last_active":"2024-04-03T05:10:52.831108+0000","last_peered":"2024-04-03T05:10:52.831108+0000","last_clean":"2024-04-03T05:10:52.831108+0000","last_became_active":"2024-04-03T03:55:53.274262+0000","last_became_peered":"2024-04-03T03:55:53.274262+0000","last_unstale":"2024-04-03T05:10:52.831108+0000","last_undegraded":"2024-04-03T05:10:52.831108+0000","last_fullsized":"2024-04-03T05:10:52.831108+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:48:37.046795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'1","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:07.839562+0000","last_change":"2024-04-03T03:55:45.808629+0000","last_active":"2024-04-03T05:12:07.839562+0000","last_peered":"2024-04-03T05:12:07.839562+0000","last_clean":"2024-04-03T05:12:07.839562+0000","last_became_active":"2024-04-03T03:55:45.807880+0000","last_became_peered":"2024-04-03T03:55:45.807880+0000","last_unstale":"2024-04-03T05:12:07.839562+0000","last_undegraded":"2024-04-03T05:12:07.839562+0000","last_fullsized":"2024-04-03T05:12:07.839562+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:07:02.590954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"263'26","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.051193+0000","last_change":"2024-04-03T03:49:00.988224+0000","last_active":"2024-04-03T05:10:18.051193+0000","last_peered":"2024-04-03T05:10:18.051193+0000","last_clean":"2024-04-03T05:10:18.051193+0000","last_became_active":"2024-04-03T03:49:00.987495+0000","last_became_peered":"2024-04-03T03:49:00.987495+0000","last_unstale":"2024-04-03T05:10:18.051193+0000","last_undegraded":"2024-04-03T05:10:18.051193+0000","last_fullsized":"2024-04-03T05:10:18.051193+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:22:00.449054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":70,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.833310+0000","last_change":"2024-04-03T04:18:51.320955+0000","last_active":"2024-04-03T05:11:23.833310+0000","last_peered":"2024-04-03T05:11:23.833310+0000","last_clean":"2024-04-03T05:11:23.833310+0000","last_became_active":"2024-04-03T04:18:51.320118+0000","last_became_peered":"2024-04-03T04:18:51.320118+0000","last_unstale":"2024-04-03T05:11:23.833310+0000","last_undegraded":"2024-04-03T05:11:23.833310+0000","last_fullsized":"2024-04-03T05:11:23.833310+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:36:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014658+0000","last_change":"2024-04-03T03:55:53.242225+0000","last_active":"2024-04-03T05:10:53.014658+0000","last_peered":"2024-04-03T05:10:53.014658+0000","last_clean":"2024-04-03T05:10:53.014658+0000","last_became_active":"2024-04-03T03:55:53.238473+0000","last_became_peered":"2024-04-03T03:55:53.238473+0000","last_unstale":"2024-04-03T05:10:53.014658+0000","last_undegraded":"2024-04-03T05:10:53.014658+0000","last_fullsized":"2024-04-03T05:10:53.014658+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:31:29.585032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"258'3","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.058060+0000","last_change":"2024-04-03T03:55:45.833198+0000","last_active":"2024-04-03T05:10:48.058060+0000","last_peered":"2024-04-03T05:10:48.058060+0000","last_clean":"2024-04-03T05:10:48.058060+0000","last_became_active":"2024-04-03T03:55:45.831610+0000","last_became_peered":"2024-04-03T03:55:45.831610+0000","last_unstale":"2024-04-03T05:10:48.058060+0000","last_undegraded":"2024-04-03T05:10:48.058060+0000","last_fullsized":"2024-04-03T05:10:48.058060+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:02:23.178186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"263'35","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:28.066849+0000","last_change":"2024-04-03T03:49:00.989569+0000","last_active":"2024-04-03T05:11:28.066849+0000","last_peered":"2024-04-03T05:11:28.066849+0000","last_clean":"2024-04-03T05:11:28.066849+0000","last_became_active":"2024-04-03T03:49:00.988912+0000","last_became_peered":"2024-04-03T03:49:00.988912+0000","last_unstale":"2024-04-03T05:11:28.066849+0000","last_undegraded":"2024-04-03T05:11:28.066849+0000","last_fullsized":"2024-04-03T05:11:28.066849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:44:30.947197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.018230+0000","last_change":"2024-04-03T04:18:51.365311+0000","last_active":"2024-04-03T05:11:08.018230+0000","last_peered":"2024-04-03T05:11:08.018230+0000","last_clean":"2024-04-03T05:11:08.018230+0000","last_became_active":"2024-04-03T04:18:51.364557+0000","last_became_peered":"2024-04-03T04:18:51.364557+0000","last_unstale":"2024-04-03T05:11:08.018230+0000","last_undegraded":"2024-04-03T05:11:08.018230+0000","last_fullsized":"2024-04-03T05:11:08.018230+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:32:56.588645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.659100+0000","last_change":"2024-04-03T03:55:53.269902+0000","last_active":"2024-04-03T05:12:58.659100+0000","last_peered":"2024-04-03T05:12:58.659100+0000","last_clean":"2024-04-03T05:12:58.659100+0000","last_became_active":"2024-04-03T03:55:53.269276+0000","last_became_peered":"2024-04-03T03:55:53.269276+0000","last_unstale":"2024-04-03T05:12:58.659100+0000","last_undegraded":"2024-04-03T05:12:58.659100+0000","last_fullsized":"2024-04-03T05:12:58.659100+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:15:06.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'6","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013335+0000","last_change":"2024-04-03T03:55:45.823314+0000","last_active":"2024-04-03T05:10:48.013335+0000","last_peered":"2024-04-03T05:10:48.013335+0000","last_clean":"2024-04-03T05:10:48.013335+0000","last_became_active":"2024-04-03T03:55:45.822526+0000","last_became_peered":"2024-04-03T03:55:45.822526+0000","last_unstale":"2024-04-03T05:10:48.013335+0000","last_undegraded":"2024-04-03T05:10:48.013335+0000","last_fullsized":"2024-04-03T05:10:48.013335+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:47:58.846580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":12606,"num_write":11,"num_write_kb":9534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:34.041215+0000","last_change":"2024-04-03T03:49:00.993012+0000","last_active":"2024-04-03T05:11:34.041215+0000","last_peered":"2024-04-03T05:11:34.041215+0000","last_clean":"2024-04-03T05:11:34.041215+0000","last_became_active":"2024-04-03T03:49:00.992254+0000","last_became_peered":"2024-04-03T03:49:00.992254+0000","last_unstale":"2024-04-03T05:11:34.041215+0000","last_undegraded":"2024-04-03T05:11:34.041215+0000","last_fullsized":"2024-04-03T05:11:34.041215+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:16.501916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":101,"num_write":55,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060573+0000","last_change":"2024-04-03T04:18:51.373813+0000","last_active":"2024-04-03T05:10:58.060573+0000","last_peered":"2024-04-03T05:10:58.060573+0000","last_clean":"2024-04-03T05:10:58.060573+0000","last_became_active":"2024-04-03T04:18:51.373051+0000","last_became_peered":"2024-04-03T04:18:51.373051+0000","last_unstale":"2024-04-03T05:10:58.060573+0000","last_undegraded":"2024-04-03T05:10:58.060573+0000","last_fullsized":"2024-04-03T05:10:58.060573+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:25:49.915796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'1","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.815198+0000","last_change":"2024-04-03T03:55:53.276078+0000","last_active":"2024-04-03T05:10:12.815198+0000","last_peered":"2024-04-03T05:10:12.815198+0000","last_clean":"2024-04-03T05:10:12.815198+0000","last_became_active":"2024-04-03T03:55:53.274825+0000","last_became_peered":"2024-04-03T03:55:53.274825+0000","last_unstale":"2024-04-03T05:10:12.815198+0000","last_undegraded":"2024-04-03T05:10:12.815198+0000","last_fullsized":"2024-04-03T05:10:12.815198+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:54:31.500440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.057924+0000","last_change":"2024-04-03T03:55:45.810413+0000","last_active":"2024-04-03T05:10:48.057924+0000","last_peered":"2024-04-03T05:10:48.057924+0000","last_clean":"2024-04-03T05:10:48.057924+0000","last_became_active":"2024-04-03T03:55:45.809649+0000","last_became_peered":"2024-04-03T03:55:45.809649+0000","last_unstale":"2024-04-03T05:10:48.057924+0000","last_undegraded":"2024-04-03T05:10:48.057924+0000","last_fullsized":"2024-04-03T05:10:48.057924+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:07:31.286451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"263'106","reported_seq":376,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:32.844991+0000","last_change":"2024-04-03T03:49:00.991120+0000","last_active":"2024-04-03T05:11:32.844991+0000","last_peered":"2024-04-03T05:11:32.844991+0000","last_clean":"2024-04-03T05:11:32.844991+0000","last_became_active":"2024-04-03T03:49:00.990318+0000","last_became_peered":"2024-04-03T03:49:00.990318+0000","last_unstale":"2024-04-03T05:11:32.844991+0000","last_undegraded":"2024-04-03T05:11:32.844991+0000","last_fullsized":"2024-04-03T05:11:32.844991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:40:07.793280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":587,"num_read_kb":421,"num_write":142,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:38.988696+0000","last_change":"2024-04-03T04:18:51.317587+0000","last_active":"2024-04-03T05:09:38.988696+0000","last_peered":"2024-04-03T05:09:38.988696+0000","last_clean":"2024-04-03T05:09:38.988696+0000","last_became_active":"2024-04-03T04:18:51.316328+0000","last_became_peered":"2024-04-03T04:18:51.316328+0000","last_unstale":"2024-04-03T05:09:38.988696+0000","last_undegraded":"2024-04-03T05:09:38.988696+0000","last_fullsized":"2024-04-03T05:09:38.988696+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:59:54.383193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.950586+0000","last_change":"2024-04-03T03:55:53.252686+0000","last_active":"2024-04-03T05:14:07.950586+0000","last_peered":"2024-04-03T05:14:07.950586+0000","last_clean":"2024-04-03T05:14:07.950586+0000","last_became_active":"2024-04-03T03:55:53.251965+0000","last_became_peered":"2024-04-03T03:55:53.251965+0000","last_unstale":"2024-04-03T05:14:07.950586+0000","last_undegraded":"2024-04-03T05:14:07.950586+0000","last_fullsized":"2024-04-03T05:14:07.950586+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:11:31.485683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4667,"num_write":4,"num_write_kb":4667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:19.040963+0000","last_change":"2024-04-03T03:55:45.811812+0000","last_active":"2024-04-03T05:13:19.040963+0000","last_peered":"2024-04-03T05:13:19.040963+0000","last_clean":"2024-04-03T05:13:19.040963+0000","last_became_active":"2024-04-03T03:55:45.811051+0000","last_became_peered":"2024-04-03T03:55:45.811051+0000","last_unstale":"2024-04-03T05:13:19.040963+0000","last_undegraded":"2024-04-03T05:13:19.040963+0000","last_fullsized":"2024-04-03T05:13:19.040963+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:29:56.079808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"263'6","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:32.844932+0000","last_change":"2024-04-03T03:49:00.990124+0000","last_active":"2024-04-03T05:11:32.844932+0000","last_peered":"2024-04-03T05:11:32.844932+0000","last_clean":"2024-04-03T05:11:32.844932+0000","last_became_active":"2024-04-03T03:49:00.989383+0000","last_became_peered":"2024-04-03T03:49:00.989383+0000","last_unstale":"2024-04-03T05:11:32.844932+0000","last_undegraded":"2024-04-03T05:11:32.844932+0000","last_fullsized":"2024-04-03T05:11:32.844932+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:51:07.689068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:53.812847+0000","last_change":"2024-04-03T04:18:51.318126+0000","last_active":"2024-04-03T05:09:53.812847+0000","last_peered":"2024-04-03T05:09:53.812847+0000","last_clean":"2024-04-03T05:09:53.812847+0000","last_became_active":"2024-04-03T04:18:51.317417+0000","last_became_peered":"2024-04-03T04:18:51.317417+0000","last_unstale":"2024-04-03T05:09:53.812847+0000","last_undegraded":"2024-04-03T05:09:53.812847+0000","last_fullsized":"2024-04-03T05:09:53.812847+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:40:19.565316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"258'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.057729+0000","last_change":"2024-04-03T03:55:53.251802+0000","last_active":"2024-04-03T05:10:48.057729+0000","last_peered":"2024-04-03T05:10:48.057729+0000","last_clean":"2024-04-03T05:10:48.057729+0000","last_became_active":"2024-04-03T03:55:53.250769+0000","last_became_peered":"2024-04-03T03:55:53.250769+0000","last_unstale":"2024-04-03T05:10:48.057729+0000","last_undegraded":"2024-04-03T05:10:48.057729+0000","last_fullsized":"2024-04-03T05:10:48.057729+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:22:00.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013249+0000","last_change":"2024-04-03T03:55:45.821907+0000","last_active":"2024-04-03T05:10:48.013249+0000","last_peered":"2024-04-03T05:10:48.013249+0000","last_clean":"2024-04-03T05:10:48.013249+0000","last_became_active":"2024-04-03T03:55:45.821160+0000","last_became_peered":"2024-04-03T03:55:45.821160+0000","last_unstale":"2024-04-03T05:10:48.013249+0000","last_undegraded":"2024-04-03T05:10:48.013249+0000","last_fullsized":"2024-04-03T05:10:48.013249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:35:53.921787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"263'66","reported_seq":279,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:34.041123+0000","last_change":"2024-04-03T03:49:00.994955+0000","last_active":"2024-04-03T05:11:34.041123+0000","last_peered":"2024-04-03T05:11:34.041123+0000","last_clean":"2024-04-03T05:11:34.041123+0000","last_became_active":"2024-04-03T03:49:00.994321+0000","last_became_peered":"2024-04-03T03:49:00.994321+0000","last_unstale":"2024-04-03T05:11:34.041123+0000","last_undegraded":"2024-04-03T05:11:34.041123+0000","last_fullsized":"2024-04-03T05:11:34.041123+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:04:59.985722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":300,"num_write":80,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.021856+0000","last_change":"2024-04-03T04:18:51.312623+0000","last_active":"2024-04-03T05:11:23.021856+0000","last_peered":"2024-04-03T05:11:23.021856+0000","last_clean":"2024-04-03T05:11:23.021856+0000","last_became_active":"2024-04-03T04:18:51.311870+0000","last_became_peered":"2024-04-03T04:18:51.311870+0000","last_unstale":"2024-04-03T05:11:23.021856+0000","last_undegraded":"2024-04-03T05:11:23.021856+0000","last_fullsized":"2024-04-03T05:11:23.021856+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:38:54.851895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.059027+0000","last_change":"2024-04-03T03:55:53.242608+0000","last_active":"2024-04-03T05:10:53.059027+0000","last_peered":"2024-04-03T05:10:53.059027+0000","last_clean":"2024-04-03T05:10:53.059027+0000","last_became_active":"2024-04-03T03:55:53.241200+0000","last_became_peered":"2024-04-03T03:55:53.241200+0000","last_unstale":"2024-04-03T05:10:53.059027+0000","last_undegraded":"2024-04-03T05:10:53.059027+0000","last_fullsized":"2024-04-03T05:10:53.059027+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:46:17.515799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'8","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.828861+0000","last_change":"2024-04-03T03:55:45.836536+0000","last_active":"2024-04-03T05:10:42.828861+0000","last_peered":"2024-04-03T05:10:42.828861+0000","last_clean":"2024-04-03T05:10:42.828861+0000","last_became_active":"2024-04-03T03:55:45.835828+0000","last_became_peered":"2024-04-03T03:55:45.835828+0000","last_unstale":"2024-04-03T05:10:42.828861+0000","last_undegraded":"2024-04-03T05:10:42.828861+0000","last_fullsized":"2024-04-03T05:10:42.828861+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:34:15.514688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291305,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":7,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"263'59","reported_seq":210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:33.023899+0000","last_change":"2024-04-03T03:49:00.989070+0000","last_active":"2024-04-03T05:11:33.023899+0000","last_peered":"2024-04-03T05:11:33.023899+0000","last_clean":"2024-04-03T05:11:33.023899+0000","last_became_active":"2024-04-03T03:49:00.988327+0000","last_became_peered":"2024-04-03T03:49:00.988327+0000","last_unstale":"2024-04-03T05:11:33.023899+0000","last_undegraded":"2024-04-03T05:11:33.023899+0000","last_fullsized":"2024-04-03T05:11:33.023899+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:24:56.998629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":175,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012373+0000","last_change":"2024-04-03T04:18:51.307288+0000","last_active":"2024-04-03T05:11:24.012373+0000","last_peered":"2024-04-03T05:11:24.012373+0000","last_clean":"2024-04-03T05:11:24.012373+0000","last_became_active":"2024-04-03T04:18:51.299249+0000","last_became_peered":"2024-04-03T04:18:51.299249+0000","last_unstale":"2024-04-03T05:11:24.012373+0000","last_undegraded":"2024-04-03T05:11:24.012373+0000","last_fullsized":"2024-04-03T05:11:24.012373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:30:50.463422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631815+0000","last_change":"2024-04-03T03:55:53.278378+0000","last_active":"2024-04-03T05:10:53.631815+0000","last_peered":"2024-04-03T05:10:53.631815+0000","last_clean":"2024-04-03T05:10:53.631815+0000","last_became_active":"2024-04-03T03:55:53.277505+0000","last_became_peered":"2024-04-03T03:55:53.277505+0000","last_unstale":"2024-04-03T05:10:53.631815+0000","last_undegraded":"2024-04-03T05:10:53.631815+0000","last_fullsized":"2024-04-03T05:10:53.631815+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:20:26.901761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"258'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062645+0000","last_change":"2024-04-03T03:55:45.820242+0000","last_active":"2024-04-03T05:11:08.062645+0000","last_peered":"2024-04-03T05:11:08.062645+0000","last_clean":"2024-04-03T05:11:08.062645+0000","last_became_active":"2024-04-03T03:55:45.811093+0000","last_became_peered":"2024-04-03T03:55:45.811093+0000","last_unstale":"2024-04-03T05:11:08.062645+0000","last_undegraded":"2024-04-03T05:11:08.062645+0000","last_fullsized":"2024-04-03T05:11:08.062645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:19:41.634825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:13.831105+0000","last_change":"2024-04-03T03:49:00.974095+0000","last_active":"2024-04-03T05:11:13.831105+0000","last_peered":"2024-04-03T05:11:13.831105+0000","last_clean":"2024-04-03T05:11:13.831105+0000","last_became_active":"2024-04-03T03:49:00.973216+0000","last_became_peered":"2024-04-03T03:49:00.973216+0000","last_unstale":"2024-04-03T05:11:13.831105+0000","last_undegraded":"2024-04-03T05:11:13.831105+0000","last_fullsized":"2024-04-03T05:11:13.831105+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:37:20.222939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"260'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056727+0000","last_change":"2024-04-03T04:19:00.383020+0000","last_active":"2024-04-03T05:10:43.056727+0000","last_peered":"2024-04-03T05:10:43.056727+0000","last_clean":"2024-04-03T05:10:43.056727+0000","last_became_active":"2024-04-03T04:19:00.377208+0000","last_became_peered":"2024-04-03T04:19:00.377208+0000","last_unstale":"2024-04-03T05:10:43.056727+0000","last_undegraded":"2024-04-03T05:10:43.056727+0000","last_fullsized":"2024-04-03T05:10:43.056727+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:44.601663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:14.063888+0000","last_change":"2024-04-03T03:55:53.258982+0000","last_active":"2024-04-03T05:13:14.063888+0000","last_peered":"2024-04-03T05:13:14.063888+0000","last_clean":"2024-04-03T05:13:14.063888+0000","last_became_active":"2024-04-03T03:55:53.258699+0000","last_became_peered":"2024-04-03T03:55:53.258699+0000","last_unstale":"2024-04-03T05:13:14.063888+0000","last_undegraded":"2024-04-03T05:13:14.063888+0000","last_fullsized":"2024-04-03T05:13:14.063888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:38:05.039097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'4","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.012109+0000","last_change":"2024-04-03T03:55:45.837044+0000","last_active":"2024-04-03T05:10:43.012109+0000","last_peered":"2024-04-03T05:10:43.012109+0000","last_clean":"2024-04-03T05:10:43.012109+0000","last_became_active":"2024-04-03T03:55:45.831660+0000","last_became_peered":"2024-04-03T03:55:45.831660+0000","last_unstale":"2024-04-03T05:10:43.012109+0000","last_undegraded":"2024-04-03T05:10:43.012109+0000","last_fullsized":"2024-04-03T05:10:43.012109+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:28:51.321618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5691,"num_write":4,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"263'39","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:14.010323+0000","last_change":"2024-04-03T03:49:00.969632+0000","last_active":"2024-04-03T05:11:14.010323+0000","last_peered":"2024-04-03T05:11:14.010323+0000","last_clean":"2024-04-03T05:11:14.010323+0000","last_became_active":"2024-04-03T03:49:00.968902+0000","last_became_peered":"2024-04-03T03:49:00.968902+0000","last_unstale":"2024-04-03T05:11:14.010323+0000","last_undegraded":"2024-04-03T05:11:14.010323+0000","last_fullsized":"2024-04-03T05:11:14.010323+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:23.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":106,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:37.996691+0000","last_change":"2024-04-03T04:18:51.368008+0000","last_active":"2024-04-03T05:09:37.996691+0000","last_peered":"2024-04-03T05:09:37.996691+0000","last_clean":"2024-04-03T05:09:37.996691+0000","last_became_active":"2024-04-03T04:18:51.367290+0000","last_became_peered":"2024-04-03T04:18:51.367290+0000","last_unstale":"2024-04-03T05:09:37.996691+0000","last_undegraded":"2024-04-03T05:09:37.996691+0000","last_fullsized":"2024-04-03T05:09:37.996691+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:43.727578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.827724+0000","last_change":"2024-04-03T03:55:53.249249+0000","last_active":"2024-04-03T05:10:58.827724+0000","last_peered":"2024-04-03T05:10:58.827724+0000","last_clean":"2024-04-03T05:10:58.827724+0000","last_became_active":"2024-04-03T03:55:53.247541+0000","last_became_peered":"2024-04-03T03:55:53.247541+0000","last_unstale":"2024-04-03T05:10:58.827724+0000","last_undegraded":"2024-04-03T05:10:58.827724+0000","last_fullsized":"2024-04-03T05:10:58.827724+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:08.778733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"258'4","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056828+0000","last_change":"2024-04-03T03:55:45.820738+0000","last_active":"2024-04-03T05:10:43.056828+0000","last_peered":"2024-04-03T05:10:43.056828+0000","last_clean":"2024-04-03T05:10:43.056828+0000","last_became_active":"2024-04-03T03:55:45.819664+0000","last_became_peered":"2024-04-03T03:55:45.819664+0000","last_unstale":"2024-04-03T05:10:43.056828+0000","last_undegraded":"2024-04-03T05:10:43.056828+0000","last_fullsized":"2024-04-03T05:10:43.056828+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:03:06.968618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"263'13","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.840880+0000","last_change":"2024-04-03T03:49:00.962589+0000","last_active":"2024-04-03T05:11:12.840880+0000","last_peered":"2024-04-03T05:11:12.840880+0000","last_clean":"2024-04-03T05:11:12.840880+0000","last_became_active":"2024-04-03T03:49:00.961782+0000","last_became_peered":"2024-04-03T03:49:00.961782+0000","last_unstale":"2024-04-03T05:11:12.840880+0000","last_undegraded":"2024-04-03T05:11:12.840880+0000","last_fullsized":"2024-04-03T05:11:12.840880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:41:35.535598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:38.614737+0000","last_change":"2024-04-03T04:18:51.305071+0000","last_active":"2024-04-03T05:09:38.614737+0000","last_peered":"2024-04-03T05:09:38.614737+0000","last_clean":"2024-04-03T05:09:38.614737+0000","last_became_active":"2024-04-03T04:18:51.304323+0000","last_became_peered":"2024-04-03T04:18:51.304323+0000","last_unstale":"2024-04-03T05:09:38.614737+0000","last_undegraded":"2024-04-03T05:09:38.614737+0000","last_fullsized":"2024-04-03T05:09:38.614737+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:18.815723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'8","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:13.091218+0000","last_change":"2024-04-03T03:55:53.260481+0000","last_active":"2024-04-03T05:13:13.091218+0000","last_peered":"2024-04-03T05:13:13.091218+0000","last_clean":"2024-04-03T05:13:13.091218+0000","last_became_active":"2024-04-03T03:55:53.255231+0000","last_became_peered":"2024-04-03T03:55:53.255231+0000","last_unstale":"2024-04-03T05:13:13.091218+0000","last_undegraded":"2024-04-03T05:13:13.091218+0000","last_fullsized":"2024-04-03T05:13:13.091218+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:02:58.467385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.031015+0000","last_change":"2024-04-03T03:55:45.830178+0000","last_active":"2024-04-03T05:10:49.031015+0000","last_peered":"2024-04-03T05:10:49.031015+0000","last_clean":"2024-04-03T05:10:49.031015+0000","last_became_active":"2024-04-03T03:55:45.829412+0000","last_became_peered":"2024-04-03T03:55:45.829412+0000","last_unstale":"2024-04-03T05:10:49.031015+0000","last_undegraded":"2024-04-03T05:10:49.031015+0000","last_fullsized":"2024-04-03T05:10:49.031015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:56.123646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"263'19","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.828392+0000","last_change":"2024-04-03T03:49:00.983727+0000","last_active":"2024-04-03T05:11:12.828392+0000","last_peered":"2024-04-03T05:11:12.828392+0000","last_clean":"2024-04-03T05:11:12.828392+0000","last_became_active":"2024-04-03T03:49:00.981577+0000","last_became_peered":"2024-04-03T03:49:00.981577+0000","last_unstale":"2024-04-03T05:11:12.828392+0000","last_undegraded":"2024-04-03T05:11:12.828392+0000","last_fullsized":"2024-04-03T05:11:12.828392+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:30.772410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:37.996724+0000","last_change":"2024-04-03T04:18:51.373777+0000","last_active":"2024-04-03T05:09:37.996724+0000","last_peered":"2024-04-03T05:09:37.996724+0000","last_clean":"2024-04-03T05:09:37.996724+0000","last_became_active":"2024-04-03T04:18:51.372963+0000","last_became_peered":"2024-04-03T04:18:51.372963+0000","last_unstale":"2024-04-03T05:09:37.996724+0000","last_undegraded":"2024-04-03T05:09:37.996724+0000","last_fullsized":"2024-04-03T05:09:37.996724+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:47:59.061915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.823126+0000","last_change":"2024-04-03T03:55:53.270124+0000","last_active":"2024-04-03T05:10:47.823126+0000","last_peered":"2024-04-03T05:10:47.823126+0000","last_clean":"2024-04-03T05:10:47.823126+0000","last_became_active":"2024-04-03T03:55:53.268903+0000","last_became_peered":"2024-04-03T03:55:53.268903+0000","last_unstale":"2024-04-03T05:10:47.823126+0000","last_undegraded":"2024-04-03T05:10:47.823126+0000","last_fullsized":"2024-04-03T05:10:47.823126+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:54.240436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'1","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.821604+0000","last_change":"2024-04-03T03:55:45.835558+0000","last_active":"2024-04-03T05:10:42.821604+0000","last_peered":"2024-04-03T05:10:42.821604+0000","last_clean":"2024-04-03T05:10:42.821604+0000","last_became_active":"2024-04-03T03:55:45.834865+0000","last_became_peered":"2024-04-03T03:55:45.834865+0000","last_unstale":"2024-04-03T05:10:42.821604+0000","last_undegraded":"2024-04-03T05:10:42.821604+0000","last_fullsized":"2024-04-03T05:10:42.821604+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:44:08.343281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"263'64","reported_seq":230,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:07.839335+0000","last_change":"2024-04-03T03:49:00.971740+0000","last_active":"2024-04-03T05:11:07.839335+0000","last_peered":"2024-04-03T05:11:07.839335+0000","last_clean":"2024-04-03T05:11:07.839335+0000","last_became_active":"2024-04-03T03:49:00.971042+0000","last_became_peered":"2024-04-03T03:49:00.971042+0000","last_unstale":"2024-04-03T05:11:07.839335+0000","last_undegraded":"2024-04-03T05:11:07.839335+0000","last_fullsized":"2024-04-03T05:11:07.839335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:27.210269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":214,"num_write":97,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.822413+0000","last_change":"2024-04-03T04:18:51.308665+0000","last_active":"2024-04-03T05:10:12.822413+0000","last_peered":"2024-04-03T05:10:12.822413+0000","last_clean":"2024-04-03T05:10:12.822413+0000","last_became_active":"2024-04-03T04:18:51.307933+0000","last_became_peered":"2024-04-03T04:18:51.307933+0000","last_unstale":"2024-04-03T05:10:12.822413+0000","last_undegraded":"2024-04-03T05:10:12.822413+0000","last_fullsized":"2024-04-03T05:10:12.822413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:40:38.179255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:33.009473+0000","last_change":"2024-04-03T03:55:53.267596+0000","last_active":"2024-04-03T05:10:33.009473+0000","last_peered":"2024-04-03T05:10:33.009473+0000","last_clean":"2024-04-03T05:10:33.009473+0000","last_became_active":"2024-04-03T03:55:53.266957+0000","last_became_peered":"2024-04-03T03:55:53.266957+0000","last_unstale":"2024-04-03T05:10:33.009473+0000","last_undegraded":"2024-04-03T05:10:33.009473+0000","last_fullsized":"2024-04-03T05:10:33.009473+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:59:34.273773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'1","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.053319+0000","last_change":"2024-04-03T03:55:45.830004+0000","last_active":"2024-04-03T05:10:28.053319+0000","last_peered":"2024-04-03T05:10:28.053319+0000","last_clean":"2024-04-03T05:10:28.053319+0000","last_became_active":"2024-04-03T03:55:45.829247+0000","last_became_peered":"2024-04-03T03:55:45.829247+0000","last_unstale":"2024-04-03T05:10:28.053319+0000","last_undegraded":"2024-04-03T05:10:28.053319+0000","last_fullsized":"2024-04-03T05:10:28.053319+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:09.809498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"263'66","reported_seq":227,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.821469+0000","last_change":"2024-04-03T03:49:00.991682+0000","last_active":"2024-04-03T05:10:42.821469+0000","last_peered":"2024-04-03T05:10:42.821469+0000","last_clean":"2024-04-03T05:10:42.821469+0000","last_became_active":"2024-04-03T03:49:00.990969+0000","last_became_peered":"2024-04-03T03:49:00.990969+0000","last_unstale":"2024-04-03T05:10:42.821469+0000","last_undegraded":"2024-04-03T05:10:42.821469+0000","last_fullsized":"2024-04-03T05:10:42.821469+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:40.104007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":193,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.822537+0000","last_change":"2024-04-03T04:18:51.311760+0000","last_active":"2024-04-03T05:10:12.822537+0000","last_peered":"2024-04-03T05:10:12.822537+0000","last_clean":"2024-04-03T05:10:12.822537+0000","last_became_active":"2024-04-03T04:18:51.310856+0000","last_became_peered":"2024-04-03T04:18:51.310856+0000","last_unstale":"2024-04-03T05:10:12.822537+0000","last_undegraded":"2024-04-03T05:10:12.822537+0000","last_fullsized":"2024-04-03T05:10:12.822537+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:51:40.696345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.657654+0000","last_change":"2024-04-03T03:55:53.241238+0000","last_active":"2024-04-03T05:12:53.657654+0000","last_peered":"2024-04-03T05:12:53.657654+0000","last_clean":"2024-04-03T05:12:53.657654+0000","last_became_active":"2024-04-03T03:55:53.240485+0000","last_became_peered":"2024-04-03T03:55:53.240485+0000","last_unstale":"2024-04-03T05:12:53.657654+0000","last_undegraded":"2024-04-03T05:12:53.657654+0000","last_fullsized":"2024-04-03T05:12:53.657654+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:01:44.348572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026394+0000","last_change":"2024-04-03T03:55:45.833791+0000","last_active":"2024-04-03T05:10:29.026394+0000","last_peered":"2024-04-03T05:10:29.026394+0000","last_clean":"2024-04-03T05:10:29.026394+0000","last_became_active":"2024-04-03T03:55:45.833049+0000","last_became_peered":"2024-04-03T03:55:45.833049+0000","last_unstale":"2024-04-03T05:10:29.026394+0000","last_undegraded":"2024-04-03T05:10:29.026394+0000","last_fullsized":"2024-04-03T05:10:29.026394+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:01:14.170475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"263'54","reported_seq":206,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.824123+0000","last_change":"2024-04-03T03:49:00.970056+0000","last_active":"2024-04-03T05:10:43.824123+0000","last_peered":"2024-04-03T05:10:43.824123+0000","last_clean":"2024-04-03T05:10:43.824123+0000","last_became_active":"2024-04-03T03:49:00.969239+0000","last_became_peered":"2024-04-03T03:49:00.969239+0000","last_unstale":"2024-04-03T05:10:43.824123+0000","last_undegraded":"2024-04-03T05:10:43.824123+0000","last_fullsized":"2024-04-03T05:10:43.824123+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:11:29.264574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":93,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.997173+0000","last_change":"2024-04-03T04:18:51.318533+0000","last_active":"2024-04-03T05:10:13.997173+0000","last_peered":"2024-04-03T05:10:13.997173+0000","last_clean":"2024-04-03T05:10:13.997173+0000","last_became_active":"2024-04-03T04:18:51.318231+0000","last_became_peered":"2024-04-03T04:18:51.318231+0000","last_unstale":"2024-04-03T05:10:13.997173+0000","last_undegraded":"2024-04-03T05:10:13.997173+0000","last_fullsized":"2024-04-03T05:10:13.997173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:52:18.856506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'1","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:33.821947+0000","last_change":"2024-04-03T03:55:53.279237+0000","last_active":"2024-04-03T05:10:33.821947+0000","last_peered":"2024-04-03T05:10:33.821947+0000","last_clean":"2024-04-03T05:10:33.821947+0000","last_became_active":"2024-04-03T03:55:53.278529+0000","last_became_peered":"2024-04-03T03:55:53.278529+0000","last_unstale":"2024-04-03T05:10:33.821947+0000","last_undegraded":"2024-04-03T05:10:33.821947+0000","last_fullsized":"2024-04-03T05:10:33.821947+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:28:45.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'1","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.008254+0000","last_change":"2024-04-03T03:55:45.821524+0000","last_active":"2024-04-03T05:10:28.008254+0000","last_peered":"2024-04-03T05:10:28.008254+0000","last_clean":"2024-04-03T05:10:28.008254+0000","last_became_active":"2024-04-03T03:55:45.820737+0000","last_became_peered":"2024-04-03T03:55:45.820737+0000","last_unstale":"2024-04-03T05:10:28.008254+0000","last_undegraded":"2024-04-03T05:10:28.008254+0000","last_fullsized":"2024-04-03T05:10:28.008254+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:34.782850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"263'71","reported_seq":249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.629354+0000","last_change":"2024-04-03T03:49:00.991967+0000","last_active":"2024-04-03T05:10:43.629354+0000","last_peered":"2024-04-03T05:10:43.629354+0000","last_clean":"2024-04-03T05:10:43.629354+0000","last_became_active":"2024-04-03T03:49:00.987062+0000","last_became_peered":"2024-04-03T03:49:00.987062+0000","last_unstale":"2024-04-03T05:10:43.629354+0000","last_undegraded":"2024-04-03T05:10:43.629354+0000","last_fullsized":"2024-04-03T05:10:43.629354+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:22.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":233,"num_write":115,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.004757+0000","last_change":"2024-04-03T04:18:51.320211+0000","last_active":"2024-04-03T05:10:13.004757+0000","last_peered":"2024-04-03T05:10:13.004757+0000","last_clean":"2024-04-03T05:10:13.004757+0000","last_became_active":"2024-04-03T04:18:51.319383+0000","last_became_peered":"2024-04-03T04:18:51.319383+0000","last_unstale":"2024-04-03T05:10:13.004757+0000","last_undegraded":"2024-04-03T05:10:13.004757+0000","last_fullsized":"2024-04-03T05:10:13.004757+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:36:49.544317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'8","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:34.001324+0000","last_change":"2024-04-03T03:55:53.280600+0000","last_active":"2024-04-03T05:10:34.001324+0000","last_peered":"2024-04-03T05:10:34.001324+0000","last_clean":"2024-04-03T05:10:34.001324+0000","last_became_active":"2024-04-03T03:55:53.279910+0000","last_became_peered":"2024-04-03T03:55:53.279910+0000","last_unstale":"2024-04-03T05:10:34.001324+0000","last_undegraded":"2024-04-03T05:10:34.001324+0000","last_fullsized":"2024-04-03T05:10:34.001324+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:59.801920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'6","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:48.656558+0000","last_change":"2024-04-03T03:55:45.841365+0000","last_active":"2024-04-03T05:12:48.656558+0000","last_peered":"2024-04-03T05:12:48.656558+0000","last_clean":"2024-04-03T05:12:48.656558+0000","last_became_active":"2024-04-03T03:55:45.840884+0000","last_became_peered":"2024-04-03T03:55:45.840884+0000","last_unstale":"2024-04-03T05:12:48.656558+0000","last_undegraded":"2024-04-03T05:12:48.656558+0000","last_fullsized":"2024-04-03T05:12:48.656558+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:16:08.781831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"263'34","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.011805+0000","last_change":"2024-04-03T03:49:00.967711+0000","last_active":"2024-04-03T05:10:43.011805+0000","last_peered":"2024-04-03T05:10:43.011805+0000","last_clean":"2024-04-03T05:10:43.011805+0000","last_became_active":"2024-04-03T03:49:00.966982+0000","last_became_peered":"2024-04-03T03:49:00.966982+0000","last_unstale":"2024-04-03T05:10:43.011805+0000","last_undegraded":"2024-04-03T05:10:43.011805+0000","last_fullsized":"2024-04-03T05:10:43.011805+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:56.610313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"261'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010784+0000","last_change":"2024-04-03T04:18:51.315214+0000","last_active":"2024-04-03T05:10:38.010784+0000","last_peered":"2024-04-03T05:10:38.010784+0000","last_clean":"2024-04-03T05:10:38.010784+0000","last_became_active":"2024-04-03T04:18:51.314416+0000","last_became_peered":"2024-04-03T04:18:51.314416+0000","last_unstale":"2024-04-03T05:10:38.010784+0000","last_undegraded":"2024-04-03T05:10:38.010784+0000","last_fullsized":"2024-04-03T05:10:38.010784+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:02.075238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'7","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:07.814110+0000","last_change":"2024-04-03T03:55:53.248818+0000","last_active":"2024-04-03T05:10:07.814110+0000","last_peered":"2024-04-03T05:10:07.814110+0000","last_clean":"2024-04-03T05:10:07.814110+0000","last_became_active":"2024-04-03T03:55:53.248092+0000","last_became_peered":"2024-04-03T03:55:53.248092+0000","last_unstale":"2024-04-03T05:10:07.814110+0000","last_undegraded":"2024-04-03T05:10:07.814110+0000","last_fullsized":"2024-04-03T05:10:07.814110+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:20:29.850186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"258'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.815188+0000","last_change":"2024-04-03T03:55:45.830497+0000","last_active":"2024-04-03T05:10:03.815188+0000","last_peered":"2024-04-03T05:10:03.815188+0000","last_clean":"2024-04-03T05:10:03.815188+0000","last_became_active":"2024-04-03T03:55:45.829835+0000","last_became_peered":"2024-04-03T03:55:45.829835+0000","last_unstale":"2024-04-03T05:10:03.815188+0000","last_undegraded":"2024-04-03T05:10:03.815188+0000","last_fullsized":"2024-04-03T05:10:03.815188+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:42.544072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"263'30","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.820973+0000","last_change":"2024-04-03T03:49:00.984614+0000","last_active":"2024-04-03T05:10:28.820973+0000","last_peered":"2024-04-03T05:10:28.820973+0000","last_clean":"2024-04-03T05:10:28.820973+0000","last_became_active":"2024-04-03T03:49:00.983761+0000","last_became_peered":"2024-04-03T03:49:00.983761+0000","last_unstale":"2024-04-03T05:10:28.820973+0000","last_undegraded":"2024-04-03T05:10:28.820973+0000","last_fullsized":"2024-04-03T05:10:28.820973+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:55:59.720764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010837+0000","last_change":"2024-04-03T04:18:51.320209+0000","last_active":"2024-04-03T05:10:38.010837+0000","last_peered":"2024-04-03T05:10:38.010837+0000","last_clean":"2024-04-03T05:10:38.010837+0000","last_became_active":"2024-04-03T04:18:51.319470+0000","last_became_peered":"2024-04-03T04:18:51.319470+0000","last_unstale":"2024-04-03T05:10:38.010837+0000","last_undegraded":"2024-04-03T05:10:38.010837+0000","last_fullsized":"2024-04-03T05:10:38.010837+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:33:04.413239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'7","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:24.052556+0000","last_change":"2024-04-03T03:55:53.258437+0000","last_active":"2024-04-03T05:12:24.052556+0000","last_peered":"2024-04-03T05:12:24.052556+0000","last_clean":"2024-04-03T05:12:24.052556+0000","last_became_active":"2024-04-03T03:55:53.257856+0000","last_became_peered":"2024-04-03T03:55:53.257856+0000","last_unstale":"2024-04-03T05:12:24.052556+0000","last_undegraded":"2024-04-03T05:12:24.052556+0000","last_fullsized":"2024-04-03T05:12:24.052556+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:11:30.203783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":16434,"num_write":11,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'11","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.007285+0000","last_change":"2024-04-03T03:55:45.835655+0000","last_active":"2024-04-03T05:10:23.007285+0000","last_peered":"2024-04-03T05:10:23.007285+0000","last_clean":"2024-04-03T05:10:23.007285+0000","last_became_active":"2024-04-03T03:55:45.829711+0000","last_became_peered":"2024-04-03T03:55:45.829711+0000","last_unstale":"2024-04-03T05:10:23.007285+0000","last_undegraded":"2024-04-03T05:10:23.007285+0000","last_fullsized":"2024-04-03T05:10:23.007285+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:48.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":19,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"263'38","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.995075+0000","last_change":"2024-04-03T03:49:00.987947+0000","last_active":"2024-04-03T05:10:03.995075+0000","last_peered":"2024-04-03T05:10:03.995075+0000","last_clean":"2024-04-03T05:10:03.995075+0000","last_became_active":"2024-04-03T03:49:00.987174+0000","last_became_peered":"2024-04-03T03:49:00.987174+0000","last_unstale":"2024-04-03T05:10:03.995075+0000","last_undegraded":"2024-04-03T05:10:03.995075+0000","last_fullsized":"2024-04-03T05:10:03.995075+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:24:58.481056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010877+0000","last_change":"2024-04-03T04:18:51.321162+0000","last_active":"2024-04-03T05:10:38.010877+0000","last_peered":"2024-04-03T05:10:38.010877+0000","last_clean":"2024-04-03T05:10:38.010877+0000","last_became_active":"2024-04-03T04:18:51.320359+0000","last_became_peered":"2024-04-03T04:18:51.320359+0000","last_unstale":"2024-04-03T05:10:38.010877+0000","last_undegraded":"2024-04-03T05:10:38.010877+0000","last_fullsized":"2024-04-03T05:10:38.010877+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:19:17.610665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"258'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:27.825755+0000","last_change":"2024-04-03T03:55:53.275336+0000","last_active":"2024-04-03T05:10:27.825755+0000","last_peered":"2024-04-03T05:10:27.825755+0000","last_clean":"2024-04-03T05:10:27.825755+0000","last_became_active":"2024-04-03T03:55:53.274653+0000","last_became_peered":"2024-04-03T03:55:53.274653+0000","last_unstale":"2024-04-03T05:10:27.825755+0000","last_undegraded":"2024-04-03T05:10:27.825755+0000","last_fullsized":"2024-04-03T05:10:27.825755+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:08:05.730323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.813033+0000","last_change":"2024-04-03T03:55:45.832909+0000","last_active":"2024-04-03T05:10:02.813033+0000","last_peered":"2024-04-03T05:10:02.813033+0000","last_clean":"2024-04-03T05:10:02.813033+0000","last_became_active":"2024-04-03T03:55:45.832127+0000","last_became_peered":"2024-04-03T03:55:45.832127+0000","last_unstale":"2024-04-03T05:10:02.813033+0000","last_undegraded":"2024-04-03T05:10:02.813033+0000","last_fullsized":"2024-04-03T05:10:02.813033+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:03:14.969466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"263'16","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.620556+0000","last_change":"2024-04-03T03:49:00.992325+0000","last_active":"2024-04-03T05:10:03.620556+0000","last_peered":"2024-04-03T05:10:03.620556+0000","last_clean":"2024-04-03T05:10:03.620556+0000","last_became_active":"2024-04-03T03:49:00.987993+0000","last_became_peered":"2024-04-03T03:49:00.987993+0000","last_unstale":"2024-04-03T05:10:03.620556+0000","last_undegraded":"2024-04-03T05:10:03.620556+0000","last_fullsized":"2024-04-03T05:10:03.620556+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:47.291199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831156+0000","last_change":"2024-04-03T04:18:51.373972+0000","last_active":"2024-04-03T05:10:52.831156+0000","last_peered":"2024-04-03T05:10:52.831156+0000","last_clean":"2024-04-03T05:10:52.831156+0000","last_became_active":"2024-04-03T04:18:51.373189+0000","last_became_peered":"2024-04-03T04:18:51.373189+0000","last_unstale":"2024-04-03T05:10:52.831156+0000","last_undegraded":"2024-04-03T05:10:52.831156+0000","last_fullsized":"2024-04-03T05:10:52.831156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:58.064420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.045799+0000","last_change":"2024-04-03T03:55:53.244970+0000","last_active":"2024-04-03T05:10:08.045799+0000","last_peered":"2024-04-03T05:10:08.045799+0000","last_clean":"2024-04-03T05:10:08.045799+0000","last_became_active":"2024-04-03T03:55:53.243858+0000","last_became_peered":"2024-04-03T03:55:53.243858+0000","last_unstale":"2024-04-03T05:10:08.045799+0000","last_undegraded":"2024-04-03T05:10:08.045799+0000","last_fullsized":"2024-04-03T05:10:08.045799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:44:36.583585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'6","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.994992+0000","last_change":"2024-04-03T03:55:45.817717+0000","last_active":"2024-04-03T05:10:03.994992+0000","last_peered":"2024-04-03T05:10:03.994992+0000","last_clean":"2024-04-03T05:10:03.994992+0000","last_became_active":"2024-04-03T03:55:45.815910+0000","last_became_peered":"2024-04-03T03:55:45.815910+0000","last_unstale":"2024-04-03T05:10:03.994992+0000","last_undegraded":"2024-04-03T05:10:03.994992+0000","last_fullsized":"2024-04-03T05:10:03.994992+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:54:30.857141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":18434,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"263'51","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.815083+0000","last_change":"2024-04-03T03:49:00.966203+0000","last_active":"2024-04-03T05:10:03.815083+0000","last_peered":"2024-04-03T05:10:03.815083+0000","last_clean":"2024-04-03T05:10:03.815083+0000","last_became_active":"2024-04-03T03:49:00.965454+0000","last_became_peered":"2024-04-03T03:49:00.965454+0000","last_unstale":"2024-04-03T05:10:03.815083+0000","last_undegraded":"2024-04-03T05:10:03.815083+0000","last_fullsized":"2024-04-03T05:10:03.815083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:28.980846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":162,"num_write":91,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032020+0000","last_change":"2024-04-03T04:18:51.367810+0000","last_active":"2024-04-03T05:10:54.032020+0000","last_peered":"2024-04-03T05:10:54.032020+0000","last_clean":"2024-04-03T05:10:54.032020+0000","last_became_active":"2024-04-03T04:18:51.367071+0000","last_became_peered":"2024-04-03T04:18:51.367071+0000","last_unstale":"2024-04-03T05:10:54.032020+0000","last_undegraded":"2024-04-03T05:10:54.032020+0000","last_fullsized":"2024-04-03T05:10:54.032020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:36.487716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"258'2","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.847213+0000","last_change":"2024-04-03T03:55:53.265746+0000","last_active":"2024-04-03T05:11:42.847213+0000","last_peered":"2024-04-03T05:11:42.847213+0000","last_clean":"2024-04-03T05:11:42.847213+0000","last_became_active":"2024-04-03T03:55:53.265100+0000","last_became_peered":"2024-04-03T03:55:53.265100+0000","last_unstale":"2024-04-03T05:11:42.847213+0000","last_undegraded":"2024-04-03T05:11:42.847213+0000","last_fullsized":"2024-04-03T05:11:42.847213+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:30.419453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'5","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.045035+0000","last_change":"2024-04-03T03:55:45.823070+0000","last_active":"2024-04-03T05:14:09.045035+0000","last_peered":"2024-04-03T05:14:09.045035+0000","last_clean":"2024-04-03T05:14:09.045035+0000","last_became_active":"2024-04-03T03:55:45.822292+0000","last_became_peered":"2024-04-03T03:55:45.822292+0000","last_unstale":"2024-04-03T05:14:09.045035+0000","last_undegraded":"2024-04-03T05:14:09.045035+0000","last_fullsized":"2024-04-03T05:14:09.045035+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:18:47.010740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":5,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"263'28","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.820452+0000","last_change":"2024-04-03T03:49:00.981872+0000","last_active":"2024-04-03T05:10:02.820452+0000","last_peered":"2024-04-03T05:10:02.820452+0000","last_clean":"2024-04-03T05:10:02.820452+0000","last_became_active":"2024-04-03T03:49:00.981338+0000","last_became_peered":"2024-04-03T03:49:00.981338+0000","last_unstale":"2024-04-03T05:10:02.820452+0000","last_undegraded":"2024-04-03T05:10:02.820452+0000","last_fullsized":"2024-04-03T05:10:02.820452+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:55:28.926003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631722+0000","last_change":"2024-04-03T04:18:51.309156+0000","last_active":"2024-04-03T05:10:53.631722+0000","last_peered":"2024-04-03T05:10:53.631722+0000","last_clean":"2024-04-03T05:10:53.631722+0000","last_became_active":"2024-04-03T04:18:51.308461+0000","last_became_peered":"2024-04-03T04:18:51.308461+0000","last_unstale":"2024-04-03T05:10:53.631722+0000","last_undegraded":"2024-04-03T05:10:53.631722+0000","last_fullsized":"2024-04-03T05:10:53.631722+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:21.152603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.070316+0000","last_change":"2024-04-03T03:55:53.244597+0000","last_active":"2024-04-03T05:11:43.070316+0000","last_peered":"2024-04-03T05:11:43.070316+0000","last_clean":"2024-04-03T05:11:43.070316+0000","last_became_active":"2024-04-03T03:55:53.243822+0000","last_became_peered":"2024-04-03T03:55:53.243822+0000","last_unstale":"2024-04-03T05:11:43.070316+0000","last_undegraded":"2024-04-03T05:11:43.070316+0000","last_fullsized":"2024-04-03T05:11:43.070316+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:29.709703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'3","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.044433+0000","last_change":"2024-04-03T03:55:45.819884+0000","last_active":"2024-04-03T05:10:03.044433+0000","last_peered":"2024-04-03T05:10:03.044433+0000","last_clean":"2024-04-03T05:10:03.044433+0000","last_became_active":"2024-04-03T03:55:45.819117+0000","last_became_peered":"2024-04-03T03:55:45.819117+0000","last_unstale":"2024-04-03T05:10:03.044433+0000","last_undegraded":"2024-04-03T05:10:03.044433+0000","last_fullsized":"2024-04-03T05:10:03.044433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:34:21.679511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"263'9","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.835717+0000","last_change":"2024-04-03T03:49:00.992070+0000","last_active":"2024-04-03T05:11:47.835717+0000","last_peered":"2024-04-03T05:11:47.835717+0000","last_clean":"2024-04-03T05:11:47.835717+0000","last_became_active":"2024-04-03T03:49:00.991393+0000","last_became_peered":"2024-04-03T03:49:00.991393+0000","last_unstale":"2024-04-03T05:11:47.835717+0000","last_undegraded":"2024-04-03T05:11:47.835717+0000","last_fullsized":"2024-04-03T05:11:47.835717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:31.923155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:09.035711+0000","last_change":"2024-04-03T04:18:51.316420+0000","last_active":"2024-04-03T05:11:09.035711+0000","last_peered":"2024-04-03T05:11:09.035711+0000","last_clean":"2024-04-03T05:11:09.035711+0000","last_became_active":"2024-04-03T04:18:51.315679+0000","last_became_peered":"2024-04-03T04:18:51.315679+0000","last_unstale":"2024-04-03T05:11:09.035711+0000","last_undegraded":"2024-04-03T05:11:09.035711+0000","last_fullsized":"2024-04-03T05:11:09.035711+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:48:40.281554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"258'4","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.621671+0000","last_change":"2024-04-03T03:55:53.278183+0000","last_active":"2024-04-03T05:10:08.621671+0000","last_peered":"2024-04-03T05:10:08.621671+0000","last_clean":"2024-04-03T05:10:08.621671+0000","last_became_active":"2024-04-03T03:55:53.277402+0000","last_became_peered":"2024-04-03T03:55:53.277402+0000","last_unstale":"2024-04-03T05:10:08.621671+0000","last_undegraded":"2024-04-03T05:10:08.621671+0000","last_fullsized":"2024-04-03T05:10:08.621671+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:52:40.795096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":3,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'6","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.015463+0000","last_change":"2024-04-03T03:55:45.815042+0000","last_active":"2024-04-03T05:11:39.015463+0000","last_peered":"2024-04-03T05:11:39.015463+0000","last_clean":"2024-04-03T05:11:39.015463+0000","last_became_active":"2024-04-03T03:55:45.814319+0000","last_became_peered":"2024-04-03T03:55:45.814319+0000","last_unstale":"2024-04-03T05:11:39.015463+0000","last_undegraded":"2024-04-03T05:11:39.015463+0000","last_fullsized":"2024-04-03T05:11:39.015463+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:37.639076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"263'34","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.830330+0000","last_change":"2024-04-03T03:49:00.979853+0000","last_active":"2024-04-03T05:11:22.830330+0000","last_peered":"2024-04-03T05:11:22.830330+0000","last_clean":"2024-04-03T05:11:22.830330+0000","last_became_active":"2024-04-03T03:49:00.979122+0000","last_became_peered":"2024-04-03T03:49:00.979122+0000","last_unstale":"2024-04-03T05:11:22.830330+0000","last_undegraded":"2024-04-03T05:11:22.830330+0000","last_fullsized":"2024-04-03T05:11:22.830330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:05:49.282231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":103,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:37.827796+0000","last_change":"2024-04-03T04:18:51.318648+0000","last_active":"2024-04-03T05:10:37.827796+0000","last_peered":"2024-04-03T05:10:37.827796+0000","last_clean":"2024-04-03T05:10:37.827796+0000","last_became_active":"2024-04-03T04:18:51.318018+0000","last_became_peered":"2024-04-03T04:18:51.318018+0000","last_unstale":"2024-04-03T05:10:37.827796+0000","last_undegraded":"2024-04-03T05:10:37.827796+0000","last_fullsized":"2024-04-03T05:10:37.827796+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:37:23.498696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'6","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:58.043293+0000","last_change":"2024-04-03T03:55:53.255437+0000","last_active":"2024-04-03T05:09:58.043293+0000","last_peered":"2024-04-03T05:09:58.043293+0000","last_clean":"2024-04-03T05:09:58.043293+0000","last_became_active":"2024-04-03T03:55:53.254546+0000","last_became_peered":"2024-04-03T03:55:53.254546+0000","last_unstale":"2024-04-03T05:09:58.043293+0000","last_undegraded":"2024-04-03T05:09:58.043293+0000","last_fullsized":"2024-04-03T05:09:58.043293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:50:56.563374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"258'9","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.025293+0000","last_change":"2024-04-03T03:55:45.821106+0000","last_active":"2024-04-03T05:11:38.025293+0000","last_peered":"2024-04-03T05:11:38.025293+0000","last_clean":"2024-04-03T05:11:38.025293+0000","last_became_active":"2024-04-03T03:55:45.820294+0000","last_became_peered":"2024-04-03T03:55:45.820294+0000","last_unstale":"2024-04-03T05:11:38.025293+0000","last_undegraded":"2024-04-03T05:11:38.025293+0000","last_fullsized":"2024-04-03T05:11:38.025293+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:18:59.587447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18434,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"263'22","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012281+0000","last_change":"2024-04-03T03:49:00.980486+0000","last_active":"2024-04-03T05:11:24.012281+0000","last_peered":"2024-04-03T05:11:24.012281+0000","last_clean":"2024-04-03T05:11:24.012281+0000","last_became_active":"2024-04-03T03:49:00.979598+0000","last_became_peered":"2024-04-03T03:49:00.979598+0000","last_unstale":"2024-04-03T05:11:24.012281+0000","last_undegraded":"2024-04-03T05:11:24.012281+0000","last_fullsized":"2024-04-03T05:11:24.012281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:44:21.546630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":52,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060442+0000","last_change":"2024-04-03T04:18:51.367266+0000","last_active":"2024-04-03T05:10:58.060442+0000","last_peered":"2024-04-03T05:10:58.060442+0000","last_clean":"2024-04-03T05:10:58.060442+0000","last_became_active":"2024-04-03T04:18:51.366501+0000","last_became_peered":"2024-04-03T04:18:51.366501+0000","last_unstale":"2024-04-03T05:10:58.060442+0000","last_undegraded":"2024-04-03T05:10:58.060442+0000","last_fullsized":"2024-04-03T05:10:58.060442+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:54:14.385852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'9","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.828366+0000","last_change":"2024-04-03T03:55:53.268300+0000","last_active":"2024-04-03T05:11:12.828366+0000","last_peered":"2024-04-03T05:11:12.828366+0000","last_clean":"2024-04-03T05:11:12.828366+0000","last_became_active":"2024-04-03T03:55:53.266771+0000","last_became_peered":"2024-04-03T03:55:53.266771+0000","last_unstale":"2024-04-03T05:11:12.828366+0000","last_undegraded":"2024-04-03T05:11:12.828366+0000","last_fullsized":"2024-04-03T05:11:12.828366+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:55:16.846729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.015614+0000","last_change":"2024-04-03T03:55:45.837048+0000","last_active":"2024-04-03T05:11:39.015614+0000","last_peered":"2024-04-03T05:11:39.015614+0000","last_clean":"2024-04-03T05:11:39.015614+0000","last_became_active":"2024-04-03T03:55:45.836623+0000","last_became_peered":"2024-04-03T03:55:45.836623+0000","last_unstale":"2024-04-03T05:11:39.015614+0000","last_undegraded":"2024-04-03T05:11:39.015614+0000","last_fullsized":"2024-04-03T05:11:39.015614+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:50.851547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"263'70","reported_seq":234,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.830519+0000","last_change":"2024-04-03T03:49:00.982602+0000","last_active":"2024-04-03T05:11:22.830519+0000","last_peered":"2024-04-03T05:11:22.830519+0000","last_clean":"2024-04-03T05:11:22.830519+0000","last_became_active":"2024-04-03T03:49:00.978563+0000","last_became_peered":"2024-04-03T03:49:00.978563+0000","last_unstale":"2024-04-03T05:11:22.830519+0000","last_undegraded":"2024-04-03T05:11:22.830519+0000","last_fullsized":"2024-04-03T05:11:22.830519+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:33.306663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":197,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.064707+0000","last_change":"2024-04-03T04:18:51.311769+0000","last_active":"2024-04-03T05:11:18.064707+0000","last_peered":"2024-04-03T05:11:18.064707+0000","last_clean":"2024-04-03T05:11:18.064707+0000","last_became_active":"2024-04-03T04:18:51.311005+0000","last_became_peered":"2024-04-03T04:18:51.311005+0000","last_unstale":"2024-04-03T05:11:18.064707+0000","last_undegraded":"2024-04-03T05:11:18.064707+0000","last_fullsized":"2024-04-03T05:11:18.064707+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:05:36.093095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"258'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032168+0000","last_change":"2024-04-03T03:55:53.252248+0000","last_active":"2024-04-03T05:10:54.032168+0000","last_peered":"2024-04-03T05:10:54.032168+0000","last_clean":"2024-04-03T05:10:54.032168+0000","last_became_active":"2024-04-03T03:55:53.251863+0000","last_became_peered":"2024-04-03T03:55:53.251863+0000","last_unstale":"2024-04-03T05:10:54.032168+0000","last_undegraded":"2024-04-03T05:10:54.032168+0000","last_fullsized":"2024-04-03T05:10:54.032168+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:47:22.809184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.069140+0000","last_change":"2024-04-03T03:55:45.829280+0000","last_active":"2024-04-03T05:11:38.069140+0000","last_peered":"2024-04-03T05:11:38.069140+0000","last_clean":"2024-04-03T05:11:38.069140+0000","last_became_active":"2024-04-03T03:55:45.823003+0000","last_became_peered":"2024-04-03T03:55:45.823003+0000","last_unstale":"2024-04-03T05:11:38.069140+0000","last_undegraded":"2024-04-03T05:11:38.069140+0000","last_fullsized":"2024-04-03T05:11:38.069140+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:11:38.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"263'42","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.039050+0000","last_change":"2024-04-03T03:49:00.982818+0000","last_active":"2024-04-03T05:11:24.039050+0000","last_peered":"2024-04-03T05:11:24.039050+0000","last_clean":"2024-04-03T05:11:24.039050+0000","last_became_active":"2024-04-03T03:49:00.981940+0000","last_became_peered":"2024-04-03T03:49:00.981940+0000","last_unstale":"2024-04-03T05:11:24.039050+0000","last_undegraded":"2024-04-03T05:11:24.039050+0000","last_fullsized":"2024-04-03T05:11:24.039050+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:42:45.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"260'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631991+0000","last_change":"2024-04-03T04:18:51.302485+0000","last_active":"2024-04-03T05:10:53.631991+0000","last_peered":"2024-04-03T05:10:53.631991+0000","last_clean":"2024-04-03T05:10:53.631991+0000","last_became_active":"2024-04-03T04:18:51.301260+0000","last_became_peered":"2024-04-03T04:18:51.301260+0000","last_unstale":"2024-04-03T05:10:53.631991+0000","last_undegraded":"2024-04-03T05:10:53.631991+0000","last_fullsized":"2024-04-03T05:10:53.631991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:07.397862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'1","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:44.043459+0000","last_change":"2024-04-03T03:55:53.257731+0000","last_active":"2024-04-03T05:11:44.043459+0000","last_peered":"2024-04-03T05:11:44.043459+0000","last_clean":"2024-04-03T05:11:44.043459+0000","last_became_active":"2024-04-03T03:55:53.257421+0000","last_became_peered":"2024-04-03T03:55:53.257421+0000","last_unstale":"2024-04-03T05:11:44.043459+0000","last_undegraded":"2024-04-03T05:11:44.043459+0000","last_fullsized":"2024-04-03T05:11:44.043459+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:17.122324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830207+0000","last_change":"2024-04-03T03:55:45.822850+0000","last_active":"2024-04-03T05:10:47.830207+0000","last_peered":"2024-04-03T05:10:47.830207+0000","last_clean":"2024-04-03T05:10:47.830207+0000","last_became_active":"2024-04-03T03:55:45.822134+0000","last_became_peered":"2024-04-03T03:55:45.822134+0000","last_unstale":"2024-04-03T05:10:47.830207+0000","last_undegraded":"2024-04-03T05:10:47.830207+0000","last_fullsized":"2024-04-03T05:10:47.830207+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:51.265204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"263'37","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.824327+0000","last_change":"2024-04-03T03:49:00.990198+0000","last_active":"2024-04-03T05:10:43.824327+0000","last_peered":"2024-04-03T05:10:43.824327+0000","last_clean":"2024-04-03T05:10:43.824327+0000","last_became_active":"2024-04-03T03:49:00.989509+0000","last_became_peered":"2024-04-03T03:49:00.989509+0000","last_unstale":"2024-04-03T05:10:43.824327+0000","last_undegraded":"2024-04-03T05:10:43.824327+0000","last_fullsized":"2024-04-03T05:10:43.824327+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:47:32.824649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032254+0000","last_change":"2024-04-03T04:18:51.367656+0000","last_active":"2024-04-03T05:10:54.032254+0000","last_peered":"2024-04-03T05:10:54.032254+0000","last_clean":"2024-04-03T05:10:54.032254+0000","last_became_active":"2024-04-03T04:18:51.366898+0000","last_became_peered":"2024-04-03T04:18:51.366898+0000","last_unstale":"2024-04-03T05:10:54.032254+0000","last_undegraded":"2024-04-03T05:10:54.032254+0000","last_fullsized":"2024-04-03T05:10:54.032254+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:02:42.380567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.837650+0000","last_change":"2024-04-03T03:55:53.273186+0000","last_active":"2024-04-03T05:11:43.837650+0000","last_peered":"2024-04-03T05:11:43.837650+0000","last_clean":"2024-04-03T05:11:43.837650+0000","last_became_active":"2024-04-03T03:55:53.272757+0000","last_became_peered":"2024-04-03T03:55:53.272757+0000","last_unstale":"2024-04-03T05:11:43.837650+0000","last_undegraded":"2024-04-03T05:11:43.837650+0000","last_fullsized":"2024-04-03T05:11:43.837650+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:30:01.756534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:09.035840+0000","last_change":"2024-04-03T03:55:45.835017+0000","last_active":"2024-04-03T05:11:09.035840+0000","last_peered":"2024-04-03T05:11:09.035840+0000","last_clean":"2024-04-03T05:11:09.035840+0000","last_became_active":"2024-04-03T03:55:45.834364+0000","last_became_peered":"2024-04-03T03:55:45.834364+0000","last_unstale":"2024-04-03T05:11:09.035840+0000","last_undegraded":"2024-04-03T05:11:09.035840+0000","last_fullsized":"2024-04-03T05:11:09.035840+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:24:43.835815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"263'29","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:19.024038+0000","last_change":"2024-04-03T03:49:00.975429+0000","last_active":"2024-04-03T05:10:19.024038+0000","last_peered":"2024-04-03T05:10:19.024038+0000","last_clean":"2024-04-03T05:10:19.024038+0000","last_became_active":"2024-04-03T03:49:00.974654+0000","last_became_peered":"2024-04-03T03:49:00.974654+0000","last_unstale":"2024-04-03T05:10:19.024038+0000","last_undegraded":"2024-04-03T05:10:19.024038+0000","last_fullsized":"2024-04-03T05:10:19.024038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:46.921570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.829945+0000","last_change":"2024-04-03T04:18:51.323217+0000","last_active":"2024-04-03T05:11:08.829945+0000","last_peered":"2024-04-03T05:11:08.829945+0000","last_clean":"2024-04-03T05:11:08.829945+0000","last_became_active":"2024-04-03T04:18:51.322311+0000","last_became_peered":"2024-04-03T04:18:51.322311+0000","last_unstale":"2024-04-03T05:11:08.829945+0000","last_undegraded":"2024-04-03T05:11:08.829945+0000","last_fullsized":"2024-04-03T05:11:08.829945+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:50:12.059710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:59.060422+0000","last_change":"2024-04-03T03:55:53.256346+0000","last_active":"2024-04-03T05:12:59.060422+0000","last_peered":"2024-04-03T05:12:59.060422+0000","last_clean":"2024-04-03T05:12:59.060422+0000","last_became_active":"2024-04-03T03:55:53.255322+0000","last_became_peered":"2024-04-03T03:55:53.255322+0000","last_unstale":"2024-04-03T05:12:59.060422+0000","last_undegraded":"2024-04-03T05:12:59.060422+0000","last_fullsized":"2024-04-03T05:12:59.060422+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:09.641737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":90,"num_write":10,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'1","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.630607+0000","last_change":"2024-04-03T03:55:45.826097+0000","last_active":"2024-04-03T05:10:48.630607+0000","last_peered":"2024-04-03T05:10:48.630607+0000","last_clean":"2024-04-03T05:10:48.630607+0000","last_became_active":"2024-04-03T03:55:45.825324+0000","last_became_peered":"2024-04-03T03:55:45.825324+0000","last_unstale":"2024-04-03T05:10:48.630607+0000","last_undegraded":"2024-04-03T05:10:48.630607+0000","last_fullsized":"2024-04-03T05:10:48.630607+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:24.023966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"263'10","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.005883+0000","last_change":"2024-04-03T03:49:00.989237+0000","last_active":"2024-04-03T05:10:18.005883+0000","last_peered":"2024-04-03T05:10:18.005883+0000","last_clean":"2024-04-03T05:10:18.005883+0000","last_became_active":"2024-04-03T03:49:00.988511+0000","last_became_peered":"2024-04-03T03:49:00.988511+0000","last_unstale":"2024-04-03T05:10:18.005883+0000","last_undegraded":"2024-04-03T05:10:18.005883+0000","last_fullsized":"2024-04-03T05:10:18.005883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:30:04.122245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.836789+0000","last_change":"2024-04-03T04:18:51.311624+0000","last_active":"2024-04-03T05:10:57.836789+0000","last_peered":"2024-04-03T05:10:57.836789+0000","last_clean":"2024-04-03T05:10:57.836789+0000","last_became_active":"2024-04-03T04:18:51.310903+0000","last_became_peered":"2024-04-03T04:18:51.310903+0000","last_unstale":"2024-04-03T05:10:57.836789+0000","last_undegraded":"2024-04-03T05:10:57.836789+0000","last_fullsized":"2024-04-03T05:10:57.836789+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:16:43.080955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'3","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:14.050111+0000","last_change":"2024-04-03T03:55:53.249654+0000","last_active":"2024-04-03T05:12:14.050111+0000","last_peered":"2024-04-03T05:12:14.050111+0000","last_clean":"2024-04-03T05:12:14.050111+0000","last_became_active":"2024-04-03T03:55:53.248897+0000","last_became_peered":"2024-04-03T03:55:53.248897+0000","last_unstale":"2024-04-03T05:12:14.050111+0000","last_undegraded":"2024-04-03T05:12:14.050111+0000","last_fullsized":"2024-04-03T05:12:14.050111+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:46:01.196435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.825361+0000","last_change":"2024-04-03T03:55:45.823094+0000","last_active":"2024-04-03T05:10:48.825361+0000","last_peered":"2024-04-03T05:10:48.825361+0000","last_clean":"2024-04-03T05:10:48.825361+0000","last_became_active":"2024-04-03T03:55:45.822406+0000","last_became_peered":"2024-04-03T03:55:45.822406+0000","last_unstale":"2024-04-03T05:10:48.825361+0000","last_undegraded":"2024-04-03T05:10:48.825361+0000","last_fullsized":"2024-04-03T05:10:48.825361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:27:33.919111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"263'32","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.998233+0000","last_change":"2024-04-03T03:49:00.984263+0000","last_active":"2024-04-03T05:10:18.998233+0000","last_peered":"2024-04-03T05:10:18.998233+0000","last_clean":"2024-04-03T05:10:18.998233+0000","last_became_active":"2024-04-03T03:49:00.983502+0000","last_became_peered":"2024-04-03T03:49:00.983502+0000","last_unstale":"2024-04-03T05:10:18.998233+0000","last_undegraded":"2024-04-03T05:10:18.998233+0000","last_fullsized":"2024-04-03T05:10:18.998233+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:43:07.869966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":91,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633108+0000","last_change":"2024-04-03T04:18:51.320361+0000","last_active":"2024-04-03T05:10:58.633108+0000","last_peered":"2024-04-03T05:10:58.633108+0000","last_clean":"2024-04-03T05:10:58.633108+0000","last_became_active":"2024-04-03T04:18:51.319585+0000","last_became_peered":"2024-04-03T04:18:51.319585+0000","last_unstale":"2024-04-03T05:10:58.633108+0000","last_undegraded":"2024-04-03T05:10:58.633108+0000","last_fullsized":"2024-04-03T05:10:58.633108+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:06:53.044441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.005827+0000","last_change":"2024-04-03T03:55:53.254086+0000","last_active":"2024-04-03T05:10:54.005827+0000","last_peered":"2024-04-03T05:10:54.005827+0000","last_clean":"2024-04-03T05:10:54.005827+0000","last_became_active":"2024-04-03T03:55:53.253313+0000","last_became_peered":"2024-04-03T03:55:53.253313+0000","last_unstale":"2024-04-03T05:10:54.005827+0000","last_undegraded":"2024-04-03T05:10:54.005827+0000","last_fullsized":"2024-04-03T05:10:54.005827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:42:59.596779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'7","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.845635+0000","last_change":"2024-04-03T03:55:45.821498+0000","last_active":"2024-04-03T05:14:08.845635+0000","last_peered":"2024-04-03T05:14:08.845635+0000","last_clean":"2024-04-03T05:14:08.845635+0000","last_became_active":"2024-04-03T03:55:45.820786+0000","last_became_peered":"2024-04-03T03:55:45.820786+0000","last_unstale":"2024-04-03T05:14:08.845635+0000","last_undegraded":"2024-04-03T05:14:08.845635+0000","last_fullsized":"2024-04-03T05:14:08.845635+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:09:15.309227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":17,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"263'69","reported_seq":242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818307+0000","last_change":"2024-04-03T03:49:00.962192+0000","last_active":"2024-04-03T05:10:18.818307+0000","last_peered":"2024-04-03T05:10:18.818307+0000","last_clean":"2024-04-03T05:10:18.818307+0000","last_became_active":"2024-04-03T03:49:00.961318+0000","last_became_peered":"2024-04-03T03:49:00.961318+0000","last_unstale":"2024-04-03T05:10:18.818307+0000","last_undegraded":"2024-04-03T05:10:18.818307+0000","last_fullsized":"2024-04-03T05:10:18.818307+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:24:56.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":306,"num_read_kb":217,"num_write":109,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:59.007033+0000","last_change":"2024-04-03T04:18:51.318872+0000","last_active":"2024-04-03T05:10:59.007033+0000","last_peered":"2024-04-03T05:10:59.007033+0000","last_clean":"2024-04-03T05:10:59.007033+0000","last_became_active":"2024-04-03T04:18:51.318123+0000","last_became_peered":"2024-04-03T04:18:51.318123+0000","last_unstale":"2024-04-03T05:10:59.007033+0000","last_undegraded":"2024-04-03T05:10:59.007033+0000","last_fullsized":"2024-04-03T05:10:59.007033+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:43:45.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831053+0000","last_change":"2024-04-03T03:55:53.273476+0000","last_active":"2024-04-03T05:10:52.831053+0000","last_peered":"2024-04-03T05:10:52.831053+0000","last_clean":"2024-04-03T05:10:52.831053+0000","last_became_active":"2024-04-03T03:55:53.272979+0000","last_became_peered":"2024-04-03T03:55:53.272979+0000","last_unstale":"2024-04-03T05:10:52.831053+0000","last_undegraded":"2024-04-03T05:10:52.831053+0000","last_fullsized":"2024-04-03T05:10:52.831053+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:02:06.605755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"258'2","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.004446+0000","last_change":"2024-04-03T03:55:45.808103+0000","last_active":"2024-04-03T05:10:49.004446+0000","last_peered":"2024-04-03T05:10:49.004446+0000","last_clean":"2024-04-03T05:10:49.004446+0000","last_became_active":"2024-04-03T03:55:45.807410+0000","last_became_peered":"2024-04-03T03:55:45.807410+0000","last_unstale":"2024-04-03T05:10:49.004446+0000","last_undegraded":"2024-04-03T05:10:49.004446+0000","last_fullsized":"2024-04-03T05:10:49.004446+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:55:34.688567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"263'45","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:27.831292+0000","last_change":"2024-04-03T03:49:00.980550+0000","last_active":"2024-04-03T05:11:27.831292+0000","last_peered":"2024-04-03T05:11:27.831292+0000","last_clean":"2024-04-03T05:11:27.831292+0000","last_became_active":"2024-04-03T03:49:00.978547+0000","last_became_peered":"2024-04-03T03:49:00.978547+0000","last_unstale":"2024-04-03T05:11:27.831292+0000","last_undegraded":"2024-04-03T05:11:27.831292+0000","last_fullsized":"2024-04-03T05:11:27.831292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:02:28.324158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":127,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'369","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.876929+0000","last_change":"2024-04-03T03:38:24.754612+0000","last_active":"2024-04-03T05:14:08.876929+0000","last_peered":"2024-04-03T05:14:08.876929+0000","last_clean":"2024-04-03T05:14:08.876929+0000","last_became_active":"2024-04-03T03:38:24.753446+0000","last_became_peered":"2024-04-03T03:38:24.753446+0000","last_unstale":"2024-04-03T05:14:08.876929+0000","last_undegraded":"2024-04-03T05:14:08.876929+0000","last_fullsized":"2024-04-03T05:14:08.876929+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:22:38.341258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19563641,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":627,"num_read_kb":35431,"num_write":1329,"num_write_kb":27233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'364","reported_seq":1890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.373264+0000","last_change":"2024-04-03T03:38:26.751530+0000","last_active":"2024-04-03T05:11:12.373264+0000","last_peered":"2024-04-03T05:11:12.373264+0000","last_clean":"2024-04-03T05:11:12.373264+0000","last_became_active":"2024-04-03T03:38:26.750879+0000","last_became_peered":"2024-04-03T03:38:26.750879+0000","last_unstale":"2024-04-03T05:11:12.373264+0000","last_undegraded":"2024-04-03T05:11:12.373264+0000","last_fullsized":"2024-04-03T05:11:12.373264+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:50.660673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2014,"num_read_kb":1942,"num_write":406,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'290","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.743433+0000","last_change":"2024-04-03T03:38:24.723229+0000","last_active":"2024-04-03T05:14:07.743433+0000","last_peered":"2024-04-03T05:14:07.743433+0000","last_clean":"2024-04-03T05:14:07.743433+0000","last_became_active":"2024-04-03T03:38:24.722769+0000","last_became_peered":"2024-04-03T03:38:24.722769+0000","last_unstale":"2024-04-03T05:14:07.743433+0000","last_undegraded":"2024-04-03T05:14:07.743433+0000","last_fullsized":"2024-04-03T05:14:07.743433+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:48:04.458628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13170229,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":563,"num_read_kb":76319,"num_write":1262,"num_write_kb":34753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'860","reported_seq":2513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.128819+0000","last_change":"2024-04-03T03:38:26.726050+0000","last_active":"2024-04-03T05:13:59.128819+0000","last_peered":"2024-04-03T05:13:59.128819+0000","last_clean":"2024-04-03T05:13:59.128819+0000","last_became_active":"2024-04-03T03:38:26.724640+0000","last_became_peered":"2024-04-03T03:38:26.724640+0000","last_unstale":"2024-04-03T05:13:59.128819+0000","last_undegraded":"2024-04-03T05:13:59.128819+0000","last_fullsized":"2024-04-03T05:13:59.128819+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:18:50.425634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3968,"num_read_kb":3559,"num_write":1184,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'262","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.996025+0000","last_change":"2024-04-03T03:38:24.711403+0000","last_active":"2024-04-03T05:14:07.996025+0000","last_peered":"2024-04-03T05:14:07.996025+0000","last_clean":"2024-04-03T05:14:07.996025+0000","last_became_active":"2024-04-03T03:38:24.711028+0000","last_became_peered":"2024-04-03T03:38:24.711028+0000","last_unstale":"2024-04-03T05:14:07.996025+0000","last_undegraded":"2024-04-03T05:14:07.996025+0000","last_fullsized":"2024-04-03T05:14:07.996025+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:36:37.333600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3343596,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":380,"num_read_kb":16597,"num_write":974,"num_write_kb":26343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'709","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.222128+0000","last_change":"2024-04-03T03:38:26.750079+0000","last_active":"2024-04-03T05:12:22.222128+0000","last_peered":"2024-04-03T05:12:22.222128+0000","last_clean":"2024-04-03T05:12:22.222128+0000","last_became_active":"2024-04-03T03:38:26.745277+0000","last_became_peered":"2024-04-03T03:38:26.745277+0000","last_unstale":"2024-04-03T05:12:22.222128+0000","last_undegraded":"2024-04-03T05:12:22.222128+0000","last_fullsized":"2024-04-03T05:12:22.222128+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:56:00.667466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3170,"num_read_kb":2825,"num_write":964,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'344","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.862259+0000","last_change":"2024-04-03T03:38:24.757433+0000","last_active":"2024-04-03T05:14:08.862259+0000","last_peered":"2024-04-03T05:14:08.862259+0000","last_clean":"2024-04-03T05:14:08.862259+0000","last_became_active":"2024-04-03T03:38:24.756927+0000","last_became_peered":"2024-04-03T03:38:24.756927+0000","last_unstale":"2024-04-03T05:14:08.862259+0000","last_undegraded":"2024-04-03T05:14:08.862259+0000","last_fullsized":"2024-04-03T05:14:08.862259+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:38:37.035425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4217494,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":601,"num_read_kb":48559,"num_write":1336,"num_write_kb":35333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'577","reported_seq":2216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060394+0000","last_change":"2024-04-03T03:38:26.730190+0000","last_active":"2024-04-03T05:10:58.060394+0000","last_peered":"2024-04-03T05:10:58.060394+0000","last_clean":"2024-04-03T05:10:58.060394+0000","last_became_active":"2024-04-03T03:38:26.729866+0000","last_became_peered":"2024-04-03T03:38:26.729866+0000","last_unstale":"2024-04-03T05:10:58.060394+0000","last_undegraded":"2024-04-03T05:10:58.060394+0000","last_fullsized":"2024-04-03T05:10:58.060394+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:34.215876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2799,"num_write":801,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'364","reported_seq":1270,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.048172+0000","last_change":"2024-04-03T03:38:24.748987+0000","last_active":"2024-04-03T05:14:09.048172+0000","last_peered":"2024-04-03T05:14:09.048172+0000","last_clean":"2024-04-03T05:14:09.048172+0000","last_became_active":"2024-04-03T03:38:24.748338+0000","last_became_peered":"2024-04-03T03:38:24.748338+0000","last_unstale":"2024-04-03T05:14:09.048172+0000","last_undegraded":"2024-04-03T05:14:09.048172+0000","last_fullsized":"2024-04-03T05:14:09.048172+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:49:02.239604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9766408,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":1206,"num_read_kb":39092,"num_write":1633,"num_write_kb":52242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'478","reported_seq":1925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.372354+0000","last_change":"2024-04-03T03:38:26.720548+0000","last_active":"2024-04-03T05:11:12.372354+0000","last_peered":"2024-04-03T05:11:12.372354+0000","last_clean":"2024-04-03T05:11:12.372354+0000","last_became_active":"2024-04-03T03:38:26.719805+0000","last_became_peered":"2024-04-03T03:38:26.719805+0000","last_unstale":"2024-04-03T05:11:12.372354+0000","last_undegraded":"2024-04-03T05:11:12.372354+0000","last_fullsized":"2024-04-03T05:11:12.372354+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:06:02.662745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2340,"num_read_kb":2138,"num_write":626,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'315","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.853533+0000","last_change":"2024-04-03T03:38:24.754531+0000","last_active":"2024-04-03T05:14:08.853533+0000","last_peered":"2024-04-03T05:14:08.853533+0000","last_clean":"2024-04-03T05:14:08.853533+0000","last_became_active":"2024-04-03T03:38:24.749192+0000","last_became_peered":"2024-04-03T03:38:24.749192+0000","last_unstale":"2024-04-03T05:14:08.853533+0000","last_undegraded":"2024-04-03T05:14:08.853533+0000","last_fullsized":"2024-04-03T05:14:08.853533+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:24:13.416735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5778104,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":415,"num_read_kb":24946,"num_write":1253,"num_write_kb":50928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'294","reported_seq":1649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.605723+0000","last_change":"2024-04-03T03:38:26.750146+0000","last_active":"2024-04-03T05:10:43.605723+0000","last_peered":"2024-04-03T05:10:43.605723+0000","last_clean":"2024-04-03T05:10:43.605723+0000","last_became_active":"2024-04-03T03:38:26.744762+0000","last_became_peered":"2024-04-03T03:38:26.744762+0000","last_unstale":"2024-04-03T05:10:43.605723+0000","last_undegraded":"2024-04-03T05:10:43.605723+0000","last_fullsized":"2024-04-03T05:10:43.605723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:44.097623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1674,"num_read_kb":1613,"num_write":327,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'295","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.054593+0000","last_change":"2024-04-03T03:38:24.730594+0000","last_active":"2024-04-03T05:14:09.054593+0000","last_peered":"2024-04-03T05:14:09.054593+0000","last_clean":"2024-04-03T05:14:09.054593+0000","last_became_active":"2024-04-03T03:38:24.728188+0000","last_became_peered":"2024-04-03T03:38:24.728188+0000","last_unstale":"2024-04-03T05:14:09.054593+0000","last_undegraded":"2024-04-03T05:14:09.054593+0000","last_fullsized":"2024-04-03T05:14:09.054593+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:12:23.518716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6443356,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":508,"num_read_kb":30991,"num_write":1137,"num_write_kb":37947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'732","reported_seq":2231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.844541+0000","last_change":"2024-04-03T03:38:26.722813+0000","last_active":"2024-04-03T05:12:13.844541+0000","last_peered":"2024-04-03T05:12:13.844541+0000","last_clean":"2024-04-03T05:12:13.844541+0000","last_became_active":"2024-04-03T03:38:26.722053+0000","last_became_peered":"2024-04-03T03:38:26.722053+0000","last_unstale":"2024-04-03T05:12:13.844541+0000","last_undegraded":"2024-04-03T05:12:13.844541+0000","last_fullsized":"2024-04-03T05:12:13.844541+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:52:12.496090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3332,"num_read_kb":2987,"num_write":969,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'285","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.977729+0000","last_change":"2024-04-03T03:38:24.749214+0000","last_active":"2024-04-03T05:14:07.977729+0000","last_peered":"2024-04-03T05:14:07.977729+0000","last_clean":"2024-04-03T05:14:07.977729+0000","last_became_active":"2024-04-03T03:38:24.748669+0000","last_became_peered":"2024-04-03T03:38:24.748669+0000","last_unstale":"2024-04-03T05:14:07.977729+0000","last_undegraded":"2024-04-03T05:14:07.977729+0000","last_fullsized":"2024-04-03T05:14:07.977729+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:20:30.983491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7227232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":442,"num_read_kb":30915,"num_write":1190,"num_write_kb":34378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'466","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.453334+0000","last_change":"2024-04-03T03:38:26.712374+0000","last_active":"2024-04-03T05:11:08.453334+0000","last_peered":"2024-04-03T05:11:08.453334+0000","last_clean":"2024-04-03T05:11:08.453334+0000","last_became_active":"2024-04-03T03:38:26.711993+0000","last_became_peered":"2024-04-03T03:38:26.711993+0000","last_unstale":"2024-04-03T05:11:08.453334+0000","last_undegraded":"2024-04-03T05:11:08.453334+0000","last_fullsized":"2024-04-03T05:11:08.453334+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:28:06.991173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2333,"num_write":597,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'427","reported_seq":1881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.643681+0000","last_change":"2024-04-03T03:38:26.741314+0000","last_active":"2024-04-03T05:11:48.643681+0000","last_peered":"2024-04-03T05:11:48.643681+0000","last_clean":"2024-04-03T05:11:48.643681+0000","last_became_active":"2024-04-03T03:38:26.740542+0000","last_became_peered":"2024-04-03T03:38:26.740542+0000","last_unstale":"2024-04-03T05:11:48.643681+0000","last_undegraded":"2024-04-03T05:11:48.643681+0000","last_fullsized":"2024-04-03T05:11:48.643681+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:02:13.637413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2192,"num_read_kb":2031,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.042430+0000","last_change":"2024-04-03T03:38:24.762053+0000","last_active":"2024-04-03T05:14:09.042430+0000","last_peered":"2024-04-03T05:14:09.042430+0000","last_clean":"2024-04-03T05:14:09.042430+0000","last_became_active":"2024-04-03T03:38:24.761424+0000","last_became_peered":"2024-04-03T03:38:24.761424+0000","last_unstale":"2024-04-03T05:14:09.042430+0000","last_undegraded":"2024-04-03T05:14:09.042430+0000","last_fullsized":"2024-04-03T05:14:09.042430+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:58:18.665928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1588863,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":468,"num_read_kb":4079,"num_write":1206,"num_write_kb":13920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'364","reported_seq":1752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193276+0000","last_change":"2024-04-03T03:38:26.725447+0000","last_active":"2024-04-03T05:13:59.193276+0000","last_peered":"2024-04-03T05:13:59.193276+0000","last_clean":"2024-04-03T05:13:59.193276+0000","last_became_active":"2024-04-03T03:38:26.723638+0000","last_became_peered":"2024-04-03T03:38:26.723638+0000","last_unstale":"2024-04-03T05:13:59.193276+0000","last_undegraded":"2024-04-03T05:13:59.193276+0000","last_fullsized":"2024-04-03T05:13:59.193276+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:30:54.500121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1899,"num_read_kb":1790,"num_write":424,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'302","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.974821+0000","last_change":"2024-04-03T03:38:58.351102+0000","last_active":"2024-04-03T05:14:08.974821+0000","last_peered":"2024-04-03T05:14:08.974821+0000","last_clean":"2024-04-03T05:14:08.974821+0000","last_became_active":"2024-04-03T03:38:58.349885+0000","last_became_peered":"2024-04-03T03:38:58.349885+0000","last_unstale":"2024-04-03T05:14:08.974821+0000","last_undegraded":"2024-04-03T05:14:08.974821+0000","last_fullsized":"2024-04-03T05:14:08.974821+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:16:53.864983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14459487,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":486,"num_read_kb":66677,"num_write":1204,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'451","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.396049+0000","last_change":"2024-04-03T03:38:26.710365+0000","last_active":"2024-04-03T05:11:18.396049+0000","last_peered":"2024-04-03T05:11:18.396049+0000","last_clean":"2024-04-03T05:11:18.396049+0000","last_became_active":"2024-04-03T03:38:26.709613+0000","last_became_peered":"2024-04-03T03:38:26.709613+0000","last_unstale":"2024-04-03T05:11:18.396049+0000","last_undegraded":"2024-04-03T05:11:18.396049+0000","last_fullsized":"2024-04-03T05:11:18.396049+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:37:42.966727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2380,"num_write":570,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'306","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.985418+0000","last_change":"2024-04-03T03:38:24.761922+0000","last_active":"2024-04-03T05:14:08.985418+0000","last_peered":"2024-04-03T05:14:08.985418+0000","last_clean":"2024-04-03T05:14:08.985418+0000","last_became_active":"2024-04-03T03:38:24.761284+0000","last_became_peered":"2024-04-03T03:38:24.761284+0000","last_unstale":"2024-04-03T05:14:08.985418+0000","last_undegraded":"2024-04-03T05:14:08.985418+0000","last_fullsized":"2024-04-03T05:14:08.985418+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:33:18.725669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5282135,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":548,"num_read_kb":65080,"num_write":1155,"num_write_kb":43379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'446","reported_seq":2408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.213868+0000","last_change":"2024-04-03T03:38:26.713266+0000","last_active":"2024-04-03T05:12:22.213868+0000","last_peered":"2024-04-03T05:12:22.213868+0000","last_clean":"2024-04-03T05:12:22.213868+0000","last_became_active":"2024-04-03T03:38:26.711748+0000","last_became_peered":"2024-04-03T03:38:26.711748+0000","last_unstale":"2024-04-03T05:12:22.213868+0000","last_undegraded":"2024-04-03T05:12:22.213868+0000","last_fullsized":"2024-04-03T05:12:22.213868+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:16:46.211389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2976,"num_read_kb":2877,"num_write":500,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'255","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.632281+0000","last_change":"2024-04-03T03:38:24.744386+0000","last_active":"2024-04-03T05:14:08.632281+0000","last_peered":"2024-04-03T05:14:08.632281+0000","last_clean":"2024-04-03T05:14:08.632281+0000","last_became_active":"2024-04-03T03:38:24.742574+0000","last_became_peered":"2024-04-03T03:38:24.742574+0000","last_unstale":"2024-04-03T05:14:08.632281+0000","last_undegraded":"2024-04-03T05:14:08.632281+0000","last_fullsized":"2024-04-03T05:14:08.632281+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:11.179082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15102384,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":405,"num_read_kb":46919,"num_write":1070,"num_write_kb":37595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'342","reported_seq":1754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.276727+0000","last_change":"2024-04-03T03:38:26.744328+0000","last_active":"2024-04-03T05:11:29.276727+0000","last_peered":"2024-04-03T05:11:29.276727+0000","last_clean":"2024-04-03T05:11:29.276727+0000","last_became_active":"2024-04-03T03:38:26.743735+0000","last_became_peered":"2024-04-03T03:38:26.743735+0000","last_unstale":"2024-04-03T05:11:29.276727+0000","last_undegraded":"2024-04-03T05:11:29.276727+0000","last_fullsized":"2024-04-03T05:11:29.276727+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:20:00.390318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1802,"num_read_kb":1729,"num_write":383,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'294","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.005786+0000","last_change":"2024-04-03T03:38:24.726007+0000","last_active":"2024-04-03T05:14:08.005786+0000","last_peered":"2024-04-03T05:14:08.005786+0000","last_clean":"2024-04-03T05:14:08.005786+0000","last_became_active":"2024-04-03T03:38:24.725557+0000","last_became_peered":"2024-04-03T03:38:24.725557+0000","last_unstale":"2024-04-03T05:14:08.005786+0000","last_undegraded":"2024-04-03T05:14:08.005786+0000","last_fullsized":"2024-04-03T05:14:08.005786+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:50:47.134109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5507739,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":443,"num_read_kb":4167,"num_write":1103,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'335","reported_seq":1763,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.286070+0000","last_change":"2024-04-03T03:38:26.745907+0000","last_active":"2024-04-03T05:11:29.286070+0000","last_peered":"2024-04-03T05:11:29.286070+0000","last_clean":"2024-04-03T05:11:29.286070+0000","last_became_active":"2024-04-03T03:38:26.744977+0000","last_became_peered":"2024-04-03T03:38:26.744977+0000","last_unstale":"2024-04-03T05:11:29.286070+0000","last_undegraded":"2024-04-03T05:11:29.286070+0000","last_fullsized":"2024-04-03T05:11:29.286070+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:09:58.311296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1755,"num_write":385,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'234","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.978970+0000","last_change":"2024-04-03T03:38:24.725895+0000","last_active":"2024-04-03T05:14:07.978970+0000","last_peered":"2024-04-03T05:14:07.978970+0000","last_clean":"2024-04-03T05:14:07.978970+0000","last_became_active":"2024-04-03T03:38:24.725410+0000","last_became_peered":"2024-04-03T03:38:24.725410+0000","last_unstale":"2024-04-03T05:14:07.978970+0000","last_undegraded":"2024-04-03T05:14:07.978970+0000","last_fullsized":"2024-04-03T05:14:07.978970+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:07:55.757685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21031641,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":485,"num_read_kb":79698,"num_write":935,"num_write_kb":41581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'139","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.408690+0000","last_change":"2024-04-03T03:38:34.739613+0000","last_active":"2024-04-03T05:11:18.408690+0000","last_peered":"2024-04-03T05:11:18.408690+0000","last_clean":"2024-04-03T05:11:18.408690+0000","last_became_active":"2024-04-03T03:38:34.738565+0000","last_became_peered":"2024-04-03T03:38:34.738565+0000","last_unstale":"2024-04-03T05:11:18.408690+0000","last_undegraded":"2024-04-03T05:11:18.408690+0000","last_fullsized":"2024-04-03T05:11:18.408690+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:08:22.326355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":345,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'372","reported_seq":1823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.374074+0000","last_change":"2024-04-03T03:39:58.990871+0000","last_active":"2024-04-03T05:11:12.374074+0000","last_peered":"2024-04-03T05:11:12.374074+0000","last_clean":"2024-04-03T05:11:12.374074+0000","last_became_active":"2024-04-03T03:39:58.989982+0000","last_became_peered":"2024-04-03T03:39:58.989982+0000","last_unstale":"2024-04-03T05:11:12.374074+0000","last_undegraded":"2024-04-03T05:11:12.374074+0000","last_fullsized":"2024-04-03T05:11:12.374074+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:57:23.445483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2119,"num_read_kb":1999,"num_write":436,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'300","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.995287+0000","last_change":"2024-04-03T03:38:24.750884+0000","last_active":"2024-04-03T05:14:08.995287+0000","last_peered":"2024-04-03T05:14:08.995287+0000","last_clean":"2024-04-03T05:14:08.995287+0000","last_became_active":"2024-04-03T03:38:24.750235+0000","last_became_peered":"2024-04-03T03:38:24.750235+0000","last_unstale":"2024-04-03T05:14:08.995287+0000","last_undegraded":"2024-04-03T05:14:08.995287+0000","last_fullsized":"2024-04-03T05:14:08.995287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:38:04.324570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340614,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":461,"num_read_kb":98318,"num_write":1162,"num_write_kb":49383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818558+0000","last_change":"2024-04-03T03:38:28.726652+0000","last_active":"2024-04-03T05:10:18.818558+0000","last_peered":"2024-04-03T05:10:18.818558+0000","last_clean":"2024-04-03T05:10:18.818558+0000","last_became_active":"2024-04-03T03:38:28.725801+0000","last_became_peered":"2024-04-03T03:38:28.725801+0000","last_unstale":"2024-04-03T05:10:18.818558+0000","last_undegraded":"2024-04-03T05:10:18.818558+0000","last_fullsized":"2024-04-03T05:10:18.818558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:31:07.597192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'344","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.495856+0000","last_change":"2024-04-03T03:38:30.727143+0000","last_active":"2024-04-03T05:14:00.495856+0000","last_peered":"2024-04-03T05:14:00.495856+0000","last_clean":"2024-04-03T05:14:00.495856+0000","last_became_active":"2024-04-03T03:38:30.726684+0000","last_became_peered":"2024-04-03T03:38:30.726684+0000","last_unstale":"2024-04-03T05:14:00.495856+0000","last_undegraded":"2024-04-03T05:14:00.495856+0000","last_fullsized":"2024-04-03T05:14:00.495856+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:51.225223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58921,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":1006,"num_write":422,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:24.025369+0000","last_change":"2024-04-03T03:38:32.748206+0000","last_active":"2024-04-03T05:10:24.025369+0000","last_peered":"2024-04-03T05:10:24.025369+0000","last_clean":"2024-04-03T05:10:24.025369+0000","last_became_active":"2024-04-03T03:38:32.745434+0000","last_became_peered":"2024-04-03T03:38:32.745434+0000","last_unstale":"2024-04-03T05:10:24.025369+0000","last_undegraded":"2024-04-03T05:10:24.025369+0000","last_fullsized":"2024-04-03T05:10:24.025369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:43:21.765675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2398","reported_seq":4223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.236396+0000","last_change":"2024-04-03T03:38:34.759059+0000","last_active":"2024-04-03T05:12:22.236396+0000","last_peered":"2024-04-03T05:12:22.236396+0000","last_clean":"2024-04-03T05:12:22.236396+0000","last_became_active":"2024-04-03T03:38:34.757256+0000","last_became_peered":"2024-04-03T03:38:34.757256+0000","last_unstale":"2024-04-03T05:12:22.236396+0000","last_undegraded":"2024-04-03T05:12:22.236396+0000","last_fullsized":"2024-04-03T05:12:22.236396+0000","mapping_epoch":33,"log_start":"263'2300","ondisk_log_start":"263'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":2300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:07.414083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5948,"num_read_kb":5953,"num_write":4769,"num_write_kb":1764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'433","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.110390+0000","last_change":"2024-04-03T03:38:26.725258+0000","last_active":"2024-04-03T05:13:59.110390+0000","last_peered":"2024-04-03T05:13:59.110390+0000","last_clean":"2024-04-03T05:13:59.110390+0000","last_became_active":"2024-04-03T03:38:26.724537+0000","last_became_peered":"2024-04-03T03:38:26.724537+0000","last_unstale":"2024-04-03T05:13:59.110390+0000","last_undegraded":"2024-04-03T05:13:59.110390+0000","last_fullsized":"2024-04-03T05:13:59.110390+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:55:34.004187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2269,"num_read_kb":2119,"num_write":527,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'296","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.805558+0000","last_change":"2024-04-03T03:38:57.871292+0000","last_active":"2024-04-03T05:14:07.805558+0000","last_peered":"2024-04-03T05:14:07.805558+0000","last_clean":"2024-04-03T05:14:07.805558+0000","last_became_active":"2024-04-03T03:38:57.870251+0000","last_became_peered":"2024-04-03T03:38:57.870251+0000","last_unstale":"2024-04-03T05:14:07.805558+0000","last_undegraded":"2024-04-03T05:14:07.805558+0000","last_fullsized":"2024-04-03T05:14:07.805558+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:41.934446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2272671,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":600,"num_read_kb":14924,"num_write":1365,"num_write_kb":20295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:53.000142+0000","last_change":"2024-04-03T03:38:28.729101+0000","last_active":"2024-04-03T05:09:53.000142+0000","last_peered":"2024-04-03T05:09:53.000142+0000","last_clean":"2024-04-03T05:09:53.000142+0000","last_became_active":"2024-04-03T03:38:28.728632+0000","last_became_peered":"2024-04-03T03:38:28.728632+0000","last_unstale":"2024-04-03T05:09:53.000142+0000","last_undegraded":"2024-04-03T05:09:53.000142+0000","last_fullsized":"2024-04-03T05:09:53.000142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:02:19.986062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'120","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.625381+0000","last_change":"2024-04-03T03:38:30.731626+0000","last_active":"2024-04-03T05:10:23.625381+0000","last_peered":"2024-04-03T05:10:23.625381+0000","last_clean":"2024-04-03T05:10:23.625381+0000","last_became_active":"2024-04-03T03:38:30.730797+0000","last_became_peered":"2024-04-03T03:38:30.730797+0000","last_unstale":"2024-04-03T05:10:23.625381+0000","last_undegraded":"2024-04-03T05:10:23.625381+0000","last_fullsized":"2024-04-03T05:10:23.625381+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:20.134850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":139,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.625339+0000","last_change":"2024-04-03T03:38:32.733871+0000","last_active":"2024-04-03T05:10:23.625339+0000","last_peered":"2024-04-03T05:10:23.625339+0000","last_clean":"2024-04-03T05:10:23.625339+0000","last_became_active":"2024-04-03T03:38:32.732994+0000","last_became_peered":"2024-04-03T03:38:32.732994+0000","last_unstale":"2024-04-03T05:10:23.625339+0000","last_undegraded":"2024-04-03T05:10:23.625339+0000","last_fullsized":"2024-04-03T05:10:23.625339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:01.913002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'106","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062730+0000","last_change":"2024-04-03T03:38:34.746933+0000","last_active":"2024-04-03T05:11:08.062730+0000","last_peered":"2024-04-03T05:11:08.062730+0000","last_clean":"2024-04-03T05:11:08.062730+0000","last_became_active":"2024-04-03T03:38:34.746126+0000","last_became_peered":"2024-04-03T03:38:34.746126+0000","last_unstale":"2024-04-03T05:11:08.062730+0000","last_undegraded":"2024-04-03T05:11:08.062730+0000","last_fullsized":"2024-04-03T05:11:08.062730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:08:36.510470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":113,"num_write":252,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'388","reported_seq":1870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.596727+0000","last_change":"2024-04-03T03:38:26.725947+0000","last_active":"2024-04-03T05:10:43.596727+0000","last_peered":"2024-04-03T05:10:43.596727+0000","last_clean":"2024-04-03T05:10:43.596727+0000","last_became_active":"2024-04-03T03:38:26.724468+0000","last_became_peered":"2024-04-03T03:38:26.724468+0000","last_unstale":"2024-04-03T05:10:43.596727+0000","last_undegraded":"2024-04-03T05:10:43.596727+0000","last_fullsized":"2024-04-03T05:10:43.596727+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:46:05.423762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1964,"num_write":459,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'299","reported_seq":1126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.000214+0000","last_change":"2024-04-03T03:38:24.733041+0000","last_active":"2024-04-03T05:14:09.000214+0000","last_peered":"2024-04-03T05:14:09.000214+0000","last_clean":"2024-04-03T05:14:09.000214+0000","last_became_active":"2024-04-03T03:38:24.732182+0000","last_became_peered":"2024-04-03T03:38:24.732182+0000","last_unstale":"2024-04-03T05:14:09.000214+0000","last_undegraded":"2024-04-03T05:14:09.000214+0000","last_fullsized":"2024-04-03T05:14:09.000214+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:04:10.217131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5577205,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":829,"num_read_kb":9858,"num_write":1174,"num_write_kb":55489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.007355+0000","last_change":"2024-04-03T03:38:28.733914+0000","last_active":"2024-04-03T05:10:23.007355+0000","last_peered":"2024-04-03T05:10:23.007355+0000","last_clean":"2024-04-03T05:10:23.007355+0000","last_became_active":"2024-04-03T03:38:28.733142+0000","last_became_peered":"2024-04-03T03:38:28.733142+0000","last_unstale":"2024-04-03T05:10:23.007355+0000","last_undegraded":"2024-04-03T05:10:23.007355+0000","last_fullsized":"2024-04-03T05:10:23.007355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:59:55.469233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'170","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:57.811949+0000","last_change":"2024-04-03T03:38:30.735680+0000","last_active":"2024-04-03T05:09:57.811949+0000","last_peered":"2024-04-03T05:09:57.811949+0000","last_clean":"2024-04-03T05:09:57.811949+0000","last_became_active":"2024-04-03T03:38:30.734934+0000","last_became_peered":"2024-04-03T03:38:30.734934+0000","last_unstale":"2024-04-03T05:09:57.811949+0000","last_undegraded":"2024-04-03T05:09:57.811949+0000","last_fullsized":"2024-04-03T05:09:57.811949+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:03.598253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'514","reported_seq":2435,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.494677+0000","last_change":"2024-04-03T03:38:32.749915+0000","last_active":"2024-04-03T05:14:07.494677+0000","last_peered":"2024-04-03T05:14:07.494677+0000","last_clean":"2024-04-03T05:14:07.494677+0000","last_became_active":"2024-04-03T03:38:32.748836+0000","last_became_peered":"2024-04-03T03:38:32.748836+0000","last_unstale":"2024-04-03T05:14:07.494677+0000","last_undegraded":"2024-04-03T05:14:07.494677+0000","last_fullsized":"2024-04-03T05:14:07.494677+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:20:14.250362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'104","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.635415+0000","last_change":"2024-04-03T03:38:34.941018+0000","last_active":"2024-04-03T05:11:08.635415+0000","last_peered":"2024-04-03T05:11:08.635415+0000","last_clean":"2024-04-03T05:11:08.635415+0000","last_became_active":"2024-04-03T03:38:34.940390+0000","last_became_peered":"2024-04-03T03:38:34.940390+0000","last_unstale":"2024-04-03T05:11:08.635415+0000","last_undegraded":"2024-04-03T05:11:08.635415+0000","last_fullsized":"2024-04-03T05:11:08.635415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:47.643064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'569","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398822+0000","last_change":"2024-04-03T03:38:26.718097+0000","last_active":"2024-04-03T05:11:18.398822+0000","last_peered":"2024-04-03T05:11:18.398822+0000","last_clean":"2024-04-03T05:11:18.398822+0000","last_became_active":"2024-04-03T03:38:26.717394+0000","last_became_peered":"2024-04-03T03:38:26.717394+0000","last_unstale":"2024-04-03T05:11:18.398822+0000","last_undegraded":"2024-04-03T05:11:18.398822+0000","last_fullsized":"2024-04-03T05:11:18.398822+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:36.179522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2983,"num_read_kb":2733,"num_write":743,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'288","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.042350+0000","last_change":"2024-04-03T03:38:24.762461+0000","last_active":"2024-04-03T05:14:09.042350+0000","last_peered":"2024-04-03T05:14:09.042350+0000","last_clean":"2024-04-03T05:14:09.042350+0000","last_became_active":"2024-04-03T03:38:24.761913+0000","last_became_peered":"2024-04-03T03:38:24.761913+0000","last_unstale":"2024-04-03T05:14:09.042350+0000","last_undegraded":"2024-04-03T05:14:09.042350+0000","last_fullsized":"2024-04-03T05:14:09.042350+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:18:50.867012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245582,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":470,"num_read_kb":83386,"num_write":1117,"num_write_kb":33117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818707+0000","last_change":"2024-04-03T03:38:28.731460+0000","last_active":"2024-04-03T05:10:18.818707+0000","last_peered":"2024-04-03T05:10:18.818707+0000","last_clean":"2024-04-03T05:10:18.818707+0000","last_became_active":"2024-04-03T03:38:28.730711+0000","last_became_peered":"2024-04-03T03:38:28.730711+0000","last_unstale":"2024-04-03T05:10:18.818707+0000","last_undegraded":"2024-04-03T05:10:18.818707+0000","last_fullsized":"2024-04-03T05:10:18.818707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:32.235397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'298","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.481180+0000","last_change":"2024-04-03T03:38:30.825170+0000","last_active":"2024-04-03T05:14:00.481180+0000","last_peered":"2024-04-03T05:14:00.481180+0000","last_clean":"2024-04-03T05:14:00.481180+0000","last_became_active":"2024-04-03T03:38:30.824397+0000","last_became_peered":"2024-04-03T03:38:30.824397+0000","last_unstale":"2024-04-03T05:14:00.481180+0000","last_undegraded":"2024-04-03T05:14:00.481180+0000","last_fullsized":"2024-04-03T05:14:00.481180+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:35:06.339872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":979,"num_write":388,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'551","reported_seq":4238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.506225+0000","last_change":"2024-04-03T03:38:32.744325+0000","last_active":"2024-04-03T05:14:07.506225+0000","last_peered":"2024-04-03T05:14:07.506225+0000","last_clean":"2024-04-03T05:14:07.506225+0000","last_became_active":"2024-04-03T03:38:32.743645+0000","last_became_peered":"2024-04-03T03:38:32.743645+0000","last_unstale":"2024-04-03T05:14:07.506225+0000","last_undegraded":"2024-04-03T05:14:07.506225+0000","last_fullsized":"2024-04-03T05:14:07.506225+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:07:29.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1050","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.140148+0000","last_change":"2024-04-03T03:38:26.726712+0000","last_active":"2024-04-03T05:13:59.140148+0000","last_peered":"2024-04-03T05:13:59.140148+0000","last_clean":"2024-04-03T05:13:59.140148+0000","last_became_active":"2024-04-03T03:38:26.726039+0000","last_became_peered":"2024-04-03T03:38:26.726039+0000","last_unstale":"2024-04-03T05:13:59.140148+0000","last_undegraded":"2024-04-03T05:13:59.140148+0000","last_fullsized":"2024-04-03T05:13:59.140148+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:40:13.491224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4374,"num_read_kb":3788,"num_write":1482,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'334","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.018676+0000","last_change":"2024-04-03T03:38:24.754120+0000","last_active":"2024-04-03T05:14:09.018676+0000","last_peered":"2024-04-03T05:14:09.018676+0000","last_clean":"2024-04-03T05:14:09.018676+0000","last_became_active":"2024-04-03T03:38:24.752543+0000","last_became_peered":"2024-04-03T03:38:24.752543+0000","last_unstale":"2024-04-03T05:14:09.018676+0000","last_undegraded":"2024-04-03T05:14:09.018676+0000","last_fullsized":"2024-04-03T05:14:09.018676+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:09:55.105836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10141901,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":483,"num_read_kb":24934,"num_write":1114,"num_write_kb":21782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.042244+0000","last_change":"2024-04-03T03:38:28.738400+0000","last_active":"2024-04-03T05:11:39.042244+0000","last_peered":"2024-04-03T05:11:39.042244+0000","last_clean":"2024-04-03T05:11:39.042244+0000","last_became_active":"2024-04-03T03:38:28.737738+0000","last_became_peered":"2024-04-03T03:38:28.737738+0000","last_unstale":"2024-04-03T05:11:39.042244+0000","last_undegraded":"2024-04-03T05:11:39.042244+0000","last_fullsized":"2024-04-03T05:11:39.042244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:12:06.496501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'417","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.507852+0000","last_change":"2024-04-03T03:38:30.823152+0000","last_active":"2024-04-03T05:14:00.507852+0000","last_peered":"2024-04-03T05:14:00.507852+0000","last_clean":"2024-04-03T05:14:00.507852+0000","last_became_active":"2024-04-03T03:38:30.822389+0000","last_became_peered":"2024-04-03T03:38:30.822389+0000","last_unstale":"2024-04-03T05:14:00.507852+0000","last_undegraded":"2024-04-03T05:14:00.507852+0000","last_fullsized":"2024-04-03T05:14:00.507852+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:41:29.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50957,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":660,"num_read_kb":1135,"num_write":500,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830178+0000","last_change":"2024-04-03T03:38:32.731693+0000","last_active":"2024-04-03T05:10:47.830178+0000","last_peered":"2024-04-03T05:10:47.830178+0000","last_clean":"2024-04-03T05:10:47.830178+0000","last_became_active":"2024-04-03T03:38:32.730901+0000","last_became_peered":"2024-04-03T03:38:32.730901+0000","last_unstale":"2024-04-03T05:10:47.830178+0000","last_undegraded":"2024-04-03T05:10:47.830178+0000","last_fullsized":"2024-04-03T05:10:47.830178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:15:01.774475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'539","reported_seq":1368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.544147+0000","last_change":"2024-04-03T03:38:34.756576+0000","last_active":"2024-04-03T05:14:00.544147+0000","last_peered":"2024-04-03T05:14:00.544147+0000","last_clean":"2024-04-03T05:14:00.544147+0000","last_became_active":"2024-04-03T03:38:34.754300+0000","last_became_peered":"2024-04-03T03:38:34.754300+0000","last_unstale":"2024-04-03T05:14:00.544147+0000","last_undegraded":"2024-04-03T05:14:00.544147+0000","last_fullsized":"2024-04-03T05:14:00.544147+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:49.037819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1265,"num_read_kb":1263,"num_write":1135,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'842","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.143894+0000","last_change":"2024-04-03T03:38:26.749563+0000","last_active":"2024-04-03T05:13:59.143894+0000","last_peered":"2024-04-03T05:13:59.143894+0000","last_clean":"2024-04-03T05:13:59.143894+0000","last_became_active":"2024-04-03T03:38:26.742328+0000","last_became_peered":"2024-04-03T03:38:26.742328+0000","last_unstale":"2024-04-03T05:13:59.143894+0000","last_undegraded":"2024-04-03T05:13:59.143894+0000","last_fullsized":"2024-04-03T05:13:59.143894+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:14:05.259556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3790,"num_read_kb":3360,"num_write":1145,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'322","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.742373+0000","last_change":"2024-04-03T03:38:58.349005+0000","last_active":"2024-04-03T05:14:07.742373+0000","last_peered":"2024-04-03T05:14:07.742373+0000","last_clean":"2024-04-03T05:14:07.742373+0000","last_became_active":"2024-04-03T03:38:58.348120+0000","last_became_peered":"2024-04-03T03:38:58.348120+0000","last_unstale":"2024-04-03T05:14:07.742373+0000","last_undegraded":"2024-04-03T05:14:07.742373+0000","last_fullsized":"2024-04-03T05:14:07.742373+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:15.110906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2892940,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":627,"num_read_kb":8001,"num_write":1258,"num_write_kb":23217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834543+0000","last_change":"2024-04-03T03:38:28.731205+0000","last_active":"2024-04-03T05:11:42.834543+0000","last_peered":"2024-04-03T05:11:42.834543+0000","last_clean":"2024-04-03T05:11:42.834543+0000","last_became_active":"2024-04-03T03:38:28.729832+0000","last_became_peered":"2024-04-03T03:38:28.729832+0000","last_unstale":"2024-04-03T05:11:42.834543+0000","last_undegraded":"2024-04-03T05:11:42.834543+0000","last_fullsized":"2024-04-03T05:11:42.834543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:46.103991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'312","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.054867+0000","last_change":"2024-04-03T03:38:30.721619+0000","last_active":"2024-04-03T05:14:08.054867+0000","last_peered":"2024-04-03T05:14:08.054867+0000","last_clean":"2024-04-03T05:14:08.054867+0000","last_became_active":"2024-04-03T03:38:30.720884+0000","last_became_peered":"2024-04-03T03:38:30.720884+0000","last_unstale":"2024-04-03T05:14:08.054867+0000","last_undegraded":"2024-04-03T05:14:08.054867+0000","last_fullsized":"2024-04-03T05:14:08.054867+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:01:23.554077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1184,"num_write":408,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:52.999988+0000","last_change":"2024-04-03T03:38:32.742446+0000","last_active":"2024-04-03T05:09:52.999988+0000","last_peered":"2024-04-03T05:09:52.999988+0000","last_clean":"2024-04-03T05:09:52.999988+0000","last_became_active":"2024-04-03T03:38:32.741770+0000","last_became_peered":"2024-04-03T03:38:32.741770+0000","last_unstale":"2024-04-03T05:09:52.999988+0000","last_undegraded":"2024-04-03T05:09:52.999988+0000","last_fullsized":"2024-04-03T05:09:52.999988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:03:05.043052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'85","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:44.033021+0000","last_change":"2024-04-03T03:38:34.734633+0000","last_active":"2024-04-03T05:12:44.033021+0000","last_peered":"2024-04-03T05:12:44.033021+0000","last_clean":"2024-04-03T05:12:44.033021+0000","last_became_active":"2024-04-03T03:38:34.733896+0000","last_became_peered":"2024-04-03T03:38:34.733896+0000","last_unstale":"2024-04-03T05:12:44.033021+0000","last_undegraded":"2024-04-03T05:12:44.033021+0000","last_fullsized":"2024-04-03T05:12:44.033021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:01:46.697380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'718","reported_seq":2130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.188828+0000","last_change":"2024-04-03T03:38:26.735283+0000","last_active":"2024-04-03T05:13:59.188828+0000","last_peered":"2024-04-03T05:13:59.188828+0000","last_clean":"2024-04-03T05:13:59.188828+0000","last_became_active":"2024-04-03T03:38:26.734518+0000","last_became_peered":"2024-04-03T03:38:26.734518+0000","last_unstale":"2024-04-03T05:13:59.188828+0000","last_undegraded":"2024-04-03T05:13:59.188828+0000","last_fullsized":"2024-04-03T05:13:59.188828+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:24:23.571507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3204,"num_read_kb":2862,"num_write":964,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'306","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.000287+0000","last_change":"2024-04-03T03:38:24.759103+0000","last_active":"2024-04-03T05:14:09.000287+0000","last_peered":"2024-04-03T05:14:09.000287+0000","last_clean":"2024-04-03T05:14:09.000287+0000","last_became_active":"2024-04-03T03:38:24.758401+0000","last_became_peered":"2024-04-03T03:38:24.758401+0000","last_unstale":"2024-04-03T05:14:09.000287+0000","last_undegraded":"2024-04-03T05:14:09.000287+0000","last_fullsized":"2024-04-03T05:14:09.000287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:49:27.974853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5289818,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":639,"num_read_kb":12991,"num_write":1234,"num_write_kb":25567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.822882+0000","last_change":"2024-04-03T03:38:28.731957+0000","last_active":"2024-04-03T05:10:47.822882+0000","last_peered":"2024-04-03T05:10:47.822882+0000","last_clean":"2024-04-03T05:10:47.822882+0000","last_became_active":"2024-04-03T03:38:28.731257+0000","last_became_peered":"2024-04-03T03:38:28.731257+0000","last_unstale":"2024-04-03T05:10:47.822882+0000","last_undegraded":"2024-04-03T05:10:47.822882+0000","last_fullsized":"2024-04-03T05:10:47.822882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:02:15.763718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'335","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.514743+0000","last_change":"2024-04-03T03:38:30.734366+0000","last_active":"2024-04-03T05:14:00.514743+0000","last_peered":"2024-04-03T05:14:00.514743+0000","last_clean":"2024-04-03T05:14:00.514743+0000","last_became_active":"2024-04-03T03:38:30.732417+0000","last_became_peered":"2024-04-03T03:38:30.732417+0000","last_unstale":"2024-04-03T05:14:00.514743+0000","last_undegraded":"2024-04-03T05:14:00.514743+0000","last_fullsized":"2024-04-03T05:14:00.514743+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:17:12.716764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57769,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":543,"num_read_kb":996,"num_write":416,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'544","reported_seq":3037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.510526+0000","last_change":"2024-04-03T03:38:32.746838+0000","last_active":"2024-04-03T05:14:07.510526+0000","last_peered":"2024-04-03T05:14:07.510526+0000","last_clean":"2024-04-03T05:14:07.510526+0000","last_became_active":"2024-04-03T03:38:32.746029+0000","last_became_peered":"2024-04-03T03:38:32.746029+0000","last_unstale":"2024-04-03T05:14:07.510526+0000","last_undegraded":"2024-04-03T05:14:07.510526+0000","last_fullsized":"2024-04-03T05:14:07.510526+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:35:26.100890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'94","reported_seq":605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:58.856544+0000","last_change":"2024-04-03T03:38:34.742226+0000","last_active":"2024-04-03T05:13:58.856544+0000","last_peered":"2024-04-03T05:13:58.856544+0000","last_clean":"2024-04-03T05:13:58.856544+0000","last_became_active":"2024-04-03T03:38:34.741505+0000","last_became_peered":"2024-04-03T03:38:34.741505+0000","last_unstale":"2024-04-03T05:13:58.856544+0000","last_undegraded":"2024-04-03T05:13:58.856544+0000","last_fullsized":"2024-04-03T05:13:58.856544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:35:43.800179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'443","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.121620+0000","last_change":"2024-04-03T03:38:26.732154+0000","last_active":"2024-04-03T05:13:59.121620+0000","last_peered":"2024-04-03T05:13:59.121620+0000","last_clean":"2024-04-03T05:13:59.121620+0000","last_became_active":"2024-04-03T03:38:26.731734+0000","last_became_peered":"2024-04-03T03:38:26.731734+0000","last_unstale":"2024-04-03T05:13:59.121620+0000","last_undegraded":"2024-04-03T05:13:59.121620+0000","last_fullsized":"2024-04-03T05:13:59.121620+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:33:11.766451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2428,"num_write":531,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'276","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.723158+0000","last_change":"2024-04-03T03:38:24.749540+0000","last_active":"2024-04-03T05:14:08.723158+0000","last_peered":"2024-04-03T05:14:08.723158+0000","last_clean":"2024-04-03T05:14:08.723158+0000","last_became_active":"2024-04-03T03:38:24.748646+0000","last_became_peered":"2024-04-03T03:38:24.748646+0000","last_unstale":"2024-04-03T05:14:08.723158+0000","last_undegraded":"2024-04-03T05:14:08.723158+0000","last_fullsized":"2024-04-03T05:14:08.723158+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:57:53.191419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262597,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":630,"num_read_kb":9921,"num_write":1161,"num_write_kb":21025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"35'5","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.028985+0000","last_change":"2024-04-03T03:38:28.733706+0000","last_active":"2024-04-03T05:14:07.028985+0000","last_peered":"2024-04-03T05:14:07.028985+0000","last_clean":"2024-04-03T05:14:07.028985+0000","last_became_active":"2024-04-03T03:38:28.733096+0000","last_became_peered":"2024-04-03T03:38:28.733096+0000","last_unstale":"2024-04-03T05:14:07.028985+0000","last_undegraded":"2024-04-03T05:14:07.028985+0000","last_fullsized":"2024-04-03T05:14:07.028985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:10:00.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":788,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'494","reported_seq":1166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.532717+0000","last_change":"2024-04-03T03:38:30.730692+0000","last_active":"2024-04-03T05:14:07.532717+0000","last_peered":"2024-04-03T05:14:07.532717+0000","last_clean":"2024-04-03T05:14:07.532717+0000","last_became_active":"2024-04-03T03:38:30.729624+0000","last_became_peered":"2024-04-03T03:38:30.729624+0000","last_unstale":"2024-04-03T05:14:07.532717+0000","last_undegraded":"2024-04-03T05:14:07.532717+0000","last_fullsized":"2024-04-03T05:14:07.532717+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:45:22.992777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":837,"num_read_kb":1824,"num_write":678,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834483+0000","last_change":"2024-04-03T03:38:32.749162+0000","last_active":"2024-04-03T05:11:42.834483+0000","last_peered":"2024-04-03T05:11:42.834483+0000","last_clean":"2024-04-03T05:11:42.834483+0000","last_became_active":"2024-04-03T03:38:32.746634+0000","last_became_peered":"2024-04-03T03:38:32.746634+0000","last_unstale":"2024-04-03T05:11:42.834483+0000","last_undegraded":"2024-04-03T05:11:42.834483+0000","last_fullsized":"2024-04-03T05:11:42.834483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:19:34.062410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'90","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.848438+0000","last_change":"2024-04-03T03:38:34.731395+0000","last_active":"2024-04-03T05:11:47.848438+0000","last_peered":"2024-04-03T05:11:47.848438+0000","last_clean":"2024-04-03T05:11:47.848438+0000","last_became_active":"2024-04-03T03:38:34.730714+0000","last_became_peered":"2024-04-03T03:38:34.730714+0000","last_unstale":"2024-04-03T05:11:47.848438+0000","last_undegraded":"2024-04-03T05:11:47.848438+0000","last_fullsized":"2024-04-03T05:11:47.848438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:51:40.746014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":214,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'707","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:01.902920+0000","last_change":"2024-04-03T03:39:58.685134+0000","last_active":"2024-04-03T05:11:01.902920+0000","last_peered":"2024-04-03T05:11:01.902920+0000","last_clean":"2024-04-03T05:11:01.902920+0000","last_became_active":"2024-04-03T03:39:58.684099+0000","last_became_peered":"2024-04-03T03:39:58.684099+0000","last_unstale":"2024-04-03T05:11:01.902920+0000","last_undegraded":"2024-04-03T05:11:01.902920+0000","last_fullsized":"2024-04-03T05:11:01.902920+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:24.723504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3233,"num_read_kb":2920,"num_write":926,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'281","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.716850+0000","last_change":"2024-04-03T03:38:57.880756+0000","last_active":"2024-04-03T05:14:07.716850+0000","last_peered":"2024-04-03T05:14:07.716850+0000","last_clean":"2024-04-03T05:14:07.716850+0000","last_became_active":"2024-04-03T03:38:57.880334+0000","last_became_peered":"2024-04-03T03:38:57.880334+0000","last_unstale":"2024-04-03T05:14:07.716850+0000","last_undegraded":"2024-04-03T05:14:07.716850+0000","last_fullsized":"2024-04-03T05:14:07.716850+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:59.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8986016,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":480,"num_read_kb":83385,"num_write":1118,"num_write_kb":48172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.823008+0000","last_change":"2024-04-03T03:38:28.735727+0000","last_active":"2024-04-03T05:10:47.823008+0000","last_peered":"2024-04-03T05:10:47.823008+0000","last_clean":"2024-04-03T05:10:47.823008+0000","last_became_active":"2024-04-03T03:38:28.735217+0000","last_became_peered":"2024-04-03T03:38:28.735217+0000","last_unstale":"2024-04-03T05:10:47.823008+0000","last_undegraded":"2024-04-03T05:10:47.823008+0000","last_fullsized":"2024-04-03T05:10:47.823008+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:47.141174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'344","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.588874+0000","last_change":"2024-04-03T03:38:30.717823+0000","last_active":"2024-04-03T05:14:08.588874+0000","last_peered":"2024-04-03T05:14:08.588874+0000","last_clean":"2024-04-03T05:14:08.588874+0000","last_became_active":"2024-04-03T03:38:30.716983+0000","last_became_peered":"2024-04-03T03:38:30.716983+0000","last_unstale":"2024-04-03T05:14:08.588874+0000","last_undegraded":"2024-04-03T05:14:08.588874+0000","last_fullsized":"2024-04-03T05:14:08.588874+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:58:18.745061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78494,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":1274,"num_write":529,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:13.063766+0000","last_change":"2024-04-03T03:38:32.738099+0000","last_active":"2024-04-03T05:11:13.063766+0000","last_peered":"2024-04-03T05:11:13.063766+0000","last_clean":"2024-04-03T05:11:13.063766+0000","last_became_active":"2024-04-03T03:38:32.737619+0000","last_became_peered":"2024-04-03T03:38:32.737619+0000","last_unstale":"2024-04-03T05:11:13.063766+0000","last_undegraded":"2024-04-03T05:11:13.063766+0000","last_fullsized":"2024-04-03T05:11:13.063766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:01.783659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'102","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.044667+0000","last_change":"2024-04-03T03:38:34.755669+0000","last_active":"2024-04-03T05:12:58.044667+0000","last_peered":"2024-04-03T05:12:58.044667+0000","last_clean":"2024-04-03T05:12:58.044667+0000","last_became_active":"2024-04-03T03:38:34.754907+0000","last_became_peered":"2024-04-03T03:38:34.754907+0000","last_unstale":"2024-04-03T05:12:58.044667+0000","last_undegraded":"2024-04-03T05:12:58.044667+0000","last_fullsized":"2024-04-03T05:12:58.044667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:49.625336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":237,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'876","reported_seq":2630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.221358+0000","last_change":"2024-04-03T03:38:26.741422+0000","last_active":"2024-04-03T05:12:22.221358+0000","last_peered":"2024-04-03T05:12:22.221358+0000","last_clean":"2024-04-03T05:12:22.221358+0000","last_became_active":"2024-04-03T03:38:26.740674+0000","last_became_peered":"2024-04-03T03:38:26.740674+0000","last_unstale":"2024-04-03T05:12:22.221358+0000","last_undegraded":"2024-04-03T05:12:22.221358+0000","last_fullsized":"2024-04-03T05:12:22.221358+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:32.052642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4230,"num_read_kb":3805,"num_write":1201,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'251","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.782344+0000","last_change":"2024-04-03T03:38:58.345059+0000","last_active":"2024-04-03T05:14:07.782344+0000","last_peered":"2024-04-03T05:14:07.782344+0000","last_clean":"2024-04-03T05:14:07.782344+0000","last_became_active":"2024-04-03T03:38:58.344044+0000","last_became_peered":"2024-04-03T03:38:58.344044+0000","last_unstale":"2024-04-03T05:14:07.782344+0000","last_undegraded":"2024-04-03T05:14:07.782344+0000","last_fullsized":"2024-04-03T05:14:07.782344+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:56.276421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13392985,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":405,"num_read_kb":45117,"num_write":1082,"num_write_kb":60620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830246+0000","last_change":"2024-04-03T03:38:28.716186+0000","last_active":"2024-04-03T05:10:47.830246+0000","last_peered":"2024-04-03T05:10:47.830246+0000","last_clean":"2024-04-03T05:10:47.830246+0000","last_became_active":"2024-04-03T03:38:28.715394+0000","last_became_peered":"2024-04-03T03:38:28.715394+0000","last_unstale":"2024-04-03T05:10:47.830246+0000","last_undegraded":"2024-04-03T05:10:47.830246+0000","last_fullsized":"2024-04-03T05:10:47.830246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:46.237254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'336","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.730658+0000","last_change":"2024-04-03T03:38:30.733851+0000","last_active":"2024-04-03T05:14:07.730658+0000","last_peered":"2024-04-03T05:14:07.730658+0000","last_clean":"2024-04-03T05:14:07.730658+0000","last_became_active":"2024-04-03T03:38:30.733001+0000","last_became_peered":"2024-04-03T03:38:30.733001+0000","last_unstale":"2024-04-03T05:14:07.730658+0000","last_undegraded":"2024-04-03T05:14:07.730658+0000","last_fullsized":"2024-04-03T05:14:07.730658+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:49:06.273548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1151,"num_write":432,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'498","reported_seq":2366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.497894+0000","last_change":"2024-04-03T03:38:32.741613+0000","last_active":"2024-04-03T05:14:07.497894+0000","last_peered":"2024-04-03T05:14:07.497894+0000","last_clean":"2024-04-03T05:14:07.497894+0000","last_became_active":"2024-04-03T03:38:32.740883+0000","last_became_peered":"2024-04-03T03:38:32.740883+0000","last_unstale":"2024-04-03T05:14:07.497894+0000","last_undegraded":"2024-04-03T05:14:07.497894+0000","last_fullsized":"2024-04-03T05:14:07.497894+0000","mapping_epoch":31,"log_start":"258'400","ondisk_log_start":"258'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:10:34.038922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'91","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:17.980790+0000","last_change":"2024-04-03T03:38:34.749468+0000","last_active":"2024-04-03T05:10:17.980790+0000","last_peered":"2024-04-03T05:10:17.980790+0000","last_clean":"2024-04-03T05:10:17.980790+0000","last_became_active":"2024-04-03T03:38:34.748128+0000","last_became_peered":"2024-04-03T03:38:34.748128+0000","last_unstale":"2024-04-03T05:10:17.980790+0000","last_undegraded":"2024-04-03T05:10:17.980790+0000","last_fullsized":"2024-04-03T05:10:17.980790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:41:37.569030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":229,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'412","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.286549+0000","last_change":"2024-04-03T03:38:26.746310+0000","last_active":"2024-04-03T05:11:29.286549+0000","last_peered":"2024-04-03T05:11:29.286549+0000","last_clean":"2024-04-03T05:11:29.286549+0000","last_became_active":"2024-04-03T03:38:26.742254+0000","last_became_peered":"2024-04-03T03:38:26.742254+0000","last_unstale":"2024-04-03T05:11:29.286549+0000","last_undegraded":"2024-04-03T05:11:29.286549+0000","last_fullsized":"2024-04-03T05:11:29.286549+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:45:43.364326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2115,"num_read_kb":2003,"num_write":485,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'300","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.509714+0000","last_change":"2024-04-03T03:38:24.713564+0000","last_active":"2024-04-03T05:14:08.509714+0000","last_peered":"2024-04-03T05:14:08.509714+0000","last_clean":"2024-04-03T05:14:08.509714+0000","last_became_active":"2024-04-03T03:38:24.710396+0000","last_became_peered":"2024-04-03T03:38:24.710396+0000","last_unstale":"2024-04-03T05:14:08.509714+0000","last_undegraded":"2024-04-03T05:14:08.509714+0000","last_fullsized":"2024-04-03T05:14:08.509714+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:04:14.187436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13922337,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":468,"num_read_kb":39635,"num_write":1222,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.041945+0000","last_change":"2024-04-03T03:38:28.735630+0000","last_active":"2024-04-03T05:14:07.041945+0000","last_peered":"2024-04-03T05:14:07.041945+0000","last_clean":"2024-04-03T05:14:07.041945+0000","last_became_active":"2024-04-03T03:38:28.734894+0000","last_became_peered":"2024-04-03T03:38:28.734894+0000","last_unstale":"2024-04-03T05:14:07.041945+0000","last_undegraded":"2024-04-03T05:14:07.041945+0000","last_fullsized":"2024-04-03T05:14:07.041945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:06.360323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":632,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'126","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013371+0000","last_change":"2024-04-03T03:38:30.822812+0000","last_active":"2024-04-03T05:10:48.013371+0000","last_peered":"2024-04-03T05:10:48.013371+0000","last_clean":"2024-04-03T05:10:48.013371+0000","last_became_active":"2024-04-03T03:38:30.821224+0000","last_became_peered":"2024-04-03T03:38:30.821224+0000","last_unstale":"2024-04-03T05:10:48.013371+0000","last_undegraded":"2024-04-03T05:10:48.013371+0000","last_fullsized":"2024-04-03T05:10:48.013371+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:32:28.000773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'525","reported_seq":2472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.503319+0000","last_change":"2024-04-03T03:38:32.748028+0000","last_active":"2024-04-03T05:14:07.503319+0000","last_peered":"2024-04-03T05:14:07.503319+0000","last_clean":"2024-04-03T05:14:07.503319+0000","last_became_active":"2024-04-03T03:38:32.747078+0000","last_became_peered":"2024-04-03T03:38:32.747078+0000","last_unstale":"2024-04-03T05:14:07.503319+0000","last_undegraded":"2024-04-03T05:14:07.503319+0000","last_fullsized":"2024-04-03T05:14:07.503319+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:21.612026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'98","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:58.857389+0000","last_change":"2024-04-03T03:38:34.740348+0000","last_active":"2024-04-03T05:13:58.857389+0000","last_peered":"2024-04-03T05:13:58.857389+0000","last_clean":"2024-04-03T05:13:58.857389+0000","last_became_active":"2024-04-03T03:38:34.739554+0000","last_became_peered":"2024-04-03T03:38:34.739554+0000","last_unstale":"2024-04-03T05:13:58.857389+0000","last_undegraded":"2024-04-03T05:13:58.857389+0000","last_fullsized":"2024-04-03T05:13:58.857389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:59:41.957959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'345","reported_seq":1750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:07.839480+0000","last_change":"2024-04-03T03:38:26.729619+0000","last_active":"2024-04-03T05:11:07.839480+0000","last_peered":"2024-04-03T05:11:07.839480+0000","last_clean":"2024-04-03T05:11:07.839480+0000","last_became_active":"2024-04-03T03:38:26.729241+0000","last_became_peered":"2024-04-03T03:38:26.729241+0000","last_unstale":"2024-04-03T05:11:07.839480+0000","last_undegraded":"2024-04-03T05:11:07.839480+0000","last_fullsized":"2024-04-03T05:11:07.839480+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:27:27.602414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1840,"num_read_kb":1751,"num_write":396,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'245","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.025576+0000","last_change":"2024-04-03T03:38:24.715501+0000","last_active":"2024-04-03T05:14:08.025576+0000","last_peered":"2024-04-03T05:14:08.025576+0000","last_clean":"2024-04-03T05:14:08.025576+0000","last_became_active":"2024-04-03T03:38:24.709105+0000","last_became_peered":"2024-04-03T03:38:24.709105+0000","last_unstale":"2024-04-03T05:14:08.025576+0000","last_undegraded":"2024-04-03T05:14:08.025576+0000","last_fullsized":"2024-04-03T05:14:08.025576+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:59:29.586390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15092362,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":358,"num_read_kb":67615,"num_write":1013,"num_write_kb":19160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.629640+0000","last_change":"2024-04-03T03:38:28.730578+0000","last_active":"2024-04-03T05:10:43.629640+0000","last_peered":"2024-04-03T05:10:43.629640+0000","last_clean":"2024-04-03T05:10:43.629640+0000","last_became_active":"2024-04-03T03:38:28.729835+0000","last_became_peered":"2024-04-03T03:38:28.729835+0000","last_unstale":"2024-04-03T05:10:43.629640+0000","last_undegraded":"2024-04-03T05:10:43.629640+0000","last_fullsized":"2024-04-03T05:10:43.629640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:23.115894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'507","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.498625+0000","last_change":"2024-04-03T03:38:30.730361+0000","last_active":"2024-04-03T05:14:00.498625+0000","last_peered":"2024-04-03T05:14:00.498625+0000","last_clean":"2024-04-03T05:14:00.498625+0000","last_became_active":"2024-04-03T03:38:30.729797+0000","last_became_peered":"2024-04-03T03:38:30.729797+0000","last_unstale":"2024-04-03T05:14:00.498625+0000","last_undegraded":"2024-04-03T05:14:00.498625+0000","last_fullsized":"2024-04-03T05:14:00.498625+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:13:30.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59692,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1375,"num_read_kb":1864,"num_write":1976,"num_write_kb":1774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.004650+0000","last_change":"2024-04-03T03:38:32.739831+0000","last_active":"2024-04-03T05:10:49.004650+0000","last_peered":"2024-04-03T05:10:49.004650+0000","last_clean":"2024-04-03T05:10:49.004650+0000","last_became_active":"2024-04-03T03:38:32.738974+0000","last_became_peered":"2024-04-03T03:38:32.738974+0000","last_unstale":"2024-04-03T05:10:49.004650+0000","last_undegraded":"2024-04-03T05:10:49.004650+0000","last_fullsized":"2024-04-03T05:10:49.004650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:56.614207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'126","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:17.823774+0000","last_change":"2024-04-03T03:38:34.756154+0000","last_active":"2024-04-03T05:10:17.823774+0000","last_peered":"2024-04-03T05:10:17.823774+0000","last_clean":"2024-04-03T05:10:17.823774+0000","last_became_active":"2024-04-03T03:38:34.755358+0000","last_became_peered":"2024-04-03T03:38:34.755358+0000","last_unstale":"2024-04-03T05:10:17.823774+0000","last_undegraded":"2024-04-03T05:10:17.823774+0000","last_fullsized":"2024-04-03T05:10:17.823774+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:16:30.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":275,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'755","reported_seq":2261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.451786+0000","last_change":"2024-04-03T03:38:26.748524+0000","last_active":"2024-04-03T05:11:08.451786+0000","last_peered":"2024-04-03T05:11:08.451786+0000","last_clean":"2024-04-03T05:11:08.451786+0000","last_became_active":"2024-04-03T03:38:26.747883+0000","last_became_peered":"2024-04-03T03:38:26.747883+0000","last_unstale":"2024-04-03T05:11:08.451786+0000","last_undegraded":"2024-04-03T05:11:08.451786+0000","last_fullsized":"2024-04-03T05:11:08.451786+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:40:23.177113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3405,"num_read_kb":3046,"num_write":999,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026291+0000","last_change":"2024-04-03T03:38:04.257665+0000","last_active":"2024-04-03T05:10:29.026291+0000","last_peered":"2024-04-03T05:10:29.026291+0000","last_clean":"2024-04-03T05:10:29.026291+0000","last_became_active":"2024-04-03T03:38:04.255147+0000","last_became_peered":"2024-04-03T03:38:04.255147+0000","last_unstale":"2024-04-03T05:10:29.026291+0000","last_undegraded":"2024-04-03T05:10:29.026291+0000","last_fullsized":"2024-04-03T05:10:29.026291+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_clean_scrub_stamp":"2024-04-03T03:38:03.047546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:39:28.268533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:58.841142+0000","last_change":"2024-04-03T03:38:11.616774+0000","last_active":"2024-04-03T05:11:58.841142+0000","last_peered":"2024-04-03T05:11:58.841142+0000","last_clean":"2024-04-03T05:11:58.841142+0000","last_became_active":"2024-04-03T03:38:11.615990+0000","last_became_peered":"2024-04-03T03:38:11.615990+0000","last_unstale":"2024-04-03T05:11:58.841142+0000","last_undegraded":"2024-04-03T05:11:58.841142+0000","last_fullsized":"2024-04-03T05:11:58.841142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:31.225680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'231","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.905549+0000","last_change":"2024-04-03T03:38:24.759919+0000","last_active":"2024-04-03T05:14:07.905549+0000","last_peered":"2024-04-03T05:14:07.905549+0000","last_clean":"2024-04-03T05:14:07.905549+0000","last_became_active":"2024-04-03T03:38:24.759653+0000","last_became_peered":"2024-04-03T03:38:24.759653+0000","last_unstale":"2024-04-03T05:14:07.905549+0000","last_undegraded":"2024-04-03T05:14:07.905549+0000","last_fullsized":"2024-04-03T05:14:07.905549+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:41:42.084865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11848079,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":409,"num_read_kb":37025,"num_write":1042,"num_write_kb":41578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:09.021791+0000","last_change":"2024-04-03T03:38:28.738201+0000","last_active":"2024-04-03T05:10:09.021791+0000","last_peered":"2024-04-03T05:10:09.021791+0000","last_clean":"2024-04-03T05:10:09.021791+0000","last_became_active":"2024-04-03T03:38:28.735507+0000","last_became_peered":"2024-04-03T03:38:28.735507+0000","last_unstale":"2024-04-03T05:10:09.021791+0000","last_undegraded":"2024-04-03T05:10:09.021791+0000","last_fullsized":"2024-04-03T05:10:09.021791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:35:10.061515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'727","reported_seq":1455,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.574036+0000","last_change":"2024-04-03T03:38:30.723361+0000","last_active":"2024-04-03T05:14:07.574036+0000","last_peered":"2024-04-03T05:14:07.574036+0000","last_clean":"2024-04-03T05:14:07.574036+0000","last_became_active":"2024-04-03T03:38:30.722613+0000","last_became_peered":"2024-04-03T03:38:30.722613+0000","last_unstale":"2024-04-03T05:14:07.574036+0000","last_undegraded":"2024-04-03T05:14:07.574036+0000","last_fullsized":"2024-04-03T05:14:07.574036+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:07:59.714595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155517,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1404,"num_read_kb":2893,"num_write":1354,"num_write_kb":1181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.070721+0000","last_change":"2024-04-03T03:38:32.747059+0000","last_active":"2024-04-03T05:11:43.070721+0000","last_peered":"2024-04-03T05:11:43.070721+0000","last_clean":"2024-04-03T05:11:43.070721+0000","last_became_active":"2024-04-03T03:38:32.746148+0000","last_became_peered":"2024-04-03T03:38:32.746148+0000","last_unstale":"2024-04-03T05:11:43.070721+0000","last_undegraded":"2024-04-03T05:11:43.070721+0000","last_fullsized":"2024-04-03T05:11:43.070721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:20:36.906339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'114","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.017684+0000","last_change":"2024-04-03T03:38:34.761254+0000","last_active":"2024-04-03T05:11:49.017684+0000","last_peered":"2024-04-03T05:11:49.017684+0000","last_clean":"2024-04-03T05:11:49.017684+0000","last_became_active":"2024-04-03T03:38:34.760522+0000","last_became_peered":"2024-04-03T03:38:34.760522+0000","last_unstale":"2024-04-03T05:11:49.017684+0000","last_undegraded":"2024-04-03T05:11:49.017684+0000","last_fullsized":"2024-04-03T05:11:49.017684+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:48.393317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":148,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'705","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.069042+0000","last_change":"2024-04-03T03:38:26.726518+0000","last_active":"2024-04-03T05:11:38.069042+0000","last_peered":"2024-04-03T05:11:38.069042+0000","last_clean":"2024-04-03T05:11:38.069042+0000","last_became_active":"2024-04-03T03:38:26.725330+0000","last_became_peered":"2024-04-03T03:38:26.725330+0000","last_unstale":"2024-04-03T05:11:38.069042+0000","last_undegraded":"2024-04-03T05:11:38.069042+0000","last_fullsized":"2024-04-03T05:11:38.069042+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":600,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:20:31.608702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3168,"num_read_kb":2822,"num_write":954,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:39.028616+0000","last_change":"2024-04-03T03:38:11.620060+0000","last_active":"2024-04-03T05:10:39.028616+0000","last_peered":"2024-04-03T05:10:39.028616+0000","last_clean":"2024-04-03T05:10:39.028616+0000","last_became_active":"2024-04-03T03:38:11.619474+0000","last_became_peered":"2024-04-03T03:38:11.619474+0000","last_unstale":"2024-04-03T05:10:39.028616+0000","last_undegraded":"2024-04-03T05:10:39.028616+0000","last_fullsized":"2024-04-03T05:10:39.028616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:13:54.362230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'271","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.036834+0000","last_change":"2024-04-03T03:38:24.745584+0000","last_active":"2024-04-03T05:14:08.036834+0000","last_peered":"2024-04-03T05:14:08.036834+0000","last_clean":"2024-04-03T05:14:08.036834+0000","last_became_active":"2024-04-03T03:38:24.745231+0000","last_became_peered":"2024-04-03T03:38:24.745231+0000","last_unstale":"2024-04-03T05:14:08.036834+0000","last_undegraded":"2024-04-03T05:14:08.036834+0000","last_fullsized":"2024-04-03T05:14:08.036834+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:04:43.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8700168,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":405,"num_read_kb":22150,"num_write":1102,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.836656+0000","last_change":"2024-04-03T03:38:28.741133+0000","last_active":"2024-04-03T05:11:38.836656+0000","last_peered":"2024-04-03T05:11:38.836656+0000","last_clean":"2024-04-03T05:11:38.836656+0000","last_became_active":"2024-04-03T03:38:28.740595+0000","last_became_peered":"2024-04-03T03:38:28.740595+0000","last_unstale":"2024-04-03T05:11:38.836656+0000","last_undegraded":"2024-04-03T05:11:38.836656+0000","last_fullsized":"2024-04-03T05:11:38.836656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:29:01.051877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1176","reported_seq":3215,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.557148+0000","last_change":"2024-04-03T03:38:30.725691+0000","last_active":"2024-04-03T05:14:07.557148+0000","last_peered":"2024-04-03T05:14:07.557148+0000","last_clean":"2024-04-03T05:14:07.557148+0000","last_became_active":"2024-04-03T03:38:30.719511+0000","last_became_peered":"2024-04-03T03:38:30.719511+0000","last_unstale":"2024-04-03T05:14:07.557148+0000","last_undegraded":"2024-04-03T05:14:07.557148+0000","last_fullsized":"2024-04-03T05:14:07.557148+0000","mapping_epoch":29,"log_start":"263'1100","ondisk_log_start":"263'1100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:38:42.566363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172439,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1824,"num_read_kb":3282,"num_write":1198,"num_write_kb":991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:39.028804+0000","last_change":"2024-04-03T03:38:32.749446+0000","last_active":"2024-04-03T05:10:39.028804+0000","last_peered":"2024-04-03T05:10:39.028804+0000","last_clean":"2024-04-03T05:10:39.028804+0000","last_became_active":"2024-04-03T03:38:32.748061+0000","last_became_peered":"2024-04-03T03:38:32.748061+0000","last_unstale":"2024-04-03T05:10:39.028804+0000","last_undegraded":"2024-04-03T05:10:39.028804+0000","last_fullsized":"2024-04-03T05:10:39.028804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:27:00.730176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'163","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.820397+0000","last_change":"2024-04-03T03:38:34.937386+0000","last_active":"2024-04-03T05:10:02.820397+0000","last_peered":"2024-04-03T05:10:02.820397+0000","last_clean":"2024-04-03T05:10:02.820397+0000","last_became_active":"2024-04-03T03:38:34.936635+0000","last_became_peered":"2024-04-03T03:38:34.936635+0000","last_unstale":"2024-04-03T05:10:02.820397+0000","last_undegraded":"2024-04-03T05:10:02.820397+0000","last_fullsized":"2024-04-03T05:10:02.820397+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:53:55.693822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":219,"num_write":382,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'394","reported_seq":1830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.114549+0000","last_change":"2024-04-03T03:38:26.722334+0000","last_active":"2024-04-03T05:13:59.114549+0000","last_peered":"2024-04-03T05:13:59.114549+0000","last_clean":"2024-04-03T05:13:59.114549+0000","last_became_active":"2024-04-03T03:38:26.721536+0000","last_became_peered":"2024-04-03T03:38:26.721536+0000","last_unstale":"2024-04-03T05:13:59.114549+0000","last_undegraded":"2024-04-03T05:13:59.114549+0000","last_fullsized":"2024-04-03T05:13:59.114549+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:53.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2077,"num_read_kb":1939,"num_write":478,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:57.837427+0000","last_change":"2024-04-03T03:38:11.755773+0000","last_active":"2024-04-03T05:11:57.837427+0000","last_peered":"2024-04-03T05:11:57.837427+0000","last_clean":"2024-04-03T05:11:57.837427+0000","last_became_active":"2024-04-03T03:38:11.755301+0000","last_became_peered":"2024-04-03T03:38:11.755301+0000","last_unstale":"2024-04-03T05:11:57.837427+0000","last_undegraded":"2024-04-03T05:11:57.837427+0000","last_fullsized":"2024-04-03T05:11:57.837427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:56:40.206707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'248","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.701531+0000","last_change":"2024-04-03T03:38:24.720942+0000","last_active":"2024-04-03T05:14:07.701531+0000","last_peered":"2024-04-03T05:14:07.701531+0000","last_clean":"2024-04-03T05:14:07.701531+0000","last_became_active":"2024-04-03T03:38:24.720445+0000","last_became_peered":"2024-04-03T03:38:24.720445+0000","last_unstale":"2024-04-03T05:14:07.701531+0000","last_undegraded":"2024-04-03T05:14:07.701531+0000","last_fullsized":"2024-04-03T05:14:07.701531+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:22:22.841422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25199529,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":349,"num_read_kb":20915,"num_write":1016,"num_write_kb":36230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834723+0000","last_change":"2024-04-03T03:38:28.734259+0000","last_active":"2024-04-03T05:11:42.834723+0000","last_peered":"2024-04-03T05:11:42.834723+0000","last_clean":"2024-04-03T05:11:42.834723+0000","last_became_active":"2024-04-03T03:38:28.733750+0000","last_became_peered":"2024-04-03T03:38:28.733750+0000","last_unstale":"2024-04-03T05:11:42.834723+0000","last_undegraded":"2024-04-03T05:11:42.834723+0000","last_fullsized":"2024-04-03T05:11:42.834723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:15:52.422170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'331","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:57.929725+0000","last_change":"2024-04-03T03:38:30.824797+0000","last_active":"2024-04-03T05:13:57.929725+0000","last_peered":"2024-04-03T05:13:57.929725+0000","last_clean":"2024-04-03T05:13:57.929725+0000","last_became_active":"2024-04-03T03:38:30.824061+0000","last_became_peered":"2024-04-03T03:38:30.824061+0000","last_unstale":"2024-04-03T05:13:57.929725+0000","last_undegraded":"2024-04-03T05:13:57.929725+0000","last_fullsized":"2024-04-03T05:13:57.929725+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:24.797261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":319,"num_read_kb":311,"num_write":309,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.046912+0000","last_change":"2024-04-03T03:38:32.735866+0000","last_active":"2024-04-03T05:10:13.046912+0000","last_peered":"2024-04-03T05:10:13.046912+0000","last_clean":"2024-04-03T05:10:13.046912+0000","last_became_active":"2024-04-03T03:38:32.735151+0000","last_became_peered":"2024-04-03T03:38:32.735151+0000","last_unstale":"2024-04-03T05:10:13.046912+0000","last_undegraded":"2024-04-03T05:10:13.046912+0000","last_fullsized":"2024-04-03T05:10:13.046912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:48:02.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'192","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014576+0000","last_change":"2024-04-03T03:38:34.732538+0000","last_active":"2024-04-03T05:10:53.014576+0000","last_peered":"2024-04-03T05:10:53.014576+0000","last_clean":"2024-04-03T05:10:53.014576+0000","last_became_active":"2024-04-03T03:38:34.731776+0000","last_became_peered":"2024-04-03T03:38:34.731776+0000","last_unstale":"2024-04-03T05:10:53.014576+0000","last_undegraded":"2024-04-03T05:10:53.014576+0000","last_fullsized":"2024-04-03T05:10:53.014576+0000","mapping_epoch":33,"log_start":"252'100","ondisk_log_start":"252'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:35:06.296897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":349,"num_read_kb":358,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'382","reported_seq":1859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.232691+0000","last_change":"2024-04-03T03:38:26.727951+0000","last_active":"2024-04-03T05:10:55.232691+0000","last_peered":"2024-04-03T05:10:55.232691+0000","last_clean":"2024-04-03T05:10:55.232691+0000","last_became_active":"2024-04-03T03:38:26.727581+0000","last_became_peered":"2024-04-03T03:38:26.727581+0000","last_unstale":"2024-04-03T05:10:55.232691+0000","last_undegraded":"2024-04-03T05:10:55.232691+0000","last_fullsized":"2024-04-03T05:10:55.232691+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:26:22.789971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2147,"num_read_kb":2031,"num_write":458,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:58.841089+0000","last_change":"2024-04-03T03:38:11.614869+0000","last_active":"2024-04-03T05:11:58.841089+0000","last_peered":"2024-04-03T05:11:58.841089+0000","last_clean":"2024-04-03T05:11:58.841089+0000","last_became_active":"2024-04-03T03:38:11.613973+0000","last_became_peered":"2024-04-03T03:38:11.613973+0000","last_unstale":"2024-04-03T05:11:58.841089+0000","last_undegraded":"2024-04-03T05:11:58.841089+0000","last_fullsized":"2024-04-03T05:11:58.841089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:38:53.162490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'261","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.850295+0000","last_change":"2024-04-03T03:38:58.350014+0000","last_active":"2024-04-03T05:14:07.850295+0000","last_peered":"2024-04-03T05:14:07.850295+0000","last_clean":"2024-04-03T05:14:07.850295+0000","last_became_active":"2024-04-03T03:38:58.349561+0000","last_became_peered":"2024-04-03T03:38:58.349561+0000","last_unstale":"2024-04-03T05:14:07.850295+0000","last_undegraded":"2024-04-03T05:14:07.850295+0000","last_fullsized":"2024-04-03T05:14:07.850295+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:53:53.418209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12038047,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":422,"num_read_kb":36392,"num_write":993,"num_write_kb":30181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.055575+0000","last_change":"2024-04-03T03:38:28.713016+0000","last_active":"2024-04-03T05:10:38.055575+0000","last_peered":"2024-04-03T05:10:38.055575+0000","last_clean":"2024-04-03T05:10:38.055575+0000","last_became_active":"2024-04-03T03:38:28.711551+0000","last_became_peered":"2024-04-03T03:38:28.711551+0000","last_unstale":"2024-04-03T05:10:38.055575+0000","last_undegraded":"2024-04-03T05:10:38.055575+0000","last_fullsized":"2024-04-03T05:10:38.055575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:02:00.901908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'182","reported_seq":776,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.056299+0000","last_change":"2024-04-03T03:38:30.718183+0000","last_active":"2024-04-03T05:13:53.056299+0000","last_peered":"2024-04-03T05:13:53.056299+0000","last_clean":"2024-04-03T05:13:53.056299+0000","last_became_active":"2024-04-03T03:38:30.717437+0000","last_became_peered":"2024-04-03T03:38:30.717437+0000","last_unstale":"2024-04-03T05:13:53.056299+0000","last_undegraded":"2024-04-03T05:13:53.056299+0000","last_fullsized":"2024-04-03T05:13:53.056299+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:19:51.986312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":238,"num_read_kb":232,"num_write":176,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:44.016713+0000","last_change":"2024-04-03T03:38:32.740103+0000","last_active":"2024-04-03T05:11:44.016713+0000","last_peered":"2024-04-03T05:11:44.016713+0000","last_clean":"2024-04-03T05:11:44.016713+0000","last_became_active":"2024-04-03T03:38:32.739201+0000","last_became_peered":"2024-04-03T03:38:32.739201+0000","last_unstale":"2024-04-03T05:11:44.016713+0000","last_undegraded":"2024-04-03T05:11:44.016713+0000","last_fullsized":"2024-04-03T05:11:44.016713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:29.389145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.838705+0000","last_change":"2024-04-03T03:38:34.755897+0000","last_active":"2024-04-03T05:11:48.838705+0000","last_peered":"2024-04-03T05:11:48.838705+0000","last_clean":"2024-04-03T05:11:48.838705+0000","last_became_active":"2024-04-03T03:38:34.749642+0000","last_became_peered":"2024-04-03T03:38:34.749642+0000","last_unstale":"2024-04-03T05:11:48.838705+0000","last_undegraded":"2024-04-03T05:11:48.838705+0000","last_fullsized":"2024-04-03T05:11:48.838705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:24:40.979283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":197,"num_write":285,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'481","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:01.899466+0000","last_change":"2024-04-03T03:38:26.720851+0000","last_active":"2024-04-03T05:11:01.899466+0000","last_peered":"2024-04-03T05:11:01.899466+0000","last_clean":"2024-04-03T05:11:01.899466+0000","last_became_active":"2024-04-03T03:38:26.720476+0000","last_became_peered":"2024-04-03T03:38:26.720476+0000","last_unstale":"2024-04-03T05:11:01.899466+0000","last_undegraded":"2024-04-03T05:11:01.899466+0000","last_fullsized":"2024-04-03T05:11:01.899466+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:16:11.552164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2351,"num_write":586,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'279","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.687975+0000","last_change":"2024-04-03T03:38:24.749672+0000","last_active":"2024-04-03T05:14:08.687975+0000","last_peered":"2024-04-03T05:14:08.687975+0000","last_clean":"2024-04-03T05:14:08.687975+0000","last_became_active":"2024-04-03T03:38:24.748412+0000","last_became_peered":"2024-04-03T03:38:24.748412+0000","last_unstale":"2024-04-03T05:14:08.687975+0000","last_undegraded":"2024-04-03T05:14:08.687975+0000","last_fullsized":"2024-04-03T05:14:08.687975+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:46.714828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4595649,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":640,"num_read_kb":11584,"num_write":1120,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:57.850522+0000","last_change":"2024-04-03T03:38:11.611219+0000","last_active":"2024-04-03T05:11:57.850522+0000","last_peered":"2024-04-03T05:11:57.850522+0000","last_clean":"2024-04-03T05:11:57.850522+0000","last_became_active":"2024-04-03T03:38:11.609995+0000","last_became_peered":"2024-04-03T03:38:11.609995+0000","last_unstale":"2024-04-03T05:11:57.850522+0000","last_undegraded":"2024-04-03T05:11:57.850522+0000","last_fullsized":"2024-04-03T05:11:57.850522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:52:03.961331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'3","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.030519+0000","last_change":"2024-04-03T03:38:28.717488+0000","last_active":"2024-04-03T05:14:07.030519+0000","last_peered":"2024-04-03T05:14:07.030519+0000","last_clean":"2024-04-03T05:14:07.030519+0000","last_became_active":"2024-04-03T03:38:28.716761+0000","last_became_peered":"2024-04-03T03:38:28.716761+0000","last_unstale":"2024-04-03T05:14:07.030519+0000","last_undegraded":"2024-04-03T05:14:07.030519+0000","last_fullsized":"2024-04-03T05:14:07.030519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:16:55.208823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":482,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'610","reported_seq":1331,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.554792+0000","last_change":"2024-04-03T03:38:30.731606+0000","last_active":"2024-04-03T05:14:07.554792+0000","last_peered":"2024-04-03T05:14:07.554792+0000","last_clean":"2024-04-03T05:14:07.554792+0000","last_became_active":"2024-04-03T03:38:30.731186+0000","last_became_peered":"2024-04-03T03:38:30.731186+0000","last_unstale":"2024-04-03T05:14:07.554792+0000","last_undegraded":"2024-04-03T05:14:07.554792+0000","last_fullsized":"2024-04-03T05:14:07.554792+0000","mapping_epoch":29,"log_start":"263'500","ondisk_log_start":"263'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":500,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:47:57.629875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1041,"num_read_kb":2138,"num_write":838,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.622768+0000","last_change":"2024-04-03T03:38:32.726283+0000","last_active":"2024-04-03T05:10:13.622768+0000","last_peered":"2024-04-03T05:10:13.622768+0000","last_clean":"2024-04-03T05:10:13.622768+0000","last_became_active":"2024-04-03T03:38:32.725549+0000","last_became_peered":"2024-04-03T03:38:32.725549+0000","last_unstale":"2024-04-03T05:10:13.622768+0000","last_undegraded":"2024-04-03T05:10:13.622768+0000","last_fullsized":"2024-04-03T05:10:13.622768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:58.188714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'103","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.246058+0000","last_change":"2024-04-03T03:38:34.940294+0000","last_active":"2024-04-03T05:10:55.246058+0000","last_peered":"2024-04-03T05:10:55.246058+0000","last_clean":"2024-04-03T05:10:55.246058+0000","last_became_active":"2024-04-03T03:38:34.939419+0000","last_became_peered":"2024-04-03T03:38:34.939419+0000","last_unstale":"2024-04-03T05:10:55.246058+0000","last_undegraded":"2024-04-03T05:10:55.246058+0000","last_fullsized":"2024-04-03T05:10:55.246058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:30:08.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":118,"num_write":243,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'842","reported_seq":2346,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.076939+0000","last_change":"2024-04-03T03:38:26.732400+0000","last_active":"2024-04-03T05:12:13.076939+0000","last_peered":"2024-04-03T05:12:13.076939+0000","last_clean":"2024-04-03T05:12:13.076939+0000","last_became_active":"2024-04-03T03:38:26.731406+0000","last_became_peered":"2024-04-03T03:38:26.731406+0000","last_unstale":"2024-04-03T05:12:13.076939+0000","last_undegraded":"2024-04-03T05:12:13.076939+0000","last_fullsized":"2024-04-03T05:12:13.076939+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:49.785408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3757,"num_read_kb":3345,"num_write":1171,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'266","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.806904+0000","last_change":"2024-04-03T03:38:24.722172+0000","last_active":"2024-04-03T05:14:07.806904+0000","last_peered":"2024-04-03T05:14:07.806904+0000","last_clean":"2024-04-03T05:14:07.806904+0000","last_became_active":"2024-04-03T03:38:24.721685+0000","last_became_peered":"2024-04-03T03:38:24.721685+0000","last_unstale":"2024-04-03T05:14:07.806904+0000","last_undegraded":"2024-04-03T05:14:07.806904+0000","last_fullsized":"2024-04-03T05:14:07.806904+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:39.493128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4488322,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":379,"num_read_kb":12381,"num_write":1173,"num_write_kb":30338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:19.024098+0000","last_change":"2024-04-03T03:38:11.618107+0000","last_active":"2024-04-03T05:10:19.024098+0000","last_peered":"2024-04-03T05:10:19.024098+0000","last_clean":"2024-04-03T05:10:19.024098+0000","last_became_active":"2024-04-03T03:38:11.617057+0000","last_became_peered":"2024-04-03T03:38:11.617057+0000","last_unstale":"2024-04-03T05:10:19.024098+0000","last_undegraded":"2024-04-03T05:10:19.024098+0000","last_fullsized":"2024-04-03T05:10:19.024098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:22:38.744380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.996201+0000","last_change":"2024-04-03T03:38:28.720480+0000","last_active":"2024-04-03T05:10:08.996201+0000","last_peered":"2024-04-03T05:10:08.996201+0000","last_clean":"2024-04-03T05:10:08.996201+0000","last_became_active":"2024-04-03T03:38:28.719394+0000","last_became_peered":"2024-04-03T03:38:28.719394+0000","last_unstale":"2024-04-03T05:10:08.996201+0000","last_undegraded":"2024-04-03T05:10:08.996201+0000","last_fullsized":"2024-04-03T05:10:08.996201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:06.496312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'307","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:17.854662+0000","last_change":"2024-04-03T03:38:30.822163+0000","last_active":"2024-04-03T05:12:17.854662+0000","last_peered":"2024-04-03T05:12:17.854662+0000","last_clean":"2024-04-03T05:12:17.854662+0000","last_became_active":"2024-04-03T03:38:30.821297+0000","last_became_peered":"2024-04-03T03:38:30.821297+0000","last_unstale":"2024-04-03T05:12:17.854662+0000","last_undegraded":"2024-04-03T05:12:17.854662+0000","last_fullsized":"2024-04-03T05:12:17.854662+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:12.866281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":386,"num_write":374,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'552","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.491148+0000","last_change":"2024-04-03T03:38:32.748169+0000","last_active":"2024-04-03T05:14:07.491148+0000","last_peered":"2024-04-03T05:14:07.491148+0000","last_clean":"2024-04-03T05:14:07.491148+0000","last_became_active":"2024-04-03T03:38:32.747292+0000","last_became_peered":"2024-04-03T03:38:32.747292+0000","last_unstale":"2024-04-03T05:14:07.491148+0000","last_undegraded":"2024-04-03T05:14:07.491148+0000","last_fullsized":"2024-04-03T05:14:07.491148+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:43.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'90","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.050986+0000","last_change":"2024-04-03T03:38:34.936362+0000","last_active":"2024-04-03T05:13:28.050986+0000","last_peered":"2024-04-03T05:13:28.050986+0000","last_clean":"2024-04-03T05:13:28.050986+0000","last_became_active":"2024-04-03T03:38:34.935593+0000","last_became_peered":"2024-04-03T03:38:34.935593+0000","last_unstale":"2024-04-03T05:13:28.050986+0000","last_undegraded":"2024-04-03T05:13:28.050986+0000","last_fullsized":"2024-04-03T05:13:28.050986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:15.143724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":828,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":224,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'421","reported_seq":1889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013119+0000","last_change":"2024-04-03T03:38:26.717074+0000","last_active":"2024-04-03T05:10:48.013119+0000","last_peered":"2024-04-03T05:10:48.013119+0000","last_clean":"2024-04-03T05:10:48.013119+0000","last_became_active":"2024-04-03T03:38:26.716004+0000","last_became_peered":"2024-04-03T03:38:26.716004+0000","last_unstale":"2024-04-03T05:10:48.013119+0000","last_undegraded":"2024-04-03T05:10:48.013119+0000","last_fullsized":"2024-04-03T05:10:48.013119+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:35.702121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":2164,"num_write":539,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'278","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.959970+0000","last_change":"2024-04-03T03:38:24.728339+0000","last_active":"2024-04-03T05:14:07.959970+0000","last_peered":"2024-04-03T05:14:07.959970+0000","last_clean":"2024-04-03T05:14:07.959970+0000","last_became_active":"2024-04-03T03:38:24.727736+0000","last_became_peered":"2024-04-03T03:38:24.727736+0000","last_unstale":"2024-04-03T05:14:07.959970+0000","last_undegraded":"2024-04-03T05:14:07.959970+0000","last_fullsized":"2024-04-03T05:14:07.959970+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:59:04.813514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285493,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":462,"num_read_kb":37307,"num_write":1162,"num_write_kb":23236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.843088+0000","last_change":"2024-04-03T03:38:11.613510+0000","last_active":"2024-04-03T05:11:22.843088+0000","last_peered":"2024-04-03T05:11:22.843088+0000","last_clean":"2024-04-03T05:11:22.843088+0000","last_became_active":"2024-04-03T03:38:11.613252+0000","last_became_peered":"2024-04-03T03:38:11.613252+0000","last_unstale":"2024-04-03T05:11:22.843088+0000","last_undegraded":"2024-04-03T05:11:22.843088+0000","last_fullsized":"2024-04-03T05:11:22.843088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:56:15.329216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.621550+0000","last_change":"2024-04-03T03:38:28.722584+0000","last_active":"2024-04-03T05:10:08.621550+0000","last_peered":"2024-04-03T05:10:08.621550+0000","last_clean":"2024-04-03T05:10:08.621550+0000","last_became_active":"2024-04-03T03:38:28.721796+0000","last_became_peered":"2024-04-03T03:38:28.721796+0000","last_unstale":"2024-04-03T05:10:08.621550+0000","last_undegraded":"2024-04-03T05:10:08.621550+0000","last_fullsized":"2024-04-03T05:10:08.621550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:50.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'166","reported_seq":755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.622863+0000","last_change":"2024-04-03T03:38:30.719677+0000","last_active":"2024-04-03T05:10:13.622863+0000","last_peered":"2024-04-03T05:10:13.622863+0000","last_clean":"2024-04-03T05:10:13.622863+0000","last_became_active":"2024-04-03T03:38:30.718913+0000","last_became_peered":"2024-04-03T03:38:30.718913+0000","last_unstale":"2024-04-03T05:10:13.622863+0000","last_undegraded":"2024-04-03T05:10:13.622863+0000","last_fullsized":"2024-04-03T05:10:13.622863+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:08:10.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":144,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'552","reported_seq":2668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.503414+0000","last_change":"2024-04-03T03:38:32.744373+0000","last_active":"2024-04-03T05:14:07.503414+0000","last_peered":"2024-04-03T05:14:07.503414+0000","last_clean":"2024-04-03T05:14:07.503414+0000","last_became_active":"2024-04-03T03:38:32.743829+0000","last_became_peered":"2024-04-03T03:38:32.743829+0000","last_unstale":"2024-04-03T05:14:07.503414+0000","last_undegraded":"2024-04-03T05:14:07.503414+0000","last_fullsized":"2024-04-03T05:14:07.503414+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:07:40.400539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'94","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.059107+0000","last_change":"2024-04-03T03:38:34.747164+0000","last_active":"2024-04-03T05:10:53.059107+0000","last_peered":"2024-04-03T05:10:53.059107+0000","last_clean":"2024-04-03T05:10:53.059107+0000","last_became_active":"2024-04-03T03:38:34.746249+0000","last_became_peered":"2024-04-03T03:38:34.746249+0000","last_unstale":"2024-04-03T05:10:53.059107+0000","last_undegraded":"2024-04-03T05:10:53.059107+0000","last_fullsized":"2024-04-03T05:10:53.059107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:25:14.477982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":217,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1105","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398899+0000","last_change":"2024-04-03T03:38:26.741936+0000","last_active":"2024-04-03T05:11:18.398899+0000","last_peered":"2024-04-03T05:11:18.398899+0000","last_clean":"2024-04-03T05:11:18.398899+0000","last_became_active":"2024-04-03T03:38:26.741272+0000","last_became_peered":"2024-04-03T03:38:26.741272+0000","last_unstale":"2024-04-03T05:11:18.398899+0000","last_undegraded":"2024-04-03T05:11:18.398899+0000","last_fullsized":"2024-04-03T05:11:18.398899+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:11:49.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4771,"num_read_kb":4189,"num_write":1521,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'267","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.074588+0000","last_change":"2024-04-03T03:38:24.747700+0000","last_active":"2024-04-03T05:14:08.074588+0000","last_peered":"2024-04-03T05:14:08.074588+0000","last_clean":"2024-04-03T05:14:08.074588+0000","last_became_active":"2024-04-03T03:38:24.747145+0000","last_became_peered":"2024-04-03T03:38:24.747145+0000","last_unstale":"2024-04-03T05:14:08.074588+0000","last_undegraded":"2024-04-03T05:14:08.074588+0000","last_fullsized":"2024-04-03T05:14:08.074588+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:03:58.509965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8850535,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":347,"num_read_kb":38174,"num_write":1012,"num_write_kb":41152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012441+0000","last_change":"2024-04-03T03:38:11.618291+0000","last_active":"2024-04-03T05:11:24.012441+0000","last_peered":"2024-04-03T05:11:24.012441+0000","last_clean":"2024-04-03T05:11:24.012441+0000","last_became_active":"2024-04-03T03:38:11.617573+0000","last_became_peered":"2024-04-03T03:38:11.617573+0000","last_unstale":"2024-04-03T05:11:24.012441+0000","last_undegraded":"2024-04-03T05:11:24.012441+0000","last_fullsized":"2024-04-03T05:11:24.012441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:12:17.137777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014435+0000","last_change":"2024-04-03T03:38:28.734000+0000","last_active":"2024-04-03T05:10:53.014435+0000","last_peered":"2024-04-03T05:10:53.014435+0000","last_clean":"2024-04-03T05:10:53.014435+0000","last_became_active":"2024-04-03T03:38:28.733237+0000","last_became_peered":"2024-04-03T03:38:28.733237+0000","last_unstale":"2024-04-03T05:10:53.014435+0000","last_undegraded":"2024-04-03T05:10:53.014435+0000","last_fullsized":"2024-04-03T05:10:53.014435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:17.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'789","reported_seq":1555,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.037369+0000","last_change":"2024-04-03T03:38:30.823414+0000","last_active":"2024-04-03T05:14:09.037369+0000","last_peered":"2024-04-03T05:14:09.037369+0000","last_clean":"2024-04-03T05:14:09.037369+0000","last_became_active":"2024-04-03T03:38:30.822610+0000","last_became_peered":"2024-04-03T03:38:30.822610+0000","last_unstale":"2024-04-03T05:14:09.037369+0000","last_undegraded":"2024-04-03T05:14:09.037369+0000","last_fullsized":"2024-04-03T05:14:09.037369+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:08:41.961174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161519,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1384,"num_read_kb":3113,"num_write":1121,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.004685+0000","last_change":"2024-04-03T03:38:32.729501+0000","last_active":"2024-04-03T05:10:13.004685+0000","last_peered":"2024-04-03T05:10:13.004685+0000","last_clean":"2024-04-03T05:10:13.004685+0000","last_became_active":"2024-04-03T03:38:32.728874+0000","last_became_peered":"2024-04-03T03:38:32.728874+0000","last_unstale":"2024-04-03T05:10:13.004685+0000","last_undegraded":"2024-04-03T05:10:13.004685+0000","last_fullsized":"2024-04-03T05:10:13.004685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:13:52.894350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'104","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.296042+0000","last_change":"2024-04-03T03:38:34.757708+0000","last_active":"2024-04-03T05:11:29.296042+0000","last_peered":"2024-04-03T05:11:29.296042+0000","last_clean":"2024-04-03T05:11:29.296042+0000","last_became_active":"2024-04-03T03:38:34.756936+0000","last_became_peered":"2024-04-03T03:38:34.756936+0000","last_unstale":"2024-04-03T05:11:29.296042+0000","last_undegraded":"2024-04-03T05:11:29.296042+0000","last_fullsized":"2024-04-03T05:11:29.296042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:39.973669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'144","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.051218+0000","last_change":"2024-04-03T03:38:34.760408+0000","last_active":"2024-04-03T05:10:18.051218+0000","last_peered":"2024-04-03T05:10:18.051218+0000","last_clean":"2024-04-03T05:10:18.051218+0000","last_became_active":"2024-04-03T03:38:34.759767+0000","last_became_peered":"2024-04-03T03:38:34.759767+0000","last_unstale":"2024-04-03T05:10:18.051218+0000","last_undegraded":"2024-04-03T05:10:18.051218+0000","last_fullsized":"2024-04-03T05:10:18.051218+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:27:11.459564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":108,"num_write":250,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'826","reported_seq":2402,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.643808+0000","last_change":"2024-04-03T03:38:26.741454+0000","last_active":"2024-04-03T05:11:48.643808+0000","last_peered":"2024-04-03T05:11:48.643808+0000","last_clean":"2024-04-03T05:11:48.643808+0000","last_became_active":"2024-04-03T03:38:26.740732+0000","last_became_peered":"2024-04-03T03:38:26.740732+0000","last_unstale":"2024-04-03T05:11:48.643808+0000","last_undegraded":"2024-04-03T05:11:48.643808+0000","last_fullsized":"2024-04-03T05:11:48.643808+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:26.379990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3680,"num_read_kb":3271,"num_write":1116,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'304","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.597696+0000","last_change":"2024-04-03T03:38:24.741664+0000","last_active":"2024-04-03T05:14:08.597696+0000","last_peered":"2024-04-03T05:14:08.597696+0000","last_clean":"2024-04-03T05:14:08.597696+0000","last_became_active":"2024-04-03T03:38:24.740900+0000","last_became_peered":"2024-04-03T03:38:24.740900+0000","last_unstale":"2024-04-03T05:14:08.597696+0000","last_undegraded":"2024-04-03T05:14:08.597696+0000","last_fullsized":"2024-04-03T05:14:08.597696+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:54:13.177313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10742918,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":563,"num_read_kb":65764,"num_write":1202,"num_write_kb":26843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:32.813587+0000","last_change":"2024-04-03T03:38:28.725751+0000","last_active":"2024-04-03T05:09:32.813587+0000","last_peered":"2024-04-03T05:09:32.813587+0000","last_clean":"2024-04-03T05:09:32.813587+0000","last_became_active":"2024-04-03T03:38:28.725020+0000","last_became_peered":"2024-04-03T03:38:28.725020+0000","last_unstale":"2024-04-03T05:09:32.813587+0000","last_undegraded":"2024-04-03T05:09:32.813587+0000","last_fullsized":"2024-04-03T05:09:32.813587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:26:47.268104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'305","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.511944+0000","last_change":"2024-04-03T03:38:30.730341+0000","last_active":"2024-04-03T05:14:00.511944+0000","last_peered":"2024-04-03T05:14:00.511944+0000","last_clean":"2024-04-03T05:14:00.511944+0000","last_became_active":"2024-04-03T03:38:30.729608+0000","last_became_peered":"2024-04-03T03:38:30.729608+0000","last_unstale":"2024-04-03T05:14:00.511944+0000","last_undegraded":"2024-04-03T05:14:00.511944+0000","last_fullsized":"2024-04-03T05:14:00.511944+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:12:36.054464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49761,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":488,"num_read_kb":954,"num_write":384,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:32.995494+0000","last_change":"2024-04-03T03:38:32.746511+0000","last_active":"2024-04-03T05:09:32.995494+0000","last_peered":"2024-04-03T05:09:32.995494+0000","last_clean":"2024-04-03T05:09:32.995494+0000","last_became_active":"2024-04-03T03:38:32.744256+0000","last_became_peered":"2024-04-03T03:38:32.744256+0000","last_unstale":"2024-04-03T05:09:32.995494+0000","last_undegraded":"2024-04-03T05:09:32.995494+0000","last_fullsized":"2024-04-03T05:09:32.995494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:40:51.923207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'108","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.015981+0000","last_change":"2024-04-03T03:38:34.737865+0000","last_active":"2024-04-03T05:10:58.015981+0000","last_peered":"2024-04-03T05:10:58.015981+0000","last_clean":"2024-04-03T05:10:58.015981+0000","last_became_active":"2024-04-03T03:38:34.736176+0000","last_became_peered":"2024-04-03T03:38:34.736176+0000","last_unstale":"2024-04-03T05:10:58.015981+0000","last_undegraded":"2024-04-03T05:10:58.015981+0000","last_fullsized":"2024-04-03T05:10:58.015981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:17:39.580695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":259,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'759","reported_seq":2571,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.848276+0000","last_change":"2024-04-03T03:38:26.720574+0000","last_active":"2024-04-03T05:11:47.848276+0000","last_peered":"2024-04-03T05:11:47.848276+0000","last_clean":"2024-04-03T05:11:47.848276+0000","last_became_active":"2024-04-03T03:38:26.720106+0000","last_became_peered":"2024-04-03T03:38:26.720106+0000","last_unstale":"2024-04-03T05:11:47.848276+0000","last_undegraded":"2024-04-03T05:11:47.848276+0000","last_fullsized":"2024-04-03T05:11:47.848276+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:10:18.194606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3508,"num_write":1155,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'302","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.924918+0000","last_change":"2024-04-03T03:38:57.883863+0000","last_active":"2024-04-03T05:14:08.924918+0000","last_peered":"2024-04-03T05:14:08.924918+0000","last_clean":"2024-04-03T05:14:08.924918+0000","last_became_active":"2024-04-03T03:38:57.882607+0000","last_became_peered":"2024-04-03T03:38:57.882607+0000","last_unstale":"2024-04-03T05:14:08.924918+0000","last_undegraded":"2024-04-03T05:14:08.924918+0000","last_fullsized":"2024-04-03T05:14:08.924918+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:06:53.732174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18518996,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":576,"num_read_kb":85963,"num_write":1239,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:32.995750+0000","last_change":"2024-04-03T03:38:28.723791+0000","last_active":"2024-04-03T05:09:32.995750+0000","last_peered":"2024-04-03T05:09:32.995750+0000","last_clean":"2024-04-03T05:09:32.995750+0000","last_became_active":"2024-04-03T03:38:28.723082+0000","last_became_peered":"2024-04-03T03:38:28.723082+0000","last_unstale":"2024-04-03T05:09:32.995750+0000","last_undegraded":"2024-04-03T05:09:32.995750+0000","last_fullsized":"2024-04-03T05:09:32.995750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:47:02.690730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:33.037838+0000","last_change":"2024-04-03T03:38:30.730377+0000","last_active":"2024-04-03T05:09:33.037838+0000","last_peered":"2024-04-03T05:09:33.037838+0000","last_clean":"2024-04-03T05:09:33.037838+0000","last_became_active":"2024-04-03T03:38:30.729412+0000","last_became_peered":"2024-04-03T03:38:30.729412+0000","last_unstale":"2024-04-03T05:09:33.037838+0000","last_undegraded":"2024-04-03T05:09:33.037838+0000","last_fullsized":"2024-04-03T05:09:33.037838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:49:48.699386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":60,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:34.013641+0000","last_change":"2024-04-03T03:38:32.748751+0000","last_active":"2024-04-03T05:09:34.013641+0000","last_peered":"2024-04-03T05:09:34.013641+0000","last_clean":"2024-04-03T05:09:34.013641+0000","last_became_active":"2024-04-03T03:38:32.747294+0000","last_became_peered":"2024-04-03T03:38:32.747294+0000","last_unstale":"2024-04-03T05:09:34.013641+0000","last_undegraded":"2024-04-03T05:09:34.013641+0000","last_fullsized":"2024-04-03T05:09:34.013641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:27.522363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'97","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062855+0000","last_change":"2024-04-03T03:38:34.739547+0000","last_active":"2024-04-03T05:11:08.062855+0000","last_peered":"2024-04-03T05:11:08.062855+0000","last_clean":"2024-04-03T05:11:08.062855+0000","last_became_active":"2024-04-03T03:38:34.737841+0000","last_became_peered":"2024-04-03T03:38:34.737841+0000","last_unstale":"2024-04-03T05:11:08.062855+0000","last_undegraded":"2024-04-03T05:11:08.062855+0000","last_fullsized":"2024-04-03T05:11:08.062855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:58:36.235149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":225,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'410","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.027664+0000","last_change":"2024-04-03T03:38:26.720039+0000","last_active":"2024-04-03T05:11:48.027664+0000","last_peered":"2024-04-03T05:11:48.027664+0000","last_clean":"2024-04-03T05:11:48.027664+0000","last_became_active":"2024-04-03T03:38:26.715716+0000","last_became_peered":"2024-04-03T03:38:26.715716+0000","last_unstale":"2024-04-03T05:11:48.027664+0000","last_undegraded":"2024-04-03T05:11:48.027664+0000","last_fullsized":"2024-04-03T05:11:48.027664+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:34.026023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2104,"num_read_kb":1969,"num_write":502,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'398","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.649394+0000","last_change":"2024-04-03T03:38:24.742857+0000","last_active":"2024-04-03T05:14:08.649394+0000","last_peered":"2024-04-03T05:14:08.649394+0000","last_clean":"2024-04-03T05:14:08.649394+0000","last_became_active":"2024-04-03T03:38:24.737281+0000","last_became_peered":"2024-04-03T03:38:24.737281+0000","last_unstale":"2024-04-03T05:14:08.649394+0000","last_undegraded":"2024-04-03T05:14:08.649394+0000","last_fullsized":"2024-04-03T05:14:08.649394+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:25:22.407147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9888688,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":722,"num_read_kb":29465,"num_write":1348,"num_write_kb":33665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.044403+0000","last_change":"2024-04-03T03:38:28.735969+0000","last_active":"2024-04-03T05:11:49.044403+0000","last_peered":"2024-04-03T05:11:49.044403+0000","last_clean":"2024-04-03T05:11:49.044403+0000","last_became_active":"2024-04-03T03:38:28.735156+0000","last_became_peered":"2024-04-03T03:38:28.735156+0000","last_unstale":"2024-04-03T05:11:49.044403+0000","last_undegraded":"2024-04-03T05:11:49.044403+0000","last_fullsized":"2024-04-03T05:11:49.044403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:53.609411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'320","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.478593+0000","last_change":"2024-04-03T03:38:30.734504+0000","last_active":"2024-04-03T05:14:00.478593+0000","last_peered":"2024-04-03T05:14:00.478593+0000","last_clean":"2024-04-03T05:14:00.478593+0000","last_became_active":"2024-04-03T03:38:30.733682+0000","last_became_peered":"2024-04-03T03:38:30.733682+0000","last_unstale":"2024-04-03T05:14:00.478593+0000","last_undegraded":"2024-04-03T05:14:00.478593+0000","last_fullsized":"2024-04-03T05:14:00.478593+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:34:59.488858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50383,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":1019,"num_write":416,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:33.987763+0000","last_change":"2024-04-03T03:38:32.734561+0000","last_active":"2024-04-03T05:09:33.987763+0000","last_peered":"2024-04-03T05:09:33.987763+0000","last_clean":"2024-04-03T05:09:33.987763+0000","last_became_active":"2024-04-03T03:38:32.733728+0000","last_became_peered":"2024-04-03T03:38:32.733728+0000","last_unstale":"2024-04-03T05:09:33.987763+0000","last_undegraded":"2024-04-03T05:09:33.987763+0000","last_fullsized":"2024-04-03T05:09:33.987763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:55:41.581847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'152","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.830070+0000","last_change":"2024-04-03T03:38:34.756727+0000","last_active":"2024-04-03T05:11:08.830070+0000","last_peered":"2024-04-03T05:11:08.830070+0000","last_clean":"2024-04-03T05:11:08.830070+0000","last_became_active":"2024-04-03T03:38:34.755929+0000","last_became_peered":"2024-04-03T03:38:34.755929+0000","last_unstale":"2024-04-03T05:11:08.830070+0000","last_undegraded":"2024-04-03T05:11:08.830070+0000","last_fullsized":"2024-04-03T05:11:08.830070+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:41.464119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":91,"num_write":329,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'735","reported_seq":2109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.027568+0000","last_change":"2024-04-03T03:38:26.724380+0000","last_active":"2024-04-03T05:11:48.027568+0000","last_peered":"2024-04-03T05:11:48.027568+0000","last_clean":"2024-04-03T05:11:48.027568+0000","last_became_active":"2024-04-03T03:38:26.723758+0000","last_became_peered":"2024-04-03T03:38:26.723758+0000","last_unstale":"2024-04-03T05:11:48.027568+0000","last_undegraded":"2024-04-03T05:11:48.027568+0000","last_fullsized":"2024-04-03T05:11:48.027568+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:31.930788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3210,"num_read_kb":2838,"num_write":998,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'300","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.001046+0000","last_change":"2024-04-03T03:38:24.740315+0000","last_active":"2024-04-03T05:14:08.001046+0000","last_peered":"2024-04-03T05:14:08.001046+0000","last_clean":"2024-04-03T05:14:08.001046+0000","last_became_active":"2024-04-03T03:38:24.739968+0000","last_became_peered":"2024-04-03T03:38:24.739968+0000","last_unstale":"2024-04-03T05:14:08.001046+0000","last_undegraded":"2024-04-03T05:14:08.001046+0000","last_fullsized":"2024-04-03T05:14:08.001046+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:36:09.717326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5500171,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":555,"num_read_kb":31745,"num_write":1138,"num_write_kb":30139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.017719+0000","last_change":"2024-04-03T03:38:28.724693+0000","last_active":"2024-04-03T05:11:49.017719+0000","last_peered":"2024-04-03T05:11:49.017719+0000","last_clean":"2024-04-03T05:11:49.017719+0000","last_became_active":"2024-04-03T03:38:28.723907+0000","last_became_peered":"2024-04-03T03:38:28.723907+0000","last_unstale":"2024-04-03T05:11:49.017719+0000","last_undegraded":"2024-04-03T05:11:49.017719+0000","last_fullsized":"2024-04-03T05:11:49.017719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:13:05.741974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'313","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.933996+0000","last_change":"2024-04-03T03:38:30.733466+0000","last_active":"2024-04-03T05:14:08.933996+0000","last_peered":"2024-04-03T05:14:08.933996+0000","last_clean":"2024-04-03T05:14:08.933996+0000","last_became_active":"2024-04-03T03:38:30.732520+0000","last_became_peered":"2024-04-03T03:38:30.732520+0000","last_unstale":"2024-04-03T05:14:08.933996+0000","last_undegraded":"2024-04-03T05:14:08.933996+0000","last_fullsized":"2024-04-03T05:14:08.933996+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:53.671349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49780,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1180,"num_write":410,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:33.038005+0000","last_change":"2024-04-03T03:38:32.749555+0000","last_active":"2024-04-03T05:09:33.038005+0000","last_peered":"2024-04-03T05:09:33.038005+0000","last_clean":"2024-04-03T05:09:33.038005+0000","last_became_active":"2024-04-03T03:38:32.748621+0000","last_became_peered":"2024-04-03T03:38:32.748621+0000","last_unstale":"2024-04-03T05:09:33.038005+0000","last_undegraded":"2024-04-03T05:09:33.038005+0000","last_fullsized":"2024-04-03T05:09:33.038005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:14:00.976597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'375","reported_seq":2039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.276649+0000","last_change":"2024-04-03T03:38:26.714514+0000","last_active":"2024-04-03T05:11:29.276649+0000","last_peered":"2024-04-03T05:11:29.276649+0000","last_clean":"2024-04-03T05:11:29.276649+0000","last_became_active":"2024-04-03T03:38:26.711974+0000","last_became_peered":"2024-04-03T03:38:26.711974+0000","last_unstale":"2024-04-03T05:11:29.276649+0000","last_undegraded":"2024-04-03T05:11:29.276649+0000","last_fullsized":"2024-04-03T05:11:29.276649+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:02.940173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2240,"num_write":411,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'289","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.960731+0000","last_change":"2024-04-03T03:38:24.717991+0000","last_active":"2024-04-03T05:14:07.960731+0000","last_peered":"2024-04-03T05:14:07.960731+0000","last_clean":"2024-04-03T05:14:07.960731+0000","last_became_active":"2024-04-03T03:38:24.715050+0000","last_became_peered":"2024-04-03T03:38:24.715050+0000","last_unstale":"2024-04-03T05:14:07.960731+0000","last_undegraded":"2024-04-03T05:14:07.960731+0000","last_fullsized":"2024-04-03T05:14:07.960731+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:38:21.124593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19655769,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":404,"num_read_kb":21764,"num_write":1119,"num_write_kb":53575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060528+0000","last_change":"2024-04-03T03:38:28.717346+0000","last_active":"2024-04-03T05:10:58.060528+0000","last_peered":"2024-04-03T05:10:58.060528+0000","last_clean":"2024-04-03T05:10:58.060528+0000","last_became_active":"2024-04-03T03:38:28.716638+0000","last_became_peered":"2024-04-03T03:38:28.716638+0000","last_unstale":"2024-04-03T05:10:58.060528+0000","last_undegraded":"2024-04-03T05:10:58.060528+0000","last_fullsized":"2024-04-03T05:10:58.060528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:43:16.450833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'501","reported_seq":1161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.538155+0000","last_change":"2024-04-03T03:38:30.726825+0000","last_active":"2024-04-03T05:14:07.538155+0000","last_peered":"2024-04-03T05:14:07.538155+0000","last_clean":"2024-04-03T05:14:07.538155+0000","last_became_active":"2024-04-03T03:38:30.725324+0000","last_became_peered":"2024-04-03T03:38:30.725324+0000","last_unstale":"2024-04-03T05:14:07.538155+0000","last_undegraded":"2024-04-03T05:14:07.538155+0000","last_fullsized":"2024-04-03T05:14:07.538155+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:45:26.155940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126247,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":859,"num_read_kb":1917,"num_write":702,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.828908+0000","last_change":"2024-04-03T03:38:32.735911+0000","last_active":"2024-04-03T05:11:03.828908+0000","last_peered":"2024-04-03T05:11:03.828908+0000","last_clean":"2024-04-03T05:11:03.828908+0000","last_became_active":"2024-04-03T03:38:32.730456+0000","last_became_peered":"2024-04-03T03:38:32.730456+0000","last_unstale":"2024-04-03T05:11:03.828908+0000","last_undegraded":"2024-04-03T05:11:03.828908+0000","last_fullsized":"2024-04-03T05:11:03.828908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:36:50.012219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'158","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.481133+0000","last_change":"2024-04-03T03:38:34.940007+0000","last_active":"2024-04-03T05:11:08.481133+0000","last_peered":"2024-04-03T05:11:08.481133+0000","last_clean":"2024-04-03T05:11:08.481133+0000","last_became_active":"2024-04-03T03:38:34.939244+0000","last_became_peered":"2024-04-03T03:38:34.939244+0000","last_unstale":"2024-04-03T05:11:08.481133+0000","last_undegraded":"2024-04-03T05:11:08.481133+0000","last_fullsized":"2024-04-03T05:11:08.481133+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:49:45.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":238,"num_write":361,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'563","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.118189+0000","last_change":"2024-04-03T03:38:26.723127+0000","last_active":"2024-04-03T05:13:59.118189+0000","last_peered":"2024-04-03T05:13:59.118189+0000","last_clean":"2024-04-03T05:13:59.118189+0000","last_became_active":"2024-04-03T03:38:26.718375+0000","last_became_peered":"2024-04-03T03:38:26.718375+0000","last_unstale":"2024-04-03T05:13:59.118189+0000","last_undegraded":"2024-04-03T05:13:59.118189+0000","last_fullsized":"2024-04-03T05:13:59.118189+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:58:09.941905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2911,"num_read_kb":2669,"num_write":774,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'267","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.837711+0000","last_change":"2024-04-03T03:38:24.730652+0000","last_active":"2024-04-03T05:14:07.837711+0000","last_peered":"2024-04-03T05:14:07.837711+0000","last_clean":"2024-04-03T05:14:07.837711+0000","last_became_active":"2024-04-03T03:38:24.730294+0000","last_became_peered":"2024-04-03T03:38:24.730294+0000","last_unstale":"2024-04-03T05:14:07.837711+0000","last_undegraded":"2024-04-03T05:14:07.837711+0000","last_fullsized":"2024-04-03T05:14:07.837711+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:53:27.113096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11567712,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":421,"num_read_kb":62893,"num_write":1267,"num_write_kb":30207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.996314+0000","last_change":"2024-04-03T03:38:28.720598+0000","last_active":"2024-04-03T05:10:08.996314+0000","last_peered":"2024-04-03T05:10:08.996314+0000","last_clean":"2024-04-03T05:10:08.996314+0000","last_became_active":"2024-04-03T03:38:28.719692+0000","last_became_peered":"2024-04-03T03:38:28.719692+0000","last_unstale":"2024-04-03T05:10:08.996314+0000","last_undegraded":"2024-04-03T05:10:08.996314+0000","last_fullsized":"2024-04-03T05:10:08.996314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:36.700015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'337","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.032362+0000","last_change":"2024-04-03T03:38:30.733396+0000","last_active":"2024-04-03T05:14:09.032362+0000","last_peered":"2024-04-03T05:14:09.032362+0000","last_clean":"2024-04-03T05:14:09.032362+0000","last_became_active":"2024-04-03T03:38:30.732529+0000","last_became_peered":"2024-04-03T03:38:30.732529+0000","last_unstale":"2024-04-03T05:14:09.032362+0000","last_undegraded":"2024-04-03T05:14:09.032362+0000","last_fullsized":"2024-04-03T05:14:09.032362+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:08:35.143644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":563,"num_read_kb":1112,"num_write":458,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:02.838256+0000","last_change":"2024-04-03T03:38:32.735100+0000","last_active":"2024-04-03T05:11:02.838256+0000","last_peered":"2024-04-03T05:11:02.838256+0000","last_clean":"2024-04-03T05:11:02.838256+0000","last_became_active":"2024-04-03T03:38:32.731752+0000","last_became_peered":"2024-04-03T03:38:32.731752+0000","last_unstale":"2024-04-03T05:11:02.838256+0000","last_undegraded":"2024-04-03T05:11:02.838256+0000","last_fullsized":"2024-04-03T05:11:02.838256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:55:58.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'186","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.365316+0000","last_change":"2024-04-03T03:38:34.737380+0000","last_active":"2024-04-03T05:12:13.365316+0000","last_peered":"2024-04-03T05:12:13.365316+0000","last_clean":"2024-04-03T05:12:13.365316+0000","last_became_active":"2024-04-03T03:38:34.736663+0000","last_became_peered":"2024-04-03T03:38:34.736663+0000","last_unstale":"2024-04-03T05:12:13.365316+0000","last_undegraded":"2024-04-03T05:12:13.365316+0000","last_fullsized":"2024-04-03T05:12:13.365316+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:12:54.724658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":719,"num_read_kb":691,"num_write":524,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'751","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.015946+0000","last_change":"2024-04-03T03:38:26.711611+0000","last_active":"2024-04-03T05:10:58.015946+0000","last_peered":"2024-04-03T05:10:58.015946+0000","last_clean":"2024-04-03T05:10:58.015946+0000","last_became_active":"2024-04-03T03:38:26.711214+0000","last_became_peered":"2024-04-03T03:38:26.711214+0000","last_unstale":"2024-04-03T05:10:58.015946+0000","last_undegraded":"2024-04-03T05:10:58.015946+0000","last_fullsized":"2024-04-03T05:10:58.015946+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:14:42.035748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3543,"num_read_kb":3207,"num_write":983,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'256","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.616832+0000","last_change":"2024-04-03T03:38:24.761914+0000","last_active":"2024-04-03T05:14:08.616832+0000","last_peered":"2024-04-03T05:14:08.616832+0000","last_clean":"2024-04-03T05:14:08.616832+0000","last_became_active":"2024-04-03T03:38:24.761330+0000","last_became_peered":"2024-04-03T03:38:24.761330+0000","last_unstale":"2024-04-03T05:14:08.616832+0000","last_undegraded":"2024-04-03T05:14:08.616832+0000","last_fullsized":"2024-04-03T05:14:08.616832+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:38:35.443926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13063112,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":366,"num_read_kb":53466,"num_write":1078,"num_write_kb":35897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633284+0000","last_change":"2024-04-03T03:38:28.725003+0000","last_active":"2024-04-03T05:10:58.633284+0000","last_peered":"2024-04-03T05:10:58.633284+0000","last_clean":"2024-04-03T05:10:58.633284+0000","last_became_active":"2024-04-03T03:38:28.724296+0000","last_became_peered":"2024-04-03T03:38:28.724296+0000","last_unstale":"2024-04-03T05:10:58.633284+0000","last_undegraded":"2024-04-03T05:10:58.633284+0000","last_fullsized":"2024-04-03T05:10:58.633284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:51:03.993282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'304","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.524060+0000","last_change":"2024-04-03T03:38:30.822164+0000","last_active":"2024-04-03T05:14:00.524060+0000","last_peered":"2024-04-03T05:14:00.524060+0000","last_clean":"2024-04-03T05:14:00.524060+0000","last_became_active":"2024-04-03T03:38:30.821335+0000","last_became_peered":"2024-04-03T03:38:30.821335+0000","last_unstale":"2024-04-03T05:14:00.524060+0000","last_undegraded":"2024-04-03T05:14:00.524060+0000","last_fullsized":"2024-04-03T05:14:00.524060+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:51:04.303948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":994,"num_write":396,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.836987+0000","last_change":"2024-04-03T03:38:32.731796+0000","last_active":"2024-04-03T05:10:57.836987+0000","last_peered":"2024-04-03T05:10:57.836987+0000","last_clean":"2024-04-03T05:10:57.836987+0000","last_became_active":"2024-04-03T03:38:32.730954+0000","last_became_peered":"2024-04-03T03:38:32.730954+0000","last_unstale":"2024-04-03T05:10:57.836987+0000","last_undegraded":"2024-04-03T05:10:57.836987+0000","last_fullsized":"2024-04-03T05:10:57.836987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:28.623155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'104","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.542084+0000","last_change":"2024-04-03T03:38:34.755793+0000","last_active":"2024-04-03T05:14:00.542084+0000","last_peered":"2024-04-03T05:14:00.542084+0000","last_clean":"2024-04-03T05:14:00.542084+0000","last_became_active":"2024-04-03T03:38:34.754544+0000","last_became_peered":"2024-04-03T03:38:34.754544+0000","last_unstale":"2024-04-03T05:14:00.542084+0000","last_undegraded":"2024-04-03T05:14:00.542084+0000","last_fullsized":"2024-04-03T05:14:00.542084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:02.640564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":262,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'316","reported_seq":1732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.824774+0000","last_change":"2024-04-03T03:38:26.721787+0000","last_active":"2024-04-03T05:10:57.824774+0000","last_peered":"2024-04-03T05:10:57.824774+0000","last_clean":"2024-04-03T05:10:57.824774+0000","last_became_active":"2024-04-03T03:38:26.720984+0000","last_became_peered":"2024-04-03T03:38:26.720984+0000","last_unstale":"2024-04-03T05:10:57.824774+0000","last_undegraded":"2024-04-03T05:10:57.824774+0000","last_fullsized":"2024-04-03T05:10:57.824774+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:26:13.345541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1783,"num_read_kb":1722,"num_write":353,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'310","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.031545+0000","last_change":"2024-04-03T03:38:24.745501+0000","last_active":"2024-04-03T05:14:08.031545+0000","last_peered":"2024-04-03T05:14:08.031545+0000","last_clean":"2024-04-03T05:14:08.031545+0000","last_became_active":"2024-04-03T03:38:24.745183+0000","last_became_peered":"2024-04-03T03:38:24.745183+0000","last_unstale":"2024-04-03T05:14:08.031545+0000","last_undegraded":"2024-04-03T05:14:08.031545+0000","last_fullsized":"2024-04-03T05:14:08.031545+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:07:38.812807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7909340,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":464,"num_read_kb":13372,"num_write":1226,"num_write_kb":33178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:02.838294+0000","last_change":"2024-04-03T03:38:28.711378+0000","last_active":"2024-04-03T05:11:02.838294+0000","last_peered":"2024-04-03T05:11:02.838294+0000","last_clean":"2024-04-03T05:11:02.838294+0000","last_became_active":"2024-04-03T03:38:28.710708+0000","last_became_peered":"2024-04-03T03:38:28.710708+0000","last_unstale":"2024-04-03T05:11:02.838294+0000","last_undegraded":"2024-04-03T05:11:02.838294+0000","last_fullsized":"2024-04-03T05:11:02.838294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:02.818218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'150","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.634475+0000","last_change":"2024-04-03T03:38:30.823215+0000","last_active":"2024-04-03T05:11:03.634475+0000","last_peered":"2024-04-03T05:11:03.634475+0000","last_clean":"2024-04-03T05:11:03.634475+0000","last_became_active":"2024-04-03T03:38:30.822452+0000","last_became_peered":"2024-04-03T03:38:30.822452+0000","last_unstale":"2024-04-03T05:11:03.634475+0000","last_undegraded":"2024-04-03T05:11:03.634475+0000","last_fullsized":"2024-04-03T05:11:03.634475+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:15:19.776214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":168,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'525","reported_seq":4604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.490669+0000","last_change":"2024-04-03T03:38:32.735340+0000","last_active":"2024-04-03T05:14:07.490669+0000","last_peered":"2024-04-03T05:14:07.490669+0000","last_clean":"2024-04-03T05:14:07.490669+0000","last_became_active":"2024-04-03T03:38:32.734617+0000","last_became_peered":"2024-04-03T03:38:32.734617+0000","last_unstale":"2024-04-03T05:14:07.490669+0000","last_undegraded":"2024-04-03T05:14:07.490669+0000","last_fullsized":"2024-04-03T05:14:07.490669+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:51:07.710407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'182","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:59.046748+0000","last_change":"2024-04-03T03:38:34.758091+0000","last_active":"2024-04-03T05:11:59.046748+0000","last_peered":"2024-04-03T05:11:59.046748+0000","last_clean":"2024-04-03T05:11:59.046748+0000","last_became_active":"2024-04-03T03:38:34.756694+0000","last_became_peered":"2024-04-03T03:38:34.756694+0000","last_unstale":"2024-04-03T05:11:59.046748+0000","last_undegraded":"2024-04-03T05:11:59.046748+0000","last_fullsized":"2024-04-03T05:11:59.046748+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:19:35.787478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":410,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'389","reported_seq":2026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633205+0000","last_change":"2024-04-03T03:38:26.745973+0000","last_active":"2024-04-03T05:10:58.633205+0000","last_peered":"2024-04-03T05:10:58.633205+0000","last_clean":"2024-04-03T05:10:58.633205+0000","last_became_active":"2024-04-03T03:38:26.744905+0000","last_became_peered":"2024-04-03T03:38:26.744905+0000","last_unstale":"2024-04-03T05:10:58.633205+0000","last_undegraded":"2024-04-03T05:10:58.633205+0000","last_fullsized":"2024-04-03T05:10:58.633205+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:28:50.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2315,"num_read_kb":2222,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.808422+0000","last_change":"2024-04-03T03:38:58.351960+0000","last_active":"2024-04-03T05:14:08.808422+0000","last_peered":"2024-04-03T05:14:08.808422+0000","last_clean":"2024-04-03T05:14:08.808422+0000","last_became_active":"2024-04-03T03:38:58.350828+0000","last_became_peered":"2024-04-03T03:38:58.350828+0000","last_unstale":"2024-04-03T05:14:08.808422+0000","last_undegraded":"2024-04-03T05:14:08.808422+0000","last_fullsized":"2024-04-03T05:14:08.808422+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:36:44.987003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10752549,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":500,"num_read_kb":21295,"num_write":1260,"num_write_kb":30213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:59.033276+0000","last_change":"2024-04-03T03:38:28.727247+0000","last_active":"2024-04-03T05:10:59.033276+0000","last_peered":"2024-04-03T05:10:59.033276+0000","last_clean":"2024-04-03T05:10:59.033276+0000","last_became_active":"2024-04-03T03:38:28.726412+0000","last_became_peered":"2024-04-03T03:38:28.726412+0000","last_unstale":"2024-04-03T05:10:59.033276+0000","last_undegraded":"2024-04-03T05:10:59.033276+0000","last_fullsized":"2024-04-03T05:10:59.033276+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:55:21.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'377","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.822893+0000","last_change":"2024-04-03T03:38:30.722458+0000","last_active":"2024-04-03T05:14:07.822893+0000","last_peered":"2024-04-03T05:14:07.822893+0000","last_clean":"2024-04-03T05:14:07.822893+0000","last_became_active":"2024-04-03T03:38:30.721642+0000","last_became_peered":"2024-04-03T03:38:30.721642+0000","last_unstale":"2024-04-03T05:14:07.822893+0000","last_undegraded":"2024-04-03T05:14:07.822893+0000","last_fullsized":"2024-04-03T05:14:07.822893+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:55:24.375134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44870,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":590,"num_read_kb":1131,"num_write":454,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.052159+0000","last_change":"2024-04-03T03:38:32.740223+0000","last_active":"2024-04-03T05:10:23.052159+0000","last_peered":"2024-04-03T05:10:23.052159+0000","last_clean":"2024-04-03T05:10:23.052159+0000","last_became_active":"2024-04-03T03:38:32.739496+0000","last_became_peered":"2024-04-03T03:38:32.739496+0000","last_unstale":"2024-04-03T05:10:23.052159+0000","last_undegraded":"2024-04-03T05:10:23.052159+0000","last_fullsized":"2024-04-03T05:10:23.052159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:01:28.964739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'91","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026574+0000","last_change":"2024-04-03T03:38:34.751547+0000","last_active":"2024-04-03T05:10:29.026574+0000","last_peered":"2024-04-03T05:10:29.026574+0000","last_clean":"2024-04-03T05:10:29.026574+0000","last_became_active":"2024-04-03T03:38:34.751005+0000","last_became_peered":"2024-04-03T03:38:34.751005+0000","last_unstale":"2024-04-03T05:10:29.026574+0000","last_undegraded":"2024-04-03T05:10:29.026574+0000","last_fullsized":"2024-04-03T05:10:29.026574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:21.830655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":214,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'780","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.458352+0000","last_change":"2024-04-03T03:38:26.745971+0000","last_active":"2024-04-03T05:11:08.458352+0000","last_peered":"2024-04-03T05:11:08.458352+0000","last_clean":"2024-04-03T05:11:08.458352+0000","last_became_active":"2024-04-03T03:38:26.745135+0000","last_became_peered":"2024-04-03T03:38:26.745135+0000","last_unstale":"2024-04-03T05:11:08.458352+0000","last_undegraded":"2024-04-03T05:11:08.458352+0000","last_fullsized":"2024-04-03T05:11:08.458352+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:10.552726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3471,"num_read_kb":3079,"num_write":1070,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'252","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.781535+0000","last_change":"2024-04-03T03:38:24.744318+0000","last_active":"2024-04-03T05:14:08.781535+0000","last_peered":"2024-04-03T05:14:08.781535+0000","last_clean":"2024-04-03T05:14:08.781535+0000","last_became_active":"2024-04-03T03:38:24.743710+0000","last_became_peered":"2024-04-03T03:38:24.743710+0000","last_unstale":"2024-04-03T05:14:08.781535+0000","last_undegraded":"2024-04-03T05:14:08.781535+0000","last_fullsized":"2024-04-03T05:14:08.781535+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:21.325257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828727,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":374,"num_read_kb":32345,"num_write":985,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.827699+0000","last_change":"2024-04-03T03:38:28.732955+0000","last_active":"2024-04-03T05:10:58.827699+0000","last_peered":"2024-04-03T05:10:58.827699+0000","last_clean":"2024-04-03T05:10:58.827699+0000","last_became_active":"2024-04-03T03:38:28.731547+0000","last_became_peered":"2024-04-03T03:38:28.731547+0000","last_unstale":"2024-04-03T05:10:58.827699+0000","last_undegraded":"2024-04-03T05:10:58.827699+0000","last_fullsized":"2024-04-03T05:10:58.827699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:15:17.819800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'314","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.941454+0000","last_change":"2024-04-03T03:38:30.733183+0000","last_active":"2024-04-03T05:14:07.941454+0000","last_peered":"2024-04-03T05:14:07.941454+0000","last_clean":"2024-04-03T05:14:07.941454+0000","last_became_active":"2024-04-03T03:38:30.732095+0000","last_became_peered":"2024-04-03T03:38:30.732095+0000","last_unstale":"2024-04-03T05:14:07.941454+0000","last_undegraded":"2024-04-03T05:14:07.941454+0000","last_fullsized":"2024-04-03T05:14:07.941454+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:12:09.905056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1184,"num_write":416,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:44.003351+0000","last_change":"2024-04-03T03:38:32.744744+0000","last_active":"2024-04-03T05:10:44.003351+0000","last_peered":"2024-04-03T05:10:44.003351+0000","last_clean":"2024-04-03T05:10:44.003351+0000","last_became_active":"2024-04-03T03:38:32.743994+0000","last_became_peered":"2024-04-03T03:38:32.743994+0000","last_unstale":"2024-04-03T05:10:44.003351+0000","last_undegraded":"2024-04-03T05:10:44.003351+0000","last_fullsized":"2024-04-03T05:10:44.003351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:21:04.554872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'88","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.008492+0000","last_change":"2024-04-03T03:38:34.942097+0000","last_active":"2024-04-03T05:10:28.008492+0000","last_peered":"2024-04-03T05:10:28.008492+0000","last_clean":"2024-04-03T05:10:28.008492+0000","last_became_active":"2024-04-03T03:38:34.941122+0000","last_became_peered":"2024-04-03T03:38:34.941122+0000","last_unstale":"2024-04-03T05:10:28.008492+0000","last_undegraded":"2024-04-03T05:10:28.008492+0000","last_fullsized":"2024-04-03T05:10:28.008492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:35:17.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'825","reported_seq":2457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218515+0000","last_change":"2024-04-03T03:38:26.713100+0000","last_active":"2024-04-03T05:12:22.218515+0000","last_peered":"2024-04-03T05:12:22.218515+0000","last_clean":"2024-04-03T05:12:22.218515+0000","last_became_active":"2024-04-03T03:38:26.710804+0000","last_became_peered":"2024-04-03T03:38:26.710804+0000","last_unstale":"2024-04-03T05:12:22.218515+0000","last_undegraded":"2024-04-03T05:12:22.218515+0000","last_fullsized":"2024-04-03T05:12:22.218515+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:56:46.565815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3882,"num_read_kb":3472,"num_write":1106,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'300","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.934963+0000","last_change":"2024-04-03T03:38:24.727210+0000","last_active":"2024-04-03T05:14:07.934963+0000","last_peered":"2024-04-03T05:14:07.934963+0000","last_clean":"2024-04-03T05:14:07.934963+0000","last_became_active":"2024-04-03T03:38:24.726765+0000","last_became_peered":"2024-04-03T03:38:24.726765+0000","last_unstale":"2024-04-03T05:14:07.934963+0000","last_undegraded":"2024-04-03T05:14:07.934963+0000","last_fullsized":"2024-04-03T05:14:07.934963+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:44:40.435859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221133,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":474,"num_read_kb":31084,"num_write":1216,"num_write_kb":58109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.623953+0000","last_change":"2024-04-03T03:38:28.725916+0000","last_active":"2024-04-03T05:10:18.623953+0000","last_peered":"2024-04-03T05:10:18.623953+0000","last_clean":"2024-04-03T05:10:18.623953+0000","last_became_active":"2024-04-03T03:38:28.725139+0000","last_became_peered":"2024-04-03T03:38:28.725139+0000","last_unstale":"2024-04-03T05:10:18.623953+0000","last_undegraded":"2024-04-03T05:10:18.623953+0000","last_fullsized":"2024-04-03T05:10:18.623953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:05:50.849970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'255","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.517970+0000","last_change":"2024-04-03T03:38:30.721488+0000","last_active":"2024-04-03T05:14:00.517970+0000","last_peered":"2024-04-03T05:14:00.517970+0000","last_clean":"2024-04-03T05:14:00.517970+0000","last_became_active":"2024-04-03T03:38:30.719983+0000","last_became_peered":"2024-04-03T03:38:30.719983+0000","last_unstale":"2024-04-03T05:14:00.517970+0000","last_undegraded":"2024-04-03T05:14:00.517970+0000","last_fullsized":"2024-04-03T05:14:00.517970+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:30:54.735121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61822,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":951,"num_write":354,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.634346+0000","last_change":"2024-04-03T03:38:32.729151+0000","last_active":"2024-04-03T05:11:03.634346+0000","last_peered":"2024-04-03T05:11:03.634346+0000","last_clean":"2024-04-03T05:11:03.634346+0000","last_became_active":"2024-04-03T03:38:32.728438+0000","last_became_peered":"2024-04-03T03:38:32.728438+0000","last_unstale":"2024-04-03T05:11:03.634346+0000","last_undegraded":"2024-04-03T05:11:03.634346+0000","last_fullsized":"2024-04-03T05:11:03.634346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:14:01.189190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'136","reported_seq":1179,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.956146+0000","last_change":"2024-04-03T03:38:34.749288+0000","last_active":"2024-04-03T05:12:13.956146+0000","last_peered":"2024-04-03T05:12:13.956146+0000","last_clean":"2024-04-03T05:12:13.956146+0000","last_became_active":"2024-04-03T03:38:34.748329+0000","last_became_peered":"2024-04-03T03:38:34.748329+0000","last_unstale":"2024-04-03T05:12:13.956146+0000","last_undegraded":"2024-04-03T05:12:13.956146+0000","last_fullsized":"2024-04-03T05:12:13.956146+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:59:32.495711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":680,"num_read_kb":679,"num_write":303,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'715","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.623993+0000","last_change":"2024-04-03T03:38:26.746139+0000","last_active":"2024-04-03T05:10:18.623993+0000","last_peered":"2024-04-03T05:10:18.623993+0000","last_clean":"2024-04-03T05:10:18.623993+0000","last_became_active":"2024-04-03T03:38:26.742044+0000","last_became_peered":"2024-04-03T03:38:26.742044+0000","last_unstale":"2024-04-03T05:10:18.623993+0000","last_undegraded":"2024-04-03T05:10:18.623993+0000","last_fullsized":"2024-04-03T05:10:18.623993+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:54:05.286590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3199,"num_read_kb":2853,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'278","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.997908+0000","last_change":"2024-04-03T03:38:24.741033+0000","last_active":"2024-04-03T05:14:07.997908+0000","last_peered":"2024-04-03T05:14:07.997908+0000","last_clean":"2024-04-03T05:14:07.997908+0000","last_became_active":"2024-04-03T03:38:24.740329+0000","last_became_peered":"2024-04-03T03:38:24.740329+0000","last_unstale":"2024-04-03T05:14:07.997908+0000","last_undegraded":"2024-04-03T05:14:07.997908+0000","last_fullsized":"2024-04-03T05:14:07.997908+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:21.254706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10960120,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":422,"num_read_kb":56728,"num_write":1204,"num_write_kb":35698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830115+0000","last_change":"2024-04-03T03:38:28.726028+0000","last_active":"2024-04-03T05:10:47.830115+0000","last_peered":"2024-04-03T05:10:47.830115+0000","last_clean":"2024-04-03T05:10:47.830115+0000","last_became_active":"2024-04-03T03:38:28.725225+0000","last_became_peered":"2024-04-03T03:38:28.725225+0000","last_unstale":"2024-04-03T05:10:47.830115+0000","last_undegraded":"2024-04-03T05:10:47.830115+0000","last_fullsized":"2024-04-03T05:10:47.830115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:50:16.486831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'329","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.526781+0000","last_change":"2024-04-03T03:38:30.718060+0000","last_active":"2024-04-03T05:14:00.526781+0000","last_peered":"2024-04-03T05:14:00.526781+0000","last_clean":"2024-04-03T05:14:00.526781+0000","last_became_active":"2024-04-03T03:38:30.717323+0000","last_became_peered":"2024-04-03T03:38:30.717323+0000","last_unstale":"2024-04-03T05:14:00.526781+0000","last_undegraded":"2024-04-03T05:14:00.526781+0000","last_fullsized":"2024-04-03T05:14:00.526781+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:07:23.819748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50184,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":998,"num_write":410,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.061582+0000","last_change":"2024-04-03T03:38:32.743866+0000","last_active":"2024-04-03T05:11:03.061582+0000","last_peered":"2024-04-03T05:11:03.061582+0000","last_clean":"2024-04-03T05:11:03.061582+0000","last_became_active":"2024-04-03T03:38:32.743076+0000","last_became_peered":"2024-04-03T03:38:32.743076+0000","last_unstale":"2024-04-03T05:11:03.061582+0000","last_undegraded":"2024-04-03T05:11:03.061582+0000","last_fullsized":"2024-04-03T05:11:03.061582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:28:25.384912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'76","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.102158+0000","last_change":"2024-04-03T03:38:34.750455+0000","last_active":"2024-04-03T05:13:59.102158+0000","last_peered":"2024-04-03T05:13:59.102158+0000","last_clean":"2024-04-03T05:13:59.102158+0000","last_became_active":"2024-04-03T03:38:34.749644+0000","last_became_peered":"2024-04-03T03:38:34.749644+0000","last_unstale":"2024-04-03T05:13:59.102158+0000","last_undegraded":"2024-04-03T05:13:59.102158+0000","last_fullsized":"2024-04-03T05:13:59.102158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:17.219887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":90,"num_write":191,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'754","reported_seq":2410,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846312+0000","last_change":"2024-04-03T03:38:26.722653+0000","last_active":"2024-04-03T05:11:37.846312+0000","last_peered":"2024-04-03T05:11:37.846312+0000","last_clean":"2024-04-03T05:11:37.846312+0000","last_became_active":"2024-04-03T03:38:26.721951+0000","last_became_peered":"2024-04-03T03:38:26.721951+0000","last_unstale":"2024-04-03T05:11:37.846312+0000","last_undegraded":"2024-04-03T05:11:37.846312+0000","last_fullsized":"2024-04-03T05:11:37.846312+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:14:23.340976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3698,"num_read_kb":3347,"num_write":1000,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'271","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.960979+0000","last_change":"2024-04-03T03:38:24.742187+0000","last_active":"2024-04-03T05:14:08.960979+0000","last_peered":"2024-04-03T05:14:08.960979+0000","last_clean":"2024-04-03T05:14:08.960979+0000","last_became_active":"2024-04-03T03:38:24.741407+0000","last_became_peered":"2024-04-03T03:38:24.741407+0000","last_unstale":"2024-04-03T05:14:08.960979+0000","last_undegraded":"2024-04-03T05:14:08.960979+0000","last_fullsized":"2024-04-03T05:14:08.960979+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:44:29.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651184,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":385,"num_read_kb":24965,"num_write":1117,"num_write_kb":36078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1406","reported_seq":2747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846282+0000","last_change":"2024-04-03T03:38:26.719813+0000","last_active":"2024-04-03T05:11:37.846282+0000","last_peered":"2024-04-03T05:11:37.846282+0000","last_clean":"2024-04-03T05:11:37.846282+0000","last_became_active":"2024-04-03T03:38:26.719386+0000","last_became_peered":"2024-04-03T03:38:26.719386+0000","last_unstale":"2024-04-03T05:11:37.846282+0000","last_undegraded":"2024-04-03T05:11:37.846282+0000","last_fullsized":"2024-04-03T05:11:37.846282+0000","mapping_epoch":25,"log_start":"263'1300","ondisk_log_start":"263'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:39:04.440314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5587,"num_read_kb":4776,"num_write":2003,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'216","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:07.814009+0000","last_change":"2024-04-03T03:38:24.748771+0000","last_active":"2024-04-03T05:10:07.814009+0000","last_peered":"2024-04-03T05:10:07.814009+0000","last_clean":"2024-04-03T05:10:07.814009+0000","last_became_active":"2024-04-03T03:38:24.748369+0000","last_became_peered":"2024-04-03T03:38:24.748369+0000","last_unstale":"2024-04-03T05:10:07.814009+0000","last_undegraded":"2024-04-03T05:10:07.814009+0000","last_fullsized":"2024-04-03T05:10:07.814009+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:30:39.474530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6789502,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":372,"num_read_kb":45141,"num_write":967,"num_write_kb":24649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'761","reported_seq":2384,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.836588+0000","last_change":"2024-04-03T03:38:26.715097+0000","last_active":"2024-04-03T05:11:38.836588+0000","last_peered":"2024-04-03T05:11:38.836588+0000","last_clean":"2024-04-03T05:11:38.836588+0000","last_became_active":"2024-04-03T03:38:26.713821+0000","last_became_peered":"2024-04-03T03:38:26.713821+0000","last_unstale":"2024-04-03T05:11:38.836588+0000","last_undegraded":"2024-04-03T05:11:38.836588+0000","last_fullsized":"2024-04-03T05:11:38.836588+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:02:25.387554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3127,"num_write":983,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'316","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.816484+0000","last_change":"2024-04-03T03:38:24.741935+0000","last_active":"2024-04-03T05:14:08.816484+0000","last_peered":"2024-04-03T05:14:08.816484+0000","last_clean":"2024-04-03T05:14:08.816484+0000","last_became_active":"2024-04-03T03:38:24.741322+0000","last_became_peered":"2024-04-03T03:38:24.741322+0000","last_unstale":"2024-04-03T05:14:08.816484+0000","last_undegraded":"2024-04-03T05:14:08.816484+0000","last_fullsized":"2024-04-03T05:14:08.816484+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:47.935999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11128362,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":503,"num_read_kb":110805,"num_write":1171,"num_write_kb":46785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'793","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846165+0000","last_change":"2024-04-03T03:38:26.719415+0000","last_active":"2024-04-03T05:11:37.846165+0000","last_peered":"2024-04-03T05:11:37.846165+0000","last_clean":"2024-04-03T05:11:37.846165+0000","last_became_active":"2024-04-03T03:38:26.718895+0000","last_became_peered":"2024-04-03T03:38:26.718895+0000","last_unstale":"2024-04-03T05:11:37.846165+0000","last_undegraded":"2024-04-03T05:11:37.846165+0000","last_fullsized":"2024-04-03T05:11:37.846165+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:06:38.311692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3511,"num_read_kb":3115,"num_write":1065,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'317","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.995910+0000","last_change":"2024-04-03T03:38:58.351583+0000","last_active":"2024-04-03T05:14:07.995910+0000","last_peered":"2024-04-03T05:14:07.995910+0000","last_clean":"2024-04-03T05:14:07.995910+0000","last_became_active":"2024-04-03T03:38:58.349944+0000","last_became_peered":"2024-04-03T03:38:58.349944+0000","last_unstale":"2024-04-03T05:14:07.995910+0000","last_undegraded":"2024-04-03T05:14:07.995910+0000","last_fullsized":"2024-04-03T05:14:07.995910+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:01.822490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7433091,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":823,"num_read_kb":89019,"num_write":1324,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1190","reported_seq":2755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218508+0000","last_change":"2024-04-03T03:38:26.715473+0000","last_active":"2024-04-03T05:12:22.218508+0000","last_peered":"2024-04-03T05:12:22.218508+0000","last_clean":"2024-04-03T05:12:22.218508+0000","last_became_active":"2024-04-03T03:38:26.715042+0000","last_became_peered":"2024-04-03T03:38:26.715042+0000","last_unstale":"2024-04-03T05:12:22.218508+0000","last_undegraded":"2024-04-03T05:12:22.218508+0000","last_fullsized":"2024-04-03T05:12:22.218508+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:00.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5057,"num_read_kb":4409,"num_write":1655,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'243","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.932441+0000","last_change":"2024-04-03T03:38:58.351316+0000","last_active":"2024-04-03T05:14:07.932441+0000","last_peered":"2024-04-03T05:14:07.932441+0000","last_clean":"2024-04-03T05:14:07.932441+0000","last_became_active":"2024-04-03T03:38:58.350321+0000","last_became_peered":"2024-04-03T03:38:58.350321+0000","last_unstale":"2024-04-03T05:14:07.932441+0000","last_undegraded":"2024-04-03T05:14:07.932441+0000","last_fullsized":"2024-04-03T05:14:07.932441+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:29:08.087215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10015119,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":476,"num_read_kb":66631,"num_write":1027,"num_write_kb":28536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'742","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398107+0000","last_change":"2024-04-03T03:38:26.745737+0000","last_active":"2024-04-03T05:11:18.398107+0000","last_peered":"2024-04-03T05:11:18.398107+0000","last_clean":"2024-04-03T05:11:18.398107+0000","last_became_active":"2024-04-03T03:38:26.744330+0000","last_became_peered":"2024-04-03T03:38:26.744330+0000","last_unstale":"2024-04-03T05:11:18.398107+0000","last_undegraded":"2024-04-03T05:11:18.398107+0000","last_fullsized":"2024-04-03T05:11:18.398107+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:18:51.864453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3386,"num_read_kb":3032,"num_write":1008,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'272","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.742681+0000","last_change":"2024-04-03T03:38:24.708018+0000","last_active":"2024-04-03T05:14:07.742681+0000","last_peered":"2024-04-03T05:14:07.742681+0000","last_clean":"2024-04-03T05:14:07.742681+0000","last_became_active":"2024-04-03T03:38:24.707626+0000","last_became_peered":"2024-04-03T03:38:24.707626+0000","last_unstale":"2024-04-03T05:14:07.742681+0000","last_undegraded":"2024-04-03T05:14:07.742681+0000","last_fullsized":"2024-04-03T05:14:07.742681+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:55:34.304671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5727928,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":512,"num_read_kb":9989,"num_write":1250,"num_write_kb":25388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'423","reported_seq":1811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.229419+0000","last_change":"2024-04-03T03:38:26.726283+0000","last_active":"2024-04-03T05:10:55.229419+0000","last_peered":"2024-04-03T05:10:55.229419+0000","last_clean":"2024-04-03T05:10:55.229419+0000","last_became_active":"2024-04-03T03:38:26.725513+0000","last_became_peered":"2024-04-03T03:38:26.725513+0000","last_unstale":"2024-04-03T05:10:55.229419+0000","last_undegraded":"2024-04-03T05:10:55.229419+0000","last_fullsized":"2024-04-03T05:10:55.229419+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:40:24.269906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2235,"num_read_kb":2034,"num_write":556,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'241","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.987319+0000","last_change":"2024-04-03T03:38:24.749614+0000","last_active":"2024-04-03T05:14:08.987319+0000","last_peered":"2024-04-03T05:14:08.987319+0000","last_clean":"2024-04-03T05:14:08.987319+0000","last_became_active":"2024-04-03T03:38:24.748923+0000","last_became_peered":"2024-04-03T03:38:24.748923+0000","last_unstale":"2024-04-03T05:14:08.987319+0000","last_undegraded":"2024-04-03T05:14:08.987319+0000","last_fullsized":"2024-04-03T05:14:08.987319+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:57.601061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4531786,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":392,"num_read_kb":42672,"num_write":989,"num_write_kb":23960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'702","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.401427+0000","last_change":"2024-04-03T03:38:26.717032+0000","last_active":"2024-04-03T05:11:18.401427+0000","last_peered":"2024-04-03T05:11:18.401427+0000","last_clean":"2024-04-03T05:11:18.401427+0000","last_became_active":"2024-04-03T03:38:26.716359+0000","last_became_peered":"2024-04-03T03:38:26.716359+0000","last_unstale":"2024-04-03T05:11:18.401427+0000","last_undegraded":"2024-04-03T05:11:18.401427+0000","last_fullsized":"2024-04-03T05:11:18.401427+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:50:51.526153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3142,"num_read_kb":2808,"num_write":934,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'279","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.961213+0000","last_change":"2024-04-03T03:38:24.718541+0000","last_active":"2024-04-03T05:14:07.961213+0000","last_peered":"2024-04-03T05:14:07.961213+0000","last_clean":"2024-04-03T05:14:07.961213+0000","last_became_active":"2024-04-03T03:38:24.716473+0000","last_became_peered":"2024-04-03T03:38:24.716473+0000","last_unstale":"2024-04-03T05:14:07.961213+0000","last_undegraded":"2024-04-03T05:14:07.961213+0000","last_fullsized":"2024-04-03T05:14:07.961213+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:02.325821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15301456,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":410,"num_read_kb":31436,"num_write":1179,"num_write_kb":38562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'397","reported_seq":1846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.071686+0000","last_change":"2024-04-03T03:38:26.717644+0000","last_active":"2024-04-03T05:11:48.071686+0000","last_peered":"2024-04-03T05:11:48.071686+0000","last_clean":"2024-04-03T05:11:48.071686+0000","last_became_active":"2024-04-03T03:38:26.716435+0000","last_became_peered":"2024-04-03T03:38:26.716435+0000","last_unstale":"2024-04-03T05:11:48.071686+0000","last_undegraded":"2024-04-03T05:11:48.071686+0000","last_fullsized":"2024-04-03T05:11:48.071686+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:50.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2146,"num_read_kb":2018,"num_write":509,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'374","reported_seq":1170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.604819+0000","last_change":"2024-04-03T03:38:24.741361+0000","last_active":"2024-04-03T05:14:08.604819+0000","last_peered":"2024-04-03T05:14:08.604819+0000","last_clean":"2024-04-03T05:14:08.604819+0000","last_became_active":"2024-04-03T03:38:24.740664+0000","last_became_peered":"2024-04-03T03:38:24.740664+0000","last_unstale":"2024-04-03T05:14:08.604819+0000","last_undegraded":"2024-04-03T05:14:08.604819+0000","last_fullsized":"2024-04-03T05:14:08.604819+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:01:10.065790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17012494,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":875,"num_read_kb":68467,"num_write":1456,"num_write_kb":54703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'407","reported_seq":1976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193909+0000","last_change":"2024-04-03T03:38:26.752206+0000","last_active":"2024-04-03T05:13:59.193909+0000","last_peered":"2024-04-03T05:13:59.193909+0000","last_clean":"2024-04-03T05:13:59.193909+0000","last_became_active":"2024-04-03T03:38:26.751399+0000","last_became_peered":"2024-04-03T03:38:26.751399+0000","last_unstale":"2024-04-03T05:13:59.193909+0000","last_undegraded":"2024-04-03T05:13:59.193909+0000","last_fullsized":"2024-04-03T05:13:59.193909+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:42:54.446617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2116,"num_write":486,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'240","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.006131+0000","last_change":"2024-04-03T03:38:24.718194+0000","last_active":"2024-04-03T05:14:08.006131+0000","last_peered":"2024-04-03T05:14:08.006131+0000","last_clean":"2024-04-03T05:14:08.006131+0000","last_became_active":"2024-04-03T03:38:24.715106+0000","last_became_peered":"2024-04-03T03:38:24.715106+0000","last_unstale":"2024-04-03T05:14:08.006131+0000","last_undegraded":"2024-04-03T05:14:08.006131+0000","last_fullsized":"2024-04-03T05:14:08.006131+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:03:49.995783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2790114,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":368,"num_read_kb":15103,"num_write":911,"num_write_kb":22507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'628","reported_seq":2277,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.106774+0000","last_change":"2024-04-03T03:38:26.717354+0000","last_active":"2024-04-03T05:13:59.106774+0000","last_peered":"2024-04-03T05:13:59.106774+0000","last_clean":"2024-04-03T05:13:59.106774+0000","last_became_active":"2024-04-03T03:38:26.717085+0000","last_became_peered":"2024-04-03T03:38:26.717085+0000","last_unstale":"2024-04-03T05:13:59.106774+0000","last_undegraded":"2024-04-03T05:13:59.106774+0000","last_fullsized":"2024-04-03T05:13:59.106774+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:56.981338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3119,"num_read_kb":2815,"num_write":838,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'292","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.785889+0000","last_change":"2024-04-03T03:38:24.755928+0000","last_active":"2024-04-03T05:14:08.785889+0000","last_peered":"2024-04-03T05:14:08.785889+0000","last_clean":"2024-04-03T05:14:08.785889+0000","last_became_active":"2024-04-03T03:38:24.755345+0000","last_became_peered":"2024-04-03T03:38:24.755345+0000","last_unstale":"2024-04-03T05:14:08.785889+0000","last_undegraded":"2024-04-03T05:14:08.785889+0000","last_fullsized":"2024-04-03T05:14:08.785889+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:17:46.705832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12025105,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":423,"num_read_kb":14159,"num_write":1232,"num_write_kb":40251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'700","reported_seq":2138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.221367+0000","last_change":"2024-04-03T03:38:26.746104+0000","last_active":"2024-04-03T05:12:22.221367+0000","last_peered":"2024-04-03T05:12:22.221367+0000","last_clean":"2024-04-03T05:12:22.221367+0000","last_became_active":"2024-04-03T03:38:26.745102+0000","last_became_peered":"2024-04-03T03:38:26.745102+0000","last_unstale":"2024-04-03T05:12:22.221367+0000","last_undegraded":"2024-04-03T05:12:22.221367+0000","last_fullsized":"2024-04-03T05:12:22.221367+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:13.112805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3146,"num_read_kb":2819,"num_write":922,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'304","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.085377+0000","last_change":"2024-04-03T03:38:24.729779+0000","last_active":"2024-04-03T05:14:08.085377+0000","last_peered":"2024-04-03T05:14:08.085377+0000","last_clean":"2024-04-03T05:14:08.085377+0000","last_became_active":"2024-04-03T03:38:24.729149+0000","last_became_peered":"2024-04-03T03:38:24.729149+0000","last_unstale":"2024-04-03T05:14:08.085377+0000","last_undegraded":"2024-04-03T05:14:08.085377+0000","last_fullsized":"2024-04-03T05:14:08.085377+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:44:06.201753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7840929,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":482,"num_read_kb":15990,"num_write":1149,"num_write_kb":30672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'376","reported_seq":1992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:44.029877+0000","last_change":"2024-04-03T03:38:26.714537+0000","last_active":"2024-04-03T05:10:44.029877+0000","last_peered":"2024-04-03T05:10:44.029877+0000","last_clean":"2024-04-03T05:10:44.029877+0000","last_became_active":"2024-04-03T03:38:26.713796+0000","last_became_peered":"2024-04-03T03:38:26.713796+0000","last_unstale":"2024-04-03T05:10:44.029877+0000","last_undegraded":"2024-04-03T05:10:44.029877+0000","last_fullsized":"2024-04-03T05:10:44.029877+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:36:53.201626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2155,"num_read_kb":2080,"num_write":414,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'257","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.903812+0000","last_change":"2024-04-03T03:38:24.750293+0000","last_active":"2024-04-03T05:14:08.903812+0000","last_peered":"2024-04-03T05:14:08.903812+0000","last_clean":"2024-04-03T05:14:08.903812+0000","last_became_active":"2024-04-03T03:38:24.749152+0000","last_became_peered":"2024-04-03T03:38:24.749152+0000","last_unstale":"2024-04-03T05:14:08.903812+0000","last_undegraded":"2024-04-03T05:14:08.903812+0000","last_fullsized":"2024-04-03T05:14:08.903812+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:48:44.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19277263,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":341,"num_read_kb":32536,"num_write":1004,"num_write_kb":42333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1009","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056540+0000","last_change":"2024-04-03T03:38:26.729663+0000","last_active":"2024-04-03T05:10:43.056540+0000","last_peered":"2024-04-03T05:10:43.056540+0000","last_clean":"2024-04-03T05:10:43.056540+0000","last_became_active":"2024-04-03T03:38:26.729124+0000","last_became_peered":"2024-04-03T03:38:26.729124+0000","last_unstale":"2024-04-03T05:10:43.056540+0000","last_undegraded":"2024-04-03T05:10:43.056540+0000","last_fullsized":"2024-04-03T05:10:43.056540+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":900,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:12:50.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4687,"num_read_kb":4082,"num_write":1459,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'307","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.827813+0000","last_change":"2024-04-03T03:38:24.732372+0000","last_active":"2024-04-03T05:14:08.827813+0000","last_peered":"2024-04-03T05:14:08.827813+0000","last_clean":"2024-04-03T05:14:08.827813+0000","last_became_active":"2024-04-03T03:38:24.731586+0000","last_became_peered":"2024-04-03T03:38:24.731586+0000","last_unstale":"2024-04-03T05:14:08.827813+0000","last_undegraded":"2024-04-03T05:14:08.827813+0000","last_fullsized":"2024-04-03T05:14:08.827813+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:34:38.457730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21457510,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":515,"num_read_kb":86610,"num_write":1353,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'364","reported_seq":1859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218422+0000","last_change":"2024-04-03T03:38:26.728365+0000","last_active":"2024-04-03T05:12:22.218422+0000","last_peered":"2024-04-03T05:12:22.218422+0000","last_clean":"2024-04-03T05:12:22.218422+0000","last_became_active":"2024-04-03T03:38:26.728070+0000","last_became_peered":"2024-04-03T03:38:26.728070+0000","last_unstale":"2024-04-03T05:12:22.218422+0000","last_undegraded":"2024-04-03T05:12:22.218422+0000","last_fullsized":"2024-04-03T05:12:22.218422+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:38:42.073330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2004,"num_read_kb":1922,"num_write":414,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'295","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.850382+0000","last_change":"2024-04-03T03:38:24.726372+0000","last_active":"2024-04-03T05:14:07.850382+0000","last_peered":"2024-04-03T05:14:07.850382+0000","last_clean":"2024-04-03T05:14:07.850382+0000","last_became_active":"2024-04-03T03:38:24.725969+0000","last_became_peered":"2024-04-03T03:38:24.725969+0000","last_unstale":"2024-04-03T05:14:07.850382+0000","last_undegraded":"2024-04-03T05:14:07.850382+0000","last_fullsized":"2024-04-03T05:14:07.850382+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:29:30.307028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6802328,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":481,"num_read_kb":62664,"num_write":1225,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'466","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:25.900290+0000","last_change":"2024-04-03T03:38:26.706006+0000","last_active":"2024-04-03T05:10:25.900290+0000","last_peered":"2024-04-03T05:10:25.900290+0000","last_clean":"2024-04-03T05:10:25.900290+0000","last_became_active":"2024-04-03T03:38:26.705142+0000","last_became_peered":"2024-04-03T03:38:26.705142+0000","last_unstale":"2024-04-03T05:10:25.900290+0000","last_undegraded":"2024-04-03T05:10:25.900290+0000","last_fullsized":"2024-04-03T05:10:25.900290+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:12.955466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2439,"num_read_kb":2283,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'263","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.870472+0000","last_change":"2024-04-03T03:38:24.749516+0000","last_active":"2024-04-03T05:14:08.870472+0000","last_peered":"2024-04-03T05:14:08.870472+0000","last_clean":"2024-04-03T05:14:08.870472+0000","last_became_active":"2024-04-03T03:38:24.748843+0000","last_became_peered":"2024-04-03T03:38:24.748843+0000","last_unstale":"2024-04-03T05:14:08.870472+0000","last_undegraded":"2024-04-03T05:14:08.870472+0000","last_fullsized":"2024-04-03T05:14:08.870472+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:41.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8418163,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":349,"num_read_kb":1436,"num_write":1018,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'283","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.775983+0000","last_change":"2024-04-03T03:38:24.740753+0000","last_active":"2024-04-03T05:14:08.775983+0000","last_peered":"2024-04-03T05:14:08.775983+0000","last_clean":"2024-04-03T05:14:08.775983+0000","last_became_active":"2024-04-03T03:38:24.737358+0000","last_became_peered":"2024-04-03T03:38:24.737358+0000","last_unstale":"2024-04-03T05:14:08.775983+0000","last_undegraded":"2024-04-03T05:14:08.775983+0000","last_fullsized":"2024-04-03T05:14:08.775983+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:25:01.791092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16393155,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":501,"num_read_kb":13844,"num_write":1301,"num_write_kb":46293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'651","reported_seq":2338,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.282490+0000","last_change":"2024-04-03T03:38:26.718253+0000","last_active":"2024-04-03T05:11:29.282490+0000","last_peered":"2024-04-03T05:11:29.282490+0000","last_clean":"2024-04-03T05:11:29.282490+0000","last_became_active":"2024-04-03T03:38:26.717854+0000","last_became_peered":"2024-04-03T03:38:26.717854+0000","last_unstale":"2024-04-03T05:11:29.282490+0000","last_undegraded":"2024-04-03T05:11:29.282490+0000","last_fullsized":"2024-04-03T05:11:29.282490+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:22.381228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3358,"num_read_kb":3036,"num_write":900,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'338","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.865283+0000","last_change":"2024-04-03T03:38:24.730677+0000","last_active":"2024-04-03T05:14:07.865283+0000","last_peered":"2024-04-03T05:14:07.865283+0000","last_clean":"2024-04-03T05:14:07.865283+0000","last_became_active":"2024-04-03T03:38:24.730312+0000","last_became_peered":"2024-04-03T03:38:24.730312+0000","last_unstale":"2024-04-03T05:14:07.865283+0000","last_undegraded":"2024-04-03T05:14:07.865283+0000","last_fullsized":"2024-04-03T05:14:07.865283+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:20:55.022050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7090666,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":613,"num_read_kb":19035,"num_write":1362,"num_write_kb":53256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'683","reported_seq":2062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.282399+0000","last_change":"2024-04-03T03:38:26.728858+0000","last_active":"2024-04-03T05:11:29.282399+0000","last_peered":"2024-04-03T05:11:29.282399+0000","last_clean":"2024-04-03T05:11:29.282399+0000","last_became_active":"2024-04-03T03:38:26.728038+0000","last_became_peered":"2024-04-03T03:38:26.728038+0000","last_unstale":"2024-04-03T05:11:29.282399+0000","last_undegraded":"2024-04-03T05:11:29.282399+0000","last_fullsized":"2024-04-03T05:11:29.282399+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:28:43.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3172,"num_read_kb":2837,"num_write":928,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":84518868,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":145,"num_read_kb":195556,"num_write":157,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161701888,"data_stored":161697704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5643,"num_read_kb":4008,"num_write":2168,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1286,"ondisk_log_size":1286,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":11006,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":12265,"num_read_kb":12111,"num_write":14239,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":22012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2564,"ondisk_log_size":2564,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":361,"ondisk_log_size":361,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1769242,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19206,"num_read_kb":36149,"num_write":16215,"num_write_kb":11681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":2191952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1857,"ondisk_log_size":1857,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1711,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1602,"num_read_kb":1902,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":189133,"num_read_kb":172083,"num_write":51171,"num_write_kb":17715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4081,"ondisk_log_size":4081,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":634200549,"num_objects":3640,"num_object_clones":0,"num_object_copies":10920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3640,"num_whiteouts":0,"num_read":32102,"num_read_kb":2539869,"num_write":74744,"num_write_kb":2266597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1006366720,"data_stored":1006366720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4512,"ondisk_log_size":4512,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":80740352,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":157,"num_read_kb":216081,"num_write":162,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510599,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477660,"kb_used_data":179776,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":93894180,"statfs":{"total":96636764160,"available":96147640320,"internally_reserved":0,"allocated":184090624,"data_stored":181973565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":304871882},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510601,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476420,"kb_used_data":206412,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93895420,"statfs":{"total":96636764160,"available":96148910080,"internally_reserved":0,"allocated":211365888,"data_stored":209304721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510598,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280416,"kb_used_data":136760,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94091424,"statfs":{"total":96636764160,"available":96349618176,"internally_reserved":0,"allocated":140042240,"data_stored":137904487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510597,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308500,"kb_used_data":196808,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94063340,"statfs":{"total":96636764160,"available":96320860160,"internally_reserved":0,"allocated":201531392,"data_stored":199491573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114358727},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543304,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439176,"kb_used_data":213588,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93932664,"statfs":{"total":96636764160,"available":96187047936,"internally_reserved":0,"allocated":218714112,"data_stored":216602747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543304,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255684,"kb_used_data":170360,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94116156,"statfs":{"total":96636764160,"available":96374943744,"internally_reserved":0,"allocated":174448640,"data_stored":172419572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543301,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339028,"kb_used_data":185740,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94032812,"statfs":{"total":96636764160,"available":96289599488,"internally_reserved":0,"allocated":190197760,"data_stored":188124258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543302,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":464496,"kb_used_data":216744,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93907344,"statfs":{"total":96636764160,"available":96161120256,"internally_reserved":0,"allocated":221945856,"data_stored":219859320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":138227712,"data_stored":138227712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":141275136,"data_stored":141275136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":121327616,"data_stored":121327616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":124157952,"data_stored":124157952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":138371072,"data_stored":138371072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":103944192,"data_stored":103944192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":125714432,"data_stored":125714432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":113348608,"data_stored":113348608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":302707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":357174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":88997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":394256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":98433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":415861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":219065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":315459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":21019945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17874944,"data_stored":17874217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35188736,"data_stored":35187371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10022912,"data_stored":10021547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T05:14:11.845 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-03T05:14:12.207 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:14:12.223 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-03T05:14:12.236 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":3138,"stamp":"2024-04-03T05:14:10.526683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":801832096,"num_objects":4124,"num_object_clones":0,"num_object_copies":11888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4124,"num_whiteouts":0,"num_read":260377,"num_read_kb":3177867,"num_write":159049,"num_write_kb":2577746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":158,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14907,"ondisk_log_size":14907,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3041380,"kb_used_data":1506188,"kb_used_omap":12,"kb_used_meta":1534771,"kb_avail":751933340,"statfs":{"total":773094113280,"available":769979740160,"internally_reserved":0,"allocated":1542336512,"data_stored":1525680243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1571606067},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-168169908,"num_objects":-906,"num_object_clones":0,"num_object_copies":-2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-906,"num_whiteouts":0,"num_read":1307,"num_read_kb":1332,"num_write":999,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009154"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.638663+0000","last_change":"2024-04-03T04:18:51.297907+0000","last_active":"2024-04-03T05:11:23.638663+0000","last_peered":"2024-04-03T05:11:23.638663+0000","last_clean":"2024-04-03T05:11:23.638663+0000","last_became_active":"2024-04-03T04:18:51.297066+0000","last_became_peered":"2024-04-03T04:18:51.297066+0000","last_unstale":"2024-04-03T05:11:23.638663+0000","last_undegraded":"2024-04-03T05:11:23.638663+0000","last_fullsized":"2024-04-03T05:11:23.638663+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:40:36.577637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"258'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831108+0000","last_change":"2024-04-03T03:55:53.275728+0000","last_active":"2024-04-03T05:10:52.831108+0000","last_peered":"2024-04-03T05:10:52.831108+0000","last_clean":"2024-04-03T05:10:52.831108+0000","last_became_active":"2024-04-03T03:55:53.274262+0000","last_became_peered":"2024-04-03T03:55:53.274262+0000","last_unstale":"2024-04-03T05:10:52.831108+0000","last_undegraded":"2024-04-03T05:10:52.831108+0000","last_fullsized":"2024-04-03T05:10:52.831108+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:48:37.046795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'1","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:07.839562+0000","last_change":"2024-04-03T03:55:45.808629+0000","last_active":"2024-04-03T05:12:07.839562+0000","last_peered":"2024-04-03T05:12:07.839562+0000","last_clean":"2024-04-03T05:12:07.839562+0000","last_became_active":"2024-04-03T03:55:45.807880+0000","last_became_peered":"2024-04-03T03:55:45.807880+0000","last_unstale":"2024-04-03T05:12:07.839562+0000","last_undegraded":"2024-04-03T05:12:07.839562+0000","last_fullsized":"2024-04-03T05:12:07.839562+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:07:02.590954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"263'26","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.051193+0000","last_change":"2024-04-03T03:49:00.988224+0000","last_active":"2024-04-03T05:10:18.051193+0000","last_peered":"2024-04-03T05:10:18.051193+0000","last_clean":"2024-04-03T05:10:18.051193+0000","last_became_active":"2024-04-03T03:49:00.987495+0000","last_became_peered":"2024-04-03T03:49:00.987495+0000","last_unstale":"2024-04-03T05:10:18.051193+0000","last_undegraded":"2024-04-03T05:10:18.051193+0000","last_fullsized":"2024-04-03T05:10:18.051193+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:22:00.449054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":70,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.833310+0000","last_change":"2024-04-03T04:18:51.320955+0000","last_active":"2024-04-03T05:11:23.833310+0000","last_peered":"2024-04-03T05:11:23.833310+0000","last_clean":"2024-04-03T05:11:23.833310+0000","last_became_active":"2024-04-03T04:18:51.320118+0000","last_became_peered":"2024-04-03T04:18:51.320118+0000","last_unstale":"2024-04-03T05:11:23.833310+0000","last_undegraded":"2024-04-03T05:11:23.833310+0000","last_fullsized":"2024-04-03T05:11:23.833310+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:36:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014658+0000","last_change":"2024-04-03T03:55:53.242225+0000","last_active":"2024-04-03T05:10:53.014658+0000","last_peered":"2024-04-03T05:10:53.014658+0000","last_clean":"2024-04-03T05:10:53.014658+0000","last_became_active":"2024-04-03T03:55:53.238473+0000","last_became_peered":"2024-04-03T03:55:53.238473+0000","last_unstale":"2024-04-03T05:10:53.014658+0000","last_undegraded":"2024-04-03T05:10:53.014658+0000","last_fullsized":"2024-04-03T05:10:53.014658+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:31:29.585032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"258'3","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.058060+0000","last_change":"2024-04-03T03:55:45.833198+0000","last_active":"2024-04-03T05:10:48.058060+0000","last_peered":"2024-04-03T05:10:48.058060+0000","last_clean":"2024-04-03T05:10:48.058060+0000","last_became_active":"2024-04-03T03:55:45.831610+0000","last_became_peered":"2024-04-03T03:55:45.831610+0000","last_unstale":"2024-04-03T05:10:48.058060+0000","last_undegraded":"2024-04-03T05:10:48.058060+0000","last_fullsized":"2024-04-03T05:10:48.058060+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:02:23.178186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"263'35","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:28.066849+0000","last_change":"2024-04-03T03:49:00.989569+0000","last_active":"2024-04-03T05:11:28.066849+0000","last_peered":"2024-04-03T05:11:28.066849+0000","last_clean":"2024-04-03T05:11:28.066849+0000","last_became_active":"2024-04-03T03:49:00.988912+0000","last_became_peered":"2024-04-03T03:49:00.988912+0000","last_unstale":"2024-04-03T05:11:28.066849+0000","last_undegraded":"2024-04-03T05:11:28.066849+0000","last_fullsized":"2024-04-03T05:11:28.066849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:44:30.947197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.018230+0000","last_change":"2024-04-03T04:18:51.365311+0000","last_active":"2024-04-03T05:11:08.018230+0000","last_peered":"2024-04-03T05:11:08.018230+0000","last_clean":"2024-04-03T05:11:08.018230+0000","last_became_active":"2024-04-03T04:18:51.364557+0000","last_became_peered":"2024-04-03T04:18:51.364557+0000","last_unstale":"2024-04-03T05:11:08.018230+0000","last_undegraded":"2024-04-03T05:11:08.018230+0000","last_fullsized":"2024-04-03T05:11:08.018230+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:32:56.588645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.659100+0000","last_change":"2024-04-03T03:55:53.269902+0000","last_active":"2024-04-03T05:12:58.659100+0000","last_peered":"2024-04-03T05:12:58.659100+0000","last_clean":"2024-04-03T05:12:58.659100+0000","last_became_active":"2024-04-03T03:55:53.269276+0000","last_became_peered":"2024-04-03T03:55:53.269276+0000","last_unstale":"2024-04-03T05:12:58.659100+0000","last_undegraded":"2024-04-03T05:12:58.659100+0000","last_fullsized":"2024-04-03T05:12:58.659100+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:15:06.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'6","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013335+0000","last_change":"2024-04-03T03:55:45.823314+0000","last_active":"2024-04-03T05:10:48.013335+0000","last_peered":"2024-04-03T05:10:48.013335+0000","last_clean":"2024-04-03T05:10:48.013335+0000","last_became_active":"2024-04-03T03:55:45.822526+0000","last_became_peered":"2024-04-03T03:55:45.822526+0000","last_unstale":"2024-04-03T05:10:48.013335+0000","last_undegraded":"2024-04-03T05:10:48.013335+0000","last_fullsized":"2024-04-03T05:10:48.013335+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:47:58.846580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":12606,"num_write":11,"num_write_kb":9534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:34.041215+0000","last_change":"2024-04-03T03:49:00.993012+0000","last_active":"2024-04-03T05:11:34.041215+0000","last_peered":"2024-04-03T05:11:34.041215+0000","last_clean":"2024-04-03T05:11:34.041215+0000","last_became_active":"2024-04-03T03:49:00.992254+0000","last_became_peered":"2024-04-03T03:49:00.992254+0000","last_unstale":"2024-04-03T05:11:34.041215+0000","last_undegraded":"2024-04-03T05:11:34.041215+0000","last_fullsized":"2024-04-03T05:11:34.041215+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:16.501916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":101,"num_write":55,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060573+0000","last_change":"2024-04-03T04:18:51.373813+0000","last_active":"2024-04-03T05:10:58.060573+0000","last_peered":"2024-04-03T05:10:58.060573+0000","last_clean":"2024-04-03T05:10:58.060573+0000","last_became_active":"2024-04-03T04:18:51.373051+0000","last_became_peered":"2024-04-03T04:18:51.373051+0000","last_unstale":"2024-04-03T05:10:58.060573+0000","last_undegraded":"2024-04-03T05:10:58.060573+0000","last_fullsized":"2024-04-03T05:10:58.060573+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:25:49.915796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'1","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.815198+0000","last_change":"2024-04-03T03:55:53.276078+0000","last_active":"2024-04-03T05:10:12.815198+0000","last_peered":"2024-04-03T05:10:12.815198+0000","last_clean":"2024-04-03T05:10:12.815198+0000","last_became_active":"2024-04-03T03:55:53.274825+0000","last_became_peered":"2024-04-03T03:55:53.274825+0000","last_unstale":"2024-04-03T05:10:12.815198+0000","last_undegraded":"2024-04-03T05:10:12.815198+0000","last_fullsized":"2024-04-03T05:10:12.815198+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:54:31.500440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.057924+0000","last_change":"2024-04-03T03:55:45.810413+0000","last_active":"2024-04-03T05:10:48.057924+0000","last_peered":"2024-04-03T05:10:48.057924+0000","last_clean":"2024-04-03T05:10:48.057924+0000","last_became_active":"2024-04-03T03:55:45.809649+0000","last_became_peered":"2024-04-03T03:55:45.809649+0000","last_unstale":"2024-04-03T05:10:48.057924+0000","last_undegraded":"2024-04-03T05:10:48.057924+0000","last_fullsized":"2024-04-03T05:10:48.057924+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:07:31.286451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"263'106","reported_seq":376,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:32.844991+0000","last_change":"2024-04-03T03:49:00.991120+0000","last_active":"2024-04-03T05:11:32.844991+0000","last_peered":"2024-04-03T05:11:32.844991+0000","last_clean":"2024-04-03T05:11:32.844991+0000","last_became_active":"2024-04-03T03:49:00.990318+0000","last_became_peered":"2024-04-03T03:49:00.990318+0000","last_unstale":"2024-04-03T05:11:32.844991+0000","last_undegraded":"2024-04-03T05:11:32.844991+0000","last_fullsized":"2024-04-03T05:11:32.844991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:40:07.793280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":587,"num_read_kb":421,"num_write":142,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:38.988696+0000","last_change":"2024-04-03T04:18:51.317587+0000","last_active":"2024-04-03T05:09:38.988696+0000","last_peered":"2024-04-03T05:09:38.988696+0000","last_clean":"2024-04-03T05:09:38.988696+0000","last_became_active":"2024-04-03T04:18:51.316328+0000","last_became_peered":"2024-04-03T04:18:51.316328+0000","last_unstale":"2024-04-03T05:09:38.988696+0000","last_undegraded":"2024-04-03T05:09:38.988696+0000","last_fullsized":"2024-04-03T05:09:38.988696+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:59:54.383193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.950586+0000","last_change":"2024-04-03T03:55:53.252686+0000","last_active":"2024-04-03T05:14:07.950586+0000","last_peered":"2024-04-03T05:14:07.950586+0000","last_clean":"2024-04-03T05:14:07.950586+0000","last_became_active":"2024-04-03T03:55:53.251965+0000","last_became_peered":"2024-04-03T03:55:53.251965+0000","last_unstale":"2024-04-03T05:14:07.950586+0000","last_undegraded":"2024-04-03T05:14:07.950586+0000","last_fullsized":"2024-04-03T05:14:07.950586+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:11:31.485683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4667,"num_write":4,"num_write_kb":4667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:19.040963+0000","last_change":"2024-04-03T03:55:45.811812+0000","last_active":"2024-04-03T05:13:19.040963+0000","last_peered":"2024-04-03T05:13:19.040963+0000","last_clean":"2024-04-03T05:13:19.040963+0000","last_became_active":"2024-04-03T03:55:45.811051+0000","last_became_peered":"2024-04-03T03:55:45.811051+0000","last_unstale":"2024-04-03T05:13:19.040963+0000","last_undegraded":"2024-04-03T05:13:19.040963+0000","last_fullsized":"2024-04-03T05:13:19.040963+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:29:56.079808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"263'6","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:32.844932+0000","last_change":"2024-04-03T03:49:00.990124+0000","last_active":"2024-04-03T05:11:32.844932+0000","last_peered":"2024-04-03T05:11:32.844932+0000","last_clean":"2024-04-03T05:11:32.844932+0000","last_became_active":"2024-04-03T03:49:00.989383+0000","last_became_peered":"2024-04-03T03:49:00.989383+0000","last_unstale":"2024-04-03T05:11:32.844932+0000","last_undegraded":"2024-04-03T05:11:32.844932+0000","last_fullsized":"2024-04-03T05:11:32.844932+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:51:07.689068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:53.812847+0000","last_change":"2024-04-03T04:18:51.318126+0000","last_active":"2024-04-03T05:09:53.812847+0000","last_peered":"2024-04-03T05:09:53.812847+0000","last_clean":"2024-04-03T05:09:53.812847+0000","last_became_active":"2024-04-03T04:18:51.317417+0000","last_became_peered":"2024-04-03T04:18:51.317417+0000","last_unstale":"2024-04-03T05:09:53.812847+0000","last_undegraded":"2024-04-03T05:09:53.812847+0000","last_fullsized":"2024-04-03T05:09:53.812847+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:40:19.565316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"258'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.057729+0000","last_change":"2024-04-03T03:55:53.251802+0000","last_active":"2024-04-03T05:10:48.057729+0000","last_peered":"2024-04-03T05:10:48.057729+0000","last_clean":"2024-04-03T05:10:48.057729+0000","last_became_active":"2024-04-03T03:55:53.250769+0000","last_became_peered":"2024-04-03T03:55:53.250769+0000","last_unstale":"2024-04-03T05:10:48.057729+0000","last_undegraded":"2024-04-03T05:10:48.057729+0000","last_fullsized":"2024-04-03T05:10:48.057729+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:22:00.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013249+0000","last_change":"2024-04-03T03:55:45.821907+0000","last_active":"2024-04-03T05:10:48.013249+0000","last_peered":"2024-04-03T05:10:48.013249+0000","last_clean":"2024-04-03T05:10:48.013249+0000","last_became_active":"2024-04-03T03:55:45.821160+0000","last_became_peered":"2024-04-03T03:55:45.821160+0000","last_unstale":"2024-04-03T05:10:48.013249+0000","last_undegraded":"2024-04-03T05:10:48.013249+0000","last_fullsized":"2024-04-03T05:10:48.013249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:35:53.921787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"263'66","reported_seq":279,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:34.041123+0000","last_change":"2024-04-03T03:49:00.994955+0000","last_active":"2024-04-03T05:11:34.041123+0000","last_peered":"2024-04-03T05:11:34.041123+0000","last_clean":"2024-04-03T05:11:34.041123+0000","last_became_active":"2024-04-03T03:49:00.994321+0000","last_became_peered":"2024-04-03T03:49:00.994321+0000","last_unstale":"2024-04-03T05:11:34.041123+0000","last_undegraded":"2024-04-03T05:11:34.041123+0000","last_fullsized":"2024-04-03T05:11:34.041123+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:04:59.985722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":300,"num_write":80,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.021856+0000","last_change":"2024-04-03T04:18:51.312623+0000","last_active":"2024-04-03T05:11:23.021856+0000","last_peered":"2024-04-03T05:11:23.021856+0000","last_clean":"2024-04-03T05:11:23.021856+0000","last_became_active":"2024-04-03T04:18:51.311870+0000","last_became_peered":"2024-04-03T04:18:51.311870+0000","last_unstale":"2024-04-03T05:11:23.021856+0000","last_undegraded":"2024-04-03T05:11:23.021856+0000","last_fullsized":"2024-04-03T05:11:23.021856+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:38:54.851895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.059027+0000","last_change":"2024-04-03T03:55:53.242608+0000","last_active":"2024-04-03T05:10:53.059027+0000","last_peered":"2024-04-03T05:10:53.059027+0000","last_clean":"2024-04-03T05:10:53.059027+0000","last_became_active":"2024-04-03T03:55:53.241200+0000","last_became_peered":"2024-04-03T03:55:53.241200+0000","last_unstale":"2024-04-03T05:10:53.059027+0000","last_undegraded":"2024-04-03T05:10:53.059027+0000","last_fullsized":"2024-04-03T05:10:53.059027+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:46:17.515799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'8","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.828861+0000","last_change":"2024-04-03T03:55:45.836536+0000","last_active":"2024-04-03T05:10:42.828861+0000","last_peered":"2024-04-03T05:10:42.828861+0000","last_clean":"2024-04-03T05:10:42.828861+0000","last_became_active":"2024-04-03T03:55:45.835828+0000","last_became_peered":"2024-04-03T03:55:45.835828+0000","last_unstale":"2024-04-03T05:10:42.828861+0000","last_undegraded":"2024-04-03T05:10:42.828861+0000","last_fullsized":"2024-04-03T05:10:42.828861+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:34:15.514688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291305,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":7,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"263'59","reported_seq":210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:33.023899+0000","last_change":"2024-04-03T03:49:00.989070+0000","last_active":"2024-04-03T05:11:33.023899+0000","last_peered":"2024-04-03T05:11:33.023899+0000","last_clean":"2024-04-03T05:11:33.023899+0000","last_became_active":"2024-04-03T03:49:00.988327+0000","last_became_peered":"2024-04-03T03:49:00.988327+0000","last_unstale":"2024-04-03T05:11:33.023899+0000","last_undegraded":"2024-04-03T05:11:33.023899+0000","last_fullsized":"2024-04-03T05:11:33.023899+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:24:56.998629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":175,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012373+0000","last_change":"2024-04-03T04:18:51.307288+0000","last_active":"2024-04-03T05:11:24.012373+0000","last_peered":"2024-04-03T05:11:24.012373+0000","last_clean":"2024-04-03T05:11:24.012373+0000","last_became_active":"2024-04-03T04:18:51.299249+0000","last_became_peered":"2024-04-03T04:18:51.299249+0000","last_unstale":"2024-04-03T05:11:24.012373+0000","last_undegraded":"2024-04-03T05:11:24.012373+0000","last_fullsized":"2024-04-03T05:11:24.012373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:30:50.463422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631815+0000","last_change":"2024-04-03T03:55:53.278378+0000","last_active":"2024-04-03T05:10:53.631815+0000","last_peered":"2024-04-03T05:10:53.631815+0000","last_clean":"2024-04-03T05:10:53.631815+0000","last_became_active":"2024-04-03T03:55:53.277505+0000","last_became_peered":"2024-04-03T03:55:53.277505+0000","last_unstale":"2024-04-03T05:10:53.631815+0000","last_undegraded":"2024-04-03T05:10:53.631815+0000","last_fullsized":"2024-04-03T05:10:53.631815+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:20:26.901761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"258'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062645+0000","last_change":"2024-04-03T03:55:45.820242+0000","last_active":"2024-04-03T05:11:08.062645+0000","last_peered":"2024-04-03T05:11:08.062645+0000","last_clean":"2024-04-03T05:11:08.062645+0000","last_became_active":"2024-04-03T03:55:45.811093+0000","last_became_peered":"2024-04-03T03:55:45.811093+0000","last_unstale":"2024-04-03T05:11:08.062645+0000","last_undegraded":"2024-04-03T05:11:08.062645+0000","last_fullsized":"2024-04-03T05:11:08.062645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:19:41.634825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:13.831105+0000","last_change":"2024-04-03T03:49:00.974095+0000","last_active":"2024-04-03T05:11:13.831105+0000","last_peered":"2024-04-03T05:11:13.831105+0000","last_clean":"2024-04-03T05:11:13.831105+0000","last_became_active":"2024-04-03T03:49:00.973216+0000","last_became_peered":"2024-04-03T03:49:00.973216+0000","last_unstale":"2024-04-03T05:11:13.831105+0000","last_undegraded":"2024-04-03T05:11:13.831105+0000","last_fullsized":"2024-04-03T05:11:13.831105+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:37:20.222939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"260'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056727+0000","last_change":"2024-04-03T04:19:00.383020+0000","last_active":"2024-04-03T05:10:43.056727+0000","last_peered":"2024-04-03T05:10:43.056727+0000","last_clean":"2024-04-03T05:10:43.056727+0000","last_became_active":"2024-04-03T04:19:00.377208+0000","last_became_peered":"2024-04-03T04:19:00.377208+0000","last_unstale":"2024-04-03T05:10:43.056727+0000","last_undegraded":"2024-04-03T05:10:43.056727+0000","last_fullsized":"2024-04-03T05:10:43.056727+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:44.601663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:14.063888+0000","last_change":"2024-04-03T03:55:53.258982+0000","last_active":"2024-04-03T05:13:14.063888+0000","last_peered":"2024-04-03T05:13:14.063888+0000","last_clean":"2024-04-03T05:13:14.063888+0000","last_became_active":"2024-04-03T03:55:53.258699+0000","last_became_peered":"2024-04-03T03:55:53.258699+0000","last_unstale":"2024-04-03T05:13:14.063888+0000","last_undegraded":"2024-04-03T05:13:14.063888+0000","last_fullsized":"2024-04-03T05:13:14.063888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:38:05.039097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'4","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.012109+0000","last_change":"2024-04-03T03:55:45.837044+0000","last_active":"2024-04-03T05:10:43.012109+0000","last_peered":"2024-04-03T05:10:43.012109+0000","last_clean":"2024-04-03T05:10:43.012109+0000","last_became_active":"2024-04-03T03:55:45.831660+0000","last_became_peered":"2024-04-03T03:55:45.831660+0000","last_unstale":"2024-04-03T05:10:43.012109+0000","last_undegraded":"2024-04-03T05:10:43.012109+0000","last_fullsized":"2024-04-03T05:10:43.012109+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:28:51.321618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5691,"num_write":4,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"263'39","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:14.010323+0000","last_change":"2024-04-03T03:49:00.969632+0000","last_active":"2024-04-03T05:11:14.010323+0000","last_peered":"2024-04-03T05:11:14.010323+0000","last_clean":"2024-04-03T05:11:14.010323+0000","last_became_active":"2024-04-03T03:49:00.968902+0000","last_became_peered":"2024-04-03T03:49:00.968902+0000","last_unstale":"2024-04-03T05:11:14.010323+0000","last_undegraded":"2024-04-03T05:11:14.010323+0000","last_fullsized":"2024-04-03T05:11:14.010323+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:23.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":106,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:37.996691+0000","last_change":"2024-04-03T04:18:51.368008+0000","last_active":"2024-04-03T05:09:37.996691+0000","last_peered":"2024-04-03T05:09:37.996691+0000","last_clean":"2024-04-03T05:09:37.996691+0000","last_became_active":"2024-04-03T04:18:51.367290+0000","last_became_peered":"2024-04-03T04:18:51.367290+0000","last_unstale":"2024-04-03T05:09:37.996691+0000","last_undegraded":"2024-04-03T05:09:37.996691+0000","last_fullsized":"2024-04-03T05:09:37.996691+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:43.727578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.827724+0000","last_change":"2024-04-03T03:55:53.249249+0000","last_active":"2024-04-03T05:10:58.827724+0000","last_peered":"2024-04-03T05:10:58.827724+0000","last_clean":"2024-04-03T05:10:58.827724+0000","last_became_active":"2024-04-03T03:55:53.247541+0000","last_became_peered":"2024-04-03T03:55:53.247541+0000","last_unstale":"2024-04-03T05:10:58.827724+0000","last_undegraded":"2024-04-03T05:10:58.827724+0000","last_fullsized":"2024-04-03T05:10:58.827724+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:08.778733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"258'4","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056828+0000","last_change":"2024-04-03T03:55:45.820738+0000","last_active":"2024-04-03T05:10:43.056828+0000","last_peered":"2024-04-03T05:10:43.056828+0000","last_clean":"2024-04-03T05:10:43.056828+0000","last_became_active":"2024-04-03T03:55:45.819664+0000","last_became_peered":"2024-04-03T03:55:45.819664+0000","last_unstale":"2024-04-03T05:10:43.056828+0000","last_undegraded":"2024-04-03T05:10:43.056828+0000","last_fullsized":"2024-04-03T05:10:43.056828+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:03:06.968618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"263'13","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.840880+0000","last_change":"2024-04-03T03:49:00.962589+0000","last_active":"2024-04-03T05:11:12.840880+0000","last_peered":"2024-04-03T05:11:12.840880+0000","last_clean":"2024-04-03T05:11:12.840880+0000","last_became_active":"2024-04-03T03:49:00.961782+0000","last_became_peered":"2024-04-03T03:49:00.961782+0000","last_unstale":"2024-04-03T05:11:12.840880+0000","last_undegraded":"2024-04-03T05:11:12.840880+0000","last_fullsized":"2024-04-03T05:11:12.840880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:41:35.535598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:38.614737+0000","last_change":"2024-04-03T04:18:51.305071+0000","last_active":"2024-04-03T05:09:38.614737+0000","last_peered":"2024-04-03T05:09:38.614737+0000","last_clean":"2024-04-03T05:09:38.614737+0000","last_became_active":"2024-04-03T04:18:51.304323+0000","last_became_peered":"2024-04-03T04:18:51.304323+0000","last_unstale":"2024-04-03T05:09:38.614737+0000","last_undegraded":"2024-04-03T05:09:38.614737+0000","last_fullsized":"2024-04-03T05:09:38.614737+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:18.815723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'8","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:13.091218+0000","last_change":"2024-04-03T03:55:53.260481+0000","last_active":"2024-04-03T05:13:13.091218+0000","last_peered":"2024-04-03T05:13:13.091218+0000","last_clean":"2024-04-03T05:13:13.091218+0000","last_became_active":"2024-04-03T03:55:53.255231+0000","last_became_peered":"2024-04-03T03:55:53.255231+0000","last_unstale":"2024-04-03T05:13:13.091218+0000","last_undegraded":"2024-04-03T05:13:13.091218+0000","last_fullsized":"2024-04-03T05:13:13.091218+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:02:58.467385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.031015+0000","last_change":"2024-04-03T03:55:45.830178+0000","last_active":"2024-04-03T05:10:49.031015+0000","last_peered":"2024-04-03T05:10:49.031015+0000","last_clean":"2024-04-03T05:10:49.031015+0000","last_became_active":"2024-04-03T03:55:45.829412+0000","last_became_peered":"2024-04-03T03:55:45.829412+0000","last_unstale":"2024-04-03T05:10:49.031015+0000","last_undegraded":"2024-04-03T05:10:49.031015+0000","last_fullsized":"2024-04-03T05:10:49.031015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:56.123646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"263'19","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.828392+0000","last_change":"2024-04-03T03:49:00.983727+0000","last_active":"2024-04-03T05:11:12.828392+0000","last_peered":"2024-04-03T05:11:12.828392+0000","last_clean":"2024-04-03T05:11:12.828392+0000","last_became_active":"2024-04-03T03:49:00.981577+0000","last_became_peered":"2024-04-03T03:49:00.981577+0000","last_unstale":"2024-04-03T05:11:12.828392+0000","last_undegraded":"2024-04-03T05:11:12.828392+0000","last_fullsized":"2024-04-03T05:11:12.828392+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:30.772410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:37.996724+0000","last_change":"2024-04-03T04:18:51.373777+0000","last_active":"2024-04-03T05:09:37.996724+0000","last_peered":"2024-04-03T05:09:37.996724+0000","last_clean":"2024-04-03T05:09:37.996724+0000","last_became_active":"2024-04-03T04:18:51.372963+0000","last_became_peered":"2024-04-03T04:18:51.372963+0000","last_unstale":"2024-04-03T05:09:37.996724+0000","last_undegraded":"2024-04-03T05:09:37.996724+0000","last_fullsized":"2024-04-03T05:09:37.996724+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:47:59.061915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.823126+0000","last_change":"2024-04-03T03:55:53.270124+0000","last_active":"2024-04-03T05:10:47.823126+0000","last_peered":"2024-04-03T05:10:47.823126+0000","last_clean":"2024-04-03T05:10:47.823126+0000","last_became_active":"2024-04-03T03:55:53.268903+0000","last_became_peered":"2024-04-03T03:55:53.268903+0000","last_unstale":"2024-04-03T05:10:47.823126+0000","last_undegraded":"2024-04-03T05:10:47.823126+0000","last_fullsized":"2024-04-03T05:10:47.823126+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:54.240436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'1","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.821604+0000","last_change":"2024-04-03T03:55:45.835558+0000","last_active":"2024-04-03T05:10:42.821604+0000","last_peered":"2024-04-03T05:10:42.821604+0000","last_clean":"2024-04-03T05:10:42.821604+0000","last_became_active":"2024-04-03T03:55:45.834865+0000","last_became_peered":"2024-04-03T03:55:45.834865+0000","last_unstale":"2024-04-03T05:10:42.821604+0000","last_undegraded":"2024-04-03T05:10:42.821604+0000","last_fullsized":"2024-04-03T05:10:42.821604+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:44:08.343281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"263'64","reported_seq":230,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:07.839335+0000","last_change":"2024-04-03T03:49:00.971740+0000","last_active":"2024-04-03T05:11:07.839335+0000","last_peered":"2024-04-03T05:11:07.839335+0000","last_clean":"2024-04-03T05:11:07.839335+0000","last_became_active":"2024-04-03T03:49:00.971042+0000","last_became_peered":"2024-04-03T03:49:00.971042+0000","last_unstale":"2024-04-03T05:11:07.839335+0000","last_undegraded":"2024-04-03T05:11:07.839335+0000","last_fullsized":"2024-04-03T05:11:07.839335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:27.210269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":214,"num_write":97,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.822413+0000","last_change":"2024-04-03T04:18:51.308665+0000","last_active":"2024-04-03T05:10:12.822413+0000","last_peered":"2024-04-03T05:10:12.822413+0000","last_clean":"2024-04-03T05:10:12.822413+0000","last_became_active":"2024-04-03T04:18:51.307933+0000","last_became_peered":"2024-04-03T04:18:51.307933+0000","last_unstale":"2024-04-03T05:10:12.822413+0000","last_undegraded":"2024-04-03T05:10:12.822413+0000","last_fullsized":"2024-04-03T05:10:12.822413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:40:38.179255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:33.009473+0000","last_change":"2024-04-03T03:55:53.267596+0000","last_active":"2024-04-03T05:10:33.009473+0000","last_peered":"2024-04-03T05:10:33.009473+0000","last_clean":"2024-04-03T05:10:33.009473+0000","last_became_active":"2024-04-03T03:55:53.266957+0000","last_became_peered":"2024-04-03T03:55:53.266957+0000","last_unstale":"2024-04-03T05:10:33.009473+0000","last_undegraded":"2024-04-03T05:10:33.009473+0000","last_fullsized":"2024-04-03T05:10:33.009473+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:59:34.273773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'1","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.053319+0000","last_change":"2024-04-03T03:55:45.830004+0000","last_active":"2024-04-03T05:10:28.053319+0000","last_peered":"2024-04-03T05:10:28.053319+0000","last_clean":"2024-04-03T05:10:28.053319+0000","last_became_active":"2024-04-03T03:55:45.829247+0000","last_became_peered":"2024-04-03T03:55:45.829247+0000","last_unstale":"2024-04-03T05:10:28.053319+0000","last_undegraded":"2024-04-03T05:10:28.053319+0000","last_fullsized":"2024-04-03T05:10:28.053319+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:09.809498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"263'66","reported_seq":227,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.821469+0000","last_change":"2024-04-03T03:49:00.991682+0000","last_active":"2024-04-03T05:10:42.821469+0000","last_peered":"2024-04-03T05:10:42.821469+0000","last_clean":"2024-04-03T05:10:42.821469+0000","last_became_active":"2024-04-03T03:49:00.990969+0000","last_became_peered":"2024-04-03T03:49:00.990969+0000","last_unstale":"2024-04-03T05:10:42.821469+0000","last_undegraded":"2024-04-03T05:10:42.821469+0000","last_fullsized":"2024-04-03T05:10:42.821469+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:40.104007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":193,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.822537+0000","last_change":"2024-04-03T04:18:51.311760+0000","last_active":"2024-04-03T05:10:12.822537+0000","last_peered":"2024-04-03T05:10:12.822537+0000","last_clean":"2024-04-03T05:10:12.822537+0000","last_became_active":"2024-04-03T04:18:51.310856+0000","last_became_peered":"2024-04-03T04:18:51.310856+0000","last_unstale":"2024-04-03T05:10:12.822537+0000","last_undegraded":"2024-04-03T05:10:12.822537+0000","last_fullsized":"2024-04-03T05:10:12.822537+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:51:40.696345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.657654+0000","last_change":"2024-04-03T03:55:53.241238+0000","last_active":"2024-04-03T05:12:53.657654+0000","last_peered":"2024-04-03T05:12:53.657654+0000","last_clean":"2024-04-03T05:12:53.657654+0000","last_became_active":"2024-04-03T03:55:53.240485+0000","last_became_peered":"2024-04-03T03:55:53.240485+0000","last_unstale":"2024-04-03T05:12:53.657654+0000","last_undegraded":"2024-04-03T05:12:53.657654+0000","last_fullsized":"2024-04-03T05:12:53.657654+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:01:44.348572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026394+0000","last_change":"2024-04-03T03:55:45.833791+0000","last_active":"2024-04-03T05:10:29.026394+0000","last_peered":"2024-04-03T05:10:29.026394+0000","last_clean":"2024-04-03T05:10:29.026394+0000","last_became_active":"2024-04-03T03:55:45.833049+0000","last_became_peered":"2024-04-03T03:55:45.833049+0000","last_unstale":"2024-04-03T05:10:29.026394+0000","last_undegraded":"2024-04-03T05:10:29.026394+0000","last_fullsized":"2024-04-03T05:10:29.026394+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:01:14.170475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"263'54","reported_seq":206,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.824123+0000","last_change":"2024-04-03T03:49:00.970056+0000","last_active":"2024-04-03T05:10:43.824123+0000","last_peered":"2024-04-03T05:10:43.824123+0000","last_clean":"2024-04-03T05:10:43.824123+0000","last_became_active":"2024-04-03T03:49:00.969239+0000","last_became_peered":"2024-04-03T03:49:00.969239+0000","last_unstale":"2024-04-03T05:10:43.824123+0000","last_undegraded":"2024-04-03T05:10:43.824123+0000","last_fullsized":"2024-04-03T05:10:43.824123+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:11:29.264574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":93,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.997173+0000","last_change":"2024-04-03T04:18:51.318533+0000","last_active":"2024-04-03T05:10:13.997173+0000","last_peered":"2024-04-03T05:10:13.997173+0000","last_clean":"2024-04-03T05:10:13.997173+0000","last_became_active":"2024-04-03T04:18:51.318231+0000","last_became_peered":"2024-04-03T04:18:51.318231+0000","last_unstale":"2024-04-03T05:10:13.997173+0000","last_undegraded":"2024-04-03T05:10:13.997173+0000","last_fullsized":"2024-04-03T05:10:13.997173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:52:18.856506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'1","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:33.821947+0000","last_change":"2024-04-03T03:55:53.279237+0000","last_active":"2024-04-03T05:10:33.821947+0000","last_peered":"2024-04-03T05:10:33.821947+0000","last_clean":"2024-04-03T05:10:33.821947+0000","last_became_active":"2024-04-03T03:55:53.278529+0000","last_became_peered":"2024-04-03T03:55:53.278529+0000","last_unstale":"2024-04-03T05:10:33.821947+0000","last_undegraded":"2024-04-03T05:10:33.821947+0000","last_fullsized":"2024-04-03T05:10:33.821947+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:28:45.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'1","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.008254+0000","last_change":"2024-04-03T03:55:45.821524+0000","last_active":"2024-04-03T05:10:28.008254+0000","last_peered":"2024-04-03T05:10:28.008254+0000","last_clean":"2024-04-03T05:10:28.008254+0000","last_became_active":"2024-04-03T03:55:45.820737+0000","last_became_peered":"2024-04-03T03:55:45.820737+0000","last_unstale":"2024-04-03T05:10:28.008254+0000","last_undegraded":"2024-04-03T05:10:28.008254+0000","last_fullsized":"2024-04-03T05:10:28.008254+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:34.782850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"263'71","reported_seq":249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.629354+0000","last_change":"2024-04-03T03:49:00.991967+0000","last_active":"2024-04-03T05:10:43.629354+0000","last_peered":"2024-04-03T05:10:43.629354+0000","last_clean":"2024-04-03T05:10:43.629354+0000","last_became_active":"2024-04-03T03:49:00.987062+0000","last_became_peered":"2024-04-03T03:49:00.987062+0000","last_unstale":"2024-04-03T05:10:43.629354+0000","last_undegraded":"2024-04-03T05:10:43.629354+0000","last_fullsized":"2024-04-03T05:10:43.629354+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:22.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":233,"num_write":115,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.004757+0000","last_change":"2024-04-03T04:18:51.320211+0000","last_active":"2024-04-03T05:10:13.004757+0000","last_peered":"2024-04-03T05:10:13.004757+0000","last_clean":"2024-04-03T05:10:13.004757+0000","last_became_active":"2024-04-03T04:18:51.319383+0000","last_became_peered":"2024-04-03T04:18:51.319383+0000","last_unstale":"2024-04-03T05:10:13.004757+0000","last_undegraded":"2024-04-03T05:10:13.004757+0000","last_fullsized":"2024-04-03T05:10:13.004757+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:36:49.544317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'8","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:34.001324+0000","last_change":"2024-04-03T03:55:53.280600+0000","last_active":"2024-04-03T05:10:34.001324+0000","last_peered":"2024-04-03T05:10:34.001324+0000","last_clean":"2024-04-03T05:10:34.001324+0000","last_became_active":"2024-04-03T03:55:53.279910+0000","last_became_peered":"2024-04-03T03:55:53.279910+0000","last_unstale":"2024-04-03T05:10:34.001324+0000","last_undegraded":"2024-04-03T05:10:34.001324+0000","last_fullsized":"2024-04-03T05:10:34.001324+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:59.801920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'6","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:48.656558+0000","last_change":"2024-04-03T03:55:45.841365+0000","last_active":"2024-04-03T05:12:48.656558+0000","last_peered":"2024-04-03T05:12:48.656558+0000","last_clean":"2024-04-03T05:12:48.656558+0000","last_became_active":"2024-04-03T03:55:45.840884+0000","last_became_peered":"2024-04-03T03:55:45.840884+0000","last_unstale":"2024-04-03T05:12:48.656558+0000","last_undegraded":"2024-04-03T05:12:48.656558+0000","last_fullsized":"2024-04-03T05:12:48.656558+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:16:08.781831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"263'34","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.011805+0000","last_change":"2024-04-03T03:49:00.967711+0000","last_active":"2024-04-03T05:10:43.011805+0000","last_peered":"2024-04-03T05:10:43.011805+0000","last_clean":"2024-04-03T05:10:43.011805+0000","last_became_active":"2024-04-03T03:49:00.966982+0000","last_became_peered":"2024-04-03T03:49:00.966982+0000","last_unstale":"2024-04-03T05:10:43.011805+0000","last_undegraded":"2024-04-03T05:10:43.011805+0000","last_fullsized":"2024-04-03T05:10:43.011805+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:56.610313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"261'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010784+0000","last_change":"2024-04-03T04:18:51.315214+0000","last_active":"2024-04-03T05:10:38.010784+0000","last_peered":"2024-04-03T05:10:38.010784+0000","last_clean":"2024-04-03T05:10:38.010784+0000","last_became_active":"2024-04-03T04:18:51.314416+0000","last_became_peered":"2024-04-03T04:18:51.314416+0000","last_unstale":"2024-04-03T05:10:38.010784+0000","last_undegraded":"2024-04-03T05:10:38.010784+0000","last_fullsized":"2024-04-03T05:10:38.010784+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:02.075238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'7","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:07.814110+0000","last_change":"2024-04-03T03:55:53.248818+0000","last_active":"2024-04-03T05:10:07.814110+0000","last_peered":"2024-04-03T05:10:07.814110+0000","last_clean":"2024-04-03T05:10:07.814110+0000","last_became_active":"2024-04-03T03:55:53.248092+0000","last_became_peered":"2024-04-03T03:55:53.248092+0000","last_unstale":"2024-04-03T05:10:07.814110+0000","last_undegraded":"2024-04-03T05:10:07.814110+0000","last_fullsized":"2024-04-03T05:10:07.814110+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:20:29.850186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"258'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.815188+0000","last_change":"2024-04-03T03:55:45.830497+0000","last_active":"2024-04-03T05:10:03.815188+0000","last_peered":"2024-04-03T05:10:03.815188+0000","last_clean":"2024-04-03T05:10:03.815188+0000","last_became_active":"2024-04-03T03:55:45.829835+0000","last_became_peered":"2024-04-03T03:55:45.829835+0000","last_unstale":"2024-04-03T05:10:03.815188+0000","last_undegraded":"2024-04-03T05:10:03.815188+0000","last_fullsized":"2024-04-03T05:10:03.815188+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:42.544072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"263'30","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.820973+0000","last_change":"2024-04-03T03:49:00.984614+0000","last_active":"2024-04-03T05:10:28.820973+0000","last_peered":"2024-04-03T05:10:28.820973+0000","last_clean":"2024-04-03T05:10:28.820973+0000","last_became_active":"2024-04-03T03:49:00.983761+0000","last_became_peered":"2024-04-03T03:49:00.983761+0000","last_unstale":"2024-04-03T05:10:28.820973+0000","last_undegraded":"2024-04-03T05:10:28.820973+0000","last_fullsized":"2024-04-03T05:10:28.820973+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:55:59.720764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010837+0000","last_change":"2024-04-03T04:18:51.320209+0000","last_active":"2024-04-03T05:10:38.010837+0000","last_peered":"2024-04-03T05:10:38.010837+0000","last_clean":"2024-04-03T05:10:38.010837+0000","last_became_active":"2024-04-03T04:18:51.319470+0000","last_became_peered":"2024-04-03T04:18:51.319470+0000","last_unstale":"2024-04-03T05:10:38.010837+0000","last_undegraded":"2024-04-03T05:10:38.010837+0000","last_fullsized":"2024-04-03T05:10:38.010837+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:33:04.413239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'7","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:24.052556+0000","last_change":"2024-04-03T03:55:53.258437+0000","last_active":"2024-04-03T05:12:24.052556+0000","last_peered":"2024-04-03T05:12:24.052556+0000","last_clean":"2024-04-03T05:12:24.052556+0000","last_became_active":"2024-04-03T03:55:53.257856+0000","last_became_peered":"2024-04-03T03:55:53.257856+0000","last_unstale":"2024-04-03T05:12:24.052556+0000","last_undegraded":"2024-04-03T05:12:24.052556+0000","last_fullsized":"2024-04-03T05:12:24.052556+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:11:30.203783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":16434,"num_write":11,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'11","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.007285+0000","last_change":"2024-04-03T03:55:45.835655+0000","last_active":"2024-04-03T05:10:23.007285+0000","last_peered":"2024-04-03T05:10:23.007285+0000","last_clean":"2024-04-03T05:10:23.007285+0000","last_became_active":"2024-04-03T03:55:45.829711+0000","last_became_peered":"2024-04-03T03:55:45.829711+0000","last_unstale":"2024-04-03T05:10:23.007285+0000","last_undegraded":"2024-04-03T05:10:23.007285+0000","last_fullsized":"2024-04-03T05:10:23.007285+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:48.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":19,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"263'38","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.995075+0000","last_change":"2024-04-03T03:49:00.987947+0000","last_active":"2024-04-03T05:10:03.995075+0000","last_peered":"2024-04-03T05:10:03.995075+0000","last_clean":"2024-04-03T05:10:03.995075+0000","last_became_active":"2024-04-03T03:49:00.987174+0000","last_became_peered":"2024-04-03T03:49:00.987174+0000","last_unstale":"2024-04-03T05:10:03.995075+0000","last_undegraded":"2024-04-03T05:10:03.995075+0000","last_fullsized":"2024-04-03T05:10:03.995075+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:24:58.481056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010877+0000","last_change":"2024-04-03T04:18:51.321162+0000","last_active":"2024-04-03T05:10:38.010877+0000","last_peered":"2024-04-03T05:10:38.010877+0000","last_clean":"2024-04-03T05:10:38.010877+0000","last_became_active":"2024-04-03T04:18:51.320359+0000","last_became_peered":"2024-04-03T04:18:51.320359+0000","last_unstale":"2024-04-03T05:10:38.010877+0000","last_undegraded":"2024-04-03T05:10:38.010877+0000","last_fullsized":"2024-04-03T05:10:38.010877+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:19:17.610665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"258'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:27.825755+0000","last_change":"2024-04-03T03:55:53.275336+0000","last_active":"2024-04-03T05:10:27.825755+0000","last_peered":"2024-04-03T05:10:27.825755+0000","last_clean":"2024-04-03T05:10:27.825755+0000","last_became_active":"2024-04-03T03:55:53.274653+0000","last_became_peered":"2024-04-03T03:55:53.274653+0000","last_unstale":"2024-04-03T05:10:27.825755+0000","last_undegraded":"2024-04-03T05:10:27.825755+0000","last_fullsized":"2024-04-03T05:10:27.825755+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:08:05.730323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.813033+0000","last_change":"2024-04-03T03:55:45.832909+0000","last_active":"2024-04-03T05:10:02.813033+0000","last_peered":"2024-04-03T05:10:02.813033+0000","last_clean":"2024-04-03T05:10:02.813033+0000","last_became_active":"2024-04-03T03:55:45.832127+0000","last_became_peered":"2024-04-03T03:55:45.832127+0000","last_unstale":"2024-04-03T05:10:02.813033+0000","last_undegraded":"2024-04-03T05:10:02.813033+0000","last_fullsized":"2024-04-03T05:10:02.813033+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:03:14.969466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"263'16","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.620556+0000","last_change":"2024-04-03T03:49:00.992325+0000","last_active":"2024-04-03T05:10:03.620556+0000","last_peered":"2024-04-03T05:10:03.620556+0000","last_clean":"2024-04-03T05:10:03.620556+0000","last_became_active":"2024-04-03T03:49:00.987993+0000","last_became_peered":"2024-04-03T03:49:00.987993+0000","last_unstale":"2024-04-03T05:10:03.620556+0000","last_undegraded":"2024-04-03T05:10:03.620556+0000","last_fullsized":"2024-04-03T05:10:03.620556+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:47.291199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831156+0000","last_change":"2024-04-03T04:18:51.373972+0000","last_active":"2024-04-03T05:10:52.831156+0000","last_peered":"2024-04-03T05:10:52.831156+0000","last_clean":"2024-04-03T05:10:52.831156+0000","last_became_active":"2024-04-03T04:18:51.373189+0000","last_became_peered":"2024-04-03T04:18:51.373189+0000","last_unstale":"2024-04-03T05:10:52.831156+0000","last_undegraded":"2024-04-03T05:10:52.831156+0000","last_fullsized":"2024-04-03T05:10:52.831156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:58.064420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.045799+0000","last_change":"2024-04-03T03:55:53.244970+0000","last_active":"2024-04-03T05:10:08.045799+0000","last_peered":"2024-04-03T05:10:08.045799+0000","last_clean":"2024-04-03T05:10:08.045799+0000","last_became_active":"2024-04-03T03:55:53.243858+0000","last_became_peered":"2024-04-03T03:55:53.243858+0000","last_unstale":"2024-04-03T05:10:08.045799+0000","last_undegraded":"2024-04-03T05:10:08.045799+0000","last_fullsized":"2024-04-03T05:10:08.045799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:44:36.583585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'6","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.994992+0000","last_change":"2024-04-03T03:55:45.817717+0000","last_active":"2024-04-03T05:10:03.994992+0000","last_peered":"2024-04-03T05:10:03.994992+0000","last_clean":"2024-04-03T05:10:03.994992+0000","last_became_active":"2024-04-03T03:55:45.815910+0000","last_became_peered":"2024-04-03T03:55:45.815910+0000","last_unstale":"2024-04-03T05:10:03.994992+0000","last_undegraded":"2024-04-03T05:10:03.994992+0000","last_fullsized":"2024-04-03T05:10:03.994992+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:54:30.857141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":18434,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"263'51","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.815083+0000","last_change":"2024-04-03T03:49:00.966203+0000","last_active":"2024-04-03T05:10:03.815083+0000","last_peered":"2024-04-03T05:10:03.815083+0000","last_clean":"2024-04-03T05:10:03.815083+0000","last_became_active":"2024-04-03T03:49:00.965454+0000","last_became_peered":"2024-04-03T03:49:00.965454+0000","last_unstale":"2024-04-03T05:10:03.815083+0000","last_undegraded":"2024-04-03T05:10:03.815083+0000","last_fullsized":"2024-04-03T05:10:03.815083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:28.980846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":162,"num_write":91,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032020+0000","last_change":"2024-04-03T04:18:51.367810+0000","last_active":"2024-04-03T05:10:54.032020+0000","last_peered":"2024-04-03T05:10:54.032020+0000","last_clean":"2024-04-03T05:10:54.032020+0000","last_became_active":"2024-04-03T04:18:51.367071+0000","last_became_peered":"2024-04-03T04:18:51.367071+0000","last_unstale":"2024-04-03T05:10:54.032020+0000","last_undegraded":"2024-04-03T05:10:54.032020+0000","last_fullsized":"2024-04-03T05:10:54.032020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:36.487716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"258'2","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.847213+0000","last_change":"2024-04-03T03:55:53.265746+0000","last_active":"2024-04-03T05:11:42.847213+0000","last_peered":"2024-04-03T05:11:42.847213+0000","last_clean":"2024-04-03T05:11:42.847213+0000","last_became_active":"2024-04-03T03:55:53.265100+0000","last_became_peered":"2024-04-03T03:55:53.265100+0000","last_unstale":"2024-04-03T05:11:42.847213+0000","last_undegraded":"2024-04-03T05:11:42.847213+0000","last_fullsized":"2024-04-03T05:11:42.847213+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:30.419453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'5","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.045035+0000","last_change":"2024-04-03T03:55:45.823070+0000","last_active":"2024-04-03T05:14:09.045035+0000","last_peered":"2024-04-03T05:14:09.045035+0000","last_clean":"2024-04-03T05:14:09.045035+0000","last_became_active":"2024-04-03T03:55:45.822292+0000","last_became_peered":"2024-04-03T03:55:45.822292+0000","last_unstale":"2024-04-03T05:14:09.045035+0000","last_undegraded":"2024-04-03T05:14:09.045035+0000","last_fullsized":"2024-04-03T05:14:09.045035+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:18:47.010740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":5,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"263'28","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.820452+0000","last_change":"2024-04-03T03:49:00.981872+0000","last_active":"2024-04-03T05:10:02.820452+0000","last_peered":"2024-04-03T05:10:02.820452+0000","last_clean":"2024-04-03T05:10:02.820452+0000","last_became_active":"2024-04-03T03:49:00.981338+0000","last_became_peered":"2024-04-03T03:49:00.981338+0000","last_unstale":"2024-04-03T05:10:02.820452+0000","last_undegraded":"2024-04-03T05:10:02.820452+0000","last_fullsized":"2024-04-03T05:10:02.820452+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:55:28.926003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631722+0000","last_change":"2024-04-03T04:18:51.309156+0000","last_active":"2024-04-03T05:10:53.631722+0000","last_peered":"2024-04-03T05:10:53.631722+0000","last_clean":"2024-04-03T05:10:53.631722+0000","last_became_active":"2024-04-03T04:18:51.308461+0000","last_became_peered":"2024-04-03T04:18:51.308461+0000","last_unstale":"2024-04-03T05:10:53.631722+0000","last_undegraded":"2024-04-03T05:10:53.631722+0000","last_fullsized":"2024-04-03T05:10:53.631722+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:21.152603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.070316+0000","last_change":"2024-04-03T03:55:53.244597+0000","last_active":"2024-04-03T05:11:43.070316+0000","last_peered":"2024-04-03T05:11:43.070316+0000","last_clean":"2024-04-03T05:11:43.070316+0000","last_became_active":"2024-04-03T03:55:53.243822+0000","last_became_peered":"2024-04-03T03:55:53.243822+0000","last_unstale":"2024-04-03T05:11:43.070316+0000","last_undegraded":"2024-04-03T05:11:43.070316+0000","last_fullsized":"2024-04-03T05:11:43.070316+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:29.709703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'3","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.044433+0000","last_change":"2024-04-03T03:55:45.819884+0000","last_active":"2024-04-03T05:10:03.044433+0000","last_peered":"2024-04-03T05:10:03.044433+0000","last_clean":"2024-04-03T05:10:03.044433+0000","last_became_active":"2024-04-03T03:55:45.819117+0000","last_became_peered":"2024-04-03T03:55:45.819117+0000","last_unstale":"2024-04-03T05:10:03.044433+0000","last_undegraded":"2024-04-03T05:10:03.044433+0000","last_fullsized":"2024-04-03T05:10:03.044433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:34:21.679511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"263'9","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.835717+0000","last_change":"2024-04-03T03:49:00.992070+0000","last_active":"2024-04-03T05:11:47.835717+0000","last_peered":"2024-04-03T05:11:47.835717+0000","last_clean":"2024-04-03T05:11:47.835717+0000","last_became_active":"2024-04-03T03:49:00.991393+0000","last_became_peered":"2024-04-03T03:49:00.991393+0000","last_unstale":"2024-04-03T05:11:47.835717+0000","last_undegraded":"2024-04-03T05:11:47.835717+0000","last_fullsized":"2024-04-03T05:11:47.835717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:31.923155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:09.035711+0000","last_change":"2024-04-03T04:18:51.316420+0000","last_active":"2024-04-03T05:11:09.035711+0000","last_peered":"2024-04-03T05:11:09.035711+0000","last_clean":"2024-04-03T05:11:09.035711+0000","last_became_active":"2024-04-03T04:18:51.315679+0000","last_became_peered":"2024-04-03T04:18:51.315679+0000","last_unstale":"2024-04-03T05:11:09.035711+0000","last_undegraded":"2024-04-03T05:11:09.035711+0000","last_fullsized":"2024-04-03T05:11:09.035711+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:48:40.281554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"258'4","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.621671+0000","last_change":"2024-04-03T03:55:53.278183+0000","last_active":"2024-04-03T05:10:08.621671+0000","last_peered":"2024-04-03T05:10:08.621671+0000","last_clean":"2024-04-03T05:10:08.621671+0000","last_became_active":"2024-04-03T03:55:53.277402+0000","last_became_peered":"2024-04-03T03:55:53.277402+0000","last_unstale":"2024-04-03T05:10:08.621671+0000","last_undegraded":"2024-04-03T05:10:08.621671+0000","last_fullsized":"2024-04-03T05:10:08.621671+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:52:40.795096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":3,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'6","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.015463+0000","last_change":"2024-04-03T03:55:45.815042+0000","last_active":"2024-04-03T05:11:39.015463+0000","last_peered":"2024-04-03T05:11:39.015463+0000","last_clean":"2024-04-03T05:11:39.015463+0000","last_became_active":"2024-04-03T03:55:45.814319+0000","last_became_peered":"2024-04-03T03:55:45.814319+0000","last_unstale":"2024-04-03T05:11:39.015463+0000","last_undegraded":"2024-04-03T05:11:39.015463+0000","last_fullsized":"2024-04-03T05:11:39.015463+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:37.639076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"263'34","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.830330+0000","last_change":"2024-04-03T03:49:00.979853+0000","last_active":"2024-04-03T05:11:22.830330+0000","last_peered":"2024-04-03T05:11:22.830330+0000","last_clean":"2024-04-03T05:11:22.830330+0000","last_became_active":"2024-04-03T03:49:00.979122+0000","last_became_peered":"2024-04-03T03:49:00.979122+0000","last_unstale":"2024-04-03T05:11:22.830330+0000","last_undegraded":"2024-04-03T05:11:22.830330+0000","last_fullsized":"2024-04-03T05:11:22.830330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:05:49.282231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":103,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:37.827796+0000","last_change":"2024-04-03T04:18:51.318648+0000","last_active":"2024-04-03T05:10:37.827796+0000","last_peered":"2024-04-03T05:10:37.827796+0000","last_clean":"2024-04-03T05:10:37.827796+0000","last_became_active":"2024-04-03T04:18:51.318018+0000","last_became_peered":"2024-04-03T04:18:51.318018+0000","last_unstale":"2024-04-03T05:10:37.827796+0000","last_undegraded":"2024-04-03T05:10:37.827796+0000","last_fullsized":"2024-04-03T05:10:37.827796+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:37:23.498696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'6","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:58.043293+0000","last_change":"2024-04-03T03:55:53.255437+0000","last_active":"2024-04-03T05:09:58.043293+0000","last_peered":"2024-04-03T05:09:58.043293+0000","last_clean":"2024-04-03T05:09:58.043293+0000","last_became_active":"2024-04-03T03:55:53.254546+0000","last_became_peered":"2024-04-03T03:55:53.254546+0000","last_unstale":"2024-04-03T05:09:58.043293+0000","last_undegraded":"2024-04-03T05:09:58.043293+0000","last_fullsized":"2024-04-03T05:09:58.043293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:50:56.563374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"258'9","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.025293+0000","last_change":"2024-04-03T03:55:45.821106+0000","last_active":"2024-04-03T05:11:38.025293+0000","last_peered":"2024-04-03T05:11:38.025293+0000","last_clean":"2024-04-03T05:11:38.025293+0000","last_became_active":"2024-04-03T03:55:45.820294+0000","last_became_peered":"2024-04-03T03:55:45.820294+0000","last_unstale":"2024-04-03T05:11:38.025293+0000","last_undegraded":"2024-04-03T05:11:38.025293+0000","last_fullsized":"2024-04-03T05:11:38.025293+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:18:59.587447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18434,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"263'22","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012281+0000","last_change":"2024-04-03T03:49:00.980486+0000","last_active":"2024-04-03T05:11:24.012281+0000","last_peered":"2024-04-03T05:11:24.012281+0000","last_clean":"2024-04-03T05:11:24.012281+0000","last_became_active":"2024-04-03T03:49:00.979598+0000","last_became_peered":"2024-04-03T03:49:00.979598+0000","last_unstale":"2024-04-03T05:11:24.012281+0000","last_undegraded":"2024-04-03T05:11:24.012281+0000","last_fullsized":"2024-04-03T05:11:24.012281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:44:21.546630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":52,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060442+0000","last_change":"2024-04-03T04:18:51.367266+0000","last_active":"2024-04-03T05:10:58.060442+0000","last_peered":"2024-04-03T05:10:58.060442+0000","last_clean":"2024-04-03T05:10:58.060442+0000","last_became_active":"2024-04-03T04:18:51.366501+0000","last_became_peered":"2024-04-03T04:18:51.366501+0000","last_unstale":"2024-04-03T05:10:58.060442+0000","last_undegraded":"2024-04-03T05:10:58.060442+0000","last_fullsized":"2024-04-03T05:10:58.060442+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:54:14.385852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'9","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.828366+0000","last_change":"2024-04-03T03:55:53.268300+0000","last_active":"2024-04-03T05:11:12.828366+0000","last_peered":"2024-04-03T05:11:12.828366+0000","last_clean":"2024-04-03T05:11:12.828366+0000","last_became_active":"2024-04-03T03:55:53.266771+0000","last_became_peered":"2024-04-03T03:55:53.266771+0000","last_unstale":"2024-04-03T05:11:12.828366+0000","last_undegraded":"2024-04-03T05:11:12.828366+0000","last_fullsized":"2024-04-03T05:11:12.828366+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:55:16.846729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.015614+0000","last_change":"2024-04-03T03:55:45.837048+0000","last_active":"2024-04-03T05:11:39.015614+0000","last_peered":"2024-04-03T05:11:39.015614+0000","last_clean":"2024-04-03T05:11:39.015614+0000","last_became_active":"2024-04-03T03:55:45.836623+0000","last_became_peered":"2024-04-03T03:55:45.836623+0000","last_unstale":"2024-04-03T05:11:39.015614+0000","last_undegraded":"2024-04-03T05:11:39.015614+0000","last_fullsized":"2024-04-03T05:11:39.015614+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:50.851547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"263'70","reported_seq":234,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.830519+0000","last_change":"2024-04-03T03:49:00.982602+0000","last_active":"2024-04-03T05:11:22.830519+0000","last_peered":"2024-04-03T05:11:22.830519+0000","last_clean":"2024-04-03T05:11:22.830519+0000","last_became_active":"2024-04-03T03:49:00.978563+0000","last_became_peered":"2024-04-03T03:49:00.978563+0000","last_unstale":"2024-04-03T05:11:22.830519+0000","last_undegraded":"2024-04-03T05:11:22.830519+0000","last_fullsized":"2024-04-03T05:11:22.830519+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:33.306663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":197,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.064707+0000","last_change":"2024-04-03T04:18:51.311769+0000","last_active":"2024-04-03T05:11:18.064707+0000","last_peered":"2024-04-03T05:11:18.064707+0000","last_clean":"2024-04-03T05:11:18.064707+0000","last_became_active":"2024-04-03T04:18:51.311005+0000","last_became_peered":"2024-04-03T04:18:51.311005+0000","last_unstale":"2024-04-03T05:11:18.064707+0000","last_undegraded":"2024-04-03T05:11:18.064707+0000","last_fullsized":"2024-04-03T05:11:18.064707+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:05:36.093095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"258'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032168+0000","last_change":"2024-04-03T03:55:53.252248+0000","last_active":"2024-04-03T05:10:54.032168+0000","last_peered":"2024-04-03T05:10:54.032168+0000","last_clean":"2024-04-03T05:10:54.032168+0000","last_became_active":"2024-04-03T03:55:53.251863+0000","last_became_peered":"2024-04-03T03:55:53.251863+0000","last_unstale":"2024-04-03T05:10:54.032168+0000","last_undegraded":"2024-04-03T05:10:54.032168+0000","last_fullsized":"2024-04-03T05:10:54.032168+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:47:22.809184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.069140+0000","last_change":"2024-04-03T03:55:45.829280+0000","last_active":"2024-04-03T05:11:38.069140+0000","last_peered":"2024-04-03T05:11:38.069140+0000","last_clean":"2024-04-03T05:11:38.069140+0000","last_became_active":"2024-04-03T03:55:45.823003+0000","last_became_peered":"2024-04-03T03:55:45.823003+0000","last_unstale":"2024-04-03T05:11:38.069140+0000","last_undegraded":"2024-04-03T05:11:38.069140+0000","last_fullsized":"2024-04-03T05:11:38.069140+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:11:38.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"263'42","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.039050+0000","last_change":"2024-04-03T03:49:00.982818+0000","last_active":"2024-04-03T05:11:24.039050+0000","last_peered":"2024-04-03T05:11:24.039050+0000","last_clean":"2024-04-03T05:11:24.039050+0000","last_became_active":"2024-04-03T03:49:00.981940+0000","last_became_peered":"2024-04-03T03:49:00.981940+0000","last_unstale":"2024-04-03T05:11:24.039050+0000","last_undegraded":"2024-04-03T05:11:24.039050+0000","last_fullsized":"2024-04-03T05:11:24.039050+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:42:45.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"260'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631991+0000","last_change":"2024-04-03T04:18:51.302485+0000","last_active":"2024-04-03T05:10:53.631991+0000","last_peered":"2024-04-03T05:10:53.631991+0000","last_clean":"2024-04-03T05:10:53.631991+0000","last_became_active":"2024-04-03T04:18:51.301260+0000","last_became_peered":"2024-04-03T04:18:51.301260+0000","last_unstale":"2024-04-03T05:10:53.631991+0000","last_undegraded":"2024-04-03T05:10:53.631991+0000","last_fullsized":"2024-04-03T05:10:53.631991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:07.397862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'1","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:44.043459+0000","last_change":"2024-04-03T03:55:53.257731+0000","last_active":"2024-04-03T05:11:44.043459+0000","last_peered":"2024-04-03T05:11:44.043459+0000","last_clean":"2024-04-03T05:11:44.043459+0000","last_became_active":"2024-04-03T03:55:53.257421+0000","last_became_peered":"2024-04-03T03:55:53.257421+0000","last_unstale":"2024-04-03T05:11:44.043459+0000","last_undegraded":"2024-04-03T05:11:44.043459+0000","last_fullsized":"2024-04-03T05:11:44.043459+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:17.122324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830207+0000","last_change":"2024-04-03T03:55:45.822850+0000","last_active":"2024-04-03T05:10:47.830207+0000","last_peered":"2024-04-03T05:10:47.830207+0000","last_clean":"2024-04-03T05:10:47.830207+0000","last_became_active":"2024-04-03T03:55:45.822134+0000","last_became_peered":"2024-04-03T03:55:45.822134+0000","last_unstale":"2024-04-03T05:10:47.830207+0000","last_undegraded":"2024-04-03T05:10:47.830207+0000","last_fullsized":"2024-04-03T05:10:47.830207+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:51.265204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"263'37","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.824327+0000","last_change":"2024-04-03T03:49:00.990198+0000","last_active":"2024-04-03T05:10:43.824327+0000","last_peered":"2024-04-03T05:10:43.824327+0000","last_clean":"2024-04-03T05:10:43.824327+0000","last_became_active":"2024-04-03T03:49:00.989509+0000","last_became_peered":"2024-04-03T03:49:00.989509+0000","last_unstale":"2024-04-03T05:10:43.824327+0000","last_undegraded":"2024-04-03T05:10:43.824327+0000","last_fullsized":"2024-04-03T05:10:43.824327+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:47:32.824649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032254+0000","last_change":"2024-04-03T04:18:51.367656+0000","last_active":"2024-04-03T05:10:54.032254+0000","last_peered":"2024-04-03T05:10:54.032254+0000","last_clean":"2024-04-03T05:10:54.032254+0000","last_became_active":"2024-04-03T04:18:51.366898+0000","last_became_peered":"2024-04-03T04:18:51.366898+0000","last_unstale":"2024-04-03T05:10:54.032254+0000","last_undegraded":"2024-04-03T05:10:54.032254+0000","last_fullsized":"2024-04-03T05:10:54.032254+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:02:42.380567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.837650+0000","last_change":"2024-04-03T03:55:53.273186+0000","last_active":"2024-04-03T05:11:43.837650+0000","last_peered":"2024-04-03T05:11:43.837650+0000","last_clean":"2024-04-03T05:11:43.837650+0000","last_became_active":"2024-04-03T03:55:53.272757+0000","last_became_peered":"2024-04-03T03:55:53.272757+0000","last_unstale":"2024-04-03T05:11:43.837650+0000","last_undegraded":"2024-04-03T05:11:43.837650+0000","last_fullsized":"2024-04-03T05:11:43.837650+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:30:01.756534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:09.035840+0000","last_change":"2024-04-03T03:55:45.835017+0000","last_active":"2024-04-03T05:11:09.035840+0000","last_peered":"2024-04-03T05:11:09.035840+0000","last_clean":"2024-04-03T05:11:09.035840+0000","last_became_active":"2024-04-03T03:55:45.834364+0000","last_became_peered":"2024-04-03T03:55:45.834364+0000","last_unstale":"2024-04-03T05:11:09.035840+0000","last_undegraded":"2024-04-03T05:11:09.035840+0000","last_fullsized":"2024-04-03T05:11:09.035840+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:24:43.835815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"263'29","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:19.024038+0000","last_change":"2024-04-03T03:49:00.975429+0000","last_active":"2024-04-03T05:10:19.024038+0000","last_peered":"2024-04-03T05:10:19.024038+0000","last_clean":"2024-04-03T05:10:19.024038+0000","last_became_active":"2024-04-03T03:49:00.974654+0000","last_became_peered":"2024-04-03T03:49:00.974654+0000","last_unstale":"2024-04-03T05:10:19.024038+0000","last_undegraded":"2024-04-03T05:10:19.024038+0000","last_fullsized":"2024-04-03T05:10:19.024038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:46.921570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.829945+0000","last_change":"2024-04-03T04:18:51.323217+0000","last_active":"2024-04-03T05:11:08.829945+0000","last_peered":"2024-04-03T05:11:08.829945+0000","last_clean":"2024-04-03T05:11:08.829945+0000","last_became_active":"2024-04-03T04:18:51.322311+0000","last_became_peered":"2024-04-03T04:18:51.322311+0000","last_unstale":"2024-04-03T05:11:08.829945+0000","last_undegraded":"2024-04-03T05:11:08.829945+0000","last_fullsized":"2024-04-03T05:11:08.829945+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:50:12.059710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:59.060422+0000","last_change":"2024-04-03T03:55:53.256346+0000","last_active":"2024-04-03T05:12:59.060422+0000","last_peered":"2024-04-03T05:12:59.060422+0000","last_clean":"2024-04-03T05:12:59.060422+0000","last_became_active":"2024-04-03T03:55:53.255322+0000","last_became_peered":"2024-04-03T03:55:53.255322+0000","last_unstale":"2024-04-03T05:12:59.060422+0000","last_undegraded":"2024-04-03T05:12:59.060422+0000","last_fullsized":"2024-04-03T05:12:59.060422+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:09.641737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":90,"num_write":10,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'1","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.630607+0000","last_change":"2024-04-03T03:55:45.826097+0000","last_active":"2024-04-03T05:10:48.630607+0000","last_peered":"2024-04-03T05:10:48.630607+0000","last_clean":"2024-04-03T05:10:48.630607+0000","last_became_active":"2024-04-03T03:55:45.825324+0000","last_became_peered":"2024-04-03T03:55:45.825324+0000","last_unstale":"2024-04-03T05:10:48.630607+0000","last_undegraded":"2024-04-03T05:10:48.630607+0000","last_fullsized":"2024-04-03T05:10:48.630607+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:24.023966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"263'10","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.005883+0000","last_change":"2024-04-03T03:49:00.989237+0000","last_active":"2024-04-03T05:10:18.005883+0000","last_peered":"2024-04-03T05:10:18.005883+0000","last_clean":"2024-04-03T05:10:18.005883+0000","last_became_active":"2024-04-03T03:49:00.988511+0000","last_became_peered":"2024-04-03T03:49:00.988511+0000","last_unstale":"2024-04-03T05:10:18.005883+0000","last_undegraded":"2024-04-03T05:10:18.005883+0000","last_fullsized":"2024-04-03T05:10:18.005883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:30:04.122245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.836789+0000","last_change":"2024-04-03T04:18:51.311624+0000","last_active":"2024-04-03T05:10:57.836789+0000","last_peered":"2024-04-03T05:10:57.836789+0000","last_clean":"2024-04-03T05:10:57.836789+0000","last_became_active":"2024-04-03T04:18:51.310903+0000","last_became_peered":"2024-04-03T04:18:51.310903+0000","last_unstale":"2024-04-03T05:10:57.836789+0000","last_undegraded":"2024-04-03T05:10:57.836789+0000","last_fullsized":"2024-04-03T05:10:57.836789+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:16:43.080955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'3","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:14.050111+0000","last_change":"2024-04-03T03:55:53.249654+0000","last_active":"2024-04-03T05:12:14.050111+0000","last_peered":"2024-04-03T05:12:14.050111+0000","last_clean":"2024-04-03T05:12:14.050111+0000","last_became_active":"2024-04-03T03:55:53.248897+0000","last_became_peered":"2024-04-03T03:55:53.248897+0000","last_unstale":"2024-04-03T05:12:14.050111+0000","last_undegraded":"2024-04-03T05:12:14.050111+0000","last_fullsized":"2024-04-03T05:12:14.050111+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:46:01.196435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.825361+0000","last_change":"2024-04-03T03:55:45.823094+0000","last_active":"2024-04-03T05:10:48.825361+0000","last_peered":"2024-04-03T05:10:48.825361+0000","last_clean":"2024-04-03T05:10:48.825361+0000","last_became_active":"2024-04-03T03:55:45.822406+0000","last_became_peered":"2024-04-03T03:55:45.822406+0000","last_unstale":"2024-04-03T05:10:48.825361+0000","last_undegraded":"2024-04-03T05:10:48.825361+0000","last_fullsized":"2024-04-03T05:10:48.825361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:27:33.919111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"263'32","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.998233+0000","last_change":"2024-04-03T03:49:00.984263+0000","last_active":"2024-04-03T05:10:18.998233+0000","last_peered":"2024-04-03T05:10:18.998233+0000","last_clean":"2024-04-03T05:10:18.998233+0000","last_became_active":"2024-04-03T03:49:00.983502+0000","last_became_peered":"2024-04-03T03:49:00.983502+0000","last_unstale":"2024-04-03T05:10:18.998233+0000","last_undegraded":"2024-04-03T05:10:18.998233+0000","last_fullsized":"2024-04-03T05:10:18.998233+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:43:07.869966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":91,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633108+0000","last_change":"2024-04-03T04:18:51.320361+0000","last_active":"2024-04-03T05:10:58.633108+0000","last_peered":"2024-04-03T05:10:58.633108+0000","last_clean":"2024-04-03T05:10:58.633108+0000","last_became_active":"2024-04-03T04:18:51.319585+0000","last_became_peered":"2024-04-03T04:18:51.319585+0000","last_unstale":"2024-04-03T05:10:58.633108+0000","last_undegraded":"2024-04-03T05:10:58.633108+0000","last_fullsized":"2024-04-03T05:10:58.633108+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:06:53.044441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.005827+0000","last_change":"2024-04-03T03:55:53.254086+0000","last_active":"2024-04-03T05:10:54.005827+0000","last_peered":"2024-04-03T05:10:54.005827+0000","last_clean":"2024-04-03T05:10:54.005827+0000","last_became_active":"2024-04-03T03:55:53.253313+0000","last_became_peered":"2024-04-03T03:55:53.253313+0000","last_unstale":"2024-04-03T05:10:54.005827+0000","last_undegraded":"2024-04-03T05:10:54.005827+0000","last_fullsized":"2024-04-03T05:10:54.005827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:42:59.596779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'7","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.845635+0000","last_change":"2024-04-03T03:55:45.821498+0000","last_active":"2024-04-03T05:14:08.845635+0000","last_peered":"2024-04-03T05:14:08.845635+0000","last_clean":"2024-04-03T05:14:08.845635+0000","last_became_active":"2024-04-03T03:55:45.820786+0000","last_became_peered":"2024-04-03T03:55:45.820786+0000","last_unstale":"2024-04-03T05:14:08.845635+0000","last_undegraded":"2024-04-03T05:14:08.845635+0000","last_fullsized":"2024-04-03T05:14:08.845635+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:09:15.309227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":17,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"263'69","reported_seq":242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818307+0000","last_change":"2024-04-03T03:49:00.962192+0000","last_active":"2024-04-03T05:10:18.818307+0000","last_peered":"2024-04-03T05:10:18.818307+0000","last_clean":"2024-04-03T05:10:18.818307+0000","last_became_active":"2024-04-03T03:49:00.961318+0000","last_became_peered":"2024-04-03T03:49:00.961318+0000","last_unstale":"2024-04-03T05:10:18.818307+0000","last_undegraded":"2024-04-03T05:10:18.818307+0000","last_fullsized":"2024-04-03T05:10:18.818307+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:24:56.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":306,"num_read_kb":217,"num_write":109,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:59.007033+0000","last_change":"2024-04-03T04:18:51.318872+0000","last_active":"2024-04-03T05:10:59.007033+0000","last_peered":"2024-04-03T05:10:59.007033+0000","last_clean":"2024-04-03T05:10:59.007033+0000","last_became_active":"2024-04-03T04:18:51.318123+0000","last_became_peered":"2024-04-03T04:18:51.318123+0000","last_unstale":"2024-04-03T05:10:59.007033+0000","last_undegraded":"2024-04-03T05:10:59.007033+0000","last_fullsized":"2024-04-03T05:10:59.007033+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:43:45.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831053+0000","last_change":"2024-04-03T03:55:53.273476+0000","last_active":"2024-04-03T05:10:52.831053+0000","last_peered":"2024-04-03T05:10:52.831053+0000","last_clean":"2024-04-03T05:10:52.831053+0000","last_became_active":"2024-04-03T03:55:53.272979+0000","last_became_peered":"2024-04-03T03:55:53.272979+0000","last_unstale":"2024-04-03T05:10:52.831053+0000","last_undegraded":"2024-04-03T05:10:52.831053+0000","last_fullsized":"2024-04-03T05:10:52.831053+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:02:06.605755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"258'2","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.004446+0000","last_change":"2024-04-03T03:55:45.808103+0000","last_active":"2024-04-03T05:10:49.004446+0000","last_peered":"2024-04-03T05:10:49.004446+0000","last_clean":"2024-04-03T05:10:49.004446+0000","last_became_active":"2024-04-03T03:55:45.807410+0000","last_became_peered":"2024-04-03T03:55:45.807410+0000","last_unstale":"2024-04-03T05:10:49.004446+0000","last_undegraded":"2024-04-03T05:10:49.004446+0000","last_fullsized":"2024-04-03T05:10:49.004446+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:55:34.688567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"263'45","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:27.831292+0000","last_change":"2024-04-03T03:49:00.980550+0000","last_active":"2024-04-03T05:11:27.831292+0000","last_peered":"2024-04-03T05:11:27.831292+0000","last_clean":"2024-04-03T05:11:27.831292+0000","last_became_active":"2024-04-03T03:49:00.978547+0000","last_became_peered":"2024-04-03T03:49:00.978547+0000","last_unstale":"2024-04-03T05:11:27.831292+0000","last_undegraded":"2024-04-03T05:11:27.831292+0000","last_fullsized":"2024-04-03T05:11:27.831292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:02:28.324158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":127,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'369","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.876929+0000","last_change":"2024-04-03T03:38:24.754612+0000","last_active":"2024-04-03T05:14:08.876929+0000","last_peered":"2024-04-03T05:14:08.876929+0000","last_clean":"2024-04-03T05:14:08.876929+0000","last_became_active":"2024-04-03T03:38:24.753446+0000","last_became_peered":"2024-04-03T03:38:24.753446+0000","last_unstale":"2024-04-03T05:14:08.876929+0000","last_undegraded":"2024-04-03T05:14:08.876929+0000","last_fullsized":"2024-04-03T05:14:08.876929+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:22:38.341258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19563641,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":627,"num_read_kb":35431,"num_write":1329,"num_write_kb":27233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'364","reported_seq":1890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.373264+0000","last_change":"2024-04-03T03:38:26.751530+0000","last_active":"2024-04-03T05:11:12.373264+0000","last_peered":"2024-04-03T05:11:12.373264+0000","last_clean":"2024-04-03T05:11:12.373264+0000","last_became_active":"2024-04-03T03:38:26.750879+0000","last_became_peered":"2024-04-03T03:38:26.750879+0000","last_unstale":"2024-04-03T05:11:12.373264+0000","last_undegraded":"2024-04-03T05:11:12.373264+0000","last_fullsized":"2024-04-03T05:11:12.373264+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:50.660673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2014,"num_read_kb":1942,"num_write":406,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'290","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.743433+0000","last_change":"2024-04-03T03:38:24.723229+0000","last_active":"2024-04-03T05:14:07.743433+0000","last_peered":"2024-04-03T05:14:07.743433+0000","last_clean":"2024-04-03T05:14:07.743433+0000","last_became_active":"2024-04-03T03:38:24.722769+0000","last_became_peered":"2024-04-03T03:38:24.722769+0000","last_unstale":"2024-04-03T05:14:07.743433+0000","last_undegraded":"2024-04-03T05:14:07.743433+0000","last_fullsized":"2024-04-03T05:14:07.743433+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:48:04.458628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13170229,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":563,"num_read_kb":76319,"num_write":1262,"num_write_kb":34753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'860","reported_seq":2513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.128819+0000","last_change":"2024-04-03T03:38:26.726050+0000","last_active":"2024-04-03T05:13:59.128819+0000","last_peered":"2024-04-03T05:13:59.128819+0000","last_clean":"2024-04-03T05:13:59.128819+0000","last_became_active":"2024-04-03T03:38:26.724640+0000","last_became_peered":"2024-04-03T03:38:26.724640+0000","last_unstale":"2024-04-03T05:13:59.128819+0000","last_undegraded":"2024-04-03T05:13:59.128819+0000","last_fullsized":"2024-04-03T05:13:59.128819+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:18:50.425634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3968,"num_read_kb":3559,"num_write":1184,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'262","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.996025+0000","last_change":"2024-04-03T03:38:24.711403+0000","last_active":"2024-04-03T05:14:07.996025+0000","last_peered":"2024-04-03T05:14:07.996025+0000","last_clean":"2024-04-03T05:14:07.996025+0000","last_became_active":"2024-04-03T03:38:24.711028+0000","last_became_peered":"2024-04-03T03:38:24.711028+0000","last_unstale":"2024-04-03T05:14:07.996025+0000","last_undegraded":"2024-04-03T05:14:07.996025+0000","last_fullsized":"2024-04-03T05:14:07.996025+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:36:37.333600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3343596,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":380,"num_read_kb":16597,"num_write":974,"num_write_kb":26343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'709","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.222128+0000","last_change":"2024-04-03T03:38:26.750079+0000","last_active":"2024-04-03T05:12:22.222128+0000","last_peered":"2024-04-03T05:12:22.222128+0000","last_clean":"2024-04-03T05:12:22.222128+0000","last_became_active":"2024-04-03T03:38:26.745277+0000","last_became_peered":"2024-04-03T03:38:26.745277+0000","last_unstale":"2024-04-03T05:12:22.222128+0000","last_undegraded":"2024-04-03T05:12:22.222128+0000","last_fullsized":"2024-04-03T05:12:22.222128+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:56:00.667466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3170,"num_read_kb":2825,"num_write":964,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'344","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.862259+0000","last_change":"2024-04-03T03:38:24.757433+0000","last_active":"2024-04-03T05:14:08.862259+0000","last_peered":"2024-04-03T05:14:08.862259+0000","last_clean":"2024-04-03T05:14:08.862259+0000","last_became_active":"2024-04-03T03:38:24.756927+0000","last_became_peered":"2024-04-03T03:38:24.756927+0000","last_unstale":"2024-04-03T05:14:08.862259+0000","last_undegraded":"2024-04-03T05:14:08.862259+0000","last_fullsized":"2024-04-03T05:14:08.862259+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:38:37.035425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4217494,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":601,"num_read_kb":48559,"num_write":1336,"num_write_kb":35333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'577","reported_seq":2216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060394+0000","last_change":"2024-04-03T03:38:26.730190+0000","last_active":"2024-04-03T05:10:58.060394+0000","last_peered":"2024-04-03T05:10:58.060394+0000","last_clean":"2024-04-03T05:10:58.060394+0000","last_became_active":"2024-04-03T03:38:26.729866+0000","last_became_peered":"2024-04-03T03:38:26.729866+0000","last_unstale":"2024-04-03T05:10:58.060394+0000","last_undegraded":"2024-04-03T05:10:58.060394+0000","last_fullsized":"2024-04-03T05:10:58.060394+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:34.215876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2799,"num_write":801,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'364","reported_seq":1270,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.048172+0000","last_change":"2024-04-03T03:38:24.748987+0000","last_active":"2024-04-03T05:14:09.048172+0000","last_peered":"2024-04-03T05:14:09.048172+0000","last_clean":"2024-04-03T05:14:09.048172+0000","last_became_active":"2024-04-03T03:38:24.748338+0000","last_became_peered":"2024-04-03T03:38:24.748338+0000","last_unstale":"2024-04-03T05:14:09.048172+0000","last_undegraded":"2024-04-03T05:14:09.048172+0000","last_fullsized":"2024-04-03T05:14:09.048172+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:49:02.239604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9766408,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":1206,"num_read_kb":39092,"num_write":1633,"num_write_kb":52242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'478","reported_seq":1925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.372354+0000","last_change":"2024-04-03T03:38:26.720548+0000","last_active":"2024-04-03T05:11:12.372354+0000","last_peered":"2024-04-03T05:11:12.372354+0000","last_clean":"2024-04-03T05:11:12.372354+0000","last_became_active":"2024-04-03T03:38:26.719805+0000","last_became_peered":"2024-04-03T03:38:26.719805+0000","last_unstale":"2024-04-03T05:11:12.372354+0000","last_undegraded":"2024-04-03T05:11:12.372354+0000","last_fullsized":"2024-04-03T05:11:12.372354+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:06:02.662745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2340,"num_read_kb":2138,"num_write":626,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'315","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.853533+0000","last_change":"2024-04-03T03:38:24.754531+0000","last_active":"2024-04-03T05:14:08.853533+0000","last_peered":"2024-04-03T05:14:08.853533+0000","last_clean":"2024-04-03T05:14:08.853533+0000","last_became_active":"2024-04-03T03:38:24.749192+0000","last_became_peered":"2024-04-03T03:38:24.749192+0000","last_unstale":"2024-04-03T05:14:08.853533+0000","last_undegraded":"2024-04-03T05:14:08.853533+0000","last_fullsized":"2024-04-03T05:14:08.853533+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:24:13.416735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5778104,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":415,"num_read_kb":24946,"num_write":1253,"num_write_kb":50928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'294","reported_seq":1649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.605723+0000","last_change":"2024-04-03T03:38:26.750146+0000","last_active":"2024-04-03T05:10:43.605723+0000","last_peered":"2024-04-03T05:10:43.605723+0000","last_clean":"2024-04-03T05:10:43.605723+0000","last_became_active":"2024-04-03T03:38:26.744762+0000","last_became_peered":"2024-04-03T03:38:26.744762+0000","last_unstale":"2024-04-03T05:10:43.605723+0000","last_undegraded":"2024-04-03T05:10:43.605723+0000","last_fullsized":"2024-04-03T05:10:43.605723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:44.097623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1674,"num_read_kb":1613,"num_write":327,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'295","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.054593+0000","last_change":"2024-04-03T03:38:24.730594+0000","last_active":"2024-04-03T05:14:09.054593+0000","last_peered":"2024-04-03T05:14:09.054593+0000","last_clean":"2024-04-03T05:14:09.054593+0000","last_became_active":"2024-04-03T03:38:24.728188+0000","last_became_peered":"2024-04-03T03:38:24.728188+0000","last_unstale":"2024-04-03T05:14:09.054593+0000","last_undegraded":"2024-04-03T05:14:09.054593+0000","last_fullsized":"2024-04-03T05:14:09.054593+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:12:23.518716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6443356,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":508,"num_read_kb":30991,"num_write":1137,"num_write_kb":37947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'732","reported_seq":2231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.844541+0000","last_change":"2024-04-03T03:38:26.722813+0000","last_active":"2024-04-03T05:12:13.844541+0000","last_peered":"2024-04-03T05:12:13.844541+0000","last_clean":"2024-04-03T05:12:13.844541+0000","last_became_active":"2024-04-03T03:38:26.722053+0000","last_became_peered":"2024-04-03T03:38:26.722053+0000","last_unstale":"2024-04-03T05:12:13.844541+0000","last_undegraded":"2024-04-03T05:12:13.844541+0000","last_fullsized":"2024-04-03T05:12:13.844541+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:52:12.496090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3332,"num_read_kb":2987,"num_write":969,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'285","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.977729+0000","last_change":"2024-04-03T03:38:24.749214+0000","last_active":"2024-04-03T05:14:07.977729+0000","last_peered":"2024-04-03T05:14:07.977729+0000","last_clean":"2024-04-03T05:14:07.977729+0000","last_became_active":"2024-04-03T03:38:24.748669+0000","last_became_peered":"2024-04-03T03:38:24.748669+0000","last_unstale":"2024-04-03T05:14:07.977729+0000","last_undegraded":"2024-04-03T05:14:07.977729+0000","last_fullsized":"2024-04-03T05:14:07.977729+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:20:30.983491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7227232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":442,"num_read_kb":30915,"num_write":1190,"num_write_kb":34378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'466","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.453334+0000","last_change":"2024-04-03T03:38:26.712374+0000","last_active":"2024-04-03T05:11:08.453334+0000","last_peered":"2024-04-03T05:11:08.453334+0000","last_clean":"2024-04-03T05:11:08.453334+0000","last_became_active":"2024-04-03T03:38:26.711993+0000","last_became_peered":"2024-04-03T03:38:26.711993+0000","last_unstale":"2024-04-03T05:11:08.453334+0000","last_undegraded":"2024-04-03T05:11:08.453334+0000","last_fullsized":"2024-04-03T05:11:08.453334+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:28:06.991173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2333,"num_write":597,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'427","reported_seq":1881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.643681+0000","last_change":"2024-04-03T03:38:26.741314+0000","last_active":"2024-04-03T05:11:48.643681+0000","last_peered":"2024-04-03T05:11:48.643681+0000","last_clean":"2024-04-03T05:11:48.643681+0000","last_became_active":"2024-04-03T03:38:26.740542+0000","last_became_peered":"2024-04-03T03:38:26.740542+0000","last_unstale":"2024-04-03T05:11:48.643681+0000","last_undegraded":"2024-04-03T05:11:48.643681+0000","last_fullsized":"2024-04-03T05:11:48.643681+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:02:13.637413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2192,"num_read_kb":2031,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.042430+0000","last_change":"2024-04-03T03:38:24.762053+0000","last_active":"2024-04-03T05:14:09.042430+0000","last_peered":"2024-04-03T05:14:09.042430+0000","last_clean":"2024-04-03T05:14:09.042430+0000","last_became_active":"2024-04-03T03:38:24.761424+0000","last_became_peered":"2024-04-03T03:38:24.761424+0000","last_unstale":"2024-04-03T05:14:09.042430+0000","last_undegraded":"2024-04-03T05:14:09.042430+0000","last_fullsized":"2024-04-03T05:14:09.042430+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:58:18.665928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1588863,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":468,"num_read_kb":4079,"num_write":1206,"num_write_kb":13920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'364","reported_seq":1752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193276+0000","last_change":"2024-04-03T03:38:26.725447+0000","last_active":"2024-04-03T05:13:59.193276+0000","last_peered":"2024-04-03T05:13:59.193276+0000","last_clean":"2024-04-03T05:13:59.193276+0000","last_became_active":"2024-04-03T03:38:26.723638+0000","last_became_peered":"2024-04-03T03:38:26.723638+0000","last_unstale":"2024-04-03T05:13:59.193276+0000","last_undegraded":"2024-04-03T05:13:59.193276+0000","last_fullsized":"2024-04-03T05:13:59.193276+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:30:54.500121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1899,"num_read_kb":1790,"num_write":424,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'302","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.974821+0000","last_change":"2024-04-03T03:38:58.351102+0000","last_active":"2024-04-03T05:14:08.974821+0000","last_peered":"2024-04-03T05:14:08.974821+0000","last_clean":"2024-04-03T05:14:08.974821+0000","last_became_active":"2024-04-03T03:38:58.349885+0000","last_became_peered":"2024-04-03T03:38:58.349885+0000","last_unstale":"2024-04-03T05:14:08.974821+0000","last_undegraded":"2024-04-03T05:14:08.974821+0000","last_fullsized":"2024-04-03T05:14:08.974821+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:16:53.864983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14459487,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":486,"num_read_kb":66677,"num_write":1204,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'451","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.396049+0000","last_change":"2024-04-03T03:38:26.710365+0000","last_active":"2024-04-03T05:11:18.396049+0000","last_peered":"2024-04-03T05:11:18.396049+0000","last_clean":"2024-04-03T05:11:18.396049+0000","last_became_active":"2024-04-03T03:38:26.709613+0000","last_became_peered":"2024-04-03T03:38:26.709613+0000","last_unstale":"2024-04-03T05:11:18.396049+0000","last_undegraded":"2024-04-03T05:11:18.396049+0000","last_fullsized":"2024-04-03T05:11:18.396049+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:37:42.966727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2380,"num_write":570,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'306","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.985418+0000","last_change":"2024-04-03T03:38:24.761922+0000","last_active":"2024-04-03T05:14:08.985418+0000","last_peered":"2024-04-03T05:14:08.985418+0000","last_clean":"2024-04-03T05:14:08.985418+0000","last_became_active":"2024-04-03T03:38:24.761284+0000","last_became_peered":"2024-04-03T03:38:24.761284+0000","last_unstale":"2024-04-03T05:14:08.985418+0000","last_undegraded":"2024-04-03T05:14:08.985418+0000","last_fullsized":"2024-04-03T05:14:08.985418+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:33:18.725669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5282135,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":548,"num_read_kb":65080,"num_write":1155,"num_write_kb":43379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'446","reported_seq":2408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.213868+0000","last_change":"2024-04-03T03:38:26.713266+0000","last_active":"2024-04-03T05:12:22.213868+0000","last_peered":"2024-04-03T05:12:22.213868+0000","last_clean":"2024-04-03T05:12:22.213868+0000","last_became_active":"2024-04-03T03:38:26.711748+0000","last_became_peered":"2024-04-03T03:38:26.711748+0000","last_unstale":"2024-04-03T05:12:22.213868+0000","last_undegraded":"2024-04-03T05:12:22.213868+0000","last_fullsized":"2024-04-03T05:12:22.213868+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:16:46.211389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2976,"num_read_kb":2877,"num_write":500,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'255","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.632281+0000","last_change":"2024-04-03T03:38:24.744386+0000","last_active":"2024-04-03T05:14:08.632281+0000","last_peered":"2024-04-03T05:14:08.632281+0000","last_clean":"2024-04-03T05:14:08.632281+0000","last_became_active":"2024-04-03T03:38:24.742574+0000","last_became_peered":"2024-04-03T03:38:24.742574+0000","last_unstale":"2024-04-03T05:14:08.632281+0000","last_undegraded":"2024-04-03T05:14:08.632281+0000","last_fullsized":"2024-04-03T05:14:08.632281+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:11.179082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15102384,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":405,"num_read_kb":46919,"num_write":1070,"num_write_kb":37595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'342","reported_seq":1754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.276727+0000","last_change":"2024-04-03T03:38:26.744328+0000","last_active":"2024-04-03T05:11:29.276727+0000","last_peered":"2024-04-03T05:11:29.276727+0000","last_clean":"2024-04-03T05:11:29.276727+0000","last_became_active":"2024-04-03T03:38:26.743735+0000","last_became_peered":"2024-04-03T03:38:26.743735+0000","last_unstale":"2024-04-03T05:11:29.276727+0000","last_undegraded":"2024-04-03T05:11:29.276727+0000","last_fullsized":"2024-04-03T05:11:29.276727+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:20:00.390318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1802,"num_read_kb":1729,"num_write":383,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'294","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.005786+0000","last_change":"2024-04-03T03:38:24.726007+0000","last_active":"2024-04-03T05:14:08.005786+0000","last_peered":"2024-04-03T05:14:08.005786+0000","last_clean":"2024-04-03T05:14:08.005786+0000","last_became_active":"2024-04-03T03:38:24.725557+0000","last_became_peered":"2024-04-03T03:38:24.725557+0000","last_unstale":"2024-04-03T05:14:08.005786+0000","last_undegraded":"2024-04-03T05:14:08.005786+0000","last_fullsized":"2024-04-03T05:14:08.005786+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:50:47.134109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5507739,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":443,"num_read_kb":4167,"num_write":1103,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'335","reported_seq":1763,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.286070+0000","last_change":"2024-04-03T03:38:26.745907+0000","last_active":"2024-04-03T05:11:29.286070+0000","last_peered":"2024-04-03T05:11:29.286070+0000","last_clean":"2024-04-03T05:11:29.286070+0000","last_became_active":"2024-04-03T03:38:26.744977+0000","last_became_peered":"2024-04-03T03:38:26.744977+0000","last_unstale":"2024-04-03T05:11:29.286070+0000","last_undegraded":"2024-04-03T05:11:29.286070+0000","last_fullsized":"2024-04-03T05:11:29.286070+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:09:58.311296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1755,"num_write":385,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'234","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.978970+0000","last_change":"2024-04-03T03:38:24.725895+0000","last_active":"2024-04-03T05:14:07.978970+0000","last_peered":"2024-04-03T05:14:07.978970+0000","last_clean":"2024-04-03T05:14:07.978970+0000","last_became_active":"2024-04-03T03:38:24.725410+0000","last_became_peered":"2024-04-03T03:38:24.725410+0000","last_unstale":"2024-04-03T05:14:07.978970+0000","last_undegraded":"2024-04-03T05:14:07.978970+0000","last_fullsized":"2024-04-03T05:14:07.978970+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:07:55.757685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21031641,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":485,"num_read_kb":79698,"num_write":935,"num_write_kb":41581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'139","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.408690+0000","last_change":"2024-04-03T03:38:34.739613+0000","last_active":"2024-04-03T05:11:18.408690+0000","last_peered":"2024-04-03T05:11:18.408690+0000","last_clean":"2024-04-03T05:11:18.408690+0000","last_became_active":"2024-04-03T03:38:34.738565+0000","last_became_peered":"2024-04-03T03:38:34.738565+0000","last_unstale":"2024-04-03T05:11:18.408690+0000","last_undegraded":"2024-04-03T05:11:18.408690+0000","last_fullsized":"2024-04-03T05:11:18.408690+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:08:22.326355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":345,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'372","reported_seq":1823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.374074+0000","last_change":"2024-04-03T03:39:58.990871+0000","last_active":"2024-04-03T05:11:12.374074+0000","last_peered":"2024-04-03T05:11:12.374074+0000","last_clean":"2024-04-03T05:11:12.374074+0000","last_became_active":"2024-04-03T03:39:58.989982+0000","last_became_peered":"2024-04-03T03:39:58.989982+0000","last_unstale":"2024-04-03T05:11:12.374074+0000","last_undegraded":"2024-04-03T05:11:12.374074+0000","last_fullsized":"2024-04-03T05:11:12.374074+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:57:23.445483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2119,"num_read_kb":1999,"num_write":436,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'300","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.995287+0000","last_change":"2024-04-03T03:38:24.750884+0000","last_active":"2024-04-03T05:14:08.995287+0000","last_peered":"2024-04-03T05:14:08.995287+0000","last_clean":"2024-04-03T05:14:08.995287+0000","last_became_active":"2024-04-03T03:38:24.750235+0000","last_became_peered":"2024-04-03T03:38:24.750235+0000","last_unstale":"2024-04-03T05:14:08.995287+0000","last_undegraded":"2024-04-03T05:14:08.995287+0000","last_fullsized":"2024-04-03T05:14:08.995287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:38:04.324570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340614,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":461,"num_read_kb":98318,"num_write":1162,"num_write_kb":49383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818558+0000","last_change":"2024-04-03T03:38:28.726652+0000","last_active":"2024-04-03T05:10:18.818558+0000","last_peered":"2024-04-03T05:10:18.818558+0000","last_clean":"2024-04-03T05:10:18.818558+0000","last_became_active":"2024-04-03T03:38:28.725801+0000","last_became_peered":"2024-04-03T03:38:28.725801+0000","last_unstale":"2024-04-03T05:10:18.818558+0000","last_undegraded":"2024-04-03T05:10:18.818558+0000","last_fullsized":"2024-04-03T05:10:18.818558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:31:07.597192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'344","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.495856+0000","last_change":"2024-04-03T03:38:30.727143+0000","last_active":"2024-04-03T05:14:00.495856+0000","last_peered":"2024-04-03T05:14:00.495856+0000","last_clean":"2024-04-03T05:14:00.495856+0000","last_became_active":"2024-04-03T03:38:30.726684+0000","last_became_peered":"2024-04-03T03:38:30.726684+0000","last_unstale":"2024-04-03T05:14:00.495856+0000","last_undegraded":"2024-04-03T05:14:00.495856+0000","last_fullsized":"2024-04-03T05:14:00.495856+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:51.225223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58921,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":1006,"num_write":422,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:24.025369+0000","last_change":"2024-04-03T03:38:32.748206+0000","last_active":"2024-04-03T05:10:24.025369+0000","last_peered":"2024-04-03T05:10:24.025369+0000","last_clean":"2024-04-03T05:10:24.025369+0000","last_became_active":"2024-04-03T03:38:32.745434+0000","last_became_peered":"2024-04-03T03:38:32.745434+0000","last_unstale":"2024-04-03T05:10:24.025369+0000","last_undegraded":"2024-04-03T05:10:24.025369+0000","last_fullsized":"2024-04-03T05:10:24.025369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:43:21.765675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2398","reported_seq":4223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.236396+0000","last_change":"2024-04-03T03:38:34.759059+0000","last_active":"2024-04-03T05:12:22.236396+0000","last_peered":"2024-04-03T05:12:22.236396+0000","last_clean":"2024-04-03T05:12:22.236396+0000","last_became_active":"2024-04-03T03:38:34.757256+0000","last_became_peered":"2024-04-03T03:38:34.757256+0000","last_unstale":"2024-04-03T05:12:22.236396+0000","last_undegraded":"2024-04-03T05:12:22.236396+0000","last_fullsized":"2024-04-03T05:12:22.236396+0000","mapping_epoch":33,"log_start":"263'2300","ondisk_log_start":"263'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":2300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:07.414083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5948,"num_read_kb":5953,"num_write":4769,"num_write_kb":1764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'433","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.110390+0000","last_change":"2024-04-03T03:38:26.725258+0000","last_active":"2024-04-03T05:13:59.110390+0000","last_peered":"2024-04-03T05:13:59.110390+0000","last_clean":"2024-04-03T05:13:59.110390+0000","last_became_active":"2024-04-03T03:38:26.724537+0000","last_became_peered":"2024-04-03T03:38:26.724537+0000","last_unstale":"2024-04-03T05:13:59.110390+0000","last_undegraded":"2024-04-03T05:13:59.110390+0000","last_fullsized":"2024-04-03T05:13:59.110390+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:55:34.004187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2269,"num_read_kb":2119,"num_write":527,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'296","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.805558+0000","last_change":"2024-04-03T03:38:57.871292+0000","last_active":"2024-04-03T05:14:07.805558+0000","last_peered":"2024-04-03T05:14:07.805558+0000","last_clean":"2024-04-03T05:14:07.805558+0000","last_became_active":"2024-04-03T03:38:57.870251+0000","last_became_peered":"2024-04-03T03:38:57.870251+0000","last_unstale":"2024-04-03T05:14:07.805558+0000","last_undegraded":"2024-04-03T05:14:07.805558+0000","last_fullsized":"2024-04-03T05:14:07.805558+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:41.934446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2272671,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":600,"num_read_kb":14924,"num_write":1365,"num_write_kb":20295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:53.000142+0000","last_change":"2024-04-03T03:38:28.729101+0000","last_active":"2024-04-03T05:09:53.000142+0000","last_peered":"2024-04-03T05:09:53.000142+0000","last_clean":"2024-04-03T05:09:53.000142+0000","last_became_active":"2024-04-03T03:38:28.728632+0000","last_became_peered":"2024-04-03T03:38:28.728632+0000","last_unstale":"2024-04-03T05:09:53.000142+0000","last_undegraded":"2024-04-03T05:09:53.000142+0000","last_fullsized":"2024-04-03T05:09:53.000142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:02:19.986062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'120","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.625381+0000","last_change":"2024-04-03T03:38:30.731626+0000","last_active":"2024-04-03T05:10:23.625381+0000","last_peered":"2024-04-03T05:10:23.625381+0000","last_clean":"2024-04-03T05:10:23.625381+0000","last_became_active":"2024-04-03T03:38:30.730797+0000","last_became_peered":"2024-04-03T03:38:30.730797+0000","last_unstale":"2024-04-03T05:10:23.625381+0000","last_undegraded":"2024-04-03T05:10:23.625381+0000","last_fullsized":"2024-04-03T05:10:23.625381+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:20.134850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":139,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.625339+0000","last_change":"2024-04-03T03:38:32.733871+0000","last_active":"2024-04-03T05:10:23.625339+0000","last_peered":"2024-04-03T05:10:23.625339+0000","last_clean":"2024-04-03T05:10:23.625339+0000","last_became_active":"2024-04-03T03:38:32.732994+0000","last_became_peered":"2024-04-03T03:38:32.732994+0000","last_unstale":"2024-04-03T05:10:23.625339+0000","last_undegraded":"2024-04-03T05:10:23.625339+0000","last_fullsized":"2024-04-03T05:10:23.625339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:01.913002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'106","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062730+0000","last_change":"2024-04-03T03:38:34.746933+0000","last_active":"2024-04-03T05:11:08.062730+0000","last_peered":"2024-04-03T05:11:08.062730+0000","last_clean":"2024-04-03T05:11:08.062730+0000","last_became_active":"2024-04-03T03:38:34.746126+0000","last_became_peered":"2024-04-03T03:38:34.746126+0000","last_unstale":"2024-04-03T05:11:08.062730+0000","last_undegraded":"2024-04-03T05:11:08.062730+0000","last_fullsized":"2024-04-03T05:11:08.062730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:08:36.510470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":113,"num_write":252,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'388","reported_seq":1870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.596727+0000","last_change":"2024-04-03T03:38:26.725947+0000","last_active":"2024-04-03T05:10:43.596727+0000","last_peered":"2024-04-03T05:10:43.596727+0000","last_clean":"2024-04-03T05:10:43.596727+0000","last_became_active":"2024-04-03T03:38:26.724468+0000","last_became_peered":"2024-04-03T03:38:26.724468+0000","last_unstale":"2024-04-03T05:10:43.596727+0000","last_undegraded":"2024-04-03T05:10:43.596727+0000","last_fullsized":"2024-04-03T05:10:43.596727+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:46:05.423762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1964,"num_write":459,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'299","reported_seq":1126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.000214+0000","last_change":"2024-04-03T03:38:24.733041+0000","last_active":"2024-04-03T05:14:09.000214+0000","last_peered":"2024-04-03T05:14:09.000214+0000","last_clean":"2024-04-03T05:14:09.000214+0000","last_became_active":"2024-04-03T03:38:24.732182+0000","last_became_peered":"2024-04-03T03:38:24.732182+0000","last_unstale":"2024-04-03T05:14:09.000214+0000","last_undegraded":"2024-04-03T05:14:09.000214+0000","last_fullsized":"2024-04-03T05:14:09.000214+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:04:10.217131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5577205,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":829,"num_read_kb":9858,"num_write":1174,"num_write_kb":55489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.007355+0000","last_change":"2024-04-03T03:38:28.733914+0000","last_active":"2024-04-03T05:10:23.007355+0000","last_peered":"2024-04-03T05:10:23.007355+0000","last_clean":"2024-04-03T05:10:23.007355+0000","last_became_active":"2024-04-03T03:38:28.733142+0000","last_became_peered":"2024-04-03T03:38:28.733142+0000","last_unstale":"2024-04-03T05:10:23.007355+0000","last_undegraded":"2024-04-03T05:10:23.007355+0000","last_fullsized":"2024-04-03T05:10:23.007355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:59:55.469233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'170","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:57.811949+0000","last_change":"2024-04-03T03:38:30.735680+0000","last_active":"2024-04-03T05:09:57.811949+0000","last_peered":"2024-04-03T05:09:57.811949+0000","last_clean":"2024-04-03T05:09:57.811949+0000","last_became_active":"2024-04-03T03:38:30.734934+0000","last_became_peered":"2024-04-03T03:38:30.734934+0000","last_unstale":"2024-04-03T05:09:57.811949+0000","last_undegraded":"2024-04-03T05:09:57.811949+0000","last_fullsized":"2024-04-03T05:09:57.811949+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:03.598253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'514","reported_seq":2435,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.494677+0000","last_change":"2024-04-03T03:38:32.749915+0000","last_active":"2024-04-03T05:14:07.494677+0000","last_peered":"2024-04-03T05:14:07.494677+0000","last_clean":"2024-04-03T05:14:07.494677+0000","last_became_active":"2024-04-03T03:38:32.748836+0000","last_became_peered":"2024-04-03T03:38:32.748836+0000","last_unstale":"2024-04-03T05:14:07.494677+0000","last_undegraded":"2024-04-03T05:14:07.494677+0000","last_fullsized":"2024-04-03T05:14:07.494677+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:20:14.250362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'104","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.635415+0000","last_change":"2024-04-03T03:38:34.941018+0000","last_active":"2024-04-03T05:11:08.635415+0000","last_peered":"2024-04-03T05:11:08.635415+0000","last_clean":"2024-04-03T05:11:08.635415+0000","last_became_active":"2024-04-03T03:38:34.940390+0000","last_became_peered":"2024-04-03T03:38:34.940390+0000","last_unstale":"2024-04-03T05:11:08.635415+0000","last_undegraded":"2024-04-03T05:11:08.635415+0000","last_fullsized":"2024-04-03T05:11:08.635415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:47.643064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'569","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398822+0000","last_change":"2024-04-03T03:38:26.718097+0000","last_active":"2024-04-03T05:11:18.398822+0000","last_peered":"2024-04-03T05:11:18.398822+0000","last_clean":"2024-04-03T05:11:18.398822+0000","last_became_active":"2024-04-03T03:38:26.717394+0000","last_became_peered":"2024-04-03T03:38:26.717394+0000","last_unstale":"2024-04-03T05:11:18.398822+0000","last_undegraded":"2024-04-03T05:11:18.398822+0000","last_fullsized":"2024-04-03T05:11:18.398822+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:36.179522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2983,"num_read_kb":2733,"num_write":743,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'288","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.042350+0000","last_change":"2024-04-03T03:38:24.762461+0000","last_active":"2024-04-03T05:14:09.042350+0000","last_peered":"2024-04-03T05:14:09.042350+0000","last_clean":"2024-04-03T05:14:09.042350+0000","last_became_active":"2024-04-03T03:38:24.761913+0000","last_became_peered":"2024-04-03T03:38:24.761913+0000","last_unstale":"2024-04-03T05:14:09.042350+0000","last_undegraded":"2024-04-03T05:14:09.042350+0000","last_fullsized":"2024-04-03T05:14:09.042350+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:18:50.867012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245582,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":470,"num_read_kb":83386,"num_write":1117,"num_write_kb":33117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818707+0000","last_change":"2024-04-03T03:38:28.731460+0000","last_active":"2024-04-03T05:10:18.818707+0000","last_peered":"2024-04-03T05:10:18.818707+0000","last_clean":"2024-04-03T05:10:18.818707+0000","last_became_active":"2024-04-03T03:38:28.730711+0000","last_became_peered":"2024-04-03T03:38:28.730711+0000","last_unstale":"2024-04-03T05:10:18.818707+0000","last_undegraded":"2024-04-03T05:10:18.818707+0000","last_fullsized":"2024-04-03T05:10:18.818707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:32.235397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'298","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.481180+0000","last_change":"2024-04-03T03:38:30.825170+0000","last_active":"2024-04-03T05:14:00.481180+0000","last_peered":"2024-04-03T05:14:00.481180+0000","last_clean":"2024-04-03T05:14:00.481180+0000","last_became_active":"2024-04-03T03:38:30.824397+0000","last_became_peered":"2024-04-03T03:38:30.824397+0000","last_unstale":"2024-04-03T05:14:00.481180+0000","last_undegraded":"2024-04-03T05:14:00.481180+0000","last_fullsized":"2024-04-03T05:14:00.481180+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:35:06.339872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":979,"num_write":388,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'551","reported_seq":4238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.506225+0000","last_change":"2024-04-03T03:38:32.744325+0000","last_active":"2024-04-03T05:14:07.506225+0000","last_peered":"2024-04-03T05:14:07.506225+0000","last_clean":"2024-04-03T05:14:07.506225+0000","last_became_active":"2024-04-03T03:38:32.743645+0000","last_became_peered":"2024-04-03T03:38:32.743645+0000","last_unstale":"2024-04-03T05:14:07.506225+0000","last_undegraded":"2024-04-03T05:14:07.506225+0000","last_fullsized":"2024-04-03T05:14:07.506225+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:07:29.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1050","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.140148+0000","last_change":"2024-04-03T03:38:26.726712+0000","last_active":"2024-04-03T05:13:59.140148+0000","last_peered":"2024-04-03T05:13:59.140148+0000","last_clean":"2024-04-03T05:13:59.140148+0000","last_became_active":"2024-04-03T03:38:26.726039+0000","last_became_peered":"2024-04-03T03:38:26.726039+0000","last_unstale":"2024-04-03T05:13:59.140148+0000","last_undegraded":"2024-04-03T05:13:59.140148+0000","last_fullsized":"2024-04-03T05:13:59.140148+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:40:13.491224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4374,"num_read_kb":3788,"num_write":1482,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'334","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.018676+0000","last_change":"2024-04-03T03:38:24.754120+0000","last_active":"2024-04-03T05:14:09.018676+0000","last_peered":"2024-04-03T05:14:09.018676+0000","last_clean":"2024-04-03T05:14:09.018676+0000","last_became_active":"2024-04-03T03:38:24.752543+0000","last_became_peered":"2024-04-03T03:38:24.752543+0000","last_unstale":"2024-04-03T05:14:09.018676+0000","last_undegraded":"2024-04-03T05:14:09.018676+0000","last_fullsized":"2024-04-03T05:14:09.018676+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:09:55.105836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10141901,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":483,"num_read_kb":24934,"num_write":1114,"num_write_kb":21782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.042244+0000","last_change":"2024-04-03T03:38:28.738400+0000","last_active":"2024-04-03T05:11:39.042244+0000","last_peered":"2024-04-03T05:11:39.042244+0000","last_clean":"2024-04-03T05:11:39.042244+0000","last_became_active":"2024-04-03T03:38:28.737738+0000","last_became_peered":"2024-04-03T03:38:28.737738+0000","last_unstale":"2024-04-03T05:11:39.042244+0000","last_undegraded":"2024-04-03T05:11:39.042244+0000","last_fullsized":"2024-04-03T05:11:39.042244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:12:06.496501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'417","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.507852+0000","last_change":"2024-04-03T03:38:30.823152+0000","last_active":"2024-04-03T05:14:00.507852+0000","last_peered":"2024-04-03T05:14:00.507852+0000","last_clean":"2024-04-03T05:14:00.507852+0000","last_became_active":"2024-04-03T03:38:30.822389+0000","last_became_peered":"2024-04-03T03:38:30.822389+0000","last_unstale":"2024-04-03T05:14:00.507852+0000","last_undegraded":"2024-04-03T05:14:00.507852+0000","last_fullsized":"2024-04-03T05:14:00.507852+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:41:29.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50957,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":660,"num_read_kb":1135,"num_write":500,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830178+0000","last_change":"2024-04-03T03:38:32.731693+0000","last_active":"2024-04-03T05:10:47.830178+0000","last_peered":"2024-04-03T05:10:47.830178+0000","last_clean":"2024-04-03T05:10:47.830178+0000","last_became_active":"2024-04-03T03:38:32.730901+0000","last_became_peered":"2024-04-03T03:38:32.730901+0000","last_unstale":"2024-04-03T05:10:47.830178+0000","last_undegraded":"2024-04-03T05:10:47.830178+0000","last_fullsized":"2024-04-03T05:10:47.830178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:15:01.774475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'539","reported_seq":1368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.544147+0000","last_change":"2024-04-03T03:38:34.756576+0000","last_active":"2024-04-03T05:14:00.544147+0000","last_peered":"2024-04-03T05:14:00.544147+0000","last_clean":"2024-04-03T05:14:00.544147+0000","last_became_active":"2024-04-03T03:38:34.754300+0000","last_became_peered":"2024-04-03T03:38:34.754300+0000","last_unstale":"2024-04-03T05:14:00.544147+0000","last_undegraded":"2024-04-03T05:14:00.544147+0000","last_fullsized":"2024-04-03T05:14:00.544147+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:49.037819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1265,"num_read_kb":1263,"num_write":1135,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'842","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.143894+0000","last_change":"2024-04-03T03:38:26.749563+0000","last_active":"2024-04-03T05:13:59.143894+0000","last_peered":"2024-04-03T05:13:59.143894+0000","last_clean":"2024-04-03T05:13:59.143894+0000","last_became_active":"2024-04-03T03:38:26.742328+0000","last_became_peered":"2024-04-03T03:38:26.742328+0000","last_unstale":"2024-04-03T05:13:59.143894+0000","last_undegraded":"2024-04-03T05:13:59.143894+0000","last_fullsized":"2024-04-03T05:13:59.143894+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:14:05.259556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3790,"num_read_kb":3360,"num_write":1145,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'322","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.742373+0000","last_change":"2024-04-03T03:38:58.349005+0000","last_active":"2024-04-03T05:14:07.742373+0000","last_peered":"2024-04-03T05:14:07.742373+0000","last_clean":"2024-04-03T05:14:07.742373+0000","last_became_active":"2024-04-03T03:38:58.348120+0000","last_became_peered":"2024-04-03T03:38:58.348120+0000","last_unstale":"2024-04-03T05:14:07.742373+0000","last_undegraded":"2024-04-03T05:14:07.742373+0000","last_fullsized":"2024-04-03T05:14:07.742373+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:15.110906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2892940,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":627,"num_read_kb":8001,"num_write":1258,"num_write_kb":23217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834543+0000","last_change":"2024-04-03T03:38:28.731205+0000","last_active":"2024-04-03T05:11:42.834543+0000","last_peered":"2024-04-03T05:11:42.834543+0000","last_clean":"2024-04-03T05:11:42.834543+0000","last_became_active":"2024-04-03T03:38:28.729832+0000","last_became_peered":"2024-04-03T03:38:28.729832+0000","last_unstale":"2024-04-03T05:11:42.834543+0000","last_undegraded":"2024-04-03T05:11:42.834543+0000","last_fullsized":"2024-04-03T05:11:42.834543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:46.103991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'312","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.054867+0000","last_change":"2024-04-03T03:38:30.721619+0000","last_active":"2024-04-03T05:14:08.054867+0000","last_peered":"2024-04-03T05:14:08.054867+0000","last_clean":"2024-04-03T05:14:08.054867+0000","last_became_active":"2024-04-03T03:38:30.720884+0000","last_became_peered":"2024-04-03T03:38:30.720884+0000","last_unstale":"2024-04-03T05:14:08.054867+0000","last_undegraded":"2024-04-03T05:14:08.054867+0000","last_fullsized":"2024-04-03T05:14:08.054867+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:01:23.554077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1184,"num_write":408,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:52.999988+0000","last_change":"2024-04-03T03:38:32.742446+0000","last_active":"2024-04-03T05:09:52.999988+0000","last_peered":"2024-04-03T05:09:52.999988+0000","last_clean":"2024-04-03T05:09:52.999988+0000","last_became_active":"2024-04-03T03:38:32.741770+0000","last_became_peered":"2024-04-03T03:38:32.741770+0000","last_unstale":"2024-04-03T05:09:52.999988+0000","last_undegraded":"2024-04-03T05:09:52.999988+0000","last_fullsized":"2024-04-03T05:09:52.999988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:03:05.043052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'85","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:44.033021+0000","last_change":"2024-04-03T03:38:34.734633+0000","last_active":"2024-04-03T05:12:44.033021+0000","last_peered":"2024-04-03T05:12:44.033021+0000","last_clean":"2024-04-03T05:12:44.033021+0000","last_became_active":"2024-04-03T03:38:34.733896+0000","last_became_peered":"2024-04-03T03:38:34.733896+0000","last_unstale":"2024-04-03T05:12:44.033021+0000","last_undegraded":"2024-04-03T05:12:44.033021+0000","last_fullsized":"2024-04-03T05:12:44.033021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:01:46.697380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'718","reported_seq":2130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.188828+0000","last_change":"2024-04-03T03:38:26.735283+0000","last_active":"2024-04-03T05:13:59.188828+0000","last_peered":"2024-04-03T05:13:59.188828+0000","last_clean":"2024-04-03T05:13:59.188828+0000","last_became_active":"2024-04-03T03:38:26.734518+0000","last_became_peered":"2024-04-03T03:38:26.734518+0000","last_unstale":"2024-04-03T05:13:59.188828+0000","last_undegraded":"2024-04-03T05:13:59.188828+0000","last_fullsized":"2024-04-03T05:13:59.188828+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:24:23.571507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3204,"num_read_kb":2862,"num_write":964,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'306","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.000287+0000","last_change":"2024-04-03T03:38:24.759103+0000","last_active":"2024-04-03T05:14:09.000287+0000","last_peered":"2024-04-03T05:14:09.000287+0000","last_clean":"2024-04-03T05:14:09.000287+0000","last_became_active":"2024-04-03T03:38:24.758401+0000","last_became_peered":"2024-04-03T03:38:24.758401+0000","last_unstale":"2024-04-03T05:14:09.000287+0000","last_undegraded":"2024-04-03T05:14:09.000287+0000","last_fullsized":"2024-04-03T05:14:09.000287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:49:27.974853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5289818,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":639,"num_read_kb":12991,"num_write":1234,"num_write_kb":25567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.822882+0000","last_change":"2024-04-03T03:38:28.731957+0000","last_active":"2024-04-03T05:10:47.822882+0000","last_peered":"2024-04-03T05:10:47.822882+0000","last_clean":"2024-04-03T05:10:47.822882+0000","last_became_active":"2024-04-03T03:38:28.731257+0000","last_became_peered":"2024-04-03T03:38:28.731257+0000","last_unstale":"2024-04-03T05:10:47.822882+0000","last_undegraded":"2024-04-03T05:10:47.822882+0000","last_fullsized":"2024-04-03T05:10:47.822882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:02:15.763718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'335","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.514743+0000","last_change":"2024-04-03T03:38:30.734366+0000","last_active":"2024-04-03T05:14:00.514743+0000","last_peered":"2024-04-03T05:14:00.514743+0000","last_clean":"2024-04-03T05:14:00.514743+0000","last_became_active":"2024-04-03T03:38:30.732417+0000","last_became_peered":"2024-04-03T03:38:30.732417+0000","last_unstale":"2024-04-03T05:14:00.514743+0000","last_undegraded":"2024-04-03T05:14:00.514743+0000","last_fullsized":"2024-04-03T05:14:00.514743+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:17:12.716764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57769,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":543,"num_read_kb":996,"num_write":416,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'544","reported_seq":3037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.510526+0000","last_change":"2024-04-03T03:38:32.746838+0000","last_active":"2024-04-03T05:14:07.510526+0000","last_peered":"2024-04-03T05:14:07.510526+0000","last_clean":"2024-04-03T05:14:07.510526+0000","last_became_active":"2024-04-03T03:38:32.746029+0000","last_became_peered":"2024-04-03T03:38:32.746029+0000","last_unstale":"2024-04-03T05:14:07.510526+0000","last_undegraded":"2024-04-03T05:14:07.510526+0000","last_fullsized":"2024-04-03T05:14:07.510526+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:35:26.100890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'94","reported_seq":605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:58.856544+0000","last_change":"2024-04-03T03:38:34.742226+0000","last_active":"2024-04-03T05:13:58.856544+0000","last_peered":"2024-04-03T05:13:58.856544+0000","last_clean":"2024-04-03T05:13:58.856544+0000","last_became_active":"2024-04-03T03:38:34.741505+0000","last_became_peered":"2024-04-03T03:38:34.741505+0000","last_unstale":"2024-04-03T05:13:58.856544+0000","last_undegraded":"2024-04-03T05:13:58.856544+0000","last_fullsized":"2024-04-03T05:13:58.856544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:35:43.800179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'443","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.121620+0000","last_change":"2024-04-03T03:38:26.732154+0000","last_active":"2024-04-03T05:13:59.121620+0000","last_peered":"2024-04-03T05:13:59.121620+0000","last_clean":"2024-04-03T05:13:59.121620+0000","last_became_active":"2024-04-03T03:38:26.731734+0000","last_became_peered":"2024-04-03T03:38:26.731734+0000","last_unstale":"2024-04-03T05:13:59.121620+0000","last_undegraded":"2024-04-03T05:13:59.121620+0000","last_fullsized":"2024-04-03T05:13:59.121620+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:33:11.766451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2428,"num_write":531,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'276","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.723158+0000","last_change":"2024-04-03T03:38:24.749540+0000","last_active":"2024-04-03T05:14:08.723158+0000","last_peered":"2024-04-03T05:14:08.723158+0000","last_clean":"2024-04-03T05:14:08.723158+0000","last_became_active":"2024-04-03T03:38:24.748646+0000","last_became_peered":"2024-04-03T03:38:24.748646+0000","last_unstale":"2024-04-03T05:14:08.723158+0000","last_undegraded":"2024-04-03T05:14:08.723158+0000","last_fullsized":"2024-04-03T05:14:08.723158+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:57:53.191419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262597,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":630,"num_read_kb":9921,"num_write":1161,"num_write_kb":21025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"35'5","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.028985+0000","last_change":"2024-04-03T03:38:28.733706+0000","last_active":"2024-04-03T05:14:07.028985+0000","last_peered":"2024-04-03T05:14:07.028985+0000","last_clean":"2024-04-03T05:14:07.028985+0000","last_became_active":"2024-04-03T03:38:28.733096+0000","last_became_peered":"2024-04-03T03:38:28.733096+0000","last_unstale":"2024-04-03T05:14:07.028985+0000","last_undegraded":"2024-04-03T05:14:07.028985+0000","last_fullsized":"2024-04-03T05:14:07.028985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:10:00.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":788,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'494","reported_seq":1166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.532717+0000","last_change":"2024-04-03T03:38:30.730692+0000","last_active":"2024-04-03T05:14:07.532717+0000","last_peered":"2024-04-03T05:14:07.532717+0000","last_clean":"2024-04-03T05:14:07.532717+0000","last_became_active":"2024-04-03T03:38:30.729624+0000","last_became_peered":"2024-04-03T03:38:30.729624+0000","last_unstale":"2024-04-03T05:14:07.532717+0000","last_undegraded":"2024-04-03T05:14:07.532717+0000","last_fullsized":"2024-04-03T05:14:07.532717+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:45:22.992777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":837,"num_read_kb":1824,"num_write":678,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834483+0000","last_change":"2024-04-03T03:38:32.749162+0000","last_active":"2024-04-03T05:11:42.834483+0000","last_peered":"2024-04-03T05:11:42.834483+0000","last_clean":"2024-04-03T05:11:42.834483+0000","last_became_active":"2024-04-03T03:38:32.746634+0000","last_became_peered":"2024-04-03T03:38:32.746634+0000","last_unstale":"2024-04-03T05:11:42.834483+0000","last_undegraded":"2024-04-03T05:11:42.834483+0000","last_fullsized":"2024-04-03T05:11:42.834483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:19:34.062410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'90","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.848438+0000","last_change":"2024-04-03T03:38:34.731395+0000","last_active":"2024-04-03T05:11:47.848438+0000","last_peered":"2024-04-03T05:11:47.848438+0000","last_clean":"2024-04-03T05:11:47.848438+0000","last_became_active":"2024-04-03T03:38:34.730714+0000","last_became_peered":"2024-04-03T03:38:34.730714+0000","last_unstale":"2024-04-03T05:11:47.848438+0000","last_undegraded":"2024-04-03T05:11:47.848438+0000","last_fullsized":"2024-04-03T05:11:47.848438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:51:40.746014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":214,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'707","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:01.902920+0000","last_change":"2024-04-03T03:39:58.685134+0000","last_active":"2024-04-03T05:11:01.902920+0000","last_peered":"2024-04-03T05:11:01.902920+0000","last_clean":"2024-04-03T05:11:01.902920+0000","last_became_active":"2024-04-03T03:39:58.684099+0000","last_became_peered":"2024-04-03T03:39:58.684099+0000","last_unstale":"2024-04-03T05:11:01.902920+0000","last_undegraded":"2024-04-03T05:11:01.902920+0000","last_fullsized":"2024-04-03T05:11:01.902920+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:24.723504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3233,"num_read_kb":2920,"num_write":926,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'281","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.716850+0000","last_change":"2024-04-03T03:38:57.880756+0000","last_active":"2024-04-03T05:14:07.716850+0000","last_peered":"2024-04-03T05:14:07.716850+0000","last_clean":"2024-04-03T05:14:07.716850+0000","last_became_active":"2024-04-03T03:38:57.880334+0000","last_became_peered":"2024-04-03T03:38:57.880334+0000","last_unstale":"2024-04-03T05:14:07.716850+0000","last_undegraded":"2024-04-03T05:14:07.716850+0000","last_fullsized":"2024-04-03T05:14:07.716850+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:59.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8986016,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":480,"num_read_kb":83385,"num_write":1118,"num_write_kb":48172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.823008+0000","last_change":"2024-04-03T03:38:28.735727+0000","last_active":"2024-04-03T05:10:47.823008+0000","last_peered":"2024-04-03T05:10:47.823008+0000","last_clean":"2024-04-03T05:10:47.823008+0000","last_became_active":"2024-04-03T03:38:28.735217+0000","last_became_peered":"2024-04-03T03:38:28.735217+0000","last_unstale":"2024-04-03T05:10:47.823008+0000","last_undegraded":"2024-04-03T05:10:47.823008+0000","last_fullsized":"2024-04-03T05:10:47.823008+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:47.141174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'344","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.588874+0000","last_change":"2024-04-03T03:38:30.717823+0000","last_active":"2024-04-03T05:14:08.588874+0000","last_peered":"2024-04-03T05:14:08.588874+0000","last_clean":"2024-04-03T05:14:08.588874+0000","last_became_active":"2024-04-03T03:38:30.716983+0000","last_became_peered":"2024-04-03T03:38:30.716983+0000","last_unstale":"2024-04-03T05:14:08.588874+0000","last_undegraded":"2024-04-03T05:14:08.588874+0000","last_fullsized":"2024-04-03T05:14:08.588874+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:58:18.745061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78494,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":1274,"num_write":529,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:13.063766+0000","last_change":"2024-04-03T03:38:32.738099+0000","last_active":"2024-04-03T05:11:13.063766+0000","last_peered":"2024-04-03T05:11:13.063766+0000","last_clean":"2024-04-03T05:11:13.063766+0000","last_became_active":"2024-04-03T03:38:32.737619+0000","last_became_peered":"2024-04-03T03:38:32.737619+0000","last_unstale":"2024-04-03T05:11:13.063766+0000","last_undegraded":"2024-04-03T05:11:13.063766+0000","last_fullsized":"2024-04-03T05:11:13.063766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:01.783659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'102","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.044667+0000","last_change":"2024-04-03T03:38:34.755669+0000","last_active":"2024-04-03T05:12:58.044667+0000","last_peered":"2024-04-03T05:12:58.044667+0000","last_clean":"2024-04-03T05:12:58.044667+0000","last_became_active":"2024-04-03T03:38:34.754907+0000","last_became_peered":"2024-04-03T03:38:34.754907+0000","last_unstale":"2024-04-03T05:12:58.044667+0000","last_undegraded":"2024-04-03T05:12:58.044667+0000","last_fullsized":"2024-04-03T05:12:58.044667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:49.625336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":237,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'876","reported_seq":2630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.221358+0000","last_change":"2024-04-03T03:38:26.741422+0000","last_active":"2024-04-03T05:12:22.221358+0000","last_peered":"2024-04-03T05:12:22.221358+0000","last_clean":"2024-04-03T05:12:22.221358+0000","last_became_active":"2024-04-03T03:38:26.740674+0000","last_became_peered":"2024-04-03T03:38:26.740674+0000","last_unstale":"2024-04-03T05:12:22.221358+0000","last_undegraded":"2024-04-03T05:12:22.221358+0000","last_fullsized":"2024-04-03T05:12:22.221358+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:32.052642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4230,"num_read_kb":3805,"num_write":1201,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'251","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.782344+0000","last_change":"2024-04-03T03:38:58.345059+0000","last_active":"2024-04-03T05:14:07.782344+0000","last_peered":"2024-04-03T05:14:07.782344+0000","last_clean":"2024-04-03T05:14:07.782344+0000","last_became_active":"2024-04-03T03:38:58.344044+0000","last_became_peered":"2024-04-03T03:38:58.344044+0000","last_unstale":"2024-04-03T05:14:07.782344+0000","last_undegraded":"2024-04-03T05:14:07.782344+0000","last_fullsized":"2024-04-03T05:14:07.782344+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:56.276421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13392985,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":405,"num_read_kb":45117,"num_write":1082,"num_write_kb":60620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830246+0000","last_change":"2024-04-03T03:38:28.716186+0000","last_active":"2024-04-03T05:10:47.830246+0000","last_peered":"2024-04-03T05:10:47.830246+0000","last_clean":"2024-04-03T05:10:47.830246+0000","last_became_active":"2024-04-03T03:38:28.715394+0000","last_became_peered":"2024-04-03T03:38:28.715394+0000","last_unstale":"2024-04-03T05:10:47.830246+0000","last_undegraded":"2024-04-03T05:10:47.830246+0000","last_fullsized":"2024-04-03T05:10:47.830246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:46.237254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'336","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.730658+0000","last_change":"2024-04-03T03:38:30.733851+0000","last_active":"2024-04-03T05:14:07.730658+0000","last_peered":"2024-04-03T05:14:07.730658+0000","last_clean":"2024-04-03T05:14:07.730658+0000","last_became_active":"2024-04-03T03:38:30.733001+0000","last_became_peered":"2024-04-03T03:38:30.733001+0000","last_unstale":"2024-04-03T05:14:07.730658+0000","last_undegraded":"2024-04-03T05:14:07.730658+0000","last_fullsized":"2024-04-03T05:14:07.730658+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:49:06.273548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1151,"num_write":432,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'498","reported_seq":2366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.497894+0000","last_change":"2024-04-03T03:38:32.741613+0000","last_active":"2024-04-03T05:14:07.497894+0000","last_peered":"2024-04-03T05:14:07.497894+0000","last_clean":"2024-04-03T05:14:07.497894+0000","last_became_active":"2024-04-03T03:38:32.740883+0000","last_became_peered":"2024-04-03T03:38:32.740883+0000","last_unstale":"2024-04-03T05:14:07.497894+0000","last_undegraded":"2024-04-03T05:14:07.497894+0000","last_fullsized":"2024-04-03T05:14:07.497894+0000","mapping_epoch":31,"log_start":"258'400","ondisk_log_start":"258'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:10:34.038922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'91","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:17.980790+0000","last_change":"2024-04-03T03:38:34.749468+0000","last_active":"2024-04-03T05:10:17.980790+0000","last_peered":"2024-04-03T05:10:17.980790+0000","last_clean":"2024-04-03T05:10:17.980790+0000","last_became_active":"2024-04-03T03:38:34.748128+0000","last_became_peered":"2024-04-03T03:38:34.748128+0000","last_unstale":"2024-04-03T05:10:17.980790+0000","last_undegraded":"2024-04-03T05:10:17.980790+0000","last_fullsized":"2024-04-03T05:10:17.980790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:41:37.569030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":229,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'412","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.286549+0000","last_change":"2024-04-03T03:38:26.746310+0000","last_active":"2024-04-03T05:11:29.286549+0000","last_peered":"2024-04-03T05:11:29.286549+0000","last_clean":"2024-04-03T05:11:29.286549+0000","last_became_active":"2024-04-03T03:38:26.742254+0000","last_became_peered":"2024-04-03T03:38:26.742254+0000","last_unstale":"2024-04-03T05:11:29.286549+0000","last_undegraded":"2024-04-03T05:11:29.286549+0000","last_fullsized":"2024-04-03T05:11:29.286549+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:45:43.364326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2115,"num_read_kb":2003,"num_write":485,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'300","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.509714+0000","last_change":"2024-04-03T03:38:24.713564+0000","last_active":"2024-04-03T05:14:08.509714+0000","last_peered":"2024-04-03T05:14:08.509714+0000","last_clean":"2024-04-03T05:14:08.509714+0000","last_became_active":"2024-04-03T03:38:24.710396+0000","last_became_peered":"2024-04-03T03:38:24.710396+0000","last_unstale":"2024-04-03T05:14:08.509714+0000","last_undegraded":"2024-04-03T05:14:08.509714+0000","last_fullsized":"2024-04-03T05:14:08.509714+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:04:14.187436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13922337,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":468,"num_read_kb":39635,"num_write":1222,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.041945+0000","last_change":"2024-04-03T03:38:28.735630+0000","last_active":"2024-04-03T05:14:07.041945+0000","last_peered":"2024-04-03T05:14:07.041945+0000","last_clean":"2024-04-03T05:14:07.041945+0000","last_became_active":"2024-04-03T03:38:28.734894+0000","last_became_peered":"2024-04-03T03:38:28.734894+0000","last_unstale":"2024-04-03T05:14:07.041945+0000","last_undegraded":"2024-04-03T05:14:07.041945+0000","last_fullsized":"2024-04-03T05:14:07.041945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:06.360323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":632,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'126","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013371+0000","last_change":"2024-04-03T03:38:30.822812+0000","last_active":"2024-04-03T05:10:48.013371+0000","last_peered":"2024-04-03T05:10:48.013371+0000","last_clean":"2024-04-03T05:10:48.013371+0000","last_became_active":"2024-04-03T03:38:30.821224+0000","last_became_peered":"2024-04-03T03:38:30.821224+0000","last_unstale":"2024-04-03T05:10:48.013371+0000","last_undegraded":"2024-04-03T05:10:48.013371+0000","last_fullsized":"2024-04-03T05:10:48.013371+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:32:28.000773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'525","reported_seq":2472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.503319+0000","last_change":"2024-04-03T03:38:32.748028+0000","last_active":"2024-04-03T05:14:07.503319+0000","last_peered":"2024-04-03T05:14:07.503319+0000","last_clean":"2024-04-03T05:14:07.503319+0000","last_became_active":"2024-04-03T03:38:32.747078+0000","last_became_peered":"2024-04-03T03:38:32.747078+0000","last_unstale":"2024-04-03T05:14:07.503319+0000","last_undegraded":"2024-04-03T05:14:07.503319+0000","last_fullsized":"2024-04-03T05:14:07.503319+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:21.612026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'98","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:58.857389+0000","last_change":"2024-04-03T03:38:34.740348+0000","last_active":"2024-04-03T05:13:58.857389+0000","last_peered":"2024-04-03T05:13:58.857389+0000","last_clean":"2024-04-03T05:13:58.857389+0000","last_became_active":"2024-04-03T03:38:34.739554+0000","last_became_peered":"2024-04-03T03:38:34.739554+0000","last_unstale":"2024-04-03T05:13:58.857389+0000","last_undegraded":"2024-04-03T05:13:58.857389+0000","last_fullsized":"2024-04-03T05:13:58.857389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:59:41.957959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'345","reported_seq":1750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:07.839480+0000","last_change":"2024-04-03T03:38:26.729619+0000","last_active":"2024-04-03T05:11:07.839480+0000","last_peered":"2024-04-03T05:11:07.839480+0000","last_clean":"2024-04-03T05:11:07.839480+0000","last_became_active":"2024-04-03T03:38:26.729241+0000","last_became_peered":"2024-04-03T03:38:26.729241+0000","last_unstale":"2024-04-03T05:11:07.839480+0000","last_undegraded":"2024-04-03T05:11:07.839480+0000","last_fullsized":"2024-04-03T05:11:07.839480+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:27:27.602414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1840,"num_read_kb":1751,"num_write":396,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'245","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.025576+0000","last_change":"2024-04-03T03:38:24.715501+0000","last_active":"2024-04-03T05:14:08.025576+0000","last_peered":"2024-04-03T05:14:08.025576+0000","last_clean":"2024-04-03T05:14:08.025576+0000","last_became_active":"2024-04-03T03:38:24.709105+0000","last_became_peered":"2024-04-03T03:38:24.709105+0000","last_unstale":"2024-04-03T05:14:08.025576+0000","last_undegraded":"2024-04-03T05:14:08.025576+0000","last_fullsized":"2024-04-03T05:14:08.025576+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:59:29.586390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15092362,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":358,"num_read_kb":67615,"num_write":1013,"num_write_kb":19160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.629640+0000","last_change":"2024-04-03T03:38:28.730578+0000","last_active":"2024-04-03T05:10:43.629640+0000","last_peered":"2024-04-03T05:10:43.629640+0000","last_clean":"2024-04-03T05:10:43.629640+0000","last_became_active":"2024-04-03T03:38:28.729835+0000","last_became_peered":"2024-04-03T03:38:28.729835+0000","last_unstale":"2024-04-03T05:10:43.629640+0000","last_undegraded":"2024-04-03T05:10:43.629640+0000","last_fullsized":"2024-04-03T05:10:43.629640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:23.115894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'507","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.498625+0000","last_change":"2024-04-03T03:38:30.730361+0000","last_active":"2024-04-03T05:14:00.498625+0000","last_peered":"2024-04-03T05:14:00.498625+0000","last_clean":"2024-04-03T05:14:00.498625+0000","last_became_active":"2024-04-03T03:38:30.729797+0000","last_became_peered":"2024-04-03T03:38:30.729797+0000","last_unstale":"2024-04-03T05:14:00.498625+0000","last_undegraded":"2024-04-03T05:14:00.498625+0000","last_fullsized":"2024-04-03T05:14:00.498625+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:13:30.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59692,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1375,"num_read_kb":1864,"num_write":1976,"num_write_kb":1774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.004650+0000","last_change":"2024-04-03T03:38:32.739831+0000","last_active":"2024-04-03T05:10:49.004650+0000","last_peered":"2024-04-03T05:10:49.004650+0000","last_clean":"2024-04-03T05:10:49.004650+0000","last_became_active":"2024-04-03T03:38:32.738974+0000","last_became_peered":"2024-04-03T03:38:32.738974+0000","last_unstale":"2024-04-03T05:10:49.004650+0000","last_undegraded":"2024-04-03T05:10:49.004650+0000","last_fullsized":"2024-04-03T05:10:49.004650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:56.614207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'126","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:17.823774+0000","last_change":"2024-04-03T03:38:34.756154+0000","last_active":"2024-04-03T05:10:17.823774+0000","last_peered":"2024-04-03T05:10:17.823774+0000","last_clean":"2024-04-03T05:10:17.823774+0000","last_became_active":"2024-04-03T03:38:34.755358+0000","last_became_peered":"2024-04-03T03:38:34.755358+0000","last_unstale":"2024-04-03T05:10:17.823774+0000","last_undegraded":"2024-04-03T05:10:17.823774+0000","last_fullsized":"2024-04-03T05:10:17.823774+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:16:30.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":275,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'755","reported_seq":2261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.451786+0000","last_change":"2024-04-03T03:38:26.748524+0000","last_active":"2024-04-03T05:11:08.451786+0000","last_peered":"2024-04-03T05:11:08.451786+0000","last_clean":"2024-04-03T05:11:08.451786+0000","last_became_active":"2024-04-03T03:38:26.747883+0000","last_became_peered":"2024-04-03T03:38:26.747883+0000","last_unstale":"2024-04-03T05:11:08.451786+0000","last_undegraded":"2024-04-03T05:11:08.451786+0000","last_fullsized":"2024-04-03T05:11:08.451786+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:40:23.177113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3405,"num_read_kb":3046,"num_write":999,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026291+0000","last_change":"2024-04-03T03:38:04.257665+0000","last_active":"2024-04-03T05:10:29.026291+0000","last_peered":"2024-04-03T05:10:29.026291+0000","last_clean":"2024-04-03T05:10:29.026291+0000","last_became_active":"2024-04-03T03:38:04.255147+0000","last_became_peered":"2024-04-03T03:38:04.255147+0000","last_unstale":"2024-04-03T05:10:29.026291+0000","last_undegraded":"2024-04-03T05:10:29.026291+0000","last_fullsized":"2024-04-03T05:10:29.026291+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_clean_scrub_stamp":"2024-04-03T03:38:03.047546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:39:28.268533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:58.841142+0000","last_change":"2024-04-03T03:38:11.616774+0000","last_active":"2024-04-03T05:11:58.841142+0000","last_peered":"2024-04-03T05:11:58.841142+0000","last_clean":"2024-04-03T05:11:58.841142+0000","last_became_active":"2024-04-03T03:38:11.615990+0000","last_became_peered":"2024-04-03T03:38:11.615990+0000","last_unstale":"2024-04-03T05:11:58.841142+0000","last_undegraded":"2024-04-03T05:11:58.841142+0000","last_fullsized":"2024-04-03T05:11:58.841142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:31.225680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'231","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.905549+0000","last_change":"2024-04-03T03:38:24.759919+0000","last_active":"2024-04-03T05:14:07.905549+0000","last_peered":"2024-04-03T05:14:07.905549+0000","last_clean":"2024-04-03T05:14:07.905549+0000","last_became_active":"2024-04-03T03:38:24.759653+0000","last_became_peered":"2024-04-03T03:38:24.759653+0000","last_unstale":"2024-04-03T05:14:07.905549+0000","last_undegraded":"2024-04-03T05:14:07.905549+0000","last_fullsized":"2024-04-03T05:14:07.905549+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:41:42.084865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11848079,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":409,"num_read_kb":37025,"num_write":1042,"num_write_kb":41578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:09.021791+0000","last_change":"2024-04-03T03:38:28.738201+0000","last_active":"2024-04-03T05:10:09.021791+0000","last_peered":"2024-04-03T05:10:09.021791+0000","last_clean":"2024-04-03T05:10:09.021791+0000","last_became_active":"2024-04-03T03:38:28.735507+0000","last_became_peered":"2024-04-03T03:38:28.735507+0000","last_unstale":"2024-04-03T05:10:09.021791+0000","last_undegraded":"2024-04-03T05:10:09.021791+0000","last_fullsized":"2024-04-03T05:10:09.021791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:35:10.061515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'727","reported_seq":1455,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.574036+0000","last_change":"2024-04-03T03:38:30.723361+0000","last_active":"2024-04-03T05:14:07.574036+0000","last_peered":"2024-04-03T05:14:07.574036+0000","last_clean":"2024-04-03T05:14:07.574036+0000","last_became_active":"2024-04-03T03:38:30.722613+0000","last_became_peered":"2024-04-03T03:38:30.722613+0000","last_unstale":"2024-04-03T05:14:07.574036+0000","last_undegraded":"2024-04-03T05:14:07.574036+0000","last_fullsized":"2024-04-03T05:14:07.574036+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:07:59.714595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155517,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1404,"num_read_kb":2893,"num_write":1354,"num_write_kb":1181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.070721+0000","last_change":"2024-04-03T03:38:32.747059+0000","last_active":"2024-04-03T05:11:43.070721+0000","last_peered":"2024-04-03T05:11:43.070721+0000","last_clean":"2024-04-03T05:11:43.070721+0000","last_became_active":"2024-04-03T03:38:32.746148+0000","last_became_peered":"2024-04-03T03:38:32.746148+0000","last_unstale":"2024-04-03T05:11:43.070721+0000","last_undegraded":"2024-04-03T05:11:43.070721+0000","last_fullsized":"2024-04-03T05:11:43.070721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:20:36.906339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'114","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.017684+0000","last_change":"2024-04-03T03:38:34.761254+0000","last_active":"2024-04-03T05:11:49.017684+0000","last_peered":"2024-04-03T05:11:49.017684+0000","last_clean":"2024-04-03T05:11:49.017684+0000","last_became_active":"2024-04-03T03:38:34.760522+0000","last_became_peered":"2024-04-03T03:38:34.760522+0000","last_unstale":"2024-04-03T05:11:49.017684+0000","last_undegraded":"2024-04-03T05:11:49.017684+0000","last_fullsized":"2024-04-03T05:11:49.017684+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:48.393317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":148,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'705","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.069042+0000","last_change":"2024-04-03T03:38:26.726518+0000","last_active":"2024-04-03T05:11:38.069042+0000","last_peered":"2024-04-03T05:11:38.069042+0000","last_clean":"2024-04-03T05:11:38.069042+0000","last_became_active":"2024-04-03T03:38:26.725330+0000","last_became_peered":"2024-04-03T03:38:26.725330+0000","last_unstale":"2024-04-03T05:11:38.069042+0000","last_undegraded":"2024-04-03T05:11:38.069042+0000","last_fullsized":"2024-04-03T05:11:38.069042+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":600,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:20:31.608702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3168,"num_read_kb":2822,"num_write":954,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:39.028616+0000","last_change":"2024-04-03T03:38:11.620060+0000","last_active":"2024-04-03T05:10:39.028616+0000","last_peered":"2024-04-03T05:10:39.028616+0000","last_clean":"2024-04-03T05:10:39.028616+0000","last_became_active":"2024-04-03T03:38:11.619474+0000","last_became_peered":"2024-04-03T03:38:11.619474+0000","last_unstale":"2024-04-03T05:10:39.028616+0000","last_undegraded":"2024-04-03T05:10:39.028616+0000","last_fullsized":"2024-04-03T05:10:39.028616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:13:54.362230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'271","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.036834+0000","last_change":"2024-04-03T03:38:24.745584+0000","last_active":"2024-04-03T05:14:08.036834+0000","last_peered":"2024-04-03T05:14:08.036834+0000","last_clean":"2024-04-03T05:14:08.036834+0000","last_became_active":"2024-04-03T03:38:24.745231+0000","last_became_peered":"2024-04-03T03:38:24.745231+0000","last_unstale":"2024-04-03T05:14:08.036834+0000","last_undegraded":"2024-04-03T05:14:08.036834+0000","last_fullsized":"2024-04-03T05:14:08.036834+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:04:43.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8700168,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":405,"num_read_kb":22150,"num_write":1102,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.836656+0000","last_change":"2024-04-03T03:38:28.741133+0000","last_active":"2024-04-03T05:11:38.836656+0000","last_peered":"2024-04-03T05:11:38.836656+0000","last_clean":"2024-04-03T05:11:38.836656+0000","last_became_active":"2024-04-03T03:38:28.740595+0000","last_became_peered":"2024-04-03T03:38:28.740595+0000","last_unstale":"2024-04-03T05:11:38.836656+0000","last_undegraded":"2024-04-03T05:11:38.836656+0000","last_fullsized":"2024-04-03T05:11:38.836656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:29:01.051877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1176","reported_seq":3215,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.557148+0000","last_change":"2024-04-03T03:38:30.725691+0000","last_active":"2024-04-03T05:14:07.557148+0000","last_peered":"2024-04-03T05:14:07.557148+0000","last_clean":"2024-04-03T05:14:07.557148+0000","last_became_active":"2024-04-03T03:38:30.719511+0000","last_became_peered":"2024-04-03T03:38:30.719511+0000","last_unstale":"2024-04-03T05:14:07.557148+0000","last_undegraded":"2024-04-03T05:14:07.557148+0000","last_fullsized":"2024-04-03T05:14:07.557148+0000","mapping_epoch":29,"log_start":"263'1100","ondisk_log_start":"263'1100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:38:42.566363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172439,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1824,"num_read_kb":3282,"num_write":1198,"num_write_kb":991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:39.028804+0000","last_change":"2024-04-03T03:38:32.749446+0000","last_active":"2024-04-03T05:10:39.028804+0000","last_peered":"2024-04-03T05:10:39.028804+0000","last_clean":"2024-04-03T05:10:39.028804+0000","last_became_active":"2024-04-03T03:38:32.748061+0000","last_became_peered":"2024-04-03T03:38:32.748061+0000","last_unstale":"2024-04-03T05:10:39.028804+0000","last_undegraded":"2024-04-03T05:10:39.028804+0000","last_fullsized":"2024-04-03T05:10:39.028804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:27:00.730176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'163","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.820397+0000","last_change":"2024-04-03T03:38:34.937386+0000","last_active":"2024-04-03T05:10:02.820397+0000","last_peered":"2024-04-03T05:10:02.820397+0000","last_clean":"2024-04-03T05:10:02.820397+0000","last_became_active":"2024-04-03T03:38:34.936635+0000","last_became_peered":"2024-04-03T03:38:34.936635+0000","last_unstale":"2024-04-03T05:10:02.820397+0000","last_undegraded":"2024-04-03T05:10:02.820397+0000","last_fullsized":"2024-04-03T05:10:02.820397+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:53:55.693822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":219,"num_write":382,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'394","reported_seq":1830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.114549+0000","last_change":"2024-04-03T03:38:26.722334+0000","last_active":"2024-04-03T05:13:59.114549+0000","last_peered":"2024-04-03T05:13:59.114549+0000","last_clean":"2024-04-03T05:13:59.114549+0000","last_became_active":"2024-04-03T03:38:26.721536+0000","last_became_peered":"2024-04-03T03:38:26.721536+0000","last_unstale":"2024-04-03T05:13:59.114549+0000","last_undegraded":"2024-04-03T05:13:59.114549+0000","last_fullsized":"2024-04-03T05:13:59.114549+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:53.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2077,"num_read_kb":1939,"num_write":478,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:57.837427+0000","last_change":"2024-04-03T03:38:11.755773+0000","last_active":"2024-04-03T05:11:57.837427+0000","last_peered":"2024-04-03T05:11:57.837427+0000","last_clean":"2024-04-03T05:11:57.837427+0000","last_became_active":"2024-04-03T03:38:11.755301+0000","last_became_peered":"2024-04-03T03:38:11.755301+0000","last_unstale":"2024-04-03T05:11:57.837427+0000","last_undegraded":"2024-04-03T05:11:57.837427+0000","last_fullsized":"2024-04-03T05:11:57.837427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:56:40.206707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'248","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.701531+0000","last_change":"2024-04-03T03:38:24.720942+0000","last_active":"2024-04-03T05:14:07.701531+0000","last_peered":"2024-04-03T05:14:07.701531+0000","last_clean":"2024-04-03T05:14:07.701531+0000","last_became_active":"2024-04-03T03:38:24.720445+0000","last_became_peered":"2024-04-03T03:38:24.720445+0000","last_unstale":"2024-04-03T05:14:07.701531+0000","last_undegraded":"2024-04-03T05:14:07.701531+0000","last_fullsized":"2024-04-03T05:14:07.701531+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:22:22.841422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25199529,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":349,"num_read_kb":20915,"num_write":1016,"num_write_kb":36230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834723+0000","last_change":"2024-04-03T03:38:28.734259+0000","last_active":"2024-04-03T05:11:42.834723+0000","last_peered":"2024-04-03T05:11:42.834723+0000","last_clean":"2024-04-03T05:11:42.834723+0000","last_became_active":"2024-04-03T03:38:28.733750+0000","last_became_peered":"2024-04-03T03:38:28.733750+0000","last_unstale":"2024-04-03T05:11:42.834723+0000","last_undegraded":"2024-04-03T05:11:42.834723+0000","last_fullsized":"2024-04-03T05:11:42.834723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:15:52.422170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'331","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:57.929725+0000","last_change":"2024-04-03T03:38:30.824797+0000","last_active":"2024-04-03T05:13:57.929725+0000","last_peered":"2024-04-03T05:13:57.929725+0000","last_clean":"2024-04-03T05:13:57.929725+0000","last_became_active":"2024-04-03T03:38:30.824061+0000","last_became_peered":"2024-04-03T03:38:30.824061+0000","last_unstale":"2024-04-03T05:13:57.929725+0000","last_undegraded":"2024-04-03T05:13:57.929725+0000","last_fullsized":"2024-04-03T05:13:57.929725+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:24.797261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":319,"num_read_kb":311,"num_write":309,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.046912+0000","last_change":"2024-04-03T03:38:32.735866+0000","last_active":"2024-04-03T05:10:13.046912+0000","last_peered":"2024-04-03T05:10:13.046912+0000","last_clean":"2024-04-03T05:10:13.046912+0000","last_became_active":"2024-04-03T03:38:32.735151+0000","last_became_peered":"2024-04-03T03:38:32.735151+0000","last_unstale":"2024-04-03T05:10:13.046912+0000","last_undegraded":"2024-04-03T05:10:13.046912+0000","last_fullsized":"2024-04-03T05:10:13.046912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:48:02.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'192","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014576+0000","last_change":"2024-04-03T03:38:34.732538+0000","last_active":"2024-04-03T05:10:53.014576+0000","last_peered":"2024-04-03T05:10:53.014576+0000","last_clean":"2024-04-03T05:10:53.014576+0000","last_became_active":"2024-04-03T03:38:34.731776+0000","last_became_peered":"2024-04-03T03:38:34.731776+0000","last_unstale":"2024-04-03T05:10:53.014576+0000","last_undegraded":"2024-04-03T05:10:53.014576+0000","last_fullsized":"2024-04-03T05:10:53.014576+0000","mapping_epoch":33,"log_start":"252'100","ondisk_log_start":"252'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:35:06.296897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":349,"num_read_kb":358,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'382","reported_seq":1859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.232691+0000","last_change":"2024-04-03T03:38:26.727951+0000","last_active":"2024-04-03T05:10:55.232691+0000","last_peered":"2024-04-03T05:10:55.232691+0000","last_clean":"2024-04-03T05:10:55.232691+0000","last_became_active":"2024-04-03T03:38:26.727581+0000","last_became_peered":"2024-04-03T03:38:26.727581+0000","last_unstale":"2024-04-03T05:10:55.232691+0000","last_undegraded":"2024-04-03T05:10:55.232691+0000","last_fullsized":"2024-04-03T05:10:55.232691+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:26:22.789971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2147,"num_read_kb":2031,"num_write":458,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:58.841089+0000","last_change":"2024-04-03T03:38:11.614869+0000","last_active":"2024-04-03T05:11:58.841089+0000","last_peered":"2024-04-03T05:11:58.841089+0000","last_clean":"2024-04-03T05:11:58.841089+0000","last_became_active":"2024-04-03T03:38:11.613973+0000","last_became_peered":"2024-04-03T03:38:11.613973+0000","last_unstale":"2024-04-03T05:11:58.841089+0000","last_undegraded":"2024-04-03T05:11:58.841089+0000","last_fullsized":"2024-04-03T05:11:58.841089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:38:53.162490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'261","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.850295+0000","last_change":"2024-04-03T03:38:58.350014+0000","last_active":"2024-04-03T05:14:07.850295+0000","last_peered":"2024-04-03T05:14:07.850295+0000","last_clean":"2024-04-03T05:14:07.850295+0000","last_became_active":"2024-04-03T03:38:58.349561+0000","last_became_peered":"2024-04-03T03:38:58.349561+0000","last_unstale":"2024-04-03T05:14:07.850295+0000","last_undegraded":"2024-04-03T05:14:07.850295+0000","last_fullsized":"2024-04-03T05:14:07.850295+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:53:53.418209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12038047,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":422,"num_read_kb":36392,"num_write":993,"num_write_kb":30181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.055575+0000","last_change":"2024-04-03T03:38:28.713016+0000","last_active":"2024-04-03T05:10:38.055575+0000","last_peered":"2024-04-03T05:10:38.055575+0000","last_clean":"2024-04-03T05:10:38.055575+0000","last_became_active":"2024-04-03T03:38:28.711551+0000","last_became_peered":"2024-04-03T03:38:28.711551+0000","last_unstale":"2024-04-03T05:10:38.055575+0000","last_undegraded":"2024-04-03T05:10:38.055575+0000","last_fullsized":"2024-04-03T05:10:38.055575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:02:00.901908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'182","reported_seq":776,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.056299+0000","last_change":"2024-04-03T03:38:30.718183+0000","last_active":"2024-04-03T05:13:53.056299+0000","last_peered":"2024-04-03T05:13:53.056299+0000","last_clean":"2024-04-03T05:13:53.056299+0000","last_became_active":"2024-04-03T03:38:30.717437+0000","last_became_peered":"2024-04-03T03:38:30.717437+0000","last_unstale":"2024-04-03T05:13:53.056299+0000","last_undegraded":"2024-04-03T05:13:53.056299+0000","last_fullsized":"2024-04-03T05:13:53.056299+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:19:51.986312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":238,"num_read_kb":232,"num_write":176,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:44.016713+0000","last_change":"2024-04-03T03:38:32.740103+0000","last_active":"2024-04-03T05:11:44.016713+0000","last_peered":"2024-04-03T05:11:44.016713+0000","last_clean":"2024-04-03T05:11:44.016713+0000","last_became_active":"2024-04-03T03:38:32.739201+0000","last_became_peered":"2024-04-03T03:38:32.739201+0000","last_unstale":"2024-04-03T05:11:44.016713+0000","last_undegraded":"2024-04-03T05:11:44.016713+0000","last_fullsized":"2024-04-03T05:11:44.016713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:29.389145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.838705+0000","last_change":"2024-04-03T03:38:34.755897+0000","last_active":"2024-04-03T05:11:48.838705+0000","last_peered":"2024-04-03T05:11:48.838705+0000","last_clean":"2024-04-03T05:11:48.838705+0000","last_became_active":"2024-04-03T03:38:34.749642+0000","last_became_peered":"2024-04-03T03:38:34.749642+0000","last_unstale":"2024-04-03T05:11:48.838705+0000","last_undegraded":"2024-04-03T05:11:48.838705+0000","last_fullsized":"2024-04-03T05:11:48.838705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:24:40.979283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":197,"num_write":285,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'481","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:01.899466+0000","last_change":"2024-04-03T03:38:26.720851+0000","last_active":"2024-04-03T05:11:01.899466+0000","last_peered":"2024-04-03T05:11:01.899466+0000","last_clean":"2024-04-03T05:11:01.899466+0000","last_became_active":"2024-04-03T03:38:26.720476+0000","last_became_peered":"2024-04-03T03:38:26.720476+0000","last_unstale":"2024-04-03T05:11:01.899466+0000","last_undegraded":"2024-04-03T05:11:01.899466+0000","last_fullsized":"2024-04-03T05:11:01.899466+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:16:11.552164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2351,"num_write":586,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'279","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.687975+0000","last_change":"2024-04-03T03:38:24.749672+0000","last_active":"2024-04-03T05:14:08.687975+0000","last_peered":"2024-04-03T05:14:08.687975+0000","last_clean":"2024-04-03T05:14:08.687975+0000","last_became_active":"2024-04-03T03:38:24.748412+0000","last_became_peered":"2024-04-03T03:38:24.748412+0000","last_unstale":"2024-04-03T05:14:08.687975+0000","last_undegraded":"2024-04-03T05:14:08.687975+0000","last_fullsized":"2024-04-03T05:14:08.687975+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:46.714828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4595649,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":640,"num_read_kb":11584,"num_write":1120,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:57.850522+0000","last_change":"2024-04-03T03:38:11.611219+0000","last_active":"2024-04-03T05:11:57.850522+0000","last_peered":"2024-04-03T05:11:57.850522+0000","last_clean":"2024-04-03T05:11:57.850522+0000","last_became_active":"2024-04-03T03:38:11.609995+0000","last_became_peered":"2024-04-03T03:38:11.609995+0000","last_unstale":"2024-04-03T05:11:57.850522+0000","last_undegraded":"2024-04-03T05:11:57.850522+0000","last_fullsized":"2024-04-03T05:11:57.850522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:52:03.961331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'3","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.030519+0000","last_change":"2024-04-03T03:38:28.717488+0000","last_active":"2024-04-03T05:14:07.030519+0000","last_peered":"2024-04-03T05:14:07.030519+0000","last_clean":"2024-04-03T05:14:07.030519+0000","last_became_active":"2024-04-03T03:38:28.716761+0000","last_became_peered":"2024-04-03T03:38:28.716761+0000","last_unstale":"2024-04-03T05:14:07.030519+0000","last_undegraded":"2024-04-03T05:14:07.030519+0000","last_fullsized":"2024-04-03T05:14:07.030519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:16:55.208823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":482,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'610","reported_seq":1331,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.554792+0000","last_change":"2024-04-03T03:38:30.731606+0000","last_active":"2024-04-03T05:14:07.554792+0000","last_peered":"2024-04-03T05:14:07.554792+0000","last_clean":"2024-04-03T05:14:07.554792+0000","last_became_active":"2024-04-03T03:38:30.731186+0000","last_became_peered":"2024-04-03T03:38:30.731186+0000","last_unstale":"2024-04-03T05:14:07.554792+0000","last_undegraded":"2024-04-03T05:14:07.554792+0000","last_fullsized":"2024-04-03T05:14:07.554792+0000","mapping_epoch":29,"log_start":"263'500","ondisk_log_start":"263'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":500,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:47:57.629875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1041,"num_read_kb":2138,"num_write":838,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.622768+0000","last_change":"2024-04-03T03:38:32.726283+0000","last_active":"2024-04-03T05:10:13.622768+0000","last_peered":"2024-04-03T05:10:13.622768+0000","last_clean":"2024-04-03T05:10:13.622768+0000","last_became_active":"2024-04-03T03:38:32.725549+0000","last_became_peered":"2024-04-03T03:38:32.725549+0000","last_unstale":"2024-04-03T05:10:13.622768+0000","last_undegraded":"2024-04-03T05:10:13.622768+0000","last_fullsized":"2024-04-03T05:10:13.622768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:58.188714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'103","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.246058+0000","last_change":"2024-04-03T03:38:34.940294+0000","last_active":"2024-04-03T05:10:55.246058+0000","last_peered":"2024-04-03T05:10:55.246058+0000","last_clean":"2024-04-03T05:10:55.246058+0000","last_became_active":"2024-04-03T03:38:34.939419+0000","last_became_peered":"2024-04-03T03:38:34.939419+0000","last_unstale":"2024-04-03T05:10:55.246058+0000","last_undegraded":"2024-04-03T05:10:55.246058+0000","last_fullsized":"2024-04-03T05:10:55.246058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:30:08.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":118,"num_write":243,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'842","reported_seq":2346,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.076939+0000","last_change":"2024-04-03T03:38:26.732400+0000","last_active":"2024-04-03T05:12:13.076939+0000","last_peered":"2024-04-03T05:12:13.076939+0000","last_clean":"2024-04-03T05:12:13.076939+0000","last_became_active":"2024-04-03T03:38:26.731406+0000","last_became_peered":"2024-04-03T03:38:26.731406+0000","last_unstale":"2024-04-03T05:12:13.076939+0000","last_undegraded":"2024-04-03T05:12:13.076939+0000","last_fullsized":"2024-04-03T05:12:13.076939+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:49.785408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3757,"num_read_kb":3345,"num_write":1171,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'266","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.806904+0000","last_change":"2024-04-03T03:38:24.722172+0000","last_active":"2024-04-03T05:14:07.806904+0000","last_peered":"2024-04-03T05:14:07.806904+0000","last_clean":"2024-04-03T05:14:07.806904+0000","last_became_active":"2024-04-03T03:38:24.721685+0000","last_became_peered":"2024-04-03T03:38:24.721685+0000","last_unstale":"2024-04-03T05:14:07.806904+0000","last_undegraded":"2024-04-03T05:14:07.806904+0000","last_fullsized":"2024-04-03T05:14:07.806904+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:39.493128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4488322,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":379,"num_read_kb":12381,"num_write":1173,"num_write_kb":30338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:19.024098+0000","last_change":"2024-04-03T03:38:11.618107+0000","last_active":"2024-04-03T05:10:19.024098+0000","last_peered":"2024-04-03T05:10:19.024098+0000","last_clean":"2024-04-03T05:10:19.024098+0000","last_became_active":"2024-04-03T03:38:11.617057+0000","last_became_peered":"2024-04-03T03:38:11.617057+0000","last_unstale":"2024-04-03T05:10:19.024098+0000","last_undegraded":"2024-04-03T05:10:19.024098+0000","last_fullsized":"2024-04-03T05:10:19.024098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:22:38.744380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.996201+0000","last_change":"2024-04-03T03:38:28.720480+0000","last_active":"2024-04-03T05:10:08.996201+0000","last_peered":"2024-04-03T05:10:08.996201+0000","last_clean":"2024-04-03T05:10:08.996201+0000","last_became_active":"2024-04-03T03:38:28.719394+0000","last_became_peered":"2024-04-03T03:38:28.719394+0000","last_unstale":"2024-04-03T05:10:08.996201+0000","last_undegraded":"2024-04-03T05:10:08.996201+0000","last_fullsized":"2024-04-03T05:10:08.996201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:06.496312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'307","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:17.854662+0000","last_change":"2024-04-03T03:38:30.822163+0000","last_active":"2024-04-03T05:12:17.854662+0000","last_peered":"2024-04-03T05:12:17.854662+0000","last_clean":"2024-04-03T05:12:17.854662+0000","last_became_active":"2024-04-03T03:38:30.821297+0000","last_became_peered":"2024-04-03T03:38:30.821297+0000","last_unstale":"2024-04-03T05:12:17.854662+0000","last_undegraded":"2024-04-03T05:12:17.854662+0000","last_fullsized":"2024-04-03T05:12:17.854662+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:12.866281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":386,"num_write":374,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'552","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.491148+0000","last_change":"2024-04-03T03:38:32.748169+0000","last_active":"2024-04-03T05:14:07.491148+0000","last_peered":"2024-04-03T05:14:07.491148+0000","last_clean":"2024-04-03T05:14:07.491148+0000","last_became_active":"2024-04-03T03:38:32.747292+0000","last_became_peered":"2024-04-03T03:38:32.747292+0000","last_unstale":"2024-04-03T05:14:07.491148+0000","last_undegraded":"2024-04-03T05:14:07.491148+0000","last_fullsized":"2024-04-03T05:14:07.491148+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:43.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'90","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.050986+0000","last_change":"2024-04-03T03:38:34.936362+0000","last_active":"2024-04-03T05:13:28.050986+0000","last_peered":"2024-04-03T05:13:28.050986+0000","last_clean":"2024-04-03T05:13:28.050986+0000","last_became_active":"2024-04-03T03:38:34.935593+0000","last_became_peered":"2024-04-03T03:38:34.935593+0000","last_unstale":"2024-04-03T05:13:28.050986+0000","last_undegraded":"2024-04-03T05:13:28.050986+0000","last_fullsized":"2024-04-03T05:13:28.050986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:15.143724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":828,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":224,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'421","reported_seq":1889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013119+0000","last_change":"2024-04-03T03:38:26.717074+0000","last_active":"2024-04-03T05:10:48.013119+0000","last_peered":"2024-04-03T05:10:48.013119+0000","last_clean":"2024-04-03T05:10:48.013119+0000","last_became_active":"2024-04-03T03:38:26.716004+0000","last_became_peered":"2024-04-03T03:38:26.716004+0000","last_unstale":"2024-04-03T05:10:48.013119+0000","last_undegraded":"2024-04-03T05:10:48.013119+0000","last_fullsized":"2024-04-03T05:10:48.013119+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:35.702121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":2164,"num_write":539,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'278","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.959970+0000","last_change":"2024-04-03T03:38:24.728339+0000","last_active":"2024-04-03T05:14:07.959970+0000","last_peered":"2024-04-03T05:14:07.959970+0000","last_clean":"2024-04-03T05:14:07.959970+0000","last_became_active":"2024-04-03T03:38:24.727736+0000","last_became_peered":"2024-04-03T03:38:24.727736+0000","last_unstale":"2024-04-03T05:14:07.959970+0000","last_undegraded":"2024-04-03T05:14:07.959970+0000","last_fullsized":"2024-04-03T05:14:07.959970+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:59:04.813514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285493,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":462,"num_read_kb":37307,"num_write":1162,"num_write_kb":23236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.843088+0000","last_change":"2024-04-03T03:38:11.613510+0000","last_active":"2024-04-03T05:11:22.843088+0000","last_peered":"2024-04-03T05:11:22.843088+0000","last_clean":"2024-04-03T05:11:22.843088+0000","last_became_active":"2024-04-03T03:38:11.613252+0000","last_became_peered":"2024-04-03T03:38:11.613252+0000","last_unstale":"2024-04-03T05:11:22.843088+0000","last_undegraded":"2024-04-03T05:11:22.843088+0000","last_fullsized":"2024-04-03T05:11:22.843088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:56:15.329216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.621550+0000","last_change":"2024-04-03T03:38:28.722584+0000","last_active":"2024-04-03T05:10:08.621550+0000","last_peered":"2024-04-03T05:10:08.621550+0000","last_clean":"2024-04-03T05:10:08.621550+0000","last_became_active":"2024-04-03T03:38:28.721796+0000","last_became_peered":"2024-04-03T03:38:28.721796+0000","last_unstale":"2024-04-03T05:10:08.621550+0000","last_undegraded":"2024-04-03T05:10:08.621550+0000","last_fullsized":"2024-04-03T05:10:08.621550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:50.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'166","reported_seq":755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.622863+0000","last_change":"2024-04-03T03:38:30.719677+0000","last_active":"2024-04-03T05:10:13.622863+0000","last_peered":"2024-04-03T05:10:13.622863+0000","last_clean":"2024-04-03T05:10:13.622863+0000","last_became_active":"2024-04-03T03:38:30.718913+0000","last_became_peered":"2024-04-03T03:38:30.718913+0000","last_unstale":"2024-04-03T05:10:13.622863+0000","last_undegraded":"2024-04-03T05:10:13.622863+0000","last_fullsized":"2024-04-03T05:10:13.622863+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:08:10.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":144,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'552","reported_seq":2668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.503414+0000","last_change":"2024-04-03T03:38:32.744373+0000","last_active":"2024-04-03T05:14:07.503414+0000","last_peered":"2024-04-03T05:14:07.503414+0000","last_clean":"2024-04-03T05:14:07.503414+0000","last_became_active":"2024-04-03T03:38:32.743829+0000","last_became_peered":"2024-04-03T03:38:32.743829+0000","last_unstale":"2024-04-03T05:14:07.503414+0000","last_undegraded":"2024-04-03T05:14:07.503414+0000","last_fullsized":"2024-04-03T05:14:07.503414+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:07:40.400539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'94","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.059107+0000","last_change":"2024-04-03T03:38:34.747164+0000","last_active":"2024-04-03T05:10:53.059107+0000","last_peered":"2024-04-03T05:10:53.059107+0000","last_clean":"2024-04-03T05:10:53.059107+0000","last_became_active":"2024-04-03T03:38:34.746249+0000","last_became_peered":"2024-04-03T03:38:34.746249+0000","last_unstale":"2024-04-03T05:10:53.059107+0000","last_undegraded":"2024-04-03T05:10:53.059107+0000","last_fullsized":"2024-04-03T05:10:53.059107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:25:14.477982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":217,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1105","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398899+0000","last_change":"2024-04-03T03:38:26.741936+0000","last_active":"2024-04-03T05:11:18.398899+0000","last_peered":"2024-04-03T05:11:18.398899+0000","last_clean":"2024-04-03T05:11:18.398899+0000","last_became_active":"2024-04-03T03:38:26.741272+0000","last_became_peered":"2024-04-03T03:38:26.741272+0000","last_unstale":"2024-04-03T05:11:18.398899+0000","last_undegraded":"2024-04-03T05:11:18.398899+0000","last_fullsized":"2024-04-03T05:11:18.398899+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:11:49.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4771,"num_read_kb":4189,"num_write":1521,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'267","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.074588+0000","last_change":"2024-04-03T03:38:24.747700+0000","last_active":"2024-04-03T05:14:08.074588+0000","last_peered":"2024-04-03T05:14:08.074588+0000","last_clean":"2024-04-03T05:14:08.074588+0000","last_became_active":"2024-04-03T03:38:24.747145+0000","last_became_peered":"2024-04-03T03:38:24.747145+0000","last_unstale":"2024-04-03T05:14:08.074588+0000","last_undegraded":"2024-04-03T05:14:08.074588+0000","last_fullsized":"2024-04-03T05:14:08.074588+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:03:58.509965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8850535,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":347,"num_read_kb":38174,"num_write":1012,"num_write_kb":41152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012441+0000","last_change":"2024-04-03T03:38:11.618291+0000","last_active":"2024-04-03T05:11:24.012441+0000","last_peered":"2024-04-03T05:11:24.012441+0000","last_clean":"2024-04-03T05:11:24.012441+0000","last_became_active":"2024-04-03T03:38:11.617573+0000","last_became_peered":"2024-04-03T03:38:11.617573+0000","last_unstale":"2024-04-03T05:11:24.012441+0000","last_undegraded":"2024-04-03T05:11:24.012441+0000","last_fullsized":"2024-04-03T05:11:24.012441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:12:17.137777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014435+0000","last_change":"2024-04-03T03:38:28.734000+0000","last_active":"2024-04-03T05:10:53.014435+0000","last_peered":"2024-04-03T05:10:53.014435+0000","last_clean":"2024-04-03T05:10:53.014435+0000","last_became_active":"2024-04-03T03:38:28.733237+0000","last_became_peered":"2024-04-03T03:38:28.733237+0000","last_unstale":"2024-04-03T05:10:53.014435+0000","last_undegraded":"2024-04-03T05:10:53.014435+0000","last_fullsized":"2024-04-03T05:10:53.014435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:17.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'789","reported_seq":1555,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.037369+0000","last_change":"2024-04-03T03:38:30.823414+0000","last_active":"2024-04-03T05:14:09.037369+0000","last_peered":"2024-04-03T05:14:09.037369+0000","last_clean":"2024-04-03T05:14:09.037369+0000","last_became_active":"2024-04-03T03:38:30.822610+0000","last_became_peered":"2024-04-03T03:38:30.822610+0000","last_unstale":"2024-04-03T05:14:09.037369+0000","last_undegraded":"2024-04-03T05:14:09.037369+0000","last_fullsized":"2024-04-03T05:14:09.037369+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:08:41.961174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161519,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1384,"num_read_kb":3113,"num_write":1121,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.004685+0000","last_change":"2024-04-03T03:38:32.729501+0000","last_active":"2024-04-03T05:10:13.004685+0000","last_peered":"2024-04-03T05:10:13.004685+0000","last_clean":"2024-04-03T05:10:13.004685+0000","last_became_active":"2024-04-03T03:38:32.728874+0000","last_became_peered":"2024-04-03T03:38:32.728874+0000","last_unstale":"2024-04-03T05:10:13.004685+0000","last_undegraded":"2024-04-03T05:10:13.004685+0000","last_fullsized":"2024-04-03T05:10:13.004685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:13:52.894350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'104","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.296042+0000","last_change":"2024-04-03T03:38:34.757708+0000","last_active":"2024-04-03T05:11:29.296042+0000","last_peered":"2024-04-03T05:11:29.296042+0000","last_clean":"2024-04-03T05:11:29.296042+0000","last_became_active":"2024-04-03T03:38:34.756936+0000","last_became_peered":"2024-04-03T03:38:34.756936+0000","last_unstale":"2024-04-03T05:11:29.296042+0000","last_undegraded":"2024-04-03T05:11:29.296042+0000","last_fullsized":"2024-04-03T05:11:29.296042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:39.973669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'144","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.051218+0000","last_change":"2024-04-03T03:38:34.760408+0000","last_active":"2024-04-03T05:10:18.051218+0000","last_peered":"2024-04-03T05:10:18.051218+0000","last_clean":"2024-04-03T05:10:18.051218+0000","last_became_active":"2024-04-03T03:38:34.759767+0000","last_became_peered":"2024-04-03T03:38:34.759767+0000","last_unstale":"2024-04-03T05:10:18.051218+0000","last_undegraded":"2024-04-03T05:10:18.051218+0000","last_fullsized":"2024-04-03T05:10:18.051218+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:27:11.459564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":108,"num_write":250,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'826","reported_seq":2402,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.643808+0000","last_change":"2024-04-03T03:38:26.741454+0000","last_active":"2024-04-03T05:11:48.643808+0000","last_peered":"2024-04-03T05:11:48.643808+0000","last_clean":"2024-04-03T05:11:48.643808+0000","last_became_active":"2024-04-03T03:38:26.740732+0000","last_became_peered":"2024-04-03T03:38:26.740732+0000","last_unstale":"2024-04-03T05:11:48.643808+0000","last_undegraded":"2024-04-03T05:11:48.643808+0000","last_fullsized":"2024-04-03T05:11:48.643808+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:26.379990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3680,"num_read_kb":3271,"num_write":1116,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'304","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.597696+0000","last_change":"2024-04-03T03:38:24.741664+0000","last_active":"2024-04-03T05:14:08.597696+0000","last_peered":"2024-04-03T05:14:08.597696+0000","last_clean":"2024-04-03T05:14:08.597696+0000","last_became_active":"2024-04-03T03:38:24.740900+0000","last_became_peered":"2024-04-03T03:38:24.740900+0000","last_unstale":"2024-04-03T05:14:08.597696+0000","last_undegraded":"2024-04-03T05:14:08.597696+0000","last_fullsized":"2024-04-03T05:14:08.597696+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:54:13.177313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10742918,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":563,"num_read_kb":65764,"num_write":1202,"num_write_kb":26843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:32.813587+0000","last_change":"2024-04-03T03:38:28.725751+0000","last_active":"2024-04-03T05:09:32.813587+0000","last_peered":"2024-04-03T05:09:32.813587+0000","last_clean":"2024-04-03T05:09:32.813587+0000","last_became_active":"2024-04-03T03:38:28.725020+0000","last_became_peered":"2024-04-03T03:38:28.725020+0000","last_unstale":"2024-04-03T05:09:32.813587+0000","last_undegraded":"2024-04-03T05:09:32.813587+0000","last_fullsized":"2024-04-03T05:09:32.813587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:26:47.268104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'305","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.511944+0000","last_change":"2024-04-03T03:38:30.730341+0000","last_active":"2024-04-03T05:14:00.511944+0000","last_peered":"2024-04-03T05:14:00.511944+0000","last_clean":"2024-04-03T05:14:00.511944+0000","last_became_active":"2024-04-03T03:38:30.729608+0000","last_became_peered":"2024-04-03T03:38:30.729608+0000","last_unstale":"2024-04-03T05:14:00.511944+0000","last_undegraded":"2024-04-03T05:14:00.511944+0000","last_fullsized":"2024-04-03T05:14:00.511944+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:12:36.054464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49761,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":488,"num_read_kb":954,"num_write":384,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:32.995494+0000","last_change":"2024-04-03T03:38:32.746511+0000","last_active":"2024-04-03T05:09:32.995494+0000","last_peered":"2024-04-03T05:09:32.995494+0000","last_clean":"2024-04-03T05:09:32.995494+0000","last_became_active":"2024-04-03T03:38:32.744256+0000","last_became_peered":"2024-04-03T03:38:32.744256+0000","last_unstale":"2024-04-03T05:09:32.995494+0000","last_undegraded":"2024-04-03T05:09:32.995494+0000","last_fullsized":"2024-04-03T05:09:32.995494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:40:51.923207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'108","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.015981+0000","last_change":"2024-04-03T03:38:34.737865+0000","last_active":"2024-04-03T05:10:58.015981+0000","last_peered":"2024-04-03T05:10:58.015981+0000","last_clean":"2024-04-03T05:10:58.015981+0000","last_became_active":"2024-04-03T03:38:34.736176+0000","last_became_peered":"2024-04-03T03:38:34.736176+0000","last_unstale":"2024-04-03T05:10:58.015981+0000","last_undegraded":"2024-04-03T05:10:58.015981+0000","last_fullsized":"2024-04-03T05:10:58.015981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:17:39.580695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":259,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'759","reported_seq":2571,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.848276+0000","last_change":"2024-04-03T03:38:26.720574+0000","last_active":"2024-04-03T05:11:47.848276+0000","last_peered":"2024-04-03T05:11:47.848276+0000","last_clean":"2024-04-03T05:11:47.848276+0000","last_became_active":"2024-04-03T03:38:26.720106+0000","last_became_peered":"2024-04-03T03:38:26.720106+0000","last_unstale":"2024-04-03T05:11:47.848276+0000","last_undegraded":"2024-04-03T05:11:47.848276+0000","last_fullsized":"2024-04-03T05:11:47.848276+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:10:18.194606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3508,"num_write":1155,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'302","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.924918+0000","last_change":"2024-04-03T03:38:57.883863+0000","last_active":"2024-04-03T05:14:08.924918+0000","last_peered":"2024-04-03T05:14:08.924918+0000","last_clean":"2024-04-03T05:14:08.924918+0000","last_became_active":"2024-04-03T03:38:57.882607+0000","last_became_peered":"2024-04-03T03:38:57.882607+0000","last_unstale":"2024-04-03T05:14:08.924918+0000","last_undegraded":"2024-04-03T05:14:08.924918+0000","last_fullsized":"2024-04-03T05:14:08.924918+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:06:53.732174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18518996,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":576,"num_read_kb":85963,"num_write":1239,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:32.995750+0000","last_change":"2024-04-03T03:38:28.723791+0000","last_active":"2024-04-03T05:09:32.995750+0000","last_peered":"2024-04-03T05:09:32.995750+0000","last_clean":"2024-04-03T05:09:32.995750+0000","last_became_active":"2024-04-03T03:38:28.723082+0000","last_became_peered":"2024-04-03T03:38:28.723082+0000","last_unstale":"2024-04-03T05:09:32.995750+0000","last_undegraded":"2024-04-03T05:09:32.995750+0000","last_fullsized":"2024-04-03T05:09:32.995750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:47:02.690730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:33.037838+0000","last_change":"2024-04-03T03:38:30.730377+0000","last_active":"2024-04-03T05:09:33.037838+0000","last_peered":"2024-04-03T05:09:33.037838+0000","last_clean":"2024-04-03T05:09:33.037838+0000","last_became_active":"2024-04-03T03:38:30.729412+0000","last_became_peered":"2024-04-03T03:38:30.729412+0000","last_unstale":"2024-04-03T05:09:33.037838+0000","last_undegraded":"2024-04-03T05:09:33.037838+0000","last_fullsized":"2024-04-03T05:09:33.037838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:49:48.699386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":60,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:34.013641+0000","last_change":"2024-04-03T03:38:32.748751+0000","last_active":"2024-04-03T05:09:34.013641+0000","last_peered":"2024-04-03T05:09:34.013641+0000","last_clean":"2024-04-03T05:09:34.013641+0000","last_became_active":"2024-04-03T03:38:32.747294+0000","last_became_peered":"2024-04-03T03:38:32.747294+0000","last_unstale":"2024-04-03T05:09:34.013641+0000","last_undegraded":"2024-04-03T05:09:34.013641+0000","last_fullsized":"2024-04-03T05:09:34.013641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:27.522363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'97","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062855+0000","last_change":"2024-04-03T03:38:34.739547+0000","last_active":"2024-04-03T05:11:08.062855+0000","last_peered":"2024-04-03T05:11:08.062855+0000","last_clean":"2024-04-03T05:11:08.062855+0000","last_became_active":"2024-04-03T03:38:34.737841+0000","last_became_peered":"2024-04-03T03:38:34.737841+0000","last_unstale":"2024-04-03T05:11:08.062855+0000","last_undegraded":"2024-04-03T05:11:08.062855+0000","last_fullsized":"2024-04-03T05:11:08.062855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:58:36.235149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":225,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'410","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.027664+0000","last_change":"2024-04-03T03:38:26.720039+0000","last_active":"2024-04-03T05:11:48.027664+0000","last_peered":"2024-04-03T05:11:48.027664+0000","last_clean":"2024-04-03T05:11:48.027664+0000","last_became_active":"2024-04-03T03:38:26.715716+0000","last_became_peered":"2024-04-03T03:38:26.715716+0000","last_unstale":"2024-04-03T05:11:48.027664+0000","last_undegraded":"2024-04-03T05:11:48.027664+0000","last_fullsized":"2024-04-03T05:11:48.027664+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:34.026023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2104,"num_read_kb":1969,"num_write":502,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'398","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.649394+0000","last_change":"2024-04-03T03:38:24.742857+0000","last_active":"2024-04-03T05:14:08.649394+0000","last_peered":"2024-04-03T05:14:08.649394+0000","last_clean":"2024-04-03T05:14:08.649394+0000","last_became_active":"2024-04-03T03:38:24.737281+0000","last_became_peered":"2024-04-03T03:38:24.737281+0000","last_unstale":"2024-04-03T05:14:08.649394+0000","last_undegraded":"2024-04-03T05:14:08.649394+0000","last_fullsized":"2024-04-03T05:14:08.649394+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:25:22.407147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9888688,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":722,"num_read_kb":29465,"num_write":1348,"num_write_kb":33665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.044403+0000","last_change":"2024-04-03T03:38:28.735969+0000","last_active":"2024-04-03T05:11:49.044403+0000","last_peered":"2024-04-03T05:11:49.044403+0000","last_clean":"2024-04-03T05:11:49.044403+0000","last_became_active":"2024-04-03T03:38:28.735156+0000","last_became_peered":"2024-04-03T03:38:28.735156+0000","last_unstale":"2024-04-03T05:11:49.044403+0000","last_undegraded":"2024-04-03T05:11:49.044403+0000","last_fullsized":"2024-04-03T05:11:49.044403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:53.609411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'320","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.478593+0000","last_change":"2024-04-03T03:38:30.734504+0000","last_active":"2024-04-03T05:14:00.478593+0000","last_peered":"2024-04-03T05:14:00.478593+0000","last_clean":"2024-04-03T05:14:00.478593+0000","last_became_active":"2024-04-03T03:38:30.733682+0000","last_became_peered":"2024-04-03T03:38:30.733682+0000","last_unstale":"2024-04-03T05:14:00.478593+0000","last_undegraded":"2024-04-03T05:14:00.478593+0000","last_fullsized":"2024-04-03T05:14:00.478593+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:34:59.488858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50383,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":1019,"num_write":416,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:33.987763+0000","last_change":"2024-04-03T03:38:32.734561+0000","last_active":"2024-04-03T05:09:33.987763+0000","last_peered":"2024-04-03T05:09:33.987763+0000","last_clean":"2024-04-03T05:09:33.987763+0000","last_became_active":"2024-04-03T03:38:32.733728+0000","last_became_peered":"2024-04-03T03:38:32.733728+0000","last_unstale":"2024-04-03T05:09:33.987763+0000","last_undegraded":"2024-04-03T05:09:33.987763+0000","last_fullsized":"2024-04-03T05:09:33.987763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:55:41.581847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'152","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.830070+0000","last_change":"2024-04-03T03:38:34.756727+0000","last_active":"2024-04-03T05:11:08.830070+0000","last_peered":"2024-04-03T05:11:08.830070+0000","last_clean":"2024-04-03T05:11:08.830070+0000","last_became_active":"2024-04-03T03:38:34.755929+0000","last_became_peered":"2024-04-03T03:38:34.755929+0000","last_unstale":"2024-04-03T05:11:08.830070+0000","last_undegraded":"2024-04-03T05:11:08.830070+0000","last_fullsized":"2024-04-03T05:11:08.830070+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:41.464119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":91,"num_write":329,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'735","reported_seq":2109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.027568+0000","last_change":"2024-04-03T03:38:26.724380+0000","last_active":"2024-04-03T05:11:48.027568+0000","last_peered":"2024-04-03T05:11:48.027568+0000","last_clean":"2024-04-03T05:11:48.027568+0000","last_became_active":"2024-04-03T03:38:26.723758+0000","last_became_peered":"2024-04-03T03:38:26.723758+0000","last_unstale":"2024-04-03T05:11:48.027568+0000","last_undegraded":"2024-04-03T05:11:48.027568+0000","last_fullsized":"2024-04-03T05:11:48.027568+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:31.930788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3210,"num_read_kb":2838,"num_write":998,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'300","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.001046+0000","last_change":"2024-04-03T03:38:24.740315+0000","last_active":"2024-04-03T05:14:08.001046+0000","last_peered":"2024-04-03T05:14:08.001046+0000","last_clean":"2024-04-03T05:14:08.001046+0000","last_became_active":"2024-04-03T03:38:24.739968+0000","last_became_peered":"2024-04-03T03:38:24.739968+0000","last_unstale":"2024-04-03T05:14:08.001046+0000","last_undegraded":"2024-04-03T05:14:08.001046+0000","last_fullsized":"2024-04-03T05:14:08.001046+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:36:09.717326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5500171,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":555,"num_read_kb":31745,"num_write":1138,"num_write_kb":30139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.017719+0000","last_change":"2024-04-03T03:38:28.724693+0000","last_active":"2024-04-03T05:11:49.017719+0000","last_peered":"2024-04-03T05:11:49.017719+0000","last_clean":"2024-04-03T05:11:49.017719+0000","last_became_active":"2024-04-03T03:38:28.723907+0000","last_became_peered":"2024-04-03T03:38:28.723907+0000","last_unstale":"2024-04-03T05:11:49.017719+0000","last_undegraded":"2024-04-03T05:11:49.017719+0000","last_fullsized":"2024-04-03T05:11:49.017719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:13:05.741974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'313","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.933996+0000","last_change":"2024-04-03T03:38:30.733466+0000","last_active":"2024-04-03T05:14:08.933996+0000","last_peered":"2024-04-03T05:14:08.933996+0000","last_clean":"2024-04-03T05:14:08.933996+0000","last_became_active":"2024-04-03T03:38:30.732520+0000","last_became_peered":"2024-04-03T03:38:30.732520+0000","last_unstale":"2024-04-03T05:14:08.933996+0000","last_undegraded":"2024-04-03T05:14:08.933996+0000","last_fullsized":"2024-04-03T05:14:08.933996+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:53.671349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49780,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1180,"num_write":410,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:33.038005+0000","last_change":"2024-04-03T03:38:32.749555+0000","last_active":"2024-04-03T05:09:33.038005+0000","last_peered":"2024-04-03T05:09:33.038005+0000","last_clean":"2024-04-03T05:09:33.038005+0000","last_became_active":"2024-04-03T03:38:32.748621+0000","last_became_peered":"2024-04-03T03:38:32.748621+0000","last_unstale":"2024-04-03T05:09:33.038005+0000","last_undegraded":"2024-04-03T05:09:33.038005+0000","last_fullsized":"2024-04-03T05:09:33.038005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:14:00.976597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'375","reported_seq":2039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.276649+0000","last_change":"2024-04-03T03:38:26.714514+0000","last_active":"2024-04-03T05:11:29.276649+0000","last_peered":"2024-04-03T05:11:29.276649+0000","last_clean":"2024-04-03T05:11:29.276649+0000","last_became_active":"2024-04-03T03:38:26.711974+0000","last_became_peered":"2024-04-03T03:38:26.711974+0000","last_unstale":"2024-04-03T05:11:29.276649+0000","last_undegraded":"2024-04-03T05:11:29.276649+0000","last_fullsized":"2024-04-03T05:11:29.276649+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:02.940173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2240,"num_write":411,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'289","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.960731+0000","last_change":"2024-04-03T03:38:24.717991+0000","last_active":"2024-04-03T05:14:07.960731+0000","last_peered":"2024-04-03T05:14:07.960731+0000","last_clean":"2024-04-03T05:14:07.960731+0000","last_became_active":"2024-04-03T03:38:24.715050+0000","last_became_peered":"2024-04-03T03:38:24.715050+0000","last_unstale":"2024-04-03T05:14:07.960731+0000","last_undegraded":"2024-04-03T05:14:07.960731+0000","last_fullsized":"2024-04-03T05:14:07.960731+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:38:21.124593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19655769,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":404,"num_read_kb":21764,"num_write":1119,"num_write_kb":53575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060528+0000","last_change":"2024-04-03T03:38:28.717346+0000","last_active":"2024-04-03T05:10:58.060528+0000","last_peered":"2024-04-03T05:10:58.060528+0000","last_clean":"2024-04-03T05:10:58.060528+0000","last_became_active":"2024-04-03T03:38:28.716638+0000","last_became_peered":"2024-04-03T03:38:28.716638+0000","last_unstale":"2024-04-03T05:10:58.060528+0000","last_undegraded":"2024-04-03T05:10:58.060528+0000","last_fullsized":"2024-04-03T05:10:58.060528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:43:16.450833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'501","reported_seq":1161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.538155+0000","last_change":"2024-04-03T03:38:30.726825+0000","last_active":"2024-04-03T05:14:07.538155+0000","last_peered":"2024-04-03T05:14:07.538155+0000","last_clean":"2024-04-03T05:14:07.538155+0000","last_became_active":"2024-04-03T03:38:30.725324+0000","last_became_peered":"2024-04-03T03:38:30.725324+0000","last_unstale":"2024-04-03T05:14:07.538155+0000","last_undegraded":"2024-04-03T05:14:07.538155+0000","last_fullsized":"2024-04-03T05:14:07.538155+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:45:26.155940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126247,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":859,"num_read_kb":1917,"num_write":702,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.828908+0000","last_change":"2024-04-03T03:38:32.735911+0000","last_active":"2024-04-03T05:11:03.828908+0000","last_peered":"2024-04-03T05:11:03.828908+0000","last_clean":"2024-04-03T05:11:03.828908+0000","last_became_active":"2024-04-03T03:38:32.730456+0000","last_became_peered":"2024-04-03T03:38:32.730456+0000","last_unstale":"2024-04-03T05:11:03.828908+0000","last_undegraded":"2024-04-03T05:11:03.828908+0000","last_fullsized":"2024-04-03T05:11:03.828908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:36:50.012219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'158","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.481133+0000","last_change":"2024-04-03T03:38:34.940007+0000","last_active":"2024-04-03T05:11:08.481133+0000","last_peered":"2024-04-03T05:11:08.481133+0000","last_clean":"2024-04-03T05:11:08.481133+0000","last_became_active":"2024-04-03T03:38:34.939244+0000","last_became_peered":"2024-04-03T03:38:34.939244+0000","last_unstale":"2024-04-03T05:11:08.481133+0000","last_undegraded":"2024-04-03T05:11:08.481133+0000","last_fullsized":"2024-04-03T05:11:08.481133+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:49:45.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":238,"num_write":361,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'563","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.118189+0000","last_change":"2024-04-03T03:38:26.723127+0000","last_active":"2024-04-03T05:13:59.118189+0000","last_peered":"2024-04-03T05:13:59.118189+0000","last_clean":"2024-04-03T05:13:59.118189+0000","last_became_active":"2024-04-03T03:38:26.718375+0000","last_became_peered":"2024-04-03T03:38:26.718375+0000","last_unstale":"2024-04-03T05:13:59.118189+0000","last_undegraded":"2024-04-03T05:13:59.118189+0000","last_fullsized":"2024-04-03T05:13:59.118189+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:58:09.941905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2911,"num_read_kb":2669,"num_write":774,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'267","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.837711+0000","last_change":"2024-04-03T03:38:24.730652+0000","last_active":"2024-04-03T05:14:07.837711+0000","last_peered":"2024-04-03T05:14:07.837711+0000","last_clean":"2024-04-03T05:14:07.837711+0000","last_became_active":"2024-04-03T03:38:24.730294+0000","last_became_peered":"2024-04-03T03:38:24.730294+0000","last_unstale":"2024-04-03T05:14:07.837711+0000","last_undegraded":"2024-04-03T05:14:07.837711+0000","last_fullsized":"2024-04-03T05:14:07.837711+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:53:27.113096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11567712,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":421,"num_read_kb":62893,"num_write":1267,"num_write_kb":30207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.996314+0000","last_change":"2024-04-03T03:38:28.720598+0000","last_active":"2024-04-03T05:10:08.996314+0000","last_peered":"2024-04-03T05:10:08.996314+0000","last_clean":"2024-04-03T05:10:08.996314+0000","last_became_active":"2024-04-03T03:38:28.719692+0000","last_became_peered":"2024-04-03T03:38:28.719692+0000","last_unstale":"2024-04-03T05:10:08.996314+0000","last_undegraded":"2024-04-03T05:10:08.996314+0000","last_fullsized":"2024-04-03T05:10:08.996314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:36.700015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'337","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.032362+0000","last_change":"2024-04-03T03:38:30.733396+0000","last_active":"2024-04-03T05:14:09.032362+0000","last_peered":"2024-04-03T05:14:09.032362+0000","last_clean":"2024-04-03T05:14:09.032362+0000","last_became_active":"2024-04-03T03:38:30.732529+0000","last_became_peered":"2024-04-03T03:38:30.732529+0000","last_unstale":"2024-04-03T05:14:09.032362+0000","last_undegraded":"2024-04-03T05:14:09.032362+0000","last_fullsized":"2024-04-03T05:14:09.032362+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:08:35.143644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":563,"num_read_kb":1112,"num_write":458,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:02.838256+0000","last_change":"2024-04-03T03:38:32.735100+0000","last_active":"2024-04-03T05:11:02.838256+0000","last_peered":"2024-04-03T05:11:02.838256+0000","last_clean":"2024-04-03T05:11:02.838256+0000","last_became_active":"2024-04-03T03:38:32.731752+0000","last_became_peered":"2024-04-03T03:38:32.731752+0000","last_unstale":"2024-04-03T05:11:02.838256+0000","last_undegraded":"2024-04-03T05:11:02.838256+0000","last_fullsized":"2024-04-03T05:11:02.838256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:55:58.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'186","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.365316+0000","last_change":"2024-04-03T03:38:34.737380+0000","last_active":"2024-04-03T05:12:13.365316+0000","last_peered":"2024-04-03T05:12:13.365316+0000","last_clean":"2024-04-03T05:12:13.365316+0000","last_became_active":"2024-04-03T03:38:34.736663+0000","last_became_peered":"2024-04-03T03:38:34.736663+0000","last_unstale":"2024-04-03T05:12:13.365316+0000","last_undegraded":"2024-04-03T05:12:13.365316+0000","last_fullsized":"2024-04-03T05:12:13.365316+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:12:54.724658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":719,"num_read_kb":691,"num_write":524,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'751","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.015946+0000","last_change":"2024-04-03T03:38:26.711611+0000","last_active":"2024-04-03T05:10:58.015946+0000","last_peered":"2024-04-03T05:10:58.015946+0000","last_clean":"2024-04-03T05:10:58.015946+0000","last_became_active":"2024-04-03T03:38:26.711214+0000","last_became_peered":"2024-04-03T03:38:26.711214+0000","last_unstale":"2024-04-03T05:10:58.015946+0000","last_undegraded":"2024-04-03T05:10:58.015946+0000","last_fullsized":"2024-04-03T05:10:58.015946+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:14:42.035748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3543,"num_read_kb":3207,"num_write":983,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'256","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.616832+0000","last_change":"2024-04-03T03:38:24.761914+0000","last_active":"2024-04-03T05:14:08.616832+0000","last_peered":"2024-04-03T05:14:08.616832+0000","last_clean":"2024-04-03T05:14:08.616832+0000","last_became_active":"2024-04-03T03:38:24.761330+0000","last_became_peered":"2024-04-03T03:38:24.761330+0000","last_unstale":"2024-04-03T05:14:08.616832+0000","last_undegraded":"2024-04-03T05:14:08.616832+0000","last_fullsized":"2024-04-03T05:14:08.616832+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:38:35.443926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13063112,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":366,"num_read_kb":53466,"num_write":1078,"num_write_kb":35897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633284+0000","last_change":"2024-04-03T03:38:28.725003+0000","last_active":"2024-04-03T05:10:58.633284+0000","last_peered":"2024-04-03T05:10:58.633284+0000","last_clean":"2024-04-03T05:10:58.633284+0000","last_became_active":"2024-04-03T03:38:28.724296+0000","last_became_peered":"2024-04-03T03:38:28.724296+0000","last_unstale":"2024-04-03T05:10:58.633284+0000","last_undegraded":"2024-04-03T05:10:58.633284+0000","last_fullsized":"2024-04-03T05:10:58.633284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:51:03.993282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'304","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.524060+0000","last_change":"2024-04-03T03:38:30.822164+0000","last_active":"2024-04-03T05:14:00.524060+0000","last_peered":"2024-04-03T05:14:00.524060+0000","last_clean":"2024-04-03T05:14:00.524060+0000","last_became_active":"2024-04-03T03:38:30.821335+0000","last_became_peered":"2024-04-03T03:38:30.821335+0000","last_unstale":"2024-04-03T05:14:00.524060+0000","last_undegraded":"2024-04-03T05:14:00.524060+0000","last_fullsized":"2024-04-03T05:14:00.524060+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:51:04.303948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":994,"num_write":396,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.836987+0000","last_change":"2024-04-03T03:38:32.731796+0000","last_active":"2024-04-03T05:10:57.836987+0000","last_peered":"2024-04-03T05:10:57.836987+0000","last_clean":"2024-04-03T05:10:57.836987+0000","last_became_active":"2024-04-03T03:38:32.730954+0000","last_became_peered":"2024-04-03T03:38:32.730954+0000","last_unstale":"2024-04-03T05:10:57.836987+0000","last_undegraded":"2024-04-03T05:10:57.836987+0000","last_fullsized":"2024-04-03T05:10:57.836987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:28.623155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'104","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.542084+0000","last_change":"2024-04-03T03:38:34.755793+0000","last_active":"2024-04-03T05:14:00.542084+0000","last_peered":"2024-04-03T05:14:00.542084+0000","last_clean":"2024-04-03T05:14:00.542084+0000","last_became_active":"2024-04-03T03:38:34.754544+0000","last_became_peered":"2024-04-03T03:38:34.754544+0000","last_unstale":"2024-04-03T05:14:00.542084+0000","last_undegraded":"2024-04-03T05:14:00.542084+0000","last_fullsized":"2024-04-03T05:14:00.542084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:02.640564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":262,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'316","reported_seq":1732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.824774+0000","last_change":"2024-04-03T03:38:26.721787+0000","last_active":"2024-04-03T05:10:57.824774+0000","last_peered":"2024-04-03T05:10:57.824774+0000","last_clean":"2024-04-03T05:10:57.824774+0000","last_became_active":"2024-04-03T03:38:26.720984+0000","last_became_peered":"2024-04-03T03:38:26.720984+0000","last_unstale":"2024-04-03T05:10:57.824774+0000","last_undegraded":"2024-04-03T05:10:57.824774+0000","last_fullsized":"2024-04-03T05:10:57.824774+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:26:13.345541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1783,"num_read_kb":1722,"num_write":353,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'310","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.031545+0000","last_change":"2024-04-03T03:38:24.745501+0000","last_active":"2024-04-03T05:14:08.031545+0000","last_peered":"2024-04-03T05:14:08.031545+0000","last_clean":"2024-04-03T05:14:08.031545+0000","last_became_active":"2024-04-03T03:38:24.745183+0000","last_became_peered":"2024-04-03T03:38:24.745183+0000","last_unstale":"2024-04-03T05:14:08.031545+0000","last_undegraded":"2024-04-03T05:14:08.031545+0000","last_fullsized":"2024-04-03T05:14:08.031545+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:07:38.812807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7909340,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":464,"num_read_kb":13372,"num_write":1226,"num_write_kb":33178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:02.838294+0000","last_change":"2024-04-03T03:38:28.711378+0000","last_active":"2024-04-03T05:11:02.838294+0000","last_peered":"2024-04-03T05:11:02.838294+0000","last_clean":"2024-04-03T05:11:02.838294+0000","last_became_active":"2024-04-03T03:38:28.710708+0000","last_became_peered":"2024-04-03T03:38:28.710708+0000","last_unstale":"2024-04-03T05:11:02.838294+0000","last_undegraded":"2024-04-03T05:11:02.838294+0000","last_fullsized":"2024-04-03T05:11:02.838294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:02.818218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'150","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.634475+0000","last_change":"2024-04-03T03:38:30.823215+0000","last_active":"2024-04-03T05:11:03.634475+0000","last_peered":"2024-04-03T05:11:03.634475+0000","last_clean":"2024-04-03T05:11:03.634475+0000","last_became_active":"2024-04-03T03:38:30.822452+0000","last_became_peered":"2024-04-03T03:38:30.822452+0000","last_unstale":"2024-04-03T05:11:03.634475+0000","last_undegraded":"2024-04-03T05:11:03.634475+0000","last_fullsized":"2024-04-03T05:11:03.634475+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:15:19.776214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":168,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'525","reported_seq":4604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.490669+0000","last_change":"2024-04-03T03:38:32.735340+0000","last_active":"2024-04-03T05:14:07.490669+0000","last_peered":"2024-04-03T05:14:07.490669+0000","last_clean":"2024-04-03T05:14:07.490669+0000","last_became_active":"2024-04-03T03:38:32.734617+0000","last_became_peered":"2024-04-03T03:38:32.734617+0000","last_unstale":"2024-04-03T05:14:07.490669+0000","last_undegraded":"2024-04-03T05:14:07.490669+0000","last_fullsized":"2024-04-03T05:14:07.490669+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:51:07.710407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'182","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:59.046748+0000","last_change":"2024-04-03T03:38:34.758091+0000","last_active":"2024-04-03T05:11:59.046748+0000","last_peered":"2024-04-03T05:11:59.046748+0000","last_clean":"2024-04-03T05:11:59.046748+0000","last_became_active":"2024-04-03T03:38:34.756694+0000","last_became_peered":"2024-04-03T03:38:34.756694+0000","last_unstale":"2024-04-03T05:11:59.046748+0000","last_undegraded":"2024-04-03T05:11:59.046748+0000","last_fullsized":"2024-04-03T05:11:59.046748+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:19:35.787478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":410,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'389","reported_seq":2026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633205+0000","last_change":"2024-04-03T03:38:26.745973+0000","last_active":"2024-04-03T05:10:58.633205+0000","last_peered":"2024-04-03T05:10:58.633205+0000","last_clean":"2024-04-03T05:10:58.633205+0000","last_became_active":"2024-04-03T03:38:26.744905+0000","last_became_peered":"2024-04-03T03:38:26.744905+0000","last_unstale":"2024-04-03T05:10:58.633205+0000","last_undegraded":"2024-04-03T05:10:58.633205+0000","last_fullsized":"2024-04-03T05:10:58.633205+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:28:50.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2315,"num_read_kb":2222,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.808422+0000","last_change":"2024-04-03T03:38:58.351960+0000","last_active":"2024-04-03T05:14:08.808422+0000","last_peered":"2024-04-03T05:14:08.808422+0000","last_clean":"2024-04-03T05:14:08.808422+0000","last_became_active":"2024-04-03T03:38:58.350828+0000","last_became_peered":"2024-04-03T03:38:58.350828+0000","last_unstale":"2024-04-03T05:14:08.808422+0000","last_undegraded":"2024-04-03T05:14:08.808422+0000","last_fullsized":"2024-04-03T05:14:08.808422+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:36:44.987003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10752549,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":500,"num_read_kb":21295,"num_write":1260,"num_write_kb":30213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:59.033276+0000","last_change":"2024-04-03T03:38:28.727247+0000","last_active":"2024-04-03T05:10:59.033276+0000","last_peered":"2024-04-03T05:10:59.033276+0000","last_clean":"2024-04-03T05:10:59.033276+0000","last_became_active":"2024-04-03T03:38:28.726412+0000","last_became_peered":"2024-04-03T03:38:28.726412+0000","last_unstale":"2024-04-03T05:10:59.033276+0000","last_undegraded":"2024-04-03T05:10:59.033276+0000","last_fullsized":"2024-04-03T05:10:59.033276+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:55:21.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'377","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.822893+0000","last_change":"2024-04-03T03:38:30.722458+0000","last_active":"2024-04-03T05:14:07.822893+0000","last_peered":"2024-04-03T05:14:07.822893+0000","last_clean":"2024-04-03T05:14:07.822893+0000","last_became_active":"2024-04-03T03:38:30.721642+0000","last_became_peered":"2024-04-03T03:38:30.721642+0000","last_unstale":"2024-04-03T05:14:07.822893+0000","last_undegraded":"2024-04-03T05:14:07.822893+0000","last_fullsized":"2024-04-03T05:14:07.822893+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:55:24.375134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44870,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":590,"num_read_kb":1131,"num_write":454,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.052159+0000","last_change":"2024-04-03T03:38:32.740223+0000","last_active":"2024-04-03T05:10:23.052159+0000","last_peered":"2024-04-03T05:10:23.052159+0000","last_clean":"2024-04-03T05:10:23.052159+0000","last_became_active":"2024-04-03T03:38:32.739496+0000","last_became_peered":"2024-04-03T03:38:32.739496+0000","last_unstale":"2024-04-03T05:10:23.052159+0000","last_undegraded":"2024-04-03T05:10:23.052159+0000","last_fullsized":"2024-04-03T05:10:23.052159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:01:28.964739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'91","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026574+0000","last_change":"2024-04-03T03:38:34.751547+0000","last_active":"2024-04-03T05:10:29.026574+0000","last_peered":"2024-04-03T05:10:29.026574+0000","last_clean":"2024-04-03T05:10:29.026574+0000","last_became_active":"2024-04-03T03:38:34.751005+0000","last_became_peered":"2024-04-03T03:38:34.751005+0000","last_unstale":"2024-04-03T05:10:29.026574+0000","last_undegraded":"2024-04-03T05:10:29.026574+0000","last_fullsized":"2024-04-03T05:10:29.026574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:21.830655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":214,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'780","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.458352+0000","last_change":"2024-04-03T03:38:26.745971+0000","last_active":"2024-04-03T05:11:08.458352+0000","last_peered":"2024-04-03T05:11:08.458352+0000","last_clean":"2024-04-03T05:11:08.458352+0000","last_became_active":"2024-04-03T03:38:26.745135+0000","last_became_peered":"2024-04-03T03:38:26.745135+0000","last_unstale":"2024-04-03T05:11:08.458352+0000","last_undegraded":"2024-04-03T05:11:08.458352+0000","last_fullsized":"2024-04-03T05:11:08.458352+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:10.552726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3471,"num_read_kb":3079,"num_write":1070,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'252","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.781535+0000","last_change":"2024-04-03T03:38:24.744318+0000","last_active":"2024-04-03T05:14:08.781535+0000","last_peered":"2024-04-03T05:14:08.781535+0000","last_clean":"2024-04-03T05:14:08.781535+0000","last_became_active":"2024-04-03T03:38:24.743710+0000","last_became_peered":"2024-04-03T03:38:24.743710+0000","last_unstale":"2024-04-03T05:14:08.781535+0000","last_undegraded":"2024-04-03T05:14:08.781535+0000","last_fullsized":"2024-04-03T05:14:08.781535+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:21.325257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828727,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":374,"num_read_kb":32345,"num_write":985,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.827699+0000","last_change":"2024-04-03T03:38:28.732955+0000","last_active":"2024-04-03T05:10:58.827699+0000","last_peered":"2024-04-03T05:10:58.827699+0000","last_clean":"2024-04-03T05:10:58.827699+0000","last_became_active":"2024-04-03T03:38:28.731547+0000","last_became_peered":"2024-04-03T03:38:28.731547+0000","last_unstale":"2024-04-03T05:10:58.827699+0000","last_undegraded":"2024-04-03T05:10:58.827699+0000","last_fullsized":"2024-04-03T05:10:58.827699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:15:17.819800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'314","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.941454+0000","last_change":"2024-04-03T03:38:30.733183+0000","last_active":"2024-04-03T05:14:07.941454+0000","last_peered":"2024-04-03T05:14:07.941454+0000","last_clean":"2024-04-03T05:14:07.941454+0000","last_became_active":"2024-04-03T03:38:30.732095+0000","last_became_peered":"2024-04-03T03:38:30.732095+0000","last_unstale":"2024-04-03T05:14:07.941454+0000","last_undegraded":"2024-04-03T05:14:07.941454+0000","last_fullsized":"2024-04-03T05:14:07.941454+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:12:09.905056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1184,"num_write":416,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:44.003351+0000","last_change":"2024-04-03T03:38:32.744744+0000","last_active":"2024-04-03T05:10:44.003351+0000","last_peered":"2024-04-03T05:10:44.003351+0000","last_clean":"2024-04-03T05:10:44.003351+0000","last_became_active":"2024-04-03T03:38:32.743994+0000","last_became_peered":"2024-04-03T03:38:32.743994+0000","last_unstale":"2024-04-03T05:10:44.003351+0000","last_undegraded":"2024-04-03T05:10:44.003351+0000","last_fullsized":"2024-04-03T05:10:44.003351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:21:04.554872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'88","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.008492+0000","last_change":"2024-04-03T03:38:34.942097+0000","last_active":"2024-04-03T05:10:28.008492+0000","last_peered":"2024-04-03T05:10:28.008492+0000","last_clean":"2024-04-03T05:10:28.008492+0000","last_became_active":"2024-04-03T03:38:34.941122+0000","last_became_peered":"2024-04-03T03:38:34.941122+0000","last_unstale":"2024-04-03T05:10:28.008492+0000","last_undegraded":"2024-04-03T05:10:28.008492+0000","last_fullsized":"2024-04-03T05:10:28.008492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:35:17.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'825","reported_seq":2457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218515+0000","last_change":"2024-04-03T03:38:26.713100+0000","last_active":"2024-04-03T05:12:22.218515+0000","last_peered":"2024-04-03T05:12:22.218515+0000","last_clean":"2024-04-03T05:12:22.218515+0000","last_became_active":"2024-04-03T03:38:26.710804+0000","last_became_peered":"2024-04-03T03:38:26.710804+0000","last_unstale":"2024-04-03T05:12:22.218515+0000","last_undegraded":"2024-04-03T05:12:22.218515+0000","last_fullsized":"2024-04-03T05:12:22.218515+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:56:46.565815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3882,"num_read_kb":3472,"num_write":1106,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'300","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.934963+0000","last_change":"2024-04-03T03:38:24.727210+0000","last_active":"2024-04-03T05:14:07.934963+0000","last_peered":"2024-04-03T05:14:07.934963+0000","last_clean":"2024-04-03T05:14:07.934963+0000","last_became_active":"2024-04-03T03:38:24.726765+0000","last_became_peered":"2024-04-03T03:38:24.726765+0000","last_unstale":"2024-04-03T05:14:07.934963+0000","last_undegraded":"2024-04-03T05:14:07.934963+0000","last_fullsized":"2024-04-03T05:14:07.934963+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:44:40.435859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221133,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":474,"num_read_kb":31084,"num_write":1216,"num_write_kb":58109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.623953+0000","last_change":"2024-04-03T03:38:28.725916+0000","last_active":"2024-04-03T05:10:18.623953+0000","last_peered":"2024-04-03T05:10:18.623953+0000","last_clean":"2024-04-03T05:10:18.623953+0000","last_became_active":"2024-04-03T03:38:28.725139+0000","last_became_peered":"2024-04-03T03:38:28.725139+0000","last_unstale":"2024-04-03T05:10:18.623953+0000","last_undegraded":"2024-04-03T05:10:18.623953+0000","last_fullsized":"2024-04-03T05:10:18.623953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:05:50.849970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'255","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.517970+0000","last_change":"2024-04-03T03:38:30.721488+0000","last_active":"2024-04-03T05:14:00.517970+0000","last_peered":"2024-04-03T05:14:00.517970+0000","last_clean":"2024-04-03T05:14:00.517970+0000","last_became_active":"2024-04-03T03:38:30.719983+0000","last_became_peered":"2024-04-03T03:38:30.719983+0000","last_unstale":"2024-04-03T05:14:00.517970+0000","last_undegraded":"2024-04-03T05:14:00.517970+0000","last_fullsized":"2024-04-03T05:14:00.517970+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:30:54.735121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61822,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":951,"num_write":354,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.634346+0000","last_change":"2024-04-03T03:38:32.729151+0000","last_active":"2024-04-03T05:11:03.634346+0000","last_peered":"2024-04-03T05:11:03.634346+0000","last_clean":"2024-04-03T05:11:03.634346+0000","last_became_active":"2024-04-03T03:38:32.728438+0000","last_became_peered":"2024-04-03T03:38:32.728438+0000","last_unstale":"2024-04-03T05:11:03.634346+0000","last_undegraded":"2024-04-03T05:11:03.634346+0000","last_fullsized":"2024-04-03T05:11:03.634346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:14:01.189190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'136","reported_seq":1179,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.956146+0000","last_change":"2024-04-03T03:38:34.749288+0000","last_active":"2024-04-03T05:12:13.956146+0000","last_peered":"2024-04-03T05:12:13.956146+0000","last_clean":"2024-04-03T05:12:13.956146+0000","last_became_active":"2024-04-03T03:38:34.748329+0000","last_became_peered":"2024-04-03T03:38:34.748329+0000","last_unstale":"2024-04-03T05:12:13.956146+0000","last_undegraded":"2024-04-03T05:12:13.956146+0000","last_fullsized":"2024-04-03T05:12:13.956146+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:59:32.495711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":680,"num_read_kb":679,"num_write":303,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'715","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.623993+0000","last_change":"2024-04-03T03:38:26.746139+0000","last_active":"2024-04-03T05:10:18.623993+0000","last_peered":"2024-04-03T05:10:18.623993+0000","last_clean":"2024-04-03T05:10:18.623993+0000","last_became_active":"2024-04-03T03:38:26.742044+0000","last_became_peered":"2024-04-03T03:38:26.742044+0000","last_unstale":"2024-04-03T05:10:18.623993+0000","last_undegraded":"2024-04-03T05:10:18.623993+0000","last_fullsized":"2024-04-03T05:10:18.623993+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:54:05.286590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3199,"num_read_kb":2853,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'278","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.997908+0000","last_change":"2024-04-03T03:38:24.741033+0000","last_active":"2024-04-03T05:14:07.997908+0000","last_peered":"2024-04-03T05:14:07.997908+0000","last_clean":"2024-04-03T05:14:07.997908+0000","last_became_active":"2024-04-03T03:38:24.740329+0000","last_became_peered":"2024-04-03T03:38:24.740329+0000","last_unstale":"2024-04-03T05:14:07.997908+0000","last_undegraded":"2024-04-03T05:14:07.997908+0000","last_fullsized":"2024-04-03T05:14:07.997908+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:21.254706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10960120,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":422,"num_read_kb":56728,"num_write":1204,"num_write_kb":35698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830115+0000","last_change":"2024-04-03T03:38:28.726028+0000","last_active":"2024-04-03T05:10:47.830115+0000","last_peered":"2024-04-03T05:10:47.830115+0000","last_clean":"2024-04-03T05:10:47.830115+0000","last_became_active":"2024-04-03T03:38:28.725225+0000","last_became_peered":"2024-04-03T03:38:28.725225+0000","last_unstale":"2024-04-03T05:10:47.830115+0000","last_undegraded":"2024-04-03T05:10:47.830115+0000","last_fullsized":"2024-04-03T05:10:47.830115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:50:16.486831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'329","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.526781+0000","last_change":"2024-04-03T03:38:30.718060+0000","last_active":"2024-04-03T05:14:00.526781+0000","last_peered":"2024-04-03T05:14:00.526781+0000","last_clean":"2024-04-03T05:14:00.526781+0000","last_became_active":"2024-04-03T03:38:30.717323+0000","last_became_peered":"2024-04-03T03:38:30.717323+0000","last_unstale":"2024-04-03T05:14:00.526781+0000","last_undegraded":"2024-04-03T05:14:00.526781+0000","last_fullsized":"2024-04-03T05:14:00.526781+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:07:23.819748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50184,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":998,"num_write":410,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.061582+0000","last_change":"2024-04-03T03:38:32.743866+0000","last_active":"2024-04-03T05:11:03.061582+0000","last_peered":"2024-04-03T05:11:03.061582+0000","last_clean":"2024-04-03T05:11:03.061582+0000","last_became_active":"2024-04-03T03:38:32.743076+0000","last_became_peered":"2024-04-03T03:38:32.743076+0000","last_unstale":"2024-04-03T05:11:03.061582+0000","last_undegraded":"2024-04-03T05:11:03.061582+0000","last_fullsized":"2024-04-03T05:11:03.061582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:28:25.384912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'76","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.102158+0000","last_change":"2024-04-03T03:38:34.750455+0000","last_active":"2024-04-03T05:13:59.102158+0000","last_peered":"2024-04-03T05:13:59.102158+0000","last_clean":"2024-04-03T05:13:59.102158+0000","last_became_active":"2024-04-03T03:38:34.749644+0000","last_became_peered":"2024-04-03T03:38:34.749644+0000","last_unstale":"2024-04-03T05:13:59.102158+0000","last_undegraded":"2024-04-03T05:13:59.102158+0000","last_fullsized":"2024-04-03T05:13:59.102158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:17.219887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":90,"num_write":191,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'754","reported_seq":2410,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846312+0000","last_change":"2024-04-03T03:38:26.722653+0000","last_active":"2024-04-03T05:11:37.846312+0000","last_peered":"2024-04-03T05:11:37.846312+0000","last_clean":"2024-04-03T05:11:37.846312+0000","last_became_active":"2024-04-03T03:38:26.721951+0000","last_became_peered":"2024-04-03T03:38:26.721951+0000","last_unstale":"2024-04-03T05:11:37.846312+0000","last_undegraded":"2024-04-03T05:11:37.846312+0000","last_fullsized":"2024-04-03T05:11:37.846312+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:14:23.340976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3698,"num_read_kb":3347,"num_write":1000,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'271","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.960979+0000","last_change":"2024-04-03T03:38:24.742187+0000","last_active":"2024-04-03T05:14:08.960979+0000","last_peered":"2024-04-03T05:14:08.960979+0000","last_clean":"2024-04-03T05:14:08.960979+0000","last_became_active":"2024-04-03T03:38:24.741407+0000","last_became_peered":"2024-04-03T03:38:24.741407+0000","last_unstale":"2024-04-03T05:14:08.960979+0000","last_undegraded":"2024-04-03T05:14:08.960979+0000","last_fullsized":"2024-04-03T05:14:08.960979+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:44:29.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651184,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":385,"num_read_kb":24965,"num_write":1117,"num_write_kb":36078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1406","reported_seq":2747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846282+0000","last_change":"2024-04-03T03:38:26.719813+0000","last_active":"2024-04-03T05:11:37.846282+0000","last_peered":"2024-04-03T05:11:37.846282+0000","last_clean":"2024-04-03T05:11:37.846282+0000","last_became_active":"2024-04-03T03:38:26.719386+0000","last_became_peered":"2024-04-03T03:38:26.719386+0000","last_unstale":"2024-04-03T05:11:37.846282+0000","last_undegraded":"2024-04-03T05:11:37.846282+0000","last_fullsized":"2024-04-03T05:11:37.846282+0000","mapping_epoch":25,"log_start":"263'1300","ondisk_log_start":"263'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:39:04.440314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5587,"num_read_kb":4776,"num_write":2003,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'216","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:07.814009+0000","last_change":"2024-04-03T03:38:24.748771+0000","last_active":"2024-04-03T05:10:07.814009+0000","last_peered":"2024-04-03T05:10:07.814009+0000","last_clean":"2024-04-03T05:10:07.814009+0000","last_became_active":"2024-04-03T03:38:24.748369+0000","last_became_peered":"2024-04-03T03:38:24.748369+0000","last_unstale":"2024-04-03T05:10:07.814009+0000","last_undegraded":"2024-04-03T05:10:07.814009+0000","last_fullsized":"2024-04-03T05:10:07.814009+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:30:39.474530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6789502,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":372,"num_read_kb":45141,"num_write":967,"num_write_kb":24649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'761","reported_seq":2384,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.836588+0000","last_change":"2024-04-03T03:38:26.715097+0000","last_active":"2024-04-03T05:11:38.836588+0000","last_peered":"2024-04-03T05:11:38.836588+0000","last_clean":"2024-04-03T05:11:38.836588+0000","last_became_active":"2024-04-03T03:38:26.713821+0000","last_became_peered":"2024-04-03T03:38:26.713821+0000","last_unstale":"2024-04-03T05:11:38.836588+0000","last_undegraded":"2024-04-03T05:11:38.836588+0000","last_fullsized":"2024-04-03T05:11:38.836588+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:02:25.387554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3127,"num_write":983,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'316","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.816484+0000","last_change":"2024-04-03T03:38:24.741935+0000","last_active":"2024-04-03T05:14:08.816484+0000","last_peered":"2024-04-03T05:14:08.816484+0000","last_clean":"2024-04-03T05:14:08.816484+0000","last_became_active":"2024-04-03T03:38:24.741322+0000","last_became_peered":"2024-04-03T03:38:24.741322+0000","last_unstale":"2024-04-03T05:14:08.816484+0000","last_undegraded":"2024-04-03T05:14:08.816484+0000","last_fullsized":"2024-04-03T05:14:08.816484+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:47.935999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11128362,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":503,"num_read_kb":110805,"num_write":1171,"num_write_kb":46785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'793","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846165+0000","last_change":"2024-04-03T03:38:26.719415+0000","last_active":"2024-04-03T05:11:37.846165+0000","last_peered":"2024-04-03T05:11:37.846165+0000","last_clean":"2024-04-03T05:11:37.846165+0000","last_became_active":"2024-04-03T03:38:26.718895+0000","last_became_peered":"2024-04-03T03:38:26.718895+0000","last_unstale":"2024-04-03T05:11:37.846165+0000","last_undegraded":"2024-04-03T05:11:37.846165+0000","last_fullsized":"2024-04-03T05:11:37.846165+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:06:38.311692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3511,"num_read_kb":3115,"num_write":1065,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'317","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.995910+0000","last_change":"2024-04-03T03:38:58.351583+0000","last_active":"2024-04-03T05:14:07.995910+0000","last_peered":"2024-04-03T05:14:07.995910+0000","last_clean":"2024-04-03T05:14:07.995910+0000","last_became_active":"2024-04-03T03:38:58.349944+0000","last_became_peered":"2024-04-03T03:38:58.349944+0000","last_unstale":"2024-04-03T05:14:07.995910+0000","last_undegraded":"2024-04-03T05:14:07.995910+0000","last_fullsized":"2024-04-03T05:14:07.995910+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:01.822490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7433091,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":823,"num_read_kb":89019,"num_write":1324,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1190","reported_seq":2755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218508+0000","last_change":"2024-04-03T03:38:26.715473+0000","last_active":"2024-04-03T05:12:22.218508+0000","last_peered":"2024-04-03T05:12:22.218508+0000","last_clean":"2024-04-03T05:12:22.218508+0000","last_became_active":"2024-04-03T03:38:26.715042+0000","last_became_peered":"2024-04-03T03:38:26.715042+0000","last_unstale":"2024-04-03T05:12:22.218508+0000","last_undegraded":"2024-04-03T05:12:22.218508+0000","last_fullsized":"2024-04-03T05:12:22.218508+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:00.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5057,"num_read_kb":4409,"num_write":1655,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'243","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.932441+0000","last_change":"2024-04-03T03:38:58.351316+0000","last_active":"2024-04-03T05:14:07.932441+0000","last_peered":"2024-04-03T05:14:07.932441+0000","last_clean":"2024-04-03T05:14:07.932441+0000","last_became_active":"2024-04-03T03:38:58.350321+0000","last_became_peered":"2024-04-03T03:38:58.350321+0000","last_unstale":"2024-04-03T05:14:07.932441+0000","last_undegraded":"2024-04-03T05:14:07.932441+0000","last_fullsized":"2024-04-03T05:14:07.932441+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:29:08.087215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10015119,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":476,"num_read_kb":66631,"num_write":1027,"num_write_kb":28536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'742","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398107+0000","last_change":"2024-04-03T03:38:26.745737+0000","last_active":"2024-04-03T05:11:18.398107+0000","last_peered":"2024-04-03T05:11:18.398107+0000","last_clean":"2024-04-03T05:11:18.398107+0000","last_became_active":"2024-04-03T03:38:26.744330+0000","last_became_peered":"2024-04-03T03:38:26.744330+0000","last_unstale":"2024-04-03T05:11:18.398107+0000","last_undegraded":"2024-04-03T05:11:18.398107+0000","last_fullsized":"2024-04-03T05:11:18.398107+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:18:51.864453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3386,"num_read_kb":3032,"num_write":1008,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'272","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.742681+0000","last_change":"2024-04-03T03:38:24.708018+0000","last_active":"2024-04-03T05:14:07.742681+0000","last_peered":"2024-04-03T05:14:07.742681+0000","last_clean":"2024-04-03T05:14:07.742681+0000","last_became_active":"2024-04-03T03:38:24.707626+0000","last_became_peered":"2024-04-03T03:38:24.707626+0000","last_unstale":"2024-04-03T05:14:07.742681+0000","last_undegraded":"2024-04-03T05:14:07.742681+0000","last_fullsized":"2024-04-03T05:14:07.742681+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:55:34.304671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5727928,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":512,"num_read_kb":9989,"num_write":1250,"num_write_kb":25388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'423","reported_seq":1811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.229419+0000","last_change":"2024-04-03T03:38:26.726283+0000","last_active":"2024-04-03T05:10:55.229419+0000","last_peered":"2024-04-03T05:10:55.229419+0000","last_clean":"2024-04-03T05:10:55.229419+0000","last_became_active":"2024-04-03T03:38:26.725513+0000","last_became_peered":"2024-04-03T03:38:26.725513+0000","last_unstale":"2024-04-03T05:10:55.229419+0000","last_undegraded":"2024-04-03T05:10:55.229419+0000","last_fullsized":"2024-04-03T05:10:55.229419+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:40:24.269906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2235,"num_read_kb":2034,"num_write":556,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'241","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.987319+0000","last_change":"2024-04-03T03:38:24.749614+0000","last_active":"2024-04-03T05:14:08.987319+0000","last_peered":"2024-04-03T05:14:08.987319+0000","last_clean":"2024-04-03T05:14:08.987319+0000","last_became_active":"2024-04-03T03:38:24.748923+0000","last_became_peered":"2024-04-03T03:38:24.748923+0000","last_unstale":"2024-04-03T05:14:08.987319+0000","last_undegraded":"2024-04-03T05:14:08.987319+0000","last_fullsized":"2024-04-03T05:14:08.987319+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:57.601061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4531786,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":392,"num_read_kb":42672,"num_write":989,"num_write_kb":23960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'702","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.401427+0000","last_change":"2024-04-03T03:38:26.717032+0000","last_active":"2024-04-03T05:11:18.401427+0000","last_peered":"2024-04-03T05:11:18.401427+0000","last_clean":"2024-04-03T05:11:18.401427+0000","last_became_active":"2024-04-03T03:38:26.716359+0000","last_became_peered":"2024-04-03T03:38:26.716359+0000","last_unstale":"2024-04-03T05:11:18.401427+0000","last_undegraded":"2024-04-03T05:11:18.401427+0000","last_fullsized":"2024-04-03T05:11:18.401427+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:50:51.526153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3142,"num_read_kb":2808,"num_write":934,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'279","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.961213+0000","last_change":"2024-04-03T03:38:24.718541+0000","last_active":"2024-04-03T05:14:07.961213+0000","last_peered":"2024-04-03T05:14:07.961213+0000","last_clean":"2024-04-03T05:14:07.961213+0000","last_became_active":"2024-04-03T03:38:24.716473+0000","last_became_peered":"2024-04-03T03:38:24.716473+0000","last_unstale":"2024-04-03T05:14:07.961213+0000","last_undegraded":"2024-04-03T05:14:07.961213+0000","last_fullsized":"2024-04-03T05:14:07.961213+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:02.325821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15301456,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":410,"num_read_kb":31436,"num_write":1179,"num_write_kb":38562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'397","reported_seq":1846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.071686+0000","last_change":"2024-04-03T03:38:26.717644+0000","last_active":"2024-04-03T05:11:48.071686+0000","last_peered":"2024-04-03T05:11:48.071686+0000","last_clean":"2024-04-03T05:11:48.071686+0000","last_became_active":"2024-04-03T03:38:26.716435+0000","last_became_peered":"2024-04-03T03:38:26.716435+0000","last_unstale":"2024-04-03T05:11:48.071686+0000","last_undegraded":"2024-04-03T05:11:48.071686+0000","last_fullsized":"2024-04-03T05:11:48.071686+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:50.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2146,"num_read_kb":2018,"num_write":509,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'374","reported_seq":1170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.604819+0000","last_change":"2024-04-03T03:38:24.741361+0000","last_active":"2024-04-03T05:14:08.604819+0000","last_peered":"2024-04-03T05:14:08.604819+0000","last_clean":"2024-04-03T05:14:08.604819+0000","last_became_active":"2024-04-03T03:38:24.740664+0000","last_became_peered":"2024-04-03T03:38:24.740664+0000","last_unstale":"2024-04-03T05:14:08.604819+0000","last_undegraded":"2024-04-03T05:14:08.604819+0000","last_fullsized":"2024-04-03T05:14:08.604819+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:01:10.065790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17012494,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":875,"num_read_kb":68467,"num_write":1456,"num_write_kb":54703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'407","reported_seq":1976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193909+0000","last_change":"2024-04-03T03:38:26.752206+0000","last_active":"2024-04-03T05:13:59.193909+0000","last_peered":"2024-04-03T05:13:59.193909+0000","last_clean":"2024-04-03T05:13:59.193909+0000","last_became_active":"2024-04-03T03:38:26.751399+0000","last_became_peered":"2024-04-03T03:38:26.751399+0000","last_unstale":"2024-04-03T05:13:59.193909+0000","last_undegraded":"2024-04-03T05:13:59.193909+0000","last_fullsized":"2024-04-03T05:13:59.193909+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:42:54.446617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2116,"num_write":486,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'240","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.006131+0000","last_change":"2024-04-03T03:38:24.718194+0000","last_active":"2024-04-03T05:14:08.006131+0000","last_peered":"2024-04-03T05:14:08.006131+0000","last_clean":"2024-04-03T05:14:08.006131+0000","last_became_active":"2024-04-03T03:38:24.715106+0000","last_became_peered":"2024-04-03T03:38:24.715106+0000","last_unstale":"2024-04-03T05:14:08.006131+0000","last_undegraded":"2024-04-03T05:14:08.006131+0000","last_fullsized":"2024-04-03T05:14:08.006131+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:03:49.995783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2790114,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":368,"num_read_kb":15103,"num_write":911,"num_write_kb":22507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'628","reported_seq":2277,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.106774+0000","last_change":"2024-04-03T03:38:26.717354+0000","last_active":"2024-04-03T05:13:59.106774+0000","last_peered":"2024-04-03T05:13:59.106774+0000","last_clean":"2024-04-03T05:13:59.106774+0000","last_became_active":"2024-04-03T03:38:26.717085+0000","last_became_peered":"2024-04-03T03:38:26.717085+0000","last_unstale":"2024-04-03T05:13:59.106774+0000","last_undegraded":"2024-04-03T05:13:59.106774+0000","last_fullsized":"2024-04-03T05:13:59.106774+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:56.981338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3119,"num_read_kb":2815,"num_write":838,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'292","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.785889+0000","last_change":"2024-04-03T03:38:24.755928+0000","last_active":"2024-04-03T05:14:08.785889+0000","last_peered":"2024-04-03T05:14:08.785889+0000","last_clean":"2024-04-03T05:14:08.785889+0000","last_became_active":"2024-04-03T03:38:24.755345+0000","last_became_peered":"2024-04-03T03:38:24.755345+0000","last_unstale":"2024-04-03T05:14:08.785889+0000","last_undegraded":"2024-04-03T05:14:08.785889+0000","last_fullsized":"2024-04-03T05:14:08.785889+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:17:46.705832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12025105,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":423,"num_read_kb":14159,"num_write":1232,"num_write_kb":40251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'700","reported_seq":2138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.221367+0000","last_change":"2024-04-03T03:38:26.746104+0000","last_active":"2024-04-03T05:12:22.221367+0000","last_peered":"2024-04-03T05:12:22.221367+0000","last_clean":"2024-04-03T05:12:22.221367+0000","last_became_active":"2024-04-03T03:38:26.745102+0000","last_became_peered":"2024-04-03T03:38:26.745102+0000","last_unstale":"2024-04-03T05:12:22.221367+0000","last_undegraded":"2024-04-03T05:12:22.221367+0000","last_fullsized":"2024-04-03T05:12:22.221367+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:13.112805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3146,"num_read_kb":2819,"num_write":922,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'304","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.085377+0000","last_change":"2024-04-03T03:38:24.729779+0000","last_active":"2024-04-03T05:14:08.085377+0000","last_peered":"2024-04-03T05:14:08.085377+0000","last_clean":"2024-04-03T05:14:08.085377+0000","last_became_active":"2024-04-03T03:38:24.729149+0000","last_became_peered":"2024-04-03T03:38:24.729149+0000","last_unstale":"2024-04-03T05:14:08.085377+0000","last_undegraded":"2024-04-03T05:14:08.085377+0000","last_fullsized":"2024-04-03T05:14:08.085377+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:44:06.201753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7840929,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":482,"num_read_kb":15990,"num_write":1149,"num_write_kb":30672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'376","reported_seq":1992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:44.029877+0000","last_change":"2024-04-03T03:38:26.714537+0000","last_active":"2024-04-03T05:10:44.029877+0000","last_peered":"2024-04-03T05:10:44.029877+0000","last_clean":"2024-04-03T05:10:44.029877+0000","last_became_active":"2024-04-03T03:38:26.713796+0000","last_became_peered":"2024-04-03T03:38:26.713796+0000","last_unstale":"2024-04-03T05:10:44.029877+0000","last_undegraded":"2024-04-03T05:10:44.029877+0000","last_fullsized":"2024-04-03T05:10:44.029877+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:36:53.201626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2155,"num_read_kb":2080,"num_write":414,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'257","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.903812+0000","last_change":"2024-04-03T03:38:24.750293+0000","last_active":"2024-04-03T05:14:08.903812+0000","last_peered":"2024-04-03T05:14:08.903812+0000","last_clean":"2024-04-03T05:14:08.903812+0000","last_became_active":"2024-04-03T03:38:24.749152+0000","last_became_peered":"2024-04-03T03:38:24.749152+0000","last_unstale":"2024-04-03T05:14:08.903812+0000","last_undegraded":"2024-04-03T05:14:08.903812+0000","last_fullsized":"2024-04-03T05:14:08.903812+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:48:44.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19277263,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":341,"num_read_kb":32536,"num_write":1004,"num_write_kb":42333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1009","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056540+0000","last_change":"2024-04-03T03:38:26.729663+0000","last_active":"2024-04-03T05:10:43.056540+0000","last_peered":"2024-04-03T05:10:43.056540+0000","last_clean":"2024-04-03T05:10:43.056540+0000","last_became_active":"2024-04-03T03:38:26.729124+0000","last_became_peered":"2024-04-03T03:38:26.729124+0000","last_unstale":"2024-04-03T05:10:43.056540+0000","last_undegraded":"2024-04-03T05:10:43.056540+0000","last_fullsized":"2024-04-03T05:10:43.056540+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":900,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:12:50.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4687,"num_read_kb":4082,"num_write":1459,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'307","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.827813+0000","last_change":"2024-04-03T03:38:24.732372+0000","last_active":"2024-04-03T05:14:08.827813+0000","last_peered":"2024-04-03T05:14:08.827813+0000","last_clean":"2024-04-03T05:14:08.827813+0000","last_became_active":"2024-04-03T03:38:24.731586+0000","last_became_peered":"2024-04-03T03:38:24.731586+0000","last_unstale":"2024-04-03T05:14:08.827813+0000","last_undegraded":"2024-04-03T05:14:08.827813+0000","last_fullsized":"2024-04-03T05:14:08.827813+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:34:38.457730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21457510,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":515,"num_read_kb":86610,"num_write":1353,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'364","reported_seq":1859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218422+0000","last_change":"2024-04-03T03:38:26.728365+0000","last_active":"2024-04-03T05:12:22.218422+0000","last_peered":"2024-04-03T05:12:22.218422+0000","last_clean":"2024-04-03T05:12:22.218422+0000","last_became_active":"2024-04-03T03:38:26.728070+0000","last_became_peered":"2024-04-03T03:38:26.728070+0000","last_unstale":"2024-04-03T05:12:22.218422+0000","last_undegraded":"2024-04-03T05:12:22.218422+0000","last_fullsized":"2024-04-03T05:12:22.218422+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:38:42.073330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2004,"num_read_kb":1922,"num_write":414,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'295","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.850382+0000","last_change":"2024-04-03T03:38:24.726372+0000","last_active":"2024-04-03T05:14:07.850382+0000","last_peered":"2024-04-03T05:14:07.850382+0000","last_clean":"2024-04-03T05:14:07.850382+0000","last_became_active":"2024-04-03T03:38:24.725969+0000","last_became_peered":"2024-04-03T03:38:24.725969+0000","last_unstale":"2024-04-03T05:14:07.850382+0000","last_undegraded":"2024-04-03T05:14:07.850382+0000","last_fullsized":"2024-04-03T05:14:07.850382+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:29:30.307028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6802328,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":481,"num_read_kb":62664,"num_write":1225,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'466","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:25.900290+0000","last_change":"2024-04-03T03:38:26.706006+0000","last_active":"2024-04-03T05:10:25.900290+0000","last_peered":"2024-04-03T05:10:25.900290+0000","last_clean":"2024-04-03T05:10:25.900290+0000","last_became_active":"2024-04-03T03:38:26.705142+0000","last_became_peered":"2024-04-03T03:38:26.705142+0000","last_unstale":"2024-04-03T05:10:25.900290+0000","last_undegraded":"2024-04-03T05:10:25.900290+0000","last_fullsized":"2024-04-03T05:10:25.900290+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:12.955466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2439,"num_read_kb":2283,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'263","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.870472+0000","last_change":"2024-04-03T03:38:24.749516+0000","last_active":"2024-04-03T05:14:08.870472+0000","last_peered":"2024-04-03T05:14:08.870472+0000","last_clean":"2024-04-03T05:14:08.870472+0000","last_became_active":"2024-04-03T03:38:24.748843+0000","last_became_peered":"2024-04-03T03:38:24.748843+0000","last_unstale":"2024-04-03T05:14:08.870472+0000","last_undegraded":"2024-04-03T05:14:08.870472+0000","last_fullsized":"2024-04-03T05:14:08.870472+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:41.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8418163,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":349,"num_read_kb":1436,"num_write":1018,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'283","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.775983+0000","last_change":"2024-04-03T03:38:24.740753+0000","last_active":"2024-04-03T05:14:08.775983+0000","last_peered":"2024-04-03T05:14:08.775983+0000","last_clean":"2024-04-03T05:14:08.775983+0000","last_became_active":"2024-04-03T03:38:24.737358+0000","last_became_peered":"2024-04-03T03:38:24.737358+0000","last_unstale":"2024-04-03T05:14:08.775983+0000","last_undegraded":"2024-04-03T05:14:08.775983+0000","last_fullsized":"2024-04-03T05:14:08.775983+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:25:01.791092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16393155,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":501,"num_read_kb":13844,"num_write":1301,"num_write_kb":46293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'651","reported_seq":2338,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.282490+0000","last_change":"2024-04-03T03:38:26.718253+0000","last_active":"2024-04-03T05:11:29.282490+0000","last_peered":"2024-04-03T05:11:29.282490+0000","last_clean":"2024-04-03T05:11:29.282490+0000","last_became_active":"2024-04-03T03:38:26.717854+0000","last_became_peered":"2024-04-03T03:38:26.717854+0000","last_unstale":"2024-04-03T05:11:29.282490+0000","last_undegraded":"2024-04-03T05:11:29.282490+0000","last_fullsized":"2024-04-03T05:11:29.282490+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:22.381228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3358,"num_read_kb":3036,"num_write":900,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'338","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.865283+0000","last_change":"2024-04-03T03:38:24.730677+0000","last_active":"2024-04-03T05:14:07.865283+0000","last_peered":"2024-04-03T05:14:07.865283+0000","last_clean":"2024-04-03T05:14:07.865283+0000","last_became_active":"2024-04-03T03:38:24.730312+0000","last_became_peered":"2024-04-03T03:38:24.730312+0000","last_unstale":"2024-04-03T05:14:07.865283+0000","last_undegraded":"2024-04-03T05:14:07.865283+0000","last_fullsized":"2024-04-03T05:14:07.865283+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:20:55.022050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7090666,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":613,"num_read_kb":19035,"num_write":1362,"num_write_kb":53256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'683","reported_seq":2062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.282399+0000","last_change":"2024-04-03T03:38:26.728858+0000","last_active":"2024-04-03T05:11:29.282399+0000","last_peered":"2024-04-03T05:11:29.282399+0000","last_clean":"2024-04-03T05:11:29.282399+0000","last_became_active":"2024-04-03T03:38:26.728038+0000","last_became_peered":"2024-04-03T03:38:26.728038+0000","last_unstale":"2024-04-03T05:11:29.282399+0000","last_undegraded":"2024-04-03T05:11:29.282399+0000","last_fullsized":"2024-04-03T05:11:29.282399+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:28:43.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3172,"num_read_kb":2837,"num_write":928,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":84518868,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":145,"num_read_kb":195556,"num_write":157,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161701888,"data_stored":161697704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5643,"num_read_kb":4008,"num_write":2168,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1286,"ondisk_log_size":1286,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":11006,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":12265,"num_read_kb":12111,"num_write":14239,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":22012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2564,"ondisk_log_size":2564,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":361,"ondisk_log_size":361,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1769242,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19206,"num_read_kb":36149,"num_write":16215,"num_write_kb":11681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":2191952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1857,"ondisk_log_size":1857,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1711,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1602,"num_read_kb":1902,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":189133,"num_read_kb":172083,"num_write":51171,"num_write_kb":17715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4081,"ondisk_log_size":4081,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":634200549,"num_objects":3640,"num_object_clones":0,"num_object_copies":10920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3640,"num_whiteouts":0,"num_read":32102,"num_read_kb":2539869,"num_write":74744,"num_write_kb":2266597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1006366720,"data_stored":1006366720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4512,"ondisk_log_size":4512,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":80740352,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":157,"num_read_kb":216081,"num_write":162,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510599,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477660,"kb_used_data":179776,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":93894180,"statfs":{"total":96636764160,"available":96147640320,"internally_reserved":0,"allocated":184090624,"data_stored":181973565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":304871882},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510601,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476420,"kb_used_data":206412,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93895420,"statfs":{"total":96636764160,"available":96148910080,"internally_reserved":0,"allocated":211365888,"data_stored":209304721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510598,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280416,"kb_used_data":136760,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94091424,"statfs":{"total":96636764160,"available":96349618176,"internally_reserved":0,"allocated":140042240,"data_stored":137904487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510597,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308500,"kb_used_data":196808,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94063340,"statfs":{"total":96636764160,"available":96320860160,"internally_reserved":0,"allocated":201531392,"data_stored":199491573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114358727},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543304,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439176,"kb_used_data":213588,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93932664,"statfs":{"total":96636764160,"available":96187047936,"internally_reserved":0,"allocated":218714112,"data_stored":216602747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543304,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255684,"kb_used_data":170360,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94116156,"statfs":{"total":96636764160,"available":96374943744,"internally_reserved":0,"allocated":174448640,"data_stored":172419572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543301,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339028,"kb_used_data":185740,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94032812,"statfs":{"total":96636764160,"available":96289599488,"internally_reserved":0,"allocated":190197760,"data_stored":188124258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543302,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":464496,"kb_used_data":216744,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93907344,"statfs":{"total":96636764160,"available":96161120256,"internally_reserved":0,"allocated":221945856,"data_stored":219859320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":138227712,"data_stored":138227712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":141275136,"data_stored":141275136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":121327616,"data_stored":121327616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":124157952,"data_stored":124157952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":138371072,"data_stored":138371072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":103944192,"data_stored":103944192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":125714432,"data_stored":125714432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":113348608,"data_stored":113348608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":302707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":357174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":88997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":394256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":98433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":415861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":219065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":315459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":21019945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17874944,"data_stored":17874217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35188736,"data_stored":35187371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10022912,"data_stored":10021547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T05:14:12.251 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-03T05:14:12.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-03T05:14:12.613 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:14:12.624 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-03T05:14:12.628 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":3139,"stamp":"2024-04-03T05:14:12.527723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":801832096,"num_objects":4124,"num_object_clones":0,"num_object_copies":11888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4124,"num_whiteouts":0,"num_read":260377,"num_read_kb":3177867,"num_write":159049,"num_write_kb":2577746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":158,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14907,"ondisk_log_size":14907,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3041380,"kb_used_data":1506188,"kb_used_omap":12,"kb_used_meta":1534771,"kb_avail":751933340,"statfs":{"total":773094113280,"available":769979740160,"internally_reserved":0,"allocated":1542336512,"data_stored":1525680243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1571606067},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-168170241,"num_objects":-906,"num_object_clones":0,"num_object_copies":-2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-906,"num_whiteouts":0,"num_read":1219,"num_read_kb":1246,"num_write":984,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008576"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.638663+0000","last_change":"2024-04-03T04:18:51.297907+0000","last_active":"2024-04-03T05:11:23.638663+0000","last_peered":"2024-04-03T05:11:23.638663+0000","last_clean":"2024-04-03T05:11:23.638663+0000","last_became_active":"2024-04-03T04:18:51.297066+0000","last_became_peered":"2024-04-03T04:18:51.297066+0000","last_unstale":"2024-04-03T05:11:23.638663+0000","last_undegraded":"2024-04-03T05:11:23.638663+0000","last_fullsized":"2024-04-03T05:11:23.638663+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:40:36.577637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"258'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831108+0000","last_change":"2024-04-03T03:55:53.275728+0000","last_active":"2024-04-03T05:10:52.831108+0000","last_peered":"2024-04-03T05:10:52.831108+0000","last_clean":"2024-04-03T05:10:52.831108+0000","last_became_active":"2024-04-03T03:55:53.274262+0000","last_became_peered":"2024-04-03T03:55:53.274262+0000","last_unstale":"2024-04-03T05:10:52.831108+0000","last_undegraded":"2024-04-03T05:10:52.831108+0000","last_fullsized":"2024-04-03T05:10:52.831108+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:48:37.046795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'1","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:07.839562+0000","last_change":"2024-04-03T03:55:45.808629+0000","last_active":"2024-04-03T05:12:07.839562+0000","last_peered":"2024-04-03T05:12:07.839562+0000","last_clean":"2024-04-03T05:12:07.839562+0000","last_became_active":"2024-04-03T03:55:45.807880+0000","last_became_peered":"2024-04-03T03:55:45.807880+0000","last_unstale":"2024-04-03T05:12:07.839562+0000","last_undegraded":"2024-04-03T05:12:07.839562+0000","last_fullsized":"2024-04-03T05:12:07.839562+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:07:02.590954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"263'26","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.051193+0000","last_change":"2024-04-03T03:49:00.988224+0000","last_active":"2024-04-03T05:10:18.051193+0000","last_peered":"2024-04-03T05:10:18.051193+0000","last_clean":"2024-04-03T05:10:18.051193+0000","last_became_active":"2024-04-03T03:49:00.987495+0000","last_became_peered":"2024-04-03T03:49:00.987495+0000","last_unstale":"2024-04-03T05:10:18.051193+0000","last_undegraded":"2024-04-03T05:10:18.051193+0000","last_fullsized":"2024-04-03T05:10:18.051193+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:22:00.449054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":70,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.833310+0000","last_change":"2024-04-03T04:18:51.320955+0000","last_active":"2024-04-03T05:11:23.833310+0000","last_peered":"2024-04-03T05:11:23.833310+0000","last_clean":"2024-04-03T05:11:23.833310+0000","last_became_active":"2024-04-03T04:18:51.320118+0000","last_became_peered":"2024-04-03T04:18:51.320118+0000","last_unstale":"2024-04-03T05:11:23.833310+0000","last_undegraded":"2024-04-03T05:11:23.833310+0000","last_fullsized":"2024-04-03T05:11:23.833310+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:36:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014658+0000","last_change":"2024-04-03T03:55:53.242225+0000","last_active":"2024-04-03T05:10:53.014658+0000","last_peered":"2024-04-03T05:10:53.014658+0000","last_clean":"2024-04-03T05:10:53.014658+0000","last_became_active":"2024-04-03T03:55:53.238473+0000","last_became_peered":"2024-04-03T03:55:53.238473+0000","last_unstale":"2024-04-03T05:10:53.014658+0000","last_undegraded":"2024-04-03T05:10:53.014658+0000","last_fullsized":"2024-04-03T05:10:53.014658+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:31:29.585032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"258'3","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.058060+0000","last_change":"2024-04-03T03:55:45.833198+0000","last_active":"2024-04-03T05:10:48.058060+0000","last_peered":"2024-04-03T05:10:48.058060+0000","last_clean":"2024-04-03T05:10:48.058060+0000","last_became_active":"2024-04-03T03:55:45.831610+0000","last_became_peered":"2024-04-03T03:55:45.831610+0000","last_unstale":"2024-04-03T05:10:48.058060+0000","last_undegraded":"2024-04-03T05:10:48.058060+0000","last_fullsized":"2024-04-03T05:10:48.058060+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:02:23.178186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"263'35","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:28.066849+0000","last_change":"2024-04-03T03:49:00.989569+0000","last_active":"2024-04-03T05:11:28.066849+0000","last_peered":"2024-04-03T05:11:28.066849+0000","last_clean":"2024-04-03T05:11:28.066849+0000","last_became_active":"2024-04-03T03:49:00.988912+0000","last_became_peered":"2024-04-03T03:49:00.988912+0000","last_unstale":"2024-04-03T05:11:28.066849+0000","last_undegraded":"2024-04-03T05:11:28.066849+0000","last_fullsized":"2024-04-03T05:11:28.066849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:44:30.947197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.018230+0000","last_change":"2024-04-03T04:18:51.365311+0000","last_active":"2024-04-03T05:11:08.018230+0000","last_peered":"2024-04-03T05:11:08.018230+0000","last_clean":"2024-04-03T05:11:08.018230+0000","last_became_active":"2024-04-03T04:18:51.364557+0000","last_became_peered":"2024-04-03T04:18:51.364557+0000","last_unstale":"2024-04-03T05:11:08.018230+0000","last_undegraded":"2024-04-03T05:11:08.018230+0000","last_fullsized":"2024-04-03T05:11:08.018230+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:32:56.588645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.659100+0000","last_change":"2024-04-03T03:55:53.269902+0000","last_active":"2024-04-03T05:12:58.659100+0000","last_peered":"2024-04-03T05:12:58.659100+0000","last_clean":"2024-04-03T05:12:58.659100+0000","last_became_active":"2024-04-03T03:55:53.269276+0000","last_became_peered":"2024-04-03T03:55:53.269276+0000","last_unstale":"2024-04-03T05:12:58.659100+0000","last_undegraded":"2024-04-03T05:12:58.659100+0000","last_fullsized":"2024-04-03T05:12:58.659100+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:15:06.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'6","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013335+0000","last_change":"2024-04-03T03:55:45.823314+0000","last_active":"2024-04-03T05:10:48.013335+0000","last_peered":"2024-04-03T05:10:48.013335+0000","last_clean":"2024-04-03T05:10:48.013335+0000","last_became_active":"2024-04-03T03:55:45.822526+0000","last_became_peered":"2024-04-03T03:55:45.822526+0000","last_unstale":"2024-04-03T05:10:48.013335+0000","last_undegraded":"2024-04-03T05:10:48.013335+0000","last_fullsized":"2024-04-03T05:10:48.013335+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:47:58.846580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":12606,"num_write":11,"num_write_kb":9534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:34.041215+0000","last_change":"2024-04-03T03:49:00.993012+0000","last_active":"2024-04-03T05:11:34.041215+0000","last_peered":"2024-04-03T05:11:34.041215+0000","last_clean":"2024-04-03T05:11:34.041215+0000","last_became_active":"2024-04-03T03:49:00.992254+0000","last_became_peered":"2024-04-03T03:49:00.992254+0000","last_unstale":"2024-04-03T05:11:34.041215+0000","last_undegraded":"2024-04-03T05:11:34.041215+0000","last_fullsized":"2024-04-03T05:11:34.041215+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:16.501916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":101,"num_write":55,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060573+0000","last_change":"2024-04-03T04:18:51.373813+0000","last_active":"2024-04-03T05:10:58.060573+0000","last_peered":"2024-04-03T05:10:58.060573+0000","last_clean":"2024-04-03T05:10:58.060573+0000","last_became_active":"2024-04-03T04:18:51.373051+0000","last_became_peered":"2024-04-03T04:18:51.373051+0000","last_unstale":"2024-04-03T05:10:58.060573+0000","last_undegraded":"2024-04-03T05:10:58.060573+0000","last_fullsized":"2024-04-03T05:10:58.060573+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:25:49.915796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'1","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.815198+0000","last_change":"2024-04-03T03:55:53.276078+0000","last_active":"2024-04-03T05:10:12.815198+0000","last_peered":"2024-04-03T05:10:12.815198+0000","last_clean":"2024-04-03T05:10:12.815198+0000","last_became_active":"2024-04-03T03:55:53.274825+0000","last_became_peered":"2024-04-03T03:55:53.274825+0000","last_unstale":"2024-04-03T05:10:12.815198+0000","last_undegraded":"2024-04-03T05:10:12.815198+0000","last_fullsized":"2024-04-03T05:10:12.815198+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:54:31.500440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.057924+0000","last_change":"2024-04-03T03:55:45.810413+0000","last_active":"2024-04-03T05:10:48.057924+0000","last_peered":"2024-04-03T05:10:48.057924+0000","last_clean":"2024-04-03T05:10:48.057924+0000","last_became_active":"2024-04-03T03:55:45.809649+0000","last_became_peered":"2024-04-03T03:55:45.809649+0000","last_unstale":"2024-04-03T05:10:48.057924+0000","last_undegraded":"2024-04-03T05:10:48.057924+0000","last_fullsized":"2024-04-03T05:10:48.057924+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:07:31.286451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"263'106","reported_seq":376,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:32.844991+0000","last_change":"2024-04-03T03:49:00.991120+0000","last_active":"2024-04-03T05:11:32.844991+0000","last_peered":"2024-04-03T05:11:32.844991+0000","last_clean":"2024-04-03T05:11:32.844991+0000","last_became_active":"2024-04-03T03:49:00.990318+0000","last_became_peered":"2024-04-03T03:49:00.990318+0000","last_unstale":"2024-04-03T05:11:32.844991+0000","last_undegraded":"2024-04-03T05:11:32.844991+0000","last_fullsized":"2024-04-03T05:11:32.844991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:40:07.793280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":587,"num_read_kb":421,"num_write":142,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:38.988696+0000","last_change":"2024-04-03T04:18:51.317587+0000","last_active":"2024-04-03T05:09:38.988696+0000","last_peered":"2024-04-03T05:09:38.988696+0000","last_clean":"2024-04-03T05:09:38.988696+0000","last_became_active":"2024-04-03T04:18:51.316328+0000","last_became_peered":"2024-04-03T04:18:51.316328+0000","last_unstale":"2024-04-03T05:09:38.988696+0000","last_undegraded":"2024-04-03T05:09:38.988696+0000","last_fullsized":"2024-04-03T05:09:38.988696+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:59:54.383193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.950586+0000","last_change":"2024-04-03T03:55:53.252686+0000","last_active":"2024-04-03T05:14:07.950586+0000","last_peered":"2024-04-03T05:14:07.950586+0000","last_clean":"2024-04-03T05:14:07.950586+0000","last_became_active":"2024-04-03T03:55:53.251965+0000","last_became_peered":"2024-04-03T03:55:53.251965+0000","last_unstale":"2024-04-03T05:14:07.950586+0000","last_undegraded":"2024-04-03T05:14:07.950586+0000","last_fullsized":"2024-04-03T05:14:07.950586+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:11:31.485683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4667,"num_write":4,"num_write_kb":4667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:19.040963+0000","last_change":"2024-04-03T03:55:45.811812+0000","last_active":"2024-04-03T05:13:19.040963+0000","last_peered":"2024-04-03T05:13:19.040963+0000","last_clean":"2024-04-03T05:13:19.040963+0000","last_became_active":"2024-04-03T03:55:45.811051+0000","last_became_peered":"2024-04-03T03:55:45.811051+0000","last_unstale":"2024-04-03T05:13:19.040963+0000","last_undegraded":"2024-04-03T05:13:19.040963+0000","last_fullsized":"2024-04-03T05:13:19.040963+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:29:56.079808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"263'6","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:32.844932+0000","last_change":"2024-04-03T03:49:00.990124+0000","last_active":"2024-04-03T05:11:32.844932+0000","last_peered":"2024-04-03T05:11:32.844932+0000","last_clean":"2024-04-03T05:11:32.844932+0000","last_became_active":"2024-04-03T03:49:00.989383+0000","last_became_peered":"2024-04-03T03:49:00.989383+0000","last_unstale":"2024-04-03T05:11:32.844932+0000","last_undegraded":"2024-04-03T05:11:32.844932+0000","last_fullsized":"2024-04-03T05:11:32.844932+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:51:07.689068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:53.812847+0000","last_change":"2024-04-03T04:18:51.318126+0000","last_active":"2024-04-03T05:09:53.812847+0000","last_peered":"2024-04-03T05:09:53.812847+0000","last_clean":"2024-04-03T05:09:53.812847+0000","last_became_active":"2024-04-03T04:18:51.317417+0000","last_became_peered":"2024-04-03T04:18:51.317417+0000","last_unstale":"2024-04-03T05:09:53.812847+0000","last_undegraded":"2024-04-03T05:09:53.812847+0000","last_fullsized":"2024-04-03T05:09:53.812847+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:40:19.565316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"258'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.057729+0000","last_change":"2024-04-03T03:55:53.251802+0000","last_active":"2024-04-03T05:10:48.057729+0000","last_peered":"2024-04-03T05:10:48.057729+0000","last_clean":"2024-04-03T05:10:48.057729+0000","last_became_active":"2024-04-03T03:55:53.250769+0000","last_became_peered":"2024-04-03T03:55:53.250769+0000","last_unstale":"2024-04-03T05:10:48.057729+0000","last_undegraded":"2024-04-03T05:10:48.057729+0000","last_fullsized":"2024-04-03T05:10:48.057729+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:22:00.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013249+0000","last_change":"2024-04-03T03:55:45.821907+0000","last_active":"2024-04-03T05:10:48.013249+0000","last_peered":"2024-04-03T05:10:48.013249+0000","last_clean":"2024-04-03T05:10:48.013249+0000","last_became_active":"2024-04-03T03:55:45.821160+0000","last_became_peered":"2024-04-03T03:55:45.821160+0000","last_unstale":"2024-04-03T05:10:48.013249+0000","last_undegraded":"2024-04-03T05:10:48.013249+0000","last_fullsized":"2024-04-03T05:10:48.013249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:35:53.921787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"263'66","reported_seq":279,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:34.041123+0000","last_change":"2024-04-03T03:49:00.994955+0000","last_active":"2024-04-03T05:11:34.041123+0000","last_peered":"2024-04-03T05:11:34.041123+0000","last_clean":"2024-04-03T05:11:34.041123+0000","last_became_active":"2024-04-03T03:49:00.994321+0000","last_became_peered":"2024-04-03T03:49:00.994321+0000","last_unstale":"2024-04-03T05:11:34.041123+0000","last_undegraded":"2024-04-03T05:11:34.041123+0000","last_fullsized":"2024-04-03T05:11:34.041123+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:04:59.985722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":300,"num_write":80,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.021856+0000","last_change":"2024-04-03T04:18:51.312623+0000","last_active":"2024-04-03T05:11:23.021856+0000","last_peered":"2024-04-03T05:11:23.021856+0000","last_clean":"2024-04-03T05:11:23.021856+0000","last_became_active":"2024-04-03T04:18:51.311870+0000","last_became_peered":"2024-04-03T04:18:51.311870+0000","last_unstale":"2024-04-03T05:11:23.021856+0000","last_undegraded":"2024-04-03T05:11:23.021856+0000","last_fullsized":"2024-04-03T05:11:23.021856+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:38:54.851895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.059027+0000","last_change":"2024-04-03T03:55:53.242608+0000","last_active":"2024-04-03T05:10:53.059027+0000","last_peered":"2024-04-03T05:10:53.059027+0000","last_clean":"2024-04-03T05:10:53.059027+0000","last_became_active":"2024-04-03T03:55:53.241200+0000","last_became_peered":"2024-04-03T03:55:53.241200+0000","last_unstale":"2024-04-03T05:10:53.059027+0000","last_undegraded":"2024-04-03T05:10:53.059027+0000","last_fullsized":"2024-04-03T05:10:53.059027+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:46:17.515799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'8","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.828861+0000","last_change":"2024-04-03T03:55:45.836536+0000","last_active":"2024-04-03T05:10:42.828861+0000","last_peered":"2024-04-03T05:10:42.828861+0000","last_clean":"2024-04-03T05:10:42.828861+0000","last_became_active":"2024-04-03T03:55:45.835828+0000","last_became_peered":"2024-04-03T03:55:45.835828+0000","last_unstale":"2024-04-03T05:10:42.828861+0000","last_undegraded":"2024-04-03T05:10:42.828861+0000","last_fullsized":"2024-04-03T05:10:42.828861+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:34:15.514688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291305,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":7,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"263'59","reported_seq":210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:33.023899+0000","last_change":"2024-04-03T03:49:00.989070+0000","last_active":"2024-04-03T05:11:33.023899+0000","last_peered":"2024-04-03T05:11:33.023899+0000","last_clean":"2024-04-03T05:11:33.023899+0000","last_became_active":"2024-04-03T03:49:00.988327+0000","last_became_peered":"2024-04-03T03:49:00.988327+0000","last_unstale":"2024-04-03T05:11:33.023899+0000","last_undegraded":"2024-04-03T05:11:33.023899+0000","last_fullsized":"2024-04-03T05:11:33.023899+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:24:56.998629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":175,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012373+0000","last_change":"2024-04-03T04:18:51.307288+0000","last_active":"2024-04-03T05:11:24.012373+0000","last_peered":"2024-04-03T05:11:24.012373+0000","last_clean":"2024-04-03T05:11:24.012373+0000","last_became_active":"2024-04-03T04:18:51.299249+0000","last_became_peered":"2024-04-03T04:18:51.299249+0000","last_unstale":"2024-04-03T05:11:24.012373+0000","last_undegraded":"2024-04-03T05:11:24.012373+0000","last_fullsized":"2024-04-03T05:11:24.012373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:30:50.463422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631815+0000","last_change":"2024-04-03T03:55:53.278378+0000","last_active":"2024-04-03T05:10:53.631815+0000","last_peered":"2024-04-03T05:10:53.631815+0000","last_clean":"2024-04-03T05:10:53.631815+0000","last_became_active":"2024-04-03T03:55:53.277505+0000","last_became_peered":"2024-04-03T03:55:53.277505+0000","last_unstale":"2024-04-03T05:10:53.631815+0000","last_undegraded":"2024-04-03T05:10:53.631815+0000","last_fullsized":"2024-04-03T05:10:53.631815+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:20:26.901761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"258'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062645+0000","last_change":"2024-04-03T03:55:45.820242+0000","last_active":"2024-04-03T05:11:08.062645+0000","last_peered":"2024-04-03T05:11:08.062645+0000","last_clean":"2024-04-03T05:11:08.062645+0000","last_became_active":"2024-04-03T03:55:45.811093+0000","last_became_peered":"2024-04-03T03:55:45.811093+0000","last_unstale":"2024-04-03T05:11:08.062645+0000","last_undegraded":"2024-04-03T05:11:08.062645+0000","last_fullsized":"2024-04-03T05:11:08.062645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:19:41.634825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:13.831105+0000","last_change":"2024-04-03T03:49:00.974095+0000","last_active":"2024-04-03T05:11:13.831105+0000","last_peered":"2024-04-03T05:11:13.831105+0000","last_clean":"2024-04-03T05:11:13.831105+0000","last_became_active":"2024-04-03T03:49:00.973216+0000","last_became_peered":"2024-04-03T03:49:00.973216+0000","last_unstale":"2024-04-03T05:11:13.831105+0000","last_undegraded":"2024-04-03T05:11:13.831105+0000","last_fullsized":"2024-04-03T05:11:13.831105+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:37:20.222939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"260'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056727+0000","last_change":"2024-04-03T04:19:00.383020+0000","last_active":"2024-04-03T05:10:43.056727+0000","last_peered":"2024-04-03T05:10:43.056727+0000","last_clean":"2024-04-03T05:10:43.056727+0000","last_became_active":"2024-04-03T04:19:00.377208+0000","last_became_peered":"2024-04-03T04:19:00.377208+0000","last_unstale":"2024-04-03T05:10:43.056727+0000","last_undegraded":"2024-04-03T05:10:43.056727+0000","last_fullsized":"2024-04-03T05:10:43.056727+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:44.601663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:14.063888+0000","last_change":"2024-04-03T03:55:53.258982+0000","last_active":"2024-04-03T05:13:14.063888+0000","last_peered":"2024-04-03T05:13:14.063888+0000","last_clean":"2024-04-03T05:13:14.063888+0000","last_became_active":"2024-04-03T03:55:53.258699+0000","last_became_peered":"2024-04-03T03:55:53.258699+0000","last_unstale":"2024-04-03T05:13:14.063888+0000","last_undegraded":"2024-04-03T05:13:14.063888+0000","last_fullsized":"2024-04-03T05:13:14.063888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:38:05.039097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'4","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.012109+0000","last_change":"2024-04-03T03:55:45.837044+0000","last_active":"2024-04-03T05:10:43.012109+0000","last_peered":"2024-04-03T05:10:43.012109+0000","last_clean":"2024-04-03T05:10:43.012109+0000","last_became_active":"2024-04-03T03:55:45.831660+0000","last_became_peered":"2024-04-03T03:55:45.831660+0000","last_unstale":"2024-04-03T05:10:43.012109+0000","last_undegraded":"2024-04-03T05:10:43.012109+0000","last_fullsized":"2024-04-03T05:10:43.012109+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:28:51.321618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5691,"num_write":4,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"263'39","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:14.010323+0000","last_change":"2024-04-03T03:49:00.969632+0000","last_active":"2024-04-03T05:11:14.010323+0000","last_peered":"2024-04-03T05:11:14.010323+0000","last_clean":"2024-04-03T05:11:14.010323+0000","last_became_active":"2024-04-03T03:49:00.968902+0000","last_became_peered":"2024-04-03T03:49:00.968902+0000","last_unstale":"2024-04-03T05:11:14.010323+0000","last_undegraded":"2024-04-03T05:11:14.010323+0000","last_fullsized":"2024-04-03T05:11:14.010323+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:23.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":106,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:37.996691+0000","last_change":"2024-04-03T04:18:51.368008+0000","last_active":"2024-04-03T05:09:37.996691+0000","last_peered":"2024-04-03T05:09:37.996691+0000","last_clean":"2024-04-03T05:09:37.996691+0000","last_became_active":"2024-04-03T04:18:51.367290+0000","last_became_peered":"2024-04-03T04:18:51.367290+0000","last_unstale":"2024-04-03T05:09:37.996691+0000","last_undegraded":"2024-04-03T05:09:37.996691+0000","last_fullsized":"2024-04-03T05:09:37.996691+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:43.727578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.827724+0000","last_change":"2024-04-03T03:55:53.249249+0000","last_active":"2024-04-03T05:10:58.827724+0000","last_peered":"2024-04-03T05:10:58.827724+0000","last_clean":"2024-04-03T05:10:58.827724+0000","last_became_active":"2024-04-03T03:55:53.247541+0000","last_became_peered":"2024-04-03T03:55:53.247541+0000","last_unstale":"2024-04-03T05:10:58.827724+0000","last_undegraded":"2024-04-03T05:10:58.827724+0000","last_fullsized":"2024-04-03T05:10:58.827724+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:08.778733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"258'4","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056828+0000","last_change":"2024-04-03T03:55:45.820738+0000","last_active":"2024-04-03T05:10:43.056828+0000","last_peered":"2024-04-03T05:10:43.056828+0000","last_clean":"2024-04-03T05:10:43.056828+0000","last_became_active":"2024-04-03T03:55:45.819664+0000","last_became_peered":"2024-04-03T03:55:45.819664+0000","last_unstale":"2024-04-03T05:10:43.056828+0000","last_undegraded":"2024-04-03T05:10:43.056828+0000","last_fullsized":"2024-04-03T05:10:43.056828+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:03:06.968618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"263'13","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.840880+0000","last_change":"2024-04-03T03:49:00.962589+0000","last_active":"2024-04-03T05:11:12.840880+0000","last_peered":"2024-04-03T05:11:12.840880+0000","last_clean":"2024-04-03T05:11:12.840880+0000","last_became_active":"2024-04-03T03:49:00.961782+0000","last_became_peered":"2024-04-03T03:49:00.961782+0000","last_unstale":"2024-04-03T05:11:12.840880+0000","last_undegraded":"2024-04-03T05:11:12.840880+0000","last_fullsized":"2024-04-03T05:11:12.840880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:41:35.535598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:38.614737+0000","last_change":"2024-04-03T04:18:51.305071+0000","last_active":"2024-04-03T05:09:38.614737+0000","last_peered":"2024-04-03T05:09:38.614737+0000","last_clean":"2024-04-03T05:09:38.614737+0000","last_became_active":"2024-04-03T04:18:51.304323+0000","last_became_peered":"2024-04-03T04:18:51.304323+0000","last_unstale":"2024-04-03T05:09:38.614737+0000","last_undegraded":"2024-04-03T05:09:38.614737+0000","last_fullsized":"2024-04-03T05:09:38.614737+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:18.815723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'8","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:13.091218+0000","last_change":"2024-04-03T03:55:53.260481+0000","last_active":"2024-04-03T05:13:13.091218+0000","last_peered":"2024-04-03T05:13:13.091218+0000","last_clean":"2024-04-03T05:13:13.091218+0000","last_became_active":"2024-04-03T03:55:53.255231+0000","last_became_peered":"2024-04-03T03:55:53.255231+0000","last_unstale":"2024-04-03T05:13:13.091218+0000","last_undegraded":"2024-04-03T05:13:13.091218+0000","last_fullsized":"2024-04-03T05:13:13.091218+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:02:58.467385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.031015+0000","last_change":"2024-04-03T03:55:45.830178+0000","last_active":"2024-04-03T05:10:49.031015+0000","last_peered":"2024-04-03T05:10:49.031015+0000","last_clean":"2024-04-03T05:10:49.031015+0000","last_became_active":"2024-04-03T03:55:45.829412+0000","last_became_peered":"2024-04-03T03:55:45.829412+0000","last_unstale":"2024-04-03T05:10:49.031015+0000","last_undegraded":"2024-04-03T05:10:49.031015+0000","last_fullsized":"2024-04-03T05:10:49.031015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:56.123646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"263'19","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.828392+0000","last_change":"2024-04-03T03:49:00.983727+0000","last_active":"2024-04-03T05:11:12.828392+0000","last_peered":"2024-04-03T05:11:12.828392+0000","last_clean":"2024-04-03T05:11:12.828392+0000","last_became_active":"2024-04-03T03:49:00.981577+0000","last_became_peered":"2024-04-03T03:49:00.981577+0000","last_unstale":"2024-04-03T05:11:12.828392+0000","last_undegraded":"2024-04-03T05:11:12.828392+0000","last_fullsized":"2024-04-03T05:11:12.828392+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:30.772410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:37.996724+0000","last_change":"2024-04-03T04:18:51.373777+0000","last_active":"2024-04-03T05:09:37.996724+0000","last_peered":"2024-04-03T05:09:37.996724+0000","last_clean":"2024-04-03T05:09:37.996724+0000","last_became_active":"2024-04-03T04:18:51.372963+0000","last_became_peered":"2024-04-03T04:18:51.372963+0000","last_unstale":"2024-04-03T05:09:37.996724+0000","last_undegraded":"2024-04-03T05:09:37.996724+0000","last_fullsized":"2024-04-03T05:09:37.996724+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:47:59.061915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.823126+0000","last_change":"2024-04-03T03:55:53.270124+0000","last_active":"2024-04-03T05:10:47.823126+0000","last_peered":"2024-04-03T05:10:47.823126+0000","last_clean":"2024-04-03T05:10:47.823126+0000","last_became_active":"2024-04-03T03:55:53.268903+0000","last_became_peered":"2024-04-03T03:55:53.268903+0000","last_unstale":"2024-04-03T05:10:47.823126+0000","last_undegraded":"2024-04-03T05:10:47.823126+0000","last_fullsized":"2024-04-03T05:10:47.823126+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:54.240436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'1","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.821604+0000","last_change":"2024-04-03T03:55:45.835558+0000","last_active":"2024-04-03T05:10:42.821604+0000","last_peered":"2024-04-03T05:10:42.821604+0000","last_clean":"2024-04-03T05:10:42.821604+0000","last_became_active":"2024-04-03T03:55:45.834865+0000","last_became_peered":"2024-04-03T03:55:45.834865+0000","last_unstale":"2024-04-03T05:10:42.821604+0000","last_undegraded":"2024-04-03T05:10:42.821604+0000","last_fullsized":"2024-04-03T05:10:42.821604+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:44:08.343281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"263'64","reported_seq":230,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:07.839335+0000","last_change":"2024-04-03T03:49:00.971740+0000","last_active":"2024-04-03T05:11:07.839335+0000","last_peered":"2024-04-03T05:11:07.839335+0000","last_clean":"2024-04-03T05:11:07.839335+0000","last_became_active":"2024-04-03T03:49:00.971042+0000","last_became_peered":"2024-04-03T03:49:00.971042+0000","last_unstale":"2024-04-03T05:11:07.839335+0000","last_undegraded":"2024-04-03T05:11:07.839335+0000","last_fullsized":"2024-04-03T05:11:07.839335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:27.210269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":214,"num_write":97,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.822413+0000","last_change":"2024-04-03T04:18:51.308665+0000","last_active":"2024-04-03T05:10:12.822413+0000","last_peered":"2024-04-03T05:10:12.822413+0000","last_clean":"2024-04-03T05:10:12.822413+0000","last_became_active":"2024-04-03T04:18:51.307933+0000","last_became_peered":"2024-04-03T04:18:51.307933+0000","last_unstale":"2024-04-03T05:10:12.822413+0000","last_undegraded":"2024-04-03T05:10:12.822413+0000","last_fullsized":"2024-04-03T05:10:12.822413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:40:38.179255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:33.009473+0000","last_change":"2024-04-03T03:55:53.267596+0000","last_active":"2024-04-03T05:10:33.009473+0000","last_peered":"2024-04-03T05:10:33.009473+0000","last_clean":"2024-04-03T05:10:33.009473+0000","last_became_active":"2024-04-03T03:55:53.266957+0000","last_became_peered":"2024-04-03T03:55:53.266957+0000","last_unstale":"2024-04-03T05:10:33.009473+0000","last_undegraded":"2024-04-03T05:10:33.009473+0000","last_fullsized":"2024-04-03T05:10:33.009473+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:59:34.273773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'1","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.053319+0000","last_change":"2024-04-03T03:55:45.830004+0000","last_active":"2024-04-03T05:10:28.053319+0000","last_peered":"2024-04-03T05:10:28.053319+0000","last_clean":"2024-04-03T05:10:28.053319+0000","last_became_active":"2024-04-03T03:55:45.829247+0000","last_became_peered":"2024-04-03T03:55:45.829247+0000","last_unstale":"2024-04-03T05:10:28.053319+0000","last_undegraded":"2024-04-03T05:10:28.053319+0000","last_fullsized":"2024-04-03T05:10:28.053319+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:09.809498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"263'66","reported_seq":227,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.821469+0000","last_change":"2024-04-03T03:49:00.991682+0000","last_active":"2024-04-03T05:10:42.821469+0000","last_peered":"2024-04-03T05:10:42.821469+0000","last_clean":"2024-04-03T05:10:42.821469+0000","last_became_active":"2024-04-03T03:49:00.990969+0000","last_became_peered":"2024-04-03T03:49:00.990969+0000","last_unstale":"2024-04-03T05:10:42.821469+0000","last_undegraded":"2024-04-03T05:10:42.821469+0000","last_fullsized":"2024-04-03T05:10:42.821469+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:40.104007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":193,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.822537+0000","last_change":"2024-04-03T04:18:51.311760+0000","last_active":"2024-04-03T05:10:12.822537+0000","last_peered":"2024-04-03T05:10:12.822537+0000","last_clean":"2024-04-03T05:10:12.822537+0000","last_became_active":"2024-04-03T04:18:51.310856+0000","last_became_peered":"2024-04-03T04:18:51.310856+0000","last_unstale":"2024-04-03T05:10:12.822537+0000","last_undegraded":"2024-04-03T05:10:12.822537+0000","last_fullsized":"2024-04-03T05:10:12.822537+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:51:40.696345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.657654+0000","last_change":"2024-04-03T03:55:53.241238+0000","last_active":"2024-04-03T05:12:53.657654+0000","last_peered":"2024-04-03T05:12:53.657654+0000","last_clean":"2024-04-03T05:12:53.657654+0000","last_became_active":"2024-04-03T03:55:53.240485+0000","last_became_peered":"2024-04-03T03:55:53.240485+0000","last_unstale":"2024-04-03T05:12:53.657654+0000","last_undegraded":"2024-04-03T05:12:53.657654+0000","last_fullsized":"2024-04-03T05:12:53.657654+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:01:44.348572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026394+0000","last_change":"2024-04-03T03:55:45.833791+0000","last_active":"2024-04-03T05:10:29.026394+0000","last_peered":"2024-04-03T05:10:29.026394+0000","last_clean":"2024-04-03T05:10:29.026394+0000","last_became_active":"2024-04-03T03:55:45.833049+0000","last_became_peered":"2024-04-03T03:55:45.833049+0000","last_unstale":"2024-04-03T05:10:29.026394+0000","last_undegraded":"2024-04-03T05:10:29.026394+0000","last_fullsized":"2024-04-03T05:10:29.026394+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:01:14.170475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"263'54","reported_seq":206,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.824123+0000","last_change":"2024-04-03T03:49:00.970056+0000","last_active":"2024-04-03T05:10:43.824123+0000","last_peered":"2024-04-03T05:10:43.824123+0000","last_clean":"2024-04-03T05:10:43.824123+0000","last_became_active":"2024-04-03T03:49:00.969239+0000","last_became_peered":"2024-04-03T03:49:00.969239+0000","last_unstale":"2024-04-03T05:10:43.824123+0000","last_undegraded":"2024-04-03T05:10:43.824123+0000","last_fullsized":"2024-04-03T05:10:43.824123+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:11:29.264574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":93,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.997173+0000","last_change":"2024-04-03T04:18:51.318533+0000","last_active":"2024-04-03T05:10:13.997173+0000","last_peered":"2024-04-03T05:10:13.997173+0000","last_clean":"2024-04-03T05:10:13.997173+0000","last_became_active":"2024-04-03T04:18:51.318231+0000","last_became_peered":"2024-04-03T04:18:51.318231+0000","last_unstale":"2024-04-03T05:10:13.997173+0000","last_undegraded":"2024-04-03T05:10:13.997173+0000","last_fullsized":"2024-04-03T05:10:13.997173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:52:18.856506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'1","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:33.821947+0000","last_change":"2024-04-03T03:55:53.279237+0000","last_active":"2024-04-03T05:10:33.821947+0000","last_peered":"2024-04-03T05:10:33.821947+0000","last_clean":"2024-04-03T05:10:33.821947+0000","last_became_active":"2024-04-03T03:55:53.278529+0000","last_became_peered":"2024-04-03T03:55:53.278529+0000","last_unstale":"2024-04-03T05:10:33.821947+0000","last_undegraded":"2024-04-03T05:10:33.821947+0000","last_fullsized":"2024-04-03T05:10:33.821947+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:28:45.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'1","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.008254+0000","last_change":"2024-04-03T03:55:45.821524+0000","last_active":"2024-04-03T05:10:28.008254+0000","last_peered":"2024-04-03T05:10:28.008254+0000","last_clean":"2024-04-03T05:10:28.008254+0000","last_became_active":"2024-04-03T03:55:45.820737+0000","last_became_peered":"2024-04-03T03:55:45.820737+0000","last_unstale":"2024-04-03T05:10:28.008254+0000","last_undegraded":"2024-04-03T05:10:28.008254+0000","last_fullsized":"2024-04-03T05:10:28.008254+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:34.782850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"263'71","reported_seq":249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.629354+0000","last_change":"2024-04-03T03:49:00.991967+0000","last_active":"2024-04-03T05:10:43.629354+0000","last_peered":"2024-04-03T05:10:43.629354+0000","last_clean":"2024-04-03T05:10:43.629354+0000","last_became_active":"2024-04-03T03:49:00.987062+0000","last_became_peered":"2024-04-03T03:49:00.987062+0000","last_unstale":"2024-04-03T05:10:43.629354+0000","last_undegraded":"2024-04-03T05:10:43.629354+0000","last_fullsized":"2024-04-03T05:10:43.629354+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:22.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":233,"num_write":115,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.004757+0000","last_change":"2024-04-03T04:18:51.320211+0000","last_active":"2024-04-03T05:10:13.004757+0000","last_peered":"2024-04-03T05:10:13.004757+0000","last_clean":"2024-04-03T05:10:13.004757+0000","last_became_active":"2024-04-03T04:18:51.319383+0000","last_became_peered":"2024-04-03T04:18:51.319383+0000","last_unstale":"2024-04-03T05:10:13.004757+0000","last_undegraded":"2024-04-03T05:10:13.004757+0000","last_fullsized":"2024-04-03T05:10:13.004757+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:36:49.544317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'8","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:34.001324+0000","last_change":"2024-04-03T03:55:53.280600+0000","last_active":"2024-04-03T05:10:34.001324+0000","last_peered":"2024-04-03T05:10:34.001324+0000","last_clean":"2024-04-03T05:10:34.001324+0000","last_became_active":"2024-04-03T03:55:53.279910+0000","last_became_peered":"2024-04-03T03:55:53.279910+0000","last_unstale":"2024-04-03T05:10:34.001324+0000","last_undegraded":"2024-04-03T05:10:34.001324+0000","last_fullsized":"2024-04-03T05:10:34.001324+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:59.801920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":17,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'6","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:48.656558+0000","last_change":"2024-04-03T03:55:45.841365+0000","last_active":"2024-04-03T05:12:48.656558+0000","last_peered":"2024-04-03T05:12:48.656558+0000","last_clean":"2024-04-03T05:12:48.656558+0000","last_became_active":"2024-04-03T03:55:45.840884+0000","last_became_peered":"2024-04-03T03:55:45.840884+0000","last_unstale":"2024-04-03T05:12:48.656558+0000","last_undegraded":"2024-04-03T05:12:48.656558+0000","last_fullsized":"2024-04-03T05:12:48.656558+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:16:08.781831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"263'34","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.011805+0000","last_change":"2024-04-03T03:49:00.967711+0000","last_active":"2024-04-03T05:10:43.011805+0000","last_peered":"2024-04-03T05:10:43.011805+0000","last_clean":"2024-04-03T05:10:43.011805+0000","last_became_active":"2024-04-03T03:49:00.966982+0000","last_became_peered":"2024-04-03T03:49:00.966982+0000","last_unstale":"2024-04-03T05:10:43.011805+0000","last_undegraded":"2024-04-03T05:10:43.011805+0000","last_fullsized":"2024-04-03T05:10:43.011805+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:56.610313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"261'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010784+0000","last_change":"2024-04-03T04:18:51.315214+0000","last_active":"2024-04-03T05:10:38.010784+0000","last_peered":"2024-04-03T05:10:38.010784+0000","last_clean":"2024-04-03T05:10:38.010784+0000","last_became_active":"2024-04-03T04:18:51.314416+0000","last_became_peered":"2024-04-03T04:18:51.314416+0000","last_unstale":"2024-04-03T05:10:38.010784+0000","last_undegraded":"2024-04-03T05:10:38.010784+0000","last_fullsized":"2024-04-03T05:10:38.010784+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:02.075238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'7","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:07.814110+0000","last_change":"2024-04-03T03:55:53.248818+0000","last_active":"2024-04-03T05:10:07.814110+0000","last_peered":"2024-04-03T05:10:07.814110+0000","last_clean":"2024-04-03T05:10:07.814110+0000","last_became_active":"2024-04-03T03:55:53.248092+0000","last_became_peered":"2024-04-03T03:55:53.248092+0000","last_unstale":"2024-04-03T05:10:07.814110+0000","last_undegraded":"2024-04-03T05:10:07.814110+0000","last_fullsized":"2024-04-03T05:10:07.814110+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:20:29.850186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"258'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.815188+0000","last_change":"2024-04-03T03:55:45.830497+0000","last_active":"2024-04-03T05:10:03.815188+0000","last_peered":"2024-04-03T05:10:03.815188+0000","last_clean":"2024-04-03T05:10:03.815188+0000","last_became_active":"2024-04-03T03:55:45.829835+0000","last_became_peered":"2024-04-03T03:55:45.829835+0000","last_unstale":"2024-04-03T05:10:03.815188+0000","last_undegraded":"2024-04-03T05:10:03.815188+0000","last_fullsized":"2024-04-03T05:10:03.815188+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:42.544072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"263'30","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.820973+0000","last_change":"2024-04-03T03:49:00.984614+0000","last_active":"2024-04-03T05:10:28.820973+0000","last_peered":"2024-04-03T05:10:28.820973+0000","last_clean":"2024-04-03T05:10:28.820973+0000","last_became_active":"2024-04-03T03:49:00.983761+0000","last_became_peered":"2024-04-03T03:49:00.983761+0000","last_unstale":"2024-04-03T05:10:28.820973+0000","last_undegraded":"2024-04-03T05:10:28.820973+0000","last_fullsized":"2024-04-03T05:10:28.820973+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:55:59.720764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010837+0000","last_change":"2024-04-03T04:18:51.320209+0000","last_active":"2024-04-03T05:10:38.010837+0000","last_peered":"2024-04-03T05:10:38.010837+0000","last_clean":"2024-04-03T05:10:38.010837+0000","last_became_active":"2024-04-03T04:18:51.319470+0000","last_became_peered":"2024-04-03T04:18:51.319470+0000","last_unstale":"2024-04-03T05:10:38.010837+0000","last_undegraded":"2024-04-03T05:10:38.010837+0000","last_fullsized":"2024-04-03T05:10:38.010837+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:33:04.413239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'7","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:24.052556+0000","last_change":"2024-04-03T03:55:53.258437+0000","last_active":"2024-04-03T05:12:24.052556+0000","last_peered":"2024-04-03T05:12:24.052556+0000","last_clean":"2024-04-03T05:12:24.052556+0000","last_became_active":"2024-04-03T03:55:53.257856+0000","last_became_peered":"2024-04-03T03:55:53.257856+0000","last_unstale":"2024-04-03T05:12:24.052556+0000","last_undegraded":"2024-04-03T05:12:24.052556+0000","last_fullsized":"2024-04-03T05:12:24.052556+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:11:30.203783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":16434,"num_write":11,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'11","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.007285+0000","last_change":"2024-04-03T03:55:45.835655+0000","last_active":"2024-04-03T05:10:23.007285+0000","last_peered":"2024-04-03T05:10:23.007285+0000","last_clean":"2024-04-03T05:10:23.007285+0000","last_became_active":"2024-04-03T03:55:45.829711+0000","last_became_peered":"2024-04-03T03:55:45.829711+0000","last_unstale":"2024-04-03T05:10:23.007285+0000","last_undegraded":"2024-04-03T05:10:23.007285+0000","last_fullsized":"2024-04-03T05:10:23.007285+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:48.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":19,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"263'38","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.995075+0000","last_change":"2024-04-03T03:49:00.987947+0000","last_active":"2024-04-03T05:10:03.995075+0000","last_peered":"2024-04-03T05:10:03.995075+0000","last_clean":"2024-04-03T05:10:03.995075+0000","last_became_active":"2024-04-03T03:49:00.987174+0000","last_became_peered":"2024-04-03T03:49:00.987174+0000","last_unstale":"2024-04-03T05:10:03.995075+0000","last_undegraded":"2024-04-03T05:10:03.995075+0000","last_fullsized":"2024-04-03T05:10:03.995075+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:24:58.481056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010877+0000","last_change":"2024-04-03T04:18:51.321162+0000","last_active":"2024-04-03T05:10:38.010877+0000","last_peered":"2024-04-03T05:10:38.010877+0000","last_clean":"2024-04-03T05:10:38.010877+0000","last_became_active":"2024-04-03T04:18:51.320359+0000","last_became_peered":"2024-04-03T04:18:51.320359+0000","last_unstale":"2024-04-03T05:10:38.010877+0000","last_undegraded":"2024-04-03T05:10:38.010877+0000","last_fullsized":"2024-04-03T05:10:38.010877+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:19:17.610665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"258'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:27.825755+0000","last_change":"2024-04-03T03:55:53.275336+0000","last_active":"2024-04-03T05:10:27.825755+0000","last_peered":"2024-04-03T05:10:27.825755+0000","last_clean":"2024-04-03T05:10:27.825755+0000","last_became_active":"2024-04-03T03:55:53.274653+0000","last_became_peered":"2024-04-03T03:55:53.274653+0000","last_unstale":"2024-04-03T05:10:27.825755+0000","last_undegraded":"2024-04-03T05:10:27.825755+0000","last_fullsized":"2024-04-03T05:10:27.825755+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:08:05.730323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.813033+0000","last_change":"2024-04-03T03:55:45.832909+0000","last_active":"2024-04-03T05:10:02.813033+0000","last_peered":"2024-04-03T05:10:02.813033+0000","last_clean":"2024-04-03T05:10:02.813033+0000","last_became_active":"2024-04-03T03:55:45.832127+0000","last_became_peered":"2024-04-03T03:55:45.832127+0000","last_unstale":"2024-04-03T05:10:02.813033+0000","last_undegraded":"2024-04-03T05:10:02.813033+0000","last_fullsized":"2024-04-03T05:10:02.813033+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:03:14.969466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"263'16","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.620556+0000","last_change":"2024-04-03T03:49:00.992325+0000","last_active":"2024-04-03T05:10:03.620556+0000","last_peered":"2024-04-03T05:10:03.620556+0000","last_clean":"2024-04-03T05:10:03.620556+0000","last_became_active":"2024-04-03T03:49:00.987993+0000","last_became_peered":"2024-04-03T03:49:00.987993+0000","last_unstale":"2024-04-03T05:10:03.620556+0000","last_undegraded":"2024-04-03T05:10:03.620556+0000","last_fullsized":"2024-04-03T05:10:03.620556+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:47.291199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831156+0000","last_change":"2024-04-03T04:18:51.373972+0000","last_active":"2024-04-03T05:10:52.831156+0000","last_peered":"2024-04-03T05:10:52.831156+0000","last_clean":"2024-04-03T05:10:52.831156+0000","last_became_active":"2024-04-03T04:18:51.373189+0000","last_became_peered":"2024-04-03T04:18:51.373189+0000","last_unstale":"2024-04-03T05:10:52.831156+0000","last_undegraded":"2024-04-03T05:10:52.831156+0000","last_fullsized":"2024-04-03T05:10:52.831156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:58.064420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.045799+0000","last_change":"2024-04-03T03:55:53.244970+0000","last_active":"2024-04-03T05:10:08.045799+0000","last_peered":"2024-04-03T05:10:08.045799+0000","last_clean":"2024-04-03T05:10:08.045799+0000","last_became_active":"2024-04-03T03:55:53.243858+0000","last_became_peered":"2024-04-03T03:55:53.243858+0000","last_unstale":"2024-04-03T05:10:08.045799+0000","last_undegraded":"2024-04-03T05:10:08.045799+0000","last_fullsized":"2024-04-03T05:10:08.045799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:44:36.583585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'6","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.994992+0000","last_change":"2024-04-03T03:55:45.817717+0000","last_active":"2024-04-03T05:10:03.994992+0000","last_peered":"2024-04-03T05:10:03.994992+0000","last_clean":"2024-04-03T05:10:03.994992+0000","last_became_active":"2024-04-03T03:55:45.815910+0000","last_became_peered":"2024-04-03T03:55:45.815910+0000","last_unstale":"2024-04-03T05:10:03.994992+0000","last_undegraded":"2024-04-03T05:10:03.994992+0000","last_fullsized":"2024-04-03T05:10:03.994992+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:54:30.857141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":18434,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"263'51","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.815083+0000","last_change":"2024-04-03T03:49:00.966203+0000","last_active":"2024-04-03T05:10:03.815083+0000","last_peered":"2024-04-03T05:10:03.815083+0000","last_clean":"2024-04-03T05:10:03.815083+0000","last_became_active":"2024-04-03T03:49:00.965454+0000","last_became_peered":"2024-04-03T03:49:00.965454+0000","last_unstale":"2024-04-03T05:10:03.815083+0000","last_undegraded":"2024-04-03T05:10:03.815083+0000","last_fullsized":"2024-04-03T05:10:03.815083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:28.980846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":162,"num_write":91,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032020+0000","last_change":"2024-04-03T04:18:51.367810+0000","last_active":"2024-04-03T05:10:54.032020+0000","last_peered":"2024-04-03T05:10:54.032020+0000","last_clean":"2024-04-03T05:10:54.032020+0000","last_became_active":"2024-04-03T04:18:51.367071+0000","last_became_peered":"2024-04-03T04:18:51.367071+0000","last_unstale":"2024-04-03T05:10:54.032020+0000","last_undegraded":"2024-04-03T05:10:54.032020+0000","last_fullsized":"2024-04-03T05:10:54.032020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:36.487716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"258'2","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.847213+0000","last_change":"2024-04-03T03:55:53.265746+0000","last_active":"2024-04-03T05:11:42.847213+0000","last_peered":"2024-04-03T05:11:42.847213+0000","last_clean":"2024-04-03T05:11:42.847213+0000","last_became_active":"2024-04-03T03:55:53.265100+0000","last_became_peered":"2024-04-03T03:55:53.265100+0000","last_unstale":"2024-04-03T05:11:42.847213+0000","last_undegraded":"2024-04-03T05:11:42.847213+0000","last_fullsized":"2024-04-03T05:11:42.847213+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:30.419453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'5","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.045035+0000","last_change":"2024-04-03T03:55:45.823070+0000","last_active":"2024-04-03T05:14:09.045035+0000","last_peered":"2024-04-03T05:14:09.045035+0000","last_clean":"2024-04-03T05:14:09.045035+0000","last_became_active":"2024-04-03T03:55:45.822292+0000","last_became_peered":"2024-04-03T03:55:45.822292+0000","last_unstale":"2024-04-03T05:14:09.045035+0000","last_undegraded":"2024-04-03T05:14:09.045035+0000","last_fullsized":"2024-04-03T05:14:09.045035+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:18:47.010740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":5,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"263'28","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.820452+0000","last_change":"2024-04-03T03:49:00.981872+0000","last_active":"2024-04-03T05:10:02.820452+0000","last_peered":"2024-04-03T05:10:02.820452+0000","last_clean":"2024-04-03T05:10:02.820452+0000","last_became_active":"2024-04-03T03:49:00.981338+0000","last_became_peered":"2024-04-03T03:49:00.981338+0000","last_unstale":"2024-04-03T05:10:02.820452+0000","last_undegraded":"2024-04-03T05:10:02.820452+0000","last_fullsized":"2024-04-03T05:10:02.820452+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:55:28.926003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631722+0000","last_change":"2024-04-03T04:18:51.309156+0000","last_active":"2024-04-03T05:10:53.631722+0000","last_peered":"2024-04-03T05:10:53.631722+0000","last_clean":"2024-04-03T05:10:53.631722+0000","last_became_active":"2024-04-03T04:18:51.308461+0000","last_became_peered":"2024-04-03T04:18:51.308461+0000","last_unstale":"2024-04-03T05:10:53.631722+0000","last_undegraded":"2024-04-03T05:10:53.631722+0000","last_fullsized":"2024-04-03T05:10:53.631722+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:21.152603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.070316+0000","last_change":"2024-04-03T03:55:53.244597+0000","last_active":"2024-04-03T05:11:43.070316+0000","last_peered":"2024-04-03T05:11:43.070316+0000","last_clean":"2024-04-03T05:11:43.070316+0000","last_became_active":"2024-04-03T03:55:53.243822+0000","last_became_peered":"2024-04-03T03:55:53.243822+0000","last_unstale":"2024-04-03T05:11:43.070316+0000","last_undegraded":"2024-04-03T05:11:43.070316+0000","last_fullsized":"2024-04-03T05:11:43.070316+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:29.709703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'3","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.044433+0000","last_change":"2024-04-03T03:55:45.819884+0000","last_active":"2024-04-03T05:10:03.044433+0000","last_peered":"2024-04-03T05:10:03.044433+0000","last_clean":"2024-04-03T05:10:03.044433+0000","last_became_active":"2024-04-03T03:55:45.819117+0000","last_became_peered":"2024-04-03T03:55:45.819117+0000","last_unstale":"2024-04-03T05:10:03.044433+0000","last_undegraded":"2024-04-03T05:10:03.044433+0000","last_fullsized":"2024-04-03T05:10:03.044433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:34:21.679511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"263'9","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.835717+0000","last_change":"2024-04-03T03:49:00.992070+0000","last_active":"2024-04-03T05:11:47.835717+0000","last_peered":"2024-04-03T05:11:47.835717+0000","last_clean":"2024-04-03T05:11:47.835717+0000","last_became_active":"2024-04-03T03:49:00.991393+0000","last_became_peered":"2024-04-03T03:49:00.991393+0000","last_unstale":"2024-04-03T05:11:47.835717+0000","last_undegraded":"2024-04-03T05:11:47.835717+0000","last_fullsized":"2024-04-03T05:11:47.835717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:31.923155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:09.035711+0000","last_change":"2024-04-03T04:18:51.316420+0000","last_active":"2024-04-03T05:11:09.035711+0000","last_peered":"2024-04-03T05:11:09.035711+0000","last_clean":"2024-04-03T05:11:09.035711+0000","last_became_active":"2024-04-03T04:18:51.315679+0000","last_became_peered":"2024-04-03T04:18:51.315679+0000","last_unstale":"2024-04-03T05:11:09.035711+0000","last_undegraded":"2024-04-03T05:11:09.035711+0000","last_fullsized":"2024-04-03T05:11:09.035711+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:48:40.281554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"258'4","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.621671+0000","last_change":"2024-04-03T03:55:53.278183+0000","last_active":"2024-04-03T05:10:08.621671+0000","last_peered":"2024-04-03T05:10:08.621671+0000","last_clean":"2024-04-03T05:10:08.621671+0000","last_became_active":"2024-04-03T03:55:53.277402+0000","last_became_peered":"2024-04-03T03:55:53.277402+0000","last_unstale":"2024-04-03T05:10:08.621671+0000","last_undegraded":"2024-04-03T05:10:08.621671+0000","last_fullsized":"2024-04-03T05:10:08.621671+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:52:40.795096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":3,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'6","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.015463+0000","last_change":"2024-04-03T03:55:45.815042+0000","last_active":"2024-04-03T05:11:39.015463+0000","last_peered":"2024-04-03T05:11:39.015463+0000","last_clean":"2024-04-03T05:11:39.015463+0000","last_became_active":"2024-04-03T03:55:45.814319+0000","last_became_peered":"2024-04-03T03:55:45.814319+0000","last_unstale":"2024-04-03T05:11:39.015463+0000","last_undegraded":"2024-04-03T05:11:39.015463+0000","last_fullsized":"2024-04-03T05:11:39.015463+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:37.639076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"263'34","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.830330+0000","last_change":"2024-04-03T03:49:00.979853+0000","last_active":"2024-04-03T05:11:22.830330+0000","last_peered":"2024-04-03T05:11:22.830330+0000","last_clean":"2024-04-03T05:11:22.830330+0000","last_became_active":"2024-04-03T03:49:00.979122+0000","last_became_peered":"2024-04-03T03:49:00.979122+0000","last_unstale":"2024-04-03T05:11:22.830330+0000","last_undegraded":"2024-04-03T05:11:22.830330+0000","last_fullsized":"2024-04-03T05:11:22.830330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:05:49.282231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":103,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:37.827796+0000","last_change":"2024-04-03T04:18:51.318648+0000","last_active":"2024-04-03T05:10:37.827796+0000","last_peered":"2024-04-03T05:10:37.827796+0000","last_clean":"2024-04-03T05:10:37.827796+0000","last_became_active":"2024-04-03T04:18:51.318018+0000","last_became_peered":"2024-04-03T04:18:51.318018+0000","last_unstale":"2024-04-03T05:10:37.827796+0000","last_undegraded":"2024-04-03T05:10:37.827796+0000","last_fullsized":"2024-04-03T05:10:37.827796+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:37:23.498696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'6","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:58.043293+0000","last_change":"2024-04-03T03:55:53.255437+0000","last_active":"2024-04-03T05:09:58.043293+0000","last_peered":"2024-04-03T05:09:58.043293+0000","last_clean":"2024-04-03T05:09:58.043293+0000","last_became_active":"2024-04-03T03:55:53.254546+0000","last_became_peered":"2024-04-03T03:55:53.254546+0000","last_unstale":"2024-04-03T05:09:58.043293+0000","last_undegraded":"2024-04-03T05:09:58.043293+0000","last_fullsized":"2024-04-03T05:09:58.043293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:50:56.563374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"258'9","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.025293+0000","last_change":"2024-04-03T03:55:45.821106+0000","last_active":"2024-04-03T05:11:38.025293+0000","last_peered":"2024-04-03T05:11:38.025293+0000","last_clean":"2024-04-03T05:11:38.025293+0000","last_became_active":"2024-04-03T03:55:45.820294+0000","last_became_peered":"2024-04-03T03:55:45.820294+0000","last_unstale":"2024-04-03T05:11:38.025293+0000","last_undegraded":"2024-04-03T05:11:38.025293+0000","last_fullsized":"2024-04-03T05:11:38.025293+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:18:59.587447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18434,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"263'22","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012281+0000","last_change":"2024-04-03T03:49:00.980486+0000","last_active":"2024-04-03T05:11:24.012281+0000","last_peered":"2024-04-03T05:11:24.012281+0000","last_clean":"2024-04-03T05:11:24.012281+0000","last_became_active":"2024-04-03T03:49:00.979598+0000","last_became_peered":"2024-04-03T03:49:00.979598+0000","last_unstale":"2024-04-03T05:11:24.012281+0000","last_undegraded":"2024-04-03T05:11:24.012281+0000","last_fullsized":"2024-04-03T05:11:24.012281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:44:21.546630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":52,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060442+0000","last_change":"2024-04-03T04:18:51.367266+0000","last_active":"2024-04-03T05:10:58.060442+0000","last_peered":"2024-04-03T05:10:58.060442+0000","last_clean":"2024-04-03T05:10:58.060442+0000","last_became_active":"2024-04-03T04:18:51.366501+0000","last_became_peered":"2024-04-03T04:18:51.366501+0000","last_unstale":"2024-04-03T05:10:58.060442+0000","last_undegraded":"2024-04-03T05:10:58.060442+0000","last_fullsized":"2024-04-03T05:10:58.060442+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:54:14.385852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'9","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.828366+0000","last_change":"2024-04-03T03:55:53.268300+0000","last_active":"2024-04-03T05:11:12.828366+0000","last_peered":"2024-04-03T05:11:12.828366+0000","last_clean":"2024-04-03T05:11:12.828366+0000","last_became_active":"2024-04-03T03:55:53.266771+0000","last_became_peered":"2024-04-03T03:55:53.266771+0000","last_unstale":"2024-04-03T05:11:12.828366+0000","last_undegraded":"2024-04-03T05:11:12.828366+0000","last_fullsized":"2024-04-03T05:11:12.828366+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:55:16.846729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'2","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.015614+0000","last_change":"2024-04-03T03:55:45.837048+0000","last_active":"2024-04-03T05:11:39.015614+0000","last_peered":"2024-04-03T05:11:39.015614+0000","last_clean":"2024-04-03T05:11:39.015614+0000","last_became_active":"2024-04-03T03:55:45.836623+0000","last_became_peered":"2024-04-03T03:55:45.836623+0000","last_unstale":"2024-04-03T05:11:39.015614+0000","last_undegraded":"2024-04-03T05:11:39.015614+0000","last_fullsized":"2024-04-03T05:11:39.015614+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:50.851547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"263'70","reported_seq":234,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.830519+0000","last_change":"2024-04-03T03:49:00.982602+0000","last_active":"2024-04-03T05:11:22.830519+0000","last_peered":"2024-04-03T05:11:22.830519+0000","last_clean":"2024-04-03T05:11:22.830519+0000","last_became_active":"2024-04-03T03:49:00.978563+0000","last_became_peered":"2024-04-03T03:49:00.978563+0000","last_unstale":"2024-04-03T05:11:22.830519+0000","last_undegraded":"2024-04-03T05:11:22.830519+0000","last_fullsized":"2024-04-03T05:11:22.830519+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:33.306663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":197,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.064707+0000","last_change":"2024-04-03T04:18:51.311769+0000","last_active":"2024-04-03T05:11:18.064707+0000","last_peered":"2024-04-03T05:11:18.064707+0000","last_clean":"2024-04-03T05:11:18.064707+0000","last_became_active":"2024-04-03T04:18:51.311005+0000","last_became_peered":"2024-04-03T04:18:51.311005+0000","last_unstale":"2024-04-03T05:11:18.064707+0000","last_undegraded":"2024-04-03T05:11:18.064707+0000","last_fullsized":"2024-04-03T05:11:18.064707+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:05:36.093095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"258'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032168+0000","last_change":"2024-04-03T03:55:53.252248+0000","last_active":"2024-04-03T05:10:54.032168+0000","last_peered":"2024-04-03T05:10:54.032168+0000","last_clean":"2024-04-03T05:10:54.032168+0000","last_became_active":"2024-04-03T03:55:53.251863+0000","last_became_peered":"2024-04-03T03:55:53.251863+0000","last_unstale":"2024-04-03T05:10:54.032168+0000","last_undegraded":"2024-04-03T05:10:54.032168+0000","last_fullsized":"2024-04-03T05:10:54.032168+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:47:22.809184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.069140+0000","last_change":"2024-04-03T03:55:45.829280+0000","last_active":"2024-04-03T05:11:38.069140+0000","last_peered":"2024-04-03T05:11:38.069140+0000","last_clean":"2024-04-03T05:11:38.069140+0000","last_became_active":"2024-04-03T03:55:45.823003+0000","last_became_peered":"2024-04-03T03:55:45.823003+0000","last_unstale":"2024-04-03T05:11:38.069140+0000","last_undegraded":"2024-04-03T05:11:38.069140+0000","last_fullsized":"2024-04-03T05:11:38.069140+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:11:38.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"263'42","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.039050+0000","last_change":"2024-04-03T03:49:00.982818+0000","last_active":"2024-04-03T05:11:24.039050+0000","last_peered":"2024-04-03T05:11:24.039050+0000","last_clean":"2024-04-03T05:11:24.039050+0000","last_became_active":"2024-04-03T03:49:00.981940+0000","last_became_peered":"2024-04-03T03:49:00.981940+0000","last_unstale":"2024-04-03T05:11:24.039050+0000","last_undegraded":"2024-04-03T05:11:24.039050+0000","last_fullsized":"2024-04-03T05:11:24.039050+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:42:45.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"260'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631991+0000","last_change":"2024-04-03T04:18:51.302485+0000","last_active":"2024-04-03T05:10:53.631991+0000","last_peered":"2024-04-03T05:10:53.631991+0000","last_clean":"2024-04-03T05:10:53.631991+0000","last_became_active":"2024-04-03T04:18:51.301260+0000","last_became_peered":"2024-04-03T04:18:51.301260+0000","last_unstale":"2024-04-03T05:10:53.631991+0000","last_undegraded":"2024-04-03T05:10:53.631991+0000","last_fullsized":"2024-04-03T05:10:53.631991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:07.397862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'1","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:44.043459+0000","last_change":"2024-04-03T03:55:53.257731+0000","last_active":"2024-04-03T05:11:44.043459+0000","last_peered":"2024-04-03T05:11:44.043459+0000","last_clean":"2024-04-03T05:11:44.043459+0000","last_became_active":"2024-04-03T03:55:53.257421+0000","last_became_peered":"2024-04-03T03:55:53.257421+0000","last_unstale":"2024-04-03T05:11:44.043459+0000","last_undegraded":"2024-04-03T05:11:44.043459+0000","last_fullsized":"2024-04-03T05:11:44.043459+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:17.122324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830207+0000","last_change":"2024-04-03T03:55:45.822850+0000","last_active":"2024-04-03T05:10:47.830207+0000","last_peered":"2024-04-03T05:10:47.830207+0000","last_clean":"2024-04-03T05:10:47.830207+0000","last_became_active":"2024-04-03T03:55:45.822134+0000","last_became_peered":"2024-04-03T03:55:45.822134+0000","last_unstale":"2024-04-03T05:10:47.830207+0000","last_undegraded":"2024-04-03T05:10:47.830207+0000","last_fullsized":"2024-04-03T05:10:47.830207+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:51.265204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"263'37","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.824327+0000","last_change":"2024-04-03T03:49:00.990198+0000","last_active":"2024-04-03T05:10:43.824327+0000","last_peered":"2024-04-03T05:10:43.824327+0000","last_clean":"2024-04-03T05:10:43.824327+0000","last_became_active":"2024-04-03T03:49:00.989509+0000","last_became_peered":"2024-04-03T03:49:00.989509+0000","last_unstale":"2024-04-03T05:10:43.824327+0000","last_undegraded":"2024-04-03T05:10:43.824327+0000","last_fullsized":"2024-04-03T05:10:43.824327+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:47:32.824649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032254+0000","last_change":"2024-04-03T04:18:51.367656+0000","last_active":"2024-04-03T05:10:54.032254+0000","last_peered":"2024-04-03T05:10:54.032254+0000","last_clean":"2024-04-03T05:10:54.032254+0000","last_became_active":"2024-04-03T04:18:51.366898+0000","last_became_peered":"2024-04-03T04:18:51.366898+0000","last_unstale":"2024-04-03T05:10:54.032254+0000","last_undegraded":"2024-04-03T05:10:54.032254+0000","last_fullsized":"2024-04-03T05:10:54.032254+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:02:42.380567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.837650+0000","last_change":"2024-04-03T03:55:53.273186+0000","last_active":"2024-04-03T05:11:43.837650+0000","last_peered":"2024-04-03T05:11:43.837650+0000","last_clean":"2024-04-03T05:11:43.837650+0000","last_became_active":"2024-04-03T03:55:53.272757+0000","last_became_peered":"2024-04-03T03:55:53.272757+0000","last_unstale":"2024-04-03T05:11:43.837650+0000","last_undegraded":"2024-04-03T05:11:43.837650+0000","last_fullsized":"2024-04-03T05:11:43.837650+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:30:01.756534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:09.035840+0000","last_change":"2024-04-03T03:55:45.835017+0000","last_active":"2024-04-03T05:11:09.035840+0000","last_peered":"2024-04-03T05:11:09.035840+0000","last_clean":"2024-04-03T05:11:09.035840+0000","last_became_active":"2024-04-03T03:55:45.834364+0000","last_became_peered":"2024-04-03T03:55:45.834364+0000","last_unstale":"2024-04-03T05:11:09.035840+0000","last_undegraded":"2024-04-03T05:11:09.035840+0000","last_fullsized":"2024-04-03T05:11:09.035840+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:24:43.835815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"263'29","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:19.024038+0000","last_change":"2024-04-03T03:49:00.975429+0000","last_active":"2024-04-03T05:10:19.024038+0000","last_peered":"2024-04-03T05:10:19.024038+0000","last_clean":"2024-04-03T05:10:19.024038+0000","last_became_active":"2024-04-03T03:49:00.974654+0000","last_became_peered":"2024-04-03T03:49:00.974654+0000","last_unstale":"2024-04-03T05:10:19.024038+0000","last_undegraded":"2024-04-03T05:10:19.024038+0000","last_fullsized":"2024-04-03T05:10:19.024038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:46.921570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.829945+0000","last_change":"2024-04-03T04:18:51.323217+0000","last_active":"2024-04-03T05:11:08.829945+0000","last_peered":"2024-04-03T05:11:08.829945+0000","last_clean":"2024-04-03T05:11:08.829945+0000","last_became_active":"2024-04-03T04:18:51.322311+0000","last_became_peered":"2024-04-03T04:18:51.322311+0000","last_unstale":"2024-04-03T05:11:08.829945+0000","last_undegraded":"2024-04-03T05:11:08.829945+0000","last_fullsized":"2024-04-03T05:11:08.829945+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:50:12.059710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:59.060422+0000","last_change":"2024-04-03T03:55:53.256346+0000","last_active":"2024-04-03T05:12:59.060422+0000","last_peered":"2024-04-03T05:12:59.060422+0000","last_clean":"2024-04-03T05:12:59.060422+0000","last_became_active":"2024-04-03T03:55:53.255322+0000","last_became_peered":"2024-04-03T03:55:53.255322+0000","last_unstale":"2024-04-03T05:12:59.060422+0000","last_undegraded":"2024-04-03T05:12:59.060422+0000","last_fullsized":"2024-04-03T05:12:59.060422+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:09.641737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":90,"num_write":10,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'1","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.630607+0000","last_change":"2024-04-03T03:55:45.826097+0000","last_active":"2024-04-03T05:10:48.630607+0000","last_peered":"2024-04-03T05:10:48.630607+0000","last_clean":"2024-04-03T05:10:48.630607+0000","last_became_active":"2024-04-03T03:55:45.825324+0000","last_became_peered":"2024-04-03T03:55:45.825324+0000","last_unstale":"2024-04-03T05:10:48.630607+0000","last_undegraded":"2024-04-03T05:10:48.630607+0000","last_fullsized":"2024-04-03T05:10:48.630607+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:24.023966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"263'10","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.005883+0000","last_change":"2024-04-03T03:49:00.989237+0000","last_active":"2024-04-03T05:10:18.005883+0000","last_peered":"2024-04-03T05:10:18.005883+0000","last_clean":"2024-04-03T05:10:18.005883+0000","last_became_active":"2024-04-03T03:49:00.988511+0000","last_became_peered":"2024-04-03T03:49:00.988511+0000","last_unstale":"2024-04-03T05:10:18.005883+0000","last_undegraded":"2024-04-03T05:10:18.005883+0000","last_fullsized":"2024-04-03T05:10:18.005883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:30:04.122245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.836789+0000","last_change":"2024-04-03T04:18:51.311624+0000","last_active":"2024-04-03T05:10:57.836789+0000","last_peered":"2024-04-03T05:10:57.836789+0000","last_clean":"2024-04-03T05:10:57.836789+0000","last_became_active":"2024-04-03T04:18:51.310903+0000","last_became_peered":"2024-04-03T04:18:51.310903+0000","last_unstale":"2024-04-03T05:10:57.836789+0000","last_undegraded":"2024-04-03T05:10:57.836789+0000","last_fullsized":"2024-04-03T05:10:57.836789+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:16:43.080955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'3","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:14.050111+0000","last_change":"2024-04-03T03:55:53.249654+0000","last_active":"2024-04-03T05:12:14.050111+0000","last_peered":"2024-04-03T05:12:14.050111+0000","last_clean":"2024-04-03T05:12:14.050111+0000","last_became_active":"2024-04-03T03:55:53.248897+0000","last_became_peered":"2024-04-03T03:55:53.248897+0000","last_unstale":"2024-04-03T05:12:14.050111+0000","last_undegraded":"2024-04-03T05:12:14.050111+0000","last_fullsized":"2024-04-03T05:12:14.050111+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:46:01.196435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.825361+0000","last_change":"2024-04-03T03:55:45.823094+0000","last_active":"2024-04-03T05:10:48.825361+0000","last_peered":"2024-04-03T05:10:48.825361+0000","last_clean":"2024-04-03T05:10:48.825361+0000","last_became_active":"2024-04-03T03:55:45.822406+0000","last_became_peered":"2024-04-03T03:55:45.822406+0000","last_unstale":"2024-04-03T05:10:48.825361+0000","last_undegraded":"2024-04-03T05:10:48.825361+0000","last_fullsized":"2024-04-03T05:10:48.825361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:27:33.919111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"263'32","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.998233+0000","last_change":"2024-04-03T03:49:00.984263+0000","last_active":"2024-04-03T05:10:18.998233+0000","last_peered":"2024-04-03T05:10:18.998233+0000","last_clean":"2024-04-03T05:10:18.998233+0000","last_became_active":"2024-04-03T03:49:00.983502+0000","last_became_peered":"2024-04-03T03:49:00.983502+0000","last_unstale":"2024-04-03T05:10:18.998233+0000","last_undegraded":"2024-04-03T05:10:18.998233+0000","last_fullsized":"2024-04-03T05:10:18.998233+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:43:07.869966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":91,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633108+0000","last_change":"2024-04-03T04:18:51.320361+0000","last_active":"2024-04-03T05:10:58.633108+0000","last_peered":"2024-04-03T05:10:58.633108+0000","last_clean":"2024-04-03T05:10:58.633108+0000","last_became_active":"2024-04-03T04:18:51.319585+0000","last_became_peered":"2024-04-03T04:18:51.319585+0000","last_unstale":"2024-04-03T05:10:58.633108+0000","last_undegraded":"2024-04-03T05:10:58.633108+0000","last_fullsized":"2024-04-03T05:10:58.633108+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:06:53.044441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.005827+0000","last_change":"2024-04-03T03:55:53.254086+0000","last_active":"2024-04-03T05:10:54.005827+0000","last_peered":"2024-04-03T05:10:54.005827+0000","last_clean":"2024-04-03T05:10:54.005827+0000","last_became_active":"2024-04-03T03:55:53.253313+0000","last_became_peered":"2024-04-03T03:55:53.253313+0000","last_unstale":"2024-04-03T05:10:54.005827+0000","last_undegraded":"2024-04-03T05:10:54.005827+0000","last_fullsized":"2024-04-03T05:10:54.005827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:42:59.596779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'7","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.845635+0000","last_change":"2024-04-03T03:55:45.821498+0000","last_active":"2024-04-03T05:14:08.845635+0000","last_peered":"2024-04-03T05:14:08.845635+0000","last_clean":"2024-04-03T05:14:08.845635+0000","last_became_active":"2024-04-03T03:55:45.820786+0000","last_became_peered":"2024-04-03T03:55:45.820786+0000","last_unstale":"2024-04-03T05:14:08.845635+0000","last_undegraded":"2024-04-03T05:14:08.845635+0000","last_fullsized":"2024-04-03T05:14:08.845635+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:09:15.309227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":17,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"263'69","reported_seq":242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818307+0000","last_change":"2024-04-03T03:49:00.962192+0000","last_active":"2024-04-03T05:10:18.818307+0000","last_peered":"2024-04-03T05:10:18.818307+0000","last_clean":"2024-04-03T05:10:18.818307+0000","last_became_active":"2024-04-03T03:49:00.961318+0000","last_became_peered":"2024-04-03T03:49:00.961318+0000","last_unstale":"2024-04-03T05:10:18.818307+0000","last_undegraded":"2024-04-03T05:10:18.818307+0000","last_fullsized":"2024-04-03T05:10:18.818307+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:24:56.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":306,"num_read_kb":217,"num_write":109,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:59.007033+0000","last_change":"2024-04-03T04:18:51.318872+0000","last_active":"2024-04-03T05:10:59.007033+0000","last_peered":"2024-04-03T05:10:59.007033+0000","last_clean":"2024-04-03T05:10:59.007033+0000","last_became_active":"2024-04-03T04:18:51.318123+0000","last_became_peered":"2024-04-03T04:18:51.318123+0000","last_unstale":"2024-04-03T05:10:59.007033+0000","last_undegraded":"2024-04-03T05:10:59.007033+0000","last_fullsized":"2024-04-03T05:10:59.007033+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:43:45.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831053+0000","last_change":"2024-04-03T03:55:53.273476+0000","last_active":"2024-04-03T05:10:52.831053+0000","last_peered":"2024-04-03T05:10:52.831053+0000","last_clean":"2024-04-03T05:10:52.831053+0000","last_became_active":"2024-04-03T03:55:53.272979+0000","last_became_peered":"2024-04-03T03:55:53.272979+0000","last_unstale":"2024-04-03T05:10:52.831053+0000","last_undegraded":"2024-04-03T05:10:52.831053+0000","last_fullsized":"2024-04-03T05:10:52.831053+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:02:06.605755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"258'2","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.004446+0000","last_change":"2024-04-03T03:55:45.808103+0000","last_active":"2024-04-03T05:10:49.004446+0000","last_peered":"2024-04-03T05:10:49.004446+0000","last_clean":"2024-04-03T05:10:49.004446+0000","last_became_active":"2024-04-03T03:55:45.807410+0000","last_became_peered":"2024-04-03T03:55:45.807410+0000","last_unstale":"2024-04-03T05:10:49.004446+0000","last_undegraded":"2024-04-03T05:10:49.004446+0000","last_fullsized":"2024-04-03T05:10:49.004446+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:55:34.688567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"263'45","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:27.831292+0000","last_change":"2024-04-03T03:49:00.980550+0000","last_active":"2024-04-03T05:11:27.831292+0000","last_peered":"2024-04-03T05:11:27.831292+0000","last_clean":"2024-04-03T05:11:27.831292+0000","last_became_active":"2024-04-03T03:49:00.978547+0000","last_became_peered":"2024-04-03T03:49:00.978547+0000","last_unstale":"2024-04-03T05:11:27.831292+0000","last_undegraded":"2024-04-03T05:11:27.831292+0000","last_fullsized":"2024-04-03T05:11:27.831292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:02:28.324158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":127,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'369","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.876929+0000","last_change":"2024-04-03T03:38:24.754612+0000","last_active":"2024-04-03T05:14:08.876929+0000","last_peered":"2024-04-03T05:14:08.876929+0000","last_clean":"2024-04-03T05:14:08.876929+0000","last_became_active":"2024-04-03T03:38:24.753446+0000","last_became_peered":"2024-04-03T03:38:24.753446+0000","last_unstale":"2024-04-03T05:14:08.876929+0000","last_undegraded":"2024-04-03T05:14:08.876929+0000","last_fullsized":"2024-04-03T05:14:08.876929+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:22:38.341258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19563641,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":627,"num_read_kb":35431,"num_write":1329,"num_write_kb":27233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'364","reported_seq":1890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.373264+0000","last_change":"2024-04-03T03:38:26.751530+0000","last_active":"2024-04-03T05:11:12.373264+0000","last_peered":"2024-04-03T05:11:12.373264+0000","last_clean":"2024-04-03T05:11:12.373264+0000","last_became_active":"2024-04-03T03:38:26.750879+0000","last_became_peered":"2024-04-03T03:38:26.750879+0000","last_unstale":"2024-04-03T05:11:12.373264+0000","last_undegraded":"2024-04-03T05:11:12.373264+0000","last_fullsized":"2024-04-03T05:11:12.373264+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:50.660673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2014,"num_read_kb":1942,"num_write":406,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'290","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.743433+0000","last_change":"2024-04-03T03:38:24.723229+0000","last_active":"2024-04-03T05:14:07.743433+0000","last_peered":"2024-04-03T05:14:07.743433+0000","last_clean":"2024-04-03T05:14:07.743433+0000","last_became_active":"2024-04-03T03:38:24.722769+0000","last_became_peered":"2024-04-03T03:38:24.722769+0000","last_unstale":"2024-04-03T05:14:07.743433+0000","last_undegraded":"2024-04-03T05:14:07.743433+0000","last_fullsized":"2024-04-03T05:14:07.743433+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:48:04.458628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13170229,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":563,"num_read_kb":76319,"num_write":1262,"num_write_kb":34753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'860","reported_seq":2513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.128819+0000","last_change":"2024-04-03T03:38:26.726050+0000","last_active":"2024-04-03T05:13:59.128819+0000","last_peered":"2024-04-03T05:13:59.128819+0000","last_clean":"2024-04-03T05:13:59.128819+0000","last_became_active":"2024-04-03T03:38:26.724640+0000","last_became_peered":"2024-04-03T03:38:26.724640+0000","last_unstale":"2024-04-03T05:13:59.128819+0000","last_undegraded":"2024-04-03T05:13:59.128819+0000","last_fullsized":"2024-04-03T05:13:59.128819+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:18:50.425634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3968,"num_read_kb":3559,"num_write":1184,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'262","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.996025+0000","last_change":"2024-04-03T03:38:24.711403+0000","last_active":"2024-04-03T05:14:07.996025+0000","last_peered":"2024-04-03T05:14:07.996025+0000","last_clean":"2024-04-03T05:14:07.996025+0000","last_became_active":"2024-04-03T03:38:24.711028+0000","last_became_peered":"2024-04-03T03:38:24.711028+0000","last_unstale":"2024-04-03T05:14:07.996025+0000","last_undegraded":"2024-04-03T05:14:07.996025+0000","last_fullsized":"2024-04-03T05:14:07.996025+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:36:37.333600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3343596,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":380,"num_read_kb":16597,"num_write":974,"num_write_kb":26343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'709","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.222128+0000","last_change":"2024-04-03T03:38:26.750079+0000","last_active":"2024-04-03T05:12:22.222128+0000","last_peered":"2024-04-03T05:12:22.222128+0000","last_clean":"2024-04-03T05:12:22.222128+0000","last_became_active":"2024-04-03T03:38:26.745277+0000","last_became_peered":"2024-04-03T03:38:26.745277+0000","last_unstale":"2024-04-03T05:12:22.222128+0000","last_undegraded":"2024-04-03T05:12:22.222128+0000","last_fullsized":"2024-04-03T05:12:22.222128+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:56:00.667466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3170,"num_read_kb":2825,"num_write":964,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'344","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.862259+0000","last_change":"2024-04-03T03:38:24.757433+0000","last_active":"2024-04-03T05:14:08.862259+0000","last_peered":"2024-04-03T05:14:08.862259+0000","last_clean":"2024-04-03T05:14:08.862259+0000","last_became_active":"2024-04-03T03:38:24.756927+0000","last_became_peered":"2024-04-03T03:38:24.756927+0000","last_unstale":"2024-04-03T05:14:08.862259+0000","last_undegraded":"2024-04-03T05:14:08.862259+0000","last_fullsized":"2024-04-03T05:14:08.862259+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:38:37.035425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4217494,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":601,"num_read_kb":48559,"num_write":1336,"num_write_kb":35333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'577","reported_seq":2216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060394+0000","last_change":"2024-04-03T03:38:26.730190+0000","last_active":"2024-04-03T05:10:58.060394+0000","last_peered":"2024-04-03T05:10:58.060394+0000","last_clean":"2024-04-03T05:10:58.060394+0000","last_became_active":"2024-04-03T03:38:26.729866+0000","last_became_peered":"2024-04-03T03:38:26.729866+0000","last_unstale":"2024-04-03T05:10:58.060394+0000","last_undegraded":"2024-04-03T05:10:58.060394+0000","last_fullsized":"2024-04-03T05:10:58.060394+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:34.215876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2799,"num_write":801,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'364","reported_seq":1270,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.048172+0000","last_change":"2024-04-03T03:38:24.748987+0000","last_active":"2024-04-03T05:14:09.048172+0000","last_peered":"2024-04-03T05:14:09.048172+0000","last_clean":"2024-04-03T05:14:09.048172+0000","last_became_active":"2024-04-03T03:38:24.748338+0000","last_became_peered":"2024-04-03T03:38:24.748338+0000","last_unstale":"2024-04-03T05:14:09.048172+0000","last_undegraded":"2024-04-03T05:14:09.048172+0000","last_fullsized":"2024-04-03T05:14:09.048172+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:49:02.239604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9766408,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":1206,"num_read_kb":39092,"num_write":1633,"num_write_kb":52242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'478","reported_seq":1925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.372354+0000","last_change":"2024-04-03T03:38:26.720548+0000","last_active":"2024-04-03T05:11:12.372354+0000","last_peered":"2024-04-03T05:11:12.372354+0000","last_clean":"2024-04-03T05:11:12.372354+0000","last_became_active":"2024-04-03T03:38:26.719805+0000","last_became_peered":"2024-04-03T03:38:26.719805+0000","last_unstale":"2024-04-03T05:11:12.372354+0000","last_undegraded":"2024-04-03T05:11:12.372354+0000","last_fullsized":"2024-04-03T05:11:12.372354+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:06:02.662745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2340,"num_read_kb":2138,"num_write":626,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'315","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.853533+0000","last_change":"2024-04-03T03:38:24.754531+0000","last_active":"2024-04-03T05:14:08.853533+0000","last_peered":"2024-04-03T05:14:08.853533+0000","last_clean":"2024-04-03T05:14:08.853533+0000","last_became_active":"2024-04-03T03:38:24.749192+0000","last_became_peered":"2024-04-03T03:38:24.749192+0000","last_unstale":"2024-04-03T05:14:08.853533+0000","last_undegraded":"2024-04-03T05:14:08.853533+0000","last_fullsized":"2024-04-03T05:14:08.853533+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:24:13.416735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5778104,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":415,"num_read_kb":24946,"num_write":1253,"num_write_kb":50928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'294","reported_seq":1649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.605723+0000","last_change":"2024-04-03T03:38:26.750146+0000","last_active":"2024-04-03T05:10:43.605723+0000","last_peered":"2024-04-03T05:10:43.605723+0000","last_clean":"2024-04-03T05:10:43.605723+0000","last_became_active":"2024-04-03T03:38:26.744762+0000","last_became_peered":"2024-04-03T03:38:26.744762+0000","last_unstale":"2024-04-03T05:10:43.605723+0000","last_undegraded":"2024-04-03T05:10:43.605723+0000","last_fullsized":"2024-04-03T05:10:43.605723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:44.097623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1674,"num_read_kb":1613,"num_write":327,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'295","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.054593+0000","last_change":"2024-04-03T03:38:24.730594+0000","last_active":"2024-04-03T05:14:09.054593+0000","last_peered":"2024-04-03T05:14:09.054593+0000","last_clean":"2024-04-03T05:14:09.054593+0000","last_became_active":"2024-04-03T03:38:24.728188+0000","last_became_peered":"2024-04-03T03:38:24.728188+0000","last_unstale":"2024-04-03T05:14:09.054593+0000","last_undegraded":"2024-04-03T05:14:09.054593+0000","last_fullsized":"2024-04-03T05:14:09.054593+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:12:23.518716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6443356,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":508,"num_read_kb":30991,"num_write":1137,"num_write_kb":37947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'732","reported_seq":2231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.844541+0000","last_change":"2024-04-03T03:38:26.722813+0000","last_active":"2024-04-03T05:12:13.844541+0000","last_peered":"2024-04-03T05:12:13.844541+0000","last_clean":"2024-04-03T05:12:13.844541+0000","last_became_active":"2024-04-03T03:38:26.722053+0000","last_became_peered":"2024-04-03T03:38:26.722053+0000","last_unstale":"2024-04-03T05:12:13.844541+0000","last_undegraded":"2024-04-03T05:12:13.844541+0000","last_fullsized":"2024-04-03T05:12:13.844541+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:52:12.496090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3332,"num_read_kb":2987,"num_write":969,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'285","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.977729+0000","last_change":"2024-04-03T03:38:24.749214+0000","last_active":"2024-04-03T05:14:07.977729+0000","last_peered":"2024-04-03T05:14:07.977729+0000","last_clean":"2024-04-03T05:14:07.977729+0000","last_became_active":"2024-04-03T03:38:24.748669+0000","last_became_peered":"2024-04-03T03:38:24.748669+0000","last_unstale":"2024-04-03T05:14:07.977729+0000","last_undegraded":"2024-04-03T05:14:07.977729+0000","last_fullsized":"2024-04-03T05:14:07.977729+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:20:30.983491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7227232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":442,"num_read_kb":30915,"num_write":1190,"num_write_kb":34378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'466","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.453334+0000","last_change":"2024-04-03T03:38:26.712374+0000","last_active":"2024-04-03T05:11:08.453334+0000","last_peered":"2024-04-03T05:11:08.453334+0000","last_clean":"2024-04-03T05:11:08.453334+0000","last_became_active":"2024-04-03T03:38:26.711993+0000","last_became_peered":"2024-04-03T03:38:26.711993+0000","last_unstale":"2024-04-03T05:11:08.453334+0000","last_undegraded":"2024-04-03T05:11:08.453334+0000","last_fullsized":"2024-04-03T05:11:08.453334+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:28:06.991173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2333,"num_write":597,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'427","reported_seq":1881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.643681+0000","last_change":"2024-04-03T03:38:26.741314+0000","last_active":"2024-04-03T05:11:48.643681+0000","last_peered":"2024-04-03T05:11:48.643681+0000","last_clean":"2024-04-03T05:11:48.643681+0000","last_became_active":"2024-04-03T03:38:26.740542+0000","last_became_peered":"2024-04-03T03:38:26.740542+0000","last_unstale":"2024-04-03T05:11:48.643681+0000","last_undegraded":"2024-04-03T05:11:48.643681+0000","last_fullsized":"2024-04-03T05:11:48.643681+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:02:13.637413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2192,"num_read_kb":2031,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'306","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.042430+0000","last_change":"2024-04-03T03:38:24.762053+0000","last_active":"2024-04-03T05:14:09.042430+0000","last_peered":"2024-04-03T05:14:09.042430+0000","last_clean":"2024-04-03T05:14:09.042430+0000","last_became_active":"2024-04-03T03:38:24.761424+0000","last_became_peered":"2024-04-03T03:38:24.761424+0000","last_unstale":"2024-04-03T05:14:09.042430+0000","last_undegraded":"2024-04-03T05:14:09.042430+0000","last_fullsized":"2024-04-03T05:14:09.042430+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:58:18.665928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1588863,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":468,"num_read_kb":4079,"num_write":1206,"num_write_kb":13920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'364","reported_seq":1752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193276+0000","last_change":"2024-04-03T03:38:26.725447+0000","last_active":"2024-04-03T05:13:59.193276+0000","last_peered":"2024-04-03T05:13:59.193276+0000","last_clean":"2024-04-03T05:13:59.193276+0000","last_became_active":"2024-04-03T03:38:26.723638+0000","last_became_peered":"2024-04-03T03:38:26.723638+0000","last_unstale":"2024-04-03T05:13:59.193276+0000","last_undegraded":"2024-04-03T05:13:59.193276+0000","last_fullsized":"2024-04-03T05:13:59.193276+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:30:54.500121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1899,"num_read_kb":1790,"num_write":424,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'302","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.974821+0000","last_change":"2024-04-03T03:38:58.351102+0000","last_active":"2024-04-03T05:14:08.974821+0000","last_peered":"2024-04-03T05:14:08.974821+0000","last_clean":"2024-04-03T05:14:08.974821+0000","last_became_active":"2024-04-03T03:38:58.349885+0000","last_became_peered":"2024-04-03T03:38:58.349885+0000","last_unstale":"2024-04-03T05:14:08.974821+0000","last_undegraded":"2024-04-03T05:14:08.974821+0000","last_fullsized":"2024-04-03T05:14:08.974821+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:16:53.864983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14459487,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":486,"num_read_kb":66677,"num_write":1204,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'451","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.396049+0000","last_change":"2024-04-03T03:38:26.710365+0000","last_active":"2024-04-03T05:11:18.396049+0000","last_peered":"2024-04-03T05:11:18.396049+0000","last_clean":"2024-04-03T05:11:18.396049+0000","last_became_active":"2024-04-03T03:38:26.709613+0000","last_became_peered":"2024-04-03T03:38:26.709613+0000","last_unstale":"2024-04-03T05:11:18.396049+0000","last_undegraded":"2024-04-03T05:11:18.396049+0000","last_fullsized":"2024-04-03T05:11:18.396049+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:37:42.966727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2380,"num_write":570,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'306","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.985418+0000","last_change":"2024-04-03T03:38:24.761922+0000","last_active":"2024-04-03T05:14:08.985418+0000","last_peered":"2024-04-03T05:14:08.985418+0000","last_clean":"2024-04-03T05:14:08.985418+0000","last_became_active":"2024-04-03T03:38:24.761284+0000","last_became_peered":"2024-04-03T03:38:24.761284+0000","last_unstale":"2024-04-03T05:14:08.985418+0000","last_undegraded":"2024-04-03T05:14:08.985418+0000","last_fullsized":"2024-04-03T05:14:08.985418+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:33:18.725669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5282135,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":548,"num_read_kb":65080,"num_write":1155,"num_write_kb":43379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'446","reported_seq":2408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.213868+0000","last_change":"2024-04-03T03:38:26.713266+0000","last_active":"2024-04-03T05:12:22.213868+0000","last_peered":"2024-04-03T05:12:22.213868+0000","last_clean":"2024-04-03T05:12:22.213868+0000","last_became_active":"2024-04-03T03:38:26.711748+0000","last_became_peered":"2024-04-03T03:38:26.711748+0000","last_unstale":"2024-04-03T05:12:22.213868+0000","last_undegraded":"2024-04-03T05:12:22.213868+0000","last_fullsized":"2024-04-03T05:12:22.213868+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:16:46.211389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2976,"num_read_kb":2877,"num_write":500,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'255","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.632281+0000","last_change":"2024-04-03T03:38:24.744386+0000","last_active":"2024-04-03T05:14:08.632281+0000","last_peered":"2024-04-03T05:14:08.632281+0000","last_clean":"2024-04-03T05:14:08.632281+0000","last_became_active":"2024-04-03T03:38:24.742574+0000","last_became_peered":"2024-04-03T03:38:24.742574+0000","last_unstale":"2024-04-03T05:14:08.632281+0000","last_undegraded":"2024-04-03T05:14:08.632281+0000","last_fullsized":"2024-04-03T05:14:08.632281+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:11.179082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15102384,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":405,"num_read_kb":46919,"num_write":1070,"num_write_kb":37595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'342","reported_seq":1754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.276727+0000","last_change":"2024-04-03T03:38:26.744328+0000","last_active":"2024-04-03T05:11:29.276727+0000","last_peered":"2024-04-03T05:11:29.276727+0000","last_clean":"2024-04-03T05:11:29.276727+0000","last_became_active":"2024-04-03T03:38:26.743735+0000","last_became_peered":"2024-04-03T03:38:26.743735+0000","last_unstale":"2024-04-03T05:11:29.276727+0000","last_undegraded":"2024-04-03T05:11:29.276727+0000","last_fullsized":"2024-04-03T05:11:29.276727+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:20:00.390318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1802,"num_read_kb":1729,"num_write":383,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'294","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.005786+0000","last_change":"2024-04-03T03:38:24.726007+0000","last_active":"2024-04-03T05:14:08.005786+0000","last_peered":"2024-04-03T05:14:08.005786+0000","last_clean":"2024-04-03T05:14:08.005786+0000","last_became_active":"2024-04-03T03:38:24.725557+0000","last_became_peered":"2024-04-03T03:38:24.725557+0000","last_unstale":"2024-04-03T05:14:08.005786+0000","last_undegraded":"2024-04-03T05:14:08.005786+0000","last_fullsized":"2024-04-03T05:14:08.005786+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:50:47.134109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5507739,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":443,"num_read_kb":4167,"num_write":1103,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'335","reported_seq":1763,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.286070+0000","last_change":"2024-04-03T03:38:26.745907+0000","last_active":"2024-04-03T05:11:29.286070+0000","last_peered":"2024-04-03T05:11:29.286070+0000","last_clean":"2024-04-03T05:11:29.286070+0000","last_became_active":"2024-04-03T03:38:26.744977+0000","last_became_peered":"2024-04-03T03:38:26.744977+0000","last_unstale":"2024-04-03T05:11:29.286070+0000","last_undegraded":"2024-04-03T05:11:29.286070+0000","last_fullsized":"2024-04-03T05:11:29.286070+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:09:58.311296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1755,"num_write":385,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'234","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.978970+0000","last_change":"2024-04-03T03:38:24.725895+0000","last_active":"2024-04-03T05:14:07.978970+0000","last_peered":"2024-04-03T05:14:07.978970+0000","last_clean":"2024-04-03T05:14:07.978970+0000","last_became_active":"2024-04-03T03:38:24.725410+0000","last_became_peered":"2024-04-03T03:38:24.725410+0000","last_unstale":"2024-04-03T05:14:07.978970+0000","last_undegraded":"2024-04-03T05:14:07.978970+0000","last_fullsized":"2024-04-03T05:14:07.978970+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:07:55.757685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21031641,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":485,"num_read_kb":79698,"num_write":935,"num_write_kb":41581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'139","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.408690+0000","last_change":"2024-04-03T03:38:34.739613+0000","last_active":"2024-04-03T05:11:18.408690+0000","last_peered":"2024-04-03T05:11:18.408690+0000","last_clean":"2024-04-03T05:11:18.408690+0000","last_became_active":"2024-04-03T03:38:34.738565+0000","last_became_peered":"2024-04-03T03:38:34.738565+0000","last_unstale":"2024-04-03T05:11:18.408690+0000","last_undegraded":"2024-04-03T05:11:18.408690+0000","last_fullsized":"2024-04-03T05:11:18.408690+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:08:22.326355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":345,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'372","reported_seq":1823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.374074+0000","last_change":"2024-04-03T03:39:58.990871+0000","last_active":"2024-04-03T05:11:12.374074+0000","last_peered":"2024-04-03T05:11:12.374074+0000","last_clean":"2024-04-03T05:11:12.374074+0000","last_became_active":"2024-04-03T03:39:58.989982+0000","last_became_peered":"2024-04-03T03:39:58.989982+0000","last_unstale":"2024-04-03T05:11:12.374074+0000","last_undegraded":"2024-04-03T05:11:12.374074+0000","last_fullsized":"2024-04-03T05:11:12.374074+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:57:23.445483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2119,"num_read_kb":1999,"num_write":436,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'300","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.995287+0000","last_change":"2024-04-03T03:38:24.750884+0000","last_active":"2024-04-03T05:14:08.995287+0000","last_peered":"2024-04-03T05:14:08.995287+0000","last_clean":"2024-04-03T05:14:08.995287+0000","last_became_active":"2024-04-03T03:38:24.750235+0000","last_became_peered":"2024-04-03T03:38:24.750235+0000","last_unstale":"2024-04-03T05:14:08.995287+0000","last_undegraded":"2024-04-03T05:14:08.995287+0000","last_fullsized":"2024-04-03T05:14:08.995287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:38:04.324570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340614,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":461,"num_read_kb":98318,"num_write":1162,"num_write_kb":49383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818558+0000","last_change":"2024-04-03T03:38:28.726652+0000","last_active":"2024-04-03T05:10:18.818558+0000","last_peered":"2024-04-03T05:10:18.818558+0000","last_clean":"2024-04-03T05:10:18.818558+0000","last_became_active":"2024-04-03T03:38:28.725801+0000","last_became_peered":"2024-04-03T03:38:28.725801+0000","last_unstale":"2024-04-03T05:10:18.818558+0000","last_undegraded":"2024-04-03T05:10:18.818558+0000","last_fullsized":"2024-04-03T05:10:18.818558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:31:07.597192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'344","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.495856+0000","last_change":"2024-04-03T03:38:30.727143+0000","last_active":"2024-04-03T05:14:00.495856+0000","last_peered":"2024-04-03T05:14:00.495856+0000","last_clean":"2024-04-03T05:14:00.495856+0000","last_became_active":"2024-04-03T03:38:30.726684+0000","last_became_peered":"2024-04-03T03:38:30.726684+0000","last_unstale":"2024-04-03T05:14:00.495856+0000","last_undegraded":"2024-04-03T05:14:00.495856+0000","last_fullsized":"2024-04-03T05:14:00.495856+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:51.225223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58921,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":551,"num_read_kb":1006,"num_write":422,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:24.025369+0000","last_change":"2024-04-03T03:38:32.748206+0000","last_active":"2024-04-03T05:10:24.025369+0000","last_peered":"2024-04-03T05:10:24.025369+0000","last_clean":"2024-04-03T05:10:24.025369+0000","last_became_active":"2024-04-03T03:38:32.745434+0000","last_became_peered":"2024-04-03T03:38:32.745434+0000","last_unstale":"2024-04-03T05:10:24.025369+0000","last_undegraded":"2024-04-03T05:10:24.025369+0000","last_fullsized":"2024-04-03T05:10:24.025369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:43:21.765675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2398","reported_seq":4223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.236396+0000","last_change":"2024-04-03T03:38:34.759059+0000","last_active":"2024-04-03T05:12:22.236396+0000","last_peered":"2024-04-03T05:12:22.236396+0000","last_clean":"2024-04-03T05:12:22.236396+0000","last_became_active":"2024-04-03T03:38:34.757256+0000","last_became_peered":"2024-04-03T03:38:34.757256+0000","last_unstale":"2024-04-03T05:12:22.236396+0000","last_undegraded":"2024-04-03T05:12:22.236396+0000","last_fullsized":"2024-04-03T05:12:22.236396+0000","mapping_epoch":33,"log_start":"263'2300","ondisk_log_start":"263'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":2300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:07.414083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5948,"num_read_kb":5953,"num_write":4769,"num_write_kb":1764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'433","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.110390+0000","last_change":"2024-04-03T03:38:26.725258+0000","last_active":"2024-04-03T05:13:59.110390+0000","last_peered":"2024-04-03T05:13:59.110390+0000","last_clean":"2024-04-03T05:13:59.110390+0000","last_became_active":"2024-04-03T03:38:26.724537+0000","last_became_peered":"2024-04-03T03:38:26.724537+0000","last_unstale":"2024-04-03T05:13:59.110390+0000","last_undegraded":"2024-04-03T05:13:59.110390+0000","last_fullsized":"2024-04-03T05:13:59.110390+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:55:34.004187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2269,"num_read_kb":2119,"num_write":527,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'296","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.805558+0000","last_change":"2024-04-03T03:38:57.871292+0000","last_active":"2024-04-03T05:14:07.805558+0000","last_peered":"2024-04-03T05:14:07.805558+0000","last_clean":"2024-04-03T05:14:07.805558+0000","last_became_active":"2024-04-03T03:38:57.870251+0000","last_became_peered":"2024-04-03T03:38:57.870251+0000","last_unstale":"2024-04-03T05:14:07.805558+0000","last_undegraded":"2024-04-03T05:14:07.805558+0000","last_fullsized":"2024-04-03T05:14:07.805558+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:41.934446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2272671,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":600,"num_read_kb":14924,"num_write":1365,"num_write_kb":20295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:53.000142+0000","last_change":"2024-04-03T03:38:28.729101+0000","last_active":"2024-04-03T05:09:53.000142+0000","last_peered":"2024-04-03T05:09:53.000142+0000","last_clean":"2024-04-03T05:09:53.000142+0000","last_became_active":"2024-04-03T03:38:28.728632+0000","last_became_peered":"2024-04-03T03:38:28.728632+0000","last_unstale":"2024-04-03T05:09:53.000142+0000","last_undegraded":"2024-04-03T05:09:53.000142+0000","last_fullsized":"2024-04-03T05:09:53.000142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:02:19.986062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'120","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.625381+0000","last_change":"2024-04-03T03:38:30.731626+0000","last_active":"2024-04-03T05:10:23.625381+0000","last_peered":"2024-04-03T05:10:23.625381+0000","last_clean":"2024-04-03T05:10:23.625381+0000","last_became_active":"2024-04-03T03:38:30.730797+0000","last_became_peered":"2024-04-03T03:38:30.730797+0000","last_unstale":"2024-04-03T05:10:23.625381+0000","last_undegraded":"2024-04-03T05:10:23.625381+0000","last_fullsized":"2024-04-03T05:10:23.625381+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:20.134850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":139,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.625339+0000","last_change":"2024-04-03T03:38:32.733871+0000","last_active":"2024-04-03T05:10:23.625339+0000","last_peered":"2024-04-03T05:10:23.625339+0000","last_clean":"2024-04-03T05:10:23.625339+0000","last_became_active":"2024-04-03T03:38:32.732994+0000","last_became_peered":"2024-04-03T03:38:32.732994+0000","last_unstale":"2024-04-03T05:10:23.625339+0000","last_undegraded":"2024-04-03T05:10:23.625339+0000","last_fullsized":"2024-04-03T05:10:23.625339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:01.913002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'106","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062730+0000","last_change":"2024-04-03T03:38:34.746933+0000","last_active":"2024-04-03T05:11:08.062730+0000","last_peered":"2024-04-03T05:11:08.062730+0000","last_clean":"2024-04-03T05:11:08.062730+0000","last_became_active":"2024-04-03T03:38:34.746126+0000","last_became_peered":"2024-04-03T03:38:34.746126+0000","last_unstale":"2024-04-03T05:11:08.062730+0000","last_undegraded":"2024-04-03T05:11:08.062730+0000","last_fullsized":"2024-04-03T05:11:08.062730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:08:36.510470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":113,"num_write":252,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'388","reported_seq":1870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.596727+0000","last_change":"2024-04-03T03:38:26.725947+0000","last_active":"2024-04-03T05:10:43.596727+0000","last_peered":"2024-04-03T05:10:43.596727+0000","last_clean":"2024-04-03T05:10:43.596727+0000","last_became_active":"2024-04-03T03:38:26.724468+0000","last_became_peered":"2024-04-03T03:38:26.724468+0000","last_unstale":"2024-04-03T05:10:43.596727+0000","last_undegraded":"2024-04-03T05:10:43.596727+0000","last_fullsized":"2024-04-03T05:10:43.596727+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:46:05.423762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1964,"num_write":459,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'299","reported_seq":1126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.000214+0000","last_change":"2024-04-03T03:38:24.733041+0000","last_active":"2024-04-03T05:14:09.000214+0000","last_peered":"2024-04-03T05:14:09.000214+0000","last_clean":"2024-04-03T05:14:09.000214+0000","last_became_active":"2024-04-03T03:38:24.732182+0000","last_became_peered":"2024-04-03T03:38:24.732182+0000","last_unstale":"2024-04-03T05:14:09.000214+0000","last_undegraded":"2024-04-03T05:14:09.000214+0000","last_fullsized":"2024-04-03T05:14:09.000214+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:04:10.217131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5577205,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":829,"num_read_kb":9858,"num_write":1174,"num_write_kb":55489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.007355+0000","last_change":"2024-04-03T03:38:28.733914+0000","last_active":"2024-04-03T05:10:23.007355+0000","last_peered":"2024-04-03T05:10:23.007355+0000","last_clean":"2024-04-03T05:10:23.007355+0000","last_became_active":"2024-04-03T03:38:28.733142+0000","last_became_peered":"2024-04-03T03:38:28.733142+0000","last_unstale":"2024-04-03T05:10:23.007355+0000","last_undegraded":"2024-04-03T05:10:23.007355+0000","last_fullsized":"2024-04-03T05:10:23.007355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:59:55.469233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'170","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:57.811949+0000","last_change":"2024-04-03T03:38:30.735680+0000","last_active":"2024-04-03T05:09:57.811949+0000","last_peered":"2024-04-03T05:09:57.811949+0000","last_clean":"2024-04-03T05:09:57.811949+0000","last_became_active":"2024-04-03T03:38:30.734934+0000","last_became_peered":"2024-04-03T03:38:30.734934+0000","last_unstale":"2024-04-03T05:09:57.811949+0000","last_undegraded":"2024-04-03T05:09:57.811949+0000","last_fullsized":"2024-04-03T05:09:57.811949+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:03.598253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'514","reported_seq":2435,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.494677+0000","last_change":"2024-04-03T03:38:32.749915+0000","last_active":"2024-04-03T05:14:07.494677+0000","last_peered":"2024-04-03T05:14:07.494677+0000","last_clean":"2024-04-03T05:14:07.494677+0000","last_became_active":"2024-04-03T03:38:32.748836+0000","last_became_peered":"2024-04-03T03:38:32.748836+0000","last_unstale":"2024-04-03T05:14:07.494677+0000","last_undegraded":"2024-04-03T05:14:07.494677+0000","last_fullsized":"2024-04-03T05:14:07.494677+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:20:14.250362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'104","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.635415+0000","last_change":"2024-04-03T03:38:34.941018+0000","last_active":"2024-04-03T05:11:08.635415+0000","last_peered":"2024-04-03T05:11:08.635415+0000","last_clean":"2024-04-03T05:11:08.635415+0000","last_became_active":"2024-04-03T03:38:34.940390+0000","last_became_peered":"2024-04-03T03:38:34.940390+0000","last_unstale":"2024-04-03T05:11:08.635415+0000","last_undegraded":"2024-04-03T05:11:08.635415+0000","last_fullsized":"2024-04-03T05:11:08.635415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:47.643064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'569","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398822+0000","last_change":"2024-04-03T03:38:26.718097+0000","last_active":"2024-04-03T05:11:18.398822+0000","last_peered":"2024-04-03T05:11:18.398822+0000","last_clean":"2024-04-03T05:11:18.398822+0000","last_became_active":"2024-04-03T03:38:26.717394+0000","last_became_peered":"2024-04-03T03:38:26.717394+0000","last_unstale":"2024-04-03T05:11:18.398822+0000","last_undegraded":"2024-04-03T05:11:18.398822+0000","last_fullsized":"2024-04-03T05:11:18.398822+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:36.179522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2983,"num_read_kb":2733,"num_write":743,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'288","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.042350+0000","last_change":"2024-04-03T03:38:24.762461+0000","last_active":"2024-04-03T05:14:09.042350+0000","last_peered":"2024-04-03T05:14:09.042350+0000","last_clean":"2024-04-03T05:14:09.042350+0000","last_became_active":"2024-04-03T03:38:24.761913+0000","last_became_peered":"2024-04-03T03:38:24.761913+0000","last_unstale":"2024-04-03T05:14:09.042350+0000","last_undegraded":"2024-04-03T05:14:09.042350+0000","last_fullsized":"2024-04-03T05:14:09.042350+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:18:50.867012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245582,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":470,"num_read_kb":83386,"num_write":1117,"num_write_kb":33117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818707+0000","last_change":"2024-04-03T03:38:28.731460+0000","last_active":"2024-04-03T05:10:18.818707+0000","last_peered":"2024-04-03T05:10:18.818707+0000","last_clean":"2024-04-03T05:10:18.818707+0000","last_became_active":"2024-04-03T03:38:28.730711+0000","last_became_peered":"2024-04-03T03:38:28.730711+0000","last_unstale":"2024-04-03T05:10:18.818707+0000","last_undegraded":"2024-04-03T05:10:18.818707+0000","last_fullsized":"2024-04-03T05:10:18.818707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:32.235397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'298","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.481180+0000","last_change":"2024-04-03T03:38:30.825170+0000","last_active":"2024-04-03T05:14:00.481180+0000","last_peered":"2024-04-03T05:14:00.481180+0000","last_clean":"2024-04-03T05:14:00.481180+0000","last_became_active":"2024-04-03T03:38:30.824397+0000","last_became_peered":"2024-04-03T03:38:30.824397+0000","last_unstale":"2024-04-03T05:14:00.481180+0000","last_undegraded":"2024-04-03T05:14:00.481180+0000","last_fullsized":"2024-04-03T05:14:00.481180+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:35:06.339872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":979,"num_write":388,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'551","reported_seq":4238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.506225+0000","last_change":"2024-04-03T03:38:32.744325+0000","last_active":"2024-04-03T05:14:07.506225+0000","last_peered":"2024-04-03T05:14:07.506225+0000","last_clean":"2024-04-03T05:14:07.506225+0000","last_became_active":"2024-04-03T03:38:32.743645+0000","last_became_peered":"2024-04-03T03:38:32.743645+0000","last_unstale":"2024-04-03T05:14:07.506225+0000","last_undegraded":"2024-04-03T05:14:07.506225+0000","last_fullsized":"2024-04-03T05:14:07.506225+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:07:29.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1050","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.140148+0000","last_change":"2024-04-03T03:38:26.726712+0000","last_active":"2024-04-03T05:13:59.140148+0000","last_peered":"2024-04-03T05:13:59.140148+0000","last_clean":"2024-04-03T05:13:59.140148+0000","last_became_active":"2024-04-03T03:38:26.726039+0000","last_became_peered":"2024-04-03T03:38:26.726039+0000","last_unstale":"2024-04-03T05:13:59.140148+0000","last_undegraded":"2024-04-03T05:13:59.140148+0000","last_fullsized":"2024-04-03T05:13:59.140148+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:40:13.491224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4374,"num_read_kb":3788,"num_write":1482,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'334","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.018676+0000","last_change":"2024-04-03T03:38:24.754120+0000","last_active":"2024-04-03T05:14:09.018676+0000","last_peered":"2024-04-03T05:14:09.018676+0000","last_clean":"2024-04-03T05:14:09.018676+0000","last_became_active":"2024-04-03T03:38:24.752543+0000","last_became_peered":"2024-04-03T03:38:24.752543+0000","last_unstale":"2024-04-03T05:14:09.018676+0000","last_undegraded":"2024-04-03T05:14:09.018676+0000","last_fullsized":"2024-04-03T05:14:09.018676+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:09:55.105836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10141901,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":483,"num_read_kb":24934,"num_write":1114,"num_write_kb":21782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.042244+0000","last_change":"2024-04-03T03:38:28.738400+0000","last_active":"2024-04-03T05:11:39.042244+0000","last_peered":"2024-04-03T05:11:39.042244+0000","last_clean":"2024-04-03T05:11:39.042244+0000","last_became_active":"2024-04-03T03:38:28.737738+0000","last_became_peered":"2024-04-03T03:38:28.737738+0000","last_unstale":"2024-04-03T05:11:39.042244+0000","last_undegraded":"2024-04-03T05:11:39.042244+0000","last_fullsized":"2024-04-03T05:11:39.042244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:12:06.496501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'417","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.507852+0000","last_change":"2024-04-03T03:38:30.823152+0000","last_active":"2024-04-03T05:14:00.507852+0000","last_peered":"2024-04-03T05:14:00.507852+0000","last_clean":"2024-04-03T05:14:00.507852+0000","last_became_active":"2024-04-03T03:38:30.822389+0000","last_became_peered":"2024-04-03T03:38:30.822389+0000","last_unstale":"2024-04-03T05:14:00.507852+0000","last_undegraded":"2024-04-03T05:14:00.507852+0000","last_fullsized":"2024-04-03T05:14:00.507852+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:41:29.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50957,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":660,"num_read_kb":1135,"num_write":500,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830178+0000","last_change":"2024-04-03T03:38:32.731693+0000","last_active":"2024-04-03T05:10:47.830178+0000","last_peered":"2024-04-03T05:10:47.830178+0000","last_clean":"2024-04-03T05:10:47.830178+0000","last_became_active":"2024-04-03T03:38:32.730901+0000","last_became_peered":"2024-04-03T03:38:32.730901+0000","last_unstale":"2024-04-03T05:10:47.830178+0000","last_undegraded":"2024-04-03T05:10:47.830178+0000","last_fullsized":"2024-04-03T05:10:47.830178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:15:01.774475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'539","reported_seq":1368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.544147+0000","last_change":"2024-04-03T03:38:34.756576+0000","last_active":"2024-04-03T05:14:00.544147+0000","last_peered":"2024-04-03T05:14:00.544147+0000","last_clean":"2024-04-03T05:14:00.544147+0000","last_became_active":"2024-04-03T03:38:34.754300+0000","last_became_peered":"2024-04-03T03:38:34.754300+0000","last_unstale":"2024-04-03T05:14:00.544147+0000","last_undegraded":"2024-04-03T05:14:00.544147+0000","last_fullsized":"2024-04-03T05:14:00.544147+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:49.037819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1265,"num_read_kb":1263,"num_write":1135,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'842","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.143894+0000","last_change":"2024-04-03T03:38:26.749563+0000","last_active":"2024-04-03T05:13:59.143894+0000","last_peered":"2024-04-03T05:13:59.143894+0000","last_clean":"2024-04-03T05:13:59.143894+0000","last_became_active":"2024-04-03T03:38:26.742328+0000","last_became_peered":"2024-04-03T03:38:26.742328+0000","last_unstale":"2024-04-03T05:13:59.143894+0000","last_undegraded":"2024-04-03T05:13:59.143894+0000","last_fullsized":"2024-04-03T05:13:59.143894+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:14:05.259556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3790,"num_read_kb":3360,"num_write":1145,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'322","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.742373+0000","last_change":"2024-04-03T03:38:58.349005+0000","last_active":"2024-04-03T05:14:07.742373+0000","last_peered":"2024-04-03T05:14:07.742373+0000","last_clean":"2024-04-03T05:14:07.742373+0000","last_became_active":"2024-04-03T03:38:58.348120+0000","last_became_peered":"2024-04-03T03:38:58.348120+0000","last_unstale":"2024-04-03T05:14:07.742373+0000","last_undegraded":"2024-04-03T05:14:07.742373+0000","last_fullsized":"2024-04-03T05:14:07.742373+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:15.110906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2892940,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":627,"num_read_kb":8001,"num_write":1258,"num_write_kb":23217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834543+0000","last_change":"2024-04-03T03:38:28.731205+0000","last_active":"2024-04-03T05:11:42.834543+0000","last_peered":"2024-04-03T05:11:42.834543+0000","last_clean":"2024-04-03T05:11:42.834543+0000","last_became_active":"2024-04-03T03:38:28.729832+0000","last_became_peered":"2024-04-03T03:38:28.729832+0000","last_unstale":"2024-04-03T05:11:42.834543+0000","last_undegraded":"2024-04-03T05:11:42.834543+0000","last_fullsized":"2024-04-03T05:11:42.834543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:46.103991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'312","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.054867+0000","last_change":"2024-04-03T03:38:30.721619+0000","last_active":"2024-04-03T05:14:08.054867+0000","last_peered":"2024-04-03T05:14:08.054867+0000","last_clean":"2024-04-03T05:14:08.054867+0000","last_became_active":"2024-04-03T03:38:30.720884+0000","last_became_peered":"2024-04-03T03:38:30.720884+0000","last_unstale":"2024-04-03T05:14:08.054867+0000","last_undegraded":"2024-04-03T05:14:08.054867+0000","last_fullsized":"2024-04-03T05:14:08.054867+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:01:23.554077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1184,"num_write":408,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:52.999988+0000","last_change":"2024-04-03T03:38:32.742446+0000","last_active":"2024-04-03T05:09:52.999988+0000","last_peered":"2024-04-03T05:09:52.999988+0000","last_clean":"2024-04-03T05:09:52.999988+0000","last_became_active":"2024-04-03T03:38:32.741770+0000","last_became_peered":"2024-04-03T03:38:32.741770+0000","last_unstale":"2024-04-03T05:09:52.999988+0000","last_undegraded":"2024-04-03T05:09:52.999988+0000","last_fullsized":"2024-04-03T05:09:52.999988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:03:05.043052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'85","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:44.033021+0000","last_change":"2024-04-03T03:38:34.734633+0000","last_active":"2024-04-03T05:12:44.033021+0000","last_peered":"2024-04-03T05:12:44.033021+0000","last_clean":"2024-04-03T05:12:44.033021+0000","last_became_active":"2024-04-03T03:38:34.733896+0000","last_became_peered":"2024-04-03T03:38:34.733896+0000","last_unstale":"2024-04-03T05:12:44.033021+0000","last_undegraded":"2024-04-03T05:12:44.033021+0000","last_fullsized":"2024-04-03T05:12:44.033021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:01:46.697380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'718","reported_seq":2130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.188828+0000","last_change":"2024-04-03T03:38:26.735283+0000","last_active":"2024-04-03T05:13:59.188828+0000","last_peered":"2024-04-03T05:13:59.188828+0000","last_clean":"2024-04-03T05:13:59.188828+0000","last_became_active":"2024-04-03T03:38:26.734518+0000","last_became_peered":"2024-04-03T03:38:26.734518+0000","last_unstale":"2024-04-03T05:13:59.188828+0000","last_undegraded":"2024-04-03T05:13:59.188828+0000","last_fullsized":"2024-04-03T05:13:59.188828+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:24:23.571507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3204,"num_read_kb":2862,"num_write":964,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'306","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.000287+0000","last_change":"2024-04-03T03:38:24.759103+0000","last_active":"2024-04-03T05:14:09.000287+0000","last_peered":"2024-04-03T05:14:09.000287+0000","last_clean":"2024-04-03T05:14:09.000287+0000","last_became_active":"2024-04-03T03:38:24.758401+0000","last_became_peered":"2024-04-03T03:38:24.758401+0000","last_unstale":"2024-04-03T05:14:09.000287+0000","last_undegraded":"2024-04-03T05:14:09.000287+0000","last_fullsized":"2024-04-03T05:14:09.000287+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:49:27.974853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5289818,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":639,"num_read_kb":12991,"num_write":1234,"num_write_kb":25567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.822882+0000","last_change":"2024-04-03T03:38:28.731957+0000","last_active":"2024-04-03T05:10:47.822882+0000","last_peered":"2024-04-03T05:10:47.822882+0000","last_clean":"2024-04-03T05:10:47.822882+0000","last_became_active":"2024-04-03T03:38:28.731257+0000","last_became_peered":"2024-04-03T03:38:28.731257+0000","last_unstale":"2024-04-03T05:10:47.822882+0000","last_undegraded":"2024-04-03T05:10:47.822882+0000","last_fullsized":"2024-04-03T05:10:47.822882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:02:15.763718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'335","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.514743+0000","last_change":"2024-04-03T03:38:30.734366+0000","last_active":"2024-04-03T05:14:00.514743+0000","last_peered":"2024-04-03T05:14:00.514743+0000","last_clean":"2024-04-03T05:14:00.514743+0000","last_became_active":"2024-04-03T03:38:30.732417+0000","last_became_peered":"2024-04-03T03:38:30.732417+0000","last_unstale":"2024-04-03T05:14:00.514743+0000","last_undegraded":"2024-04-03T05:14:00.514743+0000","last_fullsized":"2024-04-03T05:14:00.514743+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:17:12.716764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57769,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":543,"num_read_kb":996,"num_write":416,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'544","reported_seq":3037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.510526+0000","last_change":"2024-04-03T03:38:32.746838+0000","last_active":"2024-04-03T05:14:07.510526+0000","last_peered":"2024-04-03T05:14:07.510526+0000","last_clean":"2024-04-03T05:14:07.510526+0000","last_became_active":"2024-04-03T03:38:32.746029+0000","last_became_peered":"2024-04-03T03:38:32.746029+0000","last_unstale":"2024-04-03T05:14:07.510526+0000","last_undegraded":"2024-04-03T05:14:07.510526+0000","last_fullsized":"2024-04-03T05:14:07.510526+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:35:26.100890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'94","reported_seq":605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:58.856544+0000","last_change":"2024-04-03T03:38:34.742226+0000","last_active":"2024-04-03T05:13:58.856544+0000","last_peered":"2024-04-03T05:13:58.856544+0000","last_clean":"2024-04-03T05:13:58.856544+0000","last_became_active":"2024-04-03T03:38:34.741505+0000","last_became_peered":"2024-04-03T03:38:34.741505+0000","last_unstale":"2024-04-03T05:13:58.856544+0000","last_undegraded":"2024-04-03T05:13:58.856544+0000","last_fullsized":"2024-04-03T05:13:58.856544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:35:43.800179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'443","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.121620+0000","last_change":"2024-04-03T03:38:26.732154+0000","last_active":"2024-04-03T05:13:59.121620+0000","last_peered":"2024-04-03T05:13:59.121620+0000","last_clean":"2024-04-03T05:13:59.121620+0000","last_became_active":"2024-04-03T03:38:26.731734+0000","last_became_peered":"2024-04-03T03:38:26.731734+0000","last_unstale":"2024-04-03T05:13:59.121620+0000","last_undegraded":"2024-04-03T05:13:59.121620+0000","last_fullsized":"2024-04-03T05:13:59.121620+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:33:11.766451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2428,"num_write":531,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'276","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.723158+0000","last_change":"2024-04-03T03:38:24.749540+0000","last_active":"2024-04-03T05:14:08.723158+0000","last_peered":"2024-04-03T05:14:08.723158+0000","last_clean":"2024-04-03T05:14:08.723158+0000","last_became_active":"2024-04-03T03:38:24.748646+0000","last_became_peered":"2024-04-03T03:38:24.748646+0000","last_unstale":"2024-04-03T05:14:08.723158+0000","last_undegraded":"2024-04-03T05:14:08.723158+0000","last_fullsized":"2024-04-03T05:14:08.723158+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:57:53.191419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262597,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":630,"num_read_kb":9921,"num_write":1161,"num_write_kb":21025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"35'5","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.028985+0000","last_change":"2024-04-03T03:38:28.733706+0000","last_active":"2024-04-03T05:14:07.028985+0000","last_peered":"2024-04-03T05:14:07.028985+0000","last_clean":"2024-04-03T05:14:07.028985+0000","last_became_active":"2024-04-03T03:38:28.733096+0000","last_became_peered":"2024-04-03T03:38:28.733096+0000","last_unstale":"2024-04-03T05:14:07.028985+0000","last_undegraded":"2024-04-03T05:14:07.028985+0000","last_fullsized":"2024-04-03T05:14:07.028985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:10:00.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":788,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'494","reported_seq":1166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.532717+0000","last_change":"2024-04-03T03:38:30.730692+0000","last_active":"2024-04-03T05:14:07.532717+0000","last_peered":"2024-04-03T05:14:07.532717+0000","last_clean":"2024-04-03T05:14:07.532717+0000","last_became_active":"2024-04-03T03:38:30.729624+0000","last_became_peered":"2024-04-03T03:38:30.729624+0000","last_unstale":"2024-04-03T05:14:07.532717+0000","last_undegraded":"2024-04-03T05:14:07.532717+0000","last_fullsized":"2024-04-03T05:14:07.532717+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:45:22.992777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112540,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":837,"num_read_kb":1824,"num_write":678,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834483+0000","last_change":"2024-04-03T03:38:32.749162+0000","last_active":"2024-04-03T05:11:42.834483+0000","last_peered":"2024-04-03T05:11:42.834483+0000","last_clean":"2024-04-03T05:11:42.834483+0000","last_became_active":"2024-04-03T03:38:32.746634+0000","last_became_peered":"2024-04-03T03:38:32.746634+0000","last_unstale":"2024-04-03T05:11:42.834483+0000","last_undegraded":"2024-04-03T05:11:42.834483+0000","last_fullsized":"2024-04-03T05:11:42.834483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:19:34.062410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'90","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.848438+0000","last_change":"2024-04-03T03:38:34.731395+0000","last_active":"2024-04-03T05:11:47.848438+0000","last_peered":"2024-04-03T05:11:47.848438+0000","last_clean":"2024-04-03T05:11:47.848438+0000","last_became_active":"2024-04-03T03:38:34.730714+0000","last_became_peered":"2024-04-03T03:38:34.730714+0000","last_unstale":"2024-04-03T05:11:47.848438+0000","last_undegraded":"2024-04-03T05:11:47.848438+0000","last_fullsized":"2024-04-03T05:11:47.848438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:51:40.746014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":214,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'707","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:01.902920+0000","last_change":"2024-04-03T03:39:58.685134+0000","last_active":"2024-04-03T05:11:01.902920+0000","last_peered":"2024-04-03T05:11:01.902920+0000","last_clean":"2024-04-03T05:11:01.902920+0000","last_became_active":"2024-04-03T03:39:58.684099+0000","last_became_peered":"2024-04-03T03:39:58.684099+0000","last_unstale":"2024-04-03T05:11:01.902920+0000","last_undegraded":"2024-04-03T05:11:01.902920+0000","last_fullsized":"2024-04-03T05:11:01.902920+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:24.723504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3233,"num_read_kb":2920,"num_write":926,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'281","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.716850+0000","last_change":"2024-04-03T03:38:57.880756+0000","last_active":"2024-04-03T05:14:07.716850+0000","last_peered":"2024-04-03T05:14:07.716850+0000","last_clean":"2024-04-03T05:14:07.716850+0000","last_became_active":"2024-04-03T03:38:57.880334+0000","last_became_peered":"2024-04-03T03:38:57.880334+0000","last_unstale":"2024-04-03T05:14:07.716850+0000","last_undegraded":"2024-04-03T05:14:07.716850+0000","last_fullsized":"2024-04-03T05:14:07.716850+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:59.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8986016,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":480,"num_read_kb":83385,"num_write":1118,"num_write_kb":48172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.823008+0000","last_change":"2024-04-03T03:38:28.735727+0000","last_active":"2024-04-03T05:10:47.823008+0000","last_peered":"2024-04-03T05:10:47.823008+0000","last_clean":"2024-04-03T05:10:47.823008+0000","last_became_active":"2024-04-03T03:38:28.735217+0000","last_became_peered":"2024-04-03T03:38:28.735217+0000","last_unstale":"2024-04-03T05:10:47.823008+0000","last_undegraded":"2024-04-03T05:10:47.823008+0000","last_fullsized":"2024-04-03T05:10:47.823008+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:47.141174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'344","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.588874+0000","last_change":"2024-04-03T03:38:30.717823+0000","last_active":"2024-04-03T05:14:08.588874+0000","last_peered":"2024-04-03T05:14:08.588874+0000","last_clean":"2024-04-03T05:14:08.588874+0000","last_became_active":"2024-04-03T03:38:30.716983+0000","last_became_peered":"2024-04-03T03:38:30.716983+0000","last_unstale":"2024-04-03T05:14:08.588874+0000","last_undegraded":"2024-04-03T05:14:08.588874+0000","last_fullsized":"2024-04-03T05:14:08.588874+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:58:18.745061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78494,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":1274,"num_write":529,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:13.063766+0000","last_change":"2024-04-03T03:38:32.738099+0000","last_active":"2024-04-03T05:11:13.063766+0000","last_peered":"2024-04-03T05:11:13.063766+0000","last_clean":"2024-04-03T05:11:13.063766+0000","last_became_active":"2024-04-03T03:38:32.737619+0000","last_became_peered":"2024-04-03T03:38:32.737619+0000","last_unstale":"2024-04-03T05:11:13.063766+0000","last_undegraded":"2024-04-03T05:11:13.063766+0000","last_fullsized":"2024-04-03T05:11:13.063766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:01.783659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'102","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.044667+0000","last_change":"2024-04-03T03:38:34.755669+0000","last_active":"2024-04-03T05:12:58.044667+0000","last_peered":"2024-04-03T05:12:58.044667+0000","last_clean":"2024-04-03T05:12:58.044667+0000","last_became_active":"2024-04-03T03:38:34.754907+0000","last_became_peered":"2024-04-03T03:38:34.754907+0000","last_unstale":"2024-04-03T05:12:58.044667+0000","last_undegraded":"2024-04-03T05:12:58.044667+0000","last_fullsized":"2024-04-03T05:12:58.044667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:49.625336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":237,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'876","reported_seq":2630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.221358+0000","last_change":"2024-04-03T03:38:26.741422+0000","last_active":"2024-04-03T05:12:22.221358+0000","last_peered":"2024-04-03T05:12:22.221358+0000","last_clean":"2024-04-03T05:12:22.221358+0000","last_became_active":"2024-04-03T03:38:26.740674+0000","last_became_peered":"2024-04-03T03:38:26.740674+0000","last_unstale":"2024-04-03T05:12:22.221358+0000","last_undegraded":"2024-04-03T05:12:22.221358+0000","last_fullsized":"2024-04-03T05:12:22.221358+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:32.052642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4230,"num_read_kb":3805,"num_write":1201,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'251","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.782344+0000","last_change":"2024-04-03T03:38:58.345059+0000","last_active":"2024-04-03T05:14:07.782344+0000","last_peered":"2024-04-03T05:14:07.782344+0000","last_clean":"2024-04-03T05:14:07.782344+0000","last_became_active":"2024-04-03T03:38:58.344044+0000","last_became_peered":"2024-04-03T03:38:58.344044+0000","last_unstale":"2024-04-03T05:14:07.782344+0000","last_undegraded":"2024-04-03T05:14:07.782344+0000","last_fullsized":"2024-04-03T05:14:07.782344+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:56.276421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13392985,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":405,"num_read_kb":45117,"num_write":1082,"num_write_kb":60620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830246+0000","last_change":"2024-04-03T03:38:28.716186+0000","last_active":"2024-04-03T05:10:47.830246+0000","last_peered":"2024-04-03T05:10:47.830246+0000","last_clean":"2024-04-03T05:10:47.830246+0000","last_became_active":"2024-04-03T03:38:28.715394+0000","last_became_peered":"2024-04-03T03:38:28.715394+0000","last_unstale":"2024-04-03T05:10:47.830246+0000","last_undegraded":"2024-04-03T05:10:47.830246+0000","last_fullsized":"2024-04-03T05:10:47.830246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:46.237254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'336","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.730658+0000","last_change":"2024-04-03T03:38:30.733851+0000","last_active":"2024-04-03T05:14:07.730658+0000","last_peered":"2024-04-03T05:14:07.730658+0000","last_clean":"2024-04-03T05:14:07.730658+0000","last_became_active":"2024-04-03T03:38:30.733001+0000","last_became_peered":"2024-04-03T03:38:30.733001+0000","last_unstale":"2024-04-03T05:14:07.730658+0000","last_undegraded":"2024-04-03T05:14:07.730658+0000","last_fullsized":"2024-04-03T05:14:07.730658+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:49:06.273548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1151,"num_write":432,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'498","reported_seq":2366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.497894+0000","last_change":"2024-04-03T03:38:32.741613+0000","last_active":"2024-04-03T05:14:07.497894+0000","last_peered":"2024-04-03T05:14:07.497894+0000","last_clean":"2024-04-03T05:14:07.497894+0000","last_became_active":"2024-04-03T03:38:32.740883+0000","last_became_peered":"2024-04-03T03:38:32.740883+0000","last_unstale":"2024-04-03T05:14:07.497894+0000","last_undegraded":"2024-04-03T05:14:07.497894+0000","last_fullsized":"2024-04-03T05:14:07.497894+0000","mapping_epoch":31,"log_start":"258'400","ondisk_log_start":"258'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:10:34.038922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'91","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:17.980790+0000","last_change":"2024-04-03T03:38:34.749468+0000","last_active":"2024-04-03T05:10:17.980790+0000","last_peered":"2024-04-03T05:10:17.980790+0000","last_clean":"2024-04-03T05:10:17.980790+0000","last_became_active":"2024-04-03T03:38:34.748128+0000","last_became_peered":"2024-04-03T03:38:34.748128+0000","last_unstale":"2024-04-03T05:10:17.980790+0000","last_undegraded":"2024-04-03T05:10:17.980790+0000","last_fullsized":"2024-04-03T05:10:17.980790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:41:37.569030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":229,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'412","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.286549+0000","last_change":"2024-04-03T03:38:26.746310+0000","last_active":"2024-04-03T05:11:29.286549+0000","last_peered":"2024-04-03T05:11:29.286549+0000","last_clean":"2024-04-03T05:11:29.286549+0000","last_became_active":"2024-04-03T03:38:26.742254+0000","last_became_peered":"2024-04-03T03:38:26.742254+0000","last_unstale":"2024-04-03T05:11:29.286549+0000","last_undegraded":"2024-04-03T05:11:29.286549+0000","last_fullsized":"2024-04-03T05:11:29.286549+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:45:43.364326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2115,"num_read_kb":2003,"num_write":485,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'300","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.509714+0000","last_change":"2024-04-03T03:38:24.713564+0000","last_active":"2024-04-03T05:14:08.509714+0000","last_peered":"2024-04-03T05:14:08.509714+0000","last_clean":"2024-04-03T05:14:08.509714+0000","last_became_active":"2024-04-03T03:38:24.710396+0000","last_became_peered":"2024-04-03T03:38:24.710396+0000","last_unstale":"2024-04-03T05:14:08.509714+0000","last_undegraded":"2024-04-03T05:14:08.509714+0000","last_fullsized":"2024-04-03T05:14:08.509714+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:04:14.187436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13922337,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":468,"num_read_kb":39635,"num_write":1222,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.041945+0000","last_change":"2024-04-03T03:38:28.735630+0000","last_active":"2024-04-03T05:14:07.041945+0000","last_peered":"2024-04-03T05:14:07.041945+0000","last_clean":"2024-04-03T05:14:07.041945+0000","last_became_active":"2024-04-03T03:38:28.734894+0000","last_became_peered":"2024-04-03T03:38:28.734894+0000","last_unstale":"2024-04-03T05:14:07.041945+0000","last_undegraded":"2024-04-03T05:14:07.041945+0000","last_fullsized":"2024-04-03T05:14:07.041945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:06.360323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":632,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'126","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013371+0000","last_change":"2024-04-03T03:38:30.822812+0000","last_active":"2024-04-03T05:10:48.013371+0000","last_peered":"2024-04-03T05:10:48.013371+0000","last_clean":"2024-04-03T05:10:48.013371+0000","last_became_active":"2024-04-03T03:38:30.821224+0000","last_became_peered":"2024-04-03T03:38:30.821224+0000","last_unstale":"2024-04-03T05:10:48.013371+0000","last_undegraded":"2024-04-03T05:10:48.013371+0000","last_fullsized":"2024-04-03T05:10:48.013371+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:32:28.000773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'525","reported_seq":2472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.503319+0000","last_change":"2024-04-03T03:38:32.748028+0000","last_active":"2024-04-03T05:14:07.503319+0000","last_peered":"2024-04-03T05:14:07.503319+0000","last_clean":"2024-04-03T05:14:07.503319+0000","last_became_active":"2024-04-03T03:38:32.747078+0000","last_became_peered":"2024-04-03T03:38:32.747078+0000","last_unstale":"2024-04-03T05:14:07.503319+0000","last_undegraded":"2024-04-03T05:14:07.503319+0000","last_fullsized":"2024-04-03T05:14:07.503319+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:21.612026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'98","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:58.857389+0000","last_change":"2024-04-03T03:38:34.740348+0000","last_active":"2024-04-03T05:13:58.857389+0000","last_peered":"2024-04-03T05:13:58.857389+0000","last_clean":"2024-04-03T05:13:58.857389+0000","last_became_active":"2024-04-03T03:38:34.739554+0000","last_became_peered":"2024-04-03T03:38:34.739554+0000","last_unstale":"2024-04-03T05:13:58.857389+0000","last_undegraded":"2024-04-03T05:13:58.857389+0000","last_fullsized":"2024-04-03T05:13:58.857389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:59:41.957959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'345","reported_seq":1750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:07.839480+0000","last_change":"2024-04-03T03:38:26.729619+0000","last_active":"2024-04-03T05:11:07.839480+0000","last_peered":"2024-04-03T05:11:07.839480+0000","last_clean":"2024-04-03T05:11:07.839480+0000","last_became_active":"2024-04-03T03:38:26.729241+0000","last_became_peered":"2024-04-03T03:38:26.729241+0000","last_unstale":"2024-04-03T05:11:07.839480+0000","last_undegraded":"2024-04-03T05:11:07.839480+0000","last_fullsized":"2024-04-03T05:11:07.839480+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:27:27.602414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1840,"num_read_kb":1751,"num_write":396,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'245","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.025576+0000","last_change":"2024-04-03T03:38:24.715501+0000","last_active":"2024-04-03T05:14:08.025576+0000","last_peered":"2024-04-03T05:14:08.025576+0000","last_clean":"2024-04-03T05:14:08.025576+0000","last_became_active":"2024-04-03T03:38:24.709105+0000","last_became_peered":"2024-04-03T03:38:24.709105+0000","last_unstale":"2024-04-03T05:14:08.025576+0000","last_undegraded":"2024-04-03T05:14:08.025576+0000","last_fullsized":"2024-04-03T05:14:08.025576+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:59:29.586390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15092362,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":358,"num_read_kb":67615,"num_write":1013,"num_write_kb":19160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.629640+0000","last_change":"2024-04-03T03:38:28.730578+0000","last_active":"2024-04-03T05:10:43.629640+0000","last_peered":"2024-04-03T05:10:43.629640+0000","last_clean":"2024-04-03T05:10:43.629640+0000","last_became_active":"2024-04-03T03:38:28.729835+0000","last_became_peered":"2024-04-03T03:38:28.729835+0000","last_unstale":"2024-04-03T05:10:43.629640+0000","last_undegraded":"2024-04-03T05:10:43.629640+0000","last_fullsized":"2024-04-03T05:10:43.629640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:23.115894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'507","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.498625+0000","last_change":"2024-04-03T03:38:30.730361+0000","last_active":"2024-04-03T05:14:00.498625+0000","last_peered":"2024-04-03T05:14:00.498625+0000","last_clean":"2024-04-03T05:14:00.498625+0000","last_became_active":"2024-04-03T03:38:30.729797+0000","last_became_peered":"2024-04-03T03:38:30.729797+0000","last_unstale":"2024-04-03T05:14:00.498625+0000","last_undegraded":"2024-04-03T05:14:00.498625+0000","last_fullsized":"2024-04-03T05:14:00.498625+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:13:30.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59692,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1375,"num_read_kb":1864,"num_write":1976,"num_write_kb":1774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.004650+0000","last_change":"2024-04-03T03:38:32.739831+0000","last_active":"2024-04-03T05:10:49.004650+0000","last_peered":"2024-04-03T05:10:49.004650+0000","last_clean":"2024-04-03T05:10:49.004650+0000","last_became_active":"2024-04-03T03:38:32.738974+0000","last_became_peered":"2024-04-03T03:38:32.738974+0000","last_unstale":"2024-04-03T05:10:49.004650+0000","last_undegraded":"2024-04-03T05:10:49.004650+0000","last_fullsized":"2024-04-03T05:10:49.004650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:56.614207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'126","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:17.823774+0000","last_change":"2024-04-03T03:38:34.756154+0000","last_active":"2024-04-03T05:10:17.823774+0000","last_peered":"2024-04-03T05:10:17.823774+0000","last_clean":"2024-04-03T05:10:17.823774+0000","last_became_active":"2024-04-03T03:38:34.755358+0000","last_became_peered":"2024-04-03T03:38:34.755358+0000","last_unstale":"2024-04-03T05:10:17.823774+0000","last_undegraded":"2024-04-03T05:10:17.823774+0000","last_fullsized":"2024-04-03T05:10:17.823774+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:16:30.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":275,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'755","reported_seq":2261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.451786+0000","last_change":"2024-04-03T03:38:26.748524+0000","last_active":"2024-04-03T05:11:08.451786+0000","last_peered":"2024-04-03T05:11:08.451786+0000","last_clean":"2024-04-03T05:11:08.451786+0000","last_became_active":"2024-04-03T03:38:26.747883+0000","last_became_peered":"2024-04-03T03:38:26.747883+0000","last_unstale":"2024-04-03T05:11:08.451786+0000","last_undegraded":"2024-04-03T05:11:08.451786+0000","last_fullsized":"2024-04-03T05:11:08.451786+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:40:23.177113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3405,"num_read_kb":3046,"num_write":999,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026291+0000","last_change":"2024-04-03T03:38:04.257665+0000","last_active":"2024-04-03T05:10:29.026291+0000","last_peered":"2024-04-03T05:10:29.026291+0000","last_clean":"2024-04-03T05:10:29.026291+0000","last_became_active":"2024-04-03T03:38:04.255147+0000","last_became_peered":"2024-04-03T03:38:04.255147+0000","last_unstale":"2024-04-03T05:10:29.026291+0000","last_undegraded":"2024-04-03T05:10:29.026291+0000","last_fullsized":"2024-04-03T05:10:29.026291+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_clean_scrub_stamp":"2024-04-03T03:38:03.047546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:39:28.268533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:58.841142+0000","last_change":"2024-04-03T03:38:11.616774+0000","last_active":"2024-04-03T05:11:58.841142+0000","last_peered":"2024-04-03T05:11:58.841142+0000","last_clean":"2024-04-03T05:11:58.841142+0000","last_became_active":"2024-04-03T03:38:11.615990+0000","last_became_peered":"2024-04-03T03:38:11.615990+0000","last_unstale":"2024-04-03T05:11:58.841142+0000","last_undegraded":"2024-04-03T05:11:58.841142+0000","last_fullsized":"2024-04-03T05:11:58.841142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:31.225680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'231","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.905549+0000","last_change":"2024-04-03T03:38:24.759919+0000","last_active":"2024-04-03T05:14:07.905549+0000","last_peered":"2024-04-03T05:14:07.905549+0000","last_clean":"2024-04-03T05:14:07.905549+0000","last_became_active":"2024-04-03T03:38:24.759653+0000","last_became_peered":"2024-04-03T03:38:24.759653+0000","last_unstale":"2024-04-03T05:14:07.905549+0000","last_undegraded":"2024-04-03T05:14:07.905549+0000","last_fullsized":"2024-04-03T05:14:07.905549+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:41:42.084865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11848079,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":409,"num_read_kb":37025,"num_write":1042,"num_write_kb":41578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:09.021791+0000","last_change":"2024-04-03T03:38:28.738201+0000","last_active":"2024-04-03T05:10:09.021791+0000","last_peered":"2024-04-03T05:10:09.021791+0000","last_clean":"2024-04-03T05:10:09.021791+0000","last_became_active":"2024-04-03T03:38:28.735507+0000","last_became_peered":"2024-04-03T03:38:28.735507+0000","last_unstale":"2024-04-03T05:10:09.021791+0000","last_undegraded":"2024-04-03T05:10:09.021791+0000","last_fullsized":"2024-04-03T05:10:09.021791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:35:10.061515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'727","reported_seq":1455,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.574036+0000","last_change":"2024-04-03T03:38:30.723361+0000","last_active":"2024-04-03T05:14:07.574036+0000","last_peered":"2024-04-03T05:14:07.574036+0000","last_clean":"2024-04-03T05:14:07.574036+0000","last_became_active":"2024-04-03T03:38:30.722613+0000","last_became_peered":"2024-04-03T03:38:30.722613+0000","last_unstale":"2024-04-03T05:14:07.574036+0000","last_undegraded":"2024-04-03T05:14:07.574036+0000","last_fullsized":"2024-04-03T05:14:07.574036+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:07:59.714595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155517,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1404,"num_read_kb":2893,"num_write":1354,"num_write_kb":1181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.070721+0000","last_change":"2024-04-03T03:38:32.747059+0000","last_active":"2024-04-03T05:11:43.070721+0000","last_peered":"2024-04-03T05:11:43.070721+0000","last_clean":"2024-04-03T05:11:43.070721+0000","last_became_active":"2024-04-03T03:38:32.746148+0000","last_became_peered":"2024-04-03T03:38:32.746148+0000","last_unstale":"2024-04-03T05:11:43.070721+0000","last_undegraded":"2024-04-03T05:11:43.070721+0000","last_fullsized":"2024-04-03T05:11:43.070721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:20:36.906339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'114","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.017684+0000","last_change":"2024-04-03T03:38:34.761254+0000","last_active":"2024-04-03T05:11:49.017684+0000","last_peered":"2024-04-03T05:11:49.017684+0000","last_clean":"2024-04-03T05:11:49.017684+0000","last_became_active":"2024-04-03T03:38:34.760522+0000","last_became_peered":"2024-04-03T03:38:34.760522+0000","last_unstale":"2024-04-03T05:11:49.017684+0000","last_undegraded":"2024-04-03T05:11:49.017684+0000","last_fullsized":"2024-04-03T05:11:49.017684+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:48.393317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":148,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'705","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.069042+0000","last_change":"2024-04-03T03:38:26.726518+0000","last_active":"2024-04-03T05:11:38.069042+0000","last_peered":"2024-04-03T05:11:38.069042+0000","last_clean":"2024-04-03T05:11:38.069042+0000","last_became_active":"2024-04-03T03:38:26.725330+0000","last_became_peered":"2024-04-03T03:38:26.725330+0000","last_unstale":"2024-04-03T05:11:38.069042+0000","last_undegraded":"2024-04-03T05:11:38.069042+0000","last_fullsized":"2024-04-03T05:11:38.069042+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":600,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:20:31.608702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3168,"num_read_kb":2822,"num_write":954,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:39.028616+0000","last_change":"2024-04-03T03:38:11.620060+0000","last_active":"2024-04-03T05:10:39.028616+0000","last_peered":"2024-04-03T05:10:39.028616+0000","last_clean":"2024-04-03T05:10:39.028616+0000","last_became_active":"2024-04-03T03:38:11.619474+0000","last_became_peered":"2024-04-03T03:38:11.619474+0000","last_unstale":"2024-04-03T05:10:39.028616+0000","last_undegraded":"2024-04-03T05:10:39.028616+0000","last_fullsized":"2024-04-03T05:10:39.028616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:13:54.362230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'271","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.036834+0000","last_change":"2024-04-03T03:38:24.745584+0000","last_active":"2024-04-03T05:14:08.036834+0000","last_peered":"2024-04-03T05:14:08.036834+0000","last_clean":"2024-04-03T05:14:08.036834+0000","last_became_active":"2024-04-03T03:38:24.745231+0000","last_became_peered":"2024-04-03T03:38:24.745231+0000","last_unstale":"2024-04-03T05:14:08.036834+0000","last_undegraded":"2024-04-03T05:14:08.036834+0000","last_fullsized":"2024-04-03T05:14:08.036834+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:04:43.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8700168,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":405,"num_read_kb":22150,"num_write":1102,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.836656+0000","last_change":"2024-04-03T03:38:28.741133+0000","last_active":"2024-04-03T05:11:38.836656+0000","last_peered":"2024-04-03T05:11:38.836656+0000","last_clean":"2024-04-03T05:11:38.836656+0000","last_became_active":"2024-04-03T03:38:28.740595+0000","last_became_peered":"2024-04-03T03:38:28.740595+0000","last_unstale":"2024-04-03T05:11:38.836656+0000","last_undegraded":"2024-04-03T05:11:38.836656+0000","last_fullsized":"2024-04-03T05:11:38.836656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:29:01.051877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1176","reported_seq":3215,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.557148+0000","last_change":"2024-04-03T03:38:30.725691+0000","last_active":"2024-04-03T05:14:07.557148+0000","last_peered":"2024-04-03T05:14:07.557148+0000","last_clean":"2024-04-03T05:14:07.557148+0000","last_became_active":"2024-04-03T03:38:30.719511+0000","last_became_peered":"2024-04-03T03:38:30.719511+0000","last_unstale":"2024-04-03T05:14:07.557148+0000","last_undegraded":"2024-04-03T05:14:07.557148+0000","last_fullsized":"2024-04-03T05:14:07.557148+0000","mapping_epoch":29,"log_start":"263'1100","ondisk_log_start":"263'1100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:38:42.566363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172439,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1824,"num_read_kb":3282,"num_write":1198,"num_write_kb":991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:39.028804+0000","last_change":"2024-04-03T03:38:32.749446+0000","last_active":"2024-04-03T05:10:39.028804+0000","last_peered":"2024-04-03T05:10:39.028804+0000","last_clean":"2024-04-03T05:10:39.028804+0000","last_became_active":"2024-04-03T03:38:32.748061+0000","last_became_peered":"2024-04-03T03:38:32.748061+0000","last_unstale":"2024-04-03T05:10:39.028804+0000","last_undegraded":"2024-04-03T05:10:39.028804+0000","last_fullsized":"2024-04-03T05:10:39.028804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:27:00.730176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'163","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.820397+0000","last_change":"2024-04-03T03:38:34.937386+0000","last_active":"2024-04-03T05:10:02.820397+0000","last_peered":"2024-04-03T05:10:02.820397+0000","last_clean":"2024-04-03T05:10:02.820397+0000","last_became_active":"2024-04-03T03:38:34.936635+0000","last_became_peered":"2024-04-03T03:38:34.936635+0000","last_unstale":"2024-04-03T05:10:02.820397+0000","last_undegraded":"2024-04-03T05:10:02.820397+0000","last_fullsized":"2024-04-03T05:10:02.820397+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:53:55.693822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":219,"num_write":382,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'394","reported_seq":1830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.114549+0000","last_change":"2024-04-03T03:38:26.722334+0000","last_active":"2024-04-03T05:13:59.114549+0000","last_peered":"2024-04-03T05:13:59.114549+0000","last_clean":"2024-04-03T05:13:59.114549+0000","last_became_active":"2024-04-03T03:38:26.721536+0000","last_became_peered":"2024-04-03T03:38:26.721536+0000","last_unstale":"2024-04-03T05:13:59.114549+0000","last_undegraded":"2024-04-03T05:13:59.114549+0000","last_fullsized":"2024-04-03T05:13:59.114549+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:53.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2077,"num_read_kb":1939,"num_write":478,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:57.837427+0000","last_change":"2024-04-03T03:38:11.755773+0000","last_active":"2024-04-03T05:11:57.837427+0000","last_peered":"2024-04-03T05:11:57.837427+0000","last_clean":"2024-04-03T05:11:57.837427+0000","last_became_active":"2024-04-03T03:38:11.755301+0000","last_became_peered":"2024-04-03T03:38:11.755301+0000","last_unstale":"2024-04-03T05:11:57.837427+0000","last_undegraded":"2024-04-03T05:11:57.837427+0000","last_fullsized":"2024-04-03T05:11:57.837427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:56:40.206707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'248","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.701531+0000","last_change":"2024-04-03T03:38:24.720942+0000","last_active":"2024-04-03T05:14:07.701531+0000","last_peered":"2024-04-03T05:14:07.701531+0000","last_clean":"2024-04-03T05:14:07.701531+0000","last_became_active":"2024-04-03T03:38:24.720445+0000","last_became_peered":"2024-04-03T03:38:24.720445+0000","last_unstale":"2024-04-03T05:14:07.701531+0000","last_undegraded":"2024-04-03T05:14:07.701531+0000","last_fullsized":"2024-04-03T05:14:07.701531+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:22:22.841422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25199529,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":349,"num_read_kb":20915,"num_write":1016,"num_write_kb":36230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834723+0000","last_change":"2024-04-03T03:38:28.734259+0000","last_active":"2024-04-03T05:11:42.834723+0000","last_peered":"2024-04-03T05:11:42.834723+0000","last_clean":"2024-04-03T05:11:42.834723+0000","last_became_active":"2024-04-03T03:38:28.733750+0000","last_became_peered":"2024-04-03T03:38:28.733750+0000","last_unstale":"2024-04-03T05:11:42.834723+0000","last_undegraded":"2024-04-03T05:11:42.834723+0000","last_fullsized":"2024-04-03T05:11:42.834723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:15:52.422170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'331","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:57.929725+0000","last_change":"2024-04-03T03:38:30.824797+0000","last_active":"2024-04-03T05:13:57.929725+0000","last_peered":"2024-04-03T05:13:57.929725+0000","last_clean":"2024-04-03T05:13:57.929725+0000","last_became_active":"2024-04-03T03:38:30.824061+0000","last_became_peered":"2024-04-03T03:38:30.824061+0000","last_unstale":"2024-04-03T05:13:57.929725+0000","last_undegraded":"2024-04-03T05:13:57.929725+0000","last_fullsized":"2024-04-03T05:13:57.929725+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:24.797261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":319,"num_read_kb":311,"num_write":309,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.046912+0000","last_change":"2024-04-03T03:38:32.735866+0000","last_active":"2024-04-03T05:10:13.046912+0000","last_peered":"2024-04-03T05:10:13.046912+0000","last_clean":"2024-04-03T05:10:13.046912+0000","last_became_active":"2024-04-03T03:38:32.735151+0000","last_became_peered":"2024-04-03T03:38:32.735151+0000","last_unstale":"2024-04-03T05:10:13.046912+0000","last_undegraded":"2024-04-03T05:10:13.046912+0000","last_fullsized":"2024-04-03T05:10:13.046912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:48:02.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'192","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014576+0000","last_change":"2024-04-03T03:38:34.732538+0000","last_active":"2024-04-03T05:10:53.014576+0000","last_peered":"2024-04-03T05:10:53.014576+0000","last_clean":"2024-04-03T05:10:53.014576+0000","last_became_active":"2024-04-03T03:38:34.731776+0000","last_became_peered":"2024-04-03T03:38:34.731776+0000","last_unstale":"2024-04-03T05:10:53.014576+0000","last_undegraded":"2024-04-03T05:10:53.014576+0000","last_fullsized":"2024-04-03T05:10:53.014576+0000","mapping_epoch":33,"log_start":"252'100","ondisk_log_start":"252'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:35:06.296897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":349,"num_read_kb":358,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'382","reported_seq":1859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.232691+0000","last_change":"2024-04-03T03:38:26.727951+0000","last_active":"2024-04-03T05:10:55.232691+0000","last_peered":"2024-04-03T05:10:55.232691+0000","last_clean":"2024-04-03T05:10:55.232691+0000","last_became_active":"2024-04-03T03:38:26.727581+0000","last_became_peered":"2024-04-03T03:38:26.727581+0000","last_unstale":"2024-04-03T05:10:55.232691+0000","last_undegraded":"2024-04-03T05:10:55.232691+0000","last_fullsized":"2024-04-03T05:10:55.232691+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:26:22.789971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2147,"num_read_kb":2031,"num_write":458,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:58.841089+0000","last_change":"2024-04-03T03:38:11.614869+0000","last_active":"2024-04-03T05:11:58.841089+0000","last_peered":"2024-04-03T05:11:58.841089+0000","last_clean":"2024-04-03T05:11:58.841089+0000","last_became_active":"2024-04-03T03:38:11.613973+0000","last_became_peered":"2024-04-03T03:38:11.613973+0000","last_unstale":"2024-04-03T05:11:58.841089+0000","last_undegraded":"2024-04-03T05:11:58.841089+0000","last_fullsized":"2024-04-03T05:11:58.841089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:38:53.162490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'261","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.850295+0000","last_change":"2024-04-03T03:38:58.350014+0000","last_active":"2024-04-03T05:14:07.850295+0000","last_peered":"2024-04-03T05:14:07.850295+0000","last_clean":"2024-04-03T05:14:07.850295+0000","last_became_active":"2024-04-03T03:38:58.349561+0000","last_became_peered":"2024-04-03T03:38:58.349561+0000","last_unstale":"2024-04-03T05:14:07.850295+0000","last_undegraded":"2024-04-03T05:14:07.850295+0000","last_fullsized":"2024-04-03T05:14:07.850295+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:53:53.418209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12038047,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":422,"num_read_kb":36392,"num_write":993,"num_write_kb":30181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.055575+0000","last_change":"2024-04-03T03:38:28.713016+0000","last_active":"2024-04-03T05:10:38.055575+0000","last_peered":"2024-04-03T05:10:38.055575+0000","last_clean":"2024-04-03T05:10:38.055575+0000","last_became_active":"2024-04-03T03:38:28.711551+0000","last_became_peered":"2024-04-03T03:38:28.711551+0000","last_unstale":"2024-04-03T05:10:38.055575+0000","last_undegraded":"2024-04-03T05:10:38.055575+0000","last_fullsized":"2024-04-03T05:10:38.055575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:02:00.901908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'182","reported_seq":776,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.056299+0000","last_change":"2024-04-03T03:38:30.718183+0000","last_active":"2024-04-03T05:13:53.056299+0000","last_peered":"2024-04-03T05:13:53.056299+0000","last_clean":"2024-04-03T05:13:53.056299+0000","last_became_active":"2024-04-03T03:38:30.717437+0000","last_became_peered":"2024-04-03T03:38:30.717437+0000","last_unstale":"2024-04-03T05:13:53.056299+0000","last_undegraded":"2024-04-03T05:13:53.056299+0000","last_fullsized":"2024-04-03T05:13:53.056299+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:19:51.986312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":238,"num_read_kb":232,"num_write":176,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:44.016713+0000","last_change":"2024-04-03T03:38:32.740103+0000","last_active":"2024-04-03T05:11:44.016713+0000","last_peered":"2024-04-03T05:11:44.016713+0000","last_clean":"2024-04-03T05:11:44.016713+0000","last_became_active":"2024-04-03T03:38:32.739201+0000","last_became_peered":"2024-04-03T03:38:32.739201+0000","last_unstale":"2024-04-03T05:11:44.016713+0000","last_undegraded":"2024-04-03T05:11:44.016713+0000","last_fullsized":"2024-04-03T05:11:44.016713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:29.389145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.838705+0000","last_change":"2024-04-03T03:38:34.755897+0000","last_active":"2024-04-03T05:11:48.838705+0000","last_peered":"2024-04-03T05:11:48.838705+0000","last_clean":"2024-04-03T05:11:48.838705+0000","last_became_active":"2024-04-03T03:38:34.749642+0000","last_became_peered":"2024-04-03T03:38:34.749642+0000","last_unstale":"2024-04-03T05:11:48.838705+0000","last_undegraded":"2024-04-03T05:11:48.838705+0000","last_fullsized":"2024-04-03T05:11:48.838705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:24:40.979283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":197,"num_write":285,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'481","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:01.899466+0000","last_change":"2024-04-03T03:38:26.720851+0000","last_active":"2024-04-03T05:11:01.899466+0000","last_peered":"2024-04-03T05:11:01.899466+0000","last_clean":"2024-04-03T05:11:01.899466+0000","last_became_active":"2024-04-03T03:38:26.720476+0000","last_became_peered":"2024-04-03T03:38:26.720476+0000","last_unstale":"2024-04-03T05:11:01.899466+0000","last_undegraded":"2024-04-03T05:11:01.899466+0000","last_fullsized":"2024-04-03T05:11:01.899466+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:16:11.552164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2351,"num_write":586,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'279","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.687975+0000","last_change":"2024-04-03T03:38:24.749672+0000","last_active":"2024-04-03T05:14:08.687975+0000","last_peered":"2024-04-03T05:14:08.687975+0000","last_clean":"2024-04-03T05:14:08.687975+0000","last_became_active":"2024-04-03T03:38:24.748412+0000","last_became_peered":"2024-04-03T03:38:24.748412+0000","last_unstale":"2024-04-03T05:14:08.687975+0000","last_undegraded":"2024-04-03T05:14:08.687975+0000","last_fullsized":"2024-04-03T05:14:08.687975+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:46.714828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4595649,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":640,"num_read_kb":11584,"num_write":1120,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:57.850522+0000","last_change":"2024-04-03T03:38:11.611219+0000","last_active":"2024-04-03T05:11:57.850522+0000","last_peered":"2024-04-03T05:11:57.850522+0000","last_clean":"2024-04-03T05:11:57.850522+0000","last_became_active":"2024-04-03T03:38:11.609995+0000","last_became_peered":"2024-04-03T03:38:11.609995+0000","last_unstale":"2024-04-03T05:11:57.850522+0000","last_undegraded":"2024-04-03T05:11:57.850522+0000","last_fullsized":"2024-04-03T05:11:57.850522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:52:03.961331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'3","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.030519+0000","last_change":"2024-04-03T03:38:28.717488+0000","last_active":"2024-04-03T05:14:07.030519+0000","last_peered":"2024-04-03T05:14:07.030519+0000","last_clean":"2024-04-03T05:14:07.030519+0000","last_became_active":"2024-04-03T03:38:28.716761+0000","last_became_peered":"2024-04-03T03:38:28.716761+0000","last_unstale":"2024-04-03T05:14:07.030519+0000","last_undegraded":"2024-04-03T05:14:07.030519+0000","last_fullsized":"2024-04-03T05:14:07.030519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:16:55.208823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":482,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'610","reported_seq":1331,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.554792+0000","last_change":"2024-04-03T03:38:30.731606+0000","last_active":"2024-04-03T05:14:07.554792+0000","last_peered":"2024-04-03T05:14:07.554792+0000","last_clean":"2024-04-03T05:14:07.554792+0000","last_became_active":"2024-04-03T03:38:30.731186+0000","last_became_peered":"2024-04-03T03:38:30.731186+0000","last_unstale":"2024-04-03T05:14:07.554792+0000","last_undegraded":"2024-04-03T05:14:07.554792+0000","last_fullsized":"2024-04-03T05:14:07.554792+0000","mapping_epoch":29,"log_start":"263'500","ondisk_log_start":"263'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":500,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:47:57.629875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1041,"num_read_kb":2138,"num_write":838,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.622768+0000","last_change":"2024-04-03T03:38:32.726283+0000","last_active":"2024-04-03T05:10:13.622768+0000","last_peered":"2024-04-03T05:10:13.622768+0000","last_clean":"2024-04-03T05:10:13.622768+0000","last_became_active":"2024-04-03T03:38:32.725549+0000","last_became_peered":"2024-04-03T03:38:32.725549+0000","last_unstale":"2024-04-03T05:10:13.622768+0000","last_undegraded":"2024-04-03T05:10:13.622768+0000","last_fullsized":"2024-04-03T05:10:13.622768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:58.188714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'103","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.246058+0000","last_change":"2024-04-03T03:38:34.940294+0000","last_active":"2024-04-03T05:10:55.246058+0000","last_peered":"2024-04-03T05:10:55.246058+0000","last_clean":"2024-04-03T05:10:55.246058+0000","last_became_active":"2024-04-03T03:38:34.939419+0000","last_became_peered":"2024-04-03T03:38:34.939419+0000","last_unstale":"2024-04-03T05:10:55.246058+0000","last_undegraded":"2024-04-03T05:10:55.246058+0000","last_fullsized":"2024-04-03T05:10:55.246058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:30:08.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":118,"num_write":243,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'842","reported_seq":2346,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.076939+0000","last_change":"2024-04-03T03:38:26.732400+0000","last_active":"2024-04-03T05:12:13.076939+0000","last_peered":"2024-04-03T05:12:13.076939+0000","last_clean":"2024-04-03T05:12:13.076939+0000","last_became_active":"2024-04-03T03:38:26.731406+0000","last_became_peered":"2024-04-03T03:38:26.731406+0000","last_unstale":"2024-04-03T05:12:13.076939+0000","last_undegraded":"2024-04-03T05:12:13.076939+0000","last_fullsized":"2024-04-03T05:12:13.076939+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:49.785408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3757,"num_read_kb":3345,"num_write":1171,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'266","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.806904+0000","last_change":"2024-04-03T03:38:24.722172+0000","last_active":"2024-04-03T05:14:07.806904+0000","last_peered":"2024-04-03T05:14:07.806904+0000","last_clean":"2024-04-03T05:14:07.806904+0000","last_became_active":"2024-04-03T03:38:24.721685+0000","last_became_peered":"2024-04-03T03:38:24.721685+0000","last_unstale":"2024-04-03T05:14:07.806904+0000","last_undegraded":"2024-04-03T05:14:07.806904+0000","last_fullsized":"2024-04-03T05:14:07.806904+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:39.493128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4488322,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":379,"num_read_kb":12381,"num_write":1173,"num_write_kb":30338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:19.024098+0000","last_change":"2024-04-03T03:38:11.618107+0000","last_active":"2024-04-03T05:10:19.024098+0000","last_peered":"2024-04-03T05:10:19.024098+0000","last_clean":"2024-04-03T05:10:19.024098+0000","last_became_active":"2024-04-03T03:38:11.617057+0000","last_became_peered":"2024-04-03T03:38:11.617057+0000","last_unstale":"2024-04-03T05:10:19.024098+0000","last_undegraded":"2024-04-03T05:10:19.024098+0000","last_fullsized":"2024-04-03T05:10:19.024098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:22:38.744380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.996201+0000","last_change":"2024-04-03T03:38:28.720480+0000","last_active":"2024-04-03T05:10:08.996201+0000","last_peered":"2024-04-03T05:10:08.996201+0000","last_clean":"2024-04-03T05:10:08.996201+0000","last_became_active":"2024-04-03T03:38:28.719394+0000","last_became_peered":"2024-04-03T03:38:28.719394+0000","last_unstale":"2024-04-03T05:10:08.996201+0000","last_undegraded":"2024-04-03T05:10:08.996201+0000","last_fullsized":"2024-04-03T05:10:08.996201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:06.496312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'307","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:17.854662+0000","last_change":"2024-04-03T03:38:30.822163+0000","last_active":"2024-04-03T05:12:17.854662+0000","last_peered":"2024-04-03T05:12:17.854662+0000","last_clean":"2024-04-03T05:12:17.854662+0000","last_became_active":"2024-04-03T03:38:30.821297+0000","last_became_peered":"2024-04-03T03:38:30.821297+0000","last_unstale":"2024-04-03T05:12:17.854662+0000","last_undegraded":"2024-04-03T05:12:17.854662+0000","last_fullsized":"2024-04-03T05:12:17.854662+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:12.866281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":386,"num_write":374,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'552","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.491148+0000","last_change":"2024-04-03T03:38:32.748169+0000","last_active":"2024-04-03T05:14:07.491148+0000","last_peered":"2024-04-03T05:14:07.491148+0000","last_clean":"2024-04-03T05:14:07.491148+0000","last_became_active":"2024-04-03T03:38:32.747292+0000","last_became_peered":"2024-04-03T03:38:32.747292+0000","last_unstale":"2024-04-03T05:14:07.491148+0000","last_undegraded":"2024-04-03T05:14:07.491148+0000","last_fullsized":"2024-04-03T05:14:07.491148+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:43.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'90","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.050986+0000","last_change":"2024-04-03T03:38:34.936362+0000","last_active":"2024-04-03T05:13:28.050986+0000","last_peered":"2024-04-03T05:13:28.050986+0000","last_clean":"2024-04-03T05:13:28.050986+0000","last_became_active":"2024-04-03T03:38:34.935593+0000","last_became_peered":"2024-04-03T03:38:34.935593+0000","last_unstale":"2024-04-03T05:13:28.050986+0000","last_undegraded":"2024-04-03T05:13:28.050986+0000","last_fullsized":"2024-04-03T05:13:28.050986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:15.143724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":828,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":224,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'421","reported_seq":1889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013119+0000","last_change":"2024-04-03T03:38:26.717074+0000","last_active":"2024-04-03T05:10:48.013119+0000","last_peered":"2024-04-03T05:10:48.013119+0000","last_clean":"2024-04-03T05:10:48.013119+0000","last_became_active":"2024-04-03T03:38:26.716004+0000","last_became_peered":"2024-04-03T03:38:26.716004+0000","last_unstale":"2024-04-03T05:10:48.013119+0000","last_undegraded":"2024-04-03T05:10:48.013119+0000","last_fullsized":"2024-04-03T05:10:48.013119+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:35.702121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":2164,"num_write":539,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'278","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.959970+0000","last_change":"2024-04-03T03:38:24.728339+0000","last_active":"2024-04-03T05:14:07.959970+0000","last_peered":"2024-04-03T05:14:07.959970+0000","last_clean":"2024-04-03T05:14:07.959970+0000","last_became_active":"2024-04-03T03:38:24.727736+0000","last_became_peered":"2024-04-03T03:38:24.727736+0000","last_unstale":"2024-04-03T05:14:07.959970+0000","last_undegraded":"2024-04-03T05:14:07.959970+0000","last_fullsized":"2024-04-03T05:14:07.959970+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:59:04.813514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285493,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":462,"num_read_kb":37307,"num_write":1162,"num_write_kb":23236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.843088+0000","last_change":"2024-04-03T03:38:11.613510+0000","last_active":"2024-04-03T05:11:22.843088+0000","last_peered":"2024-04-03T05:11:22.843088+0000","last_clean":"2024-04-03T05:11:22.843088+0000","last_became_active":"2024-04-03T03:38:11.613252+0000","last_became_peered":"2024-04-03T03:38:11.613252+0000","last_unstale":"2024-04-03T05:11:22.843088+0000","last_undegraded":"2024-04-03T05:11:22.843088+0000","last_fullsized":"2024-04-03T05:11:22.843088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:56:15.329216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.621550+0000","last_change":"2024-04-03T03:38:28.722584+0000","last_active":"2024-04-03T05:10:08.621550+0000","last_peered":"2024-04-03T05:10:08.621550+0000","last_clean":"2024-04-03T05:10:08.621550+0000","last_became_active":"2024-04-03T03:38:28.721796+0000","last_became_peered":"2024-04-03T03:38:28.721796+0000","last_unstale":"2024-04-03T05:10:08.621550+0000","last_undegraded":"2024-04-03T05:10:08.621550+0000","last_fullsized":"2024-04-03T05:10:08.621550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:50.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'166","reported_seq":755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.622863+0000","last_change":"2024-04-03T03:38:30.719677+0000","last_active":"2024-04-03T05:10:13.622863+0000","last_peered":"2024-04-03T05:10:13.622863+0000","last_clean":"2024-04-03T05:10:13.622863+0000","last_became_active":"2024-04-03T03:38:30.718913+0000","last_became_peered":"2024-04-03T03:38:30.718913+0000","last_unstale":"2024-04-03T05:10:13.622863+0000","last_undegraded":"2024-04-03T05:10:13.622863+0000","last_fullsized":"2024-04-03T05:10:13.622863+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:08:10.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":144,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'552","reported_seq":2668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.503414+0000","last_change":"2024-04-03T03:38:32.744373+0000","last_active":"2024-04-03T05:14:07.503414+0000","last_peered":"2024-04-03T05:14:07.503414+0000","last_clean":"2024-04-03T05:14:07.503414+0000","last_became_active":"2024-04-03T03:38:32.743829+0000","last_became_peered":"2024-04-03T03:38:32.743829+0000","last_unstale":"2024-04-03T05:14:07.503414+0000","last_undegraded":"2024-04-03T05:14:07.503414+0000","last_fullsized":"2024-04-03T05:14:07.503414+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:07:40.400539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'94","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.059107+0000","last_change":"2024-04-03T03:38:34.747164+0000","last_active":"2024-04-03T05:10:53.059107+0000","last_peered":"2024-04-03T05:10:53.059107+0000","last_clean":"2024-04-03T05:10:53.059107+0000","last_became_active":"2024-04-03T03:38:34.746249+0000","last_became_peered":"2024-04-03T03:38:34.746249+0000","last_unstale":"2024-04-03T05:10:53.059107+0000","last_undegraded":"2024-04-03T05:10:53.059107+0000","last_fullsized":"2024-04-03T05:10:53.059107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:25:14.477982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":217,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1105","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398899+0000","last_change":"2024-04-03T03:38:26.741936+0000","last_active":"2024-04-03T05:11:18.398899+0000","last_peered":"2024-04-03T05:11:18.398899+0000","last_clean":"2024-04-03T05:11:18.398899+0000","last_became_active":"2024-04-03T03:38:26.741272+0000","last_became_peered":"2024-04-03T03:38:26.741272+0000","last_unstale":"2024-04-03T05:11:18.398899+0000","last_undegraded":"2024-04-03T05:11:18.398899+0000","last_fullsized":"2024-04-03T05:11:18.398899+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:11:49.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4771,"num_read_kb":4189,"num_write":1521,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'267","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.074588+0000","last_change":"2024-04-03T03:38:24.747700+0000","last_active":"2024-04-03T05:14:08.074588+0000","last_peered":"2024-04-03T05:14:08.074588+0000","last_clean":"2024-04-03T05:14:08.074588+0000","last_became_active":"2024-04-03T03:38:24.747145+0000","last_became_peered":"2024-04-03T03:38:24.747145+0000","last_unstale":"2024-04-03T05:14:08.074588+0000","last_undegraded":"2024-04-03T05:14:08.074588+0000","last_fullsized":"2024-04-03T05:14:08.074588+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:03:58.509965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8850535,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":347,"num_read_kb":38174,"num_write":1012,"num_write_kb":41152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012441+0000","last_change":"2024-04-03T03:38:11.618291+0000","last_active":"2024-04-03T05:11:24.012441+0000","last_peered":"2024-04-03T05:11:24.012441+0000","last_clean":"2024-04-03T05:11:24.012441+0000","last_became_active":"2024-04-03T03:38:11.617573+0000","last_became_peered":"2024-04-03T03:38:11.617573+0000","last_unstale":"2024-04-03T05:11:24.012441+0000","last_undegraded":"2024-04-03T05:11:24.012441+0000","last_fullsized":"2024-04-03T05:11:24.012441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:12:17.137777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014435+0000","last_change":"2024-04-03T03:38:28.734000+0000","last_active":"2024-04-03T05:10:53.014435+0000","last_peered":"2024-04-03T05:10:53.014435+0000","last_clean":"2024-04-03T05:10:53.014435+0000","last_became_active":"2024-04-03T03:38:28.733237+0000","last_became_peered":"2024-04-03T03:38:28.733237+0000","last_unstale":"2024-04-03T05:10:53.014435+0000","last_undegraded":"2024-04-03T05:10:53.014435+0000","last_fullsized":"2024-04-03T05:10:53.014435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:17.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'789","reported_seq":1555,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.037369+0000","last_change":"2024-04-03T03:38:30.823414+0000","last_active":"2024-04-03T05:14:09.037369+0000","last_peered":"2024-04-03T05:14:09.037369+0000","last_clean":"2024-04-03T05:14:09.037369+0000","last_became_active":"2024-04-03T03:38:30.822610+0000","last_became_peered":"2024-04-03T03:38:30.822610+0000","last_unstale":"2024-04-03T05:14:09.037369+0000","last_undegraded":"2024-04-03T05:14:09.037369+0000","last_fullsized":"2024-04-03T05:14:09.037369+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:08:41.961174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161519,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1384,"num_read_kb":3113,"num_write":1121,"num_write_kb":887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.004685+0000","last_change":"2024-04-03T03:38:32.729501+0000","last_active":"2024-04-03T05:10:13.004685+0000","last_peered":"2024-04-03T05:10:13.004685+0000","last_clean":"2024-04-03T05:10:13.004685+0000","last_became_active":"2024-04-03T03:38:32.728874+0000","last_became_peered":"2024-04-03T03:38:32.728874+0000","last_unstale":"2024-04-03T05:10:13.004685+0000","last_undegraded":"2024-04-03T05:10:13.004685+0000","last_fullsized":"2024-04-03T05:10:13.004685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:13:52.894350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'104","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.296042+0000","last_change":"2024-04-03T03:38:34.757708+0000","last_active":"2024-04-03T05:11:29.296042+0000","last_peered":"2024-04-03T05:11:29.296042+0000","last_clean":"2024-04-03T05:11:29.296042+0000","last_became_active":"2024-04-03T03:38:34.756936+0000","last_became_peered":"2024-04-03T03:38:34.756936+0000","last_unstale":"2024-04-03T05:11:29.296042+0000","last_undegraded":"2024-04-03T05:11:29.296042+0000","last_fullsized":"2024-04-03T05:11:29.296042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:39.973669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'144","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.051218+0000","last_change":"2024-04-03T03:38:34.760408+0000","last_active":"2024-04-03T05:10:18.051218+0000","last_peered":"2024-04-03T05:10:18.051218+0000","last_clean":"2024-04-03T05:10:18.051218+0000","last_became_active":"2024-04-03T03:38:34.759767+0000","last_became_peered":"2024-04-03T03:38:34.759767+0000","last_unstale":"2024-04-03T05:10:18.051218+0000","last_undegraded":"2024-04-03T05:10:18.051218+0000","last_fullsized":"2024-04-03T05:10:18.051218+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:27:11.459564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":108,"num_write":250,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'826","reported_seq":2402,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.643808+0000","last_change":"2024-04-03T03:38:26.741454+0000","last_active":"2024-04-03T05:11:48.643808+0000","last_peered":"2024-04-03T05:11:48.643808+0000","last_clean":"2024-04-03T05:11:48.643808+0000","last_became_active":"2024-04-03T03:38:26.740732+0000","last_became_peered":"2024-04-03T03:38:26.740732+0000","last_unstale":"2024-04-03T05:11:48.643808+0000","last_undegraded":"2024-04-03T05:11:48.643808+0000","last_fullsized":"2024-04-03T05:11:48.643808+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:26.379990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3680,"num_read_kb":3271,"num_write":1116,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'304","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.597696+0000","last_change":"2024-04-03T03:38:24.741664+0000","last_active":"2024-04-03T05:14:08.597696+0000","last_peered":"2024-04-03T05:14:08.597696+0000","last_clean":"2024-04-03T05:14:08.597696+0000","last_became_active":"2024-04-03T03:38:24.740900+0000","last_became_peered":"2024-04-03T03:38:24.740900+0000","last_unstale":"2024-04-03T05:14:08.597696+0000","last_undegraded":"2024-04-03T05:14:08.597696+0000","last_fullsized":"2024-04-03T05:14:08.597696+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:54:13.177313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10742918,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":563,"num_read_kb":65764,"num_write":1202,"num_write_kb":26843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:32.813587+0000","last_change":"2024-04-03T03:38:28.725751+0000","last_active":"2024-04-03T05:09:32.813587+0000","last_peered":"2024-04-03T05:09:32.813587+0000","last_clean":"2024-04-03T05:09:32.813587+0000","last_became_active":"2024-04-03T03:38:28.725020+0000","last_became_peered":"2024-04-03T03:38:28.725020+0000","last_unstale":"2024-04-03T05:09:32.813587+0000","last_undegraded":"2024-04-03T05:09:32.813587+0000","last_fullsized":"2024-04-03T05:09:32.813587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:26:47.268104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'305","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.511944+0000","last_change":"2024-04-03T03:38:30.730341+0000","last_active":"2024-04-03T05:14:00.511944+0000","last_peered":"2024-04-03T05:14:00.511944+0000","last_clean":"2024-04-03T05:14:00.511944+0000","last_became_active":"2024-04-03T03:38:30.729608+0000","last_became_peered":"2024-04-03T03:38:30.729608+0000","last_unstale":"2024-04-03T05:14:00.511944+0000","last_undegraded":"2024-04-03T05:14:00.511944+0000","last_fullsized":"2024-04-03T05:14:00.511944+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:12:36.054464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49761,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":488,"num_read_kb":954,"num_write":384,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:32.995494+0000","last_change":"2024-04-03T03:38:32.746511+0000","last_active":"2024-04-03T05:09:32.995494+0000","last_peered":"2024-04-03T05:09:32.995494+0000","last_clean":"2024-04-03T05:09:32.995494+0000","last_became_active":"2024-04-03T03:38:32.744256+0000","last_became_peered":"2024-04-03T03:38:32.744256+0000","last_unstale":"2024-04-03T05:09:32.995494+0000","last_undegraded":"2024-04-03T05:09:32.995494+0000","last_fullsized":"2024-04-03T05:09:32.995494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:40:51.923207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'108","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.015981+0000","last_change":"2024-04-03T03:38:34.737865+0000","last_active":"2024-04-03T05:10:58.015981+0000","last_peered":"2024-04-03T05:10:58.015981+0000","last_clean":"2024-04-03T05:10:58.015981+0000","last_became_active":"2024-04-03T03:38:34.736176+0000","last_became_peered":"2024-04-03T03:38:34.736176+0000","last_unstale":"2024-04-03T05:10:58.015981+0000","last_undegraded":"2024-04-03T05:10:58.015981+0000","last_fullsized":"2024-04-03T05:10:58.015981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:17:39.580695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":259,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'759","reported_seq":2571,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.848276+0000","last_change":"2024-04-03T03:38:26.720574+0000","last_active":"2024-04-03T05:11:47.848276+0000","last_peered":"2024-04-03T05:11:47.848276+0000","last_clean":"2024-04-03T05:11:47.848276+0000","last_became_active":"2024-04-03T03:38:26.720106+0000","last_became_peered":"2024-04-03T03:38:26.720106+0000","last_unstale":"2024-04-03T05:11:47.848276+0000","last_undegraded":"2024-04-03T05:11:47.848276+0000","last_fullsized":"2024-04-03T05:11:47.848276+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:10:18.194606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3508,"num_write":1155,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'302","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.924918+0000","last_change":"2024-04-03T03:38:57.883863+0000","last_active":"2024-04-03T05:14:08.924918+0000","last_peered":"2024-04-03T05:14:08.924918+0000","last_clean":"2024-04-03T05:14:08.924918+0000","last_became_active":"2024-04-03T03:38:57.882607+0000","last_became_peered":"2024-04-03T03:38:57.882607+0000","last_unstale":"2024-04-03T05:14:08.924918+0000","last_undegraded":"2024-04-03T05:14:08.924918+0000","last_fullsized":"2024-04-03T05:14:08.924918+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:06:53.732174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18518996,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":576,"num_read_kb":85963,"num_write":1239,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:32.995750+0000","last_change":"2024-04-03T03:38:28.723791+0000","last_active":"2024-04-03T05:09:32.995750+0000","last_peered":"2024-04-03T05:09:32.995750+0000","last_clean":"2024-04-03T05:09:32.995750+0000","last_became_active":"2024-04-03T03:38:28.723082+0000","last_became_peered":"2024-04-03T03:38:28.723082+0000","last_unstale":"2024-04-03T05:09:32.995750+0000","last_undegraded":"2024-04-03T05:09:32.995750+0000","last_fullsized":"2024-04-03T05:09:32.995750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:47:02.690730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:33.037838+0000","last_change":"2024-04-03T03:38:30.730377+0000","last_active":"2024-04-03T05:09:33.037838+0000","last_peered":"2024-04-03T05:09:33.037838+0000","last_clean":"2024-04-03T05:09:33.037838+0000","last_became_active":"2024-04-03T03:38:30.729412+0000","last_became_peered":"2024-04-03T03:38:30.729412+0000","last_unstale":"2024-04-03T05:09:33.037838+0000","last_undegraded":"2024-04-03T05:09:33.037838+0000","last_fullsized":"2024-04-03T05:09:33.037838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:49:48.699386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":60,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:34.013641+0000","last_change":"2024-04-03T03:38:32.748751+0000","last_active":"2024-04-03T05:09:34.013641+0000","last_peered":"2024-04-03T05:09:34.013641+0000","last_clean":"2024-04-03T05:09:34.013641+0000","last_became_active":"2024-04-03T03:38:32.747294+0000","last_became_peered":"2024-04-03T03:38:32.747294+0000","last_unstale":"2024-04-03T05:09:34.013641+0000","last_undegraded":"2024-04-03T05:09:34.013641+0000","last_fullsized":"2024-04-03T05:09:34.013641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:27.522363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'97","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062855+0000","last_change":"2024-04-03T03:38:34.739547+0000","last_active":"2024-04-03T05:11:08.062855+0000","last_peered":"2024-04-03T05:11:08.062855+0000","last_clean":"2024-04-03T05:11:08.062855+0000","last_became_active":"2024-04-03T03:38:34.737841+0000","last_became_peered":"2024-04-03T03:38:34.737841+0000","last_unstale":"2024-04-03T05:11:08.062855+0000","last_undegraded":"2024-04-03T05:11:08.062855+0000","last_fullsized":"2024-04-03T05:11:08.062855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:58:36.235149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":225,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'410","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.027664+0000","last_change":"2024-04-03T03:38:26.720039+0000","last_active":"2024-04-03T05:11:48.027664+0000","last_peered":"2024-04-03T05:11:48.027664+0000","last_clean":"2024-04-03T05:11:48.027664+0000","last_became_active":"2024-04-03T03:38:26.715716+0000","last_became_peered":"2024-04-03T03:38:26.715716+0000","last_unstale":"2024-04-03T05:11:48.027664+0000","last_undegraded":"2024-04-03T05:11:48.027664+0000","last_fullsized":"2024-04-03T05:11:48.027664+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:34.026023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2104,"num_read_kb":1969,"num_write":502,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'398","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.649394+0000","last_change":"2024-04-03T03:38:24.742857+0000","last_active":"2024-04-03T05:14:08.649394+0000","last_peered":"2024-04-03T05:14:08.649394+0000","last_clean":"2024-04-03T05:14:08.649394+0000","last_became_active":"2024-04-03T03:38:24.737281+0000","last_became_peered":"2024-04-03T03:38:24.737281+0000","last_unstale":"2024-04-03T05:14:08.649394+0000","last_undegraded":"2024-04-03T05:14:08.649394+0000","last_fullsized":"2024-04-03T05:14:08.649394+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:25:22.407147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9888688,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":722,"num_read_kb":29465,"num_write":1348,"num_write_kb":33665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.044403+0000","last_change":"2024-04-03T03:38:28.735969+0000","last_active":"2024-04-03T05:11:49.044403+0000","last_peered":"2024-04-03T05:11:49.044403+0000","last_clean":"2024-04-03T05:11:49.044403+0000","last_became_active":"2024-04-03T03:38:28.735156+0000","last_became_peered":"2024-04-03T03:38:28.735156+0000","last_unstale":"2024-04-03T05:11:49.044403+0000","last_undegraded":"2024-04-03T05:11:49.044403+0000","last_fullsized":"2024-04-03T05:11:49.044403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:53.609411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'320","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.478593+0000","last_change":"2024-04-03T03:38:30.734504+0000","last_active":"2024-04-03T05:14:00.478593+0000","last_peered":"2024-04-03T05:14:00.478593+0000","last_clean":"2024-04-03T05:14:00.478593+0000","last_became_active":"2024-04-03T03:38:30.733682+0000","last_became_peered":"2024-04-03T03:38:30.733682+0000","last_unstale":"2024-04-03T05:14:00.478593+0000","last_undegraded":"2024-04-03T05:14:00.478593+0000","last_fullsized":"2024-04-03T05:14:00.478593+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:34:59.488858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50383,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":1019,"num_write":416,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:33.987763+0000","last_change":"2024-04-03T03:38:32.734561+0000","last_active":"2024-04-03T05:09:33.987763+0000","last_peered":"2024-04-03T05:09:33.987763+0000","last_clean":"2024-04-03T05:09:33.987763+0000","last_became_active":"2024-04-03T03:38:32.733728+0000","last_became_peered":"2024-04-03T03:38:32.733728+0000","last_unstale":"2024-04-03T05:09:33.987763+0000","last_undegraded":"2024-04-03T05:09:33.987763+0000","last_fullsized":"2024-04-03T05:09:33.987763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:55:41.581847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'152","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.830070+0000","last_change":"2024-04-03T03:38:34.756727+0000","last_active":"2024-04-03T05:11:08.830070+0000","last_peered":"2024-04-03T05:11:08.830070+0000","last_clean":"2024-04-03T05:11:08.830070+0000","last_became_active":"2024-04-03T03:38:34.755929+0000","last_became_peered":"2024-04-03T03:38:34.755929+0000","last_unstale":"2024-04-03T05:11:08.830070+0000","last_undegraded":"2024-04-03T05:11:08.830070+0000","last_fullsized":"2024-04-03T05:11:08.830070+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:41.464119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":91,"num_write":329,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'735","reported_seq":2109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.027568+0000","last_change":"2024-04-03T03:38:26.724380+0000","last_active":"2024-04-03T05:11:48.027568+0000","last_peered":"2024-04-03T05:11:48.027568+0000","last_clean":"2024-04-03T05:11:48.027568+0000","last_became_active":"2024-04-03T03:38:26.723758+0000","last_became_peered":"2024-04-03T03:38:26.723758+0000","last_unstale":"2024-04-03T05:11:48.027568+0000","last_undegraded":"2024-04-03T05:11:48.027568+0000","last_fullsized":"2024-04-03T05:11:48.027568+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:31.930788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3210,"num_read_kb":2838,"num_write":998,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'300","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.001046+0000","last_change":"2024-04-03T03:38:24.740315+0000","last_active":"2024-04-03T05:14:08.001046+0000","last_peered":"2024-04-03T05:14:08.001046+0000","last_clean":"2024-04-03T05:14:08.001046+0000","last_became_active":"2024-04-03T03:38:24.739968+0000","last_became_peered":"2024-04-03T03:38:24.739968+0000","last_unstale":"2024-04-03T05:14:08.001046+0000","last_undegraded":"2024-04-03T05:14:08.001046+0000","last_fullsized":"2024-04-03T05:14:08.001046+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:36:09.717326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5500171,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":555,"num_read_kb":31745,"num_write":1138,"num_write_kb":30139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.017719+0000","last_change":"2024-04-03T03:38:28.724693+0000","last_active":"2024-04-03T05:11:49.017719+0000","last_peered":"2024-04-03T05:11:49.017719+0000","last_clean":"2024-04-03T05:11:49.017719+0000","last_became_active":"2024-04-03T03:38:28.723907+0000","last_became_peered":"2024-04-03T03:38:28.723907+0000","last_unstale":"2024-04-03T05:11:49.017719+0000","last_undegraded":"2024-04-03T05:11:49.017719+0000","last_fullsized":"2024-04-03T05:11:49.017719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:13:05.741974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'313","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.933996+0000","last_change":"2024-04-03T03:38:30.733466+0000","last_active":"2024-04-03T05:14:08.933996+0000","last_peered":"2024-04-03T05:14:08.933996+0000","last_clean":"2024-04-03T05:14:08.933996+0000","last_became_active":"2024-04-03T03:38:30.732520+0000","last_became_peered":"2024-04-03T03:38:30.732520+0000","last_unstale":"2024-04-03T05:14:08.933996+0000","last_undegraded":"2024-04-03T05:14:08.933996+0000","last_fullsized":"2024-04-03T05:14:08.933996+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:53.671349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49780,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1180,"num_write":410,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:33.038005+0000","last_change":"2024-04-03T03:38:32.749555+0000","last_active":"2024-04-03T05:09:33.038005+0000","last_peered":"2024-04-03T05:09:33.038005+0000","last_clean":"2024-04-03T05:09:33.038005+0000","last_became_active":"2024-04-03T03:38:32.748621+0000","last_became_peered":"2024-04-03T03:38:32.748621+0000","last_unstale":"2024-04-03T05:09:33.038005+0000","last_undegraded":"2024-04-03T05:09:33.038005+0000","last_fullsized":"2024-04-03T05:09:33.038005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:14:00.976597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'375","reported_seq":2039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.276649+0000","last_change":"2024-04-03T03:38:26.714514+0000","last_active":"2024-04-03T05:11:29.276649+0000","last_peered":"2024-04-03T05:11:29.276649+0000","last_clean":"2024-04-03T05:11:29.276649+0000","last_became_active":"2024-04-03T03:38:26.711974+0000","last_became_peered":"2024-04-03T03:38:26.711974+0000","last_unstale":"2024-04-03T05:11:29.276649+0000","last_undegraded":"2024-04-03T05:11:29.276649+0000","last_fullsized":"2024-04-03T05:11:29.276649+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:02.940173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2240,"num_write":411,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'289","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.960731+0000","last_change":"2024-04-03T03:38:24.717991+0000","last_active":"2024-04-03T05:14:07.960731+0000","last_peered":"2024-04-03T05:14:07.960731+0000","last_clean":"2024-04-03T05:14:07.960731+0000","last_became_active":"2024-04-03T03:38:24.715050+0000","last_became_peered":"2024-04-03T03:38:24.715050+0000","last_unstale":"2024-04-03T05:14:07.960731+0000","last_undegraded":"2024-04-03T05:14:07.960731+0000","last_fullsized":"2024-04-03T05:14:07.960731+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:38:21.124593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19655769,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":404,"num_read_kb":21764,"num_write":1119,"num_write_kb":53575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060528+0000","last_change":"2024-04-03T03:38:28.717346+0000","last_active":"2024-04-03T05:10:58.060528+0000","last_peered":"2024-04-03T05:10:58.060528+0000","last_clean":"2024-04-03T05:10:58.060528+0000","last_became_active":"2024-04-03T03:38:28.716638+0000","last_became_peered":"2024-04-03T03:38:28.716638+0000","last_unstale":"2024-04-03T05:10:58.060528+0000","last_undegraded":"2024-04-03T05:10:58.060528+0000","last_fullsized":"2024-04-03T05:10:58.060528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:43:16.450833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'501","reported_seq":1161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.538155+0000","last_change":"2024-04-03T03:38:30.726825+0000","last_active":"2024-04-03T05:14:07.538155+0000","last_peered":"2024-04-03T05:14:07.538155+0000","last_clean":"2024-04-03T05:14:07.538155+0000","last_became_active":"2024-04-03T03:38:30.725324+0000","last_became_peered":"2024-04-03T03:38:30.725324+0000","last_unstale":"2024-04-03T05:14:07.538155+0000","last_undegraded":"2024-04-03T05:14:07.538155+0000","last_fullsized":"2024-04-03T05:14:07.538155+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:45:26.155940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126247,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":859,"num_read_kb":1917,"num_write":702,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.828908+0000","last_change":"2024-04-03T03:38:32.735911+0000","last_active":"2024-04-03T05:11:03.828908+0000","last_peered":"2024-04-03T05:11:03.828908+0000","last_clean":"2024-04-03T05:11:03.828908+0000","last_became_active":"2024-04-03T03:38:32.730456+0000","last_became_peered":"2024-04-03T03:38:32.730456+0000","last_unstale":"2024-04-03T05:11:03.828908+0000","last_undegraded":"2024-04-03T05:11:03.828908+0000","last_fullsized":"2024-04-03T05:11:03.828908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:36:50.012219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'158","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.481133+0000","last_change":"2024-04-03T03:38:34.940007+0000","last_active":"2024-04-03T05:11:08.481133+0000","last_peered":"2024-04-03T05:11:08.481133+0000","last_clean":"2024-04-03T05:11:08.481133+0000","last_became_active":"2024-04-03T03:38:34.939244+0000","last_became_peered":"2024-04-03T03:38:34.939244+0000","last_unstale":"2024-04-03T05:11:08.481133+0000","last_undegraded":"2024-04-03T05:11:08.481133+0000","last_fullsized":"2024-04-03T05:11:08.481133+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:49:45.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":238,"num_write":361,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'563","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.118189+0000","last_change":"2024-04-03T03:38:26.723127+0000","last_active":"2024-04-03T05:13:59.118189+0000","last_peered":"2024-04-03T05:13:59.118189+0000","last_clean":"2024-04-03T05:13:59.118189+0000","last_became_active":"2024-04-03T03:38:26.718375+0000","last_became_peered":"2024-04-03T03:38:26.718375+0000","last_unstale":"2024-04-03T05:13:59.118189+0000","last_undegraded":"2024-04-03T05:13:59.118189+0000","last_fullsized":"2024-04-03T05:13:59.118189+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:58:09.941905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2911,"num_read_kb":2669,"num_write":774,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'267","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.837711+0000","last_change":"2024-04-03T03:38:24.730652+0000","last_active":"2024-04-03T05:14:07.837711+0000","last_peered":"2024-04-03T05:14:07.837711+0000","last_clean":"2024-04-03T05:14:07.837711+0000","last_became_active":"2024-04-03T03:38:24.730294+0000","last_became_peered":"2024-04-03T03:38:24.730294+0000","last_unstale":"2024-04-03T05:14:07.837711+0000","last_undegraded":"2024-04-03T05:14:07.837711+0000","last_fullsized":"2024-04-03T05:14:07.837711+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:53:27.113096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11567712,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":421,"num_read_kb":62893,"num_write":1267,"num_write_kb":30207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.996314+0000","last_change":"2024-04-03T03:38:28.720598+0000","last_active":"2024-04-03T05:10:08.996314+0000","last_peered":"2024-04-03T05:10:08.996314+0000","last_clean":"2024-04-03T05:10:08.996314+0000","last_became_active":"2024-04-03T03:38:28.719692+0000","last_became_peered":"2024-04-03T03:38:28.719692+0000","last_unstale":"2024-04-03T05:10:08.996314+0000","last_undegraded":"2024-04-03T05:10:08.996314+0000","last_fullsized":"2024-04-03T05:10:08.996314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:36.700015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'337","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.032362+0000","last_change":"2024-04-03T03:38:30.733396+0000","last_active":"2024-04-03T05:14:09.032362+0000","last_peered":"2024-04-03T05:14:09.032362+0000","last_clean":"2024-04-03T05:14:09.032362+0000","last_became_active":"2024-04-03T03:38:30.732529+0000","last_became_peered":"2024-04-03T03:38:30.732529+0000","last_unstale":"2024-04-03T05:14:09.032362+0000","last_undegraded":"2024-04-03T05:14:09.032362+0000","last_fullsized":"2024-04-03T05:14:09.032362+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:08:35.143644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":563,"num_read_kb":1112,"num_write":458,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:02.838256+0000","last_change":"2024-04-03T03:38:32.735100+0000","last_active":"2024-04-03T05:11:02.838256+0000","last_peered":"2024-04-03T05:11:02.838256+0000","last_clean":"2024-04-03T05:11:02.838256+0000","last_became_active":"2024-04-03T03:38:32.731752+0000","last_became_peered":"2024-04-03T03:38:32.731752+0000","last_unstale":"2024-04-03T05:11:02.838256+0000","last_undegraded":"2024-04-03T05:11:02.838256+0000","last_fullsized":"2024-04-03T05:11:02.838256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:55:58.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'186","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.365316+0000","last_change":"2024-04-03T03:38:34.737380+0000","last_active":"2024-04-03T05:12:13.365316+0000","last_peered":"2024-04-03T05:12:13.365316+0000","last_clean":"2024-04-03T05:12:13.365316+0000","last_became_active":"2024-04-03T03:38:34.736663+0000","last_became_peered":"2024-04-03T03:38:34.736663+0000","last_unstale":"2024-04-03T05:12:13.365316+0000","last_undegraded":"2024-04-03T05:12:13.365316+0000","last_fullsized":"2024-04-03T05:12:13.365316+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:12:54.724658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":719,"num_read_kb":691,"num_write":524,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'751","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.015946+0000","last_change":"2024-04-03T03:38:26.711611+0000","last_active":"2024-04-03T05:10:58.015946+0000","last_peered":"2024-04-03T05:10:58.015946+0000","last_clean":"2024-04-03T05:10:58.015946+0000","last_became_active":"2024-04-03T03:38:26.711214+0000","last_became_peered":"2024-04-03T03:38:26.711214+0000","last_unstale":"2024-04-03T05:10:58.015946+0000","last_undegraded":"2024-04-03T05:10:58.015946+0000","last_fullsized":"2024-04-03T05:10:58.015946+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:14:42.035748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3543,"num_read_kb":3207,"num_write":983,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'256","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.616832+0000","last_change":"2024-04-03T03:38:24.761914+0000","last_active":"2024-04-03T05:14:08.616832+0000","last_peered":"2024-04-03T05:14:08.616832+0000","last_clean":"2024-04-03T05:14:08.616832+0000","last_became_active":"2024-04-03T03:38:24.761330+0000","last_became_peered":"2024-04-03T03:38:24.761330+0000","last_unstale":"2024-04-03T05:14:08.616832+0000","last_undegraded":"2024-04-03T05:14:08.616832+0000","last_fullsized":"2024-04-03T05:14:08.616832+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:38:35.443926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13063112,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":366,"num_read_kb":53466,"num_write":1078,"num_write_kb":35897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633284+0000","last_change":"2024-04-03T03:38:28.725003+0000","last_active":"2024-04-03T05:10:58.633284+0000","last_peered":"2024-04-03T05:10:58.633284+0000","last_clean":"2024-04-03T05:10:58.633284+0000","last_became_active":"2024-04-03T03:38:28.724296+0000","last_became_peered":"2024-04-03T03:38:28.724296+0000","last_unstale":"2024-04-03T05:10:58.633284+0000","last_undegraded":"2024-04-03T05:10:58.633284+0000","last_fullsized":"2024-04-03T05:10:58.633284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:51:03.993282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'304","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.524060+0000","last_change":"2024-04-03T03:38:30.822164+0000","last_active":"2024-04-03T05:14:00.524060+0000","last_peered":"2024-04-03T05:14:00.524060+0000","last_clean":"2024-04-03T05:14:00.524060+0000","last_became_active":"2024-04-03T03:38:30.821335+0000","last_became_peered":"2024-04-03T03:38:30.821335+0000","last_unstale":"2024-04-03T05:14:00.524060+0000","last_undegraded":"2024-04-03T05:14:00.524060+0000","last_fullsized":"2024-04-03T05:14:00.524060+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:51:04.303948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":994,"num_write":396,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.836987+0000","last_change":"2024-04-03T03:38:32.731796+0000","last_active":"2024-04-03T05:10:57.836987+0000","last_peered":"2024-04-03T05:10:57.836987+0000","last_clean":"2024-04-03T05:10:57.836987+0000","last_became_active":"2024-04-03T03:38:32.730954+0000","last_became_peered":"2024-04-03T03:38:32.730954+0000","last_unstale":"2024-04-03T05:10:57.836987+0000","last_undegraded":"2024-04-03T05:10:57.836987+0000","last_fullsized":"2024-04-03T05:10:57.836987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:28.623155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'104","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.542084+0000","last_change":"2024-04-03T03:38:34.755793+0000","last_active":"2024-04-03T05:14:00.542084+0000","last_peered":"2024-04-03T05:14:00.542084+0000","last_clean":"2024-04-03T05:14:00.542084+0000","last_became_active":"2024-04-03T03:38:34.754544+0000","last_became_peered":"2024-04-03T03:38:34.754544+0000","last_unstale":"2024-04-03T05:14:00.542084+0000","last_undegraded":"2024-04-03T05:14:00.542084+0000","last_fullsized":"2024-04-03T05:14:00.542084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:02.640564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":262,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'316","reported_seq":1732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.824774+0000","last_change":"2024-04-03T03:38:26.721787+0000","last_active":"2024-04-03T05:10:57.824774+0000","last_peered":"2024-04-03T05:10:57.824774+0000","last_clean":"2024-04-03T05:10:57.824774+0000","last_became_active":"2024-04-03T03:38:26.720984+0000","last_became_peered":"2024-04-03T03:38:26.720984+0000","last_unstale":"2024-04-03T05:10:57.824774+0000","last_undegraded":"2024-04-03T05:10:57.824774+0000","last_fullsized":"2024-04-03T05:10:57.824774+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:26:13.345541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1783,"num_read_kb":1722,"num_write":353,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'310","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.031545+0000","last_change":"2024-04-03T03:38:24.745501+0000","last_active":"2024-04-03T05:14:08.031545+0000","last_peered":"2024-04-03T05:14:08.031545+0000","last_clean":"2024-04-03T05:14:08.031545+0000","last_became_active":"2024-04-03T03:38:24.745183+0000","last_became_peered":"2024-04-03T03:38:24.745183+0000","last_unstale":"2024-04-03T05:14:08.031545+0000","last_undegraded":"2024-04-03T05:14:08.031545+0000","last_fullsized":"2024-04-03T05:14:08.031545+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:07:38.812807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7909340,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":464,"num_read_kb":13372,"num_write":1226,"num_write_kb":33178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:02.838294+0000","last_change":"2024-04-03T03:38:28.711378+0000","last_active":"2024-04-03T05:11:02.838294+0000","last_peered":"2024-04-03T05:11:02.838294+0000","last_clean":"2024-04-03T05:11:02.838294+0000","last_became_active":"2024-04-03T03:38:28.710708+0000","last_became_peered":"2024-04-03T03:38:28.710708+0000","last_unstale":"2024-04-03T05:11:02.838294+0000","last_undegraded":"2024-04-03T05:11:02.838294+0000","last_fullsized":"2024-04-03T05:11:02.838294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:02.818218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'150","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.634475+0000","last_change":"2024-04-03T03:38:30.823215+0000","last_active":"2024-04-03T05:11:03.634475+0000","last_peered":"2024-04-03T05:11:03.634475+0000","last_clean":"2024-04-03T05:11:03.634475+0000","last_became_active":"2024-04-03T03:38:30.822452+0000","last_became_peered":"2024-04-03T03:38:30.822452+0000","last_unstale":"2024-04-03T05:11:03.634475+0000","last_undegraded":"2024-04-03T05:11:03.634475+0000","last_fullsized":"2024-04-03T05:11:03.634475+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:15:19.776214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":168,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'525","reported_seq":4604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.490669+0000","last_change":"2024-04-03T03:38:32.735340+0000","last_active":"2024-04-03T05:14:07.490669+0000","last_peered":"2024-04-03T05:14:07.490669+0000","last_clean":"2024-04-03T05:14:07.490669+0000","last_became_active":"2024-04-03T03:38:32.734617+0000","last_became_peered":"2024-04-03T03:38:32.734617+0000","last_unstale":"2024-04-03T05:14:07.490669+0000","last_undegraded":"2024-04-03T05:14:07.490669+0000","last_fullsized":"2024-04-03T05:14:07.490669+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:51:07.710407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'182","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:59.046748+0000","last_change":"2024-04-03T03:38:34.758091+0000","last_active":"2024-04-03T05:11:59.046748+0000","last_peered":"2024-04-03T05:11:59.046748+0000","last_clean":"2024-04-03T05:11:59.046748+0000","last_became_active":"2024-04-03T03:38:34.756694+0000","last_became_peered":"2024-04-03T03:38:34.756694+0000","last_unstale":"2024-04-03T05:11:59.046748+0000","last_undegraded":"2024-04-03T05:11:59.046748+0000","last_fullsized":"2024-04-03T05:11:59.046748+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:19:35.787478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":410,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'389","reported_seq":2026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633205+0000","last_change":"2024-04-03T03:38:26.745973+0000","last_active":"2024-04-03T05:10:58.633205+0000","last_peered":"2024-04-03T05:10:58.633205+0000","last_clean":"2024-04-03T05:10:58.633205+0000","last_became_active":"2024-04-03T03:38:26.744905+0000","last_became_peered":"2024-04-03T03:38:26.744905+0000","last_unstale":"2024-04-03T05:10:58.633205+0000","last_undegraded":"2024-04-03T05:10:58.633205+0000","last_fullsized":"2024-04-03T05:10:58.633205+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:28:50.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2315,"num_read_kb":2222,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.808422+0000","last_change":"2024-04-03T03:38:58.351960+0000","last_active":"2024-04-03T05:14:08.808422+0000","last_peered":"2024-04-03T05:14:08.808422+0000","last_clean":"2024-04-03T05:14:08.808422+0000","last_became_active":"2024-04-03T03:38:58.350828+0000","last_became_peered":"2024-04-03T03:38:58.350828+0000","last_unstale":"2024-04-03T05:14:08.808422+0000","last_undegraded":"2024-04-03T05:14:08.808422+0000","last_fullsized":"2024-04-03T05:14:08.808422+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:36:44.987003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10752549,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":500,"num_read_kb":21295,"num_write":1260,"num_write_kb":30213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:59.033276+0000","last_change":"2024-04-03T03:38:28.727247+0000","last_active":"2024-04-03T05:10:59.033276+0000","last_peered":"2024-04-03T05:10:59.033276+0000","last_clean":"2024-04-03T05:10:59.033276+0000","last_became_active":"2024-04-03T03:38:28.726412+0000","last_became_peered":"2024-04-03T03:38:28.726412+0000","last_unstale":"2024-04-03T05:10:59.033276+0000","last_undegraded":"2024-04-03T05:10:59.033276+0000","last_fullsized":"2024-04-03T05:10:59.033276+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:55:21.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'377","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.822893+0000","last_change":"2024-04-03T03:38:30.722458+0000","last_active":"2024-04-03T05:14:07.822893+0000","last_peered":"2024-04-03T05:14:07.822893+0000","last_clean":"2024-04-03T05:14:07.822893+0000","last_became_active":"2024-04-03T03:38:30.721642+0000","last_became_peered":"2024-04-03T03:38:30.721642+0000","last_unstale":"2024-04-03T05:14:07.822893+0000","last_undegraded":"2024-04-03T05:14:07.822893+0000","last_fullsized":"2024-04-03T05:14:07.822893+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:55:24.375134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44870,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":590,"num_read_kb":1131,"num_write":454,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.052159+0000","last_change":"2024-04-03T03:38:32.740223+0000","last_active":"2024-04-03T05:10:23.052159+0000","last_peered":"2024-04-03T05:10:23.052159+0000","last_clean":"2024-04-03T05:10:23.052159+0000","last_became_active":"2024-04-03T03:38:32.739496+0000","last_became_peered":"2024-04-03T03:38:32.739496+0000","last_unstale":"2024-04-03T05:10:23.052159+0000","last_undegraded":"2024-04-03T05:10:23.052159+0000","last_fullsized":"2024-04-03T05:10:23.052159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:01:28.964739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'91","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026574+0000","last_change":"2024-04-03T03:38:34.751547+0000","last_active":"2024-04-03T05:10:29.026574+0000","last_peered":"2024-04-03T05:10:29.026574+0000","last_clean":"2024-04-03T05:10:29.026574+0000","last_became_active":"2024-04-03T03:38:34.751005+0000","last_became_peered":"2024-04-03T03:38:34.751005+0000","last_unstale":"2024-04-03T05:10:29.026574+0000","last_undegraded":"2024-04-03T05:10:29.026574+0000","last_fullsized":"2024-04-03T05:10:29.026574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:21.830655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":214,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'780","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.458352+0000","last_change":"2024-04-03T03:38:26.745971+0000","last_active":"2024-04-03T05:11:08.458352+0000","last_peered":"2024-04-03T05:11:08.458352+0000","last_clean":"2024-04-03T05:11:08.458352+0000","last_became_active":"2024-04-03T03:38:26.745135+0000","last_became_peered":"2024-04-03T03:38:26.745135+0000","last_unstale":"2024-04-03T05:11:08.458352+0000","last_undegraded":"2024-04-03T05:11:08.458352+0000","last_fullsized":"2024-04-03T05:11:08.458352+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:10.552726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3471,"num_read_kb":3079,"num_write":1070,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'252","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.781535+0000","last_change":"2024-04-03T03:38:24.744318+0000","last_active":"2024-04-03T05:14:08.781535+0000","last_peered":"2024-04-03T05:14:08.781535+0000","last_clean":"2024-04-03T05:14:08.781535+0000","last_became_active":"2024-04-03T03:38:24.743710+0000","last_became_peered":"2024-04-03T03:38:24.743710+0000","last_unstale":"2024-04-03T05:14:08.781535+0000","last_undegraded":"2024-04-03T05:14:08.781535+0000","last_fullsized":"2024-04-03T05:14:08.781535+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:21.325257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828727,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":374,"num_read_kb":32345,"num_write":985,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.827699+0000","last_change":"2024-04-03T03:38:28.732955+0000","last_active":"2024-04-03T05:10:58.827699+0000","last_peered":"2024-04-03T05:10:58.827699+0000","last_clean":"2024-04-03T05:10:58.827699+0000","last_became_active":"2024-04-03T03:38:28.731547+0000","last_became_peered":"2024-04-03T03:38:28.731547+0000","last_unstale":"2024-04-03T05:10:58.827699+0000","last_undegraded":"2024-04-03T05:10:58.827699+0000","last_fullsized":"2024-04-03T05:10:58.827699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:15:17.819800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'314","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.941454+0000","last_change":"2024-04-03T03:38:30.733183+0000","last_active":"2024-04-03T05:14:07.941454+0000","last_peered":"2024-04-03T05:14:07.941454+0000","last_clean":"2024-04-03T05:14:07.941454+0000","last_became_active":"2024-04-03T03:38:30.732095+0000","last_became_peered":"2024-04-03T03:38:30.732095+0000","last_unstale":"2024-04-03T05:14:07.941454+0000","last_undegraded":"2024-04-03T05:14:07.941454+0000","last_fullsized":"2024-04-03T05:14:07.941454+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:12:09.905056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1184,"num_write":416,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:44.003351+0000","last_change":"2024-04-03T03:38:32.744744+0000","last_active":"2024-04-03T05:10:44.003351+0000","last_peered":"2024-04-03T05:10:44.003351+0000","last_clean":"2024-04-03T05:10:44.003351+0000","last_became_active":"2024-04-03T03:38:32.743994+0000","last_became_peered":"2024-04-03T03:38:32.743994+0000","last_unstale":"2024-04-03T05:10:44.003351+0000","last_undegraded":"2024-04-03T05:10:44.003351+0000","last_fullsized":"2024-04-03T05:10:44.003351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:21:04.554872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'88","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.008492+0000","last_change":"2024-04-03T03:38:34.942097+0000","last_active":"2024-04-03T05:10:28.008492+0000","last_peered":"2024-04-03T05:10:28.008492+0000","last_clean":"2024-04-03T05:10:28.008492+0000","last_became_active":"2024-04-03T03:38:34.941122+0000","last_became_peered":"2024-04-03T03:38:34.941122+0000","last_unstale":"2024-04-03T05:10:28.008492+0000","last_undegraded":"2024-04-03T05:10:28.008492+0000","last_fullsized":"2024-04-03T05:10:28.008492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:35:17.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'825","reported_seq":2457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218515+0000","last_change":"2024-04-03T03:38:26.713100+0000","last_active":"2024-04-03T05:12:22.218515+0000","last_peered":"2024-04-03T05:12:22.218515+0000","last_clean":"2024-04-03T05:12:22.218515+0000","last_became_active":"2024-04-03T03:38:26.710804+0000","last_became_peered":"2024-04-03T03:38:26.710804+0000","last_unstale":"2024-04-03T05:12:22.218515+0000","last_undegraded":"2024-04-03T05:12:22.218515+0000","last_fullsized":"2024-04-03T05:12:22.218515+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:56:46.565815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3882,"num_read_kb":3472,"num_write":1106,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'300","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.934963+0000","last_change":"2024-04-03T03:38:24.727210+0000","last_active":"2024-04-03T05:14:07.934963+0000","last_peered":"2024-04-03T05:14:07.934963+0000","last_clean":"2024-04-03T05:14:07.934963+0000","last_became_active":"2024-04-03T03:38:24.726765+0000","last_became_peered":"2024-04-03T03:38:24.726765+0000","last_unstale":"2024-04-03T05:14:07.934963+0000","last_undegraded":"2024-04-03T05:14:07.934963+0000","last_fullsized":"2024-04-03T05:14:07.934963+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:44:40.435859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221133,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":474,"num_read_kb":31084,"num_write":1216,"num_write_kb":58109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.623953+0000","last_change":"2024-04-03T03:38:28.725916+0000","last_active":"2024-04-03T05:10:18.623953+0000","last_peered":"2024-04-03T05:10:18.623953+0000","last_clean":"2024-04-03T05:10:18.623953+0000","last_became_active":"2024-04-03T03:38:28.725139+0000","last_became_peered":"2024-04-03T03:38:28.725139+0000","last_unstale":"2024-04-03T05:10:18.623953+0000","last_undegraded":"2024-04-03T05:10:18.623953+0000","last_fullsized":"2024-04-03T05:10:18.623953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:05:50.849970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'255","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.517970+0000","last_change":"2024-04-03T03:38:30.721488+0000","last_active":"2024-04-03T05:14:00.517970+0000","last_peered":"2024-04-03T05:14:00.517970+0000","last_clean":"2024-04-03T05:14:00.517970+0000","last_became_active":"2024-04-03T03:38:30.719983+0000","last_became_peered":"2024-04-03T03:38:30.719983+0000","last_unstale":"2024-04-03T05:14:00.517970+0000","last_undegraded":"2024-04-03T05:14:00.517970+0000","last_fullsized":"2024-04-03T05:14:00.517970+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:30:54.735121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61822,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":951,"num_write":354,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.634346+0000","last_change":"2024-04-03T03:38:32.729151+0000","last_active":"2024-04-03T05:11:03.634346+0000","last_peered":"2024-04-03T05:11:03.634346+0000","last_clean":"2024-04-03T05:11:03.634346+0000","last_became_active":"2024-04-03T03:38:32.728438+0000","last_became_peered":"2024-04-03T03:38:32.728438+0000","last_unstale":"2024-04-03T05:11:03.634346+0000","last_undegraded":"2024-04-03T05:11:03.634346+0000","last_fullsized":"2024-04-03T05:11:03.634346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:14:01.189190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'136","reported_seq":1179,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.956146+0000","last_change":"2024-04-03T03:38:34.749288+0000","last_active":"2024-04-03T05:12:13.956146+0000","last_peered":"2024-04-03T05:12:13.956146+0000","last_clean":"2024-04-03T05:12:13.956146+0000","last_became_active":"2024-04-03T03:38:34.748329+0000","last_became_peered":"2024-04-03T03:38:34.748329+0000","last_unstale":"2024-04-03T05:12:13.956146+0000","last_undegraded":"2024-04-03T05:12:13.956146+0000","last_fullsized":"2024-04-03T05:12:13.956146+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:59:32.495711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":680,"num_read_kb":679,"num_write":303,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'715","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.623993+0000","last_change":"2024-04-03T03:38:26.746139+0000","last_active":"2024-04-03T05:10:18.623993+0000","last_peered":"2024-04-03T05:10:18.623993+0000","last_clean":"2024-04-03T05:10:18.623993+0000","last_became_active":"2024-04-03T03:38:26.742044+0000","last_became_peered":"2024-04-03T03:38:26.742044+0000","last_unstale":"2024-04-03T05:10:18.623993+0000","last_undegraded":"2024-04-03T05:10:18.623993+0000","last_fullsized":"2024-04-03T05:10:18.623993+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:54:05.286590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3199,"num_read_kb":2853,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'278","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.997908+0000","last_change":"2024-04-03T03:38:24.741033+0000","last_active":"2024-04-03T05:14:07.997908+0000","last_peered":"2024-04-03T05:14:07.997908+0000","last_clean":"2024-04-03T05:14:07.997908+0000","last_became_active":"2024-04-03T03:38:24.740329+0000","last_became_peered":"2024-04-03T03:38:24.740329+0000","last_unstale":"2024-04-03T05:14:07.997908+0000","last_undegraded":"2024-04-03T05:14:07.997908+0000","last_fullsized":"2024-04-03T05:14:07.997908+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:21.254706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10960120,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":422,"num_read_kb":56728,"num_write":1204,"num_write_kb":35698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830115+0000","last_change":"2024-04-03T03:38:28.726028+0000","last_active":"2024-04-03T05:10:47.830115+0000","last_peered":"2024-04-03T05:10:47.830115+0000","last_clean":"2024-04-03T05:10:47.830115+0000","last_became_active":"2024-04-03T03:38:28.725225+0000","last_became_peered":"2024-04-03T03:38:28.725225+0000","last_unstale":"2024-04-03T05:10:47.830115+0000","last_undegraded":"2024-04-03T05:10:47.830115+0000","last_fullsized":"2024-04-03T05:10:47.830115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:50:16.486831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'329","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.526781+0000","last_change":"2024-04-03T03:38:30.718060+0000","last_active":"2024-04-03T05:14:00.526781+0000","last_peered":"2024-04-03T05:14:00.526781+0000","last_clean":"2024-04-03T05:14:00.526781+0000","last_became_active":"2024-04-03T03:38:30.717323+0000","last_became_peered":"2024-04-03T03:38:30.717323+0000","last_unstale":"2024-04-03T05:14:00.526781+0000","last_undegraded":"2024-04-03T05:14:00.526781+0000","last_fullsized":"2024-04-03T05:14:00.526781+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:07:23.819748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50184,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":998,"num_write":410,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.061582+0000","last_change":"2024-04-03T03:38:32.743866+0000","last_active":"2024-04-03T05:11:03.061582+0000","last_peered":"2024-04-03T05:11:03.061582+0000","last_clean":"2024-04-03T05:11:03.061582+0000","last_became_active":"2024-04-03T03:38:32.743076+0000","last_became_peered":"2024-04-03T03:38:32.743076+0000","last_unstale":"2024-04-03T05:11:03.061582+0000","last_undegraded":"2024-04-03T05:11:03.061582+0000","last_fullsized":"2024-04-03T05:11:03.061582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:28:25.384912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'76","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.102158+0000","last_change":"2024-04-03T03:38:34.750455+0000","last_active":"2024-04-03T05:13:59.102158+0000","last_peered":"2024-04-03T05:13:59.102158+0000","last_clean":"2024-04-03T05:13:59.102158+0000","last_became_active":"2024-04-03T03:38:34.749644+0000","last_became_peered":"2024-04-03T03:38:34.749644+0000","last_unstale":"2024-04-03T05:13:59.102158+0000","last_undegraded":"2024-04-03T05:13:59.102158+0000","last_fullsized":"2024-04-03T05:13:59.102158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:17.219887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":90,"num_write":191,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'754","reported_seq":2410,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846312+0000","last_change":"2024-04-03T03:38:26.722653+0000","last_active":"2024-04-03T05:11:37.846312+0000","last_peered":"2024-04-03T05:11:37.846312+0000","last_clean":"2024-04-03T05:11:37.846312+0000","last_became_active":"2024-04-03T03:38:26.721951+0000","last_became_peered":"2024-04-03T03:38:26.721951+0000","last_unstale":"2024-04-03T05:11:37.846312+0000","last_undegraded":"2024-04-03T05:11:37.846312+0000","last_fullsized":"2024-04-03T05:11:37.846312+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:14:23.340976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3698,"num_read_kb":3347,"num_write":1000,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'271","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.960979+0000","last_change":"2024-04-03T03:38:24.742187+0000","last_active":"2024-04-03T05:14:08.960979+0000","last_peered":"2024-04-03T05:14:08.960979+0000","last_clean":"2024-04-03T05:14:08.960979+0000","last_became_active":"2024-04-03T03:38:24.741407+0000","last_became_peered":"2024-04-03T03:38:24.741407+0000","last_unstale":"2024-04-03T05:14:08.960979+0000","last_undegraded":"2024-04-03T05:14:08.960979+0000","last_fullsized":"2024-04-03T05:14:08.960979+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:44:29.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651184,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":385,"num_read_kb":24965,"num_write":1117,"num_write_kb":36078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1406","reported_seq":2747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846282+0000","last_change":"2024-04-03T03:38:26.719813+0000","last_active":"2024-04-03T05:11:37.846282+0000","last_peered":"2024-04-03T05:11:37.846282+0000","last_clean":"2024-04-03T05:11:37.846282+0000","last_became_active":"2024-04-03T03:38:26.719386+0000","last_became_peered":"2024-04-03T03:38:26.719386+0000","last_unstale":"2024-04-03T05:11:37.846282+0000","last_undegraded":"2024-04-03T05:11:37.846282+0000","last_fullsized":"2024-04-03T05:11:37.846282+0000","mapping_epoch":25,"log_start":"263'1300","ondisk_log_start":"263'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:39:04.440314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5587,"num_read_kb":4776,"num_write":2003,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'216","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:07.814009+0000","last_change":"2024-04-03T03:38:24.748771+0000","last_active":"2024-04-03T05:10:07.814009+0000","last_peered":"2024-04-03T05:10:07.814009+0000","last_clean":"2024-04-03T05:10:07.814009+0000","last_became_active":"2024-04-03T03:38:24.748369+0000","last_became_peered":"2024-04-03T03:38:24.748369+0000","last_unstale":"2024-04-03T05:10:07.814009+0000","last_undegraded":"2024-04-03T05:10:07.814009+0000","last_fullsized":"2024-04-03T05:10:07.814009+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:30:39.474530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6789502,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":372,"num_read_kb":45141,"num_write":967,"num_write_kb":24649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'761","reported_seq":2384,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.836588+0000","last_change":"2024-04-03T03:38:26.715097+0000","last_active":"2024-04-03T05:11:38.836588+0000","last_peered":"2024-04-03T05:11:38.836588+0000","last_clean":"2024-04-03T05:11:38.836588+0000","last_became_active":"2024-04-03T03:38:26.713821+0000","last_became_peered":"2024-04-03T03:38:26.713821+0000","last_unstale":"2024-04-03T05:11:38.836588+0000","last_undegraded":"2024-04-03T05:11:38.836588+0000","last_fullsized":"2024-04-03T05:11:38.836588+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:02:25.387554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3127,"num_write":983,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'316","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.816484+0000","last_change":"2024-04-03T03:38:24.741935+0000","last_active":"2024-04-03T05:14:08.816484+0000","last_peered":"2024-04-03T05:14:08.816484+0000","last_clean":"2024-04-03T05:14:08.816484+0000","last_became_active":"2024-04-03T03:38:24.741322+0000","last_became_peered":"2024-04-03T03:38:24.741322+0000","last_unstale":"2024-04-03T05:14:08.816484+0000","last_undegraded":"2024-04-03T05:14:08.816484+0000","last_fullsized":"2024-04-03T05:14:08.816484+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:47.935999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11128362,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":503,"num_read_kb":110805,"num_write":1171,"num_write_kb":46785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'793","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846165+0000","last_change":"2024-04-03T03:38:26.719415+0000","last_active":"2024-04-03T05:11:37.846165+0000","last_peered":"2024-04-03T05:11:37.846165+0000","last_clean":"2024-04-03T05:11:37.846165+0000","last_became_active":"2024-04-03T03:38:26.718895+0000","last_became_peered":"2024-04-03T03:38:26.718895+0000","last_unstale":"2024-04-03T05:11:37.846165+0000","last_undegraded":"2024-04-03T05:11:37.846165+0000","last_fullsized":"2024-04-03T05:11:37.846165+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:06:38.311692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3511,"num_read_kb":3115,"num_write":1065,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'317","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.995910+0000","last_change":"2024-04-03T03:38:58.351583+0000","last_active":"2024-04-03T05:14:07.995910+0000","last_peered":"2024-04-03T05:14:07.995910+0000","last_clean":"2024-04-03T05:14:07.995910+0000","last_became_active":"2024-04-03T03:38:58.349944+0000","last_became_peered":"2024-04-03T03:38:58.349944+0000","last_unstale":"2024-04-03T05:14:07.995910+0000","last_undegraded":"2024-04-03T05:14:07.995910+0000","last_fullsized":"2024-04-03T05:14:07.995910+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:01.822490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7433091,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":823,"num_read_kb":89019,"num_write":1324,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1190","reported_seq":2755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218508+0000","last_change":"2024-04-03T03:38:26.715473+0000","last_active":"2024-04-03T05:12:22.218508+0000","last_peered":"2024-04-03T05:12:22.218508+0000","last_clean":"2024-04-03T05:12:22.218508+0000","last_became_active":"2024-04-03T03:38:26.715042+0000","last_became_peered":"2024-04-03T03:38:26.715042+0000","last_unstale":"2024-04-03T05:12:22.218508+0000","last_undegraded":"2024-04-03T05:12:22.218508+0000","last_fullsized":"2024-04-03T05:12:22.218508+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:00.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5057,"num_read_kb":4409,"num_write":1655,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'243","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.932441+0000","last_change":"2024-04-03T03:38:58.351316+0000","last_active":"2024-04-03T05:14:07.932441+0000","last_peered":"2024-04-03T05:14:07.932441+0000","last_clean":"2024-04-03T05:14:07.932441+0000","last_became_active":"2024-04-03T03:38:58.350321+0000","last_became_peered":"2024-04-03T03:38:58.350321+0000","last_unstale":"2024-04-03T05:14:07.932441+0000","last_undegraded":"2024-04-03T05:14:07.932441+0000","last_fullsized":"2024-04-03T05:14:07.932441+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:29:08.087215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10015119,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":476,"num_read_kb":66631,"num_write":1027,"num_write_kb":28536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'742","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398107+0000","last_change":"2024-04-03T03:38:26.745737+0000","last_active":"2024-04-03T05:11:18.398107+0000","last_peered":"2024-04-03T05:11:18.398107+0000","last_clean":"2024-04-03T05:11:18.398107+0000","last_became_active":"2024-04-03T03:38:26.744330+0000","last_became_peered":"2024-04-03T03:38:26.744330+0000","last_unstale":"2024-04-03T05:11:18.398107+0000","last_undegraded":"2024-04-03T05:11:18.398107+0000","last_fullsized":"2024-04-03T05:11:18.398107+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:18:51.864453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3386,"num_read_kb":3032,"num_write":1008,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'272","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.742681+0000","last_change":"2024-04-03T03:38:24.708018+0000","last_active":"2024-04-03T05:14:07.742681+0000","last_peered":"2024-04-03T05:14:07.742681+0000","last_clean":"2024-04-03T05:14:07.742681+0000","last_became_active":"2024-04-03T03:38:24.707626+0000","last_became_peered":"2024-04-03T03:38:24.707626+0000","last_unstale":"2024-04-03T05:14:07.742681+0000","last_undegraded":"2024-04-03T05:14:07.742681+0000","last_fullsized":"2024-04-03T05:14:07.742681+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:55:34.304671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5727928,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":512,"num_read_kb":9989,"num_write":1250,"num_write_kb":25388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'423","reported_seq":1811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.229419+0000","last_change":"2024-04-03T03:38:26.726283+0000","last_active":"2024-04-03T05:10:55.229419+0000","last_peered":"2024-04-03T05:10:55.229419+0000","last_clean":"2024-04-03T05:10:55.229419+0000","last_became_active":"2024-04-03T03:38:26.725513+0000","last_became_peered":"2024-04-03T03:38:26.725513+0000","last_unstale":"2024-04-03T05:10:55.229419+0000","last_undegraded":"2024-04-03T05:10:55.229419+0000","last_fullsized":"2024-04-03T05:10:55.229419+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:40:24.269906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2235,"num_read_kb":2034,"num_write":556,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'241","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.987319+0000","last_change":"2024-04-03T03:38:24.749614+0000","last_active":"2024-04-03T05:14:08.987319+0000","last_peered":"2024-04-03T05:14:08.987319+0000","last_clean":"2024-04-03T05:14:08.987319+0000","last_became_active":"2024-04-03T03:38:24.748923+0000","last_became_peered":"2024-04-03T03:38:24.748923+0000","last_unstale":"2024-04-03T05:14:08.987319+0000","last_undegraded":"2024-04-03T05:14:08.987319+0000","last_fullsized":"2024-04-03T05:14:08.987319+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:57.601061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4531786,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":392,"num_read_kb":42672,"num_write":989,"num_write_kb":23960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'702","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.401427+0000","last_change":"2024-04-03T03:38:26.717032+0000","last_active":"2024-04-03T05:11:18.401427+0000","last_peered":"2024-04-03T05:11:18.401427+0000","last_clean":"2024-04-03T05:11:18.401427+0000","last_became_active":"2024-04-03T03:38:26.716359+0000","last_became_peered":"2024-04-03T03:38:26.716359+0000","last_unstale":"2024-04-03T05:11:18.401427+0000","last_undegraded":"2024-04-03T05:11:18.401427+0000","last_fullsized":"2024-04-03T05:11:18.401427+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:50:51.526153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3142,"num_read_kb":2808,"num_write":934,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'279","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.961213+0000","last_change":"2024-04-03T03:38:24.718541+0000","last_active":"2024-04-03T05:14:07.961213+0000","last_peered":"2024-04-03T05:14:07.961213+0000","last_clean":"2024-04-03T05:14:07.961213+0000","last_became_active":"2024-04-03T03:38:24.716473+0000","last_became_peered":"2024-04-03T03:38:24.716473+0000","last_unstale":"2024-04-03T05:14:07.961213+0000","last_undegraded":"2024-04-03T05:14:07.961213+0000","last_fullsized":"2024-04-03T05:14:07.961213+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:02.325821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15301456,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":410,"num_read_kb":31436,"num_write":1179,"num_write_kb":38562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'397","reported_seq":1846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.071686+0000","last_change":"2024-04-03T03:38:26.717644+0000","last_active":"2024-04-03T05:11:48.071686+0000","last_peered":"2024-04-03T05:11:48.071686+0000","last_clean":"2024-04-03T05:11:48.071686+0000","last_became_active":"2024-04-03T03:38:26.716435+0000","last_became_peered":"2024-04-03T03:38:26.716435+0000","last_unstale":"2024-04-03T05:11:48.071686+0000","last_undegraded":"2024-04-03T05:11:48.071686+0000","last_fullsized":"2024-04-03T05:11:48.071686+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:50.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2146,"num_read_kb":2018,"num_write":509,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'374","reported_seq":1170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.604819+0000","last_change":"2024-04-03T03:38:24.741361+0000","last_active":"2024-04-03T05:14:08.604819+0000","last_peered":"2024-04-03T05:14:08.604819+0000","last_clean":"2024-04-03T05:14:08.604819+0000","last_became_active":"2024-04-03T03:38:24.740664+0000","last_became_peered":"2024-04-03T03:38:24.740664+0000","last_unstale":"2024-04-03T05:14:08.604819+0000","last_undegraded":"2024-04-03T05:14:08.604819+0000","last_fullsized":"2024-04-03T05:14:08.604819+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:01:10.065790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17012494,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":875,"num_read_kb":68467,"num_write":1456,"num_write_kb":54703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'407","reported_seq":1976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193909+0000","last_change":"2024-04-03T03:38:26.752206+0000","last_active":"2024-04-03T05:13:59.193909+0000","last_peered":"2024-04-03T05:13:59.193909+0000","last_clean":"2024-04-03T05:13:59.193909+0000","last_became_active":"2024-04-03T03:38:26.751399+0000","last_became_peered":"2024-04-03T03:38:26.751399+0000","last_unstale":"2024-04-03T05:13:59.193909+0000","last_undegraded":"2024-04-03T05:13:59.193909+0000","last_fullsized":"2024-04-03T05:13:59.193909+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:42:54.446617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2116,"num_write":486,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'240","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.006131+0000","last_change":"2024-04-03T03:38:24.718194+0000","last_active":"2024-04-03T05:14:08.006131+0000","last_peered":"2024-04-03T05:14:08.006131+0000","last_clean":"2024-04-03T05:14:08.006131+0000","last_became_active":"2024-04-03T03:38:24.715106+0000","last_became_peered":"2024-04-03T03:38:24.715106+0000","last_unstale":"2024-04-03T05:14:08.006131+0000","last_undegraded":"2024-04-03T05:14:08.006131+0000","last_fullsized":"2024-04-03T05:14:08.006131+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:03:49.995783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2790114,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":368,"num_read_kb":15103,"num_write":911,"num_write_kb":22507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'628","reported_seq":2277,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.106774+0000","last_change":"2024-04-03T03:38:26.717354+0000","last_active":"2024-04-03T05:13:59.106774+0000","last_peered":"2024-04-03T05:13:59.106774+0000","last_clean":"2024-04-03T05:13:59.106774+0000","last_became_active":"2024-04-03T03:38:26.717085+0000","last_became_peered":"2024-04-03T03:38:26.717085+0000","last_unstale":"2024-04-03T05:13:59.106774+0000","last_undegraded":"2024-04-03T05:13:59.106774+0000","last_fullsized":"2024-04-03T05:13:59.106774+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:56.981338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3119,"num_read_kb":2815,"num_write":838,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'292","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.785889+0000","last_change":"2024-04-03T03:38:24.755928+0000","last_active":"2024-04-03T05:14:08.785889+0000","last_peered":"2024-04-03T05:14:08.785889+0000","last_clean":"2024-04-03T05:14:08.785889+0000","last_became_active":"2024-04-03T03:38:24.755345+0000","last_became_peered":"2024-04-03T03:38:24.755345+0000","last_unstale":"2024-04-03T05:14:08.785889+0000","last_undegraded":"2024-04-03T05:14:08.785889+0000","last_fullsized":"2024-04-03T05:14:08.785889+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:17:46.705832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12025105,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":423,"num_read_kb":14159,"num_write":1232,"num_write_kb":40251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'700","reported_seq":2138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.221367+0000","last_change":"2024-04-03T03:38:26.746104+0000","last_active":"2024-04-03T05:12:22.221367+0000","last_peered":"2024-04-03T05:12:22.221367+0000","last_clean":"2024-04-03T05:12:22.221367+0000","last_became_active":"2024-04-03T03:38:26.745102+0000","last_became_peered":"2024-04-03T03:38:26.745102+0000","last_unstale":"2024-04-03T05:12:22.221367+0000","last_undegraded":"2024-04-03T05:12:22.221367+0000","last_fullsized":"2024-04-03T05:12:22.221367+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:13.112805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3146,"num_read_kb":2819,"num_write":922,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'304","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.085377+0000","last_change":"2024-04-03T03:38:24.729779+0000","last_active":"2024-04-03T05:14:08.085377+0000","last_peered":"2024-04-03T05:14:08.085377+0000","last_clean":"2024-04-03T05:14:08.085377+0000","last_became_active":"2024-04-03T03:38:24.729149+0000","last_became_peered":"2024-04-03T03:38:24.729149+0000","last_unstale":"2024-04-03T05:14:08.085377+0000","last_undegraded":"2024-04-03T05:14:08.085377+0000","last_fullsized":"2024-04-03T05:14:08.085377+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:44:06.201753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7840929,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":482,"num_read_kb":15990,"num_write":1149,"num_write_kb":30672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'376","reported_seq":1992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:44.029877+0000","last_change":"2024-04-03T03:38:26.714537+0000","last_active":"2024-04-03T05:10:44.029877+0000","last_peered":"2024-04-03T05:10:44.029877+0000","last_clean":"2024-04-03T05:10:44.029877+0000","last_became_active":"2024-04-03T03:38:26.713796+0000","last_became_peered":"2024-04-03T03:38:26.713796+0000","last_unstale":"2024-04-03T05:10:44.029877+0000","last_undegraded":"2024-04-03T05:10:44.029877+0000","last_fullsized":"2024-04-03T05:10:44.029877+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:36:53.201626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2155,"num_read_kb":2080,"num_write":414,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'257","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.903812+0000","last_change":"2024-04-03T03:38:24.750293+0000","last_active":"2024-04-03T05:14:08.903812+0000","last_peered":"2024-04-03T05:14:08.903812+0000","last_clean":"2024-04-03T05:14:08.903812+0000","last_became_active":"2024-04-03T03:38:24.749152+0000","last_became_peered":"2024-04-03T03:38:24.749152+0000","last_unstale":"2024-04-03T05:14:08.903812+0000","last_undegraded":"2024-04-03T05:14:08.903812+0000","last_fullsized":"2024-04-03T05:14:08.903812+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:48:44.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19277263,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":341,"num_read_kb":32536,"num_write":1004,"num_write_kb":42333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1009","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056540+0000","last_change":"2024-04-03T03:38:26.729663+0000","last_active":"2024-04-03T05:10:43.056540+0000","last_peered":"2024-04-03T05:10:43.056540+0000","last_clean":"2024-04-03T05:10:43.056540+0000","last_became_active":"2024-04-03T03:38:26.729124+0000","last_became_peered":"2024-04-03T03:38:26.729124+0000","last_unstale":"2024-04-03T05:10:43.056540+0000","last_undegraded":"2024-04-03T05:10:43.056540+0000","last_fullsized":"2024-04-03T05:10:43.056540+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":900,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:12:50.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4687,"num_read_kb":4082,"num_write":1459,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'307","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.827813+0000","last_change":"2024-04-03T03:38:24.732372+0000","last_active":"2024-04-03T05:14:08.827813+0000","last_peered":"2024-04-03T05:14:08.827813+0000","last_clean":"2024-04-03T05:14:08.827813+0000","last_became_active":"2024-04-03T03:38:24.731586+0000","last_became_peered":"2024-04-03T03:38:24.731586+0000","last_unstale":"2024-04-03T05:14:08.827813+0000","last_undegraded":"2024-04-03T05:14:08.827813+0000","last_fullsized":"2024-04-03T05:14:08.827813+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:34:38.457730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21457510,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":515,"num_read_kb":86610,"num_write":1353,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'364","reported_seq":1859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218422+0000","last_change":"2024-04-03T03:38:26.728365+0000","last_active":"2024-04-03T05:12:22.218422+0000","last_peered":"2024-04-03T05:12:22.218422+0000","last_clean":"2024-04-03T05:12:22.218422+0000","last_became_active":"2024-04-03T03:38:26.728070+0000","last_became_peered":"2024-04-03T03:38:26.728070+0000","last_unstale":"2024-04-03T05:12:22.218422+0000","last_undegraded":"2024-04-03T05:12:22.218422+0000","last_fullsized":"2024-04-03T05:12:22.218422+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:38:42.073330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2004,"num_read_kb":1922,"num_write":414,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'295","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.850382+0000","last_change":"2024-04-03T03:38:24.726372+0000","last_active":"2024-04-03T05:14:07.850382+0000","last_peered":"2024-04-03T05:14:07.850382+0000","last_clean":"2024-04-03T05:14:07.850382+0000","last_became_active":"2024-04-03T03:38:24.725969+0000","last_became_peered":"2024-04-03T03:38:24.725969+0000","last_unstale":"2024-04-03T05:14:07.850382+0000","last_undegraded":"2024-04-03T05:14:07.850382+0000","last_fullsized":"2024-04-03T05:14:07.850382+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:29:30.307028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6802328,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":481,"num_read_kb":62664,"num_write":1225,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'466","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:25.900290+0000","last_change":"2024-04-03T03:38:26.706006+0000","last_active":"2024-04-03T05:10:25.900290+0000","last_peered":"2024-04-03T05:10:25.900290+0000","last_clean":"2024-04-03T05:10:25.900290+0000","last_became_active":"2024-04-03T03:38:26.705142+0000","last_became_peered":"2024-04-03T03:38:26.705142+0000","last_unstale":"2024-04-03T05:10:25.900290+0000","last_undegraded":"2024-04-03T05:10:25.900290+0000","last_fullsized":"2024-04-03T05:10:25.900290+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:12.955466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2439,"num_read_kb":2283,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'263","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.870472+0000","last_change":"2024-04-03T03:38:24.749516+0000","last_active":"2024-04-03T05:14:08.870472+0000","last_peered":"2024-04-03T05:14:08.870472+0000","last_clean":"2024-04-03T05:14:08.870472+0000","last_became_active":"2024-04-03T03:38:24.748843+0000","last_became_peered":"2024-04-03T03:38:24.748843+0000","last_unstale":"2024-04-03T05:14:08.870472+0000","last_undegraded":"2024-04-03T05:14:08.870472+0000","last_fullsized":"2024-04-03T05:14:08.870472+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:41.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8418163,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":349,"num_read_kb":1436,"num_write":1018,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'283","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.775983+0000","last_change":"2024-04-03T03:38:24.740753+0000","last_active":"2024-04-03T05:14:08.775983+0000","last_peered":"2024-04-03T05:14:08.775983+0000","last_clean":"2024-04-03T05:14:08.775983+0000","last_became_active":"2024-04-03T03:38:24.737358+0000","last_became_peered":"2024-04-03T03:38:24.737358+0000","last_unstale":"2024-04-03T05:14:08.775983+0000","last_undegraded":"2024-04-03T05:14:08.775983+0000","last_fullsized":"2024-04-03T05:14:08.775983+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:25:01.791092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16393155,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":501,"num_read_kb":13844,"num_write":1301,"num_write_kb":46293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'651","reported_seq":2338,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.282490+0000","last_change":"2024-04-03T03:38:26.718253+0000","last_active":"2024-04-03T05:11:29.282490+0000","last_peered":"2024-04-03T05:11:29.282490+0000","last_clean":"2024-04-03T05:11:29.282490+0000","last_became_active":"2024-04-03T03:38:26.717854+0000","last_became_peered":"2024-04-03T03:38:26.717854+0000","last_unstale":"2024-04-03T05:11:29.282490+0000","last_undegraded":"2024-04-03T05:11:29.282490+0000","last_fullsized":"2024-04-03T05:11:29.282490+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:22.381228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3358,"num_read_kb":3036,"num_write":900,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'338","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.865283+0000","last_change":"2024-04-03T03:38:24.730677+0000","last_active":"2024-04-03T05:14:07.865283+0000","last_peered":"2024-04-03T05:14:07.865283+0000","last_clean":"2024-04-03T05:14:07.865283+0000","last_became_active":"2024-04-03T03:38:24.730312+0000","last_became_peered":"2024-04-03T03:38:24.730312+0000","last_unstale":"2024-04-03T05:14:07.865283+0000","last_undegraded":"2024-04-03T05:14:07.865283+0000","last_fullsized":"2024-04-03T05:14:07.865283+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:20:55.022050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7090666,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":613,"num_read_kb":19035,"num_write":1362,"num_write_kb":53256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'683","reported_seq":2062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.282399+0000","last_change":"2024-04-03T03:38:26.728858+0000","last_active":"2024-04-03T05:11:29.282399+0000","last_peered":"2024-04-03T05:11:29.282399+0000","last_clean":"2024-04-03T05:11:29.282399+0000","last_became_active":"2024-04-03T03:38:26.728038+0000","last_became_peered":"2024-04-03T03:38:26.728038+0000","last_unstale":"2024-04-03T05:11:29.282399+0000","last_undegraded":"2024-04-03T05:11:29.282399+0000","last_fullsized":"2024-04-03T05:11:29.282399+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:28:43.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3172,"num_read_kb":2837,"num_write":928,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":84518868,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":145,"num_read_kb":195556,"num_write":157,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161701888,"data_stored":161697704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5643,"num_read_kb":4008,"num_write":2168,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1286,"ondisk_log_size":1286,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":11006,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":12265,"num_read_kb":12111,"num_write":14239,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":22012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2564,"ondisk_log_size":2564,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":361,"ondisk_log_size":361,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1769242,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19206,"num_read_kb":36149,"num_write":16215,"num_write_kb":11681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":2191952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1857,"ondisk_log_size":1857,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1711,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1602,"num_read_kb":1902,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":189133,"num_read_kb":172083,"num_write":51171,"num_write_kb":17715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4081,"ondisk_log_size":4081,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":634200549,"num_objects":3640,"num_object_clones":0,"num_object_copies":10920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3640,"num_whiteouts":0,"num_read":32102,"num_read_kb":2539869,"num_write":74744,"num_write_kb":2266597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1006366720,"data_stored":1006366720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4512,"ondisk_log_size":4512,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":80740352,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":157,"num_read_kb":216081,"num_write":162,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510599,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477660,"kb_used_data":179776,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":93894180,"statfs":{"total":96636764160,"available":96147640320,"internally_reserved":0,"allocated":184090624,"data_stored":181973565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":304871882},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510601,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476420,"kb_used_data":206412,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93895420,"statfs":{"total":96636764160,"available":96148910080,"internally_reserved":0,"allocated":211365888,"data_stored":209304721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510598,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280416,"kb_used_data":136760,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94091424,"statfs":{"total":96636764160,"available":96349618176,"internally_reserved":0,"allocated":140042240,"data_stored":137904487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510597,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308500,"kb_used_data":196808,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94063340,"statfs":{"total":96636764160,"available":96320860160,"internally_reserved":0,"allocated":201531392,"data_stored":199491573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114358727},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543304,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439176,"kb_used_data":213588,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93932664,"statfs":{"total":96636764160,"available":96187047936,"internally_reserved":0,"allocated":218714112,"data_stored":216602747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543304,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255684,"kb_used_data":170360,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94116156,"statfs":{"total":96636764160,"available":96374943744,"internally_reserved":0,"allocated":174448640,"data_stored":172419572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543301,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339028,"kb_used_data":185740,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94032812,"statfs":{"total":96636764160,"available":96289599488,"internally_reserved":0,"allocated":190197760,"data_stored":188124258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543302,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":464496,"kb_used_data":216744,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93907344,"statfs":{"total":96636764160,"available":96161120256,"internally_reserved":0,"allocated":221945856,"data_stored":219859320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":138227712,"data_stored":138227712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":141275136,"data_stored":141275136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":121327616,"data_stored":121327616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":124157952,"data_stored":124157952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":138371072,"data_stored":138371072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":103944192,"data_stored":103944192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":125714432,"data_stored":125714432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":113348608,"data_stored":113348608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":302707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":357174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":88997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":394256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":98433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":415861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":219065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":315459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":21019945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17874944,"data_stored":17874217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35188736,"data_stored":35187371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10022912,"data_stored":10021547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T05:14:12.642 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-03T05:14:12.967 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:14:12.967 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":263,"fsid":"a081b84a-44ad-4905-81c6-ab13dbb94769","created":"2024-04-03T03:37:51.907603+0000","modified":"2024-04-03T04:19:00.344407+0000","last_up_change":"2024-04-03T03:38:03.047546+0000","last_in_change":"2024-04-03T03:37:54.203613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":67,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-03T03:38:02.577485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-03T03:38:10.032509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-03T03:38:22.667488+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-03T03:38:25.030207+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-03T03:38:26.839057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-03T03:38:28.825151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-03T03:38:30.725366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-03T03:38:32.876742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":64,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-04-03T03:48:59.731965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-04-03T03:55:44.723378+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-04-03T03:55:51.785781+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.otp","create_time":"2024-04-03T04:18:49.974106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"261","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdcccedf-738f-4af4-b6fe-239363e19af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6809","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6810","nonce":1629744318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6814","nonce":1629744318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6819","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6821","nonce":1629744318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1629744318},{"type":"v1","addr":"172.21.15.104:6817","nonce":1629744318}]},"public_addr":"172.21.15.104:6810/1629744318","cluster_addr":"172.21.15.104:6814/1629744318","heartbeat_back_addr":"172.21.15.104:6821/1629744318","heartbeat_front_addr":"172.21.15.104:6817/1629744318","state":["exists","up"]},{"osd":1,"uuid":"cb64780c-0034-4021-a7d7-0b725dd52bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6825","nonce":1648728207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6827","nonce":1648728207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6831","nonce":1648728207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":1648728207},{"type":"v1","addr":"172.21.15.104:6829","nonce":1648728207}]},"public_addr":"172.21.15.104:6825/1648728207","cluster_addr":"172.21.15.104:6827/1648728207","heartbeat_back_addr":"172.21.15.104:6831/1648728207","heartbeat_front_addr":"172.21.15.104:6829/1648728207","state":["exists","up"]},{"osd":2,"uuid":"493c05f7-c1db-4b96-8b6f-02aeb44d8c11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":256,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6801","nonce":3577269254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6803","nonce":3577269254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6807","nonce":3577269254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3577269254},{"type":"v1","addr":"172.21.15.104:6805","nonce":3577269254}]},"public_addr":"172.21.15.104:6801/3577269254","cluster_addr":"172.21.15.104:6803/3577269254","heartbeat_back_addr":"172.21.15.104:6807/3577269254","heartbeat_front_addr":"172.21.15.104:6805/3577269254","state":["exists","up"]},{"osd":3,"uuid":"cadbc92e-6c80-46a1-ba6a-048465239e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6811","nonce":2848281456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6813","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6815","nonce":2848281456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6823","nonce":2848281456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2848281456},{"type":"v1","addr":"172.21.15.104:6820","nonce":2848281456}]},"public_addr":"172.21.15.104:6811/2848281456","cluster_addr":"172.21.15.104:6815/2848281456","heartbeat_back_addr":"172.21.15.104:6823/2848281456","heartbeat_front_addr":"172.21.15.104:6820/2848281456","state":["exists","up"]},{"osd":4,"uuid":"5e978b18-a3f9-423b-ac65-efd7261c2127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6825","nonce":3307467241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6827","nonce":3307467241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6831","nonce":3307467241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":3307467241},{"type":"v1","addr":"172.21.15.130:6829","nonce":3307467241}]},"public_addr":"172.21.15.130:6825/3307467241","cluster_addr":"172.21.15.130:6827/3307467241","heartbeat_back_addr":"172.21.15.130:6831/3307467241","heartbeat_front_addr":"172.21.15.130:6829/3307467241","state":["exists","up"]},{"osd":5,"uuid":"b5e1a1fd-c60f-4f92-8176-f41d8ef5d86b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6808","nonce":2542797043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6814","nonce":2542797043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6823","nonce":2542797043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6817","nonce":2542797043},{"type":"v1","addr":"172.21.15.130:6820","nonce":2542797043}]},"public_addr":"172.21.15.130:6808/2542797043","cluster_addr":"172.21.15.130:6814/2542797043","heartbeat_back_addr":"172.21.15.130:6823/2542797043","heartbeat_front_addr":"172.21.15.130:6820/2542797043","state":["exists","up"]},{"osd":6,"uuid":"734ba606-b896-45d4-8268-9ab8ba12baa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6807","nonce":3494208016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6811","nonce":3494208016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6821","nonce":3494208016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6813","nonce":3494208016},{"type":"v1","addr":"172.21.15.130:6816","nonce":3494208016}]},"public_addr":"172.21.15.130:6807/3494208016","cluster_addr":"172.21.15.130:6811/3494208016","heartbeat_back_addr":"172.21.15.130:6821/3494208016","heartbeat_front_addr":"172.21.15.130:6816/3494208016","state":["exists","up"]},{"osd":7,"uuid":"ee2a9629-90cb-4b2d-8793-bb070513fada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6801","nonce":1404666531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6803","nonce":1404666531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6815","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6819","nonce":1404666531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":1404666531},{"type":"v1","addr":"172.21.15.130:6810","nonce":1404666531}]},"public_addr":"172.21.15.130:6801/1404666531","cluster_addr":"172.21.15.130:6803/1404666531","heartbeat_back_addr":"172.21.15.130:6819/1404666531","heartbeat_front_addr":"172.21.15.130:6810/1404666531","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.476315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.833487+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.541824+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.514798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.672766+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.567478+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.759099+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-03T03:37:59.729435+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.a","mappings":[{"from":6,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":4,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.24","mappings":[{"from":4,"to":1}]},{"pgid":"3.36","mappings":[{"from":4,"to":1}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"67.14","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-03T05:14:13.987 INFO:tasks.ceph:Scrubbing osd.0 2024-04-03T05:14:13.987 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-03T05:14:14.149 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T05:14:14.149 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-03T05:14:14.149 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T05:14:14.165 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-03T05:14:14.451 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 0 to deep-scrub 2024-04-03T05:14:14.470 INFO:tasks.ceph:Scrubbing osd.1 2024-04-03T05:14:14.470 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-03T05:14:14.605 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T05:14:14.605 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-03T05:14:14.605 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T05:14:14.619 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-03T05:14:14.903 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 1 to deep-scrub 2024-04-03T05:14:14.922 INFO:tasks.ceph:Scrubbing osd.2 2024-04-03T05:14:14.922 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-03T05:14:15.057 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T05:14:15.057 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-03T05:14:15.057 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T05:14:15.072 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-03T05:14:15.358 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 2 to deep-scrub 2024-04-03T05:14:15.375 INFO:tasks.ceph:Scrubbing osd.3 2024-04-03T05:14:15.376 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-03T05:14:15.513 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T05:14:15.513 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-03T05:14:15.513 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T05:14:15.528 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-03T05:14:15.812 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 3 to deep-scrub 2024-04-03T05:14:15.832 INFO:tasks.ceph:Scrubbing osd.4 2024-04-03T05:14:15.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-03T05:14:15.979 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T05:14:15.979 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-03T05:14:15.979 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T05:14:15.993 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-03T05:14:16.262 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 4 to deep-scrub 2024-04-03T05:14:16.280 INFO:tasks.ceph:Scrubbing osd.5 2024-04-03T05:14:16.280 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-03T05:14:16.429 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T05:14:16.429 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-03T05:14:16.430 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T05:14:16.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-03T05:14:16.715 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 5 to deep-scrub 2024-04-03T05:14:16.733 INFO:tasks.ceph:Scrubbing osd.6 2024-04-03T05:14:16.733 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-03T05:14:16.873 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T05:14:16.873 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-03T05:14:16.873 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T05:14:16.888 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-03T05:14:17.160 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 6 to deep-scrub 2024-04-03T05:14:17.178 INFO:tasks.ceph:Scrubbing osd.7 2024-04-03T05:14:17.178 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-03T05:14:17.330 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-04-03T05:14:17.330 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-03T05:14:17.330 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-04-03T05:14:17.346 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-03T05:14:17.635 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 7 to deep-scrub 2024-04-03T05:14:17.655 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-03T05:14:17.979 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:14:17.991 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-03T05:14:17.996 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":3141,"stamp":"2024-04-03T05:14:16.530698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198101438,"num_objects":887,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":887,"num_whiteouts":0,"num_read":263989,"num_read_kb":3180969,"num_write":162444,"num_write_kb":2577796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":158,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13921,"ondisk_log_size":13921,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1924144,"kb_used_data":340808,"kb_used_omap":12,"kb_used_meta":1581939,"kb_avail":753050576,"statfs":{"total":773094113280,"available":771123789824,"internally_reserved":0,"allocated":348987392,"data_stored":332571254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1619906099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-771899821,"num_objects":-4126,"num_object_clones":0,"num_object_copies":-12318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4126,"num_whiteouts":0,"num_read":4639,"num_read_kb":4155,"num_write":4344,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009205"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.638663+0000","last_change":"2024-04-03T04:18:51.297907+0000","last_active":"2024-04-03T05:11:23.638663+0000","last_peered":"2024-04-03T05:11:23.638663+0000","last_clean":"2024-04-03T05:11:23.638663+0000","last_became_active":"2024-04-03T04:18:51.297066+0000","last_became_peered":"2024-04-03T04:18:51.297066+0000","last_unstale":"2024-04-03T05:11:23.638663+0000","last_undegraded":"2024-04-03T05:11:23.638663+0000","last_fullsized":"2024-04-03T05:11:23.638663+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:40:36.577637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"258'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831108+0000","last_change":"2024-04-03T03:55:53.275728+0000","last_active":"2024-04-03T05:10:52.831108+0000","last_peered":"2024-04-03T05:10:52.831108+0000","last_clean":"2024-04-03T05:10:52.831108+0000","last_became_active":"2024-04-03T03:55:53.274262+0000","last_became_peered":"2024-04-03T03:55:53.274262+0000","last_unstale":"2024-04-03T05:10:52.831108+0000","last_undegraded":"2024-04-03T05:10:52.831108+0000","last_fullsized":"2024-04-03T05:10:52.831108+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:48:37.046795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'2","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.862250+0000","last_change":"2024-04-03T03:55:45.808629+0000","last_active":"2024-04-03T05:14:07.862250+0000","last_peered":"2024-04-03T05:14:07.862250+0000","last_clean":"2024-04-03T05:14:07.862250+0000","last_became_active":"2024-04-03T03:55:45.807880+0000","last_became_peered":"2024-04-03T03:55:45.807880+0000","last_unstale":"2024-04-03T05:14:07.862250+0000","last_undegraded":"2024-04-03T05:14:07.862250+0000","last_fullsized":"2024-04-03T05:14:07.862250+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:07:02.590954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"263'26","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.051193+0000","last_change":"2024-04-03T03:49:00.988224+0000","last_active":"2024-04-03T05:10:18.051193+0000","last_peered":"2024-04-03T05:10:18.051193+0000","last_clean":"2024-04-03T05:10:18.051193+0000","last_became_active":"2024-04-03T03:49:00.987495+0000","last_became_peered":"2024-04-03T03:49:00.987495+0000","last_unstale":"2024-04-03T05:10:18.051193+0000","last_undegraded":"2024-04-03T05:10:18.051193+0000","last_fullsized":"2024-04-03T05:10:18.051193+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:22:00.449054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":70,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.833310+0000","last_change":"2024-04-03T04:18:51.320955+0000","last_active":"2024-04-03T05:11:23.833310+0000","last_peered":"2024-04-03T05:11:23.833310+0000","last_clean":"2024-04-03T05:11:23.833310+0000","last_became_active":"2024-04-03T04:18:51.320118+0000","last_became_peered":"2024-04-03T04:18:51.320118+0000","last_unstale":"2024-04-03T05:11:23.833310+0000","last_undegraded":"2024-04-03T05:11:23.833310+0000","last_fullsized":"2024-04-03T05:11:23.833310+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:36:11.622961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.366221+0000","last_change":"2024-04-03T03:55:53.242225+0000","last_active":"2024-04-03T05:14:09.366221+0000","last_peered":"2024-04-03T05:14:09.366221+0000","last_clean":"2024-04-03T05:14:09.366221+0000","last_became_active":"2024-04-03T03:55:53.238473+0000","last_became_peered":"2024-04-03T03:55:53.238473+0000","last_unstale":"2024-04-03T05:14:09.366221+0000","last_undegraded":"2024-04-03T05:14:09.366221+0000","last_fullsized":"2024-04-03T05:14:09.366221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:31:29.585032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"258'3","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.058060+0000","last_change":"2024-04-03T03:55:45.833198+0000","last_active":"2024-04-03T05:10:48.058060+0000","last_peered":"2024-04-03T05:10:48.058060+0000","last_clean":"2024-04-03T05:10:48.058060+0000","last_became_active":"2024-04-03T03:55:45.831610+0000","last_became_peered":"2024-04-03T03:55:45.831610+0000","last_unstale":"2024-04-03T05:10:48.058060+0000","last_undegraded":"2024-04-03T05:10:48.058060+0000","last_fullsized":"2024-04-03T05:10:48.058060+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:02:23.178186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"263'35","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:28.066849+0000","last_change":"2024-04-03T03:49:00.989569+0000","last_active":"2024-04-03T05:11:28.066849+0000","last_peered":"2024-04-03T05:11:28.066849+0000","last_clean":"2024-04-03T05:11:28.066849+0000","last_became_active":"2024-04-03T03:49:00.988912+0000","last_became_peered":"2024-04-03T03:49:00.988912+0000","last_unstale":"2024-04-03T05:11:28.066849+0000","last_undegraded":"2024-04-03T05:11:28.066849+0000","last_fullsized":"2024-04-03T05:11:28.066849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:44:30.947197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.018230+0000","last_change":"2024-04-03T04:18:51.365311+0000","last_active":"2024-04-03T05:11:08.018230+0000","last_peered":"2024-04-03T05:11:08.018230+0000","last_clean":"2024-04-03T05:11:08.018230+0000","last_became_active":"2024-04-03T04:18:51.364557+0000","last_became_peered":"2024-04-03T04:18:51.364557+0000","last_unstale":"2024-04-03T05:11:08.018230+0000","last_undegraded":"2024-04-03T05:11:08.018230+0000","last_fullsized":"2024-04-03T05:11:08.018230+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:32:56.588645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.659100+0000","last_change":"2024-04-03T03:55:53.269902+0000","last_active":"2024-04-03T05:12:58.659100+0000","last_peered":"2024-04-03T05:12:58.659100+0000","last_clean":"2024-04-03T05:12:58.659100+0000","last_became_active":"2024-04-03T03:55:53.269276+0000","last_became_peered":"2024-04-03T03:55:53.269276+0000","last_unstale":"2024-04-03T05:12:58.659100+0000","last_undegraded":"2024-04-03T05:12:58.659100+0000","last_fullsized":"2024-04-03T05:12:58.659100+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:15:06.133472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'9","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.038974+0000","last_change":"2024-04-03T03:55:45.823314+0000","last_active":"2024-04-03T05:14:10.038974+0000","last_peered":"2024-04-03T05:14:10.038974+0000","last_clean":"2024-04-03T05:14:10.038974+0000","last_became_active":"2024-04-03T03:55:45.822526+0000","last_became_peered":"2024-04-03T03:55:45.822526+0000","last_unstale":"2024-04-03T05:14:10.038974+0000","last_undegraded":"2024-04-03T05:14:10.038974+0000","last_fullsized":"2024-04-03T05:14:10.038974+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:47:58.846580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12606,"num_write":14,"num_write_kb":9534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:34.041215+0000","last_change":"2024-04-03T03:49:00.993012+0000","last_active":"2024-04-03T05:11:34.041215+0000","last_peered":"2024-04-03T05:11:34.041215+0000","last_clean":"2024-04-03T05:11:34.041215+0000","last_became_active":"2024-04-03T03:49:00.992254+0000","last_became_peered":"2024-04-03T03:49:00.992254+0000","last_unstale":"2024-04-03T05:11:34.041215+0000","last_undegraded":"2024-04-03T05:11:34.041215+0000","last_fullsized":"2024-04-03T05:11:34.041215+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:16.501916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":101,"num_write":55,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060573+0000","last_change":"2024-04-03T04:18:51.373813+0000","last_active":"2024-04-03T05:10:58.060573+0000","last_peered":"2024-04-03T05:10:58.060573+0000","last_clean":"2024-04-03T05:10:58.060573+0000","last_became_active":"2024-04-03T04:18:51.373051+0000","last_became_peered":"2024-04-03T04:18:51.373051+0000","last_unstale":"2024-04-03T05:10:58.060573+0000","last_undegraded":"2024-04-03T05:10:58.060573+0000","last_fullsized":"2024-04-03T05:10:58.060573+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:25:49.915796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.367606+0000","last_change":"2024-04-03T03:55:53.276078+0000","last_active":"2024-04-03T05:14:09.367606+0000","last_peered":"2024-04-03T05:14:09.367606+0000","last_clean":"2024-04-03T05:14:09.367606+0000","last_became_active":"2024-04-03T03:55:53.274825+0000","last_became_peered":"2024-04-03T03:55:53.274825+0000","last_unstale":"2024-04-03T05:14:09.367606+0000","last_undegraded":"2024-04-03T05:14:09.367606+0000","last_fullsized":"2024-04-03T05:14:09.367606+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:54:31.500440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.057924+0000","last_change":"2024-04-03T03:55:45.810413+0000","last_active":"2024-04-03T05:10:48.057924+0000","last_peered":"2024-04-03T05:10:48.057924+0000","last_clean":"2024-04-03T05:10:48.057924+0000","last_became_active":"2024-04-03T03:55:45.809649+0000","last_became_peered":"2024-04-03T03:55:45.809649+0000","last_unstale":"2024-04-03T05:10:48.057924+0000","last_undegraded":"2024-04-03T05:10:48.057924+0000","last_fullsized":"2024-04-03T05:10:48.057924+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:07:31.286451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"263'106","reported_seq":376,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:32.844991+0000","last_change":"2024-04-03T03:49:00.991120+0000","last_active":"2024-04-03T05:11:32.844991+0000","last_peered":"2024-04-03T05:11:32.844991+0000","last_clean":"2024-04-03T05:11:32.844991+0000","last_became_active":"2024-04-03T03:49:00.990318+0000","last_became_peered":"2024-04-03T03:49:00.990318+0000","last_unstale":"2024-04-03T05:11:32.844991+0000","last_undegraded":"2024-04-03T05:11:32.844991+0000","last_fullsized":"2024-04-03T05:11:32.844991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:40:07.793280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":587,"num_read_kb":421,"num_write":142,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:38.988696+0000","last_change":"2024-04-03T04:18:51.317587+0000","last_active":"2024-04-03T05:09:38.988696+0000","last_peered":"2024-04-03T05:09:38.988696+0000","last_clean":"2024-04-03T05:09:38.988696+0000","last_became_active":"2024-04-03T04:18:51.316328+0000","last_became_peered":"2024-04-03T04:18:51.316328+0000","last_unstale":"2024-04-03T05:09:38.988696+0000","last_undegraded":"2024-04-03T05:09:38.988696+0000","last_fullsized":"2024-04-03T05:09:38.988696+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:59:54.383193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.950586+0000","last_change":"2024-04-03T03:55:53.252686+0000","last_active":"2024-04-03T05:14:07.950586+0000","last_peered":"2024-04-03T05:14:07.950586+0000","last_clean":"2024-04-03T05:14:07.950586+0000","last_became_active":"2024-04-03T03:55:53.251965+0000","last_became_peered":"2024-04-03T03:55:53.251965+0000","last_unstale":"2024-04-03T05:14:07.950586+0000","last_undegraded":"2024-04-03T05:14:07.950586+0000","last_fullsized":"2024-04-03T05:14:07.950586+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:11:31.485683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4667,"num_write":4,"num_write_kb":4667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.845391+0000","last_change":"2024-04-03T03:55:45.811812+0000","last_active":"2024-04-03T05:14:08.845391+0000","last_peered":"2024-04-03T05:14:08.845391+0000","last_clean":"2024-04-03T05:14:08.845391+0000","last_became_active":"2024-04-03T03:55:45.811051+0000","last_became_peered":"2024-04-03T03:55:45.811051+0000","last_unstale":"2024-04-03T05:14:08.845391+0000","last_undegraded":"2024-04-03T05:14:08.845391+0000","last_fullsized":"2024-04-03T05:14:08.845391+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:29:56.079808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"263'6","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:32.844932+0000","last_change":"2024-04-03T03:49:00.990124+0000","last_active":"2024-04-03T05:11:32.844932+0000","last_peered":"2024-04-03T05:11:32.844932+0000","last_clean":"2024-04-03T05:11:32.844932+0000","last_became_active":"2024-04-03T03:49:00.989383+0000","last_became_peered":"2024-04-03T03:49:00.989383+0000","last_unstale":"2024-04-03T05:11:32.844932+0000","last_undegraded":"2024-04-03T05:11:32.844932+0000","last_fullsized":"2024-04-03T05:11:32.844932+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:51:07.689068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:53.812847+0000","last_change":"2024-04-03T04:18:51.318126+0000","last_active":"2024-04-03T05:09:53.812847+0000","last_peered":"2024-04-03T05:09:53.812847+0000","last_clean":"2024-04-03T05:09:53.812847+0000","last_became_active":"2024-04-03T04:18:51.317417+0000","last_became_peered":"2024-04-03T04:18:51.317417+0000","last_unstale":"2024-04-03T05:09:53.812847+0000","last_undegraded":"2024-04-03T05:09:53.812847+0000","last_fullsized":"2024-04-03T05:09:53.812847+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:40:19.565316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"258'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.057729+0000","last_change":"2024-04-03T03:55:53.251802+0000","last_active":"2024-04-03T05:10:48.057729+0000","last_peered":"2024-04-03T05:10:48.057729+0000","last_clean":"2024-04-03T05:10:48.057729+0000","last_became_active":"2024-04-03T03:55:53.250769+0000","last_became_peered":"2024-04-03T03:55:53.250769+0000","last_unstale":"2024-04-03T05:10:48.057729+0000","last_undegraded":"2024-04-03T05:10:48.057729+0000","last_fullsized":"2024-04-03T05:10:48.057729+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:22:00.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'4","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.062599+0000","last_change":"2024-04-03T03:55:45.821907+0000","last_active":"2024-04-03T05:14:08.062599+0000","last_peered":"2024-04-03T05:14:08.062599+0000","last_clean":"2024-04-03T05:14:08.062599+0000","last_became_active":"2024-04-03T03:55:45.821160+0000","last_became_peered":"2024-04-03T03:55:45.821160+0000","last_unstale":"2024-04-03T05:14:08.062599+0000","last_undegraded":"2024-04-03T05:14:08.062599+0000","last_fullsized":"2024-04-03T05:14:08.062599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:35:53.921787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"263'66","reported_seq":279,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:34.041123+0000","last_change":"2024-04-03T03:49:00.994955+0000","last_active":"2024-04-03T05:11:34.041123+0000","last_peered":"2024-04-03T05:11:34.041123+0000","last_clean":"2024-04-03T05:11:34.041123+0000","last_became_active":"2024-04-03T03:49:00.994321+0000","last_became_peered":"2024-04-03T03:49:00.994321+0000","last_unstale":"2024-04-03T05:11:34.041123+0000","last_undegraded":"2024-04-03T05:11:34.041123+0000","last_fullsized":"2024-04-03T05:11:34.041123+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:04:59.985722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":300,"num_write":80,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:23.021856+0000","last_change":"2024-04-03T04:18:51.312623+0000","last_active":"2024-04-03T05:11:23.021856+0000","last_peered":"2024-04-03T05:11:23.021856+0000","last_clean":"2024-04-03T05:11:23.021856+0000","last_became_active":"2024-04-03T04:18:51.311870+0000","last_became_peered":"2024-04-03T04:18:51.311870+0000","last_unstale":"2024-04-03T05:11:23.021856+0000","last_undegraded":"2024-04-03T05:11:23.021856+0000","last_fullsized":"2024-04-03T05:11:23.021856+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:38:54.851895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.059027+0000","last_change":"2024-04-03T03:55:53.242608+0000","last_active":"2024-04-03T05:10:53.059027+0000","last_peered":"2024-04-03T05:10:53.059027+0000","last_clean":"2024-04-03T05:10:53.059027+0000","last_became_active":"2024-04-03T03:55:53.241200+0000","last_became_peered":"2024-04-03T03:55:53.241200+0000","last_unstale":"2024-04-03T05:10:53.059027+0000","last_undegraded":"2024-04-03T05:10:53.059027+0000","last_fullsized":"2024-04-03T05:10:53.059027+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:46:17.515799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.110786+0000","last_change":"2024-04-03T03:55:45.836536+0000","last_active":"2024-04-03T05:14:10.110786+0000","last_peered":"2024-04-03T05:14:10.110786+0000","last_clean":"2024-04-03T05:14:10.110786+0000","last_became_active":"2024-04-03T03:55:45.835828+0000","last_became_peered":"2024-04-03T03:55:45.835828+0000","last_unstale":"2024-04-03T05:14:10.110786+0000","last_undegraded":"2024-04-03T05:14:10.110786+0000","last_fullsized":"2024-04-03T05:14:10.110786+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:34:15.514688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12338,"num_write":9,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"263'59","reported_seq":210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:33.023899+0000","last_change":"2024-04-03T03:49:00.989070+0000","last_active":"2024-04-03T05:11:33.023899+0000","last_peered":"2024-04-03T05:11:33.023899+0000","last_clean":"2024-04-03T05:11:33.023899+0000","last_became_active":"2024-04-03T03:49:00.988327+0000","last_became_peered":"2024-04-03T03:49:00.988327+0000","last_unstale":"2024-04-03T05:11:33.023899+0000","last_undegraded":"2024-04-03T05:11:33.023899+0000","last_fullsized":"2024-04-03T05:11:33.023899+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:24:56.998629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":175,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012373+0000","last_change":"2024-04-03T04:18:51.307288+0000","last_active":"2024-04-03T05:11:24.012373+0000","last_peered":"2024-04-03T05:11:24.012373+0000","last_clean":"2024-04-03T05:11:24.012373+0000","last_became_active":"2024-04-03T04:18:51.299249+0000","last_became_peered":"2024-04-03T04:18:51.299249+0000","last_unstale":"2024-04-03T05:11:24.012373+0000","last_undegraded":"2024-04-03T05:11:24.012373+0000","last_fullsized":"2024-04-03T05:11:24.012373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:30:50.463422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'9","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:23.664298+0000","last_change":"2024-04-03T03:55:53.278378+0000","last_active":"2024-04-03T05:13:23.664298+0000","last_peered":"2024-04-03T05:13:23.664298+0000","last_clean":"2024-04-03T05:13:23.664298+0000","last_became_active":"2024-04-03T03:55:53.277505+0000","last_became_peered":"2024-04-03T03:55:53.277505+0000","last_unstale":"2024-04-03T05:13:23.664298+0000","last_undegraded":"2024-04-03T05:13:23.664298+0000","last_fullsized":"2024-04-03T05:13:23.664298+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:20:26.901761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"258'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062645+0000","last_change":"2024-04-03T03:55:45.820242+0000","last_active":"2024-04-03T05:11:08.062645+0000","last_peered":"2024-04-03T05:11:08.062645+0000","last_clean":"2024-04-03T05:11:08.062645+0000","last_became_active":"2024-04-03T03:55:45.811093+0000","last_became_peered":"2024-04-03T03:55:45.811093+0000","last_unstale":"2024-04-03T05:11:08.062645+0000","last_undegraded":"2024-04-03T05:11:08.062645+0000","last_fullsized":"2024-04-03T05:11:08.062645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:19:41.634825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:13.831105+0000","last_change":"2024-04-03T03:49:00.974095+0000","last_active":"2024-04-03T05:11:13.831105+0000","last_peered":"2024-04-03T05:11:13.831105+0000","last_clean":"2024-04-03T05:11:13.831105+0000","last_became_active":"2024-04-03T03:49:00.973216+0000","last_became_peered":"2024-04-03T03:49:00.973216+0000","last_unstale":"2024-04-03T05:11:13.831105+0000","last_undegraded":"2024-04-03T05:11:13.831105+0000","last_fullsized":"2024-04-03T05:11:13.831105+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:37:20.222939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"260'1","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056727+0000","last_change":"2024-04-03T04:19:00.383020+0000","last_active":"2024-04-03T05:10:43.056727+0000","last_peered":"2024-04-03T05:10:43.056727+0000","last_clean":"2024-04-03T05:10:43.056727+0000","last_became_active":"2024-04-03T04:19:00.377208+0000","last_became_peered":"2024-04-03T04:19:00.377208+0000","last_unstale":"2024-04-03T05:10:43.056727+0000","last_undegraded":"2024-04-03T05:10:43.056727+0000","last_fullsized":"2024-04-03T05:10:43.056727+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:44.601663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:14.063888+0000","last_change":"2024-04-03T03:55:53.258982+0000","last_active":"2024-04-03T05:13:14.063888+0000","last_peered":"2024-04-03T05:13:14.063888+0000","last_clean":"2024-04-03T05:13:14.063888+0000","last_became_active":"2024-04-03T03:55:53.258699+0000","last_became_peered":"2024-04-03T03:55:53.258699+0000","last_unstale":"2024-04-03T05:13:14.063888+0000","last_undegraded":"2024-04-03T05:13:14.063888+0000","last_fullsized":"2024-04-03T05:13:14.063888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:38:05.039097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'6","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.323384+0000","last_change":"2024-04-03T03:55:45.837044+0000","last_active":"2024-04-03T05:14:10.323384+0000","last_peered":"2024-04-03T05:14:10.323384+0000","last_clean":"2024-04-03T05:14:10.323384+0000","last_became_active":"2024-04-03T03:55:45.831660+0000","last_became_peered":"2024-04-03T03:55:45.831660+0000","last_unstale":"2024-04-03T05:14:10.323384+0000","last_undegraded":"2024-04-03T05:14:10.323384+0000","last_fullsized":"2024-04-03T05:14:10.323384+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:28:51.321618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"263'39","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:14.010323+0000","last_change":"2024-04-03T03:49:00.969632+0000","last_active":"2024-04-03T05:11:14.010323+0000","last_peered":"2024-04-03T05:11:14.010323+0000","last_clean":"2024-04-03T05:11:14.010323+0000","last_became_active":"2024-04-03T03:49:00.968902+0000","last_became_peered":"2024-04-03T03:49:00.968902+0000","last_unstale":"2024-04-03T05:11:14.010323+0000","last_undegraded":"2024-04-03T05:11:14.010323+0000","last_fullsized":"2024-04-03T05:11:14.010323+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:23.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":106,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:37.996691+0000","last_change":"2024-04-03T04:18:51.368008+0000","last_active":"2024-04-03T05:09:37.996691+0000","last_peered":"2024-04-03T05:09:37.996691+0000","last_clean":"2024-04-03T05:09:37.996691+0000","last_became_active":"2024-04-03T04:18:51.367290+0000","last_became_peered":"2024-04-03T04:18:51.367290+0000","last_unstale":"2024-04-03T05:09:37.996691+0000","last_undegraded":"2024-04-03T05:09:37.996691+0000","last_fullsized":"2024-04-03T05:09:37.996691+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:43.727578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.827724+0000","last_change":"2024-04-03T03:55:53.249249+0000","last_active":"2024-04-03T05:10:58.827724+0000","last_peered":"2024-04-03T05:10:58.827724+0000","last_clean":"2024-04-03T05:10:58.827724+0000","last_became_active":"2024-04-03T03:55:53.247541+0000","last_became_peered":"2024-04-03T03:55:53.247541+0000","last_unstale":"2024-04-03T05:10:58.827724+0000","last_undegraded":"2024-04-03T05:10:58.827724+0000","last_fullsized":"2024-04-03T05:10:58.827724+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:08.778733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"258'4","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056828+0000","last_change":"2024-04-03T03:55:45.820738+0000","last_active":"2024-04-03T05:10:43.056828+0000","last_peered":"2024-04-03T05:10:43.056828+0000","last_clean":"2024-04-03T05:10:43.056828+0000","last_became_active":"2024-04-03T03:55:45.819664+0000","last_became_peered":"2024-04-03T03:55:45.819664+0000","last_unstale":"2024-04-03T05:10:43.056828+0000","last_undegraded":"2024-04-03T05:10:43.056828+0000","last_fullsized":"2024-04-03T05:10:43.056828+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:03:06.968618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"263'13","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.840880+0000","last_change":"2024-04-03T03:49:00.962589+0000","last_active":"2024-04-03T05:11:12.840880+0000","last_peered":"2024-04-03T05:11:12.840880+0000","last_clean":"2024-04-03T05:11:12.840880+0000","last_became_active":"2024-04-03T03:49:00.961782+0000","last_became_peered":"2024-04-03T03:49:00.961782+0000","last_unstale":"2024-04-03T05:11:12.840880+0000","last_undegraded":"2024-04-03T05:11:12.840880+0000","last_fullsized":"2024-04-03T05:11:12.840880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:41:35.535598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:38.614737+0000","last_change":"2024-04-03T04:18:51.305071+0000","last_active":"2024-04-03T05:09:38.614737+0000","last_peered":"2024-04-03T05:09:38.614737+0000","last_clean":"2024-04-03T05:09:38.614737+0000","last_became_active":"2024-04-03T04:18:51.304323+0000","last_became_peered":"2024-04-03T04:18:51.304323+0000","last_unstale":"2024-04-03T05:09:38.614737+0000","last_undegraded":"2024-04-03T05:09:38.614737+0000","last_fullsized":"2024-04-03T05:09:38.614737+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:18.815723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'9","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.064864+0000","last_change":"2024-04-03T03:55:53.260481+0000","last_active":"2024-04-03T05:14:08.064864+0000","last_peered":"2024-04-03T05:14:08.064864+0000","last_clean":"2024-04-03T05:14:08.064864+0000","last_became_active":"2024-04-03T03:55:53.255231+0000","last_became_peered":"2024-04-03T03:55:53.255231+0000","last_unstale":"2024-04-03T05:14:08.064864+0000","last_undegraded":"2024-04-03T05:14:08.064864+0000","last_fullsized":"2024-04-03T05:14:08.064864+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:02:58.467385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.031015+0000","last_change":"2024-04-03T03:55:45.830178+0000","last_active":"2024-04-03T05:10:49.031015+0000","last_peered":"2024-04-03T05:10:49.031015+0000","last_clean":"2024-04-03T05:10:49.031015+0000","last_became_active":"2024-04-03T03:55:45.829412+0000","last_became_peered":"2024-04-03T03:55:45.829412+0000","last_unstale":"2024-04-03T05:10:49.031015+0000","last_undegraded":"2024-04-03T05:10:49.031015+0000","last_fullsized":"2024-04-03T05:10:49.031015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:56.123646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"263'19","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.828392+0000","last_change":"2024-04-03T03:49:00.983727+0000","last_active":"2024-04-03T05:11:12.828392+0000","last_peered":"2024-04-03T05:11:12.828392+0000","last_clean":"2024-04-03T05:11:12.828392+0000","last_became_active":"2024-04-03T03:49:00.981577+0000","last_became_peered":"2024-04-03T03:49:00.981577+0000","last_unstale":"2024-04-03T05:11:12.828392+0000","last_undegraded":"2024-04-03T05:11:12.828392+0000","last_fullsized":"2024-04-03T05:11:12.828392+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:30.772410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:37.996724+0000","last_change":"2024-04-03T04:18:51.373777+0000","last_active":"2024-04-03T05:09:37.996724+0000","last_peered":"2024-04-03T05:09:37.996724+0000","last_clean":"2024-04-03T05:09:37.996724+0000","last_became_active":"2024-04-03T04:18:51.372963+0000","last_became_peered":"2024-04-03T04:18:51.372963+0000","last_unstale":"2024-04-03T05:09:37.996724+0000","last_undegraded":"2024-04-03T05:09:37.996724+0000","last_fullsized":"2024-04-03T05:09:37.996724+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:47:59.061915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.369173+0000","last_change":"2024-04-03T03:55:53.270124+0000","last_active":"2024-04-03T05:14:09.369173+0000","last_peered":"2024-04-03T05:14:09.369173+0000","last_clean":"2024-04-03T05:14:09.369173+0000","last_became_active":"2024-04-03T03:55:53.268903+0000","last_became_peered":"2024-04-03T03:55:53.268903+0000","last_unstale":"2024-04-03T05:14:09.369173+0000","last_undegraded":"2024-04-03T05:14:09.369173+0000","last_fullsized":"2024-04-03T05:14:09.369173+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:54.240436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'2","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:07.852231+0000","last_change":"2024-04-03T03:55:45.835558+0000","last_active":"2024-04-03T05:13:07.852231+0000","last_peered":"2024-04-03T05:13:07.852231+0000","last_clean":"2024-04-03T05:13:07.852231+0000","last_became_active":"2024-04-03T03:55:45.834865+0000","last_became_peered":"2024-04-03T03:55:45.834865+0000","last_unstale":"2024-04-03T05:13:07.852231+0000","last_undegraded":"2024-04-03T05:13:07.852231+0000","last_fullsized":"2024-04-03T05:13:07.852231+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:44:08.343281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"263'64","reported_seq":230,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:07.839335+0000","last_change":"2024-04-03T03:49:00.971740+0000","last_active":"2024-04-03T05:11:07.839335+0000","last_peered":"2024-04-03T05:11:07.839335+0000","last_clean":"2024-04-03T05:11:07.839335+0000","last_became_active":"2024-04-03T03:49:00.971042+0000","last_became_peered":"2024-04-03T03:49:00.971042+0000","last_unstale":"2024-04-03T05:11:07.839335+0000","last_undegraded":"2024-04-03T05:11:07.839335+0000","last_fullsized":"2024-04-03T05:11:07.839335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:27.210269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":214,"num_write":97,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.822413+0000","last_change":"2024-04-03T04:18:51.308665+0000","last_active":"2024-04-03T05:10:12.822413+0000","last_peered":"2024-04-03T05:10:12.822413+0000","last_clean":"2024-04-03T05:10:12.822413+0000","last_became_active":"2024-04-03T04:18:51.307933+0000","last_became_peered":"2024-04-03T04:18:51.307933+0000","last_unstale":"2024-04-03T05:10:12.822413+0000","last_undegraded":"2024-04-03T05:10:12.822413+0000","last_fullsized":"2024-04-03T05:10:12.822413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:40:38.179255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:33.009473+0000","last_change":"2024-04-03T03:55:53.267596+0000","last_active":"2024-04-03T05:10:33.009473+0000","last_peered":"2024-04-03T05:10:33.009473+0000","last_clean":"2024-04-03T05:10:33.009473+0000","last_became_active":"2024-04-03T03:55:53.266957+0000","last_became_peered":"2024-04-03T03:55:53.266957+0000","last_unstale":"2024-04-03T05:10:33.009473+0000","last_undegraded":"2024-04-03T05:10:33.009473+0000","last_fullsized":"2024-04-03T05:10:33.009473+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:59:34.273773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:48.085314+0000","last_change":"2024-04-03T03:55:45.830004+0000","last_active":"2024-04-03T05:12:48.085314+0000","last_peered":"2024-04-03T05:12:48.085314+0000","last_clean":"2024-04-03T05:12:48.085314+0000","last_became_active":"2024-04-03T03:55:45.829247+0000","last_became_peered":"2024-04-03T03:55:45.829247+0000","last_unstale":"2024-04-03T05:12:48.085314+0000","last_undegraded":"2024-04-03T05:12:48.085314+0000","last_fullsized":"2024-04-03T05:12:48.085314+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:09.809498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"263'66","reported_seq":227,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:42.821469+0000","last_change":"2024-04-03T03:49:00.991682+0000","last_active":"2024-04-03T05:10:42.821469+0000","last_peered":"2024-04-03T05:10:42.821469+0000","last_clean":"2024-04-03T05:10:42.821469+0000","last_became_active":"2024-04-03T03:49:00.990969+0000","last_became_peered":"2024-04-03T03:49:00.990969+0000","last_unstale":"2024-04-03T05:10:42.821469+0000","last_undegraded":"2024-04-03T05:10:42.821469+0000","last_fullsized":"2024-04-03T05:10:42.821469+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:40.104007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":193,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:12.822537+0000","last_change":"2024-04-03T04:18:51.311760+0000","last_active":"2024-04-03T05:10:12.822537+0000","last_peered":"2024-04-03T05:10:12.822537+0000","last_clean":"2024-04-03T05:10:12.822537+0000","last_became_active":"2024-04-03T04:18:51.310856+0000","last_became_peered":"2024-04-03T04:18:51.310856+0000","last_unstale":"2024-04-03T05:10:12.822537+0000","last_undegraded":"2024-04-03T05:10:12.822537+0000","last_fullsized":"2024-04-03T05:10:12.822537+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:51:40.696345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'6","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.259527+0000","last_change":"2024-04-03T03:55:53.241238+0000","last_active":"2024-04-03T05:14:08.259527+0000","last_peered":"2024-04-03T05:14:08.259527+0000","last_clean":"2024-04-03T05:14:08.259527+0000","last_became_active":"2024-04-03T03:55:53.240485+0000","last_became_peered":"2024-04-03T03:55:53.240485+0000","last_unstale":"2024-04-03T05:14:08.259527+0000","last_undegraded":"2024-04-03T05:14:08.259527+0000","last_fullsized":"2024-04-03T05:14:08.259527+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:01:44.348572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026394+0000","last_change":"2024-04-03T03:55:45.833791+0000","last_active":"2024-04-03T05:10:29.026394+0000","last_peered":"2024-04-03T05:10:29.026394+0000","last_clean":"2024-04-03T05:10:29.026394+0000","last_became_active":"2024-04-03T03:55:45.833049+0000","last_became_peered":"2024-04-03T03:55:45.833049+0000","last_unstale":"2024-04-03T05:10:29.026394+0000","last_undegraded":"2024-04-03T05:10:29.026394+0000","last_fullsized":"2024-04-03T05:10:29.026394+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:01:14.170475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"263'54","reported_seq":206,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.824123+0000","last_change":"2024-04-03T03:49:00.970056+0000","last_active":"2024-04-03T05:10:43.824123+0000","last_peered":"2024-04-03T05:10:43.824123+0000","last_clean":"2024-04-03T05:10:43.824123+0000","last_became_active":"2024-04-03T03:49:00.969239+0000","last_became_peered":"2024-04-03T03:49:00.969239+0000","last_unstale":"2024-04-03T05:10:43.824123+0000","last_undegraded":"2024-04-03T05:10:43.824123+0000","last_fullsized":"2024-04-03T05:10:43.824123+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:11:29.264574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":93,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.997173+0000","last_change":"2024-04-03T04:18:51.318533+0000","last_active":"2024-04-03T05:10:13.997173+0000","last_peered":"2024-04-03T05:10:13.997173+0000","last_clean":"2024-04-03T05:10:13.997173+0000","last_became_active":"2024-04-03T04:18:51.318231+0000","last_became_peered":"2024-04-03T04:18:51.318231+0000","last_unstale":"2024-04-03T05:10:13.997173+0000","last_undegraded":"2024-04-03T05:10:13.997173+0000","last_fullsized":"2024-04-03T05:10:13.997173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:52:18.856506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.853418+0000","last_change":"2024-04-03T03:55:53.279237+0000","last_active":"2024-04-03T05:12:53.853418+0000","last_peered":"2024-04-03T05:12:53.853418+0000","last_clean":"2024-04-03T05:12:53.853418+0000","last_became_active":"2024-04-03T03:55:53.278529+0000","last_became_peered":"2024-04-03T03:55:53.278529+0000","last_unstale":"2024-04-03T05:12:53.853418+0000","last_undegraded":"2024-04-03T05:12:53.853418+0000","last_fullsized":"2024-04-03T05:12:53.853418+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:28:45.806634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:48.042074+0000","last_change":"2024-04-03T03:55:45.821524+0000","last_active":"2024-04-03T05:12:48.042074+0000","last_peered":"2024-04-03T05:12:48.042074+0000","last_clean":"2024-04-03T05:12:48.042074+0000","last_became_active":"2024-04-03T03:55:45.820737+0000","last_became_peered":"2024-04-03T03:55:45.820737+0000","last_unstale":"2024-04-03T05:12:48.042074+0000","last_undegraded":"2024-04-03T05:12:48.042074+0000","last_fullsized":"2024-04-03T05:12:48.042074+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:34.782850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"263'71","reported_seq":249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.629354+0000","last_change":"2024-04-03T03:49:00.991967+0000","last_active":"2024-04-03T05:10:43.629354+0000","last_peered":"2024-04-03T05:10:43.629354+0000","last_clean":"2024-04-03T05:10:43.629354+0000","last_became_active":"2024-04-03T03:49:00.987062+0000","last_became_peered":"2024-04-03T03:49:00.987062+0000","last_unstale":"2024-04-03T05:10:43.629354+0000","last_undegraded":"2024-04-03T05:10:43.629354+0000","last_fullsized":"2024-04-03T05:10:43.629354+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:22.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":233,"num_write":115,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.004757+0000","last_change":"2024-04-03T04:18:51.320211+0000","last_active":"2024-04-03T05:10:13.004757+0000","last_peered":"2024-04-03T05:10:13.004757+0000","last_clean":"2024-04-03T05:10:13.004757+0000","last_became_active":"2024-04-03T04:18:51.319383+0000","last_became_peered":"2024-04-03T04:18:51.319383+0000","last_unstale":"2024-04-03T05:10:13.004757+0000","last_undegraded":"2024-04-03T05:10:13.004757+0000","last_fullsized":"2024-04-03T05:10:13.004757+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:36:49.544317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'10","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.366903+0000","last_change":"2024-04-03T03:55:53.280600+0000","last_active":"2024-04-03T05:14:09.366903+0000","last_peered":"2024-04-03T05:14:09.366903+0000","last_clean":"2024-04-03T05:14:09.366903+0000","last_became_active":"2024-04-03T03:55:53.279910+0000","last_became_peered":"2024-04-03T03:55:53.279910+0000","last_unstale":"2024-04-03T05:14:09.366903+0000","last_undegraded":"2024-04-03T05:14:09.366903+0000","last_fullsized":"2024-04-03T05:14:09.366903+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:59.801920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":19,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'6","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:48.656558+0000","last_change":"2024-04-03T03:55:45.841365+0000","last_active":"2024-04-03T05:12:48.656558+0000","last_peered":"2024-04-03T05:12:48.656558+0000","last_clean":"2024-04-03T05:12:48.656558+0000","last_became_active":"2024-04-03T03:55:45.840884+0000","last_became_peered":"2024-04-03T03:55:45.840884+0000","last_unstale":"2024-04-03T05:12:48.656558+0000","last_undegraded":"2024-04-03T05:12:48.656558+0000","last_fullsized":"2024-04-03T05:12:48.656558+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:16:08.781831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"263'34","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.011805+0000","last_change":"2024-04-03T03:49:00.967711+0000","last_active":"2024-04-03T05:10:43.011805+0000","last_peered":"2024-04-03T05:10:43.011805+0000","last_clean":"2024-04-03T05:10:43.011805+0000","last_became_active":"2024-04-03T03:49:00.966982+0000","last_became_peered":"2024-04-03T03:49:00.966982+0000","last_unstale":"2024-04-03T05:10:43.011805+0000","last_undegraded":"2024-04-03T05:10:43.011805+0000","last_fullsized":"2024-04-03T05:10:43.011805+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:56.610313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"261'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010784+0000","last_change":"2024-04-03T04:18:51.315214+0000","last_active":"2024-04-03T05:10:38.010784+0000","last_peered":"2024-04-03T05:10:38.010784+0000","last_clean":"2024-04-03T05:10:38.010784+0000","last_became_active":"2024-04-03T04:18:51.314416+0000","last_became_peered":"2024-04-03T04:18:51.314416+0000","last_unstale":"2024-04-03T05:10:38.010784+0000","last_undegraded":"2024-04-03T05:10:38.010784+0000","last_fullsized":"2024-04-03T05:10:38.010784+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:02.075238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'10","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.596105+0000","last_change":"2024-04-03T03:55:53.248818+0000","last_active":"2024-04-03T05:14:08.596105+0000","last_peered":"2024-04-03T05:14:08.596105+0000","last_clean":"2024-04-03T05:14:08.596105+0000","last_became_active":"2024-04-03T03:55:53.248092+0000","last_became_peered":"2024-04-03T03:55:53.248092+0000","last_unstale":"2024-04-03T05:14:08.596105+0000","last_undegraded":"2024-04-03T05:14:08.596105+0000","last_fullsized":"2024-04-03T05:14:08.596105+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:20:29.850186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"258'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.815188+0000","last_change":"2024-04-03T03:55:45.830497+0000","last_active":"2024-04-03T05:10:03.815188+0000","last_peered":"2024-04-03T05:10:03.815188+0000","last_clean":"2024-04-03T05:10:03.815188+0000","last_became_active":"2024-04-03T03:55:45.829835+0000","last_became_peered":"2024-04-03T03:55:45.829835+0000","last_unstale":"2024-04-03T05:10:03.815188+0000","last_undegraded":"2024-04-03T05:10:03.815188+0000","last_fullsized":"2024-04-03T05:10:03.815188+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:42.544072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"263'30","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.820973+0000","last_change":"2024-04-03T03:49:00.984614+0000","last_active":"2024-04-03T05:10:28.820973+0000","last_peered":"2024-04-03T05:10:28.820973+0000","last_clean":"2024-04-03T05:10:28.820973+0000","last_became_active":"2024-04-03T03:49:00.983761+0000","last_became_peered":"2024-04-03T03:49:00.983761+0000","last_unstale":"2024-04-03T05:10:28.820973+0000","last_undegraded":"2024-04-03T05:10:28.820973+0000","last_fullsized":"2024-04-03T05:10:28.820973+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:55:59.720764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010837+0000","last_change":"2024-04-03T04:18:51.320209+0000","last_active":"2024-04-03T05:10:38.010837+0000","last_peered":"2024-04-03T05:10:38.010837+0000","last_clean":"2024-04-03T05:10:38.010837+0000","last_became_active":"2024-04-03T04:18:51.319470+0000","last_became_peered":"2024-04-03T04:18:51.319470+0000","last_unstale":"2024-04-03T05:10:38.010837+0000","last_undegraded":"2024-04-03T05:10:38.010837+0000","last_fullsized":"2024-04-03T05:10:38.010837+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:33:04.413239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'7","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:24.052556+0000","last_change":"2024-04-03T03:55:53.258437+0000","last_active":"2024-04-03T05:12:24.052556+0000","last_peered":"2024-04-03T05:12:24.052556+0000","last_clean":"2024-04-03T05:12:24.052556+0000","last_became_active":"2024-04-03T03:55:53.257856+0000","last_became_peered":"2024-04-03T03:55:53.257856+0000","last_unstale":"2024-04-03T05:12:24.052556+0000","last_undegraded":"2024-04-03T05:12:24.052556+0000","last_fullsized":"2024-04-03T05:12:24.052556+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:11:30.203783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":16434,"num_write":11,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":86,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:38.039801+0000","last_change":"2024-04-03T03:55:45.835655+0000","last_active":"2024-04-03T05:12:38.039801+0000","last_peered":"2024-04-03T05:12:38.039801+0000","last_clean":"2024-04-03T05:12:38.039801+0000","last_became_active":"2024-04-03T03:55:45.829711+0000","last_became_peered":"2024-04-03T03:55:45.829711+0000","last_unstale":"2024-04-03T05:12:38.039801+0000","last_undegraded":"2024-04-03T05:12:38.039801+0000","last_fullsized":"2024-04-03T05:12:38.039801+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:48.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":20484,"num_write":20,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"263'38","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.995075+0000","last_change":"2024-04-03T03:49:00.987947+0000","last_active":"2024-04-03T05:10:03.995075+0000","last_peered":"2024-04-03T05:10:03.995075+0000","last_clean":"2024-04-03T05:10:03.995075+0000","last_became_active":"2024-04-03T03:49:00.987174+0000","last_became_peered":"2024-04-03T03:49:00.987174+0000","last_unstale":"2024-04-03T05:10:03.995075+0000","last_undegraded":"2024-04-03T05:10:03.995075+0000","last_fullsized":"2024-04-03T05:10:03.995075+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:24:58.481056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.010877+0000","last_change":"2024-04-03T04:18:51.321162+0000","last_active":"2024-04-03T05:10:38.010877+0000","last_peered":"2024-04-03T05:10:38.010877+0000","last_clean":"2024-04-03T05:10:38.010877+0000","last_became_active":"2024-04-03T04:18:51.320359+0000","last_became_peered":"2024-04-03T04:18:51.320359+0000","last_unstale":"2024-04-03T05:10:38.010877+0000","last_undegraded":"2024-04-03T05:10:38.010877+0000","last_fullsized":"2024-04-03T05:10:38.010877+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:19:17.610665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"258'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:27.825755+0000","last_change":"2024-04-03T03:55:53.275336+0000","last_active":"2024-04-03T05:10:27.825755+0000","last_peered":"2024-04-03T05:10:27.825755+0000","last_clean":"2024-04-03T05:10:27.825755+0000","last_became_active":"2024-04-03T03:55:53.274653+0000","last_became_peered":"2024-04-03T03:55:53.274653+0000","last_unstale":"2024-04-03T05:10:27.825755+0000","last_undegraded":"2024-04-03T05:10:27.825755+0000","last_fullsized":"2024-04-03T05:10:27.825755+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:08:05.730323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.813033+0000","last_change":"2024-04-03T03:55:45.832909+0000","last_active":"2024-04-03T05:10:02.813033+0000","last_peered":"2024-04-03T05:10:02.813033+0000","last_clean":"2024-04-03T05:10:02.813033+0000","last_became_active":"2024-04-03T03:55:45.832127+0000","last_became_peered":"2024-04-03T03:55:45.832127+0000","last_unstale":"2024-04-03T05:10:02.813033+0000","last_undegraded":"2024-04-03T05:10:02.813033+0000","last_fullsized":"2024-04-03T05:10:02.813033+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:03:14.969466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"263'16","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.620556+0000","last_change":"2024-04-03T03:49:00.992325+0000","last_active":"2024-04-03T05:10:03.620556+0000","last_peered":"2024-04-03T05:10:03.620556+0000","last_clean":"2024-04-03T05:10:03.620556+0000","last_became_active":"2024-04-03T03:49:00.987993+0000","last_became_peered":"2024-04-03T03:49:00.987993+0000","last_unstale":"2024-04-03T05:10:03.620556+0000","last_undegraded":"2024-04-03T05:10:03.620556+0000","last_fullsized":"2024-04-03T05:10:03.620556+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:47.291199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831156+0000","last_change":"2024-04-03T04:18:51.373972+0000","last_active":"2024-04-03T05:10:52.831156+0000","last_peered":"2024-04-03T05:10:52.831156+0000","last_clean":"2024-04-03T05:10:52.831156+0000","last_became_active":"2024-04-03T04:18:51.373189+0000","last_became_peered":"2024-04-03T04:18:51.373189+0000","last_unstale":"2024-04-03T05:10:52.831156+0000","last_undegraded":"2024-04-03T05:10:52.831156+0000","last_fullsized":"2024-04-03T05:10:52.831156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:58.064420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'4","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:23.079451+0000","last_change":"2024-04-03T03:55:53.244970+0000","last_active":"2024-04-03T05:12:23.079451+0000","last_peered":"2024-04-03T05:12:23.079451+0000","last_clean":"2024-04-03T05:12:23.079451+0000","last_became_active":"2024-04-03T03:55:53.243858+0000","last_became_peered":"2024-04-03T03:55:53.243858+0000","last_unstale":"2024-04-03T05:12:23.079451+0000","last_undegraded":"2024-04-03T05:12:23.079451+0000","last_fullsized":"2024-04-03T05:12:23.079451+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:44:36.583585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'7","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:19.027466+0000","last_change":"2024-04-03T03:55:45.817717+0000","last_active":"2024-04-03T05:12:19.027466+0000","last_peered":"2024-04-03T05:12:19.027466+0000","last_clean":"2024-04-03T05:12:19.027466+0000","last_became_active":"2024-04-03T03:55:45.815910+0000","last_became_peered":"2024-04-03T03:55:45.815910+0000","last_unstale":"2024-04-03T05:12:19.027466+0000","last_undegraded":"2024-04-03T05:12:19.027466+0000","last_fullsized":"2024-04-03T05:12:19.027466+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:54:30.857141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"263'51","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:03.815083+0000","last_change":"2024-04-03T03:49:00.966203+0000","last_active":"2024-04-03T05:10:03.815083+0000","last_peered":"2024-04-03T05:10:03.815083+0000","last_clean":"2024-04-03T05:10:03.815083+0000","last_became_active":"2024-04-03T03:49:00.965454+0000","last_became_peered":"2024-04-03T03:49:00.965454+0000","last_unstale":"2024-04-03T05:10:03.815083+0000","last_undegraded":"2024-04-03T05:10:03.815083+0000","last_fullsized":"2024-04-03T05:10:03.815083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:28.980846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":162,"num_write":91,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032020+0000","last_change":"2024-04-03T04:18:51.367810+0000","last_active":"2024-04-03T05:10:54.032020+0000","last_peered":"2024-04-03T05:10:54.032020+0000","last_clean":"2024-04-03T05:10:54.032020+0000","last_became_active":"2024-04-03T04:18:51.367071+0000","last_became_peered":"2024-04-03T04:18:51.367071+0000","last_unstale":"2024-04-03T05:10:54.032020+0000","last_undegraded":"2024-04-03T05:10:54.032020+0000","last_fullsized":"2024-04-03T05:10:54.032020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:36.487716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"258'2","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.847213+0000","last_change":"2024-04-03T03:55:53.265746+0000","last_active":"2024-04-03T05:11:42.847213+0000","last_peered":"2024-04-03T05:11:42.847213+0000","last_clean":"2024-04-03T05:11:42.847213+0000","last_became_active":"2024-04-03T03:55:53.265100+0000","last_became_peered":"2024-04-03T03:55:53.265100+0000","last_unstale":"2024-04-03T05:11:42.847213+0000","last_undegraded":"2024-04-03T05:11:42.847213+0000","last_fullsized":"2024-04-03T05:11:42.847213+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:30.419453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'8","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.324111+0000","last_change":"2024-04-03T03:55:45.823070+0000","last_active":"2024-04-03T05:14:10.324111+0000","last_peered":"2024-04-03T05:14:10.324111+0000","last_clean":"2024-04-03T05:14:10.324111+0000","last_became_active":"2024-04-03T03:55:45.822292+0000","last_became_peered":"2024-04-03T03:55:45.822292+0000","last_unstale":"2024-04-03T05:14:10.324111+0000","last_undegraded":"2024-04-03T05:14:10.324111+0000","last_fullsized":"2024-04-03T05:14:10.324111+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:18:47.010740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"263'28","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.820452+0000","last_change":"2024-04-03T03:49:00.981872+0000","last_active":"2024-04-03T05:10:02.820452+0000","last_peered":"2024-04-03T05:10:02.820452+0000","last_clean":"2024-04-03T05:10:02.820452+0000","last_became_active":"2024-04-03T03:49:00.981338+0000","last_became_peered":"2024-04-03T03:49:00.981338+0000","last_unstale":"2024-04-03T05:10:02.820452+0000","last_undegraded":"2024-04-03T05:10:02.820452+0000","last_fullsized":"2024-04-03T05:10:02.820452+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:55:28.926003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631722+0000","last_change":"2024-04-03T04:18:51.309156+0000","last_active":"2024-04-03T05:10:53.631722+0000","last_peered":"2024-04-03T05:10:53.631722+0000","last_clean":"2024-04-03T05:10:53.631722+0000","last_became_active":"2024-04-03T04:18:51.308461+0000","last_became_peered":"2024-04-03T04:18:51.308461+0000","last_unstale":"2024-04-03T05:10:53.631722+0000","last_undegraded":"2024-04-03T05:10:53.631722+0000","last_fullsized":"2024-04-03T05:10:53.631722+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:21.152603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.366667+0000","last_change":"2024-04-03T03:55:53.244597+0000","last_active":"2024-04-03T05:14:09.366667+0000","last_peered":"2024-04-03T05:14:09.366667+0000","last_clean":"2024-04-03T05:14:09.366667+0000","last_became_active":"2024-04-03T03:55:53.243822+0000","last_became_peered":"2024-04-03T03:55:53.243822+0000","last_unstale":"2024-04-03T05:14:09.366667+0000","last_undegraded":"2024-04-03T05:14:09.366667+0000","last_fullsized":"2024-04-03T05:14:09.366667+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:29.709703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'4","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:18.078157+0000","last_change":"2024-04-03T03:55:45.819884+0000","last_active":"2024-04-03T05:12:18.078157+0000","last_peered":"2024-04-03T05:12:18.078157+0000","last_clean":"2024-04-03T05:12:18.078157+0000","last_became_active":"2024-04-03T03:55:45.819117+0000","last_became_peered":"2024-04-03T03:55:45.819117+0000","last_unstale":"2024-04-03T05:12:18.078157+0000","last_undegraded":"2024-04-03T05:12:18.078157+0000","last_fullsized":"2024-04-03T05:12:18.078157+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:34:21.679511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"263'9","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.835717+0000","last_change":"2024-04-03T03:49:00.992070+0000","last_active":"2024-04-03T05:11:47.835717+0000","last_peered":"2024-04-03T05:11:47.835717+0000","last_clean":"2024-04-03T05:11:47.835717+0000","last_became_active":"2024-04-03T03:49:00.991393+0000","last_became_peered":"2024-04-03T03:49:00.991393+0000","last_unstale":"2024-04-03T05:11:47.835717+0000","last_undegraded":"2024-04-03T05:11:47.835717+0000","last_fullsized":"2024-04-03T05:11:47.835717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:31.923155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:09.035711+0000","last_change":"2024-04-03T04:18:51.316420+0000","last_active":"2024-04-03T05:11:09.035711+0000","last_peered":"2024-04-03T05:11:09.035711+0000","last_clean":"2024-04-03T05:11:09.035711+0000","last_became_active":"2024-04-03T04:18:51.315679+0000","last_became_peered":"2024-04-03T04:18:51.315679+0000","last_unstale":"2024-04-03T05:11:09.035711+0000","last_undegraded":"2024-04-03T05:11:09.035711+0000","last_fullsized":"2024-04-03T05:11:09.035711+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:48:40.281554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"258'4","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.621671+0000","last_change":"2024-04-03T03:55:53.278183+0000","last_active":"2024-04-03T05:10:08.621671+0000","last_peered":"2024-04-03T05:10:08.621671+0000","last_clean":"2024-04-03T05:10:08.621671+0000","last_became_active":"2024-04-03T03:55:53.277402+0000","last_became_peered":"2024-04-03T03:55:53.277402+0000","last_unstale":"2024-04-03T05:10:08.621671+0000","last_undegraded":"2024-04-03T05:10:08.621671+0000","last_fullsized":"2024-04-03T05:10:08.621671+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:52:40.795096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":3,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'7","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:49.049030+0000","last_change":"2024-04-03T03:55:45.815042+0000","last_active":"2024-04-03T05:13:49.049030+0000","last_peered":"2024-04-03T05:13:49.049030+0000","last_clean":"2024-04-03T05:13:49.049030+0000","last_became_active":"2024-04-03T03:55:45.814319+0000","last_became_peered":"2024-04-03T03:55:45.814319+0000","last_unstale":"2024-04-03T05:13:49.049030+0000","last_undegraded":"2024-04-03T05:13:49.049030+0000","last_fullsized":"2024-04-03T05:13:49.049030+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:37.639076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"263'34","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.830330+0000","last_change":"2024-04-03T03:49:00.979853+0000","last_active":"2024-04-03T05:11:22.830330+0000","last_peered":"2024-04-03T05:11:22.830330+0000","last_clean":"2024-04-03T05:11:22.830330+0000","last_became_active":"2024-04-03T03:49:00.979122+0000","last_became_peered":"2024-04-03T03:49:00.979122+0000","last_unstale":"2024-04-03T05:11:22.830330+0000","last_undegraded":"2024-04-03T05:11:22.830330+0000","last_fullsized":"2024-04-03T05:11:22.830330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:05:49.282231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":103,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:37.827796+0000","last_change":"2024-04-03T04:18:51.318648+0000","last_active":"2024-04-03T05:10:37.827796+0000","last_peered":"2024-04-03T05:10:37.827796+0000","last_clean":"2024-04-03T05:10:37.827796+0000","last_became_active":"2024-04-03T04:18:51.318018+0000","last_became_peered":"2024-04-03T04:18:51.318018+0000","last_unstale":"2024-04-03T05:10:37.827796+0000","last_undegraded":"2024-04-03T05:10:37.827796+0000","last_fullsized":"2024-04-03T05:10:37.827796+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:37:23.498696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'7","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:08.075714+0000","last_change":"2024-04-03T03:55:53.255437+0000","last_active":"2024-04-03T05:12:08.075714+0000","last_peered":"2024-04-03T05:12:08.075714+0000","last_clean":"2024-04-03T05:12:08.075714+0000","last_became_active":"2024-04-03T03:55:53.254546+0000","last_became_peered":"2024-04-03T03:55:53.254546+0000","last_unstale":"2024-04-03T05:12:08.075714+0000","last_undegraded":"2024-04-03T05:12:08.075714+0000","last_fullsized":"2024-04-03T05:12:08.075714+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:50:56.563374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"258'9","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.025293+0000","last_change":"2024-04-03T03:55:45.821106+0000","last_active":"2024-04-03T05:11:38.025293+0000","last_peered":"2024-04-03T05:11:38.025293+0000","last_clean":"2024-04-03T05:11:38.025293+0000","last_became_active":"2024-04-03T03:55:45.820294+0000","last_became_peered":"2024-04-03T03:55:45.820294+0000","last_unstale":"2024-04-03T05:11:38.025293+0000","last_undegraded":"2024-04-03T05:11:38.025293+0000","last_fullsized":"2024-04-03T05:11:38.025293+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:18:59.587447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18434,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"263'22","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012281+0000","last_change":"2024-04-03T03:49:00.980486+0000","last_active":"2024-04-03T05:11:24.012281+0000","last_peered":"2024-04-03T05:11:24.012281+0000","last_clean":"2024-04-03T05:11:24.012281+0000","last_became_active":"2024-04-03T03:49:00.979598+0000","last_became_peered":"2024-04-03T03:49:00.979598+0000","last_unstale":"2024-04-03T05:11:24.012281+0000","last_undegraded":"2024-04-03T05:11:24.012281+0000","last_fullsized":"2024-04-03T05:11:24.012281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:44:21.546630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":52,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060442+0000","last_change":"2024-04-03T04:18:51.367266+0000","last_active":"2024-04-03T05:10:58.060442+0000","last_peered":"2024-04-03T05:10:58.060442+0000","last_clean":"2024-04-03T05:10:58.060442+0000","last_became_active":"2024-04-03T04:18:51.366501+0000","last_became_peered":"2024-04-03T04:18:51.366501+0000","last_unstale":"2024-04-03T05:10:58.060442+0000","last_undegraded":"2024-04-03T05:10:58.060442+0000","last_fullsized":"2024-04-03T05:10:58.060442+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:54:14.385852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'10","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:17.853600+0000","last_change":"2024-04-03T03:55:53.268300+0000","last_active":"2024-04-03T05:13:17.853600+0000","last_peered":"2024-04-03T05:13:17.853600+0000","last_clean":"2024-04-03T05:13:17.853600+0000","last_became_active":"2024-04-03T03:55:53.266771+0000","last_became_peered":"2024-04-03T03:55:53.266771+0000","last_unstale":"2024-04-03T05:13:17.853600+0000","last_undegraded":"2024-04-03T05:13:17.853600+0000","last_fullsized":"2024-04-03T05:13:17.853600+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:55:16.846729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":19,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'3","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:49.049191+0000","last_change":"2024-04-03T03:55:45.837048+0000","last_active":"2024-04-03T05:13:49.049191+0000","last_peered":"2024-04-03T05:13:49.049191+0000","last_clean":"2024-04-03T05:13:49.049191+0000","last_became_active":"2024-04-03T03:55:45.836623+0000","last_became_peered":"2024-04-03T03:55:45.836623+0000","last_unstale":"2024-04-03T05:13:49.049191+0000","last_undegraded":"2024-04-03T05:13:49.049191+0000","last_fullsized":"2024-04-03T05:13:49.049191+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:50.851547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"263'70","reported_seq":234,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.830519+0000","last_change":"2024-04-03T03:49:00.982602+0000","last_active":"2024-04-03T05:11:22.830519+0000","last_peered":"2024-04-03T05:11:22.830519+0000","last_clean":"2024-04-03T05:11:22.830519+0000","last_became_active":"2024-04-03T03:49:00.978563+0000","last_became_peered":"2024-04-03T03:49:00.978563+0000","last_unstale":"2024-04-03T05:11:22.830519+0000","last_undegraded":"2024-04-03T05:11:22.830519+0000","last_fullsized":"2024-04-03T05:11:22.830519+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:33.306663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":197,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.064707+0000","last_change":"2024-04-03T04:18:51.311769+0000","last_active":"2024-04-03T05:11:18.064707+0000","last_peered":"2024-04-03T05:11:18.064707+0000","last_clean":"2024-04-03T05:11:18.064707+0000","last_became_active":"2024-04-03T04:18:51.311005+0000","last_became_peered":"2024-04-03T04:18:51.311005+0000","last_unstale":"2024-04-03T05:11:18.064707+0000","last_undegraded":"2024-04-03T05:11:18.064707+0000","last_fullsized":"2024-04-03T05:11:18.064707+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:05:36.093095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"258'3","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032168+0000","last_change":"2024-04-03T03:55:53.252248+0000","last_active":"2024-04-03T05:10:54.032168+0000","last_peered":"2024-04-03T05:10:54.032168+0000","last_clean":"2024-04-03T05:10:54.032168+0000","last_became_active":"2024-04-03T03:55:53.251863+0000","last_became_peered":"2024-04-03T03:55:53.251863+0000","last_unstale":"2024-04-03T05:10:54.032168+0000","last_undegraded":"2024-04-03T05:10:54.032168+0000","last_fullsized":"2024-04-03T05:10:54.032168+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:47:22.809184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.069140+0000","last_change":"2024-04-03T03:55:45.829280+0000","last_active":"2024-04-03T05:11:38.069140+0000","last_peered":"2024-04-03T05:11:38.069140+0000","last_clean":"2024-04-03T05:11:38.069140+0000","last_became_active":"2024-04-03T03:55:45.823003+0000","last_became_peered":"2024-04-03T03:55:45.823003+0000","last_unstale":"2024-04-03T05:11:38.069140+0000","last_undegraded":"2024-04-03T05:11:38.069140+0000","last_fullsized":"2024-04-03T05:11:38.069140+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:11:38.406924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"263'42","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.039050+0000","last_change":"2024-04-03T03:49:00.982818+0000","last_active":"2024-04-03T05:11:24.039050+0000","last_peered":"2024-04-03T05:11:24.039050+0000","last_clean":"2024-04-03T05:11:24.039050+0000","last_became_active":"2024-04-03T03:49:00.981940+0000","last_became_peered":"2024-04-03T03:49:00.981940+0000","last_unstale":"2024-04-03T05:11:24.039050+0000","last_undegraded":"2024-04-03T05:11:24.039050+0000","last_fullsized":"2024-04-03T05:11:24.039050+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:42:45.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"260'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.631991+0000","last_change":"2024-04-03T04:18:51.302485+0000","last_active":"2024-04-03T05:10:53.631991+0000","last_peered":"2024-04-03T05:10:53.631991+0000","last_clean":"2024-04-03T05:10:53.631991+0000","last_became_active":"2024-04-03T04:18:51.301260+0000","last_became_peered":"2024-04-03T04:18:51.301260+0000","last_unstale":"2024-04-03T05:10:53.631991+0000","last_undegraded":"2024-04-03T05:10:53.631991+0000","last_fullsized":"2024-04-03T05:10:53.631991+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:07.397862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:54.072736+0000","last_change":"2024-04-03T03:55:53.257731+0000","last_active":"2024-04-03T05:13:54.072736+0000","last_peered":"2024-04-03T05:13:54.072736+0000","last_clean":"2024-04-03T05:13:54.072736+0000","last_became_active":"2024-04-03T03:55:53.257421+0000","last_became_peered":"2024-04-03T03:55:53.257421+0000","last_unstale":"2024-04-03T05:13:54.072736+0000","last_undegraded":"2024-04-03T05:13:54.072736+0000","last_fullsized":"2024-04-03T05:13:54.072736+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:57:17.122324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'10","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.039613+0000","last_change":"2024-04-03T03:55:45.822850+0000","last_active":"2024-04-03T05:14:10.039613+0000","last_peered":"2024-04-03T05:14:10.039613+0000","last_clean":"2024-04-03T05:14:10.039613+0000","last_became_active":"2024-04-03T03:55:45.822134+0000","last_became_peered":"2024-04-03T03:55:45.822134+0000","last_unstale":"2024-04-03T05:14:10.039613+0000","last_undegraded":"2024-04-03T05:14:10.039613+0000","last_fullsized":"2024-04-03T05:14:10.039613+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:51.265204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"263'37","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.824327+0000","last_change":"2024-04-03T03:49:00.990198+0000","last_active":"2024-04-03T05:10:43.824327+0000","last_peered":"2024-04-03T05:10:43.824327+0000","last_clean":"2024-04-03T05:10:43.824327+0000","last_became_active":"2024-04-03T03:49:00.989509+0000","last_became_peered":"2024-04-03T03:49:00.989509+0000","last_unstale":"2024-04-03T05:10:43.824327+0000","last_undegraded":"2024-04-03T05:10:43.824327+0000","last_fullsized":"2024-04-03T05:10:43.824327+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:47:32.824649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.032254+0000","last_change":"2024-04-03T04:18:51.367656+0000","last_active":"2024-04-03T05:10:54.032254+0000","last_peered":"2024-04-03T05:10:54.032254+0000","last_clean":"2024-04-03T05:10:54.032254+0000","last_became_active":"2024-04-03T04:18:51.366898+0000","last_became_peered":"2024-04-03T04:18:51.366898+0000","last_unstale":"2024-04-03T05:10:54.032254+0000","last_undegraded":"2024-04-03T05:10:54.032254+0000","last_fullsized":"2024-04-03T05:10:54.032254+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:02:42.380567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.837650+0000","last_change":"2024-04-03T03:55:53.273186+0000","last_active":"2024-04-03T05:11:43.837650+0000","last_peered":"2024-04-03T05:11:43.837650+0000","last_clean":"2024-04-03T05:11:43.837650+0000","last_became_active":"2024-04-03T03:55:53.272757+0000","last_became_peered":"2024-04-03T03:55:53.272757+0000","last_unstale":"2024-04-03T05:11:43.837650+0000","last_undegraded":"2024-04-03T05:11:43.837650+0000","last_fullsized":"2024-04-03T05:11:43.837650+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:30:01.756534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:09.035840+0000","last_change":"2024-04-03T03:55:45.835017+0000","last_active":"2024-04-03T05:11:09.035840+0000","last_peered":"2024-04-03T05:11:09.035840+0000","last_clean":"2024-04-03T05:11:09.035840+0000","last_became_active":"2024-04-03T03:55:45.834364+0000","last_became_peered":"2024-04-03T03:55:45.834364+0000","last_unstale":"2024-04-03T05:11:09.035840+0000","last_undegraded":"2024-04-03T05:11:09.035840+0000","last_fullsized":"2024-04-03T05:11:09.035840+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:24:43.835815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"263'29","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:19.024038+0000","last_change":"2024-04-03T03:49:00.975429+0000","last_active":"2024-04-03T05:10:19.024038+0000","last_peered":"2024-04-03T05:10:19.024038+0000","last_clean":"2024-04-03T05:10:19.024038+0000","last_became_active":"2024-04-03T03:49:00.974654+0000","last_became_peered":"2024-04-03T03:49:00.974654+0000","last_unstale":"2024-04-03T05:10:19.024038+0000","last_undegraded":"2024-04-03T05:10:19.024038+0000","last_fullsized":"2024-04-03T05:10:19.024038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:46.921570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.829945+0000","last_change":"2024-04-03T04:18:51.323217+0000","last_active":"2024-04-03T05:11:08.829945+0000","last_peered":"2024-04-03T05:11:08.829945+0000","last_clean":"2024-04-03T05:11:08.829945+0000","last_became_active":"2024-04-03T04:18:51.322311+0000","last_became_peered":"2024-04-03T04:18:51.322311+0000","last_unstale":"2024-04-03T05:11:08.829945+0000","last_undegraded":"2024-04-03T05:11:08.829945+0000","last_fullsized":"2024-04-03T05:11:08.829945+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:50:12.059710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:59.060422+0000","last_change":"2024-04-03T03:55:53.256346+0000","last_active":"2024-04-03T05:12:59.060422+0000","last_peered":"2024-04-03T05:12:59.060422+0000","last_clean":"2024-04-03T05:12:59.060422+0000","last_became_active":"2024-04-03T03:55:53.255322+0000","last_became_peered":"2024-04-03T03:55:53.255322+0000","last_unstale":"2024-04-03T05:12:59.060422+0000","last_undegraded":"2024-04-03T05:12:59.060422+0000","last_fullsized":"2024-04-03T05:12:59.060422+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:49:09.641737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":90,"num_write":10,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'2","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.657830+0000","last_change":"2024-04-03T03:55:45.826097+0000","last_active":"2024-04-03T05:12:53.657830+0000","last_peered":"2024-04-03T05:12:53.657830+0000","last_clean":"2024-04-03T05:12:53.657830+0000","last_became_active":"2024-04-03T03:55:45.825324+0000","last_became_peered":"2024-04-03T03:55:45.825324+0000","last_unstale":"2024-04-03T05:12:53.657830+0000","last_undegraded":"2024-04-03T05:12:53.657830+0000","last_fullsized":"2024-04-03T05:12:53.657830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:24.023966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"263'10","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.005883+0000","last_change":"2024-04-03T03:49:00.989237+0000","last_active":"2024-04-03T05:10:18.005883+0000","last_peered":"2024-04-03T05:10:18.005883+0000","last_clean":"2024-04-03T05:10:18.005883+0000","last_became_active":"2024-04-03T03:49:00.988511+0000","last_became_peered":"2024-04-03T03:49:00.988511+0000","last_unstale":"2024-04-03T05:10:18.005883+0000","last_undegraded":"2024-04-03T05:10:18.005883+0000","last_fullsized":"2024-04-03T05:10:18.005883+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:30:04.122245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.836789+0000","last_change":"2024-04-03T04:18:51.311624+0000","last_active":"2024-04-03T05:10:57.836789+0000","last_peered":"2024-04-03T05:10:57.836789+0000","last_clean":"2024-04-03T05:10:57.836789+0000","last_became_active":"2024-04-03T04:18:51.310903+0000","last_became_peered":"2024-04-03T04:18:51.310903+0000","last_unstale":"2024-04-03T05:10:57.836789+0000","last_undegraded":"2024-04-03T05:10:57.836789+0000","last_fullsized":"2024-04-03T05:10:57.836789+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:16:43.080955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'4","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.367181+0000","last_change":"2024-04-03T03:55:53.249654+0000","last_active":"2024-04-03T05:14:09.367181+0000","last_peered":"2024-04-03T05:14:09.367181+0000","last_clean":"2024-04-03T05:14:09.367181+0000","last_became_active":"2024-04-03T03:55:53.248897+0000","last_became_peered":"2024-04-03T03:55:53.248897+0000","last_unstale":"2024-04-03T05:14:09.367181+0000","last_undegraded":"2024-04-03T05:14:09.367181+0000","last_fullsized":"2024-04-03T05:14:09.367181+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:46:01.196435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.825361+0000","last_change":"2024-04-03T03:55:45.823094+0000","last_active":"2024-04-03T05:10:48.825361+0000","last_peered":"2024-04-03T05:10:48.825361+0000","last_clean":"2024-04-03T05:10:48.825361+0000","last_became_active":"2024-04-03T03:55:45.822406+0000","last_became_peered":"2024-04-03T03:55:45.822406+0000","last_unstale":"2024-04-03T05:10:48.825361+0000","last_undegraded":"2024-04-03T05:10:48.825361+0000","last_fullsized":"2024-04-03T05:10:48.825361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:27:33.919111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"263'32","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.998233+0000","last_change":"2024-04-03T03:49:00.984263+0000","last_active":"2024-04-03T05:10:18.998233+0000","last_peered":"2024-04-03T05:10:18.998233+0000","last_clean":"2024-04-03T05:10:18.998233+0000","last_became_active":"2024-04-03T03:49:00.983502+0000","last_became_peered":"2024-04-03T03:49:00.983502+0000","last_unstale":"2024-04-03T05:10:18.998233+0000","last_undegraded":"2024-04-03T05:10:18.998233+0000","last_fullsized":"2024-04-03T05:10:18.998233+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:43:07.869966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":91,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633108+0000","last_change":"2024-04-03T04:18:51.320361+0000","last_active":"2024-04-03T05:10:58.633108+0000","last_peered":"2024-04-03T05:10:58.633108+0000","last_clean":"2024-04-03T05:10:58.633108+0000","last_became_active":"2024-04-03T04:18:51.319585+0000","last_became_peered":"2024-04-03T04:18:51.319585+0000","last_unstale":"2024-04-03T05:10:58.633108+0000","last_undegraded":"2024-04-03T05:10:58.633108+0000","last_fullsized":"2024-04-03T05:10:58.633108+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:06:53.044441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:54.005827+0000","last_change":"2024-04-03T03:55:53.254086+0000","last_active":"2024-04-03T05:10:54.005827+0000","last_peered":"2024-04-03T05:10:54.005827+0000","last_clean":"2024-04-03T05:10:54.005827+0000","last_became_active":"2024-04-03T03:55:53.253313+0000","last_became_peered":"2024-04-03T03:55:53.253313+0000","last_unstale":"2024-04-03T05:10:54.005827+0000","last_undegraded":"2024-04-03T05:10:54.005827+0000","last_fullsized":"2024-04-03T05:10:54.005827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:42:59.596779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.077993+0000","last_change":"2024-04-03T03:55:45.821498+0000","last_active":"2024-04-03T05:14:09.077993+0000","last_peered":"2024-04-03T05:14:09.077993+0000","last_clean":"2024-04-03T05:14:09.077993+0000","last_became_active":"2024-04-03T03:55:45.820786+0000","last_became_peered":"2024-04-03T03:55:45.820786+0000","last_unstale":"2024-04-03T05:14:09.077993+0000","last_undegraded":"2024-04-03T05:14:09.077993+0000","last_fullsized":"2024-04-03T05:14:09.077993+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:09:15.309227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"263'69","reported_seq":242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818307+0000","last_change":"2024-04-03T03:49:00.962192+0000","last_active":"2024-04-03T05:10:18.818307+0000","last_peered":"2024-04-03T05:10:18.818307+0000","last_clean":"2024-04-03T05:10:18.818307+0000","last_became_active":"2024-04-03T03:49:00.961318+0000","last_became_peered":"2024-04-03T03:49:00.961318+0000","last_unstale":"2024-04-03T05:10:18.818307+0000","last_undegraded":"2024-04-03T05:10:18.818307+0000","last_fullsized":"2024-04-03T05:10:18.818307+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:24:56.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":306,"num_read_kb":217,"num_write":109,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:59.007033+0000","last_change":"2024-04-03T04:18:51.318872+0000","last_active":"2024-04-03T05:10:59.007033+0000","last_peered":"2024-04-03T05:10:59.007033+0000","last_clean":"2024-04-03T05:10:59.007033+0000","last_became_active":"2024-04-03T04:18:51.318123+0000","last_became_peered":"2024-04-03T04:18:51.318123+0000","last_unstale":"2024-04-03T05:10:59.007033+0000","last_undegraded":"2024-04-03T05:10:59.007033+0000","last_fullsized":"2024-04-03T05:10:59.007033+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:43:45.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:52.831053+0000","last_change":"2024-04-03T03:55:53.273476+0000","last_active":"2024-04-03T05:10:52.831053+0000","last_peered":"2024-04-03T05:10:52.831053+0000","last_clean":"2024-04-03T05:10:52.831053+0000","last_became_active":"2024-04-03T03:55:53.272979+0000","last_became_peered":"2024-04-03T03:55:53.272979+0000","last_unstale":"2024-04-03T05:10:52.831053+0000","last_undegraded":"2024-04-03T05:10:52.831053+0000","last_fullsized":"2024-04-03T05:10:52.831053+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:02:06.605755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"258'2","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.004446+0000","last_change":"2024-04-03T03:55:45.808103+0000","last_active":"2024-04-03T05:10:49.004446+0000","last_peered":"2024-04-03T05:10:49.004446+0000","last_clean":"2024-04-03T05:10:49.004446+0000","last_became_active":"2024-04-03T03:55:45.807410+0000","last_became_peered":"2024-04-03T03:55:45.807410+0000","last_unstale":"2024-04-03T05:10:49.004446+0000","last_undegraded":"2024-04-03T05:10:49.004446+0000","last_fullsized":"2024-04-03T05:10:49.004446+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:55:34.688567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"263'45","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:27.831292+0000","last_change":"2024-04-03T03:49:00.980550+0000","last_active":"2024-04-03T05:11:27.831292+0000","last_peered":"2024-04-03T05:11:27.831292+0000","last_clean":"2024-04-03T05:11:27.831292+0000","last_became_active":"2024-04-03T03:49:00.978547+0000","last_became_peered":"2024-04-03T03:49:00.978547+0000","last_unstale":"2024-04-03T05:11:27.831292+0000","last_undegraded":"2024-04-03T05:11:27.831292+0000","last_fullsized":"2024-04-03T05:11:27.831292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:02:28.324158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":127,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'414","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.534255+0000","last_change":"2024-04-03T03:38:24.754612+0000","last_active":"2024-04-03T05:14:10.534255+0000","last_peered":"2024-04-03T05:14:10.534255+0000","last_clean":"2024-04-03T05:14:10.534255+0000","last_became_active":"2024-04-03T03:38:24.753446+0000","last_became_peered":"2024-04-03T03:38:24.753446+0000","last_unstale":"2024-04-03T05:14:10.534255+0000","last_undegraded":"2024-04-03T05:14:10.534255+0000","last_fullsized":"2024-04-03T05:14:10.534255+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:22:38.341258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8977164,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":672,"num_read_kb":35431,"num_write":1374,"num_write_kb":27233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'364","reported_seq":1890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.373264+0000","last_change":"2024-04-03T03:38:26.751530+0000","last_active":"2024-04-03T05:11:12.373264+0000","last_peered":"2024-04-03T05:11:12.373264+0000","last_clean":"2024-04-03T05:11:12.373264+0000","last_became_active":"2024-04-03T03:38:26.750879+0000","last_became_peered":"2024-04-03T03:38:26.750879+0000","last_unstale":"2024-04-03T05:11:12.373264+0000","last_undegraded":"2024-04-03T05:11:12.373264+0000","last_fullsized":"2024-04-03T05:11:12.373264+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:50.660673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2014,"num_read_kb":1942,"num_write":406,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'333","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.299633+0000","last_change":"2024-04-03T03:38:24.723229+0000","last_active":"2024-04-03T05:14:10.299633+0000","last_peered":"2024-04-03T05:14:10.299633+0000","last_clean":"2024-04-03T05:14:10.299633+0000","last_became_active":"2024-04-03T03:38:24.722769+0000","last_became_peered":"2024-04-03T03:38:24.722769+0000","last_unstale":"2024-04-03T05:14:10.299633+0000","last_undegraded":"2024-04-03T05:14:10.299633+0000","last_fullsized":"2024-04-03T05:14:10.299633+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:48:04.458628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586810,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":606,"num_read_kb":76325,"num_write":1300,"num_write_kb":34753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'860","reported_seq":2513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.128819+0000","last_change":"2024-04-03T03:38:26.726050+0000","last_active":"2024-04-03T05:13:59.128819+0000","last_peered":"2024-04-03T05:13:59.128819+0000","last_clean":"2024-04-03T05:13:59.128819+0000","last_became_active":"2024-04-03T03:38:26.724640+0000","last_became_peered":"2024-04-03T03:38:26.724640+0000","last_unstale":"2024-04-03T05:13:59.128819+0000","last_undegraded":"2024-04-03T05:13:59.128819+0000","last_fullsized":"2024-04-03T05:13:59.128819+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:18:50.425634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3968,"num_read_kb":3559,"num_write":1184,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'315","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.553991+0000","last_change":"2024-04-03T03:38:24.711403+0000","last_active":"2024-04-03T05:14:10.553991+0000","last_peered":"2024-04-03T05:14:10.553991+0000","last_clean":"2024-04-03T05:14:10.553991+0000","last_became_active":"2024-04-03T03:38:24.711028+0000","last_became_peered":"2024-04-03T03:38:24.711028+0000","last_unstale":"2024-04-03T05:14:10.553991+0000","last_undegraded":"2024-04-03T05:14:10.553991+0000","last_fullsized":"2024-04-03T05:14:10.553991+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:36:37.333600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174583,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":16599,"num_write":1026,"num_write_kb":26343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'709","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.222128+0000","last_change":"2024-04-03T03:38:26.750079+0000","last_active":"2024-04-03T05:12:22.222128+0000","last_peered":"2024-04-03T05:12:22.222128+0000","last_clean":"2024-04-03T05:12:22.222128+0000","last_became_active":"2024-04-03T03:38:26.745277+0000","last_became_peered":"2024-04-03T03:38:26.745277+0000","last_unstale":"2024-04-03T05:12:22.222128+0000","last_undegraded":"2024-04-03T05:12:22.222128+0000","last_fullsized":"2024-04-03T05:12:22.222128+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:56:00.667466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3170,"num_read_kb":2825,"num_write":964,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'389","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.532097+0000","last_change":"2024-04-03T03:38:24.757433+0000","last_active":"2024-04-03T05:14:10.532097+0000","last_peered":"2024-04-03T05:14:10.532097+0000","last_clean":"2024-04-03T05:14:10.532097+0000","last_became_active":"2024-04-03T03:38:24.756927+0000","last_became_peered":"2024-04-03T03:38:24.756927+0000","last_unstale":"2024-04-03T05:14:10.532097+0000","last_undegraded":"2024-04-03T05:14:10.532097+0000","last_fullsized":"2024-04-03T05:14:10.532097+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:38:37.035425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":48559,"num_write":1381,"num_write_kb":35333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'577","reported_seq":2216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060394+0000","last_change":"2024-04-03T03:38:26.730190+0000","last_active":"2024-04-03T05:10:58.060394+0000","last_peered":"2024-04-03T05:10:58.060394+0000","last_clean":"2024-04-03T05:10:58.060394+0000","last_became_active":"2024-04-03T03:38:26.729866+0000","last_became_peered":"2024-04-03T03:38:26.729866+0000","last_unstale":"2024-04-03T05:10:58.060394+0000","last_undegraded":"2024-04-03T05:10:58.060394+0000","last_fullsized":"2024-04-03T05:10:58.060394+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:34.215876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2799,"num_write":801,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'407","reported_seq":1313,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.556374+0000","last_change":"2024-04-03T03:38:24.748987+0000","last_active":"2024-04-03T05:14:10.556374+0000","last_peered":"2024-04-03T05:14:10.556374+0000","last_clean":"2024-04-03T05:14:10.556374+0000","last_became_active":"2024-04-03T03:38:24.748338+0000","last_became_peered":"2024-04-03T03:38:24.748338+0000","last_unstale":"2024-04-03T05:14:10.556374+0000","last_undegraded":"2024-04-03T05:14:10.556374+0000","last_fullsized":"2024-04-03T05:14:10.556374+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:49:02.239604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1354628,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1249,"num_read_kb":39095,"num_write":1674,"num_write_kb":52242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'478","reported_seq":1925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.372354+0000","last_change":"2024-04-03T03:38:26.720548+0000","last_active":"2024-04-03T05:11:12.372354+0000","last_peered":"2024-04-03T05:11:12.372354+0000","last_clean":"2024-04-03T05:11:12.372354+0000","last_became_active":"2024-04-03T03:38:26.719805+0000","last_became_peered":"2024-04-03T03:38:26.719805+0000","last_unstale":"2024-04-03T05:11:12.372354+0000","last_undegraded":"2024-04-03T05:11:12.372354+0000","last_fullsized":"2024-04-03T05:11:12.372354+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:06:02.662745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2340,"num_read_kb":2138,"num_write":626,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'359","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.505924+0000","last_change":"2024-04-03T03:38:24.754531+0000","last_active":"2024-04-03T05:14:10.505924+0000","last_peered":"2024-04-03T05:14:10.505924+0000","last_clean":"2024-04-03T05:14:10.505924+0000","last_became_active":"2024-04-03T03:38:24.749192+0000","last_became_peered":"2024-04-03T03:38:24.749192+0000","last_unstale":"2024-04-03T05:14:10.505924+0000","last_undegraded":"2024-04-03T05:14:10.505924+0000","last_fullsized":"2024-04-03T05:14:10.505924+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:24:13.416735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4003555,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":459,"num_read_kb":24946,"num_write":1297,"num_write_kb":50928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'294","reported_seq":1649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.605723+0000","last_change":"2024-04-03T03:38:26.750146+0000","last_active":"2024-04-03T05:10:43.605723+0000","last_peered":"2024-04-03T05:10:43.605723+0000","last_clean":"2024-04-03T05:10:43.605723+0000","last_became_active":"2024-04-03T03:38:26.744762+0000","last_became_peered":"2024-04-03T03:38:26.744762+0000","last_unstale":"2024-04-03T05:10:43.605723+0000","last_undegraded":"2024-04-03T05:10:43.605723+0000","last_fullsized":"2024-04-03T05:10:43.605723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:44.097623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1674,"num_read_kb":1613,"num_write":327,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'333","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.550433+0000","last_change":"2024-04-03T03:38:24.730594+0000","last_active":"2024-04-03T05:14:10.550433+0000","last_peered":"2024-04-03T05:14:10.550433+0000","last_clean":"2024-04-03T05:14:10.550433+0000","last_became_active":"2024-04-03T03:38:24.728188+0000","last_became_peered":"2024-04-03T03:38:24.728188+0000","last_unstale":"2024-04-03T05:14:10.550433+0000","last_undegraded":"2024-04-03T05:14:10.550433+0000","last_fullsized":"2024-04-03T05:14:10.550433+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:12:23.518716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149405,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":546,"num_read_kb":30992,"num_write":1174,"num_write_kb":37947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'732","reported_seq":2231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.844541+0000","last_change":"2024-04-03T03:38:26.722813+0000","last_active":"2024-04-03T05:12:13.844541+0000","last_peered":"2024-04-03T05:12:13.844541+0000","last_clean":"2024-04-03T05:12:13.844541+0000","last_became_active":"2024-04-03T03:38:26.722053+0000","last_became_peered":"2024-04-03T03:38:26.722053+0000","last_unstale":"2024-04-03T05:12:13.844541+0000","last_undegraded":"2024-04-03T05:12:13.844541+0000","last_fullsized":"2024-04-03T05:12:13.844541+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:52:12.496090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3332,"num_read_kb":2987,"num_write":969,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'347","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.544568+0000","last_change":"2024-04-03T03:38:24.749214+0000","last_active":"2024-04-03T05:14:10.544568+0000","last_peered":"2024-04-03T05:14:10.544568+0000","last_clean":"2024-04-03T05:14:10.544568+0000","last_became_active":"2024-04-03T03:38:24.748669+0000","last_became_peered":"2024-04-03T03:38:24.748669+0000","last_unstale":"2024-04-03T05:14:10.544568+0000","last_undegraded":"2024-04-03T05:14:10.544568+0000","last_fullsized":"2024-04-03T05:14:10.544568+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:20:30.983491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1960097,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":30925,"num_write":1242,"num_write_kb":34378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'466","reported_seq":1984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.453334+0000","last_change":"2024-04-03T03:38:26.712374+0000","last_active":"2024-04-03T05:11:08.453334+0000","last_peered":"2024-04-03T05:11:08.453334+0000","last_clean":"2024-04-03T05:11:08.453334+0000","last_became_active":"2024-04-03T03:38:26.711993+0000","last_became_peered":"2024-04-03T03:38:26.711993+0000","last_unstale":"2024-04-03T05:11:08.453334+0000","last_undegraded":"2024-04-03T05:11:08.453334+0000","last_fullsized":"2024-04-03T05:11:08.453334+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:28:06.991173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2333,"num_write":597,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'427","reported_seq":1881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.643681+0000","last_change":"2024-04-03T03:38:26.741314+0000","last_active":"2024-04-03T05:11:48.643681+0000","last_peered":"2024-04-03T05:11:48.643681+0000","last_clean":"2024-04-03T05:11:48.643681+0000","last_became_active":"2024-04-03T03:38:26.740542+0000","last_became_peered":"2024-04-03T03:38:26.740542+0000","last_unstale":"2024-04-03T05:11:48.643681+0000","last_undegraded":"2024-04-03T05:11:48.643681+0000","last_fullsized":"2024-04-03T05:11:48.643681+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:02:13.637413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2192,"num_read_kb":2031,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'347","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.544419+0000","last_change":"2024-04-03T03:38:24.762053+0000","last_active":"2024-04-03T05:14:10.544419+0000","last_peered":"2024-04-03T05:14:10.544419+0000","last_clean":"2024-04-03T05:14:10.544419+0000","last_became_active":"2024-04-03T03:38:24.761424+0000","last_became_peered":"2024-04-03T03:38:24.761424+0000","last_unstale":"2024-04-03T05:14:10.544419+0000","last_undegraded":"2024-04-03T05:14:10.544419+0000","last_fullsized":"2024-04-03T05:14:10.544419+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:58:18.665928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342126,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":4079,"num_write":1247,"num_write_kb":13920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'364","reported_seq":1752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193276+0000","last_change":"2024-04-03T03:38:26.725447+0000","last_active":"2024-04-03T05:13:59.193276+0000","last_peered":"2024-04-03T05:13:59.193276+0000","last_clean":"2024-04-03T05:13:59.193276+0000","last_became_active":"2024-04-03T03:38:26.723638+0000","last_became_peered":"2024-04-03T03:38:26.723638+0000","last_unstale":"2024-04-03T05:13:59.193276+0000","last_undegraded":"2024-04-03T05:13:59.193276+0000","last_fullsized":"2024-04-03T05:13:59.193276+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:30:54.500121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1899,"num_read_kb":1790,"num_write":424,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'351","reported_seq":1038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.577722+0000","last_change":"2024-04-03T03:38:58.351102+0000","last_active":"2024-04-03T05:14:10.577722+0000","last_peered":"2024-04-03T05:14:10.577722+0000","last_clean":"2024-04-03T05:14:10.577722+0000","last_became_active":"2024-04-03T03:38:58.349885+0000","last_became_peered":"2024-04-03T03:38:58.349885+0000","last_unstale":"2024-04-03T05:14:10.577722+0000","last_undegraded":"2024-04-03T05:14:10.577722+0000","last_fullsized":"2024-04-03T05:14:10.577722+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:16:53.864983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502701,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":66677,"num_write":1253,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'451","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.396049+0000","last_change":"2024-04-03T03:38:26.710365+0000","last_active":"2024-04-03T05:11:18.396049+0000","last_peered":"2024-04-03T05:11:18.396049+0000","last_clean":"2024-04-03T05:11:18.396049+0000","last_became_active":"2024-04-03T03:38:26.709613+0000","last_became_peered":"2024-04-03T03:38:26.709613+0000","last_unstale":"2024-04-03T05:11:18.396049+0000","last_undegraded":"2024-04-03T05:11:18.396049+0000","last_fullsized":"2024-04-03T05:11:18.396049+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:37:42.966727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2380,"num_write":570,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'353","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.487931+0000","last_change":"2024-04-03T03:38:24.761922+0000","last_active":"2024-04-03T05:14:10.487931+0000","last_peered":"2024-04-03T05:14:10.487931+0000","last_clean":"2024-04-03T05:14:10.487931+0000","last_became_active":"2024-04-03T03:38:24.761284+0000","last_became_peered":"2024-04-03T03:38:24.761284+0000","last_unstale":"2024-04-03T05:14:10.487931+0000","last_undegraded":"2024-04-03T05:14:10.487931+0000","last_fullsized":"2024-04-03T05:14:10.487931+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:33:18.725669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":65082,"num_write":1201,"num_write_kb":43379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'446","reported_seq":2408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.213868+0000","last_change":"2024-04-03T03:38:26.713266+0000","last_active":"2024-04-03T05:12:22.213868+0000","last_peered":"2024-04-03T05:12:22.213868+0000","last_clean":"2024-04-03T05:12:22.213868+0000","last_became_active":"2024-04-03T03:38:26.711748+0000","last_became_peered":"2024-04-03T03:38:26.711748+0000","last_unstale":"2024-04-03T05:12:22.213868+0000","last_undegraded":"2024-04-03T05:12:22.213868+0000","last_fullsized":"2024-04-03T05:12:22.213868+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:16:46.211389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2976,"num_read_kb":2877,"num_write":500,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'299","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.505689+0000","last_change":"2024-04-03T03:38:24.744386+0000","last_active":"2024-04-03T05:14:10.505689+0000","last_peered":"2024-04-03T05:14:10.505689+0000","last_clean":"2024-04-03T05:14:10.505689+0000","last_became_active":"2024-04-03T03:38:24.742574+0000","last_became_peered":"2024-04-03T03:38:24.742574+0000","last_unstale":"2024-04-03T05:14:10.505689+0000","last_undegraded":"2024-04-03T05:14:10.505689+0000","last_fullsized":"2024-04-03T05:14:10.505689+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:11.179082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399089,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":46919,"num_write":1114,"num_write_kb":37595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'342","reported_seq":1754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.276727+0000","last_change":"2024-04-03T03:38:26.744328+0000","last_active":"2024-04-03T05:11:29.276727+0000","last_peered":"2024-04-03T05:11:29.276727+0000","last_clean":"2024-04-03T05:11:29.276727+0000","last_became_active":"2024-04-03T03:38:26.743735+0000","last_became_peered":"2024-04-03T03:38:26.743735+0000","last_unstale":"2024-04-03T05:11:29.276727+0000","last_undegraded":"2024-04-03T05:11:29.276727+0000","last_fullsized":"2024-04-03T05:11:29.276727+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:20:00.390318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1802,"num_read_kb":1729,"num_write":383,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'346","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.435901+0000","last_change":"2024-04-03T03:38:24.726007+0000","last_active":"2024-04-03T05:14:10.435901+0000","last_peered":"2024-04-03T05:14:10.435901+0000","last_clean":"2024-04-03T05:14:10.435901+0000","last_became_active":"2024-04-03T03:38:24.725557+0000","last_became_peered":"2024-04-03T03:38:24.725557+0000","last_unstale":"2024-04-03T05:14:10.435901+0000","last_undegraded":"2024-04-03T05:14:10.435901+0000","last_fullsized":"2024-04-03T05:14:10.435901+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:50:47.134109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456508,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":495,"num_read_kb":4167,"num_write":1155,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'335","reported_seq":1763,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.286070+0000","last_change":"2024-04-03T03:38:26.745907+0000","last_active":"2024-04-03T05:11:29.286070+0000","last_peered":"2024-04-03T05:11:29.286070+0000","last_clean":"2024-04-03T05:11:29.286070+0000","last_became_active":"2024-04-03T03:38:26.744977+0000","last_became_peered":"2024-04-03T03:38:26.744977+0000","last_unstale":"2024-04-03T05:11:29.286070+0000","last_undegraded":"2024-04-03T05:11:29.286070+0000","last_fullsized":"2024-04-03T05:11:29.286070+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:09:58.311296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1755,"num_write":385,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'292","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.530771+0000","last_change":"2024-04-03T03:38:24.725895+0000","last_active":"2024-04-03T05:14:10.530771+0000","last_peered":"2024-04-03T05:14:10.530771+0000","last_clean":"2024-04-03T05:14:10.530771+0000","last_became_active":"2024-04-03T03:38:24.725410+0000","last_became_peered":"2024-04-03T03:38:24.725410+0000","last_unstale":"2024-04-03T05:14:10.530771+0000","last_undegraded":"2024-04-03T05:14:10.530771+0000","last_fullsized":"2024-04-03T05:14:10.530771+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:07:55.757685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":543,"num_read_kb":79698,"num_write":993,"num_write_kb":41581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'139","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.408690+0000","last_change":"2024-04-03T03:38:34.739613+0000","last_active":"2024-04-03T05:11:18.408690+0000","last_peered":"2024-04-03T05:11:18.408690+0000","last_clean":"2024-04-03T05:11:18.408690+0000","last_became_active":"2024-04-03T03:38:34.738565+0000","last_became_peered":"2024-04-03T03:38:34.738565+0000","last_unstale":"2024-04-03T05:11:18.408690+0000","last_undegraded":"2024-04-03T05:11:18.408690+0000","last_fullsized":"2024-04-03T05:11:18.408690+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:08:22.326355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":345,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'372","reported_seq":1823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:12.374074+0000","last_change":"2024-04-03T03:39:58.990871+0000","last_active":"2024-04-03T05:11:12.374074+0000","last_peered":"2024-04-03T05:11:12.374074+0000","last_clean":"2024-04-03T05:11:12.374074+0000","last_became_active":"2024-04-03T03:39:58.989982+0000","last_became_peered":"2024-04-03T03:39:58.989982+0000","last_unstale":"2024-04-03T05:11:12.374074+0000","last_undegraded":"2024-04-03T05:11:12.374074+0000","last_fullsized":"2024-04-03T05:11:12.374074+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:57:23.445483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2119,"num_read_kb":1999,"num_write":436,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'348","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.540367+0000","last_change":"2024-04-03T03:38:24.750884+0000","last_active":"2024-04-03T05:14:10.540367+0000","last_peered":"2024-04-03T05:14:10.540367+0000","last_clean":"2024-04-03T05:14:10.540367+0000","last_became_active":"2024-04-03T03:38:24.750235+0000","last_became_peered":"2024-04-03T03:38:24.750235+0000","last_unstale":"2024-04-03T05:14:10.540367+0000","last_undegraded":"2024-04-03T05:14:10.540367+0000","last_fullsized":"2024-04-03T05:14:10.540367+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:38:04.324570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":98321,"num_write":1208,"num_write_kb":49383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818558+0000","last_change":"2024-04-03T03:38:28.726652+0000","last_active":"2024-04-03T05:10:18.818558+0000","last_peered":"2024-04-03T05:10:18.818558+0000","last_clean":"2024-04-03T05:10:18.818558+0000","last_became_active":"2024-04-03T03:38:28.725801+0000","last_became_peered":"2024-04-03T03:38:28.725801+0000","last_unstale":"2024-04-03T05:10:18.818558+0000","last_undegraded":"2024-04-03T05:10:18.818558+0000","last_fullsized":"2024-04-03T05:10:18.818558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:31:07.597192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'348","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.698842+0000","last_change":"2024-04-03T03:38:30.727143+0000","last_active":"2024-04-03T05:14:09.698842+0000","last_peered":"2024-04-03T05:14:09.698842+0000","last_clean":"2024-04-03T05:14:09.698842+0000","last_became_active":"2024-04-03T03:38:30.726684+0000","last_became_peered":"2024-04-03T03:38:30.726684+0000","last_unstale":"2024-04-03T05:14:09.698842+0000","last_undegraded":"2024-04-03T05:14:09.698842+0000","last_fullsized":"2024-04-03T05:14:09.698842+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:51.225223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46296,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":564,"num_read_kb":1147,"num_write":428,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:24.025369+0000","last_change":"2024-04-03T03:38:32.748206+0000","last_active":"2024-04-03T05:10:24.025369+0000","last_peered":"2024-04-03T05:10:24.025369+0000","last_clean":"2024-04-03T05:10:24.025369+0000","last_became_active":"2024-04-03T03:38:32.745434+0000","last_became_peered":"2024-04-03T03:38:32.745434+0000","last_unstale":"2024-04-03T05:10:24.025369+0000","last_undegraded":"2024-04-03T05:10:24.025369+0000","last_fullsized":"2024-04-03T05:10:24.025369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:43:21.765675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2398","reported_seq":4223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.236396+0000","last_change":"2024-04-03T03:38:34.759059+0000","last_active":"2024-04-03T05:12:22.236396+0000","last_peered":"2024-04-03T05:12:22.236396+0000","last_clean":"2024-04-03T05:12:22.236396+0000","last_became_active":"2024-04-03T03:38:34.757256+0000","last_became_peered":"2024-04-03T03:38:34.757256+0000","last_unstale":"2024-04-03T05:12:22.236396+0000","last_undegraded":"2024-04-03T05:12:22.236396+0000","last_fullsized":"2024-04-03T05:12:22.236396+0000","mapping_epoch":33,"log_start":"263'2300","ondisk_log_start":"263'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":2300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:07.414083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5948,"num_read_kb":5953,"num_write":4769,"num_write_kb":1764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'433","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.110390+0000","last_change":"2024-04-03T03:38:26.725258+0000","last_active":"2024-04-03T05:13:59.110390+0000","last_peered":"2024-04-03T05:13:59.110390+0000","last_clean":"2024-04-03T05:13:59.110390+0000","last_became_active":"2024-04-03T03:38:26.724537+0000","last_became_peered":"2024-04-03T03:38:26.724537+0000","last_unstale":"2024-04-03T05:13:59.110390+0000","last_undegraded":"2024-04-03T05:13:59.110390+0000","last_fullsized":"2024-04-03T05:13:59.110390+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:55:34.004187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2269,"num_read_kb":2119,"num_write":527,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'354","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.371481+0000","last_change":"2024-04-03T03:38:57.871292+0000","last_active":"2024-04-03T05:14:10.371481+0000","last_peered":"2024-04-03T05:14:10.371481+0000","last_clean":"2024-04-03T05:14:10.371481+0000","last_became_active":"2024-04-03T03:38:57.870251+0000","last_became_peered":"2024-04-03T03:38:57.870251+0000","last_unstale":"2024-04-03T05:14:10.371481+0000","last_undegraded":"2024-04-03T05:14:10.371481+0000","last_fullsized":"2024-04-03T05:14:10.371481+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:41.934446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":658,"num_read_kb":14924,"num_write":1423,"num_write_kb":20295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:53.000142+0000","last_change":"2024-04-03T03:38:28.729101+0000","last_active":"2024-04-03T05:09:53.000142+0000","last_peered":"2024-04-03T05:09:53.000142+0000","last_clean":"2024-04-03T05:09:53.000142+0000","last_became_active":"2024-04-03T03:38:28.728632+0000","last_became_peered":"2024-04-03T03:38:28.728632+0000","last_unstale":"2024-04-03T05:09:53.000142+0000","last_undegraded":"2024-04-03T05:09:53.000142+0000","last_fullsized":"2024-04-03T05:09:53.000142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:02:19.986062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'120","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.625381+0000","last_change":"2024-04-03T03:38:30.731626+0000","last_active":"2024-04-03T05:10:23.625381+0000","last_peered":"2024-04-03T05:10:23.625381+0000","last_clean":"2024-04-03T05:10:23.625381+0000","last_became_active":"2024-04-03T03:38:30.730797+0000","last_became_peered":"2024-04-03T03:38:30.730797+0000","last_unstale":"2024-04-03T05:10:23.625381+0000","last_undegraded":"2024-04-03T05:10:23.625381+0000","last_fullsized":"2024-04-03T05:10:23.625381+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:20.134850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":139,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.625339+0000","last_change":"2024-04-03T03:38:32.733871+0000","last_active":"2024-04-03T05:10:23.625339+0000","last_peered":"2024-04-03T05:10:23.625339+0000","last_clean":"2024-04-03T05:10:23.625339+0000","last_became_active":"2024-04-03T03:38:32.732994+0000","last_became_peered":"2024-04-03T03:38:32.732994+0000","last_unstale":"2024-04-03T05:10:23.625339+0000","last_undegraded":"2024-04-03T05:10:23.625339+0000","last_fullsized":"2024-04-03T05:10:23.625339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:01.913002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'106","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062730+0000","last_change":"2024-04-03T03:38:34.746933+0000","last_active":"2024-04-03T05:11:08.062730+0000","last_peered":"2024-04-03T05:11:08.062730+0000","last_clean":"2024-04-03T05:11:08.062730+0000","last_became_active":"2024-04-03T03:38:34.746126+0000","last_became_peered":"2024-04-03T03:38:34.746126+0000","last_unstale":"2024-04-03T05:11:08.062730+0000","last_undegraded":"2024-04-03T05:11:08.062730+0000","last_fullsized":"2024-04-03T05:11:08.062730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:08:36.510470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":113,"num_write":252,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'388","reported_seq":1870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.596727+0000","last_change":"2024-04-03T03:38:26.725947+0000","last_active":"2024-04-03T05:10:43.596727+0000","last_peered":"2024-04-03T05:10:43.596727+0000","last_clean":"2024-04-03T05:10:43.596727+0000","last_became_active":"2024-04-03T03:38:26.724468+0000","last_became_peered":"2024-04-03T03:38:26.724468+0000","last_unstale":"2024-04-03T05:10:43.596727+0000","last_undegraded":"2024-04-03T05:10:43.596727+0000","last_fullsized":"2024-04-03T05:10:43.596727+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:46:05.423762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1964,"num_write":459,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'331","reported_seq":1159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.545491+0000","last_change":"2024-04-03T03:38:24.733041+0000","last_active":"2024-04-03T05:14:10.545491+0000","last_peered":"2024-04-03T05:14:10.545491+0000","last_clean":"2024-04-03T05:14:10.545491+0000","last_became_active":"2024-04-03T03:38:24.732182+0000","last_became_peered":"2024-04-03T03:38:24.732182+0000","last_unstale":"2024-04-03T05:14:10.545491+0000","last_undegraded":"2024-04-03T05:14:10.545491+0000","last_fullsized":"2024-04-03T05:14:10.545491+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:04:10.217131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5549602,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":861,"num_read_kb":9858,"num_write":1206,"num_write_kb":55489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.007355+0000","last_change":"2024-04-03T03:38:28.733914+0000","last_active":"2024-04-03T05:10:23.007355+0000","last_peered":"2024-04-03T05:10:23.007355+0000","last_clean":"2024-04-03T05:10:23.007355+0000","last_became_active":"2024-04-03T03:38:28.733142+0000","last_became_peered":"2024-04-03T03:38:28.733142+0000","last_unstale":"2024-04-03T05:10:23.007355+0000","last_undegraded":"2024-04-03T05:10:23.007355+0000","last_fullsized":"2024-04-03T05:10:23.007355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:59:55.469233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'170","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:09:57.811949+0000","last_change":"2024-04-03T03:38:30.735680+0000","last_active":"2024-04-03T05:09:57.811949+0000","last_peered":"2024-04-03T05:09:57.811949+0000","last_clean":"2024-04-03T05:09:57.811949+0000","last_became_active":"2024-04-03T03:38:30.734934+0000","last_became_peered":"2024-04-03T03:38:30.734934+0000","last_unstale":"2024-04-03T05:09:57.811949+0000","last_undegraded":"2024-04-03T05:09:57.811949+0000","last_fullsized":"2024-04-03T05:09:57.811949+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:03.598253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'516","reported_seq":2437,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.077539+0000","last_change":"2024-04-03T03:38:32.749915+0000","last_active":"2024-04-03T05:14:10.077539+0000","last_peered":"2024-04-03T05:14:10.077539+0000","last_clean":"2024-04-03T05:14:10.077539+0000","last_became_active":"2024-04-03T03:38:32.748836+0000","last_became_peered":"2024-04-03T03:38:32.748836+0000","last_unstale":"2024-04-03T05:14:10.077539+0000","last_undegraded":"2024-04-03T05:14:10.077539+0000","last_fullsized":"2024-04-03T05:14:10.077539+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:20:14.250362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'104","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.635415+0000","last_change":"2024-04-03T03:38:34.941018+0000","last_active":"2024-04-03T05:11:08.635415+0000","last_peered":"2024-04-03T05:11:08.635415+0000","last_clean":"2024-04-03T05:11:08.635415+0000","last_became_active":"2024-04-03T03:38:34.940390+0000","last_became_peered":"2024-04-03T03:38:34.940390+0000","last_unstale":"2024-04-03T05:11:08.635415+0000","last_undegraded":"2024-04-03T05:11:08.635415+0000","last_fullsized":"2024-04-03T05:11:08.635415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:47.643064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'569","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398822+0000","last_change":"2024-04-03T03:38:26.718097+0000","last_active":"2024-04-03T05:11:18.398822+0000","last_peered":"2024-04-03T05:11:18.398822+0000","last_clean":"2024-04-03T05:11:18.398822+0000","last_became_active":"2024-04-03T03:38:26.717394+0000","last_became_peered":"2024-04-03T03:38:26.717394+0000","last_unstale":"2024-04-03T05:11:18.398822+0000","last_undegraded":"2024-04-03T05:11:18.398822+0000","last_fullsized":"2024-04-03T05:11:18.398822+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:36.179522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2983,"num_read_kb":2733,"num_write":743,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'339","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.527153+0000","last_change":"2024-04-03T03:38:24.762461+0000","last_active":"2024-04-03T05:14:10.527153+0000","last_peered":"2024-04-03T05:14:10.527153+0000","last_clean":"2024-04-03T05:14:10.527153+0000","last_became_active":"2024-04-03T03:38:24.761913+0000","last_became_peered":"2024-04-03T03:38:24.761913+0000","last_unstale":"2024-04-03T05:14:10.527153+0000","last_undegraded":"2024-04-03T05:14:10.527153+0000","last_fullsized":"2024-04-03T05:14:10.527153+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:18:50.867012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":83387,"num_write":1167,"num_write_kb":33117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.818707+0000","last_change":"2024-04-03T03:38:28.731460+0000","last_active":"2024-04-03T05:10:18.818707+0000","last_peered":"2024-04-03T05:10:18.818707+0000","last_clean":"2024-04-03T05:10:18.818707+0000","last_became_active":"2024-04-03T03:38:28.730711+0000","last_became_peered":"2024-04-03T03:38:28.730711+0000","last_unstale":"2024-04-03T05:10:18.818707+0000","last_undegraded":"2024-04-03T05:10:18.818707+0000","last_fullsized":"2024-04-03T05:10:18.818707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:32.235397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'302","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.281601+0000","last_change":"2024-04-03T03:38:30.825170+0000","last_active":"2024-04-03T05:14:09.281601+0000","last_peered":"2024-04-03T05:14:09.281601+0000","last_clean":"2024-04-03T05:14:09.281601+0000","last_became_active":"2024-04-03T03:38:30.824397+0000","last_became_peered":"2024-04-03T03:38:30.824397+0000","last_unstale":"2024-04-03T05:14:09.281601+0000","last_undegraded":"2024-04-03T05:14:09.281601+0000","last_fullsized":"2024-04-03T05:14:09.281601+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:35:06.339872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45592,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":493,"num_read_kb":1098,"num_write":394,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'553","reported_seq":4240,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.022971+0000","last_change":"2024-04-03T03:38:32.744325+0000","last_active":"2024-04-03T05:14:10.022971+0000","last_peered":"2024-04-03T05:14:10.022971+0000","last_clean":"2024-04-03T05:14:10.022971+0000","last_became_active":"2024-04-03T03:38:32.743645+0000","last_became_peered":"2024-04-03T03:38:32.743645+0000","last_unstale":"2024-04-03T05:14:10.022971+0000","last_undegraded":"2024-04-03T05:14:10.022971+0000","last_fullsized":"2024-04-03T05:14:10.022971+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:07:29.472884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1050","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.140148+0000","last_change":"2024-04-03T03:38:26.726712+0000","last_active":"2024-04-03T05:13:59.140148+0000","last_peered":"2024-04-03T05:13:59.140148+0000","last_clean":"2024-04-03T05:13:59.140148+0000","last_became_active":"2024-04-03T03:38:26.726039+0000","last_became_peered":"2024-04-03T03:38:26.726039+0000","last_unstale":"2024-04-03T05:13:59.140148+0000","last_undegraded":"2024-04-03T05:13:59.140148+0000","last_fullsized":"2024-04-03T05:13:59.140148+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:40:13.491224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4374,"num_read_kb":3788,"num_write":1482,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'382","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.534712+0000","last_change":"2024-04-03T03:38:24.754120+0000","last_active":"2024-04-03T05:14:10.534712+0000","last_peered":"2024-04-03T05:14:10.534712+0000","last_clean":"2024-04-03T05:14:10.534712+0000","last_became_active":"2024-04-03T03:38:24.752543+0000","last_became_peered":"2024-04-03T03:38:24.752543+0000","last_unstale":"2024-04-03T05:14:10.534712+0000","last_undegraded":"2024-04-03T05:14:10.534712+0000","last_fullsized":"2024-04-03T05:14:10.534712+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:09:55.105836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":24937,"num_write":1159,"num_write_kb":21782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:39.042244+0000","last_change":"2024-04-03T03:38:28.738400+0000","last_active":"2024-04-03T05:11:39.042244+0000","last_peered":"2024-04-03T05:11:39.042244+0000","last_clean":"2024-04-03T05:11:39.042244+0000","last_became_active":"2024-04-03T03:38:28.737738+0000","last_became_peered":"2024-04-03T03:38:28.737738+0000","last_unstale":"2024-04-03T05:11:39.042244+0000","last_undegraded":"2024-04-03T05:11:39.042244+0000","last_fullsized":"2024-04-03T05:11:39.042244+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:12:06.496501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'421","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.969814+0000","last_change":"2024-04-03T03:38:30.823152+0000","last_active":"2024-04-03T05:14:09.969814+0000","last_peered":"2024-04-03T05:14:09.969814+0000","last_clean":"2024-04-03T05:14:09.969814+0000","last_became_active":"2024-04-03T03:38:30.822389+0000","last_became_peered":"2024-04-03T03:38:30.822389+0000","last_unstale":"2024-04-03T05:14:09.969814+0000","last_undegraded":"2024-04-03T05:14:09.969814+0000","last_fullsized":"2024-04-03T05:14:09.969814+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:41:29.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42966,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":673,"num_read_kb":1254,"num_write":506,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830178+0000","last_change":"2024-04-03T03:38:32.731693+0000","last_active":"2024-04-03T05:10:47.830178+0000","last_peered":"2024-04-03T05:10:47.830178+0000","last_clean":"2024-04-03T05:10:47.830178+0000","last_became_active":"2024-04-03T03:38:32.730901+0000","last_became_peered":"2024-04-03T03:38:32.730901+0000","last_unstale":"2024-04-03T05:10:47.830178+0000","last_undegraded":"2024-04-03T05:10:47.830178+0000","last_fullsized":"2024-04-03T05:10:47.830178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:15:01.774475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'539","reported_seq":1368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.544147+0000","last_change":"2024-04-03T03:38:34.756576+0000","last_active":"2024-04-03T05:14:00.544147+0000","last_peered":"2024-04-03T05:14:00.544147+0000","last_clean":"2024-04-03T05:14:00.544147+0000","last_became_active":"2024-04-03T03:38:34.754300+0000","last_became_peered":"2024-04-03T03:38:34.754300+0000","last_unstale":"2024-04-03T05:14:00.544147+0000","last_undegraded":"2024-04-03T05:14:00.544147+0000","last_fullsized":"2024-04-03T05:14:00.544147+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:49.037819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1265,"num_read_kb":1263,"num_write":1135,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'842","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.143894+0000","last_change":"2024-04-03T03:38:26.749563+0000","last_active":"2024-04-03T05:13:59.143894+0000","last_peered":"2024-04-03T05:13:59.143894+0000","last_clean":"2024-04-03T05:13:59.143894+0000","last_became_active":"2024-04-03T03:38:26.742328+0000","last_became_peered":"2024-04-03T03:38:26.742328+0000","last_unstale":"2024-04-03T05:13:59.143894+0000","last_undegraded":"2024-04-03T05:13:59.143894+0000","last_fullsized":"2024-04-03T05:13:59.143894+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:14:05.259556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3790,"num_read_kb":3360,"num_write":1145,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'387","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.527167+0000","last_change":"2024-04-03T03:38:58.349005+0000","last_active":"2024-04-03T05:14:10.527167+0000","last_peered":"2024-04-03T05:14:10.527167+0000","last_clean":"2024-04-03T05:14:10.527167+0000","last_became_active":"2024-04-03T03:38:58.348120+0000","last_became_peered":"2024-04-03T03:38:58.348120+0000","last_unstale":"2024-04-03T05:14:10.527167+0000","last_undegraded":"2024-04-03T05:14:10.527167+0000","last_fullsized":"2024-04-03T05:14:10.527167+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:15.110906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491014,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":692,"num_read_kb":8001,"num_write":1323,"num_write_kb":23217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834543+0000","last_change":"2024-04-03T03:38:28.731205+0000","last_active":"2024-04-03T05:11:42.834543+0000","last_peered":"2024-04-03T05:11:42.834543+0000","last_clean":"2024-04-03T05:11:42.834543+0000","last_became_active":"2024-04-03T03:38:28.729832+0000","last_became_peered":"2024-04-03T03:38:28.729832+0000","last_unstale":"2024-04-03T05:11:42.834543+0000","last_undegraded":"2024-04-03T05:11:42.834543+0000","last_fullsized":"2024-04-03T05:11:42.834543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:46.103991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'312","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.054867+0000","last_change":"2024-04-03T03:38:30.721619+0000","last_active":"2024-04-03T05:14:08.054867+0000","last_peered":"2024-04-03T05:14:08.054867+0000","last_clean":"2024-04-03T05:14:08.054867+0000","last_became_active":"2024-04-03T03:38:30.720884+0000","last_became_peered":"2024-04-03T03:38:30.720884+0000","last_unstale":"2024-04-03T05:14:08.054867+0000","last_undegraded":"2024-04-03T05:14:08.054867+0000","last_fullsized":"2024-04-03T05:14:08.054867+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:01:23.554077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1184,"num_write":408,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:03.031098+0000","last_change":"2024-04-03T03:38:32.742446+0000","last_active":"2024-04-03T05:12:03.031098+0000","last_peered":"2024-04-03T05:12:03.031098+0000","last_clean":"2024-04-03T05:12:03.031098+0000","last_became_active":"2024-04-03T03:38:32.741770+0000","last_became_peered":"2024-04-03T03:38:32.741770+0000","last_unstale":"2024-04-03T05:12:03.031098+0000","last_undegraded":"2024-04-03T05:12:03.031098+0000","last_fullsized":"2024-04-03T05:12:03.031098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:03:05.043052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'85","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:44.033021+0000","last_change":"2024-04-03T03:38:34.734633+0000","last_active":"2024-04-03T05:12:44.033021+0000","last_peered":"2024-04-03T05:12:44.033021+0000","last_clean":"2024-04-03T05:12:44.033021+0000","last_became_active":"2024-04-03T03:38:34.733896+0000","last_became_peered":"2024-04-03T03:38:34.733896+0000","last_unstale":"2024-04-03T05:12:44.033021+0000","last_undegraded":"2024-04-03T05:12:44.033021+0000","last_fullsized":"2024-04-03T05:12:44.033021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:01:46.697380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'718","reported_seq":2130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.188828+0000","last_change":"2024-04-03T03:38:26.735283+0000","last_active":"2024-04-03T05:13:59.188828+0000","last_peered":"2024-04-03T05:13:59.188828+0000","last_clean":"2024-04-03T05:13:59.188828+0000","last_became_active":"2024-04-03T03:38:26.734518+0000","last_became_peered":"2024-04-03T03:38:26.734518+0000","last_unstale":"2024-04-03T05:13:59.188828+0000","last_undegraded":"2024-04-03T05:13:59.188828+0000","last_fullsized":"2024-04-03T05:13:59.188828+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:24:23.571507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3204,"num_read_kb":2862,"num_write":964,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'359","reported_seq":1095,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.574587+0000","last_change":"2024-04-03T03:38:24.759103+0000","last_active":"2024-04-03T05:14:10.574587+0000","last_peered":"2024-04-03T05:14:10.574587+0000","last_clean":"2024-04-03T05:14:10.574587+0000","last_became_active":"2024-04-03T03:38:24.758401+0000","last_became_peered":"2024-04-03T03:38:24.758401+0000","last_unstale":"2024-04-03T05:14:10.574587+0000","last_undegraded":"2024-04-03T05:14:10.574587+0000","last_fullsized":"2024-04-03T05:14:10.574587+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:49:27.974853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":692,"num_read_kb":12991,"num_write":1287,"num_write_kb":25567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.822882+0000","last_change":"2024-04-03T03:38:28.731957+0000","last_active":"2024-04-03T05:10:47.822882+0000","last_peered":"2024-04-03T05:10:47.822882+0000","last_clean":"2024-04-03T05:10:47.822882+0000","last_became_active":"2024-04-03T03:38:28.731257+0000","last_became_peered":"2024-04-03T03:38:28.731257+0000","last_unstale":"2024-04-03T05:10:47.822882+0000","last_undegraded":"2024-04-03T05:10:47.822882+0000","last_fullsized":"2024-04-03T05:10:47.822882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:02:15.763718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'339","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.103383+0000","last_change":"2024-04-03T03:38:30.734366+0000","last_active":"2024-04-03T05:14:10.103383+0000","last_peered":"2024-04-03T05:14:10.103383+0000","last_clean":"2024-04-03T05:14:10.103383+0000","last_became_active":"2024-04-03T03:38:30.732417+0000","last_became_peered":"2024-04-03T03:38:30.732417+0000","last_unstale":"2024-04-03T05:14:10.103383+0000","last_undegraded":"2024-04-03T05:14:10.103383+0000","last_fullsized":"2024-04-03T05:14:10.103383+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:17:12.716764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50822,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":1115,"num_write":422,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'545","reported_seq":3038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.513029+0000","last_change":"2024-04-03T03:38:32.746838+0000","last_active":"2024-04-03T05:14:07.513029+0000","last_peered":"2024-04-03T05:14:07.513029+0000","last_clean":"2024-04-03T05:14:07.513029+0000","last_became_active":"2024-04-03T03:38:32.746029+0000","last_became_peered":"2024-04-03T03:38:32.746029+0000","last_unstale":"2024-04-03T05:14:07.513029+0000","last_undegraded":"2024-04-03T05:14:07.513029+0000","last_fullsized":"2024-04-03T05:14:07.513029+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:35:26.100890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'94","reported_seq":605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:58.856544+0000","last_change":"2024-04-03T03:38:34.742226+0000","last_active":"2024-04-03T05:13:58.856544+0000","last_peered":"2024-04-03T05:13:58.856544+0000","last_clean":"2024-04-03T05:13:58.856544+0000","last_became_active":"2024-04-03T03:38:34.741505+0000","last_became_peered":"2024-04-03T03:38:34.741505+0000","last_unstale":"2024-04-03T05:13:58.856544+0000","last_undegraded":"2024-04-03T05:13:58.856544+0000","last_fullsized":"2024-04-03T05:13:58.856544+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:35:43.800179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'443","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.121620+0000","last_change":"2024-04-03T03:38:26.732154+0000","last_active":"2024-04-03T05:13:59.121620+0000","last_peered":"2024-04-03T05:13:59.121620+0000","last_clean":"2024-04-03T05:13:59.121620+0000","last_became_active":"2024-04-03T03:38:26.731734+0000","last_became_peered":"2024-04-03T03:38:26.731734+0000","last_unstale":"2024-04-03T05:13:59.121620+0000","last_undegraded":"2024-04-03T05:13:59.121620+0000","last_fullsized":"2024-04-03T05:13:59.121620+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:33:11.766451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2428,"num_write":531,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'311","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.555680+0000","last_change":"2024-04-03T03:38:24.749540+0000","last_active":"2024-04-03T05:14:10.555680+0000","last_peered":"2024-04-03T05:14:10.555680+0000","last_clean":"2024-04-03T05:14:10.555680+0000","last_became_active":"2024-04-03T03:38:24.748646+0000","last_became_peered":"2024-04-03T03:38:24.748646+0000","last_unstale":"2024-04-03T05:14:10.555680+0000","last_undegraded":"2024-04-03T05:14:10.555680+0000","last_fullsized":"2024-04-03T05:14:10.555680+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:57:53.191419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262207,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":9924,"num_write":1193,"num_write_kb":21025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"35'5","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.028985+0000","last_change":"2024-04-03T03:38:28.733706+0000","last_active":"2024-04-03T05:14:07.028985+0000","last_peered":"2024-04-03T05:14:07.028985+0000","last_clean":"2024-04-03T05:14:07.028985+0000","last_became_active":"2024-04-03T03:38:28.733096+0000","last_became_peered":"2024-04-03T03:38:28.733096+0000","last_unstale":"2024-04-03T05:14:07.028985+0000","last_undegraded":"2024-04-03T05:14:07.028985+0000","last_fullsized":"2024-04-03T05:14:07.028985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:10:00.317664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":788,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'502","reported_seq":1184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.254769+0000","last_change":"2024-04-03T03:38:30.730692+0000","last_active":"2024-04-03T05:14:10.254769+0000","last_peered":"2024-04-03T05:14:10.254769+0000","last_clean":"2024-04-03T05:14:10.254769+0000","last_became_active":"2024-04-03T03:38:30.729624+0000","last_became_peered":"2024-04-03T03:38:30.729624+0000","last_unstale":"2024-04-03T05:14:10.254769+0000","last_undegraded":"2024-04-03T05:14:10.254769+0000","last_fullsized":"2024-04-03T05:14:10.254769+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:45:22.992777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99740,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":863,"num_read_kb":2054,"num_write":690,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834483+0000","last_change":"2024-04-03T03:38:32.749162+0000","last_active":"2024-04-03T05:11:42.834483+0000","last_peered":"2024-04-03T05:11:42.834483+0000","last_clean":"2024-04-03T05:11:42.834483+0000","last_became_active":"2024-04-03T03:38:32.746634+0000","last_became_peered":"2024-04-03T03:38:32.746634+0000","last_unstale":"2024-04-03T05:11:42.834483+0000","last_undegraded":"2024-04-03T05:11:42.834483+0000","last_fullsized":"2024-04-03T05:11:42.834483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:19:34.062410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'90","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.848438+0000","last_change":"2024-04-03T03:38:34.731395+0000","last_active":"2024-04-03T05:11:47.848438+0000","last_peered":"2024-04-03T05:11:47.848438+0000","last_clean":"2024-04-03T05:11:47.848438+0000","last_became_active":"2024-04-03T03:38:34.730714+0000","last_became_peered":"2024-04-03T03:38:34.730714+0000","last_unstale":"2024-04-03T05:11:47.848438+0000","last_undegraded":"2024-04-03T05:11:47.848438+0000","last_fullsized":"2024-04-03T05:11:47.848438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:51:40.746014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":214,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'707","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:01.902920+0000","last_change":"2024-04-03T03:39:58.685134+0000","last_active":"2024-04-03T05:11:01.902920+0000","last_peered":"2024-04-03T05:11:01.902920+0000","last_clean":"2024-04-03T05:11:01.902920+0000","last_became_active":"2024-04-03T03:39:58.684099+0000","last_became_peered":"2024-04-03T03:39:58.684099+0000","last_unstale":"2024-04-03T05:11:01.902920+0000","last_undegraded":"2024-04-03T05:11:01.902920+0000","last_fullsized":"2024-04-03T05:11:01.902920+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:24.723504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3233,"num_read_kb":2920,"num_write":926,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'339","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.551217+0000","last_change":"2024-04-03T03:38:57.880756+0000","last_active":"2024-04-03T05:14:10.551217+0000","last_peered":"2024-04-03T05:14:10.551217+0000","last_clean":"2024-04-03T05:14:10.551217+0000","last_became_active":"2024-04-03T03:38:57.880334+0000","last_became_peered":"2024-04-03T03:38:57.880334+0000","last_unstale":"2024-04-03T05:14:10.551217+0000","last_undegraded":"2024-04-03T05:14:10.551217+0000","last_fullsized":"2024-04-03T05:14:10.551217+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:59.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263916,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":538,"num_read_kb":83385,"num_write":1176,"num_write_kb":48172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.823008+0000","last_change":"2024-04-03T03:38:28.735727+0000","last_active":"2024-04-03T05:10:47.823008+0000","last_peered":"2024-04-03T05:10:47.823008+0000","last_clean":"2024-04-03T05:10:47.823008+0000","last_became_active":"2024-04-03T03:38:28.735217+0000","last_became_peered":"2024-04-03T03:38:28.735217+0000","last_unstale":"2024-04-03T05:10:47.823008+0000","last_undegraded":"2024-04-03T05:10:47.823008+0000","last_fullsized":"2024-04-03T05:10:47.823008+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:47.141174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'347","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.733169+0000","last_change":"2024-04-03T03:38:30.717823+0000","last_active":"2024-04-03T05:14:08.733169+0000","last_peered":"2024-04-03T05:14:08.733169+0000","last_clean":"2024-04-03T05:14:08.733169+0000","last_became_active":"2024-04-03T03:38:30.716983+0000","last_became_peered":"2024-04-03T03:38:30.716983+0000","last_unstale":"2024-04-03T05:14:08.733169+0000","last_undegraded":"2024-04-03T05:14:08.733169+0000","last_fullsized":"2024-04-03T05:14:08.733169+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:58:18.745061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56711,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":610,"num_read_kb":1386,"num_write":534,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:13.063766+0000","last_change":"2024-04-03T03:38:32.738099+0000","last_active":"2024-04-03T05:11:13.063766+0000","last_peered":"2024-04-03T05:11:13.063766+0000","last_clean":"2024-04-03T05:11:13.063766+0000","last_became_active":"2024-04-03T03:38:32.737619+0000","last_became_peered":"2024-04-03T03:38:32.737619+0000","last_unstale":"2024-04-03T05:11:13.063766+0000","last_undegraded":"2024-04-03T05:11:13.063766+0000","last_fullsized":"2024-04-03T05:11:13.063766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:01.783659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'102","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.044667+0000","last_change":"2024-04-03T03:38:34.755669+0000","last_active":"2024-04-03T05:12:58.044667+0000","last_peered":"2024-04-03T05:12:58.044667+0000","last_clean":"2024-04-03T05:12:58.044667+0000","last_became_active":"2024-04-03T03:38:34.754907+0000","last_became_peered":"2024-04-03T03:38:34.754907+0000","last_unstale":"2024-04-03T05:12:58.044667+0000","last_undegraded":"2024-04-03T05:12:58.044667+0000","last_fullsized":"2024-04-03T05:12:58.044667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:49.625336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":237,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'876","reported_seq":2630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.221358+0000","last_change":"2024-04-03T03:38:26.741422+0000","last_active":"2024-04-03T05:12:22.221358+0000","last_peered":"2024-04-03T05:12:22.221358+0000","last_clean":"2024-04-03T05:12:22.221358+0000","last_became_active":"2024-04-03T03:38:26.740674+0000","last_became_peered":"2024-04-03T03:38:26.740674+0000","last_unstale":"2024-04-03T05:12:22.221358+0000","last_undegraded":"2024-04-03T05:12:22.221358+0000","last_fullsized":"2024-04-03T05:12:22.221358+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:32.052642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4230,"num_read_kb":3805,"num_write":1201,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'306","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.525295+0000","last_change":"2024-04-03T03:38:58.345059+0000","last_active":"2024-04-03T05:14:10.525295+0000","last_peered":"2024-04-03T05:14:10.525295+0000","last_clean":"2024-04-03T05:14:10.525295+0000","last_became_active":"2024-04-03T03:38:58.344044+0000","last_became_peered":"2024-04-03T03:38:58.344044+0000","last_unstale":"2024-04-03T05:14:10.525295+0000","last_undegraded":"2024-04-03T05:14:10.525295+0000","last_fullsized":"2024-04-03T05:14:10.525295+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:56.276421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6735876,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":460,"num_read_kb":45119,"num_write":1136,"num_write_kb":60620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830246+0000","last_change":"2024-04-03T03:38:28.716186+0000","last_active":"2024-04-03T05:10:47.830246+0000","last_peered":"2024-04-03T05:10:47.830246+0000","last_clean":"2024-04-03T05:10:47.830246+0000","last_became_active":"2024-04-03T03:38:28.715394+0000","last_became_peered":"2024-04-03T03:38:28.715394+0000","last_unstale":"2024-04-03T05:10:47.830246+0000","last_undegraded":"2024-04-03T05:10:47.830246+0000","last_fullsized":"2024-04-03T05:10:47.830246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:46.237254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'336","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.730658+0000","last_change":"2024-04-03T03:38:30.733851+0000","last_active":"2024-04-03T05:14:07.730658+0000","last_peered":"2024-04-03T05:14:07.730658+0000","last_clean":"2024-04-03T05:14:07.730658+0000","last_became_active":"2024-04-03T03:38:30.733001+0000","last_became_peered":"2024-04-03T03:38:30.733001+0000","last_unstale":"2024-04-03T05:14:07.730658+0000","last_undegraded":"2024-04-03T05:14:07.730658+0000","last_fullsized":"2024-04-03T05:14:07.730658+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:49:06.273548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1151,"num_write":432,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'500","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.920326+0000","last_change":"2024-04-03T03:38:32.741613+0000","last_active":"2024-04-03T05:14:09.920326+0000","last_peered":"2024-04-03T05:14:09.920326+0000","last_clean":"2024-04-03T05:14:09.920326+0000","last_became_active":"2024-04-03T03:38:32.740883+0000","last_became_peered":"2024-04-03T03:38:32.740883+0000","last_unstale":"2024-04-03T05:14:09.920326+0000","last_undegraded":"2024-04-03T05:14:09.920326+0000","last_fullsized":"2024-04-03T05:14:09.920326+0000","mapping_epoch":31,"log_start":"258'400","ondisk_log_start":"258'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:10:34.038922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'91","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:17.980790+0000","last_change":"2024-04-03T03:38:34.749468+0000","last_active":"2024-04-03T05:10:17.980790+0000","last_peered":"2024-04-03T05:10:17.980790+0000","last_clean":"2024-04-03T05:10:17.980790+0000","last_became_active":"2024-04-03T03:38:34.748128+0000","last_became_peered":"2024-04-03T03:38:34.748128+0000","last_unstale":"2024-04-03T05:10:17.980790+0000","last_undegraded":"2024-04-03T05:10:17.980790+0000","last_fullsized":"2024-04-03T05:10:17.980790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:41:37.569030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":229,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'412","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.286549+0000","last_change":"2024-04-03T03:38:26.746310+0000","last_active":"2024-04-03T05:11:29.286549+0000","last_peered":"2024-04-03T05:11:29.286549+0000","last_clean":"2024-04-03T05:11:29.286549+0000","last_became_active":"2024-04-03T03:38:26.742254+0000","last_became_peered":"2024-04-03T03:38:26.742254+0000","last_unstale":"2024-04-03T05:11:29.286549+0000","last_undegraded":"2024-04-03T05:11:29.286549+0000","last_fullsized":"2024-04-03T05:11:29.286549+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:45:43.364326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2115,"num_read_kb":2003,"num_write":485,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'358","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.530462+0000","last_change":"2024-04-03T03:38:24.713564+0000","last_active":"2024-04-03T05:14:10.530462+0000","last_peered":"2024-04-03T05:14:10.530462+0000","last_clean":"2024-04-03T05:14:10.530462+0000","last_became_active":"2024-04-03T03:38:24.710396+0000","last_became_peered":"2024-04-03T03:38:24.710396+0000","last_unstale":"2024-04-03T05:14:10.530462+0000","last_undegraded":"2024-04-03T05:14:10.530462+0000","last_fullsized":"2024-04-03T05:14:10.530462+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:04:14.187436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288129,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":39636,"num_write":1279,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.041945+0000","last_change":"2024-04-03T03:38:28.735630+0000","last_active":"2024-04-03T05:14:07.041945+0000","last_peered":"2024-04-03T05:14:07.041945+0000","last_clean":"2024-04-03T05:14:07.041945+0000","last_became_active":"2024-04-03T03:38:28.734894+0000","last_became_peered":"2024-04-03T03:38:28.734894+0000","last_unstale":"2024-04-03T05:14:07.041945+0000","last_undegraded":"2024-04-03T05:14:07.041945+0000","last_fullsized":"2024-04-03T05:14:07.041945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:06.360323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":632,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'126","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013371+0000","last_change":"2024-04-03T03:38:30.822812+0000","last_active":"2024-04-03T05:10:48.013371+0000","last_peered":"2024-04-03T05:10:48.013371+0000","last_clean":"2024-04-03T05:10:48.013371+0000","last_became_active":"2024-04-03T03:38:30.821224+0000","last_became_peered":"2024-04-03T03:38:30.821224+0000","last_unstale":"2024-04-03T05:10:48.013371+0000","last_undegraded":"2024-04-03T05:10:48.013371+0000","last_fullsized":"2024-04-03T05:10:48.013371+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:32:28.000773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'526","reported_seq":2473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.645818+0000","last_change":"2024-04-03T03:38:32.748028+0000","last_active":"2024-04-03T05:14:07.645818+0000","last_peered":"2024-04-03T05:14:07.645818+0000","last_clean":"2024-04-03T05:14:07.645818+0000","last_became_active":"2024-04-03T03:38:32.747078+0000","last_became_peered":"2024-04-03T03:38:32.747078+0000","last_unstale":"2024-04-03T05:14:07.645818+0000","last_undegraded":"2024-04-03T05:14:07.645818+0000","last_fullsized":"2024-04-03T05:14:07.645818+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:21.612026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'98","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:58.857389+0000","last_change":"2024-04-03T03:38:34.740348+0000","last_active":"2024-04-03T05:13:58.857389+0000","last_peered":"2024-04-03T05:13:58.857389+0000","last_clean":"2024-04-03T05:13:58.857389+0000","last_became_active":"2024-04-03T03:38:34.739554+0000","last_became_peered":"2024-04-03T03:38:34.739554+0000","last_unstale":"2024-04-03T05:13:58.857389+0000","last_undegraded":"2024-04-03T05:13:58.857389+0000","last_fullsized":"2024-04-03T05:13:58.857389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:59:41.957959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'345","reported_seq":1750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:07.839480+0000","last_change":"2024-04-03T03:38:26.729619+0000","last_active":"2024-04-03T05:11:07.839480+0000","last_peered":"2024-04-03T05:11:07.839480+0000","last_clean":"2024-04-03T05:11:07.839480+0000","last_became_active":"2024-04-03T03:38:26.729241+0000","last_became_peered":"2024-04-03T03:38:26.729241+0000","last_unstale":"2024-04-03T05:11:07.839480+0000","last_undegraded":"2024-04-03T05:11:07.839480+0000","last_fullsized":"2024-04-03T05:11:07.839480+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:27:27.602414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1840,"num_read_kb":1751,"num_write":396,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'307","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.540273+0000","last_change":"2024-04-03T03:38:24.715501+0000","last_active":"2024-04-03T05:14:10.540273+0000","last_peered":"2024-04-03T05:14:10.540273+0000","last_clean":"2024-04-03T05:14:10.540273+0000","last_became_active":"2024-04-03T03:38:24.709105+0000","last_became_peered":"2024-04-03T03:38:24.709105+0000","last_unstale":"2024-04-03T05:14:10.540273+0000","last_undegraded":"2024-04-03T05:14:10.540273+0000","last_fullsized":"2024-04-03T05:14:10.540273+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:59:29.586390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2161470,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":67615,"num_write":1075,"num_write_kb":19160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.629640+0000","last_change":"2024-04-03T03:38:28.730578+0000","last_active":"2024-04-03T05:10:43.629640+0000","last_peered":"2024-04-03T05:10:43.629640+0000","last_clean":"2024-04-03T05:10:43.629640+0000","last_became_active":"2024-04-03T03:38:28.729835+0000","last_became_peered":"2024-04-03T03:38:28.729835+0000","last_unstale":"2024-04-03T05:10:43.629640+0000","last_undegraded":"2024-04-03T05:10:43.629640+0000","last_fullsized":"2024-04-03T05:10:43.629640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:23.115894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'511","reported_seq":1172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.762629+0000","last_change":"2024-04-03T03:38:30.730361+0000","last_active":"2024-04-03T05:14:09.762629+0000","last_peered":"2024-04-03T05:14:09.762629+0000","last_clean":"2024-04-03T05:14:09.762629+0000","last_became_active":"2024-04-03T03:38:30.729797+0000","last_became_peered":"2024-04-03T03:38:30.729797+0000","last_unstale":"2024-04-03T05:14:09.762629+0000","last_undegraded":"2024-04-03T05:14:09.762629+0000","last_fullsized":"2024-04-03T05:14:09.762629+0000","mapping_epoch":29,"log_start":"263'500","ondisk_log_start":"263'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:13:30.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1388,"num_read_kb":1975,"num_write":1982,"num_write_kb":1776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:49.004650+0000","last_change":"2024-04-03T03:38:32.739831+0000","last_active":"2024-04-03T05:10:49.004650+0000","last_peered":"2024-04-03T05:10:49.004650+0000","last_clean":"2024-04-03T05:10:49.004650+0000","last_became_active":"2024-04-03T03:38:32.738974+0000","last_became_peered":"2024-04-03T03:38:32.738974+0000","last_unstale":"2024-04-03T05:10:49.004650+0000","last_undegraded":"2024-04-03T05:10:49.004650+0000","last_fullsized":"2024-04-03T05:10:49.004650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:56.614207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'126","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:17.823774+0000","last_change":"2024-04-03T03:38:34.756154+0000","last_active":"2024-04-03T05:10:17.823774+0000","last_peered":"2024-04-03T05:10:17.823774+0000","last_clean":"2024-04-03T05:10:17.823774+0000","last_became_active":"2024-04-03T03:38:34.755358+0000","last_became_peered":"2024-04-03T03:38:34.755358+0000","last_unstale":"2024-04-03T05:10:17.823774+0000","last_undegraded":"2024-04-03T05:10:17.823774+0000","last_fullsized":"2024-04-03T05:10:17.823774+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:16:30.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":275,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'755","reported_seq":2261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.451786+0000","last_change":"2024-04-03T03:38:26.748524+0000","last_active":"2024-04-03T05:11:08.451786+0000","last_peered":"2024-04-03T05:11:08.451786+0000","last_clean":"2024-04-03T05:11:08.451786+0000","last_became_active":"2024-04-03T03:38:26.747883+0000","last_became_peered":"2024-04-03T03:38:26.747883+0000","last_unstale":"2024-04-03T05:11:08.451786+0000","last_undegraded":"2024-04-03T05:11:08.451786+0000","last_fullsized":"2024-04-03T05:11:08.451786+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:40:23.177113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3405,"num_read_kb":3046,"num_write":999,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026291+0000","last_change":"2024-04-03T03:38:04.257665+0000","last_active":"2024-04-03T05:10:29.026291+0000","last_peered":"2024-04-03T05:10:29.026291+0000","last_clean":"2024-04-03T05:10:29.026291+0000","last_became_active":"2024-04-03T03:38:04.255147+0000","last_became_peered":"2024-04-03T03:38:04.255147+0000","last_unstale":"2024-04-03T05:10:29.026291+0000","last_undegraded":"2024-04-03T05:10:29.026291+0000","last_fullsized":"2024-04-03T05:10:29.026291+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_clean_scrub_stamp":"2024-04-03T03:38:03.047546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:39:28.268533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:58.841142+0000","last_change":"2024-04-03T03:38:11.616774+0000","last_active":"2024-04-03T05:11:58.841142+0000","last_peered":"2024-04-03T05:11:58.841142+0000","last_clean":"2024-04-03T05:11:58.841142+0000","last_became_active":"2024-04-03T03:38:11.615990+0000","last_became_peered":"2024-04-03T03:38:11.615990+0000","last_unstale":"2024-04-03T05:11:58.841142+0000","last_undegraded":"2024-04-03T05:11:58.841142+0000","last_fullsized":"2024-04-03T05:11:58.841142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:31.225680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'273","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.425125+0000","last_change":"2024-04-03T03:38:24.759919+0000","last_active":"2024-04-03T05:14:10.425125+0000","last_peered":"2024-04-03T05:14:10.425125+0000","last_clean":"2024-04-03T05:14:10.425125+0000","last_became_active":"2024-04-03T03:38:24.759653+0000","last_became_peered":"2024-04-03T03:38:24.759653+0000","last_unstale":"2024-04-03T05:14:10.425125+0000","last_undegraded":"2024-04-03T05:14:10.425125+0000","last_fullsized":"2024-04-03T05:14:10.425125+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:41:42.084865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5305714,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":451,"num_read_kb":37025,"num_write":1084,"num_write_kb":41578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:09.021791+0000","last_change":"2024-04-03T03:38:28.738201+0000","last_active":"2024-04-03T05:10:09.021791+0000","last_peered":"2024-04-03T05:10:09.021791+0000","last_clean":"2024-04-03T05:10:09.021791+0000","last_became_active":"2024-04-03T03:38:28.735507+0000","last_became_peered":"2024-04-03T03:38:28.735507+0000","last_unstale":"2024-04-03T05:10:09.021791+0000","last_undegraded":"2024-04-03T05:10:09.021791+0000","last_fullsized":"2024-04-03T05:10:09.021791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:35:10.061515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'739","reported_seq":1482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.515427+0000","last_change":"2024-04-03T03:38:30.723361+0000","last_active":"2024-04-03T05:14:10.515427+0000","last_peered":"2024-04-03T05:14:10.515427+0000","last_clean":"2024-04-03T05:14:10.515427+0000","last_became_active":"2024-04-03T03:38:30.722613+0000","last_became_peered":"2024-04-03T03:38:30.722613+0000","last_unstale":"2024-04-03T05:14:10.515427+0000","last_undegraded":"2024-04-03T05:14:10.515427+0000","last_fullsized":"2024-04-03T05:14:10.515427+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:07:59.714595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1443,"num_read_kb":3262,"num_write":1372,"num_write_kb":1187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:43.070721+0000","last_change":"2024-04-03T03:38:32.747059+0000","last_active":"2024-04-03T05:11:43.070721+0000","last_peered":"2024-04-03T05:11:43.070721+0000","last_clean":"2024-04-03T05:11:43.070721+0000","last_became_active":"2024-04-03T03:38:32.746148+0000","last_became_peered":"2024-04-03T03:38:32.746148+0000","last_unstale":"2024-04-03T05:11:43.070721+0000","last_undegraded":"2024-04-03T05:11:43.070721+0000","last_fullsized":"2024-04-03T05:11:43.070721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:20:36.906339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'114","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.017684+0000","last_change":"2024-04-03T03:38:34.761254+0000","last_active":"2024-04-03T05:11:49.017684+0000","last_peered":"2024-04-03T05:11:49.017684+0000","last_clean":"2024-04-03T05:11:49.017684+0000","last_became_active":"2024-04-03T03:38:34.760522+0000","last_became_peered":"2024-04-03T03:38:34.760522+0000","last_unstale":"2024-04-03T05:11:49.017684+0000","last_undegraded":"2024-04-03T05:11:49.017684+0000","last_fullsized":"2024-04-03T05:11:49.017684+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:48.393317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":148,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'705","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.069042+0000","last_change":"2024-04-03T03:38:26.726518+0000","last_active":"2024-04-03T05:11:38.069042+0000","last_peered":"2024-04-03T05:11:38.069042+0000","last_clean":"2024-04-03T05:11:38.069042+0000","last_became_active":"2024-04-03T03:38:26.725330+0000","last_became_peered":"2024-04-03T03:38:26.725330+0000","last_unstale":"2024-04-03T05:11:38.069042+0000","last_undegraded":"2024-04-03T05:11:38.069042+0000","last_fullsized":"2024-04-03T05:11:38.069042+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":600,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:20:31.608702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3168,"num_read_kb":2822,"num_write":954,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:39.028616+0000","last_change":"2024-04-03T03:38:11.620060+0000","last_active":"2024-04-03T05:10:39.028616+0000","last_peered":"2024-04-03T05:10:39.028616+0000","last_clean":"2024-04-03T05:10:39.028616+0000","last_became_active":"2024-04-03T03:38:11.619474+0000","last_became_peered":"2024-04-03T03:38:11.619474+0000","last_unstale":"2024-04-03T05:10:39.028616+0000","last_undegraded":"2024-04-03T05:10:39.028616+0000","last_fullsized":"2024-04-03T05:10:39.028616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:13:54.362230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'329","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.468950+0000","last_change":"2024-04-03T03:38:24.745584+0000","last_active":"2024-04-03T05:14:10.468950+0000","last_peered":"2024-04-03T05:14:10.468950+0000","last_clean":"2024-04-03T05:14:10.468950+0000","last_became_active":"2024-04-03T03:38:24.745231+0000","last_became_peered":"2024-04-03T03:38:24.745231+0000","last_unstale":"2024-04-03T05:14:10.468950+0000","last_undegraded":"2024-04-03T05:14:10.468950+0000","last_fullsized":"2024-04-03T05:14:10.468950+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:04:43.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":22150,"num_write":1160,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.836656+0000","last_change":"2024-04-03T03:38:28.741133+0000","last_active":"2024-04-03T05:11:38.836656+0000","last_peered":"2024-04-03T05:11:38.836656+0000","last_clean":"2024-04-03T05:11:38.836656+0000","last_became_active":"2024-04-03T03:38:28.740595+0000","last_became_peered":"2024-04-03T03:38:28.740595+0000","last_unstale":"2024-04-03T05:11:38.836656+0000","last_undegraded":"2024-04-03T05:11:38.836656+0000","last_fullsized":"2024-04-03T05:11:38.836656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:29:01.051877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1191","reported_seq":3245,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.381837+0000","last_change":"2024-04-03T03:38:30.725691+0000","last_active":"2024-04-03T05:14:10.381837+0000","last_peered":"2024-04-03T05:14:10.381837+0000","last_clean":"2024-04-03T05:14:10.381837+0000","last_became_active":"2024-04-03T03:38:30.719511+0000","last_became_peered":"2024-04-03T03:38:30.719511+0000","last_unstale":"2024-04-03T05:14:10.381837+0000","last_undegraded":"2024-04-03T05:14:10.381837+0000","last_fullsized":"2024-04-03T05:14:10.381837+0000","mapping_epoch":29,"log_start":"263'1100","ondisk_log_start":"263'1100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":1100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:38:42.566363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152942,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1863,"num_read_kb":3633,"num_write":1216,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:39.028804+0000","last_change":"2024-04-03T03:38:32.749446+0000","last_active":"2024-04-03T05:10:39.028804+0000","last_peered":"2024-04-03T05:10:39.028804+0000","last_clean":"2024-04-03T05:10:39.028804+0000","last_became_active":"2024-04-03T03:38:32.748061+0000","last_became_peered":"2024-04-03T03:38:32.748061+0000","last_unstale":"2024-04-03T05:10:39.028804+0000","last_undegraded":"2024-04-03T05:10:39.028804+0000","last_fullsized":"2024-04-03T05:10:39.028804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:27:00.730176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'163","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:02.820397+0000","last_change":"2024-04-03T03:38:34.937386+0000","last_active":"2024-04-03T05:10:02.820397+0000","last_peered":"2024-04-03T05:10:02.820397+0000","last_clean":"2024-04-03T05:10:02.820397+0000","last_became_active":"2024-04-03T03:38:34.936635+0000","last_became_peered":"2024-04-03T03:38:34.936635+0000","last_unstale":"2024-04-03T05:10:02.820397+0000","last_undegraded":"2024-04-03T05:10:02.820397+0000","last_fullsized":"2024-04-03T05:10:02.820397+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:53:55.693822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":219,"num_write":382,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'394","reported_seq":1830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.114549+0000","last_change":"2024-04-03T03:38:26.722334+0000","last_active":"2024-04-03T05:13:59.114549+0000","last_peered":"2024-04-03T05:13:59.114549+0000","last_clean":"2024-04-03T05:13:59.114549+0000","last_became_active":"2024-04-03T03:38:26.721536+0000","last_became_peered":"2024-04-03T03:38:26.721536+0000","last_unstale":"2024-04-03T05:13:59.114549+0000","last_undegraded":"2024-04-03T05:13:59.114549+0000","last_fullsized":"2024-04-03T05:13:59.114549+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:53.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2077,"num_read_kb":1939,"num_write":478,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:57.837427+0000","last_change":"2024-04-03T03:38:11.755773+0000","last_active":"2024-04-03T05:11:57.837427+0000","last_peered":"2024-04-03T05:11:57.837427+0000","last_clean":"2024-04-03T05:11:57.837427+0000","last_became_active":"2024-04-03T03:38:11.755301+0000","last_became_peered":"2024-04-03T03:38:11.755301+0000","last_unstale":"2024-04-03T05:11:57.837427+0000","last_undegraded":"2024-04-03T05:11:57.837427+0000","last_fullsized":"2024-04-03T05:11:57.837427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:56:40.206707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'314","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.554100+0000","last_change":"2024-04-03T03:38:24.720942+0000","last_active":"2024-04-03T05:14:10.554100+0000","last_peered":"2024-04-03T05:14:10.554100+0000","last_clean":"2024-04-03T05:14:10.554100+0000","last_became_active":"2024-04-03T03:38:24.720445+0000","last_became_peered":"2024-04-03T03:38:24.720445+0000","last_unstale":"2024-04-03T05:14:10.554100+0000","last_undegraded":"2024-04-03T05:14:10.554100+0000","last_fullsized":"2024-04-03T05:14:10.554100+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:22:22.841422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194358,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":20915,"num_write":1082,"num_write_kb":36230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:42.834723+0000","last_change":"2024-04-03T03:38:28.734259+0000","last_active":"2024-04-03T05:11:42.834723+0000","last_peered":"2024-04-03T05:11:42.834723+0000","last_clean":"2024-04-03T05:11:42.834723+0000","last_became_active":"2024-04-03T03:38:28.733750+0000","last_became_peered":"2024-04-03T03:38:28.733750+0000","last_unstale":"2024-04-03T05:11:42.834723+0000","last_undegraded":"2024-04-03T05:11:42.834723+0000","last_fullsized":"2024-04-03T05:11:42.834723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:15:52.422170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'331","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:57.929725+0000","last_change":"2024-04-03T03:38:30.824797+0000","last_active":"2024-04-03T05:13:57.929725+0000","last_peered":"2024-04-03T05:13:57.929725+0000","last_clean":"2024-04-03T05:13:57.929725+0000","last_became_active":"2024-04-03T03:38:30.824061+0000","last_became_peered":"2024-04-03T03:38:30.824061+0000","last_unstale":"2024-04-03T05:13:57.929725+0000","last_undegraded":"2024-04-03T05:13:57.929725+0000","last_fullsized":"2024-04-03T05:13:57.929725+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:24.797261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":319,"num_read_kb":311,"num_write":309,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.046912+0000","last_change":"2024-04-03T03:38:32.735866+0000","last_active":"2024-04-03T05:10:13.046912+0000","last_peered":"2024-04-03T05:10:13.046912+0000","last_clean":"2024-04-03T05:10:13.046912+0000","last_became_active":"2024-04-03T03:38:32.735151+0000","last_became_peered":"2024-04-03T03:38:32.735151+0000","last_unstale":"2024-04-03T05:10:13.046912+0000","last_undegraded":"2024-04-03T05:10:13.046912+0000","last_fullsized":"2024-04-03T05:10:13.046912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:48:02.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'192","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014576+0000","last_change":"2024-04-03T03:38:34.732538+0000","last_active":"2024-04-03T05:10:53.014576+0000","last_peered":"2024-04-03T05:10:53.014576+0000","last_clean":"2024-04-03T05:10:53.014576+0000","last_became_active":"2024-04-03T03:38:34.731776+0000","last_became_peered":"2024-04-03T03:38:34.731776+0000","last_unstale":"2024-04-03T05:10:53.014576+0000","last_undegraded":"2024-04-03T05:10:53.014576+0000","last_fullsized":"2024-04-03T05:10:53.014576+0000","mapping_epoch":33,"log_start":"252'100","ondisk_log_start":"252'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:35:06.296897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":349,"num_read_kb":358,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'382","reported_seq":1859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.232691+0000","last_change":"2024-04-03T03:38:26.727951+0000","last_active":"2024-04-03T05:10:55.232691+0000","last_peered":"2024-04-03T05:10:55.232691+0000","last_clean":"2024-04-03T05:10:55.232691+0000","last_became_active":"2024-04-03T03:38:26.727581+0000","last_became_peered":"2024-04-03T03:38:26.727581+0000","last_unstale":"2024-04-03T05:10:55.232691+0000","last_undegraded":"2024-04-03T05:10:55.232691+0000","last_fullsized":"2024-04-03T05:10:55.232691+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:26:22.789971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2147,"num_read_kb":2031,"num_write":458,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:58.841089+0000","last_change":"2024-04-03T03:38:11.614869+0000","last_active":"2024-04-03T05:11:58.841089+0000","last_peered":"2024-04-03T05:11:58.841089+0000","last_clean":"2024-04-03T05:11:58.841089+0000","last_became_active":"2024-04-03T03:38:11.613973+0000","last_became_peered":"2024-04-03T03:38:11.613973+0000","last_unstale":"2024-04-03T05:11:58.841089+0000","last_undegraded":"2024-04-03T05:11:58.841089+0000","last_fullsized":"2024-04-03T05:11:58.841089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:38:53.162490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'335","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.559800+0000","last_change":"2024-04-03T03:38:58.350014+0000","last_active":"2024-04-03T05:14:10.559800+0000","last_peered":"2024-04-03T05:14:10.559800+0000","last_clean":"2024-04-03T05:14:10.559800+0000","last_became_active":"2024-04-03T03:38:58.349561+0000","last_became_peered":"2024-04-03T03:38:58.349561+0000","last_unstale":"2024-04-03T05:14:10.559800+0000","last_undegraded":"2024-04-03T05:14:10.559800+0000","last_fullsized":"2024-04-03T05:14:10.559800+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:53:53.418209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":496,"num_read_kb":36392,"num_write":1067,"num_write_kb":30181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:38.055575+0000","last_change":"2024-04-03T03:38:28.713016+0000","last_active":"2024-04-03T05:10:38.055575+0000","last_peered":"2024-04-03T05:10:38.055575+0000","last_clean":"2024-04-03T05:10:38.055575+0000","last_became_active":"2024-04-03T03:38:28.711551+0000","last_became_peered":"2024-04-03T03:38:28.711551+0000","last_unstale":"2024-04-03T05:10:38.055575+0000","last_undegraded":"2024-04-03T05:10:38.055575+0000","last_fullsized":"2024-04-03T05:10:38.055575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:02:00.901908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'182","reported_seq":776,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.056299+0000","last_change":"2024-04-03T03:38:30.718183+0000","last_active":"2024-04-03T05:13:53.056299+0000","last_peered":"2024-04-03T05:13:53.056299+0000","last_clean":"2024-04-03T05:13:53.056299+0000","last_became_active":"2024-04-03T03:38:30.717437+0000","last_became_peered":"2024-04-03T03:38:30.717437+0000","last_unstale":"2024-04-03T05:13:53.056299+0000","last_undegraded":"2024-04-03T05:13:53.056299+0000","last_fullsized":"2024-04-03T05:13:53.056299+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:19:51.986312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":238,"num_read_kb":232,"num_write":176,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:44.016713+0000","last_change":"2024-04-03T03:38:32.740103+0000","last_active":"2024-04-03T05:11:44.016713+0000","last_peered":"2024-04-03T05:11:44.016713+0000","last_clean":"2024-04-03T05:11:44.016713+0000","last_became_active":"2024-04-03T03:38:32.739201+0000","last_became_peered":"2024-04-03T03:38:32.739201+0000","last_unstale":"2024-04-03T05:11:44.016713+0000","last_undegraded":"2024-04-03T05:11:44.016713+0000","last_fullsized":"2024-04-03T05:11:44.016713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:29.389145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'110","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.838705+0000","last_change":"2024-04-03T03:38:34.755897+0000","last_active":"2024-04-03T05:11:48.838705+0000","last_peered":"2024-04-03T05:11:48.838705+0000","last_clean":"2024-04-03T05:11:48.838705+0000","last_became_active":"2024-04-03T03:38:34.749642+0000","last_became_peered":"2024-04-03T03:38:34.749642+0000","last_unstale":"2024-04-03T05:11:48.838705+0000","last_undegraded":"2024-04-03T05:11:48.838705+0000","last_fullsized":"2024-04-03T05:11:48.838705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:24:40.979283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":197,"num_write":285,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'481","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:01.899466+0000","last_change":"2024-04-03T03:38:26.720851+0000","last_active":"2024-04-03T05:11:01.899466+0000","last_peered":"2024-04-03T05:11:01.899466+0000","last_clean":"2024-04-03T05:11:01.899466+0000","last_became_active":"2024-04-03T03:38:26.720476+0000","last_became_peered":"2024-04-03T03:38:26.720476+0000","last_unstale":"2024-04-03T05:11:01.899466+0000","last_undegraded":"2024-04-03T05:11:01.899466+0000","last_fullsized":"2024-04-03T05:11:01.899466+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:16:11.552164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2351,"num_write":586,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'318","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.436075+0000","last_change":"2024-04-03T03:38:24.749672+0000","last_active":"2024-04-03T05:14:10.436075+0000","last_peered":"2024-04-03T05:14:10.436075+0000","last_clean":"2024-04-03T05:14:10.436075+0000","last_became_active":"2024-04-03T03:38:24.748412+0000","last_became_peered":"2024-04-03T03:38:24.748412+0000","last_unstale":"2024-04-03T05:14:10.436075+0000","last_undegraded":"2024-04-03T05:14:10.436075+0000","last_fullsized":"2024-04-03T05:14:10.436075+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:46.714828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400935,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":679,"num_read_kb":11584,"num_write":1159,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:57.850522+0000","last_change":"2024-04-03T03:38:11.611219+0000","last_active":"2024-04-03T05:11:57.850522+0000","last_peered":"2024-04-03T05:11:57.850522+0000","last_clean":"2024-04-03T05:11:57.850522+0000","last_became_active":"2024-04-03T03:38:11.609995+0000","last_became_peered":"2024-04-03T03:38:11.609995+0000","last_unstale":"2024-04-03T05:11:57.850522+0000","last_undegraded":"2024-04-03T05:11:57.850522+0000","last_fullsized":"2024-04-03T05:11:57.850522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:52:03.961331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'3","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.030519+0000","last_change":"2024-04-03T03:38:28.717488+0000","last_active":"2024-04-03T05:14:07.030519+0000","last_peered":"2024-04-03T05:14:07.030519+0000","last_clean":"2024-04-03T05:14:07.030519+0000","last_became_active":"2024-04-03T03:38:28.716761+0000","last_became_peered":"2024-04-03T03:38:28.716761+0000","last_unstale":"2024-04-03T05:14:07.030519+0000","last_undegraded":"2024-04-03T05:14:07.030519+0000","last_fullsized":"2024-04-03T05:14:07.030519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:16:55.208823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":482,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'618","reported_seq":1349,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.585718+0000","last_change":"2024-04-03T03:38:30.731606+0000","last_active":"2024-04-03T05:14:10.585718+0000","last_peered":"2024-04-03T05:14:10.585718+0000","last_clean":"2024-04-03T05:14:10.585718+0000","last_became_active":"2024-04-03T03:38:30.731186+0000","last_became_peered":"2024-04-03T03:38:30.731186+0000","last_unstale":"2024-04-03T05:14:10.585718+0000","last_undegraded":"2024-04-03T05:14:10.585718+0000","last_fullsized":"2024-04-03T05:14:10.585718+0000","mapping_epoch":29,"log_start":"263'600","ondisk_log_start":"263'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:47:57.629875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105089,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1067,"num_read_kb":2412,"num_write":850,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.622768+0000","last_change":"2024-04-03T03:38:32.726283+0000","last_active":"2024-04-03T05:10:13.622768+0000","last_peered":"2024-04-03T05:10:13.622768+0000","last_clean":"2024-04-03T05:10:13.622768+0000","last_became_active":"2024-04-03T03:38:32.725549+0000","last_became_peered":"2024-04-03T03:38:32.725549+0000","last_unstale":"2024-04-03T05:10:13.622768+0000","last_undegraded":"2024-04-03T05:10:13.622768+0000","last_fullsized":"2024-04-03T05:10:13.622768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:58.188714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'103","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.246058+0000","last_change":"2024-04-03T03:38:34.940294+0000","last_active":"2024-04-03T05:10:55.246058+0000","last_peered":"2024-04-03T05:10:55.246058+0000","last_clean":"2024-04-03T05:10:55.246058+0000","last_became_active":"2024-04-03T03:38:34.939419+0000","last_became_peered":"2024-04-03T03:38:34.939419+0000","last_unstale":"2024-04-03T05:10:55.246058+0000","last_undegraded":"2024-04-03T05:10:55.246058+0000","last_fullsized":"2024-04-03T05:10:55.246058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:30:08.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":118,"num_write":243,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'842","reported_seq":2346,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.076939+0000","last_change":"2024-04-03T03:38:26.732400+0000","last_active":"2024-04-03T05:12:13.076939+0000","last_peered":"2024-04-03T05:12:13.076939+0000","last_clean":"2024-04-03T05:12:13.076939+0000","last_became_active":"2024-04-03T03:38:26.731406+0000","last_became_peered":"2024-04-03T03:38:26.731406+0000","last_unstale":"2024-04-03T05:12:13.076939+0000","last_undegraded":"2024-04-03T05:12:13.076939+0000","last_fullsized":"2024-04-03T05:12:13.076939+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:49.785408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3757,"num_read_kb":3345,"num_write":1171,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'312","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.443858+0000","last_change":"2024-04-03T03:38:24.722172+0000","last_active":"2024-04-03T05:14:10.443858+0000","last_peered":"2024-04-03T05:14:10.443858+0000","last_clean":"2024-04-03T05:14:10.443858+0000","last_became_active":"2024-04-03T03:38:24.721685+0000","last_became_peered":"2024-04-03T03:38:24.721685+0000","last_unstale":"2024-04-03T05:14:10.443858+0000","last_undegraded":"2024-04-03T05:14:10.443858+0000","last_fullsized":"2024-04-03T05:14:10.443858+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:39.493128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266323,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":425,"num_read_kb":12382,"num_write":1218,"num_write_kb":30338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:19.024098+0000","last_change":"2024-04-03T03:38:11.618107+0000","last_active":"2024-04-03T05:10:19.024098+0000","last_peered":"2024-04-03T05:10:19.024098+0000","last_clean":"2024-04-03T05:10:19.024098+0000","last_became_active":"2024-04-03T03:38:11.617057+0000","last_became_peered":"2024-04-03T03:38:11.617057+0000","last_unstale":"2024-04-03T05:10:19.024098+0000","last_undegraded":"2024-04-03T05:10:19.024098+0000","last_fullsized":"2024-04-03T05:10:19.024098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:22:38.744380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.996201+0000","last_change":"2024-04-03T03:38:28.720480+0000","last_active":"2024-04-03T05:10:08.996201+0000","last_peered":"2024-04-03T05:10:08.996201+0000","last_clean":"2024-04-03T05:10:08.996201+0000","last_became_active":"2024-04-03T03:38:28.719394+0000","last_became_peered":"2024-04-03T03:38:28.719394+0000","last_unstale":"2024-04-03T05:10:08.996201+0000","last_undegraded":"2024-04-03T05:10:08.996201+0000","last_fullsized":"2024-04-03T05:10:08.996201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:06.496312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'307","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:17.854662+0000","last_change":"2024-04-03T03:38:30.822163+0000","last_active":"2024-04-03T05:12:17.854662+0000","last_peered":"2024-04-03T05:12:17.854662+0000","last_clean":"2024-04-03T05:12:17.854662+0000","last_became_active":"2024-04-03T03:38:30.821297+0000","last_became_peered":"2024-04-03T03:38:30.821297+0000","last_unstale":"2024-04-03T05:12:17.854662+0000","last_undegraded":"2024-04-03T05:12:17.854662+0000","last_fullsized":"2024-04-03T05:12:17.854662+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:12.866281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":386,"num_write":374,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'555","reported_seq":2684,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.914047+0000","last_change":"2024-04-03T03:38:32.748169+0000","last_active":"2024-04-03T05:14:09.914047+0000","last_peered":"2024-04-03T05:14:09.914047+0000","last_clean":"2024-04-03T05:14:09.914047+0000","last_became_active":"2024-04-03T03:38:32.747292+0000","last_became_peered":"2024-04-03T03:38:32.747292+0000","last_unstale":"2024-04-03T05:14:09.914047+0000","last_undegraded":"2024-04-03T05:14:09.914047+0000","last_fullsized":"2024-04-03T05:14:09.914047+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:43.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'90","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.050986+0000","last_change":"2024-04-03T03:38:34.936362+0000","last_active":"2024-04-03T05:13:28.050986+0000","last_peered":"2024-04-03T05:13:28.050986+0000","last_clean":"2024-04-03T05:13:28.050986+0000","last_became_active":"2024-04-03T03:38:34.935593+0000","last_became_peered":"2024-04-03T03:38:34.935593+0000","last_unstale":"2024-04-03T05:13:28.050986+0000","last_undegraded":"2024-04-03T05:13:28.050986+0000","last_fullsized":"2024-04-03T05:13:28.050986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:15.143724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":828,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":224,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'421","reported_seq":1889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:48.013119+0000","last_change":"2024-04-03T03:38:26.717074+0000","last_active":"2024-04-03T05:10:48.013119+0000","last_peered":"2024-04-03T05:10:48.013119+0000","last_clean":"2024-04-03T05:10:48.013119+0000","last_became_active":"2024-04-03T03:38:26.716004+0000","last_became_peered":"2024-04-03T03:38:26.716004+0000","last_unstale":"2024-04-03T05:10:48.013119+0000","last_undegraded":"2024-04-03T05:10:48.013119+0000","last_fullsized":"2024-04-03T05:10:48.013119+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:35.702121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":2164,"num_write":539,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'334","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.481047+0000","last_change":"2024-04-03T03:38:24.728339+0000","last_active":"2024-04-03T05:14:10.481047+0000","last_peered":"2024-04-03T05:14:10.481047+0000","last_clean":"2024-04-03T05:14:10.481047+0000","last_became_active":"2024-04-03T03:38:24.727736+0000","last_became_peered":"2024-04-03T03:38:24.727736+0000","last_unstale":"2024-04-03T05:14:10.481047+0000","last_undegraded":"2024-04-03T05:14:10.481047+0000","last_fullsized":"2024-04-03T05:14:10.481047+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:59:04.813514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262228,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":37309,"num_write":1217,"num_write_kb":23236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:22.843088+0000","last_change":"2024-04-03T03:38:11.613510+0000","last_active":"2024-04-03T05:11:22.843088+0000","last_peered":"2024-04-03T05:11:22.843088+0000","last_clean":"2024-04-03T05:11:22.843088+0000","last_became_active":"2024-04-03T03:38:11.613252+0000","last_became_peered":"2024-04-03T03:38:11.613252+0000","last_unstale":"2024-04-03T05:11:22.843088+0000","last_undegraded":"2024-04-03T05:11:22.843088+0000","last_fullsized":"2024-04-03T05:11:22.843088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:56:15.329216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.621550+0000","last_change":"2024-04-03T03:38:28.722584+0000","last_active":"2024-04-03T05:10:08.621550+0000","last_peered":"2024-04-03T05:10:08.621550+0000","last_clean":"2024-04-03T05:10:08.621550+0000","last_became_active":"2024-04-03T03:38:28.721796+0000","last_became_peered":"2024-04-03T03:38:28.721796+0000","last_unstale":"2024-04-03T05:10:08.621550+0000","last_undegraded":"2024-04-03T05:10:08.621550+0000","last_fullsized":"2024-04-03T05:10:08.621550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:50.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'166","reported_seq":755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.622863+0000","last_change":"2024-04-03T03:38:30.719677+0000","last_active":"2024-04-03T05:10:13.622863+0000","last_peered":"2024-04-03T05:10:13.622863+0000","last_clean":"2024-04-03T05:10:13.622863+0000","last_became_active":"2024-04-03T03:38:30.718913+0000","last_became_peered":"2024-04-03T03:38:30.718913+0000","last_unstale":"2024-04-03T05:10:13.622863+0000","last_undegraded":"2024-04-03T05:10:13.622863+0000","last_fullsized":"2024-04-03T05:10:13.622863+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:08:10.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":144,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'554","reported_seq":2670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.020847+0000","last_change":"2024-04-03T03:38:32.744373+0000","last_active":"2024-04-03T05:14:10.020847+0000","last_peered":"2024-04-03T05:14:10.020847+0000","last_clean":"2024-04-03T05:14:10.020847+0000","last_became_active":"2024-04-03T03:38:32.743829+0000","last_became_peered":"2024-04-03T03:38:32.743829+0000","last_unstale":"2024-04-03T05:14:10.020847+0000","last_undegraded":"2024-04-03T05:14:10.020847+0000","last_fullsized":"2024-04-03T05:14:10.020847+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:07:40.400539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'94","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.059107+0000","last_change":"2024-04-03T03:38:34.747164+0000","last_active":"2024-04-03T05:10:53.059107+0000","last_peered":"2024-04-03T05:10:53.059107+0000","last_clean":"2024-04-03T05:10:53.059107+0000","last_became_active":"2024-04-03T03:38:34.746249+0000","last_became_peered":"2024-04-03T03:38:34.746249+0000","last_unstale":"2024-04-03T05:10:53.059107+0000","last_undegraded":"2024-04-03T05:10:53.059107+0000","last_fullsized":"2024-04-03T05:10:53.059107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:25:14.477982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":217,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1105","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398899+0000","last_change":"2024-04-03T03:38:26.741936+0000","last_active":"2024-04-03T05:11:18.398899+0000","last_peered":"2024-04-03T05:11:18.398899+0000","last_clean":"2024-04-03T05:11:18.398899+0000","last_became_active":"2024-04-03T03:38:26.741272+0000","last_became_peered":"2024-04-03T03:38:26.741272+0000","last_unstale":"2024-04-03T05:11:18.398899+0000","last_undegraded":"2024-04-03T05:11:18.398899+0000","last_fullsized":"2024-04-03T05:11:18.398899+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:11:49.503834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4771,"num_read_kb":4189,"num_write":1521,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'320","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.526910+0000","last_change":"2024-04-03T03:38:24.747700+0000","last_active":"2024-04-03T05:14:10.526910+0000","last_peered":"2024-04-03T05:14:10.526910+0000","last_clean":"2024-04-03T05:14:10.526910+0000","last_became_active":"2024-04-03T03:38:24.747145+0000","last_became_peered":"2024-04-03T03:38:24.747145+0000","last_unstale":"2024-04-03T05:14:10.526910+0000","last_undegraded":"2024-04-03T05:14:10.526910+0000","last_fullsized":"2024-04-03T05:14:10.526910+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:03:58.509965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3601918,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":38174,"num_write":1065,"num_write_kb":41152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:24.012441+0000","last_change":"2024-04-03T03:38:11.618291+0000","last_active":"2024-04-03T05:11:24.012441+0000","last_peered":"2024-04-03T05:11:24.012441+0000","last_clean":"2024-04-03T05:11:24.012441+0000","last_became_active":"2024-04-03T03:38:11.617573+0000","last_became_peered":"2024-04-03T03:38:11.617573+0000","last_unstale":"2024-04-03T05:11:24.012441+0000","last_undegraded":"2024-04-03T05:11:24.012441+0000","last_fullsized":"2024-04-03T05:11:24.012441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:12:17.137777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:53.014435+0000","last_change":"2024-04-03T03:38:28.734000+0000","last_active":"2024-04-03T05:10:53.014435+0000","last_peered":"2024-04-03T05:10:53.014435+0000","last_clean":"2024-04-03T05:10:53.014435+0000","last_became_active":"2024-04-03T03:38:28.733237+0000","last_became_peered":"2024-04-03T03:38:28.733237+0000","last_unstale":"2024-04-03T05:10:53.014435+0000","last_undegraded":"2024-04-03T05:10:53.014435+0000","last_fullsized":"2024-04-03T05:10:53.014435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:17.938585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'796","reported_seq":1568,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.608601+0000","last_change":"2024-04-03T03:38:30.823414+0000","last_active":"2024-04-03T05:14:09.608601+0000","last_peered":"2024-04-03T05:14:09.608601+0000","last_clean":"2024-04-03T05:14:09.608601+0000","last_became_active":"2024-04-03T03:38:30.822610+0000","last_became_peered":"2024-04-03T03:38:30.822610+0000","last_unstale":"2024-04-03T05:14:09.608601+0000","last_undegraded":"2024-04-03T05:14:09.608601+0000","last_fullsized":"2024-04-03T05:14:09.608601+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:08:41.961174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1404,"num_read_kb":3337,"num_write":1132,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:13.004685+0000","last_change":"2024-04-03T03:38:32.729501+0000","last_active":"2024-04-03T05:10:13.004685+0000","last_peered":"2024-04-03T05:10:13.004685+0000","last_clean":"2024-04-03T05:10:13.004685+0000","last_became_active":"2024-04-03T03:38:32.728874+0000","last_became_peered":"2024-04-03T03:38:32.728874+0000","last_unstale":"2024-04-03T05:10:13.004685+0000","last_undegraded":"2024-04-03T05:10:13.004685+0000","last_fullsized":"2024-04-03T05:10:13.004685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:13:52.894350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'104","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.296042+0000","last_change":"2024-04-03T03:38:34.757708+0000","last_active":"2024-04-03T05:11:29.296042+0000","last_peered":"2024-04-03T05:11:29.296042+0000","last_clean":"2024-04-03T05:11:29.296042+0000","last_became_active":"2024-04-03T03:38:34.756936+0000","last_became_peered":"2024-04-03T03:38:34.756936+0000","last_unstale":"2024-04-03T05:11:29.296042+0000","last_undegraded":"2024-04-03T05:11:29.296042+0000","last_fullsized":"2024-04-03T05:11:29.296042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:39.973669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'144","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.051218+0000","last_change":"2024-04-03T03:38:34.760408+0000","last_active":"2024-04-03T05:10:18.051218+0000","last_peered":"2024-04-03T05:10:18.051218+0000","last_clean":"2024-04-03T05:10:18.051218+0000","last_became_active":"2024-04-03T03:38:34.759767+0000","last_became_peered":"2024-04-03T03:38:34.759767+0000","last_unstale":"2024-04-03T05:10:18.051218+0000","last_undegraded":"2024-04-03T05:10:18.051218+0000","last_fullsized":"2024-04-03T05:10:18.051218+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:27:11.459564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":108,"num_write":250,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'826","reported_seq":2402,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.643808+0000","last_change":"2024-04-03T03:38:26.741454+0000","last_active":"2024-04-03T05:11:48.643808+0000","last_peered":"2024-04-03T05:11:48.643808+0000","last_clean":"2024-04-03T05:11:48.643808+0000","last_became_active":"2024-04-03T03:38:26.740732+0000","last_became_peered":"2024-04-03T03:38:26.740732+0000","last_unstale":"2024-04-03T05:11:48.643808+0000","last_undegraded":"2024-04-03T05:11:48.643808+0000","last_fullsized":"2024-04-03T05:11:48.643808+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:13:26.379990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3680,"num_read_kb":3271,"num_write":1116,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'362","reported_seq":1129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.526505+0000","last_change":"2024-04-03T03:38:24.741664+0000","last_active":"2024-04-03T05:14:10.526505+0000","last_peered":"2024-04-03T05:14:10.526505+0000","last_clean":"2024-04-03T05:14:10.526505+0000","last_became_active":"2024-04-03T03:38:24.740900+0000","last_became_peered":"2024-04-03T03:38:24.740900+0000","last_unstale":"2024-04-03T05:14:10.526505+0000","last_undegraded":"2024-04-03T05:14:10.526505+0000","last_fullsized":"2024-04-03T05:14:10.526505+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:54:13.177313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100573,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":621,"num_read_kb":65764,"num_write":1260,"num_write_kb":26843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:52.849356+0000","last_change":"2024-04-03T03:38:28.725751+0000","last_active":"2024-04-03T05:11:52.849356+0000","last_peered":"2024-04-03T05:11:52.849356+0000","last_clean":"2024-04-03T05:11:52.849356+0000","last_became_active":"2024-04-03T03:38:28.725020+0000","last_became_peered":"2024-04-03T03:38:28.725020+0000","last_unstale":"2024-04-03T05:11:52.849356+0000","last_undegraded":"2024-04-03T05:11:52.849356+0000","last_fullsized":"2024-04-03T05:11:52.849356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:26:47.268104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'309","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.032366+0000","last_change":"2024-04-03T03:38:30.730341+0000","last_active":"2024-04-03T05:14:10.032366+0000","last_peered":"2024-04-03T05:14:10.032366+0000","last_clean":"2024-04-03T05:14:10.032366+0000","last_became_active":"2024-04-03T03:38:30.729608+0000","last_became_peered":"2024-04-03T03:38:30.729608+0000","last_unstale":"2024-04-03T05:14:10.032366+0000","last_undegraded":"2024-04-03T05:14:10.032366+0000","last_fullsized":"2024-04-03T05:14:10.032366+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:12:36.054464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":1071,"num_write":390,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:53.028730+0000","last_change":"2024-04-03T03:38:32.746511+0000","last_active":"2024-04-03T05:11:53.028730+0000","last_peered":"2024-04-03T05:11:53.028730+0000","last_clean":"2024-04-03T05:11:53.028730+0000","last_became_active":"2024-04-03T03:38:32.744256+0000","last_became_peered":"2024-04-03T03:38:32.744256+0000","last_unstale":"2024-04-03T05:11:53.028730+0000","last_undegraded":"2024-04-03T05:11:53.028730+0000","last_fullsized":"2024-04-03T05:11:53.028730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:40:51.923207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'108","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.015981+0000","last_change":"2024-04-03T03:38:34.737865+0000","last_active":"2024-04-03T05:10:58.015981+0000","last_peered":"2024-04-03T05:10:58.015981+0000","last_clean":"2024-04-03T05:10:58.015981+0000","last_became_active":"2024-04-03T03:38:34.736176+0000","last_became_peered":"2024-04-03T03:38:34.736176+0000","last_unstale":"2024-04-03T05:10:58.015981+0000","last_undegraded":"2024-04-03T05:10:58.015981+0000","last_fullsized":"2024-04-03T05:10:58.015981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:17:39.580695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":259,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'759","reported_seq":2571,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:47.848276+0000","last_change":"2024-04-03T03:38:26.720574+0000","last_active":"2024-04-03T05:11:47.848276+0000","last_peered":"2024-04-03T05:11:47.848276+0000","last_clean":"2024-04-03T05:11:47.848276+0000","last_became_active":"2024-04-03T03:38:26.720106+0000","last_became_peered":"2024-04-03T03:38:26.720106+0000","last_unstale":"2024-04-03T05:11:47.848276+0000","last_undegraded":"2024-04-03T05:11:47.848276+0000","last_fullsized":"2024-04-03T05:11:47.848276+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:10:18.194606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3508,"num_write":1155,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'344","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.533003+0000","last_change":"2024-04-03T03:38:57.883863+0000","last_active":"2024-04-03T05:14:10.533003+0000","last_peered":"2024-04-03T05:14:10.533003+0000","last_clean":"2024-04-03T05:14:10.533003+0000","last_became_active":"2024-04-03T03:38:57.882607+0000","last_became_peered":"2024-04-03T03:38:57.882607+0000","last_unstale":"2024-04-03T05:14:10.533003+0000","last_undegraded":"2024-04-03T05:14:10.533003+0000","last_fullsized":"2024-04-03T05:14:10.533003+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:06:53.732174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5935608,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":618,"num_read_kb":85965,"num_write":1280,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:53.028954+0000","last_change":"2024-04-03T03:38:28.723791+0000","last_active":"2024-04-03T05:11:53.028954+0000","last_peered":"2024-04-03T05:11:53.028954+0000","last_clean":"2024-04-03T05:11:53.028954+0000","last_became_active":"2024-04-03T03:38:28.723082+0000","last_became_peered":"2024-04-03T03:38:28.723082+0000","last_unstale":"2024-04-03T05:11:53.028954+0000","last_undegraded":"2024-04-03T05:11:53.028954+0000","last_fullsized":"2024-04-03T05:11:53.028954+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:47:02.690730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":594,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:53.072485+0000","last_change":"2024-04-03T03:38:30.730377+0000","last_active":"2024-04-03T05:11:53.072485+0000","last_peered":"2024-04-03T05:11:53.072485+0000","last_clean":"2024-04-03T05:11:53.072485+0000","last_became_active":"2024-04-03T03:38:30.729412+0000","last_became_peered":"2024-04-03T03:38:30.729412+0000","last_unstale":"2024-04-03T05:11:53.072485+0000","last_undegraded":"2024-04-03T05:11:53.072485+0000","last_fullsized":"2024-04-03T05:11:53.072485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:49:48.699386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":60,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:54.045658+0000","last_change":"2024-04-03T03:38:32.748751+0000","last_active":"2024-04-03T05:11:54.045658+0000","last_peered":"2024-04-03T05:11:54.045658+0000","last_clean":"2024-04-03T05:11:54.045658+0000","last_became_active":"2024-04-03T03:38:32.747294+0000","last_became_peered":"2024-04-03T03:38:32.747294+0000","last_unstale":"2024-04-03T05:11:54.045658+0000","last_undegraded":"2024-04-03T05:11:54.045658+0000","last_fullsized":"2024-04-03T05:11:54.045658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:27.522363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'97","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.062855+0000","last_change":"2024-04-03T03:38:34.739547+0000","last_active":"2024-04-03T05:11:08.062855+0000","last_peered":"2024-04-03T05:11:08.062855+0000","last_clean":"2024-04-03T05:11:08.062855+0000","last_became_active":"2024-04-03T03:38:34.737841+0000","last_became_peered":"2024-04-03T03:38:34.737841+0000","last_unstale":"2024-04-03T05:11:08.062855+0000","last_undegraded":"2024-04-03T05:11:08.062855+0000","last_fullsized":"2024-04-03T05:11:08.062855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:58:36.235149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":225,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'410","reported_seq":1864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.027664+0000","last_change":"2024-04-03T03:38:26.720039+0000","last_active":"2024-04-03T05:11:48.027664+0000","last_peered":"2024-04-03T05:11:48.027664+0000","last_clean":"2024-04-03T05:11:48.027664+0000","last_became_active":"2024-04-03T03:38:26.715716+0000","last_became_peered":"2024-04-03T03:38:26.715716+0000","last_unstale":"2024-04-03T05:11:48.027664+0000","last_undegraded":"2024-04-03T05:11:48.027664+0000","last_fullsized":"2024-04-03T05:11:48.027664+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:34.026023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2104,"num_read_kb":1969,"num_write":502,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'456","reported_seq":1141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.513059+0000","last_change":"2024-04-03T03:38:24.742857+0000","last_active":"2024-04-03T05:14:10.513059+0000","last_peered":"2024-04-03T05:14:10.513059+0000","last_clean":"2024-04-03T05:14:10.513059+0000","last_became_active":"2024-04-03T03:38:24.737281+0000","last_became_peered":"2024-04-03T03:38:24.737281+0000","last_unstale":"2024-04-03T05:14:10.513059+0000","last_undegraded":"2024-04-03T05:14:10.513059+0000","last_fullsized":"2024-04-03T05:14:10.513059+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:25:22.407147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448109,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":780,"num_read_kb":29467,"num_write":1404,"num_write_kb":33665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.044403+0000","last_change":"2024-04-03T03:38:28.735969+0000","last_active":"2024-04-03T05:11:49.044403+0000","last_peered":"2024-04-03T05:11:49.044403+0000","last_clean":"2024-04-03T05:11:49.044403+0000","last_became_active":"2024-04-03T03:38:28.735156+0000","last_became_peered":"2024-04-03T03:38:28.735156+0000","last_unstale":"2024-04-03T05:11:49.044403+0000","last_undegraded":"2024-04-03T05:11:49.044403+0000","last_fullsized":"2024-04-03T05:11:49.044403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:18:53.609411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'324","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.212473+0000","last_change":"2024-04-03T03:38:30.734504+0000","last_active":"2024-04-03T05:14:09.212473+0000","last_peered":"2024-04-03T05:14:09.212473+0000","last_clean":"2024-04-03T05:14:09.212473+0000","last_became_active":"2024-04-03T03:38:30.733682+0000","last_became_peered":"2024-04-03T03:38:30.733682+0000","last_unstale":"2024-04-03T05:14:09.212473+0000","last_undegraded":"2024-04-03T05:14:09.212473+0000","last_fullsized":"2024-04-03T05:14:09.212473+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:34:59.488858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42201,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1138,"num_write":422,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:54.018764+0000","last_change":"2024-04-03T03:38:32.734561+0000","last_active":"2024-04-03T05:11:54.018764+0000","last_peered":"2024-04-03T05:11:54.018764+0000","last_clean":"2024-04-03T05:11:54.018764+0000","last_became_active":"2024-04-03T03:38:32.733728+0000","last_became_peered":"2024-04-03T03:38:32.733728+0000","last_unstale":"2024-04-03T05:11:54.018764+0000","last_undegraded":"2024-04-03T05:11:54.018764+0000","last_fullsized":"2024-04-03T05:11:54.018764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:55:41.581847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'152","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.830070+0000","last_change":"2024-04-03T03:38:34.756727+0000","last_active":"2024-04-03T05:11:08.830070+0000","last_peered":"2024-04-03T05:11:08.830070+0000","last_clean":"2024-04-03T05:11:08.830070+0000","last_became_active":"2024-04-03T03:38:34.755929+0000","last_became_peered":"2024-04-03T03:38:34.755929+0000","last_unstale":"2024-04-03T05:11:08.830070+0000","last_undegraded":"2024-04-03T05:11:08.830070+0000","last_fullsized":"2024-04-03T05:11:08.830070+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:41.464119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":91,"num_write":329,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'735","reported_seq":2109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.027568+0000","last_change":"2024-04-03T03:38:26.724380+0000","last_active":"2024-04-03T05:11:48.027568+0000","last_peered":"2024-04-03T05:11:48.027568+0000","last_clean":"2024-04-03T05:11:48.027568+0000","last_became_active":"2024-04-03T03:38:26.723758+0000","last_became_peered":"2024-04-03T03:38:26.723758+0000","last_unstale":"2024-04-03T05:11:48.027568+0000","last_undegraded":"2024-04-03T05:11:48.027568+0000","last_fullsized":"2024-04-03T05:11:48.027568+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:31.930788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3210,"num_read_kb":2838,"num_write":998,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'347","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.565012+0000","last_change":"2024-04-03T03:38:24.740315+0000","last_active":"2024-04-03T05:14:10.565012+0000","last_peered":"2024-04-03T05:14:10.565012+0000","last_clean":"2024-04-03T05:14:10.565012+0000","last_became_active":"2024-04-03T03:38:24.739968+0000","last_became_peered":"2024-04-03T03:38:24.739968+0000","last_unstale":"2024-04-03T05:14:10.565012+0000","last_undegraded":"2024-04-03T05:14:10.565012+0000","last_fullsized":"2024-04-03T05:14:10.565012+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:36:09.717326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303204,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":602,"num_read_kb":31745,"num_write":1185,"num_write_kb":30139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:49.017719+0000","last_change":"2024-04-03T03:38:28.724693+0000","last_active":"2024-04-03T05:11:49.017719+0000","last_peered":"2024-04-03T05:11:49.017719+0000","last_clean":"2024-04-03T05:11:49.017719+0000","last_became_active":"2024-04-03T03:38:28.723907+0000","last_became_peered":"2024-04-03T03:38:28.723907+0000","last_unstale":"2024-04-03T05:11:49.017719+0000","last_undegraded":"2024-04-03T05:11:49.017719+0000","last_fullsized":"2024-04-03T05:11:49.017719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:13:05.741974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'313","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.935069+0000","last_change":"2024-04-03T03:38:30.733466+0000","last_active":"2024-04-03T05:14:08.935069+0000","last_peered":"2024-04-03T05:14:08.935069+0000","last_clean":"2024-04-03T05:14:08.935069+0000","last_became_active":"2024-04-03T03:38:30.732520+0000","last_became_peered":"2024-04-03T03:38:30.732520+0000","last_unstale":"2024-04-03T05:14:08.935069+0000","last_undegraded":"2024-04-03T05:14:08.935069+0000","last_fullsized":"2024-04-03T05:14:08.935069+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:53.671349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49780,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1180,"num_write":410,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:53.072570+0000","last_change":"2024-04-03T03:38:32.749555+0000","last_active":"2024-04-03T05:11:53.072570+0000","last_peered":"2024-04-03T05:11:53.072570+0000","last_clean":"2024-04-03T05:11:53.072570+0000","last_became_active":"2024-04-03T03:38:32.748621+0000","last_became_peered":"2024-04-03T03:38:32.748621+0000","last_unstale":"2024-04-03T05:11:53.072570+0000","last_undegraded":"2024-04-03T05:11:53.072570+0000","last_fullsized":"2024-04-03T05:11:53.072570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:14:00.976597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'375","reported_seq":2039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.276649+0000","last_change":"2024-04-03T03:38:26.714514+0000","last_active":"2024-04-03T05:11:29.276649+0000","last_peered":"2024-04-03T05:11:29.276649+0000","last_clean":"2024-04-03T05:11:29.276649+0000","last_became_active":"2024-04-03T03:38:26.711974+0000","last_became_peered":"2024-04-03T03:38:26.711974+0000","last_unstale":"2024-04-03T05:11:29.276649+0000","last_undegraded":"2024-04-03T05:11:29.276649+0000","last_fullsized":"2024-04-03T05:11:29.276649+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:02.940173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2240,"num_write":411,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'349","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.411719+0000","last_change":"2024-04-03T03:38:24.717991+0000","last_active":"2024-04-03T05:14:10.411719+0000","last_peered":"2024-04-03T05:14:10.411719+0000","last_clean":"2024-04-03T05:14:10.411719+0000","last_became_active":"2024-04-03T03:38:24.715050+0000","last_became_peered":"2024-04-03T03:38:24.715050+0000","last_unstale":"2024-04-03T05:14:10.411719+0000","last_undegraded":"2024-04-03T05:14:10.411719+0000","last_fullsized":"2024-04-03T05:14:10.411719+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:38:21.124593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6617705,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":464,"num_read_kb":21769,"num_write":1174,"num_write_kb":53575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.060528+0000","last_change":"2024-04-03T03:38:28.717346+0000","last_active":"2024-04-03T05:10:58.060528+0000","last_peered":"2024-04-03T05:10:58.060528+0000","last_clean":"2024-04-03T05:10:58.060528+0000","last_became_active":"2024-04-03T03:38:28.716638+0000","last_became_peered":"2024-04-03T03:38:28.716638+0000","last_unstale":"2024-04-03T05:10:58.060528+0000","last_undegraded":"2024-04-03T05:10:58.060528+0000","last_fullsized":"2024-04-03T05:10:58.060528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:43:16.450833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'509","reported_seq":1179,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.448510+0000","last_change":"2024-04-03T03:38:30.726825+0000","last_active":"2024-04-03T05:14:10.448510+0000","last_peered":"2024-04-03T05:14:10.448510+0000","last_clean":"2024-04-03T05:14:10.448510+0000","last_became_active":"2024-04-03T03:38:30.725324+0000","last_became_peered":"2024-04-03T03:38:30.725324+0000","last_unstale":"2024-04-03T05:14:10.448510+0000","last_undegraded":"2024-04-03T05:14:10.448510+0000","last_fullsized":"2024-04-03T05:14:10.448510+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:45:26.155940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":885,"num_read_kb":2163,"num_write":714,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.828908+0000","last_change":"2024-04-03T03:38:32.735911+0000","last_active":"2024-04-03T05:11:03.828908+0000","last_peered":"2024-04-03T05:11:03.828908+0000","last_clean":"2024-04-03T05:11:03.828908+0000","last_became_active":"2024-04-03T03:38:32.730456+0000","last_became_peered":"2024-04-03T03:38:32.730456+0000","last_unstale":"2024-04-03T05:11:03.828908+0000","last_undegraded":"2024-04-03T05:11:03.828908+0000","last_fullsized":"2024-04-03T05:11:03.828908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:36:50.012219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'158","reported_seq":688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.481133+0000","last_change":"2024-04-03T03:38:34.940007+0000","last_active":"2024-04-03T05:11:08.481133+0000","last_peered":"2024-04-03T05:11:08.481133+0000","last_clean":"2024-04-03T05:11:08.481133+0000","last_became_active":"2024-04-03T03:38:34.939244+0000","last_became_peered":"2024-04-03T03:38:34.939244+0000","last_unstale":"2024-04-03T05:11:08.481133+0000","last_undegraded":"2024-04-03T05:11:08.481133+0000","last_fullsized":"2024-04-03T05:11:08.481133+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:49:45.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":238,"num_write":361,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'563","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.118189+0000","last_change":"2024-04-03T03:38:26.723127+0000","last_active":"2024-04-03T05:13:59.118189+0000","last_peered":"2024-04-03T05:13:59.118189+0000","last_clean":"2024-04-03T05:13:59.118189+0000","last_became_active":"2024-04-03T03:38:26.718375+0000","last_became_peered":"2024-04-03T03:38:26.718375+0000","last_unstale":"2024-04-03T05:13:59.118189+0000","last_undegraded":"2024-04-03T05:13:59.118189+0000","last_fullsized":"2024-04-03T05:13:59.118189+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:58:09.941905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2911,"num_read_kb":2669,"num_write":774,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'320","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.540079+0000","last_change":"2024-04-03T03:38:24.730652+0000","last_active":"2024-04-03T05:14:10.540079+0000","last_peered":"2024-04-03T05:14:10.540079+0000","last_clean":"2024-04-03T05:14:10.540079+0000","last_became_active":"2024-04-03T03:38:24.730294+0000","last_became_peered":"2024-04-03T03:38:24.730294+0000","last_unstale":"2024-04-03T05:14:10.540079+0000","last_undegraded":"2024-04-03T05:14:10.540079+0000","last_fullsized":"2024-04-03T05:14:10.540079+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:53:27.113096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274297,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":474,"num_read_kb":62893,"num_write":1320,"num_write_kb":30207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:08.996314+0000","last_change":"2024-04-03T03:38:28.720598+0000","last_active":"2024-04-03T05:10:08.996314+0000","last_peered":"2024-04-03T05:10:08.996314+0000","last_clean":"2024-04-03T05:10:08.996314+0000","last_became_active":"2024-04-03T03:38:28.719692+0000","last_became_peered":"2024-04-03T03:38:28.719692+0000","last_unstale":"2024-04-03T05:10:08.996314+0000","last_undegraded":"2024-04-03T05:10:08.996314+0000","last_fullsized":"2024-04-03T05:10:08.996314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:13:36.700015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'337","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.032362+0000","last_change":"2024-04-03T03:38:30.733396+0000","last_active":"2024-04-03T05:14:09.032362+0000","last_peered":"2024-04-03T05:14:09.032362+0000","last_clean":"2024-04-03T05:14:09.032362+0000","last_became_active":"2024-04-03T03:38:30.732529+0000","last_became_peered":"2024-04-03T03:38:30.732529+0000","last_unstale":"2024-04-03T05:14:09.032362+0000","last_undegraded":"2024-04-03T05:14:09.032362+0000","last_fullsized":"2024-04-03T05:14:09.032362+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:08:35.143644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":563,"num_read_kb":1112,"num_write":458,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:02.838256+0000","last_change":"2024-04-03T03:38:32.735100+0000","last_active":"2024-04-03T05:11:02.838256+0000","last_peered":"2024-04-03T05:11:02.838256+0000","last_clean":"2024-04-03T05:11:02.838256+0000","last_became_active":"2024-04-03T03:38:32.731752+0000","last_became_peered":"2024-04-03T03:38:32.731752+0000","last_unstale":"2024-04-03T05:11:02.838256+0000","last_undegraded":"2024-04-03T05:11:02.838256+0000","last_fullsized":"2024-04-03T05:11:02.838256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:55:58.116294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'186","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.365316+0000","last_change":"2024-04-03T03:38:34.737380+0000","last_active":"2024-04-03T05:12:13.365316+0000","last_peered":"2024-04-03T05:12:13.365316+0000","last_clean":"2024-04-03T05:12:13.365316+0000","last_became_active":"2024-04-03T03:38:34.736663+0000","last_became_peered":"2024-04-03T03:38:34.736663+0000","last_unstale":"2024-04-03T05:12:13.365316+0000","last_undegraded":"2024-04-03T05:12:13.365316+0000","last_fullsized":"2024-04-03T05:12:13.365316+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:12:54.724658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":719,"num_read_kb":691,"num_write":524,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'751","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.015946+0000","last_change":"2024-04-03T03:38:26.711611+0000","last_active":"2024-04-03T05:10:58.015946+0000","last_peered":"2024-04-03T05:10:58.015946+0000","last_clean":"2024-04-03T05:10:58.015946+0000","last_became_active":"2024-04-03T03:38:26.711214+0000","last_became_peered":"2024-04-03T03:38:26.711214+0000","last_unstale":"2024-04-03T05:10:58.015946+0000","last_undegraded":"2024-04-03T05:10:58.015946+0000","last_fullsized":"2024-04-03T05:10:58.015946+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:14:42.035748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3543,"num_read_kb":3207,"num_write":983,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'300","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.556180+0000","last_change":"2024-04-03T03:38:24.761914+0000","last_active":"2024-04-03T05:14:10.556180+0000","last_peered":"2024-04-03T05:14:10.556180+0000","last_clean":"2024-04-03T05:14:10.556180+0000","last_became_active":"2024-04-03T03:38:24.761330+0000","last_became_peered":"2024-04-03T03:38:24.761330+0000","last_unstale":"2024-04-03T05:14:10.556180+0000","last_undegraded":"2024-04-03T05:14:10.556180+0000","last_fullsized":"2024-04-03T05:14:10.556180+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:38:35.443926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4626676,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":410,"num_read_kb":53466,"num_write":1122,"num_write_kb":35897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633284+0000","last_change":"2024-04-03T03:38:28.725003+0000","last_active":"2024-04-03T05:10:58.633284+0000","last_peered":"2024-04-03T05:10:58.633284+0000","last_clean":"2024-04-03T05:10:58.633284+0000","last_became_active":"2024-04-03T03:38:28.724296+0000","last_became_peered":"2024-04-03T03:38:28.724296+0000","last_unstale":"2024-04-03T05:10:58.633284+0000","last_undegraded":"2024-04-03T05:10:58.633284+0000","last_fullsized":"2024-04-03T05:10:58.633284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:51:03.993282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'308","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.317856+0000","last_change":"2024-04-03T03:38:30.822164+0000","last_active":"2024-04-03T05:14:10.317856+0000","last_peered":"2024-04-03T05:14:10.317856+0000","last_clean":"2024-04-03T05:14:10.317856+0000","last_became_active":"2024-04-03T03:38:30.821335+0000","last_became_peered":"2024-04-03T03:38:30.821335+0000","last_unstale":"2024-04-03T05:14:10.317856+0000","last_undegraded":"2024-04-03T05:14:10.317856+0000","last_fullsized":"2024-04-03T05:14:10.317856+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:51:04.303948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45080,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":1115,"num_write":402,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.836987+0000","last_change":"2024-04-03T03:38:32.731796+0000","last_active":"2024-04-03T05:10:57.836987+0000","last_peered":"2024-04-03T05:10:57.836987+0000","last_clean":"2024-04-03T05:10:57.836987+0000","last_became_active":"2024-04-03T03:38:32.730954+0000","last_became_peered":"2024-04-03T03:38:32.730954+0000","last_unstale":"2024-04-03T05:10:57.836987+0000","last_undegraded":"2024-04-03T05:10:57.836987+0000","last_fullsized":"2024-04-03T05:10:57.836987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:27:28.623155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'104","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.542084+0000","last_change":"2024-04-03T03:38:34.755793+0000","last_active":"2024-04-03T05:14:00.542084+0000","last_peered":"2024-04-03T05:14:00.542084+0000","last_clean":"2024-04-03T05:14:00.542084+0000","last_became_active":"2024-04-03T03:38:34.754544+0000","last_became_peered":"2024-04-03T03:38:34.754544+0000","last_unstale":"2024-04-03T05:14:00.542084+0000","last_undegraded":"2024-04-03T05:14:00.542084+0000","last_fullsized":"2024-04-03T05:14:00.542084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:02.640564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":262,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'316","reported_seq":1732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:57.824774+0000","last_change":"2024-04-03T03:38:26.721787+0000","last_active":"2024-04-03T05:10:57.824774+0000","last_peered":"2024-04-03T05:10:57.824774+0000","last_clean":"2024-04-03T05:10:57.824774+0000","last_became_active":"2024-04-03T03:38:26.720984+0000","last_became_peered":"2024-04-03T03:38:26.720984+0000","last_unstale":"2024-04-03T05:10:57.824774+0000","last_undegraded":"2024-04-03T05:10:57.824774+0000","last_fullsized":"2024-04-03T05:10:57.824774+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:26:13.345541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1783,"num_read_kb":1722,"num_write":353,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'374","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.504351+0000","last_change":"2024-04-03T03:38:24.745501+0000","last_active":"2024-04-03T05:14:10.504351+0000","last_peered":"2024-04-03T05:14:10.504351+0000","last_clean":"2024-04-03T05:14:10.504351+0000","last_became_active":"2024-04-03T03:38:24.745183+0000","last_became_peered":"2024-04-03T03:38:24.745183+0000","last_unstale":"2024-04-03T05:14:10.504351+0000","last_undegraded":"2024-04-03T05:14:10.504351+0000","last_fullsized":"2024-04-03T05:14:10.504351+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:07:38.812807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5733043,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":528,"num_read_kb":13372,"num_write":1290,"num_write_kb":33178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:02.838294+0000","last_change":"2024-04-03T03:38:28.711378+0000","last_active":"2024-04-03T05:11:02.838294+0000","last_peered":"2024-04-03T05:11:02.838294+0000","last_clean":"2024-04-03T05:11:02.838294+0000","last_became_active":"2024-04-03T03:38:28.710708+0000","last_became_peered":"2024-04-03T03:38:28.710708+0000","last_unstale":"2024-04-03T05:11:02.838294+0000","last_undegraded":"2024-04-03T05:11:02.838294+0000","last_fullsized":"2024-04-03T05:11:02.838294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:15:02.818218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'150","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.634475+0000","last_change":"2024-04-03T03:38:30.823215+0000","last_active":"2024-04-03T05:11:03.634475+0000","last_peered":"2024-04-03T05:11:03.634475+0000","last_clean":"2024-04-03T05:11:03.634475+0000","last_became_active":"2024-04-03T03:38:30.822452+0000","last_became_peered":"2024-04-03T03:38:30.822452+0000","last_unstale":"2024-04-03T05:11:03.634475+0000","last_undegraded":"2024-04-03T05:11:03.634475+0000","last_fullsized":"2024-04-03T05:11:03.634475+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:15:19.776214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":168,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'526","reported_seq":4605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.645098+0000","last_change":"2024-04-03T03:38:32.735340+0000","last_active":"2024-04-03T05:14:07.645098+0000","last_peered":"2024-04-03T05:14:07.645098+0000","last_clean":"2024-04-03T05:14:07.645098+0000","last_became_active":"2024-04-03T03:38:32.734617+0000","last_became_peered":"2024-04-03T03:38:32.734617+0000","last_unstale":"2024-04-03T05:14:07.645098+0000","last_undegraded":"2024-04-03T05:14:07.645098+0000","last_fullsized":"2024-04-03T05:14:07.645098+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:51:07.710407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'182","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:59.046748+0000","last_change":"2024-04-03T03:38:34.758091+0000","last_active":"2024-04-03T05:11:59.046748+0000","last_peered":"2024-04-03T05:11:59.046748+0000","last_clean":"2024-04-03T05:11:59.046748+0000","last_became_active":"2024-04-03T03:38:34.756694+0000","last_became_peered":"2024-04-03T03:38:34.756694+0000","last_unstale":"2024-04-03T05:11:59.046748+0000","last_undegraded":"2024-04-03T05:11:59.046748+0000","last_fullsized":"2024-04-03T05:11:59.046748+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:19:35.787478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":410,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'389","reported_seq":2026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.633205+0000","last_change":"2024-04-03T03:38:26.745973+0000","last_active":"2024-04-03T05:10:58.633205+0000","last_peered":"2024-04-03T05:10:58.633205+0000","last_clean":"2024-04-03T05:10:58.633205+0000","last_became_active":"2024-04-03T03:38:26.744905+0000","last_became_peered":"2024-04-03T03:38:26.744905+0000","last_unstale":"2024-04-03T05:10:58.633205+0000","last_undegraded":"2024-04-03T05:10:58.633205+0000","last_fullsized":"2024-04-03T05:10:58.633205+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:28:50.618771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2315,"num_read_kb":2222,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'372","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.526569+0000","last_change":"2024-04-03T03:38:58.351960+0000","last_active":"2024-04-03T05:14:10.526569+0000","last_peered":"2024-04-03T05:14:10.526569+0000","last_clean":"2024-04-03T05:14:10.526569+0000","last_became_active":"2024-04-03T03:38:58.350828+0000","last_became_peered":"2024-04-03T03:38:58.350828+0000","last_unstale":"2024-04-03T05:14:10.526569+0000","last_undegraded":"2024-04-03T05:14:10.526569+0000","last_fullsized":"2024-04-03T05:14:10.526569+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:36:44.987003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9469383,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":544,"num_read_kb":21295,"num_write":1304,"num_write_kb":30213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:59.033276+0000","last_change":"2024-04-03T03:38:28.727247+0000","last_active":"2024-04-03T05:10:59.033276+0000","last_peered":"2024-04-03T05:10:59.033276+0000","last_clean":"2024-04-03T05:10:59.033276+0000","last_became_active":"2024-04-03T03:38:28.726412+0000","last_became_peered":"2024-04-03T03:38:28.726412+0000","last_unstale":"2024-04-03T05:10:59.033276+0000","last_undegraded":"2024-04-03T05:10:59.033276+0000","last_fullsized":"2024-04-03T05:10:59.033276+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:55:21.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'377","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.822893+0000","last_change":"2024-04-03T03:38:30.722458+0000","last_active":"2024-04-03T05:14:07.822893+0000","last_peered":"2024-04-03T05:14:07.822893+0000","last_clean":"2024-04-03T05:14:07.822893+0000","last_became_active":"2024-04-03T03:38:30.721642+0000","last_became_peered":"2024-04-03T03:38:30.721642+0000","last_unstale":"2024-04-03T05:14:07.822893+0000","last_undegraded":"2024-04-03T05:14:07.822893+0000","last_fullsized":"2024-04-03T05:14:07.822893+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:55:24.375134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44870,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":590,"num_read_kb":1131,"num_write":454,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:23.052159+0000","last_change":"2024-04-03T03:38:32.740223+0000","last_active":"2024-04-03T05:10:23.052159+0000","last_peered":"2024-04-03T05:10:23.052159+0000","last_clean":"2024-04-03T05:10:23.052159+0000","last_became_active":"2024-04-03T03:38:32.739496+0000","last_became_peered":"2024-04-03T03:38:32.739496+0000","last_unstale":"2024-04-03T05:10:23.052159+0000","last_undegraded":"2024-04-03T05:10:23.052159+0000","last_fullsized":"2024-04-03T05:10:23.052159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:01:28.964739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'91","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:29.026574+0000","last_change":"2024-04-03T03:38:34.751547+0000","last_active":"2024-04-03T05:10:29.026574+0000","last_peered":"2024-04-03T05:10:29.026574+0000","last_clean":"2024-04-03T05:10:29.026574+0000","last_became_active":"2024-04-03T03:38:34.751005+0000","last_became_peered":"2024-04-03T03:38:34.751005+0000","last_unstale":"2024-04-03T05:10:29.026574+0000","last_undegraded":"2024-04-03T05:10:29.026574+0000","last_fullsized":"2024-04-03T05:10:29.026574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:21.830655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":214,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'780","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:08.458352+0000","last_change":"2024-04-03T03:38:26.745971+0000","last_active":"2024-04-03T05:11:08.458352+0000","last_peered":"2024-04-03T05:11:08.458352+0000","last_clean":"2024-04-03T05:11:08.458352+0000","last_became_active":"2024-04-03T03:38:26.745135+0000","last_became_peered":"2024-04-03T03:38:26.745135+0000","last_unstale":"2024-04-03T05:11:08.458352+0000","last_undegraded":"2024-04-03T05:11:08.458352+0000","last_fullsized":"2024-04-03T05:11:08.458352+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:10.552726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3471,"num_read_kb":3079,"num_write":1070,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'292","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.569591+0000","last_change":"2024-04-03T03:38:24.744318+0000","last_active":"2024-04-03T05:14:10.569591+0000","last_peered":"2024-04-03T05:14:10.569591+0000","last_clean":"2024-04-03T05:14:10.569591+0000","last_became_active":"2024-04-03T03:38:24.743710+0000","last_became_peered":"2024-04-03T03:38:24.743710+0000","last_unstale":"2024-04-03T05:14:10.569591+0000","last_undegraded":"2024-04-03T05:14:10.569591+0000","last_fullsized":"2024-04-03T05:14:10.569591+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:21.325257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":414,"num_read_kb":32346,"num_write":1024,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:58.827699+0000","last_change":"2024-04-03T03:38:28.732955+0000","last_active":"2024-04-03T05:10:58.827699+0000","last_peered":"2024-04-03T05:10:58.827699+0000","last_clean":"2024-04-03T05:10:58.827699+0000","last_became_active":"2024-04-03T03:38:28.731547+0000","last_became_peered":"2024-04-03T03:38:28.731547+0000","last_unstale":"2024-04-03T05:10:58.827699+0000","last_undegraded":"2024-04-03T05:10:58.827699+0000","last_fullsized":"2024-04-03T05:10:58.827699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:15:17.819800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'314","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.941454+0000","last_change":"2024-04-03T03:38:30.733183+0000","last_active":"2024-04-03T05:14:07.941454+0000","last_peered":"2024-04-03T05:14:07.941454+0000","last_clean":"2024-04-03T05:14:07.941454+0000","last_became_active":"2024-04-03T03:38:30.732095+0000","last_became_peered":"2024-04-03T03:38:30.732095+0000","last_unstale":"2024-04-03T05:14:07.941454+0000","last_undegraded":"2024-04-03T05:14:07.941454+0000","last_fullsized":"2024-04-03T05:14:07.941454+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:12:09.905056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1184,"num_write":416,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:44.003351+0000","last_change":"2024-04-03T03:38:32.744744+0000","last_active":"2024-04-03T05:10:44.003351+0000","last_peered":"2024-04-03T05:10:44.003351+0000","last_clean":"2024-04-03T05:10:44.003351+0000","last_became_active":"2024-04-03T03:38:32.743994+0000","last_became_peered":"2024-04-03T03:38:32.743994+0000","last_unstale":"2024-04-03T05:10:44.003351+0000","last_undegraded":"2024-04-03T05:10:44.003351+0000","last_fullsized":"2024-04-03T05:10:44.003351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:21:04.554872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'88","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:28.008492+0000","last_change":"2024-04-03T03:38:34.942097+0000","last_active":"2024-04-03T05:10:28.008492+0000","last_peered":"2024-04-03T05:10:28.008492+0000","last_clean":"2024-04-03T05:10:28.008492+0000","last_became_active":"2024-04-03T03:38:34.941122+0000","last_became_peered":"2024-04-03T03:38:34.941122+0000","last_unstale":"2024-04-03T05:10:28.008492+0000","last_undegraded":"2024-04-03T05:10:28.008492+0000","last_fullsized":"2024-04-03T05:10:28.008492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:35:17.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'825","reported_seq":2457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218515+0000","last_change":"2024-04-03T03:38:26.713100+0000","last_active":"2024-04-03T05:12:22.218515+0000","last_peered":"2024-04-03T05:12:22.218515+0000","last_clean":"2024-04-03T05:12:22.218515+0000","last_became_active":"2024-04-03T03:38:26.710804+0000","last_became_peered":"2024-04-03T03:38:26.710804+0000","last_unstale":"2024-04-03T05:12:22.218515+0000","last_undegraded":"2024-04-03T05:12:22.218515+0000","last_fullsized":"2024-04-03T05:12:22.218515+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:56:46.565815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3882,"num_read_kb":3472,"num_write":1106,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'370","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.554303+0000","last_change":"2024-04-03T03:38:24.727210+0000","last_active":"2024-04-03T05:14:10.554303+0000","last_peered":"2024-04-03T05:14:10.554303+0000","last_clean":"2024-04-03T05:14:10.554303+0000","last_became_active":"2024-04-03T03:38:24.726765+0000","last_became_peered":"2024-04-03T03:38:24.726765+0000","last_unstale":"2024-04-03T05:14:10.554303+0000","last_undegraded":"2024-04-03T05:14:10.554303+0000","last_fullsized":"2024-04-03T05:14:10.554303+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:44:40.435859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975468,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":544,"num_read_kb":31092,"num_write":1278,"num_write_kb":58109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.623953+0000","last_change":"2024-04-03T03:38:28.725916+0000","last_active":"2024-04-03T05:10:18.623953+0000","last_peered":"2024-04-03T05:10:18.623953+0000","last_clean":"2024-04-03T05:10:18.623953+0000","last_became_active":"2024-04-03T03:38:28.725139+0000","last_became_peered":"2024-04-03T03:38:28.725139+0000","last_unstale":"2024-04-03T05:10:18.623953+0000","last_undegraded":"2024-04-03T05:10:18.623953+0000","last_fullsized":"2024-04-03T05:10:18.623953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:05:50.849970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'259","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.188674+0000","last_change":"2024-04-03T03:38:30.721488+0000","last_active":"2024-04-03T05:14:10.188674+0000","last_peered":"2024-04-03T05:14:10.188674+0000","last_clean":"2024-04-03T05:14:10.188674+0000","last_became_active":"2024-04-03T03:38:30.719983+0000","last_became_peered":"2024-04-03T03:38:30.719983+0000","last_unstale":"2024-04-03T05:14:10.188674+0000","last_undegraded":"2024-04-03T05:14:10.188674+0000","last_fullsized":"2024-04-03T05:14:10.188674+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:30:54.735121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46477,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":1098,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.634346+0000","last_change":"2024-04-03T03:38:32.729151+0000","last_active":"2024-04-03T05:11:03.634346+0000","last_peered":"2024-04-03T05:11:03.634346+0000","last_clean":"2024-04-03T05:11:03.634346+0000","last_became_active":"2024-04-03T03:38:32.728438+0000","last_became_peered":"2024-04-03T03:38:32.728438+0000","last_unstale":"2024-04-03T05:11:03.634346+0000","last_undegraded":"2024-04-03T05:11:03.634346+0000","last_fullsized":"2024-04-03T05:11:03.634346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T04:14:01.189190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'136","reported_seq":1179,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:13.956146+0000","last_change":"2024-04-03T03:38:34.749288+0000","last_active":"2024-04-03T05:12:13.956146+0000","last_peered":"2024-04-03T05:12:13.956146+0000","last_clean":"2024-04-03T05:12:13.956146+0000","last_became_active":"2024-04-03T03:38:34.748329+0000","last_became_peered":"2024-04-03T03:38:34.748329+0000","last_unstale":"2024-04-03T05:12:13.956146+0000","last_undegraded":"2024-04-03T05:12:13.956146+0000","last_fullsized":"2024-04-03T05:12:13.956146+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:59:32.495711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":680,"num_read_kb":679,"num_write":303,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'715","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:18.623993+0000","last_change":"2024-04-03T03:38:26.746139+0000","last_active":"2024-04-03T05:10:18.623993+0000","last_peered":"2024-04-03T05:10:18.623993+0000","last_clean":"2024-04-03T05:10:18.623993+0000","last_became_active":"2024-04-03T03:38:26.742044+0000","last_became_peered":"2024-04-03T03:38:26.742044+0000","last_unstale":"2024-04-03T05:10:18.623993+0000","last_undegraded":"2024-04-03T05:10:18.623993+0000","last_fullsized":"2024-04-03T05:10:18.623993+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:54:05.286590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3199,"num_read_kb":2853,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'338","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.561258+0000","last_change":"2024-04-03T03:38:24.741033+0000","last_active":"2024-04-03T05:14:10.561258+0000","last_peered":"2024-04-03T05:14:10.561258+0000","last_clean":"2024-04-03T05:14:10.561258+0000","last_became_active":"2024-04-03T03:38:24.740329+0000","last_became_peered":"2024-04-03T03:38:24.740329+0000","last_unstale":"2024-04-03T05:14:10.561258+0000","last_undegraded":"2024-04-03T05:14:10.561258+0000","last_fullsized":"2024-04-03T05:14:10.561258+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:21.254706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050233,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":56728,"num_write":1264,"num_write_kb":35698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:47.830115+0000","last_change":"2024-04-03T03:38:28.726028+0000","last_active":"2024-04-03T05:10:47.830115+0000","last_peered":"2024-04-03T05:10:47.830115+0000","last_clean":"2024-04-03T05:10:47.830115+0000","last_became_active":"2024-04-03T03:38:28.725225+0000","last_became_peered":"2024-04-03T03:38:28.725225+0000","last_unstale":"2024-04-03T05:10:47.830115+0000","last_undegraded":"2024-04-03T05:10:47.830115+0000","last_fullsized":"2024-04-03T05:10:47.830115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:50:16.486831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'333","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.378093+0000","last_change":"2024-04-03T03:38:30.718060+0000","last_active":"2024-04-03T05:14:10.378093+0000","last_peered":"2024-04-03T05:14:10.378093+0000","last_clean":"2024-04-03T05:14:10.378093+0000","last_became_active":"2024-04-03T03:38:30.717323+0000","last_became_peered":"2024-04-03T03:38:30.717323+0000","last_unstale":"2024-04-03T05:14:10.378093+0000","last_undegraded":"2024-04-03T05:14:10.378093+0000","last_fullsized":"2024-04-03T05:14:10.378093+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:07:23.819748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41938,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1119,"num_write":416,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:03.061582+0000","last_change":"2024-04-03T03:38:32.743866+0000","last_active":"2024-04-03T05:11:03.061582+0000","last_peered":"2024-04-03T05:11:03.061582+0000","last_clean":"2024-04-03T05:11:03.061582+0000","last_became_active":"2024-04-03T03:38:32.743076+0000","last_became_peered":"2024-04-03T03:38:32.743076+0000","last_unstale":"2024-04-03T05:11:03.061582+0000","last_undegraded":"2024-04-03T05:11:03.061582+0000","last_fullsized":"2024-04-03T05:11:03.061582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:28:25.384912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'76","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.102158+0000","last_change":"2024-04-03T03:38:34.750455+0000","last_active":"2024-04-03T05:13:59.102158+0000","last_peered":"2024-04-03T05:13:59.102158+0000","last_clean":"2024-04-03T05:13:59.102158+0000","last_became_active":"2024-04-03T03:38:34.749644+0000","last_became_peered":"2024-04-03T03:38:34.749644+0000","last_unstale":"2024-04-03T05:13:59.102158+0000","last_undegraded":"2024-04-03T05:13:59.102158+0000","last_fullsized":"2024-04-03T05:13:59.102158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:17.219887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":90,"num_write":191,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'754","reported_seq":2410,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846312+0000","last_change":"2024-04-03T03:38:26.722653+0000","last_active":"2024-04-03T05:11:37.846312+0000","last_peered":"2024-04-03T05:11:37.846312+0000","last_clean":"2024-04-03T05:11:37.846312+0000","last_became_active":"2024-04-03T03:38:26.721951+0000","last_became_peered":"2024-04-03T03:38:26.721951+0000","last_unstale":"2024-04-03T05:11:37.846312+0000","last_undegraded":"2024-04-03T05:11:37.846312+0000","last_fullsized":"2024-04-03T05:11:37.846312+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:14:23.340976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3698,"num_read_kb":3347,"num_write":1000,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'304","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.533325+0000","last_change":"2024-04-03T03:38:24.742187+0000","last_active":"2024-04-03T05:14:10.533325+0000","last_peered":"2024-04-03T05:14:10.533325+0000","last_clean":"2024-04-03T05:14:10.533325+0000","last_became_active":"2024-04-03T03:38:24.741407+0000","last_became_peered":"2024-04-03T03:38:24.741407+0000","last_unstale":"2024-04-03T05:14:10.533325+0000","last_undegraded":"2024-04-03T05:14:10.533325+0000","last_fullsized":"2024-04-03T05:14:10.533325+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:44:29.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":24965,"num_write":1150,"num_write_kb":36078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1406","reported_seq":2747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846282+0000","last_change":"2024-04-03T03:38:26.719813+0000","last_active":"2024-04-03T05:11:37.846282+0000","last_peered":"2024-04-03T05:11:37.846282+0000","last_clean":"2024-04-03T05:11:37.846282+0000","last_became_active":"2024-04-03T03:38:26.719386+0000","last_became_peered":"2024-04-03T03:38:26.719386+0000","last_unstale":"2024-04-03T05:11:37.846282+0000","last_undegraded":"2024-04-03T05:11:37.846282+0000","last_fullsized":"2024-04-03T05:11:37.846282+0000","mapping_epoch":25,"log_start":"263'1300","ondisk_log_start":"263'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:39:04.440314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5587,"num_read_kb":4776,"num_write":2003,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'265","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.438379+0000","last_change":"2024-04-03T03:38:24.748771+0000","last_active":"2024-04-03T05:14:10.438379+0000","last_peered":"2024-04-03T05:14:10.438379+0000","last_clean":"2024-04-03T05:14:10.438379+0000","last_became_active":"2024-04-03T03:38:24.748369+0000","last_became_peered":"2024-04-03T03:38:24.748369+0000","last_unstale":"2024-04-03T05:14:10.438379+0000","last_undegraded":"2024-04-03T05:14:10.438379+0000","last_fullsized":"2024-04-03T05:14:10.438379+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:30:39.474530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050494,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":45141,"num_write":1016,"num_write_kb":24649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'761","reported_seq":2384,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:38.836588+0000","last_change":"2024-04-03T03:38:26.715097+0000","last_active":"2024-04-03T05:11:38.836588+0000","last_peered":"2024-04-03T05:11:38.836588+0000","last_clean":"2024-04-03T05:11:38.836588+0000","last_became_active":"2024-04-03T03:38:26.713821+0000","last_became_peered":"2024-04-03T03:38:26.713821+0000","last_unstale":"2024-04-03T05:11:38.836588+0000","last_undegraded":"2024-04-03T05:11:38.836588+0000","last_fullsized":"2024-04-03T05:11:38.836588+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:02:25.387554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3127,"num_write":983,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'367","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.548239+0000","last_change":"2024-04-03T03:38:24.741935+0000","last_active":"2024-04-03T05:14:10.548239+0000","last_peered":"2024-04-03T05:14:10.548239+0000","last_clean":"2024-04-03T05:14:10.548239+0000","last_became_active":"2024-04-03T03:38:24.741322+0000","last_became_peered":"2024-04-03T03:38:24.741322+0000","last_unstale":"2024-04-03T05:14:10.548239+0000","last_undegraded":"2024-04-03T05:14:10.548239+0000","last_fullsized":"2024-04-03T05:14:10.548239+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:47.935999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":110805,"num_write":1222,"num_write_kb":46785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'793","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:37.846165+0000","last_change":"2024-04-03T03:38:26.719415+0000","last_active":"2024-04-03T05:11:37.846165+0000","last_peered":"2024-04-03T05:11:37.846165+0000","last_clean":"2024-04-03T05:11:37.846165+0000","last_became_active":"2024-04-03T03:38:26.718895+0000","last_became_peered":"2024-04-03T03:38:26.718895+0000","last_unstale":"2024-04-03T05:11:37.846165+0000","last_undegraded":"2024-04-03T05:11:37.846165+0000","last_fullsized":"2024-04-03T05:11:37.846165+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:06:38.311692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3511,"num_read_kb":3115,"num_write":1065,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'355","reported_seq":1137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.439468+0000","last_change":"2024-04-03T03:38:58.351583+0000","last_active":"2024-04-03T05:14:10.439468+0000","last_peered":"2024-04-03T05:14:10.439468+0000","last_clean":"2024-04-03T05:14:10.439468+0000","last_became_active":"2024-04-03T03:38:58.349944+0000","last_became_peered":"2024-04-03T03:38:58.349944+0000","last_unstale":"2024-04-03T05:14:10.439468+0000","last_undegraded":"2024-04-03T05:14:10.439468+0000","last_fullsized":"2024-04-03T05:14:10.439468+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:01.822490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":861,"num_read_kb":89019,"num_write":1362,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1190","reported_seq":2755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218508+0000","last_change":"2024-04-03T03:38:26.715473+0000","last_active":"2024-04-03T05:12:22.218508+0000","last_peered":"2024-04-03T05:12:22.218508+0000","last_clean":"2024-04-03T05:12:22.218508+0000","last_became_active":"2024-04-03T03:38:26.715042+0000","last_became_peered":"2024-04-03T03:38:26.715042+0000","last_unstale":"2024-04-03T05:12:22.218508+0000","last_undegraded":"2024-04-03T05:12:22.218508+0000","last_fullsized":"2024-04-03T05:12:22.218508+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:00.347535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5057,"num_read_kb":4409,"num_write":1655,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'301","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.563981+0000","last_change":"2024-04-03T03:38:58.351316+0000","last_active":"2024-04-03T05:14:10.563981+0000","last_peered":"2024-04-03T05:14:10.563981+0000","last_clean":"2024-04-03T05:14:10.563981+0000","last_became_active":"2024-04-03T03:38:58.350321+0000","last_became_peered":"2024-04-03T03:38:58.350321+0000","last_unstale":"2024-04-03T05:14:10.563981+0000","last_undegraded":"2024-04-03T05:14:10.563981+0000","last_fullsized":"2024-04-03T05:14:10.563981+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:29:08.087215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550052,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":66631,"num_write":1085,"num_write_kb":28536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'742","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.398107+0000","last_change":"2024-04-03T03:38:26.745737+0000","last_active":"2024-04-03T05:11:18.398107+0000","last_peered":"2024-04-03T05:11:18.398107+0000","last_clean":"2024-04-03T05:11:18.398107+0000","last_became_active":"2024-04-03T03:38:26.744330+0000","last_became_peered":"2024-04-03T03:38:26.744330+0000","last_unstale":"2024-04-03T05:11:18.398107+0000","last_undegraded":"2024-04-03T05:11:18.398107+0000","last_fullsized":"2024-04-03T05:11:18.398107+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:18:51.864453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3386,"num_read_kb":3032,"num_write":1008,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'326","reported_seq":1006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.554050+0000","last_change":"2024-04-03T03:38:24.708018+0000","last_active":"2024-04-03T05:14:10.554050+0000","last_peered":"2024-04-03T05:14:10.554050+0000","last_clean":"2024-04-03T05:14:10.554050+0000","last_became_active":"2024-04-03T03:38:24.707626+0000","last_became_peered":"2024-04-03T03:38:24.707626+0000","last_unstale":"2024-04-03T05:14:10.554050+0000","last_undegraded":"2024-04-03T05:14:10.554050+0000","last_fullsized":"2024-04-03T05:14:10.554050+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:55:34.304671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":9991,"num_write":1303,"num_write_kb":25388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'423","reported_seq":1811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:55.229419+0000","last_change":"2024-04-03T03:38:26.726283+0000","last_active":"2024-04-03T05:10:55.229419+0000","last_peered":"2024-04-03T05:10:55.229419+0000","last_clean":"2024-04-03T05:10:55.229419+0000","last_became_active":"2024-04-03T03:38:26.725513+0000","last_became_peered":"2024-04-03T03:38:26.725513+0000","last_unstale":"2024-04-03T05:10:55.229419+0000","last_undegraded":"2024-04-03T05:10:55.229419+0000","last_fullsized":"2024-04-03T05:10:55.229419+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:40:24.269906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2235,"num_read_kb":2034,"num_write":556,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'284","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.533300+0000","last_change":"2024-04-03T03:38:24.749614+0000","last_active":"2024-04-03T05:14:10.533300+0000","last_peered":"2024-04-03T05:14:10.533300+0000","last_clean":"2024-04-03T05:14:10.533300+0000","last_became_active":"2024-04-03T03:38:24.748923+0000","last_became_peered":"2024-04-03T03:38:24.748923+0000","last_unstale":"2024-04-03T05:14:10.533300+0000","last_undegraded":"2024-04-03T05:14:10.533300+0000","last_fullsized":"2024-04-03T05:14:10.533300+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:57.601061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306678,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":42672,"num_write":1032,"num_write_kb":23960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'702","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:18.401427+0000","last_change":"2024-04-03T03:38:26.717032+0000","last_active":"2024-04-03T05:11:18.401427+0000","last_peered":"2024-04-03T05:11:18.401427+0000","last_clean":"2024-04-03T05:11:18.401427+0000","last_became_active":"2024-04-03T03:38:26.716359+0000","last_became_peered":"2024-04-03T03:38:26.716359+0000","last_unstale":"2024-04-03T05:11:18.401427+0000","last_undegraded":"2024-04-03T05:11:18.401427+0000","last_fullsized":"2024-04-03T05:11:18.401427+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:50:51.526153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3142,"num_read_kb":2808,"num_write":934,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'337","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.565051+0000","last_change":"2024-04-03T03:38:24.718541+0000","last_active":"2024-04-03T05:14:10.565051+0000","last_peered":"2024-04-03T05:14:10.565051+0000","last_clean":"2024-04-03T05:14:10.565051+0000","last_became_active":"2024-04-03T03:38:24.716473+0000","last_became_peered":"2024-04-03T03:38:24.716473+0000","last_unstale":"2024-04-03T05:14:10.565051+0000","last_undegraded":"2024-04-03T05:14:10.565051+0000","last_fullsized":"2024-04-03T05:14:10.565051+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:02.325821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3764519,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":31436,"num_write":1237,"num_write_kb":38562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'397","reported_seq":1846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:48.071686+0000","last_change":"2024-04-03T03:38:26.717644+0000","last_active":"2024-04-03T05:11:48.071686+0000","last_peered":"2024-04-03T05:11:48.071686+0000","last_clean":"2024-04-03T05:11:48.071686+0000","last_became_active":"2024-04-03T03:38:26.716435+0000","last_became_peered":"2024-04-03T03:38:26.716435+0000","last_unstale":"2024-04-03T05:11:48.071686+0000","last_undegraded":"2024-04-03T05:11:48.071686+0000","last_fullsized":"2024-04-03T05:11:48.071686+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:50.500650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2146,"num_read_kb":2018,"num_write":509,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'422","reported_seq":1219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.464228+0000","last_change":"2024-04-03T03:38:24.741361+0000","last_active":"2024-04-03T05:14:10.464228+0000","last_peered":"2024-04-03T05:14:10.464228+0000","last_clean":"2024-04-03T05:14:10.464228+0000","last_became_active":"2024-04-03T03:38:24.740664+0000","last_became_peered":"2024-04-03T03:38:24.740664+0000","last_unstale":"2024-04-03T05:14:10.464228+0000","last_undegraded":"2024-04-03T05:14:10.464228+0000","last_fullsized":"2024-04-03T05:14:10.464228+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:01:10.065790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10717012,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":923,"num_read_kb":68467,"num_write":1504,"num_write_kb":54703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'407","reported_seq":1976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193909+0000","last_change":"2024-04-03T03:38:26.752206+0000","last_active":"2024-04-03T05:13:59.193909+0000","last_peered":"2024-04-03T05:13:59.193909+0000","last_clean":"2024-04-03T05:13:59.193909+0000","last_became_active":"2024-04-03T03:38:26.751399+0000","last_became_peered":"2024-04-03T03:38:26.751399+0000","last_unstale":"2024-04-03T05:13:59.193909+0000","last_undegraded":"2024-04-03T05:13:59.193909+0000","last_fullsized":"2024-04-03T05:13:59.193909+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T03:42:54.446617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2116,"num_write":486,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'294","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.530285+0000","last_change":"2024-04-03T03:38:24.718194+0000","last_active":"2024-04-03T05:14:10.530285+0000","last_peered":"2024-04-03T05:14:10.530285+0000","last_clean":"2024-04-03T05:14:10.530285+0000","last_became_active":"2024-04-03T03:38:24.715106+0000","last_became_peered":"2024-04-03T03:38:24.715106+0000","last_unstale":"2024-04-03T05:14:10.530285+0000","last_undegraded":"2024-04-03T05:14:10.530285+0000","last_fullsized":"2024-04-03T05:14:10.530285+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:03:49.995783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642458,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":15103,"num_write":965,"num_write_kb":22507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'628","reported_seq":2277,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.106774+0000","last_change":"2024-04-03T03:38:26.717354+0000","last_active":"2024-04-03T05:13:59.106774+0000","last_peered":"2024-04-03T05:13:59.106774+0000","last_clean":"2024-04-03T05:13:59.106774+0000","last_became_active":"2024-04-03T03:38:26.717085+0000","last_became_peered":"2024-04-03T03:38:26.717085+0000","last_unstale":"2024-04-03T05:13:59.106774+0000","last_undegraded":"2024-04-03T05:13:59.106774+0000","last_fullsized":"2024-04-03T05:13:59.106774+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:36:56.981338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3119,"num_read_kb":2815,"num_write":838,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'344","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.539886+0000","last_change":"2024-04-03T03:38:24.755928+0000","last_active":"2024-04-03T05:14:10.539886+0000","last_peered":"2024-04-03T05:14:10.539886+0000","last_clean":"2024-04-03T05:14:10.539886+0000","last_became_active":"2024-04-03T03:38:24.755345+0000","last_became_peered":"2024-04-03T03:38:24.755345+0000","last_unstale":"2024-04-03T05:14:10.539886+0000","last_undegraded":"2024-04-03T05:14:10.539886+0000","last_fullsized":"2024-04-03T05:14:10.539886+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:17:46.705832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194329,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":14159,"num_write":1284,"num_write_kb":40251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'700","reported_seq":2138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.221367+0000","last_change":"2024-04-03T03:38:26.746104+0000","last_active":"2024-04-03T05:12:22.221367+0000","last_peered":"2024-04-03T05:12:22.221367+0000","last_clean":"2024-04-03T05:12:22.221367+0000","last_became_active":"2024-04-03T03:38:26.745102+0000","last_became_peered":"2024-04-03T03:38:26.745102+0000","last_unstale":"2024-04-03T05:12:22.221367+0000","last_undegraded":"2024-04-03T05:12:22.221367+0000","last_fullsized":"2024-04-03T05:12:22.221367+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:54:13.112805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3146,"num_read_kb":2819,"num_write":922,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'360","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.522120+0000","last_change":"2024-04-03T03:38:24.729779+0000","last_active":"2024-04-03T05:14:10.522120+0000","last_peered":"2024-04-03T05:14:10.522120+0000","last_clean":"2024-04-03T05:14:10.522120+0000","last_became_active":"2024-04-03T03:38:24.729149+0000","last_became_peered":"2024-04-03T03:38:24.729149+0000","last_unstale":"2024-04-03T05:14:10.522120+0000","last_undegraded":"2024-04-03T05:14:10.522120+0000","last_fullsized":"2024-04-03T05:14:10.522120+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:44:06.201753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3498280,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":538,"num_read_kb":15990,"num_write":1205,"num_write_kb":30672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'376","reported_seq":1992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:44.029877+0000","last_change":"2024-04-03T03:38:26.714537+0000","last_active":"2024-04-03T05:10:44.029877+0000","last_peered":"2024-04-03T05:10:44.029877+0000","last_clean":"2024-04-03T05:10:44.029877+0000","last_became_active":"2024-04-03T03:38:26.713796+0000","last_became_peered":"2024-04-03T03:38:26.713796+0000","last_unstale":"2024-04-03T05:10:44.029877+0000","last_undegraded":"2024-04-03T05:10:44.029877+0000","last_fullsized":"2024-04-03T05:10:44.029877+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:36:53.201626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2155,"num_read_kb":2080,"num_write":414,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'297","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.478530+0000","last_change":"2024-04-03T03:38:24.750293+0000","last_active":"2024-04-03T05:14:10.478530+0000","last_peered":"2024-04-03T05:14:10.478530+0000","last_clean":"2024-04-03T05:14:10.478530+0000","last_became_active":"2024-04-03T03:38:24.749152+0000","last_became_peered":"2024-04-03T03:38:24.749152+0000","last_unstale":"2024-04-03T05:14:10.478530+0000","last_undegraded":"2024-04-03T05:14:10.478530+0000","last_fullsized":"2024-04-03T05:14:10.478530+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:48:44.832480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":381,"num_read_kb":32536,"num_write":1044,"num_write_kb":42333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1009","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:10:43.056540+0000","last_change":"2024-04-03T03:38:26.729663+0000","last_active":"2024-04-03T05:10:43.056540+0000","last_peered":"2024-04-03T05:10:43.056540+0000","last_clean":"2024-04-03T05:10:43.056540+0000","last_became_active":"2024-04-03T03:38:26.729124+0000","last_became_peered":"2024-04-03T03:38:26.729124+0000","last_unstale":"2024-04-03T05:10:43.056540+0000","last_undegraded":"2024-04-03T05:10:43.056540+0000","last_fullsized":"2024-04-03T05:10:43.056540+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":900,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:12:50.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4687,"num_read_kb":4082,"num_write":1459,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'345","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.559279+0000","last_change":"2024-04-03T03:38:24.732372+0000","last_active":"2024-04-03T05:14:10.559279+0000","last_peered":"2024-04-03T05:14:10.559279+0000","last_clean":"2024-04-03T05:14:10.559279+0000","last_became_active":"2024-04-03T03:38:24.731586+0000","last_became_peered":"2024-04-03T03:38:24.731586+0000","last_unstale":"2024-04-03T05:14:10.559279+0000","last_undegraded":"2024-04-03T05:14:10.559279+0000","last_fullsized":"2024-04-03T05:14:10.559279+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:34:38.457730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282846,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":553,"num_read_kb":86610,"num_write":1391,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'364","reported_seq":1859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:22.218422+0000","last_change":"2024-04-03T03:38:26.728365+0000","last_active":"2024-04-03T05:12:22.218422+0000","last_peered":"2024-04-03T05:12:22.218422+0000","last_clean":"2024-04-03T05:12:22.218422+0000","last_became_active":"2024-04-03T03:38:26.728070+0000","last_became_peered":"2024-04-03T03:38:26.728070+0000","last_unstale":"2024-04-03T05:12:22.218422+0000","last_undegraded":"2024-04-03T05:12:22.218422+0000","last_fullsized":"2024-04-03T05:12:22.218422+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:38:42.073330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2004,"num_read_kb":1922,"num_write":414,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'366","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.561836+0000","last_change":"2024-04-03T03:38:24.726372+0000","last_active":"2024-04-03T05:14:10.561836+0000","last_peered":"2024-04-03T05:14:10.561836+0000","last_clean":"2024-04-03T05:14:10.561836+0000","last_became_active":"2024-04-03T03:38:24.725969+0000","last_became_peered":"2024-04-03T03:38:24.725969+0000","last_unstale":"2024-04-03T05:14:10.561836+0000","last_undegraded":"2024-04-03T05:14:10.561836+0000","last_fullsized":"2024-04-03T05:14:10.561836+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:29:30.307028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360956,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":552,"num_read_kb":62664,"num_write":1296,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'466","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:04.047880+0000","last_change":"2024-04-03T03:38:26.706006+0000","last_active":"2024-04-03T05:12:04.047880+0000","last_peered":"2024-04-03T05:12:04.047880+0000","last_clean":"2024-04-03T05:12:04.047880+0000","last_became_active":"2024-04-03T03:38:26.705142+0000","last_became_peered":"2024-04-03T03:38:26.705142+0000","last_unstale":"2024-04-03T05:12:04.047880+0000","last_undegraded":"2024-04-03T05:12:04.047880+0000","last_fullsized":"2024-04-03T05:12:04.047880+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:12.955466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2439,"num_read_kb":2283,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'321","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.559921+0000","last_change":"2024-04-03T03:38:24.749516+0000","last_active":"2024-04-03T05:14:10.559921+0000","last_peered":"2024-04-03T05:14:10.559921+0000","last_clean":"2024-04-03T05:14:10.559921+0000","last_became_active":"2024-04-03T03:38:24.748843+0000","last_became_peered":"2024-04-03T03:38:24.748843+0000","last_unstale":"2024-04-03T05:14:10.559921+0000","last_undegraded":"2024-04-03T05:14:10.559921+0000","last_fullsized":"2024-04-03T05:14:10.559921+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:45:41.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":1436,"num_write":1076,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'325","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.482957+0000","last_change":"2024-04-03T03:38:24.740753+0000","last_active":"2024-04-03T05:14:10.482957+0000","last_peered":"2024-04-03T05:14:10.482957+0000","last_clean":"2024-04-03T05:14:10.482957+0000","last_became_active":"2024-04-03T03:38:24.737358+0000","last_became_peered":"2024-04-03T03:38:24.737358+0000","last_unstale":"2024-04-03T05:14:10.482957+0000","last_undegraded":"2024-04-03T05:14:10.482957+0000","last_fullsized":"2024-04-03T05:14:10.482957+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:25:01.791092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5528791,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":543,"num_read_kb":13846,"num_write":1342,"num_write_kb":46293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'651","reported_seq":2338,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.282490+0000","last_change":"2024-04-03T03:38:26.718253+0000","last_active":"2024-04-03T05:11:29.282490+0000","last_peered":"2024-04-03T05:11:29.282490+0000","last_clean":"2024-04-03T05:11:29.282490+0000","last_became_active":"2024-04-03T03:38:26.717854+0000","last_became_peered":"2024-04-03T03:38:26.717854+0000","last_unstale":"2024-04-03T05:11:29.282490+0000","last_undegraded":"2024-04-03T05:11:29.282490+0000","last_fullsized":"2024-04-03T05:11:29.282490+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:22.381228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3358,"num_read_kb":3036,"num_write":900,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'386","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.459370+0000","last_change":"2024-04-03T03:38:24.730677+0000","last_active":"2024-04-03T05:14:10.459370+0000","last_peered":"2024-04-03T05:14:10.459370+0000","last_clean":"2024-04-03T05:14:10.459370+0000","last_became_active":"2024-04-03T03:38:24.730312+0000","last_became_peered":"2024-04-03T03:38:24.730312+0000","last_unstale":"2024-04-03T05:14:10.459370+0000","last_undegraded":"2024-04-03T05:14:10.459370+0000","last_fullsized":"2024-04-03T05:14:10.459370+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:20:55.022050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342930,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":661,"num_read_kb":19035,"num_write":1410,"num_write_kb":53256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'683","reported_seq":2062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:11:29.282399+0000","last_change":"2024-04-03T03:38:26.728858+0000","last_active":"2024-04-03T05:11:29.282399+0000","last_peered":"2024-04-03T05:11:29.282399+0000","last_clean":"2024-04-03T05:11:29.282399+0000","last_became_active":"2024-04-03T03:38:26.728038+0000","last_became_peered":"2024-04-03T03:38:26.728038+0000","last_unstale":"2024-04-03T05:11:29.282399+0000","last_undegraded":"2024-04-03T05:11:29.282399+0000","last_fullsized":"2024-04-03T05:11:29.282399+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:28:43.229002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3172,"num_read_kb":2837,"num_write":928,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":195556,"num_write":183,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5643,"num_read_kb":4008,"num_write":2168,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1286,"ondisk_log_size":1286,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":11006,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":12265,"num_read_kb":12111,"num_write":14239,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":22012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2564,"ondisk_log_size":2564,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":375,"ondisk_log_size":375,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1532186,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19519,"num_read_kb":39189,"num_write":16363,"num_write_kb":11731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1711,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1602,"num_read_kb":1902,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":189133,"num_read_kb":172083,"num_write":51171,"num_write_kb":17715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4081,"ondisk_log_size":4081,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":162411735,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":0,"num_read":35354,"num_read_kb":2539931,"num_write":77944,"num_write_kb":2266597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":246079488,"data_stored":246079488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3564,"ondisk_log_size":3564,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":216081,"num_write":183,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510600,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":352728,"kb_used_data":46476,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94019112,"statfs":{"total":96636764160,"available":96275570688,"internally_reserved":0,"allocated":47591424,"data_stored":45521294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":313391562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510602,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305776,"kb_used_data":44080,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94066064,"statfs":{"total":96636764160,"available":96323649536,"internally_reserved":0,"allocated":45137920,"data_stored":43104262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510599,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183364,"kb_used_data":35416,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94188476,"statfs":{"total":96636764160,"available":96448999424,"internally_reserved":0,"allocated":36265984,"data_stored":34171288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510598,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141948,"kb_used_data":38476,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94229892,"statfs":{"total":96636764160,"available":96491409408,"internally_reserved":0,"allocated":39399424,"data_stored":37369253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":105839047},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543305,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301192,"kb_used_data":48956,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94070648,"statfs":{"total":96636764160,"available":96328343552,"internally_reserved":0,"allocated":50130944,"data_stored":48057944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543305,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132224,"kb_used_data":38488,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94239616,"statfs":{"total":96636764160,"available":96501366784,"internally_reserved":0,"allocated":39411712,"data_stored":37394593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95877574},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543302,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":203228,"kb_used_data":41488,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94168612,"statfs":{"total":96636764160,"available":96428658688,"internally_reserved":0,"allocated":42483712,"data_stored":40444668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543303,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303684,"kb_used_data":47428,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94068156,"statfs":{"total":96636764160,"available":96325791744,"internally_reserved":0,"allocated":48566272,"data_stored":46507952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262207941},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28962816,"data_stored":28962816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32927744,"data_stored":32927744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24633344,"data_stored":24633344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32149504,"data_stored":32149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32997376,"data_stored":32997376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":31895552,"data_stored":31895552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29294592,"data_stored":29294592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":33218560,"data_stored":33218560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T05:14:18.014 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.014 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.014 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.014 INFO:tasks.ceph:pgid 64.1f last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.015 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.015 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.015 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.015 INFO:tasks.ceph:pgid 64.1e last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.015 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.015 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.015 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.015 INFO:tasks.ceph:pgid 64.1d last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.016 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.016 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.016 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.016 INFO:tasks.ceph:pgid 64.1c last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.016 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.016 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.016 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.016 INFO:tasks.ceph:pgid 64.1b last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.016 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.017 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.017 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.017 INFO:tasks.ceph:pgid 64.1a last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.017 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.017 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.017 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.017 INFO:tasks.ceph:pgid 64.19 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.017 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.018 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.018 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.018 INFO:tasks.ceph:pgid 64.18 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.018 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.018 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.018 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.018 INFO:tasks.ceph:pgid 64.17 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.018 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.018 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.019 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.019 INFO:tasks.ceph:pgid 64.16 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.019 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.019 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.019 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.019 INFO:tasks.ceph:pgid 64.15 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.019 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.019 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.019 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.020 INFO:tasks.ceph:pgid 64.14 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.020 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.020 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.020 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.020 INFO:tasks.ceph:pgid 64.13 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.020 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.020 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.020 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.020 INFO:tasks.ceph:pgid 64.12 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.021 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.021 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.021 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.021 INFO:tasks.ceph:pgid 64.11 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.021 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.021 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.021 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.021 INFO:tasks.ceph:pgid 64.10 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.021 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.022 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.022 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.022 INFO:tasks.ceph:pgid 64.f last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.022 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.022 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.022 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.022 INFO:tasks.ceph:pgid 64.e last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.022 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.022 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.023 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.023 INFO:tasks.ceph:pgid 64.d last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.023 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.023 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.023 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.023 INFO:tasks.ceph:pgid 64.c last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.023 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.023 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.023 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.024 INFO:tasks.ceph:pgid 64.b last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.024 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.024 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.024 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.024 INFO:tasks.ceph:pgid 64.a last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.024 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.024 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.024 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 64.9 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 64.8 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 64.7 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.025 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.026 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.026 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.026 INFO:tasks.ceph:pgid 64.6 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.026 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.026 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.026 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.026 INFO:tasks.ceph:pgid 64.5 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.026 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 64.4 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 64.3 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.027 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.028 INFO:tasks.ceph:pgid 64.2 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.028 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.028 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.029 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.030 INFO:tasks.ceph:pgid 64.1 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.030 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.030 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.030 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.030 INFO:tasks.ceph:pgid 64.0 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.030 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.030 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.030 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.030 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.031 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.031 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.031 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.031 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.031 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.031 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.031 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.031 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.031 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.032 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.032 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.032 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.032 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.032 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.032 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.032 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.032 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.032 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.033 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.033 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.033 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.033 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.033 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.033 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.033 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.033 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.033 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.034 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.034 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.034 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.034 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.034 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.034 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.034 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.034 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.035 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.036 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.036 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.036 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.036 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.036 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.036 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.036 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.036 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.036 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.037 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.037 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.037 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.037 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.037 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.037 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.037 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.037 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.037 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.038 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.038 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.038 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.038 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.038 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.038 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.038 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.038 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.038 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.039 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.039 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.039 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.039 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.039 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.039 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.039 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.039 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.040 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.040 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.040 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.040 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.040 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.040 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.040 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.040 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.041 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.041 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.041 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.041 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.041 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.041 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.041 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.041 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.041 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.042 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-03T03:38:03.047546+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=3, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.042 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.042 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.042 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.042 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.042 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.042 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.042 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.042 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.043 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.043 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.043 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.043 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.043 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.043 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.043 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.043 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.043 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.044 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.044 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.044 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.044 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.044 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.044 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.044 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.044 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.045 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.045 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.045 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.045 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.045 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.045 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.045 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.045 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.046 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.046 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.046 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.046 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.046 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.046 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.046 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.046 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.047 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.047 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.047 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.047 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.047 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.047 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.047 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.047 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.048 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.048 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.048 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.048 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.048 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.048 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.048 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.048 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.049 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.049 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.049 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.049 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.049 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.049 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.049 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.049 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.049 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.050 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.050 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.050 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.050 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.050 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.050 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.050 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.050 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.051 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.051 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.051 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.051 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.051 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.051 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.051 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.051 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.051 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.052 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.053 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.053 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.053 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.053 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.053 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.053 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.053 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.053 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.054 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.054 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.054 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.054 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.054 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.054 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.054 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.054 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.054 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.055 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.055 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.055 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.055 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.055 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.055 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.055 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.055 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.055 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.056 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.056 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.056 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.056 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.056 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.056 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.056 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.056 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.056 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.057 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.057 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.057 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.057 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.057 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.057 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.057 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.057 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.057 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.058 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.058 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.058 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.058 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.058 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.058 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.058 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.058 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.058 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.059 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.059 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.059 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.059 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.059 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.059 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.059 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.059 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.059 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.060 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.060 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.060 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.060 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.060 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.060 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.060 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.060 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:18.060 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-03T05:14:38.061 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-03T05:14:38.440 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:14:38.454 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-03T05:14:38.460 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":3151,"stamp":"2024-04-03T05:14:36.545282+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198101438,"num_objects":887,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":887,"num_whiteouts":0,"num_read":263989,"num_read_kb":3180969,"num_write":162444,"num_write_kb":2577796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":158,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":499405,"num_omap_keys":1172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14034,"ondisk_log_size":14034,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1922824,"kb_used_data":340808,"kb_used_omap":12,"kb_used_meta":1581939,"kb_avail":753051896,"statfs":{"total":773094113280,"available":771125141504,"internally_reserved":0,"allocated":348987392,"data_stored":332571254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1619906099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":494934,"num_omap_keys":1161,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010006"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.670978+0000","last_change":"2024-04-03T04:18:51.297907+0000","last_active":"2024-04-03T05:13:53.670978+0000","last_peered":"2024-04-03T05:13:53.670978+0000","last_clean":"2024-04-03T05:13:53.670978+0000","last_became_active":"2024-04-03T04:18:51.297066+0000","last_became_peered":"2024-04-03T04:18:51.297066+0000","last_unstale":"2024-04-03T05:13:53.670978+0000","last_undegraded":"2024-04-03T05:13:53.670978+0000","last_fullsized":"2024-04-03T05:13:53.670978+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"258'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:22.868285+0000","last_change":"2024-04-03T03:55:53.275728+0000","last_active":"2024-04-03T05:13:22.868285+0000","last_peered":"2024-04-03T05:13:22.868285+0000","last_clean":"2024-04-03T05:13:22.868285+0000","last_became_active":"2024-04-03T03:55:53.274262+0000","last_became_peered":"2024-04-03T03:55:53.274262+0000","last_unstale":"2024-04-03T05:13:22.868285+0000","last_undegraded":"2024-04-03T05:13:22.868285+0000","last_fullsized":"2024-04-03T05:13:22.868285+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'2","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.064369+0000","last_change":"2024-04-03T03:55:45.808629+0000","last_active":"2024-04-03T05:14:08.064369+0000","last_peered":"2024-04-03T05:14:08.064369+0000","last_clean":"2024-04-03T05:14:08.064369+0000","last_became_active":"2024-04-03T03:55:45.807880+0000","last_became_peered":"2024-04-03T03:55:45.807880+0000","last_unstale":"2024-04-03T05:14:08.064369+0000","last_undegraded":"2024-04-03T05:14:08.064369+0000","last_fullsized":"2024-04-03T05:14:08.064369+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"263'26","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.265071+0000","last_change":"2024-04-03T05:14:21.265071+0000","last_active":"2024-04-03T05:14:21.265071+0000","last_peered":"2024-04-03T05:14:21.265071+0000","last_clean":"2024-04-03T05:14:21.265071+0000","last_became_active":"2024-04-03T03:49:00.987495+0000","last_became_peered":"2024-04-03T03:49:00.987495+0000","last_unstale":"2024-04-03T05:14:21.265071+0000","last_undegraded":"2024-04-03T05:14:21.265071+0000","last_fullsized":"2024-04-03T05:14:21.265071+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-04-03T05:14:21.264793+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-04-03T05:14:21.264793+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.264793+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:44:58.383385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":70,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.866894+0000","last_change":"2024-04-03T04:18:51.320955+0000","last_active":"2024-04-03T05:13:53.866894+0000","last_peered":"2024-04-03T05:13:53.866894+0000","last_clean":"2024-04-03T05:13:53.866894+0000","last_became_active":"2024-04-03T04:18:51.320118+0000","last_became_peered":"2024-04-03T04:18:51.320118+0000","last_unstale":"2024-04-03T05:13:53.866894+0000","last_undegraded":"2024-04-03T05:13:53.866894+0000","last_fullsized":"2024-04-03T05:13:53.866894+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.264269+0000","last_change":"2024-04-03T03:55:53.242225+0000","last_active":"2024-04-03T05:14:10.264269+0000","last_peered":"2024-04-03T05:14:10.264269+0000","last_clean":"2024-04-03T05:14:10.264269+0000","last_became_active":"2024-04-03T03:55:53.238473+0000","last_became_peered":"2024-04-03T03:55:53.238473+0000","last_unstale":"2024-04-03T05:14:10.264269+0000","last_undegraded":"2024-04-03T05:14:10.264269+0000","last_fullsized":"2024-04-03T05:14:10.264269+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"258'3","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.238334+0000","last_change":"2024-04-03T05:14:27.238725+0000","last_active":"2024-04-03T05:14:27.238334+0000","last_peered":"2024-04-03T05:14:27.238334+0000","last_clean":"2024-04-03T05:14:27.238334+0000","last_became_active":"2024-04-03T03:55:45.831610+0000","last_became_peered":"2024-04-03T03:55:45.831610+0000","last_unstale":"2024-04-03T05:14:27.238334+0000","last_undegraded":"2024-04-03T05:14:27.238334+0000","last_fullsized":"2024-04-03T05:14:27.238334+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-04-03T05:14:27.238085+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-04-03T05:14:27.238085+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.238085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:41:45.149752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"263'35","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.227454+0000","last_change":"2024-04-03T05:14:20.227526+0000","last_active":"2024-04-03T05:14:20.227454+0000","last_peered":"2024-04-03T05:14:20.227454+0000","last_clean":"2024-04-03T05:14:20.227454+0000","last_became_active":"2024-04-03T03:49:00.988912+0000","last_became_peered":"2024-04-03T03:49:00.988912+0000","last_unstale":"2024-04-03T05:14:20.227454+0000","last_undegraded":"2024-04-03T05:14:20.227454+0000","last_fullsized":"2024-04-03T05:14:20.227454+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-04-03T05:14:20.227243+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-04-03T05:14:20.227243+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.227243+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:12:02.335893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:08.047438+0000","last_change":"2024-04-03T04:18:51.365311+0000","last_active":"2024-04-03T05:13:08.047438+0000","last_peered":"2024-04-03T05:13:08.047438+0000","last_clean":"2024-04-03T05:13:08.047438+0000","last_became_active":"2024-04-03T04:18:51.364557+0000","last_became_peered":"2024-04-03T04:18:51.364557+0000","last_unstale":"2024-04-03T05:13:08.047438+0000","last_undegraded":"2024-04-03T05:13:08.047438+0000","last_fullsized":"2024-04-03T05:13:08.047438+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.738873+0000","last_change":"2024-04-03T05:14:32.738935+0000","last_active":"2024-04-03T05:14:32.738873+0000","last_peered":"2024-04-03T05:14:32.738873+0000","last_clean":"2024-04-03T05:14:32.738873+0000","last_became_active":"2024-04-03T03:55:53.269276+0000","last_became_peered":"2024-04-03T03:55:53.269276+0000","last_unstale":"2024-04-03T05:14:32.738873+0000","last_undegraded":"2024-04-03T05:14:32.738873+0000","last_fullsized":"2024-04-03T05:14:32.738873+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-04-03T05:14:32.738678+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-04-03T05:14:32.738678+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.738678+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:42.161639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'9","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.056890+0000","last_change":"2024-04-03T05:14:23.056951+0000","last_active":"2024-04-03T05:14:23.056890+0000","last_peered":"2024-04-03T05:14:23.056890+0000","last_clean":"2024-04-03T05:14:23.056890+0000","last_became_active":"2024-04-03T03:55:45.822526+0000","last_became_peered":"2024-04-03T03:55:45.822526+0000","last_unstale":"2024-04-03T05:14:23.056890+0000","last_undegraded":"2024-04-03T05:14:23.056890+0000","last_fullsized":"2024-04-03T05:14:23.056890+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-04-03T05:14:23.056684+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-04-03T05:14:23.056684+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.056684+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:33:14.906245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12606,"num_write":14,"num_write_kb":9534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"263'33","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.783144+0000","last_change":"2024-04-03T05:14:21.783310+0000","last_active":"2024-04-03T05:14:21.783144+0000","last_peered":"2024-04-03T05:14:21.783144+0000","last_clean":"2024-04-03T05:14:21.783144+0000","last_became_active":"2024-04-03T03:49:00.992254+0000","last_became_peered":"2024-04-03T03:49:00.992254+0000","last_unstale":"2024-04-03T05:14:21.783144+0000","last_undegraded":"2024-04-03T05:14:21.783144+0000","last_fullsized":"2024-04-03T05:14:21.783144+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-04-03T05:14:21.782914+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-04-03T05:14:21.782914+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.782914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:52.468078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":101,"num_write":55,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.089182+0000","last_change":"2024-04-03T04:18:51.373813+0000","last_active":"2024-04-03T05:13:03.089182+0000","last_peered":"2024-04-03T05:13:03.089182+0000","last_clean":"2024-04-03T05:13:03.089182+0000","last_became_active":"2024-04-03T04:18:51.373051+0000","last_became_peered":"2024-04-03T04:18:51.373051+0000","last_unstale":"2024-04-03T05:13:03.089182+0000","last_undegraded":"2024-04-03T05:13:03.089182+0000","last_fullsized":"2024-04-03T05:13:03.089182+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:12.863124+0000","last_change":"2024-04-03T03:55:53.276078+0000","last_active":"2024-04-03T05:14:12.863124+0000","last_peered":"2024-04-03T05:14:12.863124+0000","last_clean":"2024-04-03T05:14:12.863124+0000","last_became_active":"2024-04-03T03:55:53.274825+0000","last_became_peered":"2024-04-03T03:55:53.274825+0000","last_unstale":"2024-04-03T05:14:12.863124+0000","last_undegraded":"2024-04-03T05:14:12.863124+0000","last_fullsized":"2024-04-03T05:14:12.863124+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.229508+0000","last_change":"2024-04-03T05:14:18.229571+0000","last_active":"2024-04-03T05:14:18.229508+0000","last_peered":"2024-04-03T05:14:18.229508+0000","last_clean":"2024-04-03T05:14:18.229508+0000","last_became_active":"2024-04-03T03:55:45.809649+0000","last_became_peered":"2024-04-03T03:55:45.809649+0000","last_unstale":"2024-04-03T05:14:18.229508+0000","last_undegraded":"2024-04-03T05:14:18.229508+0000","last_fullsized":"2024-04-03T05:14:18.229508+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:18.229296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:18.229296+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.229296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:46:33.279503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"263'107","reported_seq":386,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.602336+0000","last_change":"2024-04-03T05:14:16.602380+0000","last_active":"2024-04-03T05:14:16.602336+0000","last_peered":"2024-04-03T05:14:16.602336+0000","last_clean":"2024-04-03T05:14:16.602336+0000","last_became_active":"2024-04-03T03:49:00.990318+0000","last_became_peered":"2024-04-03T03:49:00.990318+0000","last_unstale":"2024-04-03T05:14:16.602336+0000","last_undegraded":"2024-04-03T05:14:16.602336+0000","last_fullsized":"2024-04-03T05:14:16.602336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'107","last_scrub_stamp":"2024-04-03T05:14:16.602235+0000","last_deep_scrub":"263'107","last_deep_scrub_stamp":"2024-04-03T05:14:16.602235+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.602235+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:11:58.218122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":587,"num_read_kb":421,"num_write":142,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1976,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.158103+0000","last_change":"2024-04-03T04:18:51.317587+0000","last_active":"2024-04-03T05:14:17.158103+0000","last_peered":"2024-04-03T05:14:17.158103+0000","last_clean":"2024-04-03T05:14:17.158103+0000","last_became_active":"2024-04-03T04:18:51.316328+0000","last_became_peered":"2024-04-03T04:18:51.316328+0000","last_unstale":"2024-04-03T05:14:17.158103+0000","last_undegraded":"2024-04-03T05:14:17.158103+0000","last_fullsized":"2024-04-03T05:14:17.158103+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.657087+0000","last_change":"2024-04-03T05:14:28.657148+0000","last_active":"2024-04-03T05:14:28.657087+0000","last_peered":"2024-04-03T05:14:28.657087+0000","last_clean":"2024-04-03T05:14:28.657087+0000","last_became_active":"2024-04-03T03:55:53.251965+0000","last_became_peered":"2024-04-03T03:55:53.251965+0000","last_unstale":"2024-04-03T05:14:28.657087+0000","last_undegraded":"2024-04-03T05:14:28.657087+0000","last_fullsized":"2024-04-03T05:14:28.657087+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:28.656893+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:28.656893+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.656893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:10:47.815121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4667,"num_write":4,"num_write_kb":4667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'4","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.436769+0000","last_change":"2024-04-03T05:14:17.436836+0000","last_active":"2024-04-03T05:14:17.436769+0000","last_peered":"2024-04-03T05:14:17.436769+0000","last_clean":"2024-04-03T05:14:17.436769+0000","last_became_active":"2024-04-03T03:55:45.811051+0000","last_became_peered":"2024-04-03T03:55:45.811051+0000","last_unstale":"2024-04-03T05:14:17.436769+0000","last_undegraded":"2024-04-03T05:14:17.436769+0000","last_fullsized":"2024-04-03T05:14:17.436769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:17.436576+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:17.436576+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.436576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:40:06.185116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"263'6","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.581532+0000","last_change":"2024-04-03T05:14:17.581595+0000","last_active":"2024-04-03T05:14:17.581532+0000","last_peered":"2024-04-03T05:14:17.581532+0000","last_clean":"2024-04-03T05:14:17.581532+0000","last_became_active":"2024-04-03T03:49:00.989383+0000","last_became_peered":"2024-04-03T03:49:00.989383+0000","last_unstale":"2024-04-03T05:14:17.581532+0000","last_undegraded":"2024-04-03T05:14:17.581532+0000","last_fullsized":"2024-04-03T05:14:17.581532+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:17.581351+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:17.581351+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.581351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:02:07.448735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:18.845581+0000","last_change":"2024-04-03T04:18:51.318126+0000","last_active":"2024-04-03T05:12:18.845581+0000","last_peered":"2024-04-03T05:12:18.845581+0000","last_clean":"2024-04-03T05:12:18.845581+0000","last_became_active":"2024-04-03T04:18:51.317417+0000","last_became_peered":"2024-04-03T04:18:51.317417+0000","last_unstale":"2024-04-03T05:12:18.845581+0000","last_undegraded":"2024-04-03T05:12:18.845581+0000","last_fullsized":"2024-04-03T05:12:18.845581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"258'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:13.091107+0000","last_change":"2024-04-03T03:55:53.251802+0000","last_active":"2024-04-03T05:13:13.091107+0000","last_peered":"2024-04-03T05:13:13.091107+0000","last_clean":"2024-04-03T05:13:13.091107+0000","last_became_active":"2024-04-03T03:55:53.250769+0000","last_became_peered":"2024-04-03T03:55:53.250769+0000","last_unstale":"2024-04-03T05:13:13.091107+0000","last_undegraded":"2024-04-03T05:13:13.091107+0000","last_fullsized":"2024-04-03T05:13:13.091107+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'4","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.943160+0000","last_change":"2024-04-03T05:14:18.943224+0000","last_active":"2024-04-03T05:14:18.943160+0000","last_peered":"2024-04-03T05:14:18.943160+0000","last_clean":"2024-04-03T05:14:18.943160+0000","last_became_active":"2024-04-03T03:55:45.821160+0000","last_became_peered":"2024-04-03T03:55:45.821160+0000","last_unstale":"2024-04-03T05:14:18.943160+0000","last_undegraded":"2024-04-03T05:14:18.943160+0000","last_fullsized":"2024-04-03T05:14:18.943160+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:18.942964+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:18.942964+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.942964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:52.990964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"263'67","reported_seq":289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.790975+0000","last_change":"2024-04-03T05:14:20.791125+0000","last_active":"2024-04-03T05:14:20.790975+0000","last_peered":"2024-04-03T05:14:20.790975+0000","last_clean":"2024-04-03T05:14:20.790975+0000","last_became_active":"2024-04-03T03:49:00.994321+0000","last_became_peered":"2024-04-03T03:49:00.994321+0000","last_unstale":"2024-04-03T05:14:20.790975+0000","last_undegraded":"2024-04-03T05:14:20.790975+0000","last_fullsized":"2024-04-03T05:14:20.790975+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'67","last_scrub_stamp":"2024-04-03T05:14:20.790726+0000","last_deep_scrub":"263'67","last_deep_scrub_stamp":"2024-04-03T05:14:20.790726+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.790726+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:24:39.456393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":300,"num_write":80,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1980,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.056155+0000","last_change":"2024-04-03T04:18:51.312623+0000","last_active":"2024-04-03T05:13:53.056155+0000","last_peered":"2024-04-03T05:13:53.056155+0000","last_clean":"2024-04-03T05:13:53.056155+0000","last_became_active":"2024-04-03T04:18:51.311870+0000","last_became_peered":"2024-04-03T04:18:51.311870+0000","last_unstale":"2024-04-03T05:13:53.056155+0000","last_undegraded":"2024-04-03T05:13:53.056155+0000","last_fullsized":"2024-04-03T05:13:53.056155+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.224832+0000","last_change":"2024-04-03T05:14:31.224887+0000","last_active":"2024-04-03T05:14:31.224832+0000","last_peered":"2024-04-03T05:14:31.224832+0000","last_clean":"2024-04-03T05:14:31.224832+0000","last_became_active":"2024-04-03T03:55:53.241200+0000","last_became_peered":"2024-04-03T03:55:53.241200+0000","last_unstale":"2024-04-03T05:14:31.224832+0000","last_undegraded":"2024-04-03T05:14:31.224832+0000","last_fullsized":"2024-04-03T05:14:31.224832+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.224625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.224625+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.224625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:53:38.375885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'11","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.645240+0000","last_change":"2024-04-03T05:14:19.645305+0000","last_active":"2024-04-03T05:14:19.645240+0000","last_peered":"2024-04-03T05:14:19.645240+0000","last_clean":"2024-04-03T05:14:19.645240+0000","last_became_active":"2024-04-03T03:55:45.835828+0000","last_became_peered":"2024-04-03T03:55:45.835828+0000","last_unstale":"2024-04-03T05:14:19.645240+0000","last_undegraded":"2024-04-03T05:14:19.645240+0000","last_fullsized":"2024-04-03T05:14:19.645240+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:19.645047+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:19.645047+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.645047+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:51:08.338883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12338,"num_write":9,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.975186+0000","last_change":"2024-04-03T05:14:19.975252+0000","last_active":"2024-04-03T05:14:19.975186+0000","last_peered":"2024-04-03T05:14:19.975186+0000","last_clean":"2024-04-03T05:14:19.975186+0000","last_became_active":"2024-04-03T03:49:00.988327+0000","last_became_peered":"2024-04-03T03:49:00.988327+0000","last_unstale":"2024-04-03T05:14:19.975186+0000","last_undegraded":"2024-04-03T05:14:19.975186+0000","last_fullsized":"2024-04-03T05:14:19.975186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-04-03T05:14:19.974985+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-04-03T05:14:19.974985+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.974985+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:49.996232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":175,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:54.050277+0000","last_change":"2024-04-03T04:18:51.307288+0000","last_active":"2024-04-03T05:13:54.050277+0000","last_peered":"2024-04-03T05:13:54.050277+0000","last_clean":"2024-04-03T05:13:54.050277+0000","last_became_active":"2024-04-03T04:18:51.299249+0000","last_became_peered":"2024-04-03T04:18:51.299249+0000","last_unstale":"2024-04-03T05:13:54.050277+0000","last_undegraded":"2024-04-03T05:13:54.050277+0000","last_fullsized":"2024-04-03T05:13:54.050277+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'9","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.771967+0000","last_change":"2024-04-03T03:55:53.278378+0000","last_active":"2024-04-03T05:14:09.771967+0000","last_peered":"2024-04-03T05:14:09.771967+0000","last_clean":"2024-04-03T05:14:09.771967+0000","last_became_active":"2024-04-03T03:55:53.277505+0000","last_became_peered":"2024-04-03T03:55:53.277505+0000","last_unstale":"2024-04-03T05:14:09.771967+0000","last_undegraded":"2024-04-03T05:14:09.771967+0000","last_fullsized":"2024-04-03T05:14:09.771967+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"258'2","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.239327+0000","last_change":"2024-04-03T05:14:16.239400+0000","last_active":"2024-04-03T05:14:16.239327+0000","last_peered":"2024-04-03T05:14:16.239327+0000","last_clean":"2024-04-03T05:14:16.239327+0000","last_became_active":"2024-04-03T03:55:45.811093+0000","last_became_peered":"2024-04-03T03:55:45.811093+0000","last_unstale":"2024-04-03T05:14:16.239327+0000","last_undegraded":"2024-04-03T05:14:16.239327+0000","last_fullsized":"2024-04-03T05:14:16.239327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:16.239098+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:16.239098+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.239098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:00:03.108455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"263'33","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.289972+0000","last_change":"2024-04-03T05:14:23.290034+0000","last_active":"2024-04-03T05:14:23.289972+0000","last_peered":"2024-04-03T05:14:23.289972+0000","last_clean":"2024-04-03T05:14:23.289972+0000","last_became_active":"2024-04-03T03:49:00.973216+0000","last_became_peered":"2024-04-03T03:49:00.973216+0000","last_unstale":"2024-04-03T05:14:23.289972+0000","last_undegraded":"2024-04-03T05:14:23.289972+0000","last_fullsized":"2024-04-03T05:14:23.289972+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-04-03T05:14:23.289767+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-04-03T05:14:23.289767+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.289767+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:49:45.158570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"260'1","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.089066+0000","last_change":"2024-04-03T04:19:00.383020+0000","last_active":"2024-04-03T05:13:03.089066+0000","last_peered":"2024-04-03T05:13:03.089066+0000","last_clean":"2024-04-03T05:13:03.089066+0000","last_became_active":"2024-04-03T04:19:00.377208+0000","last_became_peered":"2024-04-03T04:19:00.377208+0000","last_unstale":"2024-04-03T05:13:03.089066+0000","last_undegraded":"2024-04-03T05:13:03.089066+0000","last_fullsized":"2024-04-03T05:13:03.089066+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.596999+0000","last_change":"2024-04-03T03:55:53.258982+0000","last_active":"2024-04-03T05:14:08.596999+0000","last_peered":"2024-04-03T05:14:08.596999+0000","last_clean":"2024-04-03T05:14:08.596999+0000","last_became_active":"2024-04-03T03:55:53.258699+0000","last_became_peered":"2024-04-03T03:55:53.258699+0000","last_unstale":"2024-04-03T05:14:08.596999+0000","last_undegraded":"2024-04-03T05:14:08.596999+0000","last_fullsized":"2024-04-03T05:14:08.596999+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'6","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.189199+0000","last_change":"2024-04-03T05:14:31.189266+0000","last_active":"2024-04-03T05:14:31.189199+0000","last_peered":"2024-04-03T05:14:31.189199+0000","last_clean":"2024-04-03T05:14:31.189199+0000","last_became_active":"2024-04-03T03:55:45.831660+0000","last_became_peered":"2024-04-03T03:55:45.831660+0000","last_unstale":"2024-04-03T05:14:31.189199+0000","last_undegraded":"2024-04-03T05:14:31.189199+0000","last_fullsized":"2024-04-03T05:14:31.189199+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:31.189001+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:31.189001+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.189001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:53:33.899568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"263'39","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:39.045239+0000","last_change":"2024-04-03T03:49:00.969632+0000","last_active":"2024-04-03T05:13:39.045239+0000","last_peered":"2024-04-03T05:13:39.045239+0000","last_clean":"2024-04-03T05:13:39.045239+0000","last_became_active":"2024-04-03T03:49:00.968902+0000","last_became_peered":"2024-04-03T03:49:00.968902+0000","last_unstale":"2024-04-03T05:13:39.045239+0000","last_undegraded":"2024-04-03T05:13:39.045239+0000","last_fullsized":"2024-04-03T05:13:39.045239+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":106,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.810334+0000","last_change":"2024-04-03T04:18:51.368008+0000","last_active":"2024-04-03T05:14:15.810334+0000","last_peered":"2024-04-03T05:14:15.810334+0000","last_clean":"2024-04-03T05:14:15.810334+0000","last_became_active":"2024-04-03T04:18:51.367290+0000","last_became_peered":"2024-04-03T04:18:51.367290+0000","last_unstale":"2024-04-03T05:14:15.810334+0000","last_undegraded":"2024-04-03T05:14:15.810334+0000","last_fullsized":"2024-04-03T05:14:15.810334+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:18.859029+0000","last_change":"2024-04-03T03:55:53.249249+0000","last_active":"2024-04-03T05:13:18.859029+0000","last_peered":"2024-04-03T05:13:18.859029+0000","last_clean":"2024-04-03T05:13:18.859029+0000","last_became_active":"2024-04-03T03:55:53.247541+0000","last_became_peered":"2024-04-03T03:55:53.247541+0000","last_unstale":"2024-04-03T05:13:18.859029+0000","last_undegraded":"2024-04-03T05:13:18.859029+0000","last_fullsized":"2024-04-03T05:13:18.859029+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"258'4","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.219803+0000","last_change":"2024-04-03T05:14:15.219826+0000","last_active":"2024-04-03T05:14:15.219803+0000","last_peered":"2024-04-03T05:14:15.219803+0000","last_clean":"2024-04-03T05:14:15.219803+0000","last_became_active":"2024-04-03T03:55:45.819664+0000","last_became_peered":"2024-04-03T03:55:45.819664+0000","last_unstale":"2024-04-03T05:14:15.219803+0000","last_undegraded":"2024-04-03T05:14:15.219803+0000","last_fullsized":"2024-04-03T05:14:15.219803+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'4","last_scrub_stamp":"2024-04-03T05:14:15.219711+0000","last_deep_scrub":"258'4","last_deep_scrub_stamp":"2024-04-03T05:14:15.219711+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.219711+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:39.431443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"263'13","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.596552+0000","last_change":"2024-04-03T05:14:21.596703+0000","last_active":"2024-04-03T05:14:21.596552+0000","last_peered":"2024-04-03T05:14:21.596552+0000","last_clean":"2024-04-03T05:14:21.596552+0000","last_became_active":"2024-04-03T03:49:00.961782+0000","last_became_peered":"2024-04-03T03:49:00.961782+0000","last_unstale":"2024-04-03T05:14:21.596552+0000","last_undegraded":"2024-04-03T05:14:21.596552+0000","last_fullsized":"2024-04-03T05:14:21.596552+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-04-03T05:14:21.596278+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-04-03T05:14:21.596278+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.596278+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:28:32.878479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.261181+0000","last_change":"2024-04-03T04:18:51.305071+0000","last_active":"2024-04-03T05:14:16.261181+0000","last_peered":"2024-04-03T05:14:16.261181+0000","last_clean":"2024-04-03T05:14:16.261181+0000","last_became_active":"2024-04-03T04:18:51.304323+0000","last_became_peered":"2024-04-03T04:18:51.304323+0000","last_unstale":"2024-04-03T05:14:16.261181+0000","last_undegraded":"2024-04-03T05:14:16.261181+0000","last_fullsized":"2024-04-03T05:14:16.261181+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'9","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.597352+0000","last_change":"2024-04-03T03:55:53.260481+0000","last_active":"2024-04-03T05:14:08.597352+0000","last_peered":"2024-04-03T05:14:08.597352+0000","last_clean":"2024-04-03T05:14:08.597352+0000","last_became_active":"2024-04-03T03:55:53.255231+0000","last_became_peered":"2024-04-03T03:55:53.255231+0000","last_unstale":"2024-04-03T05:14:08.597352+0000","last_undegraded":"2024-04-03T05:14:08.597352+0000","last_fullsized":"2024-04-03T05:14:08.597352+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.797480+0000","last_change":"2024-04-03T05:14:19.797532+0000","last_active":"2024-04-03T05:14:19.797480+0000","last_peered":"2024-04-03T05:14:19.797480+0000","last_clean":"2024-04-03T05:14:19.797480+0000","last_became_active":"2024-04-03T03:55:45.829412+0000","last_became_peered":"2024-04-03T03:55:45.829412+0000","last_unstale":"2024-04-03T05:14:19.797480+0000","last_undegraded":"2024-04-03T05:14:19.797480+0000","last_fullsized":"2024-04-03T05:14:19.797480+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:19.797275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:19.797275+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.797275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:12:11.890163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"263'19","reported_seq":121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.576493+0000","last_change":"2024-04-03T05:14:17.576536+0000","last_active":"2024-04-03T05:14:17.576493+0000","last_peered":"2024-04-03T05:14:17.576493+0000","last_clean":"2024-04-03T05:14:17.576493+0000","last_became_active":"2024-04-03T03:49:00.981577+0000","last_became_peered":"2024-04-03T03:49:00.981577+0000","last_unstale":"2024-04-03T05:14:17.576493+0000","last_undegraded":"2024-04-03T05:14:17.576493+0000","last_fullsized":"2024-04-03T05:14:17.576493+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-04-03T05:14:17.576374+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-04-03T05:14:17.576374+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.576374+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:47.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.810415+0000","last_change":"2024-04-03T04:18:51.373777+0000","last_active":"2024-04-03T05:14:15.810415+0000","last_peered":"2024-04-03T05:14:15.810415+0000","last_clean":"2024-04-03T05:14:15.810415+0000","last_became_active":"2024-04-03T04:18:51.372963+0000","last_became_peered":"2024-04-03T04:18:51.372963+0000","last_unstale":"2024-04-03T05:14:15.810415+0000","last_undegraded":"2024-04-03T05:14:15.810415+0000","last_fullsized":"2024-04-03T05:14:15.810415+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.262139+0000","last_change":"2024-04-03T03:55:53.270124+0000","last_active":"2024-04-03T05:14:10.262139+0000","last_peered":"2024-04-03T05:14:10.262139+0000","last_clean":"2024-04-03T05:14:10.262139+0000","last_became_active":"2024-04-03T03:55:53.268903+0000","last_became_peered":"2024-04-03T03:55:53.268903+0000","last_unstale":"2024-04-03T05:14:10.262139+0000","last_undegraded":"2024-04-03T05:14:10.262139+0000","last_fullsized":"2024-04-03T05:14:10.262139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'2","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.705201+0000","last_change":"2024-04-03T03:55:45.835558+0000","last_active":"2024-04-03T05:14:09.705201+0000","last_peered":"2024-04-03T05:14:09.705201+0000","last_clean":"2024-04-03T05:14:09.705201+0000","last_became_active":"2024-04-03T03:55:45.834865+0000","last_became_peered":"2024-04-03T03:55:45.834865+0000","last_unstale":"2024-04-03T05:14:09.705201+0000","last_undegraded":"2024-04-03T05:14:09.705201+0000","last_fullsized":"2024-04-03T05:14:09.705201+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"263'64","reported_seq":239,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.590706+0000","last_change":"2024-04-03T05:14:20.590768+0000","last_active":"2024-04-03T05:14:20.590706+0000","last_peered":"2024-04-03T05:14:20.590706+0000","last_clean":"2024-04-03T05:14:20.590706+0000","last_became_active":"2024-04-03T03:49:00.971042+0000","last_became_peered":"2024-04-03T03:49:00.971042+0000","last_unstale":"2024-04-03T05:14:20.590706+0000","last_undegraded":"2024-04-03T05:14:20.590706+0000","last_fullsized":"2024-04-03T05:14:20.590706+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-04-03T05:14:20.590514+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-04-03T05:14:20.590514+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.590514+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:29:07.571711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":214,"num_write":97,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:32.858076+0000","last_change":"2024-04-03T04:18:51.308665+0000","last_active":"2024-04-03T05:12:32.858076+0000","last_peered":"2024-04-03T05:12:32.858076+0000","last_clean":"2024-04-03T05:12:32.858076+0000","last_became_active":"2024-04-03T04:18:51.307933+0000","last_became_peered":"2024-04-03T04:18:51.307933+0000","last_unstale":"2024-04-03T05:12:32.858076+0000","last_undegraded":"2024-04-03T05:12:32.858076+0000","last_fullsized":"2024-04-03T05:12:32.858076+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.043379+0000","last_change":"2024-04-03T03:55:53.267596+0000","last_active":"2024-04-03T05:12:53.043379+0000","last_peered":"2024-04-03T05:12:53.043379+0000","last_clean":"2024-04-03T05:12:53.043379+0000","last_became_active":"2024-04-03T03:55:53.266957+0000","last_became_peered":"2024-04-03T03:55:53.266957+0000","last_unstale":"2024-04-03T05:12:53.043379+0000","last_undegraded":"2024-04-03T05:12:53.043379+0000","last_fullsized":"2024-04-03T05:12:53.043379+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'2","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.252771+0000","last_change":"2024-04-03T05:14:23.252891+0000","last_active":"2024-04-03T05:14:23.252771+0000","last_peered":"2024-04-03T05:14:23.252771+0000","last_clean":"2024-04-03T05:14:23.252771+0000","last_became_active":"2024-04-03T03:55:45.829247+0000","last_became_peered":"2024-04-03T03:55:45.829247+0000","last_unstale":"2024-04-03T05:14:23.252771+0000","last_undegraded":"2024-04-03T05:14:23.252771+0000","last_fullsized":"2024-04-03T05:14:23.252771+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:23.252480+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:23.252480+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.252480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:45.549115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"263'66","reported_seq":236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.575622+0000","last_change":"2024-04-03T05:14:15.575655+0000","last_active":"2024-04-03T05:14:15.575622+0000","last_peered":"2024-04-03T05:14:15.575622+0000","last_clean":"2024-04-03T05:14:15.575622+0000","last_became_active":"2024-04-03T03:49:00.990969+0000","last_became_peered":"2024-04-03T03:49:00.990969+0000","last_unstale":"2024-04-03T05:14:15.575622+0000","last_undegraded":"2024-04-03T05:14:15.575622+0000","last_fullsized":"2024-04-03T05:14:15.575622+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-04-03T05:14:15.575468+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-04-03T05:14:15.575468+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.575468+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:10:53.811160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":193,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:32.858187+0000","last_change":"2024-04-03T04:18:51.311760+0000","last_active":"2024-04-03T05:12:32.858187+0000","last_peered":"2024-04-03T05:12:32.858187+0000","last_clean":"2024-04-03T05:12:32.858187+0000","last_became_active":"2024-04-03T04:18:51.310856+0000","last_became_peered":"2024-04-03T04:18:51.310856+0000","last_unstale":"2024-04-03T05:12:32.858187+0000","last_undegraded":"2024-04-03T05:12:32.858187+0000","last_fullsized":"2024-04-03T05:12:32.858187+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'6","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.547397+0000","last_change":"2024-04-03T05:14:24.547531+0000","last_active":"2024-04-03T05:14:24.547397+0000","last_peered":"2024-04-03T05:14:24.547397+0000","last_clean":"2024-04-03T05:14:24.547397+0000","last_became_active":"2024-04-03T03:55:53.240485+0000","last_became_peered":"2024-04-03T03:55:53.240485+0000","last_unstale":"2024-04-03T05:14:24.547397+0000","last_undegraded":"2024-04-03T05:14:24.547397+0000","last_fullsized":"2024-04-03T05:14:24.547397+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:24.547121+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:24.547121+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.547121+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:34:01.732381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.818563+0000","last_change":"2024-04-03T05:14:23.818669+0000","last_active":"2024-04-03T05:14:23.818563+0000","last_peered":"2024-04-03T05:14:23.818563+0000","last_clean":"2024-04-03T05:14:23.818563+0000","last_became_active":"2024-04-03T03:55:45.833049+0000","last_became_peered":"2024-04-03T03:55:45.833049+0000","last_unstale":"2024-04-03T05:14:23.818563+0000","last_undegraded":"2024-04-03T05:14:23.818563+0000","last_fullsized":"2024-04-03T05:14:23.818563+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:23.818338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:23.818338+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.818338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:09:23.603846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"263'54","reported_seq":215,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.195113+0000","last_change":"2024-04-03T05:14:19.195179+0000","last_active":"2024-04-03T05:14:19.195113+0000","last_peered":"2024-04-03T05:14:19.195113+0000","last_clean":"2024-04-03T05:14:19.195113+0000","last_became_active":"2024-04-03T03:49:00.969239+0000","last_became_peered":"2024-04-03T03:49:00.969239+0000","last_unstale":"2024-04-03T05:14:19.195113+0000","last_undegraded":"2024-04-03T05:14:19.195113+0000","last_fullsized":"2024-04-03T05:14:19.195113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'54","last_scrub_stamp":"2024-04-03T05:14:19.194918+0000","last_deep_scrub":"263'54","last_deep_scrub_stamp":"2024-04-03T05:14:19.194918+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.194918+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:32:09.246304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":93,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:34.030568+0000","last_change":"2024-04-03T04:18:51.318533+0000","last_active":"2024-04-03T05:12:34.030568+0000","last_peered":"2024-04-03T05:12:34.030568+0000","last_clean":"2024-04-03T05:12:34.030568+0000","last_became_active":"2024-04-03T04:18:51.318231+0000","last_became_peered":"2024-04-03T04:18:51.318231+0000","last_unstale":"2024-04-03T05:12:34.030568+0000","last_undegraded":"2024-04-03T05:12:34.030568+0000","last_fullsized":"2024-04-03T05:12:34.030568+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.455511+0000","last_change":"2024-04-03T03:55:53.279237+0000","last_active":"2024-04-03T05:14:10.455511+0000","last_peered":"2024-04-03T05:14:10.455511+0000","last_clean":"2024-04-03T05:14:10.455511+0000","last_became_active":"2024-04-03T03:55:53.278529+0000","last_became_peered":"2024-04-03T03:55:53.278529+0000","last_unstale":"2024-04-03T05:14:10.455511+0000","last_undegraded":"2024-04-03T05:14:10.455511+0000","last_fullsized":"2024-04-03T05:14:10.455511+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'2","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.911230+0000","last_change":"2024-04-03T05:14:15.911278+0000","last_active":"2024-04-03T05:14:15.911230+0000","last_peered":"2024-04-03T05:14:15.911230+0000","last_clean":"2024-04-03T05:14:15.911230+0000","last_became_active":"2024-04-03T03:55:45.820737+0000","last_became_peered":"2024-04-03T03:55:45.820737+0000","last_unstale":"2024-04-03T05:14:15.911230+0000","last_undegraded":"2024-04-03T05:14:15.911230+0000","last_fullsized":"2024-04-03T05:14:15.911230+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:15.911138+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:15.911138+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.911138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:35:35.324319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"263'71","reported_seq":258,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.486256+0000","last_change":"2024-04-03T05:14:18.486381+0000","last_active":"2024-04-03T05:14:18.486256+0000","last_peered":"2024-04-03T05:14:18.486256+0000","last_clean":"2024-04-03T05:14:18.486256+0000","last_became_active":"2024-04-03T03:49:00.987062+0000","last_became_peered":"2024-04-03T03:49:00.987062+0000","last_unstale":"2024-04-03T05:14:18.486256+0000","last_undegraded":"2024-04-03T05:14:18.486256+0000","last_fullsized":"2024-04-03T05:14:18.486256+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'71","last_scrub_stamp":"2024-04-03T05:14:18.485978+0000","last_deep_scrub":"263'71","last_deep_scrub_stamp":"2024-04-03T05:14:18.485978+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.485978+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:34:39.263878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":233,"num_write":115,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:33.038508+0000","last_change":"2024-04-03T04:18:51.320211+0000","last_active":"2024-04-03T05:12:33.038508+0000","last_peered":"2024-04-03T05:12:33.038508+0000","last_clean":"2024-04-03T05:12:33.038508+0000","last_became_active":"2024-04-03T04:18:51.319383+0000","last_became_peered":"2024-04-03T04:18:51.319383+0000","last_unstale":"2024-04-03T05:12:33.038508+0000","last_undegraded":"2024-04-03T05:12:33.038508+0000","last_fullsized":"2024-04-03T05:12:33.038508+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'10","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.770717+0000","last_change":"2024-04-03T03:55:53.280600+0000","last_active":"2024-04-03T05:14:09.770717+0000","last_peered":"2024-04-03T05:14:09.770717+0000","last_clean":"2024-04-03T05:14:09.770717+0000","last_became_active":"2024-04-03T03:55:53.279910+0000","last_became_peered":"2024-04-03T03:55:53.279910+0000","last_unstale":"2024-04-03T05:14:09.770717+0000","last_undegraded":"2024-04-03T05:14:09.770717+0000","last_fullsized":"2024-04-03T05:14:09.770717+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":19,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'6","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.446915+0000","last_change":"2024-04-03T05:14:20.447085+0000","last_active":"2024-04-03T05:14:20.446915+0000","last_peered":"2024-04-03T05:14:20.446915+0000","last_clean":"2024-04-03T05:14:20.446915+0000","last_became_active":"2024-04-03T03:55:45.840884+0000","last_became_peered":"2024-04-03T03:55:45.840884+0000","last_unstale":"2024-04-03T05:14:20.446915+0000","last_undegraded":"2024-04-03T05:14:20.446915+0000","last_fullsized":"2024-04-03T05:14:20.446915+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:20.446700+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:20.446700+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.446700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:38:24.233173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"263'34","reported_seq":153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.003460+0000","last_change":"2024-04-03T05:14:21.003529+0000","last_active":"2024-04-03T05:14:21.003460+0000","last_peered":"2024-04-03T05:14:21.003460+0000","last_clean":"2024-04-03T05:14:21.003460+0000","last_became_active":"2024-04-03T03:49:00.966982+0000","last_became_peered":"2024-04-03T03:49:00.966982+0000","last_unstale":"2024-04-03T05:14:21.003460+0000","last_undegraded":"2024-04-03T05:14:21.003460+0000","last_fullsized":"2024-04-03T05:14:21.003460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-04-03T05:14:21.003253+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-04-03T05:14:21.003253+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.003253+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:55:19.768847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"261'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.043483+0000","last_change":"2024-04-03T04:18:51.315214+0000","last_active":"2024-04-03T05:12:53.043483+0000","last_peered":"2024-04-03T05:12:53.043483+0000","last_clean":"2024-04-03T05:12:53.043483+0000","last_became_active":"2024-04-03T04:18:51.314416+0000","last_became_peered":"2024-04-03T04:18:51.314416+0000","last_unstale":"2024-04-03T05:12:53.043483+0000","last_undegraded":"2024-04-03T05:12:53.043483+0000","last_fullsized":"2024-04-03T05:12:53.043483+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'10","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.454614+0000","last_change":"2024-04-03T03:55:53.248818+0000","last_active":"2024-04-03T05:14:10.454614+0000","last_peered":"2024-04-03T05:14:10.454614+0000","last_clean":"2024-04-03T05:14:10.454614+0000","last_became_active":"2024-04-03T03:55:53.248092+0000","last_became_peered":"2024-04-03T03:55:53.248092+0000","last_unstale":"2024-04-03T05:14:10.454614+0000","last_undegraded":"2024-04-03T05:14:10.454614+0000","last_fullsized":"2024-04-03T05:14:10.454614+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"258'2","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.713377+0000","last_change":"2024-04-03T03:55:45.830497+0000","last_active":"2024-04-03T05:14:16.713377+0000","last_peered":"2024-04-03T05:14:16.713377+0000","last_clean":"2024-04-03T05:14:16.713377+0000","last_became_active":"2024-04-03T03:55:45.829835+0000","last_became_peered":"2024-04-03T03:55:45.829835+0000","last_unstale":"2024-04-03T05:14:16.713377+0000","last_undegraded":"2024-04-03T05:14:16.713377+0000","last_fullsized":"2024-04-03T05:14:16.713377+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"263'30","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.254490+0000","last_change":"2024-04-03T05:14:27.254552+0000","last_active":"2024-04-03T05:14:27.254490+0000","last_peered":"2024-04-03T05:14:27.254490+0000","last_clean":"2024-04-03T05:14:27.254490+0000","last_became_active":"2024-04-03T03:49:00.983761+0000","last_became_peered":"2024-04-03T03:49:00.983761+0000","last_unstale":"2024-04-03T05:14:27.254490+0000","last_undegraded":"2024-04-03T05:14:27.254490+0000","last_fullsized":"2024-04-03T05:14:27.254490+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-04-03T05:14:27.254297+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-04-03T05:14:27.254297+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.254297+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:58:42.410817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.043535+0000","last_change":"2024-04-03T04:18:51.320209+0000","last_active":"2024-04-03T05:12:53.043535+0000","last_peered":"2024-04-03T05:12:53.043535+0000","last_clean":"2024-04-03T05:12:53.043535+0000","last_became_active":"2024-04-03T04:18:51.319470+0000","last_became_peered":"2024-04-03T04:18:51.319470+0000","last_unstale":"2024-04-03T05:12:53.043535+0000","last_undegraded":"2024-04-03T05:12:53.043535+0000","last_fullsized":"2024-04-03T05:12:53.043535+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'7","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.739223+0000","last_change":"2024-04-03T03:55:53.258437+0000","last_active":"2024-04-03T05:14:07.739223+0000","last_peered":"2024-04-03T05:14:07.739223+0000","last_clean":"2024-04-03T05:14:07.739223+0000","last_became_active":"2024-04-03T03:55:53.257856+0000","last_became_peered":"2024-04-03T03:55:53.257856+0000","last_unstale":"2024-04-03T05:14:07.739223+0000","last_undegraded":"2024-04-03T05:14:07.739223+0000","last_fullsized":"2024-04-03T05:14:07.739223+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":16434,"num_write":11,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'14","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.113603+0000","last_change":"2024-04-03T05:14:27.113680+0000","last_active":"2024-04-03T05:14:27.113603+0000","last_peered":"2024-04-03T05:14:27.113603+0000","last_clean":"2024-04-03T05:14:27.113603+0000","last_became_active":"2024-04-03T03:55:45.829711+0000","last_became_peered":"2024-04-03T03:55:45.829711+0000","last_unstale":"2024-04-03T05:14:27.113603+0000","last_undegraded":"2024-04-03T05:14:27.113603+0000","last_fullsized":"2024-04-03T05:14:27.113603+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-04-03T05:14:27.113418+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-04-03T05:14:27.113418+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.113418+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:00:20.265172+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":20484,"num_write":20,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"263'38","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.342198+0000","last_change":"2024-04-03T05:14:20.342198+0000","last_active":"2024-04-03T05:14:20.342198+0000","last_peered":"2024-04-03T05:14:20.342198+0000","last_clean":"2024-04-03T05:14:20.342198+0000","last_became_active":"2024-04-03T03:49:00.987174+0000","last_became_peered":"2024-04-03T03:49:00.987174+0000","last_unstale":"2024-04-03T05:14:20.342198+0000","last_undegraded":"2024-04-03T05:14:20.342198+0000","last_fullsized":"2024-04-03T05:14:20.342198+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-04-03T05:14:20.341945+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-04-03T05:14:20.341945+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.341945+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:38.153173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.043626+0000","last_change":"2024-04-03T04:18:51.321162+0000","last_active":"2024-04-03T05:12:53.043626+0000","last_peered":"2024-04-03T05:12:53.043626+0000","last_clean":"2024-04-03T05:12:53.043626+0000","last_became_active":"2024-04-03T04:18:51.320359+0000","last_became_peered":"2024-04-03T04:18:51.320359+0000","last_unstale":"2024-04-03T05:12:53.043626+0000","last_undegraded":"2024-04-03T05:12:53.043626+0000","last_fullsized":"2024-04-03T05:12:53.043626+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"258'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:42.860717+0000","last_change":"2024-04-03T03:55:53.275336+0000","last_active":"2024-04-03T05:12:42.860717+0000","last_peered":"2024-04-03T05:12:42.860717+0000","last_clean":"2024-04-03T05:12:42.860717+0000","last_became_active":"2024-04-03T03:55:53.274653+0000","last_became_peered":"2024-04-03T03:55:53.274653+0000","last_unstale":"2024-04-03T05:12:42.860717+0000","last_undegraded":"2024-04-03T05:12:42.860717+0000","last_fullsized":"2024-04-03T05:12:42.860717+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.355608+0000","last_change":"2024-04-03T03:55:45.832909+0000","last_active":"2024-04-03T05:14:15.355608+0000","last_peered":"2024-04-03T05:14:15.355608+0000","last_clean":"2024-04-03T05:14:15.355608+0000","last_became_active":"2024-04-03T03:55:45.832127+0000","last_became_peered":"2024-04-03T03:55:45.832127+0000","last_unstale":"2024-04-03T05:14:15.355608+0000","last_undegraded":"2024-04-03T05:14:15.355608+0000","last_fullsized":"2024-04-03T05:14:15.355608+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"263'16","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.516914+0000","last_change":"2024-04-03T05:14:17.516914+0000","last_active":"2024-04-03T05:14:17.516914+0000","last_peered":"2024-04-03T05:14:17.516914+0000","last_clean":"2024-04-03T05:14:17.516914+0000","last_became_active":"2024-04-03T03:49:00.987993+0000","last_became_peered":"2024-04-03T03:49:00.987993+0000","last_unstale":"2024-04-03T05:14:17.516914+0000","last_undegraded":"2024-04-03T05:14:17.516914+0000","last_fullsized":"2024-04-03T05:14:17.516914+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-04-03T05:14:17.516663+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-04-03T05:14:17.516663+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.516663+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:02:59.257046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:07.866506+0000","last_change":"2024-04-03T04:18:51.373972+0000","last_active":"2024-04-03T05:13:07.866506+0000","last_peered":"2024-04-03T05:13:07.866506+0000","last_clean":"2024-04-03T05:13:07.866506+0000","last_became_active":"2024-04-03T04:18:51.373189+0000","last_became_peered":"2024-04-03T04:18:51.373189+0000","last_unstale":"2024-04-03T05:13:07.866506+0000","last_undegraded":"2024-04-03T05:13:07.866506+0000","last_fullsized":"2024-04-03T05:13:07.866506+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.366575+0000","last_change":"2024-04-03T03:55:53.244970+0000","last_active":"2024-04-03T05:14:09.366575+0000","last_peered":"2024-04-03T05:14:09.366575+0000","last_clean":"2024-04-03T05:14:09.366575+0000","last_became_active":"2024-04-03T03:55:53.243858+0000","last_became_peered":"2024-04-03T03:55:53.243858+0000","last_unstale":"2024-04-03T05:14:09.366575+0000","last_undegraded":"2024-04-03T05:14:09.366575+0000","last_fullsized":"2024-04-03T05:14:09.366575+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'8","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.301561+0000","last_change":"2024-04-03T05:14:22.301561+0000","last_active":"2024-04-03T05:14:22.301561+0000","last_peered":"2024-04-03T05:14:22.301561+0000","last_clean":"2024-04-03T05:14:22.301561+0000","last_became_active":"2024-04-03T03:55:45.815910+0000","last_became_peered":"2024-04-03T03:55:45.815910+0000","last_unstale":"2024-04-03T05:14:22.301561+0000","last_undegraded":"2024-04-03T05:14:22.301561+0000","last_fullsized":"2024-04-03T05:14:22.301561+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:22.301288+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:22.301288+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.301288+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:28.061626+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"263'51","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.161207+0000","last_change":"2024-04-03T05:14:17.161207+0000","last_active":"2024-04-03T05:14:17.161207+0000","last_peered":"2024-04-03T05:14:17.161207+0000","last_clean":"2024-04-03T05:14:17.161207+0000","last_became_active":"2024-04-03T03:49:00.965454+0000","last_became_peered":"2024-04-03T03:49:00.965454+0000","last_unstale":"2024-04-03T05:14:17.161207+0000","last_undegraded":"2024-04-03T05:14:17.161207+0000","last_fullsized":"2024-04-03T05:14:17.161207+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-04-03T05:14:17.160932+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-04-03T05:14:17.160932+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.160932+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:02:36.721077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":162,"num_write":91,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:04.061516+0000","last_change":"2024-04-03T04:18:51.367810+0000","last_active":"2024-04-03T05:13:04.061516+0000","last_peered":"2024-04-03T05:13:04.061516+0000","last_clean":"2024-04-03T05:13:04.061516+0000","last_became_active":"2024-04-03T04:18:51.367071+0000","last_became_peered":"2024-04-03T04:18:51.367071+0000","last_unstale":"2024-04-03T05:13:04.061516+0000","last_undegraded":"2024-04-03T05:13:04.061516+0000","last_fullsized":"2024-04-03T05:13:04.061516+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"258'2","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.596827+0000","last_change":"2024-04-03T05:14:23.596893+0000","last_active":"2024-04-03T05:14:23.596827+0000","last_peered":"2024-04-03T05:14:23.596827+0000","last_clean":"2024-04-03T05:14:23.596827+0000","last_became_active":"2024-04-03T03:55:53.265100+0000","last_became_peered":"2024-04-03T03:55:53.265100+0000","last_unstale":"2024-04-03T05:14:23.596827+0000","last_undegraded":"2024-04-03T05:14:23.596827+0000","last_fullsized":"2024-04-03T05:14:23.596827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:23.596633+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:23.596633+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.596633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:33:10.162116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'8","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.790209+0000","last_change":"2024-04-03T05:14:17.790327+0000","last_active":"2024-04-03T05:14:17.790209+0000","last_peered":"2024-04-03T05:14:17.790209+0000","last_clean":"2024-04-03T05:14:17.790209+0000","last_became_active":"2024-04-03T03:55:45.822292+0000","last_became_peered":"2024-04-03T03:55:45.822292+0000","last_unstale":"2024-04-03T05:14:17.790209+0000","last_undegraded":"2024-04-03T05:14:17.790209+0000","last_fullsized":"2024-04-03T05:14:17.790209+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:17.789970+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:17.789970+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.789970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:00:22.608204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"263'28","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.615807+0000","last_change":"2024-04-03T05:14:18.615807+0000","last_active":"2024-04-03T05:14:18.615807+0000","last_peered":"2024-04-03T05:14:18.615807+0000","last_clean":"2024-04-03T05:14:18.615807+0000","last_became_active":"2024-04-03T03:49:00.981338+0000","last_became_peered":"2024-04-03T03:49:00.981338+0000","last_unstale":"2024-04-03T05:14:18.615807+0000","last_undegraded":"2024-04-03T05:14:18.615807+0000","last_fullsized":"2024-04-03T05:14:18.615807+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-04-03T05:14:18.615526+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-04-03T05:14:18.615526+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.615526+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:26:42.378669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.659953+0000","last_change":"2024-04-03T04:18:51.309156+0000","last_active":"2024-04-03T05:13:03.659953+0000","last_peered":"2024-04-03T05:13:03.659953+0000","last_clean":"2024-04-03T05:13:03.659953+0000","last_became_active":"2024-04-03T04:18:51.308461+0000","last_became_peered":"2024-04-03T04:18:51.308461+0000","last_unstale":"2024-04-03T05:13:03.659953+0000","last_undegraded":"2024-04-03T05:13:03.659953+0000","last_fullsized":"2024-04-03T05:13:03.659953+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.262346+0000","last_change":"2024-04-03T03:55:53.244597+0000","last_active":"2024-04-03T05:14:10.262346+0000","last_peered":"2024-04-03T05:14:10.262346+0000","last_clean":"2024-04-03T05:14:10.262346+0000","last_became_active":"2024-04-03T03:55:53.243822+0000","last_became_peered":"2024-04-03T03:55:53.243822+0000","last_unstale":"2024-04-03T05:14:10.262346+0000","last_undegraded":"2024-04-03T05:14:10.262346+0000","last_fullsized":"2024-04-03T05:14:10.262346+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'4","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.270479+0000","last_change":"2024-04-03T05:14:17.270479+0000","last_active":"2024-04-03T05:14:17.270479+0000","last_peered":"2024-04-03T05:14:17.270479+0000","last_clean":"2024-04-03T05:14:17.270479+0000","last_became_active":"2024-04-03T03:55:45.819117+0000","last_became_peered":"2024-04-03T03:55:45.819117+0000","last_unstale":"2024-04-03T05:14:17.270479+0000","last_undegraded":"2024-04-03T05:14:17.270479+0000","last_fullsized":"2024-04-03T05:14:17.270479+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:17.270342+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:17.270342+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.270342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:39:43.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"263'9","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.532743+0000","last_change":"2024-04-03T05:14:16.532814+0000","last_active":"2024-04-03T05:14:16.532743+0000","last_peered":"2024-04-03T05:14:16.532743+0000","last_clean":"2024-04-03T05:14:16.532743+0000","last_became_active":"2024-04-03T03:49:00.991393+0000","last_became_peered":"2024-04-03T03:49:00.991393+0000","last_unstale":"2024-04-03T05:14:16.532743+0000","last_undegraded":"2024-04-03T05:14:16.532743+0000","last_fullsized":"2024-04-03T05:14:16.532743+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-04-03T05:14:16.532534+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-04-03T05:14:16.532534+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.532534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:38:21.117233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:19.064871+0000","last_change":"2024-04-03T04:18:51.316420+0000","last_active":"2024-04-03T05:13:19.064871+0000","last_peered":"2024-04-03T05:13:19.064871+0000","last_clean":"2024-04-03T05:13:19.064871+0000","last_became_active":"2024-04-03T04:18:51.315679+0000","last_became_peered":"2024-04-03T04:18:51.315679+0000","last_unstale":"2024-04-03T05:13:19.064871+0000","last_undegraded":"2024-04-03T05:13:19.064871+0000","last_fullsized":"2024-04-03T05:13:19.064871+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"258'4","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:23.651327+0000","last_change":"2024-04-03T03:55:53.278183+0000","last_active":"2024-04-03T05:12:23.651327+0000","last_peered":"2024-04-03T05:12:23.651327+0000","last_clean":"2024-04-03T05:12:23.651327+0000","last_became_active":"2024-04-03T03:55:53.277402+0000","last_became_peered":"2024-04-03T03:55:53.277402+0000","last_unstale":"2024-04-03T05:12:23.651327+0000","last_undegraded":"2024-04-03T05:12:23.651327+0000","last_fullsized":"2024-04-03T05:12:23.651327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":3,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'8","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.423054+0000","last_change":"2024-04-03T05:14:18.423124+0000","last_active":"2024-04-03T05:14:18.423054+0000","last_peered":"2024-04-03T05:14:18.423054+0000","last_clean":"2024-04-03T05:14:18.423054+0000","last_became_active":"2024-04-03T03:55:45.814319+0000","last_became_peered":"2024-04-03T03:55:45.814319+0000","last_unstale":"2024-04-03T05:14:18.423054+0000","last_undegraded":"2024-04-03T05:14:18.423054+0000","last_fullsized":"2024-04-03T05:14:18.423054+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:18.422837+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:18.422837+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.422837+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:11:35.323066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"263'34","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.501763+0000","last_change":"2024-04-03T05:14:30.501826+0000","last_active":"2024-04-03T05:14:30.501763+0000","last_peered":"2024-04-03T05:14:30.501763+0000","last_clean":"2024-04-03T05:14:30.501763+0000","last_became_active":"2024-04-03T03:49:00.979122+0000","last_became_peered":"2024-04-03T03:49:00.979122+0000","last_unstale":"2024-04-03T05:14:30.501763+0000","last_undegraded":"2024-04-03T05:14:30.501763+0000","last_fullsized":"2024-04-03T05:14:30.501763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-04-03T05:14:30.501563+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-04-03T05:14:30.501563+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.501563+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:08:28.157076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":103,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:52.862947+0000","last_change":"2024-04-03T04:18:51.318648+0000","last_active":"2024-04-03T05:12:52.862947+0000","last_peered":"2024-04-03T05:12:52.862947+0000","last_clean":"2024-04-03T05:12:52.862947+0000","last_became_active":"2024-04-03T04:18:51.318018+0000","last_became_peered":"2024-04-03T04:18:51.318018+0000","last_unstale":"2024-04-03T05:12:52.862947+0000","last_undegraded":"2024-04-03T05:12:52.862947+0000","last_fullsized":"2024-04-03T05:12:52.862947+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'7","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.449829+0000","last_change":"2024-04-03T03:55:53.255437+0000","last_active":"2024-04-03T05:14:14.449829+0000","last_peered":"2024-04-03T05:14:14.449829+0000","last_clean":"2024-04-03T05:14:14.449829+0000","last_became_active":"2024-04-03T03:55:53.254546+0000","last_became_peered":"2024-04-03T03:55:53.254546+0000","last_unstale":"2024-04-03T05:14:14.449829+0000","last_undegraded":"2024-04-03T05:14:14.449829+0000","last_fullsized":"2024-04-03T05:14:14.449829+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.967998+0000","last_change":"2024-04-03T05:14:16.968043+0000","last_active":"2024-04-03T05:14:16.967998+0000","last_peered":"2024-04-03T05:14:16.967998+0000","last_clean":"2024-04-03T05:14:16.967998+0000","last_became_active":"2024-04-03T03:55:45.820294+0000","last_became_peered":"2024-04-03T03:55:45.820294+0000","last_unstale":"2024-04-03T05:14:16.967998+0000","last_undegraded":"2024-04-03T05:14:16.967998+0000","last_fullsized":"2024-04-03T05:14:16.967998+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-04-03T05:14:16.967919+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-04-03T05:14:16.967919+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.967919+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:45:58.471685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18434,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"263'22","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.255113+0000","last_change":"2024-04-03T05:14:23.255191+0000","last_active":"2024-04-03T05:14:23.255113+0000","last_peered":"2024-04-03T05:14:23.255113+0000","last_clean":"2024-04-03T05:14:23.255113+0000","last_became_active":"2024-04-03T03:49:00.979598+0000","last_became_peered":"2024-04-03T03:49:00.979598+0000","last_unstale":"2024-04-03T05:14:23.255113+0000","last_undegraded":"2024-04-03T05:14:23.255113+0000","last_fullsized":"2024-04-03T05:14:23.255113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'22","last_scrub_stamp":"2024-04-03T05:14:23.254887+0000","last_deep_scrub":"263'22","last_deep_scrub_stamp":"2024-04-03T05:14:23.254887+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.254887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:57:20.929131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":52,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.089111+0000","last_change":"2024-04-03T04:18:51.367266+0000","last_active":"2024-04-03T05:13:03.089111+0000","last_peered":"2024-04-03T05:13:03.089111+0000","last_clean":"2024-04-03T05:13:03.089111+0000","last_became_active":"2024-04-03T04:18:51.366501+0000","last_became_peered":"2024-04-03T04:18:51.366501+0000","last_unstale":"2024-04-03T05:13:03.089111+0000","last_undegraded":"2024-04-03T05:13:03.089111+0000","last_fullsized":"2024-04-03T05:13:03.089111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'10","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.597332+0000","last_change":"2024-04-03T03:55:53.268300+0000","last_active":"2024-04-03T05:14:08.597332+0000","last_peered":"2024-04-03T05:14:08.597332+0000","last_clean":"2024-04-03T05:14:08.597332+0000","last_became_active":"2024-04-03T03:55:53.266771+0000","last_became_peered":"2024-04-03T03:55:53.266771+0000","last_unstale":"2024-04-03T05:14:08.597332+0000","last_undegraded":"2024-04-03T05:14:08.597332+0000","last_fullsized":"2024-04-03T05:14:08.597332+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":19,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'3","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.261936+0000","last_change":"2024-04-03T03:55:45.837048+0000","last_active":"2024-04-03T05:14:10.261936+0000","last_peered":"2024-04-03T05:14:10.261936+0000","last_clean":"2024-04-03T05:14:10.261936+0000","last_became_active":"2024-04-03T03:55:45.836623+0000","last_became_peered":"2024-04-03T03:55:45.836623+0000","last_unstale":"2024-04-03T05:14:10.261936+0000","last_undegraded":"2024-04-03T05:14:10.261936+0000","last_fullsized":"2024-04-03T05:14:10.261936+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"263'70","reported_seq":235,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:32.855569+0000","last_change":"2024-04-03T03:49:00.982602+0000","last_active":"2024-04-03T05:13:32.855569+0000","last_peered":"2024-04-03T05:13:32.855569+0000","last_clean":"2024-04-03T05:13:32.855569+0000","last_became_active":"2024-04-03T03:49:00.978563+0000","last_became_peered":"2024-04-03T03:49:00.978563+0000","last_unstale":"2024-04-03T05:13:32.855569+0000","last_undegraded":"2024-04-03T05:13:32.855569+0000","last_fullsized":"2024-04-03T05:13:32.855569+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:48:59.933523+0000","last_clean_scrub_stamp":"2024-04-03T03:48:59.933523+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":197,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:23.092511+0000","last_change":"2024-04-03T04:18:51.311769+0000","last_active":"2024-04-03T05:13:23.092511+0000","last_peered":"2024-04-03T05:13:23.092511+0000","last_clean":"2024-04-03T05:13:23.092511+0000","last_became_active":"2024-04-03T04:18:51.311005+0000","last_became_peered":"2024-04-03T04:18:51.311005+0000","last_unstale":"2024-04-03T05:13:23.092511+0000","last_undegraded":"2024-04-03T05:13:23.092511+0000","last_fullsized":"2024-04-03T05:13:23.092511+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"258'3","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:59.060540+0000","last_change":"2024-04-03T03:55:53.252248+0000","last_active":"2024-04-03T05:12:59.060540+0000","last_peered":"2024-04-03T05:12:59.060540+0000","last_clean":"2024-04-03T05:12:59.060540+0000","last_became_active":"2024-04-03T03:55:53.251863+0000","last_became_peered":"2024-04-03T03:55:53.251863+0000","last_unstale":"2024-04-03T05:12:59.060540+0000","last_undegraded":"2024-04-03T05:12:59.060540+0000","last_fullsized":"2024-04-03T05:12:59.060540+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.207038+0000","last_change":"2024-04-03T05:14:19.207099+0000","last_active":"2024-04-03T05:14:19.207038+0000","last_peered":"2024-04-03T05:14:19.207038+0000","last_clean":"2024-04-03T05:14:19.207038+0000","last_became_active":"2024-04-03T03:55:45.823003+0000","last_became_peered":"2024-04-03T03:55:45.823003+0000","last_unstale":"2024-04-03T05:14:19.207038+0000","last_undegraded":"2024-04-03T05:14:19.207038+0000","last_fullsized":"2024-04-03T05:14:19.207038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:19.206826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:19.206826+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.206826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:47:42.400975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"263'42","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.827228+0000","last_change":"2024-04-03T05:14:22.827287+0000","last_active":"2024-04-03T05:14:22.827228+0000","last_peered":"2024-04-03T05:14:22.827228+0000","last_clean":"2024-04-03T05:14:22.827228+0000","last_became_active":"2024-04-03T03:49:00.981940+0000","last_became_peered":"2024-04-03T03:49:00.981940+0000","last_unstale":"2024-04-03T05:14:22.827228+0000","last_undegraded":"2024-04-03T05:14:22.827228+0000","last_fullsized":"2024-04-03T05:14:22.827228+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-04-03T05:14:22.827034+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-04-03T05:14:22.827034+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.827034+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:48:11.329544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"260'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.660202+0000","last_change":"2024-04-03T04:18:51.302485+0000","last_active":"2024-04-03T05:13:03.660202+0000","last_peered":"2024-04-03T05:13:03.660202+0000","last_clean":"2024-04-03T05:13:03.660202+0000","last_became_active":"2024-04-03T04:18:51.301260+0000","last_became_peered":"2024-04-03T04:18:51.301260+0000","last_unstale":"2024-04-03T05:13:03.660202+0000","last_undegraded":"2024-04-03T05:13:03.660202+0000","last_fullsized":"2024-04-03T05:13:03.660202+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.455355+0000","last_change":"2024-04-03T03:55:53.257731+0000","last_active":"2024-04-03T05:14:10.455355+0000","last_peered":"2024-04-03T05:14:10.455355+0000","last_clean":"2024-04-03T05:14:10.455355+0000","last_became_active":"2024-04-03T03:55:53.257421+0000","last_became_peered":"2024-04-03T03:55:53.257421+0000","last_unstale":"2024-04-03T05:14:10.455355+0000","last_undegraded":"2024-04-03T05:14:10.455355+0000","last_fullsized":"2024-04-03T05:14:10.455355+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.581891+0000","last_change":"2024-04-03T05:14:15.581955+0000","last_active":"2024-04-03T05:14:15.581891+0000","last_peered":"2024-04-03T05:14:15.581891+0000","last_clean":"2024-04-03T05:14:15.581891+0000","last_became_active":"2024-04-03T03:55:45.822134+0000","last_became_peered":"2024-04-03T03:55:45.822134+0000","last_unstale":"2024-04-03T05:14:15.581891+0000","last_undegraded":"2024-04-03T05:14:15.581891+0000","last_fullsized":"2024-04-03T05:14:15.581891+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:15.581753+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:15.581753+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.581753+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:13:39.514734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"263'37","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.295509+0000","last_change":"2024-04-03T05:14:31.295589+0000","last_active":"2024-04-03T05:14:31.295509+0000","last_peered":"2024-04-03T05:14:31.295509+0000","last_clean":"2024-04-03T05:14:31.295509+0000","last_became_active":"2024-04-03T03:49:00.989509+0000","last_became_peered":"2024-04-03T03:49:00.989509+0000","last_unstale":"2024-04-03T05:14:31.295509+0000","last_undegraded":"2024-04-03T05:14:31.295509+0000","last_fullsized":"2024-04-03T05:14:31.295509+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-04-03T05:14:31.295305+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-04-03T05:14:31.295305+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.295305+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:06:48.153827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:04.061712+0000","last_change":"2024-04-03T04:18:51.367656+0000","last_active":"2024-04-03T05:13:04.061712+0000","last_peered":"2024-04-03T05:13:04.061712+0000","last_clean":"2024-04-03T05:13:04.061712+0000","last_became_active":"2024-04-03T04:18:51.366898+0000","last_became_peered":"2024-04-03T04:18:51.366898+0000","last_unstale":"2024-04-03T05:13:04.061712+0000","last_undegraded":"2024-04-03T05:13:04.061712+0000","last_fullsized":"2024-04-03T05:13:04.061712+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.866962+0000","last_change":"2024-04-03T03:55:53.273186+0000","last_active":"2024-04-03T05:13:53.866962+0000","last_peered":"2024-04-03T05:13:53.866962+0000","last_clean":"2024-04-03T05:13:53.866962+0000","last_became_active":"2024-04-03T03:55:53.272757+0000","last_became_peered":"2024-04-03T03:55:53.272757+0000","last_unstale":"2024-04-03T05:13:53.866962+0000","last_undegraded":"2024-04-03T05:13:53.866962+0000","last_fullsized":"2024-04-03T05:13:53.866962+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.778706+0000","last_change":"2024-04-03T05:14:27.778761+0000","last_active":"2024-04-03T05:14:27.778706+0000","last_peered":"2024-04-03T05:14:27.778706+0000","last_clean":"2024-04-03T05:14:27.778706+0000","last_became_active":"2024-04-03T03:55:45.834364+0000","last_became_peered":"2024-04-03T03:55:45.834364+0000","last_unstale":"2024-04-03T05:14:27.778706+0000","last_undegraded":"2024-04-03T05:14:27.778706+0000","last_fullsized":"2024-04-03T05:14:27.778706+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.778514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.778514+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.778514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:44:07.258462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"263'29","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.843494+0000","last_change":"2024-04-03T05:14:24.843494+0000","last_active":"2024-04-03T05:14:24.843494+0000","last_peered":"2024-04-03T05:14:24.843494+0000","last_clean":"2024-04-03T05:14:24.843494+0000","last_became_active":"2024-04-03T03:49:00.974654+0000","last_became_peered":"2024-04-03T03:49:00.974654+0000","last_unstale":"2024-04-03T05:14:24.843494+0000","last_undegraded":"2024-04-03T05:14:24.843494+0000","last_fullsized":"2024-04-03T05:14:24.843494+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-04-03T05:14:24.843104+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-04-03T05:14:24.843104+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.843104+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:36:52.914225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:08.856641+0000","last_change":"2024-04-03T04:18:51.323217+0000","last_active":"2024-04-03T05:13:08.856641+0000","last_peered":"2024-04-03T05:13:08.856641+0000","last_clean":"2024-04-03T05:13:08.856641+0000","last_became_active":"2024-04-03T04:18:51.322311+0000","last_became_peered":"2024-04-03T04:18:51.322311+0000","last_unstale":"2024-04-03T05:13:08.856641+0000","last_undegraded":"2024-04-03T05:13:08.856641+0000","last_fullsized":"2024-04-03T05:13:08.856641+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.598546+0000","last_change":"2024-04-03T03:55:53.256346+0000","last_active":"2024-04-03T05:14:08.598546+0000","last_peered":"2024-04-03T05:14:08.598546+0000","last_clean":"2024-04-03T05:14:08.598546+0000","last_became_active":"2024-04-03T03:55:53.255322+0000","last_became_peered":"2024-04-03T03:55:53.255322+0000","last_unstale":"2024-04-03T05:14:08.598546+0000","last_undegraded":"2024-04-03T05:14:08.598546+0000","last_fullsized":"2024-04-03T05:14:08.598546+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":90,"num_write":10,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'2","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.524694+0000","last_change":"2024-04-03T05:14:16.524760+0000","last_active":"2024-04-03T05:14:16.524694+0000","last_peered":"2024-04-03T05:14:16.524694+0000","last_clean":"2024-04-03T05:14:16.524694+0000","last_became_active":"2024-04-03T03:55:45.825324+0000","last_became_peered":"2024-04-03T03:55:45.825324+0000","last_unstale":"2024-04-03T05:14:16.524694+0000","last_undegraded":"2024-04-03T05:14:16.524694+0000","last_fullsized":"2024-04-03T05:14:16.524694+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:16.524499+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:16.524499+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.524499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:06:55.683539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"263'10","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.922456+0000","last_change":"2024-04-03T05:14:17.922456+0000","last_active":"2024-04-03T05:14:17.922456+0000","last_peered":"2024-04-03T05:14:17.922456+0000","last_clean":"2024-04-03T05:14:17.922456+0000","last_became_active":"2024-04-03T03:49:00.988511+0000","last_became_peered":"2024-04-03T03:49:00.988511+0000","last_unstale":"2024-04-03T05:14:17.922456+0000","last_undegraded":"2024-04-03T05:14:17.922456+0000","last_fullsized":"2024-04-03T05:14:17.922456+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-04-03T05:14:17.922164+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-04-03T05:14:17.922164+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.922164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:09:03.267120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:02.865210+0000","last_change":"2024-04-03T04:18:51.311624+0000","last_active":"2024-04-03T05:13:02.865210+0000","last_peered":"2024-04-03T05:13:02.865210+0000","last_clean":"2024-04-03T05:13:02.865210+0000","last_became_active":"2024-04-03T04:18:51.310903+0000","last_became_peered":"2024-04-03T04:18:51.310903+0000","last_unstale":"2024-04-03T05:13:02.865210+0000","last_undegraded":"2024-04-03T05:13:02.865210+0000","last_fullsized":"2024-04-03T05:13:02.865210+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'4","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.816391+0000","last_change":"2024-04-03T05:14:31.816522+0000","last_active":"2024-04-03T05:14:31.816391+0000","last_peered":"2024-04-03T05:14:31.816391+0000","last_clean":"2024-04-03T05:14:31.816391+0000","last_became_active":"2024-04-03T03:55:53.248897+0000","last_became_peered":"2024-04-03T03:55:53.248897+0000","last_unstale":"2024-04-03T05:14:31.816391+0000","last_undegraded":"2024-04-03T05:14:31.816391+0000","last_fullsized":"2024-04-03T05:14:31.816391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:31.816146+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:31.816146+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.816146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:02:36.972838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.853464+0000","last_change":"2024-04-03T03:55:45.823094+0000","last_active":"2024-04-03T05:12:53.853464+0000","last_peered":"2024-04-03T05:12:53.853464+0000","last_clean":"2024-04-03T05:12:53.853464+0000","last_became_active":"2024-04-03T03:55:45.822406+0000","last_became_peered":"2024-04-03T03:55:45.822406+0000","last_unstale":"2024-04-03T05:12:53.853464+0000","last_undegraded":"2024-04-03T05:12:53.853464+0000","last_fullsized":"2024-04-03T05:12:53.853464+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"263'32","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.310176+0000","last_change":"2024-04-03T05:14:21.310176+0000","last_active":"2024-04-03T05:14:21.310176+0000","last_peered":"2024-04-03T05:14:21.310176+0000","last_clean":"2024-04-03T05:14:21.310176+0000","last_became_active":"2024-04-03T03:49:00.983502+0000","last_became_peered":"2024-04-03T03:49:00.983502+0000","last_unstale":"2024-04-03T05:14:21.310176+0000","last_undegraded":"2024-04-03T05:14:21.310176+0000","last_fullsized":"2024-04-03T05:14:21.310176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-04-03T05:14:21.309909+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-04-03T05:14:21.309909+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.309909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:33:21.060923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":91,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.660045+0000","last_change":"2024-04-03T04:18:51.320361+0000","last_active":"2024-04-03T05:13:03.660045+0000","last_peered":"2024-04-03T05:13:03.660045+0000","last_clean":"2024-04-03T05:13:03.660045+0000","last_became_active":"2024-04-03T04:18:51.319585+0000","last_became_peered":"2024-04-03T04:18:51.319585+0000","last_unstale":"2024-04-03T05:13:03.660045+0000","last_undegraded":"2024-04-03T05:13:03.660045+0000","last_fullsized":"2024-04-03T05:13:03.660045+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:59.036233+0000","last_change":"2024-04-03T03:55:53.254086+0000","last_active":"2024-04-03T05:12:59.036233+0000","last_peered":"2024-04-03T05:12:59.036233+0000","last_clean":"2024-04-03T05:12:59.036233+0000","last_became_active":"2024-04-03T03:55:53.253313+0000","last_became_peered":"2024-04-03T03:55:53.253313+0000","last_unstale":"2024-04-03T05:12:59.036233+0000","last_undegraded":"2024-04-03T05:12:59.036233+0000","last_fullsized":"2024-04-03T05:12:59.036233+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.795872+0000","last_change":"2024-04-03T05:14:18.795955+0000","last_active":"2024-04-03T05:14:18.795872+0000","last_peered":"2024-04-03T05:14:18.795872+0000","last_clean":"2024-04-03T05:14:18.795872+0000","last_became_active":"2024-04-03T03:55:45.820786+0000","last_became_peered":"2024-04-03T03:55:45.820786+0000","last_unstale":"2024-04-03T05:14:18.795872+0000","last_undegraded":"2024-04-03T05:14:18.795872+0000","last_fullsized":"2024-04-03T05:14:18.795872+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:18.795665+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:18.795665+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.795665+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:35:11.045049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"263'69","reported_seq":252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.176593+0000","last_change":"2024-04-03T05:14:18.176593+0000","last_active":"2024-04-03T05:14:18.176593+0000","last_peered":"2024-04-03T05:14:18.176593+0000","last_clean":"2024-04-03T05:14:18.176593+0000","last_became_active":"2024-04-03T03:49:00.961318+0000","last_became_peered":"2024-04-03T03:49:00.961318+0000","last_unstale":"2024-04-03T05:14:18.176593+0000","last_undegraded":"2024-04-03T05:14:18.176593+0000","last_fullsized":"2024-04-03T05:14:18.176593+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'69","last_scrub_stamp":"2024-04-03T05:14:18.176318+0000","last_deep_scrub":"263'69","last_deep_scrub_stamp":"2024-04-03T05:14:18.176318+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.176318+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:57:25.774114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":306,"num_read_kb":217,"num_write":109,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:04.037436+0000","last_change":"2024-04-03T04:18:51.318872+0000","last_active":"2024-04-03T05:13:04.037436+0000","last_peered":"2024-04-03T05:13:04.037436+0000","last_clean":"2024-04-03T05:13:04.037436+0000","last_became_active":"2024-04-03T04:18:51.318123+0000","last_became_peered":"2024-04-03T04:18:51.318123+0000","last_unstale":"2024-04-03T05:13:04.037436+0000","last_undegraded":"2024-04-03T05:13:04.037436+0000","last_fullsized":"2024-04-03T05:13:04.037436+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.572904+0000","last_change":"2024-04-03T05:14:27.572960+0000","last_active":"2024-04-03T05:14:27.572904+0000","last_peered":"2024-04-03T05:14:27.572904+0000","last_clean":"2024-04-03T05:14:27.572904+0000","last_became_active":"2024-04-03T03:55:53.272979+0000","last_became_peered":"2024-04-03T03:55:53.272979+0000","last_unstale":"2024-04-03T05:14:27.572904+0000","last_undegraded":"2024-04-03T05:14:27.572904+0000","last_fullsized":"2024-04-03T05:14:27.572904+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.572704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.572704+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.572704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:55.190017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"258'2","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.383397+0000","last_change":"2024-04-03T05:14:19.383521+0000","last_active":"2024-04-03T05:14:19.383397+0000","last_peered":"2024-04-03T05:14:19.383397+0000","last_clean":"2024-04-03T05:14:19.383397+0000","last_became_active":"2024-04-03T03:55:45.807410+0000","last_became_peered":"2024-04-03T03:55:45.807410+0000","last_unstale":"2024-04-03T05:14:19.383397+0000","last_undegraded":"2024-04-03T05:14:19.383397+0000","last_fullsized":"2024-04-03T05:14:19.383397+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:19.383065+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:19.383065+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.383065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:31.309704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"263'45","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.487332+0000","last_change":"2024-04-03T05:14:32.487398+0000","last_active":"2024-04-03T05:14:32.487332+0000","last_peered":"2024-04-03T05:14:32.487332+0000","last_clean":"2024-04-03T05:14:32.487332+0000","last_became_active":"2024-04-03T03:49:00.978547+0000","last_became_peered":"2024-04-03T03:49:00.978547+0000","last_unstale":"2024-04-03T05:14:32.487332+0000","last_undegraded":"2024-04-03T05:14:32.487332+0000","last_fullsized":"2024-04-03T05:14:32.487332+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'45","last_scrub_stamp":"2024-04-03T05:14:32.487125+0000","last_deep_scrub":"263'45","last_deep_scrub_stamp":"2024-04-03T05:14:32.487125+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.487125+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:30:00.068417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":127,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'414","reported_seq":1107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.632560+0000","last_change":"2024-04-03T03:38:24.754612+0000","last_active":"2024-04-03T05:14:17.632560+0000","last_peered":"2024-04-03T05:14:17.632560+0000","last_clean":"2024-04-03T05:14:17.632560+0000","last_became_active":"2024-04-03T03:38:24.753446+0000","last_became_peered":"2024-04-03T03:38:24.753446+0000","last_unstale":"2024-04-03T05:14:17.632560+0000","last_undegraded":"2024-04-03T05:14:17.632560+0000","last_fullsized":"2024-04-03T05:14:17.632560+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8977164,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":672,"num_read_kb":35431,"num_write":1374,"num_write_kb":27233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'364","reported_seq":1891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.861089+0000","last_change":"2024-04-03T03:38:26.751530+0000","last_active":"2024-04-03T05:13:28.861089+0000","last_peered":"2024-04-03T05:13:28.861089+0000","last_clean":"2024-04-03T05:13:28.861089+0000","last_became_active":"2024-04-03T03:38:26.750879+0000","last_became_peered":"2024-04-03T03:38:26.750879+0000","last_unstale":"2024-04-03T05:13:28.861089+0000","last_undegraded":"2024-04-03T05:13:28.861089+0000","last_fullsized":"2024-04-03T05:13:28.861089+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2014,"num_read_kb":1942,"num_write":406,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'333","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.900715+0000","last_change":"2024-04-03T03:38:24.723229+0000","last_active":"2024-04-03T05:14:14.900715+0000","last_peered":"2024-04-03T05:14:14.900715+0000","last_clean":"2024-04-03T05:14:14.900715+0000","last_became_active":"2024-04-03T03:38:24.722769+0000","last_became_peered":"2024-04-03T03:38:24.722769+0000","last_unstale":"2024-04-03T05:14:14.900715+0000","last_undegraded":"2024-04-03T05:14:14.900715+0000","last_fullsized":"2024-04-03T05:14:14.900715+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586810,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":606,"num_read_kb":76325,"num_write":1300,"num_write_kb":34753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'860","reported_seq":2514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193339+0000","last_change":"2024-04-03T03:38:26.726050+0000","last_active":"2024-04-03T05:13:59.193339+0000","last_peered":"2024-04-03T05:13:59.193339+0000","last_clean":"2024-04-03T05:13:59.193339+0000","last_became_active":"2024-04-03T03:38:26.724640+0000","last_became_peered":"2024-04-03T03:38:26.724640+0000","last_unstale":"2024-04-03T05:13:59.193339+0000","last_undegraded":"2024-04-03T05:13:59.193339+0000","last_fullsized":"2024-04-03T05:13:59.193339+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3968,"num_read_kb":3559,"num_write":1184,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'315","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.448672+0000","last_change":"2024-04-03T03:38:24.711403+0000","last_active":"2024-04-03T05:14:14.448672+0000","last_peered":"2024-04-03T05:14:14.448672+0000","last_clean":"2024-04-03T05:14:14.448672+0000","last_became_active":"2024-04-03T03:38:24.711028+0000","last_became_peered":"2024-04-03T03:38:24.711028+0000","last_unstale":"2024-04-03T05:14:14.448672+0000","last_undegraded":"2024-04-03T05:14:14.448672+0000","last_fullsized":"2024-04-03T05:14:14.448672+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174583,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":16599,"num_write":1026,"num_write_kb":26343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'709","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.665521+0000","last_change":"2024-04-03T03:38:26.750079+0000","last_active":"2024-04-03T05:13:28.665521+0000","last_peered":"2024-04-03T05:13:28.665521+0000","last_clean":"2024-04-03T05:13:28.665521+0000","last_became_active":"2024-04-03T03:38:26.745277+0000","last_became_peered":"2024-04-03T03:38:26.745277+0000","last_unstale":"2024-04-03T05:13:28.665521+0000","last_undegraded":"2024-04-03T05:13:28.665521+0000","last_fullsized":"2024-04-03T05:13:28.665521+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3170,"num_read_kb":2825,"num_write":964,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'389","reported_seq":1101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.545207+0000","last_change":"2024-04-03T03:38:24.757433+0000","last_active":"2024-04-03T05:14:10.545207+0000","last_peered":"2024-04-03T05:14:10.545207+0000","last_clean":"2024-04-03T05:14:10.545207+0000","last_became_active":"2024-04-03T03:38:24.756927+0000","last_became_peered":"2024-04-03T03:38:24.756927+0000","last_unstale":"2024-04-03T05:14:10.545207+0000","last_undegraded":"2024-04-03T05:14:10.545207+0000","last_fullsized":"2024-04-03T05:14:10.545207+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":48559,"num_write":1381,"num_write_kb":35333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'577","reported_seq":2217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.093210+0000","last_change":"2024-04-03T03:38:26.730190+0000","last_active":"2024-04-03T05:13:28.093210+0000","last_peered":"2024-04-03T05:13:28.093210+0000","last_clean":"2024-04-03T05:13:28.093210+0000","last_became_active":"2024-04-03T03:38:26.729866+0000","last_became_peered":"2024-04-03T03:38:26.729866+0000","last_unstale":"2024-04-03T05:13:28.093210+0000","last_undegraded":"2024-04-03T05:13:28.093210+0000","last_fullsized":"2024-04-03T05:13:28.093210+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2799,"num_write":801,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'407","reported_seq":1314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.582990+0000","last_change":"2024-04-03T03:38:24.748987+0000","last_active":"2024-04-03T05:14:10.582990+0000","last_peered":"2024-04-03T05:14:10.582990+0000","last_clean":"2024-04-03T05:14:10.582990+0000","last_became_active":"2024-04-03T03:38:24.748338+0000","last_became_peered":"2024-04-03T03:38:24.748338+0000","last_unstale":"2024-04-03T05:14:10.582990+0000","last_undegraded":"2024-04-03T05:14:10.582990+0000","last_fullsized":"2024-04-03T05:14:10.582990+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1354628,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1249,"num_read_kb":39095,"num_write":1674,"num_write_kb":52242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'478","reported_seq":1926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:49.034033+0000","last_change":"2024-04-03T03:38:26.720548+0000","last_active":"2024-04-03T05:12:49.034033+0000","last_peered":"2024-04-03T05:12:49.034033+0000","last_clean":"2024-04-03T05:12:49.034033+0000","last_became_active":"2024-04-03T03:38:26.719805+0000","last_became_peered":"2024-04-03T03:38:26.719805+0000","last_unstale":"2024-04-03T05:12:49.034033+0000","last_undegraded":"2024-04-03T05:12:49.034033+0000","last_fullsized":"2024-04-03T05:12:49.034033+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2340,"num_read_kb":2138,"num_write":626,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'359","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.564863+0000","last_change":"2024-04-03T03:38:24.754531+0000","last_active":"2024-04-03T05:14:10.564863+0000","last_peered":"2024-04-03T05:14:10.564863+0000","last_clean":"2024-04-03T05:14:10.564863+0000","last_became_active":"2024-04-03T03:38:24.749192+0000","last_became_peered":"2024-04-03T03:38:24.749192+0000","last_unstale":"2024-04-03T05:14:10.564863+0000","last_undegraded":"2024-04-03T05:14:10.564863+0000","last_fullsized":"2024-04-03T05:14:10.564863+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4003555,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":459,"num_read_kb":24946,"num_write":1297,"num_write_kb":50928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'294","reported_seq":1651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.260211+0000","last_change":"2024-04-03T03:38:26.750146+0000","last_active":"2024-04-03T05:14:16.260211+0000","last_peered":"2024-04-03T05:14:16.260211+0000","last_clean":"2024-04-03T05:14:16.260211+0000","last_became_active":"2024-04-03T03:38:26.744762+0000","last_became_peered":"2024-04-03T03:38:26.744762+0000","last_unstale":"2024-04-03T05:14:16.260211+0000","last_undegraded":"2024-04-03T05:14:16.260211+0000","last_fullsized":"2024-04-03T05:14:16.260211+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1674,"num_read_kb":1613,"num_write":327,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'333","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.579889+0000","last_change":"2024-04-03T03:38:24.730594+0000","last_active":"2024-04-03T05:14:10.579889+0000","last_peered":"2024-04-03T05:14:10.579889+0000","last_clean":"2024-04-03T05:14:10.579889+0000","last_became_active":"2024-04-03T03:38:24.728188+0000","last_became_peered":"2024-04-03T03:38:24.728188+0000","last_unstale":"2024-04-03T05:14:10.579889+0000","last_undegraded":"2024-04-03T05:14:10.579889+0000","last_fullsized":"2024-04-03T05:14:10.579889+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149405,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":546,"num_read_kb":30992,"num_write":1174,"num_write_kb":37947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'732","reported_seq":2233,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.712497+0000","last_change":"2024-04-03T03:38:26.722813+0000","last_active":"2024-04-03T05:14:16.712497+0000","last_peered":"2024-04-03T05:14:16.712497+0000","last_clean":"2024-04-03T05:14:16.712497+0000","last_became_active":"2024-04-03T03:38:26.722053+0000","last_became_peered":"2024-04-03T03:38:26.722053+0000","last_unstale":"2024-04-03T05:14:16.712497+0000","last_undegraded":"2024-04-03T05:14:16.712497+0000","last_fullsized":"2024-04-03T05:14:16.712497+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3332,"num_read_kb":2987,"num_write":969,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'347","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.569804+0000","last_change":"2024-04-03T03:38:24.749214+0000","last_active":"2024-04-03T05:14:10.569804+0000","last_peered":"2024-04-03T05:14:10.569804+0000","last_clean":"2024-04-03T05:14:10.569804+0000","last_became_active":"2024-04-03T03:38:24.748669+0000","last_became_peered":"2024-04-03T03:38:24.748669+0000","last_unstale":"2024-04-03T05:14:10.569804+0000","last_undegraded":"2024-04-03T05:14:10.569804+0000","last_fullsized":"2024-04-03T05:14:10.569804+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1960097,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":30925,"num_write":1242,"num_write_kb":34378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'466","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.355292+0000","last_change":"2024-04-03T03:38:26.712374+0000","last_active":"2024-04-03T05:14:15.355292+0000","last_peered":"2024-04-03T05:14:15.355292+0000","last_clean":"2024-04-03T05:14:15.355292+0000","last_became_active":"2024-04-03T03:38:26.711993+0000","last_became_peered":"2024-04-03T03:38:26.711993+0000","last_unstale":"2024-04-03T05:14:15.355292+0000","last_undegraded":"2024-04-03T05:14:15.355292+0000","last_fullsized":"2024-04-03T05:14:15.355292+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2333,"num_write":597,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'427","reported_seq":1882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.673880+0000","last_change":"2024-04-03T03:38:26.741314+0000","last_active":"2024-04-03T05:14:08.673880+0000","last_peered":"2024-04-03T05:14:08.673880+0000","last_clean":"2024-04-03T05:14:08.673880+0000","last_became_active":"2024-04-03T03:38:26.740542+0000","last_became_peered":"2024-04-03T03:38:26.740542+0000","last_unstale":"2024-04-03T05:14:08.673880+0000","last_undegraded":"2024-04-03T05:14:08.673880+0000","last_fullsized":"2024-04-03T05:14:08.673880+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2192,"num_read_kb":2031,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'347","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.544565+0000","last_change":"2024-04-03T03:38:24.762053+0000","last_active":"2024-04-03T05:14:10.544565+0000","last_peered":"2024-04-03T05:14:10.544565+0000","last_clean":"2024-04-03T05:14:10.544565+0000","last_became_active":"2024-04-03T03:38:24.761424+0000","last_became_peered":"2024-04-03T03:38:24.761424+0000","last_unstale":"2024-04-03T05:14:10.544565+0000","last_undegraded":"2024-04-03T05:14:10.544565+0000","last_fullsized":"2024-04-03T05:14:10.544565+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342126,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":4079,"num_write":1247,"num_write_kb":13920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'364","reported_seq":1753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.078080+0000","last_change":"2024-04-03T03:38:26.725447+0000","last_active":"2024-04-03T05:14:09.078080+0000","last_peered":"2024-04-03T05:14:09.078080+0000","last_clean":"2024-04-03T05:14:09.078080+0000","last_became_active":"2024-04-03T03:38:26.723638+0000","last_became_peered":"2024-04-03T03:38:26.723638+0000","last_unstale":"2024-04-03T05:14:09.078080+0000","last_undegraded":"2024-04-03T05:14:09.078080+0000","last_fullsized":"2024-04-03T05:14:09.078080+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1899,"num_read_kb":1790,"num_write":424,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'351","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.579553+0000","last_change":"2024-04-03T03:38:58.351102+0000","last_active":"2024-04-03T05:14:10.579553+0000","last_peered":"2024-04-03T05:14:10.579553+0000","last_clean":"2024-04-03T05:14:10.579553+0000","last_became_active":"2024-04-03T03:38:58.349885+0000","last_became_peered":"2024-04-03T03:38:58.349885+0000","last_unstale":"2024-04-03T05:14:10.579553+0000","last_undegraded":"2024-04-03T05:14:10.579553+0000","last_fullsized":"2024-04-03T05:14:10.579553+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502701,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":66677,"num_write":1253,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'451","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.712410+0000","last_change":"2024-04-03T03:38:26.710365+0000","last_active":"2024-04-03T05:14:16.712410+0000","last_peered":"2024-04-03T05:14:16.712410+0000","last_clean":"2024-04-03T05:14:16.712410+0000","last_became_active":"2024-04-03T03:38:26.709613+0000","last_became_peered":"2024-04-03T03:38:26.709613+0000","last_unstale":"2024-04-03T05:14:16.712410+0000","last_undegraded":"2024-04-03T05:14:16.712410+0000","last_fullsized":"2024-04-03T05:14:16.712410+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2380,"num_write":570,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'353","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.532452+0000","last_change":"2024-04-03T03:38:24.761922+0000","last_active":"2024-04-03T05:14:10.532452+0000","last_peered":"2024-04-03T05:14:10.532452+0000","last_clean":"2024-04-03T05:14:10.532452+0000","last_became_active":"2024-04-03T03:38:24.761284+0000","last_became_peered":"2024-04-03T03:38:24.761284+0000","last_unstale":"2024-04-03T05:14:10.532452+0000","last_undegraded":"2024-04-03T05:14:10.532452+0000","last_fullsized":"2024-04-03T05:14:10.532452+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":65082,"num_write":1201,"num_write_kb":43379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'446","reported_seq":2409,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:42.847086+0000","last_change":"2024-04-03T03:38:26.713266+0000","last_active":"2024-04-03T05:12:42.847086+0000","last_peered":"2024-04-03T05:12:42.847086+0000","last_clean":"2024-04-03T05:12:42.847086+0000","last_became_active":"2024-04-03T03:38:26.711748+0000","last_became_peered":"2024-04-03T03:38:26.711748+0000","last_unstale":"2024-04-03T05:12:42.847086+0000","last_undegraded":"2024-04-03T05:12:42.847086+0000","last_fullsized":"2024-04-03T05:12:42.847086+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2976,"num_read_kb":2877,"num_write":500,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'299","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.539929+0000","last_change":"2024-04-03T03:38:24.744386+0000","last_active":"2024-04-03T05:14:10.539929+0000","last_peered":"2024-04-03T05:14:10.539929+0000","last_clean":"2024-04-03T05:14:10.539929+0000","last_became_active":"2024-04-03T03:38:24.742574+0000","last_became_peered":"2024-04-03T03:38:24.742574+0000","last_unstale":"2024-04-03T05:14:10.539929+0000","last_undegraded":"2024-04-03T05:14:10.539929+0000","last_fullsized":"2024-04-03T05:14:10.539929+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399089,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":46919,"num_write":1114,"num_write_kb":37595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'342","reported_seq":1755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:42.847171+0000","last_change":"2024-04-03T03:38:26.744328+0000","last_active":"2024-04-03T05:12:42.847171+0000","last_peered":"2024-04-03T05:12:42.847171+0000","last_clean":"2024-04-03T05:12:42.847171+0000","last_became_active":"2024-04-03T03:38:26.743735+0000","last_became_peered":"2024-04-03T03:38:26.743735+0000","last_unstale":"2024-04-03T05:12:42.847171+0000","last_undegraded":"2024-04-03T05:12:42.847171+0000","last_fullsized":"2024-04-03T05:12:42.847171+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1802,"num_read_kb":1729,"num_write":383,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'346","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.492241+0000","last_change":"2024-04-03T03:38:24.726007+0000","last_active":"2024-04-03T05:14:10.492241+0000","last_peered":"2024-04-03T05:14:10.492241+0000","last_clean":"2024-04-03T05:14:10.492241+0000","last_became_active":"2024-04-03T03:38:24.725557+0000","last_became_peered":"2024-04-03T03:38:24.725557+0000","last_unstale":"2024-04-03T05:14:10.492241+0000","last_undegraded":"2024-04-03T05:14:10.492241+0000","last_fullsized":"2024-04-03T05:14:10.492241+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456508,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":495,"num_read_kb":4167,"num_write":1155,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'335","reported_seq":1764,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:43.655597+0000","last_change":"2024-04-03T03:38:26.745907+0000","last_active":"2024-04-03T05:12:43.655597+0000","last_peered":"2024-04-03T05:12:43.655597+0000","last_clean":"2024-04-03T05:12:43.655597+0000","last_became_active":"2024-04-03T03:38:26.744977+0000","last_became_peered":"2024-04-03T03:38:26.744977+0000","last_unstale":"2024-04-03T05:12:43.655597+0000","last_undegraded":"2024-04-03T05:12:43.655597+0000","last_fullsized":"2024-04-03T05:12:43.655597+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1755,"num_write":385,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'292","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.448617+0000","last_change":"2024-04-03T03:38:24.725895+0000","last_active":"2024-04-03T05:14:14.448617+0000","last_peered":"2024-04-03T05:14:14.448617+0000","last_clean":"2024-04-03T05:14:14.448617+0000","last_became_active":"2024-04-03T03:38:24.725410+0000","last_became_peered":"2024-04-03T03:38:24.725410+0000","last_unstale":"2024-04-03T05:14:14.448617+0000","last_undegraded":"2024-04-03T05:14:14.448617+0000","last_fullsized":"2024-04-03T05:14:14.448617+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":543,"num_read_kb":79698,"num_write":993,"num_write_kb":41581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'140","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.593760+0000","last_change":"2024-04-03T05:14:25.593823+0000","last_active":"2024-04-03T05:14:25.593760+0000","last_peered":"2024-04-03T05:14:25.593760+0000","last_clean":"2024-04-03T05:14:25.593760+0000","last_became_active":"2024-04-03T03:38:34.738565+0000","last_became_peered":"2024-04-03T03:38:34.738565+0000","last_unstale":"2024-04-03T05:14:25.593760+0000","last_undegraded":"2024-04-03T05:14:25.593760+0000","last_fullsized":"2024-04-03T05:14:25.593760+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-04-03T05:14:25.593574+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-04-03T05:14:25.593574+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.593574+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:12:17.516873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":345,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'373","reported_seq":1834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.038166+0000","last_change":"2024-04-03T05:14:22.038166+0000","last_active":"2024-04-03T05:14:22.038166+0000","last_peered":"2024-04-03T05:14:22.038166+0000","last_clean":"2024-04-03T05:14:22.038166+0000","last_became_active":"2024-04-03T03:39:58.989982+0000","last_became_peered":"2024-04-03T03:39:58.989982+0000","last_unstale":"2024-04-03T05:14:22.038166+0000","last_undegraded":"2024-04-03T05:14:22.038166+0000","last_fullsized":"2024-04-03T05:14:22.038166+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'373","last_scrub_stamp":"2024-04-03T05:14:22.037900+0000","last_deep_scrub":"263'373","last_deep_scrub_stamp":"2024-04-03T05:14:22.037900+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.037900+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:40:14.362011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2119,"num_read_kb":1999,"num_write":436,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'348","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.569260+0000","last_change":"2024-04-03T03:38:24.750884+0000","last_active":"2024-04-03T05:14:10.569260+0000","last_peered":"2024-04-03T05:14:10.569260+0000","last_clean":"2024-04-03T05:14:10.569260+0000","last_became_active":"2024-04-03T03:38:24.750235+0000","last_became_peered":"2024-04-03T03:38:24.750235+0000","last_unstale":"2024-04-03T05:14:10.569260+0000","last_undegraded":"2024-04-03T05:14:10.569260+0000","last_fullsized":"2024-04-03T05:14:10.569260+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":98321,"num_write":1208,"num_write_kb":49383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:43.851263+0000","last_change":"2024-04-03T03:38:28.726652+0000","last_active":"2024-04-03T05:12:43.851263+0000","last_peered":"2024-04-03T05:12:43.851263+0000","last_clean":"2024-04-03T05:12:43.851263+0000","last_became_active":"2024-04-03T03:38:28.725801+0000","last_became_peered":"2024-04-03T03:38:28.725801+0000","last_unstale":"2024-04-03T05:12:43.851263+0000","last_undegraded":"2024-04-03T05:12:43.851263+0000","last_fullsized":"2024-04-03T05:12:43.851263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'348","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.699774+0000","last_change":"2024-04-03T03:38:30.727143+0000","last_active":"2024-04-03T05:14:09.699774+0000","last_peered":"2024-04-03T05:14:09.699774+0000","last_clean":"2024-04-03T05:14:09.699774+0000","last_became_active":"2024-04-03T03:38:30.726684+0000","last_became_peered":"2024-04-03T03:38:30.726684+0000","last_unstale":"2024-04-03T05:14:09.699774+0000","last_undegraded":"2024-04-03T05:14:09.699774+0000","last_fullsized":"2024-04-03T05:14:09.699774+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46296,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":564,"num_read_kb":1147,"num_write":428,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:49.058286+0000","last_change":"2024-04-03T03:38:32.748206+0000","last_active":"2024-04-03T05:12:49.058286+0000","last_peered":"2024-04-03T05:12:49.058286+0000","last_clean":"2024-04-03T05:12:49.058286+0000","last_became_active":"2024-04-03T03:38:32.745434+0000","last_became_peered":"2024-04-03T03:38:32.745434+0000","last_unstale":"2024-04-03T05:12:49.058286+0000","last_undegraded":"2024-04-03T05:12:49.058286+0000","last_fullsized":"2024-04-03T05:12:49.058286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2400","reported_seq":4234,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.260141+0000","last_change":"2024-04-03T05:14:21.260225+0000","last_active":"2024-04-03T05:14:21.260141+0000","last_peered":"2024-04-03T05:14:21.260141+0000","last_clean":"2024-04-03T05:14:21.260141+0000","last_became_active":"2024-04-03T03:38:34.757256+0000","last_became_peered":"2024-04-03T03:38:34.757256+0000","last_unstale":"2024-04-03T05:14:21.260141+0000","last_undegraded":"2024-04-03T05:14:21.260141+0000","last_fullsized":"2024-04-03T05:14:21.260141+0000","mapping_epoch":33,"log_start":"263'2300","ondisk_log_start":"263'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2400","last_scrub_stamp":"2024-04-03T05:14:21.259923+0000","last_deep_scrub":"263'2400","last_deep_scrub_stamp":"2024-04-03T05:14:21.259923+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.259923+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":2300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:05:50.752828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5948,"num_read_kb":5953,"num_write":4769,"num_write_kb":1764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'433","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.183884+0000","last_change":"2024-04-03T03:38:26.725258+0000","last_active":"2024-04-03T05:13:59.183884+0000","last_peered":"2024-04-03T05:13:59.183884+0000","last_clean":"2024-04-03T05:13:59.183884+0000","last_became_active":"2024-04-03T03:38:26.724537+0000","last_became_peered":"2024-04-03T03:38:26.724537+0000","last_unstale":"2024-04-03T05:13:59.183884+0000","last_undegraded":"2024-04-03T05:13:59.183884+0000","last_fullsized":"2024-04-03T05:13:59.183884+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2269,"num_read_kb":2119,"num_write":527,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'354","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.525631+0000","last_change":"2024-04-03T05:14:20.525722+0000","last_active":"2024-04-03T05:14:20.525631+0000","last_peered":"2024-04-03T05:14:20.525631+0000","last_clean":"2024-04-03T05:14:20.525631+0000","last_became_active":"2024-04-03T03:38:57.870251+0000","last_became_peered":"2024-04-03T03:38:57.870251+0000","last_unstale":"2024-04-03T05:14:20.525631+0000","last_undegraded":"2024-04-03T05:14:20.525631+0000","last_fullsized":"2024-04-03T05:14:20.525631+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-04-03T05:14:20.525419+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-04-03T05:14:20.525419+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.525419+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:42:39.785681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":658,"num_read_kb":14924,"num_write":1423,"num_write_kb":20295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.809372+0000","last_change":"2024-04-03T03:38:28.729101+0000","last_active":"2024-04-03T05:14:15.809372+0000","last_peered":"2024-04-03T05:14:15.809372+0000","last_clean":"2024-04-03T05:14:15.809372+0000","last_became_active":"2024-04-03T03:38:28.728632+0000","last_became_peered":"2024-04-03T03:38:28.728632+0000","last_unstale":"2024-04-03T05:14:15.809372+0000","last_undegraded":"2024-04-03T05:14:15.809372+0000","last_fullsized":"2024-04-03T05:14:15.809372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'124","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.715883+0000","last_change":"2024-04-03T05:14:31.715959+0000","last_active":"2024-04-03T05:14:31.715883+0000","last_peered":"2024-04-03T05:14:31.715883+0000","last_clean":"2024-04-03T05:14:31.715883+0000","last_became_active":"2024-04-03T03:38:30.730797+0000","last_became_peered":"2024-04-03T03:38:30.730797+0000","last_unstale":"2024-04-03T05:14:31.715883+0000","last_undegraded":"2024-04-03T05:14:31.715883+0000","last_fullsized":"2024-04-03T05:14:31.715883+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-04-03T05:14:31.715693+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-04-03T05:14:31.715693+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.715693+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:48.930887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":139,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.582186+0000","last_change":"2024-04-03T05:14:26.582301+0000","last_active":"2024-04-03T05:14:26.582186+0000","last_peered":"2024-04-03T05:14:26.582186+0000","last_clean":"2024-04-03T05:14:26.582186+0000","last_became_active":"2024-04-03T03:38:32.732994+0000","last_became_peered":"2024-04-03T03:38:32.732994+0000","last_unstale":"2024-04-03T05:14:26.582186+0000","last_undegraded":"2024-04-03T05:14:26.582186+0000","last_fullsized":"2024-04-03T05:14:26.582186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:26.581951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:26.581951+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.581951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:09:39.194706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'109","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.293430+0000","last_change":"2024-04-03T05:14:28.293503+0000","last_active":"2024-04-03T05:14:28.293430+0000","last_peered":"2024-04-03T05:14:28.293430+0000","last_clean":"2024-04-03T05:14:28.293430+0000","last_became_active":"2024-04-03T03:38:34.746126+0000","last_became_peered":"2024-04-03T03:38:34.746126+0000","last_unstale":"2024-04-03T05:14:28.293430+0000","last_undegraded":"2024-04-03T05:14:28.293430+0000","last_fullsized":"2024-04-03T05:14:28.293430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'109","last_scrub_stamp":"2024-04-03T05:14:28.293256+0000","last_deep_scrub":"263'109","last_deep_scrub_stamp":"2024-04-03T05:14:28.293256+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.293256+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:21:21.785941+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":113,"num_write":252,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'388","reported_seq":1871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:43.084221+0000","last_change":"2024-04-03T03:38:26.725947+0000","last_active":"2024-04-03T05:12:43.084221+0000","last_peered":"2024-04-03T05:12:43.084221+0000","last_clean":"2024-04-03T05:12:43.084221+0000","last_became_active":"2024-04-03T03:38:26.724468+0000","last_became_peered":"2024-04-03T03:38:26.724468+0000","last_unstale":"2024-04-03T05:12:43.084221+0000","last_undegraded":"2024-04-03T05:12:43.084221+0000","last_fullsized":"2024-04-03T05:12:43.084221+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1964,"num_write":459,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'331","reported_seq":1160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.574816+0000","last_change":"2024-04-03T03:38:24.733041+0000","last_active":"2024-04-03T05:14:10.574816+0000","last_peered":"2024-04-03T05:14:10.574816+0000","last_clean":"2024-04-03T05:14:10.574816+0000","last_became_active":"2024-04-03T03:38:24.732182+0000","last_became_peered":"2024-04-03T03:38:24.732182+0000","last_unstale":"2024-04-03T05:14:10.574816+0000","last_undegraded":"2024-04-03T05:14:10.574816+0000","last_fullsized":"2024-04-03T05:14:10.574816+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5549602,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":861,"num_read_kb":9858,"num_write":1206,"num_write_kb":55489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:48.042474+0000","last_change":"2024-04-03T03:38:28.733914+0000","last_active":"2024-04-03T05:12:48.042474+0000","last_peered":"2024-04-03T05:12:48.042474+0000","last_clean":"2024-04-03T05:12:48.042474+0000","last_became_active":"2024-04-03T03:38:28.733142+0000","last_became_peered":"2024-04-03T03:38:28.733142+0000","last_unstale":"2024-04-03T05:12:48.042474+0000","last_undegraded":"2024-04-03T05:12:48.042474+0000","last_fullsized":"2024-04-03T05:12:48.042474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'177","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.513083+0000","last_change":"2024-04-03T05:14:21.513155+0000","last_active":"2024-04-03T05:14:21.513083+0000","last_peered":"2024-04-03T05:14:21.513083+0000","last_clean":"2024-04-03T05:14:21.513083+0000","last_became_active":"2024-04-03T03:38:30.734934+0000","last_became_peered":"2024-04-03T03:38:30.734934+0000","last_unstale":"2024-04-03T05:14:21.513083+0000","last_undegraded":"2024-04-03T05:14:21.513083+0000","last_fullsized":"2024-04-03T05:14:21.513083+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-04-03T05:14:21.512906+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-04-03T05:14:21.512906+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.512906+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:17:22.689201+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'516","reported_seq":2446,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.845032+0000","last_change":"2024-04-03T05:14:30.845096+0000","last_active":"2024-04-03T05:14:30.845032+0000","last_peered":"2024-04-03T05:14:30.845032+0000","last_clean":"2024-04-03T05:14:30.845032+0000","last_became_active":"2024-04-03T03:38:32.748836+0000","last_became_peered":"2024-04-03T03:38:32.748836+0000","last_unstale":"2024-04-03T05:14:30.845032+0000","last_undegraded":"2024-04-03T05:14:30.845032+0000","last_fullsized":"2024-04-03T05:14:30.845032+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'516","last_scrub_stamp":"2024-04-03T05:14:30.844834+0000","last_deep_scrub":"263'516","last_deep_scrub_stamp":"2024-04-03T05:14:30.844834+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.844834+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:48.358869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'105","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.496669+0000","last_change":"2024-04-03T05:14:21.496732+0000","last_active":"2024-04-03T05:14:21.496669+0000","last_peered":"2024-04-03T05:14:21.496669+0000","last_clean":"2024-04-03T05:14:21.496669+0000","last_became_active":"2024-04-03T03:38:34.940390+0000","last_became_peered":"2024-04-03T03:38:34.940390+0000","last_unstale":"2024-04-03T05:14:21.496669+0000","last_undegraded":"2024-04-03T05:14:21.496669+0000","last_fullsized":"2024-04-03T05:14:21.496669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-04-03T05:14:21.496472+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-04-03T05:14:21.496472+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.496472+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:47.773784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'569","reported_seq":2247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:43.041091+0000","last_change":"2024-04-03T03:38:26.718097+0000","last_active":"2024-04-03T05:12:43.041091+0000","last_peered":"2024-04-03T05:12:43.041091+0000","last_clean":"2024-04-03T05:12:43.041091+0000","last_became_active":"2024-04-03T03:38:26.717394+0000","last_became_peered":"2024-04-03T03:38:26.717394+0000","last_unstale":"2024-04-03T05:12:43.041091+0000","last_undegraded":"2024-04-03T05:12:43.041091+0000","last_fullsized":"2024-04-03T05:12:43.041091+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2983,"num_read_kb":2733,"num_write":743,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'339","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.555934+0000","last_change":"2024-04-03T03:38:24.762461+0000","last_active":"2024-04-03T05:14:10.555934+0000","last_peered":"2024-04-03T05:14:10.555934+0000","last_clean":"2024-04-03T05:14:10.555934+0000","last_became_active":"2024-04-03T03:38:24.761913+0000","last_became_peered":"2024-04-03T03:38:24.761913+0000","last_unstale":"2024-04-03T05:14:10.555934+0000","last_undegraded":"2024-04-03T05:14:10.555934+0000","last_fullsized":"2024-04-03T05:14:10.555934+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":83387,"num_write":1167,"num_write_kb":33117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:43.851348+0000","last_change":"2024-04-03T03:38:28.731460+0000","last_active":"2024-04-03T05:12:43.851348+0000","last_peered":"2024-04-03T05:12:43.851348+0000","last_clean":"2024-04-03T05:12:43.851348+0000","last_became_active":"2024-04-03T03:38:28.730711+0000","last_became_peered":"2024-04-03T03:38:28.730711+0000","last_unstale":"2024-04-03T05:12:43.851348+0000","last_undegraded":"2024-04-03T05:12:43.851348+0000","last_fullsized":"2024-04-03T05:12:43.851348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'302","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.282645+0000","last_change":"2024-04-03T03:38:30.825170+0000","last_active":"2024-04-03T05:14:09.282645+0000","last_peered":"2024-04-03T05:14:09.282645+0000","last_clean":"2024-04-03T05:14:09.282645+0000","last_became_active":"2024-04-03T03:38:30.824397+0000","last_became_peered":"2024-04-03T03:38:30.824397+0000","last_unstale":"2024-04-03T05:14:09.282645+0000","last_undegraded":"2024-04-03T05:14:09.282645+0000","last_fullsized":"2024-04-03T05:14:09.282645+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45592,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":493,"num_read_kb":1098,"num_write":394,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'553","reported_seq":4242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.809722+0000","last_change":"2024-04-03T03:38:32.744325+0000","last_active":"2024-04-03T05:14:15.809722+0000","last_peered":"2024-04-03T05:14:15.809722+0000","last_clean":"2024-04-03T05:14:15.809722+0000","last_became_active":"2024-04-03T03:38:32.743645+0000","last_became_peered":"2024-04-03T03:38:32.743645+0000","last_unstale":"2024-04-03T05:14:15.809722+0000","last_undegraded":"2024-04-03T05:14:15.809722+0000","last_fullsized":"2024-04-03T05:14:15.809722+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1050","reported_seq":2429,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.195253+0000","last_change":"2024-04-03T03:38:26.726712+0000","last_active":"2024-04-03T05:13:59.195253+0000","last_peered":"2024-04-03T05:13:59.195253+0000","last_clean":"2024-04-03T05:13:59.195253+0000","last_became_active":"2024-04-03T03:38:26.726039+0000","last_became_peered":"2024-04-03T03:38:26.726039+0000","last_unstale":"2024-04-03T05:13:59.195253+0000","last_undegraded":"2024-04-03T05:13:59.195253+0000","last_fullsized":"2024-04-03T05:13:59.195253+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4374,"num_read_kb":3788,"num_write":1482,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'382","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.574773+0000","last_change":"2024-04-03T03:38:24.754120+0000","last_active":"2024-04-03T05:14:10.574773+0000","last_peered":"2024-04-03T05:14:10.574773+0000","last_clean":"2024-04-03T05:14:10.574773+0000","last_became_active":"2024-04-03T03:38:24.752543+0000","last_became_peered":"2024-04-03T03:38:24.752543+0000","last_unstale":"2024-04-03T05:14:10.574773+0000","last_undegraded":"2024-04-03T05:14:10.574773+0000","last_fullsized":"2024-04-03T05:14:10.574773+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":24937,"num_write":1159,"num_write_kb":21782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:49.071498+0000","last_change":"2024-04-03T03:38:28.738400+0000","last_active":"2024-04-03T05:13:49.071498+0000","last_peered":"2024-04-03T05:13:49.071498+0000","last_clean":"2024-04-03T05:13:49.071498+0000","last_became_active":"2024-04-03T03:38:28.737738+0000","last_became_peered":"2024-04-03T03:38:28.737738+0000","last_unstale":"2024-04-03T05:13:49.071498+0000","last_undegraded":"2024-04-03T05:13:49.071498+0000","last_fullsized":"2024-04-03T05:13:49.071498+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'430","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.347824+0000","last_change":"2024-04-03T05:14:32.347919+0000","last_active":"2024-04-03T05:14:32.347824+0000","last_peered":"2024-04-03T05:14:32.347824+0000","last_clean":"2024-04-03T05:14:32.347824+0000","last_became_active":"2024-04-03T03:38:30.822389+0000","last_became_peered":"2024-04-03T03:38:30.822389+0000","last_unstale":"2024-04-03T05:14:32.347824+0000","last_undegraded":"2024-04-03T05:14:32.347824+0000","last_fullsized":"2024-04-03T05:14:32.347824+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'430","last_scrub_stamp":"2024-04-03T05:14:32.347631+0000","last_deep_scrub":"263'430","last_deep_scrub_stamp":"2024-04-03T05:14:32.347631+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.347631+0000","objects_scrubbed":10,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:40:47.707333+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42966,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":673,"num_read_kb":1254,"num_write":506,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:02.865302+0000","last_change":"2024-04-03T03:38:32.731693+0000","last_active":"2024-04-03T05:13:02.865302+0000","last_peered":"2024-04-03T05:13:02.865302+0000","last_clean":"2024-04-03T05:13:02.865302+0000","last_became_active":"2024-04-03T03:38:32.730901+0000","last_became_peered":"2024-04-03T03:38:32.730901+0000","last_unstale":"2024-04-03T05:13:02.865302+0000","last_undegraded":"2024-04-03T05:13:02.865302+0000","last_fullsized":"2024-04-03T05:13:02.865302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'542","reported_seq":1381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.293225+0000","last_change":"2024-04-03T05:14:25.293225+0000","last_active":"2024-04-03T05:14:25.293225+0000","last_peered":"2024-04-03T05:14:25.293225+0000","last_clean":"2024-04-03T05:14:25.293225+0000","last_became_active":"2024-04-03T03:38:34.754300+0000","last_became_peered":"2024-04-03T03:38:34.754300+0000","last_unstale":"2024-04-03T05:14:25.293225+0000","last_undegraded":"2024-04-03T05:14:25.293225+0000","last_fullsized":"2024-04-03T05:14:25.293225+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'542","last_scrub_stamp":"2024-04-03T05:14:25.292797+0000","last_deep_scrub":"263'542","last_deep_scrub_stamp":"2024-04-03T05:14:25.292797+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.292797+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:23:55.184793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1265,"num_read_kb":1263,"num_write":1135,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'842","reported_seq":2440,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.193786+0000","last_change":"2024-04-03T03:38:26.749563+0000","last_active":"2024-04-03T05:13:59.193786+0000","last_peered":"2024-04-03T05:13:59.193786+0000","last_clean":"2024-04-03T05:13:59.193786+0000","last_became_active":"2024-04-03T03:38:26.742328+0000","last_became_peered":"2024-04-03T03:38:26.742328+0000","last_unstale":"2024-04-03T05:13:59.193786+0000","last_undegraded":"2024-04-03T05:13:59.193786+0000","last_fullsized":"2024-04-03T05:13:59.193786+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3790,"num_read_kb":3360,"num_write":1145,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'387","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.579950+0000","last_change":"2024-04-03T05:14:26.580048+0000","last_active":"2024-04-03T05:14:26.579950+0000","last_peered":"2024-04-03T05:14:26.579950+0000","last_clean":"2024-04-03T05:14:26.579950+0000","last_became_active":"2024-04-03T03:38:58.348120+0000","last_became_peered":"2024-04-03T03:38:58.348120+0000","last_unstale":"2024-04-03T05:14:26.579950+0000","last_undegraded":"2024-04-03T05:14:26.579950+0000","last_fullsized":"2024-04-03T05:14:26.579950+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'387","last_scrub_stamp":"2024-04-03T05:14:26.579740+0000","last_deep_scrub":"263'387","last_deep_scrub_stamp":"2024-04-03T05:14:26.579740+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.579740+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:30:30.667472+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491014,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":692,"num_read_kb":8001,"num_write":1323,"num_write_kb":23217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:52.859024+0000","last_change":"2024-04-03T03:38:28.731205+0000","last_active":"2024-04-03T05:13:52.859024+0000","last_peered":"2024-04-03T05:13:52.859024+0000","last_clean":"2024-04-03T05:13:52.859024+0000","last_became_active":"2024-04-03T03:38:28.729832+0000","last_became_peered":"2024-04-03T03:38:28.729832+0000","last_unstale":"2024-04-03T05:13:52.859024+0000","last_undegraded":"2024-04-03T05:13:52.859024+0000","last_fullsized":"2024-04-03T05:13:52.859024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'312","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.057576+0000","last_change":"2024-04-03T03:38:30.721619+0000","last_active":"2024-04-03T05:14:08.057576+0000","last_peered":"2024-04-03T05:14:08.057576+0000","last_clean":"2024-04-03T05:14:08.057576+0000","last_became_active":"2024-04-03T03:38:30.720884+0000","last_became_peered":"2024-04-03T03:38:30.720884+0000","last_unstale":"2024-04-03T05:14:08.057576+0000","last_undegraded":"2024-04-03T05:14:08.057576+0000","last_fullsized":"2024-04-03T05:14:08.057576+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1184,"num_write":408,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:13.060266+0000","last_change":"2024-04-03T03:38:32.742446+0000","last_active":"2024-04-03T05:14:13.060266+0000","last_peered":"2024-04-03T05:14:13.060266+0000","last_clean":"2024-04-03T05:14:13.060266+0000","last_became_active":"2024-04-03T03:38:32.741770+0000","last_became_peered":"2024-04-03T03:38:32.741770+0000","last_unstale":"2024-04-03T05:14:13.060266+0000","last_undegraded":"2024-04-03T05:14:13.060266+0000","last_fullsized":"2024-04-03T05:14:13.060266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'86","reported_seq":603,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.314571+0000","last_change":"2024-04-03T05:14:32.314643+0000","last_active":"2024-04-03T05:14:32.314571+0000","last_peered":"2024-04-03T05:14:32.314571+0000","last_clean":"2024-04-03T05:14:32.314571+0000","last_became_active":"2024-04-03T03:38:34.733896+0000","last_became_peered":"2024-04-03T03:38:34.733896+0000","last_unstale":"2024-04-03T05:14:32.314571+0000","last_undegraded":"2024-04-03T05:14:32.314571+0000","last_fullsized":"2024-04-03T05:14:32.314571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-04-03T05:14:32.314378+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-04-03T05:14:32.314378+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.314378+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:45.957383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'718","reported_seq":2131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.053609+0000","last_change":"2024-04-03T03:38:26.735283+0000","last_active":"2024-04-03T05:14:09.053609+0000","last_peered":"2024-04-03T05:14:09.053609+0000","last_clean":"2024-04-03T05:14:09.053609+0000","last_became_active":"2024-04-03T03:38:26.734518+0000","last_became_peered":"2024-04-03T03:38:26.734518+0000","last_unstale":"2024-04-03T05:14:09.053609+0000","last_undegraded":"2024-04-03T05:14:09.053609+0000","last_fullsized":"2024-04-03T05:14:09.053609+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3204,"num_read_kb":2862,"num_write":964,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'359","reported_seq":1096,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.582253+0000","last_change":"2024-04-03T03:38:24.759103+0000","last_active":"2024-04-03T05:14:10.582253+0000","last_peered":"2024-04-03T05:14:10.582253+0000","last_clean":"2024-04-03T05:14:10.582253+0000","last_became_active":"2024-04-03T03:38:24.758401+0000","last_became_peered":"2024-04-03T03:38:24.758401+0000","last_unstale":"2024-04-03T05:14:10.582253+0000","last_undegraded":"2024-04-03T05:14:10.582253+0000","last_fullsized":"2024-04-03T05:14:10.582253+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":692,"num_read_kb":12991,"num_write":1287,"num_write_kb":25567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.469176+0000","last_change":"2024-04-03T05:14:31.469228+0000","last_active":"2024-04-03T05:14:31.469176+0000","last_peered":"2024-04-03T05:14:31.469176+0000","last_clean":"2024-04-03T05:14:31.469176+0000","last_became_active":"2024-04-03T03:38:28.731257+0000","last_became_peered":"2024-04-03T03:38:28.731257+0000","last_unstale":"2024-04-03T05:14:31.469176+0000","last_undegraded":"2024-04-03T05:14:31.469176+0000","last_fullsized":"2024-04-03T05:14:31.469176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.468968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.468968+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.468968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:53:21.461796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'339","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.105695+0000","last_change":"2024-04-03T03:38:30.734366+0000","last_active":"2024-04-03T05:14:10.105695+0000","last_peered":"2024-04-03T05:14:10.105695+0000","last_clean":"2024-04-03T05:14:10.105695+0000","last_became_active":"2024-04-03T03:38:30.732417+0000","last_became_peered":"2024-04-03T03:38:30.732417+0000","last_unstale":"2024-04-03T05:14:10.105695+0000","last_undegraded":"2024-04-03T05:14:10.105695+0000","last_fullsized":"2024-04-03T05:14:10.105695+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50822,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":1115,"num_write":422,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'545","reported_seq":3039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.596649+0000","last_change":"2024-04-03T03:38:32.746838+0000","last_active":"2024-04-03T05:14:10.596649+0000","last_peered":"2024-04-03T05:14:10.596649+0000","last_clean":"2024-04-03T05:14:10.596649+0000","last_became_active":"2024-04-03T03:38:32.746029+0000","last_became_peered":"2024-04-03T03:38:32.746029+0000","last_unstale":"2024-04-03T05:14:10.596649+0000","last_undegraded":"2024-04-03T05:14:10.596649+0000","last_fullsized":"2024-04-03T05:14:10.596649+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'95","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.300483+0000","last_change":"2024-04-03T05:14:29.300618+0000","last_active":"2024-04-03T05:14:29.300483+0000","last_peered":"2024-04-03T05:14:29.300483+0000","last_clean":"2024-04-03T05:14:29.300483+0000","last_became_active":"2024-04-03T03:38:34.741505+0000","last_became_peered":"2024-04-03T03:38:34.741505+0000","last_unstale":"2024-04-03T05:14:29.300483+0000","last_undegraded":"2024-04-03T05:14:29.300483+0000","last_fullsized":"2024-04-03T05:14:29.300483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-04-03T05:14:29.300259+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-04-03T05:14:29.300259+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.300259+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:41:52.092733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'443","reported_seq":2124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.191441+0000","last_change":"2024-04-03T03:38:26.732154+0000","last_active":"2024-04-03T05:13:59.191441+0000","last_peered":"2024-04-03T05:13:59.191441+0000","last_clean":"2024-04-03T05:13:59.191441+0000","last_became_active":"2024-04-03T03:38:26.731734+0000","last_became_peered":"2024-04-03T03:38:26.731734+0000","last_unstale":"2024-04-03T05:13:59.191441+0000","last_undegraded":"2024-04-03T05:13:59.191441+0000","last_fullsized":"2024-04-03T05:13:59.191441+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2428,"num_write":531,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'311","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.573978+0000","last_change":"2024-04-03T03:38:24.749540+0000","last_active":"2024-04-03T05:14:10.573978+0000","last_peered":"2024-04-03T05:14:10.573978+0000","last_clean":"2024-04-03T05:14:10.573978+0000","last_became_active":"2024-04-03T03:38:24.748646+0000","last_became_peered":"2024-04-03T03:38:24.748646+0000","last_unstale":"2024-04-03T05:14:10.573978+0000","last_undegraded":"2024-04-03T05:14:10.573978+0000","last_fullsized":"2024-04-03T05:14:10.573978+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262207,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":9924,"num_write":1193,"num_write_kb":21025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"263'6","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.500813+0000","last_change":"2024-04-03T05:14:29.500877+0000","last_active":"2024-04-03T05:14:29.500813+0000","last_peered":"2024-04-03T05:14:29.500813+0000","last_clean":"2024-04-03T05:14:29.500813+0000","last_became_active":"2024-04-03T03:38:28.733096+0000","last_became_peered":"2024-04-03T03:38:28.733096+0000","last_unstale":"2024-04-03T05:14:29.500813+0000","last_undegraded":"2024-04-03T05:14:29.500813+0000","last_fullsized":"2024-04-03T05:14:29.500813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:29.500623+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:29.500623+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.500623+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:45:34.140345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":788,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'502","reported_seq":1185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.257001+0000","last_change":"2024-04-03T03:38:30.730692+0000","last_active":"2024-04-03T05:14:10.257001+0000","last_peered":"2024-04-03T05:14:10.257001+0000","last_clean":"2024-04-03T05:14:10.257001+0000","last_became_active":"2024-04-03T03:38:30.729624+0000","last_became_peered":"2024-04-03T03:38:30.729624+0000","last_unstale":"2024-04-03T05:14:10.257001+0000","last_undegraded":"2024-04-03T05:14:10.257001+0000","last_fullsized":"2024-04-03T05:14:10.257001+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99740,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":863,"num_read_kb":2054,"num_write":690,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.563232+0000","last_change":"2024-04-03T05:14:18.563335+0000","last_active":"2024-04-03T05:14:18.563232+0000","last_peered":"2024-04-03T05:14:18.563232+0000","last_clean":"2024-04-03T05:14:18.563232+0000","last_became_active":"2024-04-03T03:38:32.746634+0000","last_became_peered":"2024-04-03T03:38:32.746634+0000","last_unstale":"2024-04-03T05:14:18.563232+0000","last_undegraded":"2024-04-03T05:14:18.563232+0000","last_fullsized":"2024-04-03T05:14:18.563232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:18.563005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:18.563005+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.563005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:17.147799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'92","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.597309+0000","last_change":"2024-04-03T05:14:26.597470+0000","last_active":"2024-04-03T05:14:26.597309+0000","last_peered":"2024-04-03T05:14:26.597309+0000","last_clean":"2024-04-03T05:14:26.597309+0000","last_became_active":"2024-04-03T03:38:34.730714+0000","last_became_peered":"2024-04-03T03:38:34.730714+0000","last_unstale":"2024-04-03T05:14:26.597309+0000","last_undegraded":"2024-04-03T05:14:26.597309+0000","last_fullsized":"2024-04-03T05:14:26.597309+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-04-03T05:14:26.597062+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-04-03T05:14:26.597062+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.597062+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:36.950593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":214,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'708","reported_seq":2251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.445488+0000","last_change":"2024-04-03T05:14:19.445558+0000","last_active":"2024-04-03T05:14:19.445488+0000","last_peered":"2024-04-03T05:14:19.445488+0000","last_clean":"2024-04-03T05:14:19.445488+0000","last_became_active":"2024-04-03T03:39:58.684099+0000","last_became_peered":"2024-04-03T03:39:58.684099+0000","last_unstale":"2024-04-03T05:14:19.445488+0000","last_undegraded":"2024-04-03T05:14:19.445488+0000","last_fullsized":"2024-04-03T05:14:19.445488+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'708","last_scrub_stamp":"2024-04-03T05:14:19.445286+0000","last_deep_scrub":"263'708","last_deep_scrub_stamp":"2024-04-03T05:14:19.445286+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.445286+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:37:12.157533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3233,"num_read_kb":2920,"num_write":926,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'339","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.492469+0000","last_change":"2024-04-03T05:14:22.492712+0000","last_active":"2024-04-03T05:14:22.492469+0000","last_peered":"2024-04-03T05:14:22.492469+0000","last_clean":"2024-04-03T05:14:22.492469+0000","last_became_active":"2024-04-03T03:38:57.880334+0000","last_became_peered":"2024-04-03T03:38:57.880334+0000","last_unstale":"2024-04-03T05:14:22.492469+0000","last_undegraded":"2024-04-03T05:14:22.492469+0000","last_fullsized":"2024-04-03T05:14:22.492469+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-04-03T05:14:22.492212+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-04-03T05:14:22.492212+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.492212+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:58:23.552426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263916,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":538,"num_read_kb":83385,"num_write":1176,"num_write_kb":48172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.536505+0000","last_change":"2024-04-03T05:14:25.536556+0000","last_active":"2024-04-03T05:14:25.536505+0000","last_peered":"2024-04-03T05:14:25.536505+0000","last_clean":"2024-04-03T05:14:25.536505+0000","last_became_active":"2024-04-03T03:38:28.735217+0000","last_became_peered":"2024-04-03T03:38:28.735217+0000","last_unstale":"2024-04-03T05:14:25.536505+0000","last_undegraded":"2024-04-03T05:14:25.536505+0000","last_fullsized":"2024-04-03T05:14:25.536505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:25.536310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:25.536310+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.536310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:06:47.226136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'347","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.735754+0000","last_change":"2024-04-03T03:38:30.717823+0000","last_active":"2024-04-03T05:14:08.735754+0000","last_peered":"2024-04-03T05:14:08.735754+0000","last_clean":"2024-04-03T05:14:08.735754+0000","last_became_active":"2024-04-03T03:38:30.716983+0000","last_became_peered":"2024-04-03T03:38:30.716983+0000","last_unstale":"2024-04-03T05:14:08.735754+0000","last_undegraded":"2024-04-03T05:14:08.735754+0000","last_fullsized":"2024-04-03T05:14:08.735754+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56711,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":610,"num_read_kb":1386,"num_write":534,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.093309+0000","last_change":"2024-04-03T03:38:32.738099+0000","last_active":"2024-04-03T05:13:28.093309+0000","last_peered":"2024-04-03T05:13:28.093309+0000","last_clean":"2024-04-03T05:13:28.093309+0000","last_became_active":"2024-04-03T03:38:32.737619+0000","last_became_peered":"2024-04-03T03:38:32.737619+0000","last_unstale":"2024-04-03T05:13:28.093309+0000","last_undegraded":"2024-04-03T05:13:28.093309+0000","last_fullsized":"2024-04-03T05:13:28.093309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'105","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.123058+0000","last_change":"2024-04-03T05:14:29.123126+0000","last_active":"2024-04-03T05:14:29.123058+0000","last_peered":"2024-04-03T05:14:29.123058+0000","last_clean":"2024-04-03T05:14:29.123058+0000","last_became_active":"2024-04-03T03:38:34.754907+0000","last_became_peered":"2024-04-03T03:38:34.754907+0000","last_unstale":"2024-04-03T05:14:29.123058+0000","last_undegraded":"2024-04-03T05:14:29.123058+0000","last_fullsized":"2024-04-03T05:14:29.123058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-04-03T05:14:29.122845+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-04-03T05:14:29.122845+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.122845+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:57.447948+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":237,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'876","reported_seq":2631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.659013+0000","last_change":"2024-04-03T03:38:26.741422+0000","last_active":"2024-04-03T05:12:58.659013+0000","last_peered":"2024-04-03T05:12:58.659013+0000","last_clean":"2024-04-03T05:12:58.659013+0000","last_became_active":"2024-04-03T03:38:26.740674+0000","last_became_peered":"2024-04-03T03:38:26.740674+0000","last_unstale":"2024-04-03T05:12:58.659013+0000","last_undegraded":"2024-04-03T05:12:58.659013+0000","last_fullsized":"2024-04-03T05:12:58.659013+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4230,"num_read_kb":3805,"num_write":1201,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'306","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.527128+0000","last_change":"2024-04-03T05:14:24.527258+0000","last_active":"2024-04-03T05:14:24.527128+0000","last_peered":"2024-04-03T05:14:24.527128+0000","last_clean":"2024-04-03T05:14:24.527128+0000","last_became_active":"2024-04-03T03:38:58.344044+0000","last_became_peered":"2024-04-03T03:38:58.344044+0000","last_unstale":"2024-04-03T05:14:24.527128+0000","last_undegraded":"2024-04-03T05:14:24.527128+0000","last_fullsized":"2024-04-03T05:14:24.527128+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-04-03T05:14:24.526901+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-04-03T05:14:24.526901+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.526901+0000","objects_scrubbed":14,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:03.910729+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6735876,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":460,"num_read_kb":45119,"num_write":1136,"num_write_kb":60620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.619699+0000","last_change":"2024-04-03T05:14:31.619805+0000","last_active":"2024-04-03T05:14:31.619699+0000","last_peered":"2024-04-03T05:14:31.619699+0000","last_clean":"2024-04-03T05:14:31.619699+0000","last_became_active":"2024-04-03T03:38:28.715394+0000","last_became_peered":"2024-04-03T03:38:28.715394+0000","last_unstale":"2024-04-03T05:14:31.619699+0000","last_undegraded":"2024-04-03T05:14:31.619699+0000","last_fullsized":"2024-04-03T05:14:31.619699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.619467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.619467+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.619467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:50:24.136880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'342","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.542366+0000","last_change":"2024-04-03T05:14:23.542474+0000","last_active":"2024-04-03T05:14:23.542366+0000","last_peered":"2024-04-03T05:14:23.542366+0000","last_clean":"2024-04-03T05:14:23.542366+0000","last_became_active":"2024-04-03T03:38:30.733001+0000","last_became_peered":"2024-04-03T03:38:30.733001+0000","last_unstale":"2024-04-03T05:14:23.542366+0000","last_undegraded":"2024-04-03T05:14:23.542366+0000","last_fullsized":"2024-04-03T05:14:23.542366+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-04-03T05:14:23.542156+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-04-03T05:14:23.542156+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.542156+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:43:59.797131+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1151,"num_write":432,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'500","reported_seq":2377,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.539449+0000","last_change":"2024-04-03T05:14:19.539513+0000","last_active":"2024-04-03T05:14:19.539449+0000","last_peered":"2024-04-03T05:14:19.539449+0000","last_clean":"2024-04-03T05:14:19.539449+0000","last_became_active":"2024-04-03T03:38:32.740883+0000","last_became_peered":"2024-04-03T03:38:32.740883+0000","last_unstale":"2024-04-03T05:14:19.539449+0000","last_undegraded":"2024-04-03T05:14:19.539449+0000","last_fullsized":"2024-04-03T05:14:19.539449+0000","mapping_epoch":31,"log_start":"258'400","ondisk_log_start":"258'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'500","last_scrub_stamp":"2024-04-03T05:14:19.539252+0000","last_deep_scrub":"263'500","last_deep_scrub_stamp":"2024-04-03T05:14:19.539252+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.539252+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:02:16.078882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'93","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.635841+0000","last_change":"2024-04-03T05:14:25.635841+0000","last_active":"2024-04-03T05:14:25.635841+0000","last_peered":"2024-04-03T05:14:25.635841+0000","last_clean":"2024-04-03T05:14:25.635841+0000","last_became_active":"2024-04-03T03:38:34.748128+0000","last_became_peered":"2024-04-03T03:38:34.748128+0000","last_unstale":"2024-04-03T05:14:25.635841+0000","last_undegraded":"2024-04-03T05:14:25.635841+0000","last_fullsized":"2024-04-03T05:14:25.635841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'93","last_scrub_stamp":"2024-04-03T05:14:25.635545+0000","last_deep_scrub":"263'93","last_deep_scrub_stamp":"2024-04-03T05:14:25.635545+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.635545+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:51:27.121684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":229,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'412","reported_seq":1932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.659042+0000","last_change":"2024-04-03T03:38:26.746310+0000","last_active":"2024-04-03T05:12:58.659042+0000","last_peered":"2024-04-03T05:12:58.659042+0000","last_clean":"2024-04-03T05:12:58.659042+0000","last_became_active":"2024-04-03T03:38:26.742254+0000","last_became_peered":"2024-04-03T03:38:26.742254+0000","last_unstale":"2024-04-03T05:12:58.659042+0000","last_undegraded":"2024-04-03T05:12:58.659042+0000","last_fullsized":"2024-04-03T05:12:58.659042+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2115,"num_read_kb":2003,"num_write":485,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'358","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.550500+0000","last_change":"2024-04-03T03:38:24.713564+0000","last_active":"2024-04-03T05:14:10.550500+0000","last_peered":"2024-04-03T05:14:10.550500+0000","last_clean":"2024-04-03T05:14:10.550500+0000","last_became_active":"2024-04-03T03:38:24.710396+0000","last_became_peered":"2024-04-03T03:38:24.710396+0000","last_unstale":"2024-04-03T05:14:10.550500+0000","last_undegraded":"2024-04-03T05:14:10.550500+0000","last_fullsized":"2024-04-03T05:14:10.550500+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288129,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":39636,"num_write":1279,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.481669+0000","last_change":"2024-04-03T03:38:28.735630+0000","last_active":"2024-04-03T05:14:07.481669+0000","last_peered":"2024-04-03T05:14:07.481669+0000","last_clean":"2024-04-03T05:14:07.481669+0000","last_became_active":"2024-04-03T03:38:28.734894+0000","last_became_peered":"2024-04-03T03:38:28.734894+0000","last_unstale":"2024-04-03T05:14:07.481669+0000","last_undegraded":"2024-04-03T05:14:07.481669+0000","last_fullsized":"2024-04-03T05:14:07.481669+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":632,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'126","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.046299+0000","last_change":"2024-04-03T03:38:30.822812+0000","last_active":"2024-04-03T05:13:03.046299+0000","last_peered":"2024-04-03T05:13:03.046299+0000","last_clean":"2024-04-03T05:13:03.046299+0000","last_became_active":"2024-04-03T03:38:30.821224+0000","last_became_peered":"2024-04-03T03:38:30.821224+0000","last_unstale":"2024-04-03T05:13:03.046299+0000","last_undegraded":"2024-04-03T05:13:03.046299+0000","last_fullsized":"2024-04-03T05:13:03.046299+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'526","reported_seq":2482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.280786+0000","last_change":"2024-04-03T05:14:30.280848+0000","last_active":"2024-04-03T05:14:30.280786+0000","last_peered":"2024-04-03T05:14:30.280786+0000","last_clean":"2024-04-03T05:14:30.280786+0000","last_became_active":"2024-04-03T03:38:32.747078+0000","last_became_peered":"2024-04-03T03:38:32.747078+0000","last_unstale":"2024-04-03T05:14:30.280786+0000","last_undegraded":"2024-04-03T05:14:30.280786+0000","last_fullsized":"2024-04-03T05:14:30.280786+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'526","last_scrub_stamp":"2024-04-03T05:14:30.280590+0000","last_deep_scrub":"263'526","last_deep_scrub_stamp":"2024-04-03T05:14:30.280590+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.280590+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:41.204577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'100","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.533167+0000","last_change":"2024-04-03T05:14:23.533167+0000","last_active":"2024-04-03T05:14:23.533167+0000","last_peered":"2024-04-03T05:14:23.533167+0000","last_clean":"2024-04-03T05:14:23.533167+0000","last_became_active":"2024-04-03T03:38:34.739554+0000","last_became_peered":"2024-04-03T03:38:34.739554+0000","last_unstale":"2024-04-03T05:14:23.533167+0000","last_undegraded":"2024-04-03T05:14:23.533167+0000","last_fullsized":"2024-04-03T05:14:23.533167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'100","last_scrub_stamp":"2024-04-03T05:14:23.532876+0000","last_deep_scrub":"263'100","last_deep_scrub_stamp":"2024-04-03T05:14:23.532876+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.532876+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:47.184410+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'348","reported_seq":1762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.611008+0000","last_change":"2024-04-03T05:14:30.611179+0000","last_active":"2024-04-03T05:14:30.611008+0000","last_peered":"2024-04-03T05:14:30.611008+0000","last_clean":"2024-04-03T05:14:30.611008+0000","last_became_active":"2024-04-03T03:38:26.729241+0000","last_became_peered":"2024-04-03T03:38:26.729241+0000","last_unstale":"2024-04-03T05:14:30.611008+0000","last_undegraded":"2024-04-03T05:14:30.611008+0000","last_fullsized":"2024-04-03T05:14:30.611008+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-04-03T05:14:30.610796+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-04-03T05:14:30.610796+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.610796+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:09:37.419874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1840,"num_read_kb":1751,"num_write":396,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'307","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.544844+0000","last_change":"2024-04-03T03:38:24.715501+0000","last_active":"2024-04-03T05:14:10.544844+0000","last_peered":"2024-04-03T05:14:10.544844+0000","last_clean":"2024-04-03T05:14:10.544844+0000","last_became_active":"2024-04-03T03:38:24.709105+0000","last_became_peered":"2024-04-03T03:38:24.709105+0000","last_unstale":"2024-04-03T05:14:10.544844+0000","last_undegraded":"2024-04-03T05:14:10.544844+0000","last_fullsized":"2024-04-03T05:14:10.544844+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2161470,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":67615,"num_write":1075,"num_write_kb":19160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.659070+0000","last_change":"2024-04-03T03:38:28.730578+0000","last_active":"2024-04-03T05:12:58.659070+0000","last_peered":"2024-04-03T05:12:58.659070+0000","last_clean":"2024-04-03T05:12:58.659070+0000","last_became_active":"2024-04-03T03:38:28.729835+0000","last_became_peered":"2024-04-03T03:38:28.729835+0000","last_unstale":"2024-04-03T05:12:58.659070+0000","last_undegraded":"2024-04-03T05:12:58.659070+0000","last_fullsized":"2024-04-03T05:12:58.659070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'519","reported_seq":1189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.380435+0000","last_change":"2024-04-03T05:14:33.380521+0000","last_active":"2024-04-03T05:14:33.380435+0000","last_peered":"2024-04-03T05:14:33.380435+0000","last_clean":"2024-04-03T05:14:33.380435+0000","last_became_active":"2024-04-03T03:38:30.729797+0000","last_became_peered":"2024-04-03T03:38:30.729797+0000","last_unstale":"2024-04-03T05:14:33.380435+0000","last_undegraded":"2024-04-03T05:14:33.380435+0000","last_fullsized":"2024-04-03T05:14:33.380435+0000","mapping_epoch":29,"log_start":"263'500","ondisk_log_start":"263'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'519","last_scrub_stamp":"2024-04-03T05:14:33.380246+0000","last_deep_scrub":"263'519","last_deep_scrub_stamp":"2024-04-03T05:14:33.380246+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.380246+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:28:22.253810+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1388,"num_read_kb":1975,"num_write":1982,"num_write_kb":1776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":480474,"num_omap_keys":1112,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.264992+0000","last_change":"2024-04-03T05:14:24.265046+0000","last_active":"2024-04-03T05:14:24.264992+0000","last_peered":"2024-04-03T05:14:24.264992+0000","last_clean":"2024-04-03T05:14:24.264992+0000","last_became_active":"2024-04-03T03:38:32.738974+0000","last_became_peered":"2024-04-03T03:38:32.738974+0000","last_unstale":"2024-04-03T05:14:24.264992+0000","last_undegraded":"2024-04-03T05:14:24.264992+0000","last_fullsized":"2024-04-03T05:14:24.264992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:24.264793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:24.264793+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.264793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:39:12.004063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'127","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.621498+0000","last_change":"2024-04-03T05:14:24.621498+0000","last_active":"2024-04-03T05:14:24.621498+0000","last_peered":"2024-04-03T05:14:24.621498+0000","last_clean":"2024-04-03T05:14:24.621498+0000","last_became_active":"2024-04-03T03:38:34.755358+0000","last_became_peered":"2024-04-03T03:38:34.755358+0000","last_unstale":"2024-04-03T05:14:24.621498+0000","last_undegraded":"2024-04-03T05:14:24.621498+0000","last_fullsized":"2024-04-03T05:14:24.621498+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-04-03T05:14:24.621251+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-04-03T05:14:24.621251+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.621251+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:00:25.765195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":275,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'755","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:34.030685+0000","last_change":"2024-04-03T03:38:26.748524+0000","last_active":"2024-04-03T05:12:34.030685+0000","last_peered":"2024-04-03T05:12:34.030685+0000","last_clean":"2024-04-03T05:12:34.030685+0000","last_became_active":"2024-04-03T03:38:26.747883+0000","last_became_peered":"2024-04-03T03:38:26.747883+0000","last_unstale":"2024-04-03T05:12:34.030685+0000","last_undegraded":"2024-04-03T05:12:34.030685+0000","last_fullsized":"2024-04-03T05:12:34.030685+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3405,"num_read_kb":3046,"num_write":999,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.631934+0000","last_change":"2024-04-03T03:38:04.257665+0000","last_active":"2024-04-03T05:14:17.631934+0000","last_peered":"2024-04-03T05:14:17.631934+0000","last_clean":"2024-04-03T05:14:17.631934+0000","last_became_active":"2024-04-03T03:38:04.255147+0000","last_became_peered":"2024-04-03T03:38:04.255147+0000","last_unstale":"2024-04-03T05:14:17.631934+0000","last_undegraded":"2024-04-03T05:14:17.631934+0000","last_fullsized":"2024-04-03T05:14:17.631934+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:03.047546+0000","last_clean_scrub_stamp":"2024-04-03T03:38:03.047546+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:03.869788+0000","last_change":"2024-04-03T03:38:11.616774+0000","last_active":"2024-04-03T05:14:03.869788+0000","last_peered":"2024-04-03T05:14:03.869788+0000","last_clean":"2024-04-03T05:14:03.869788+0000","last_became_active":"2024-04-03T03:38:11.615990+0000","last_became_peered":"2024-04-03T03:38:11.615990+0000","last_unstale":"2024-04-03T05:14:03.869788+0000","last_undegraded":"2024-04-03T05:14:03.869788+0000","last_fullsized":"2024-04-03T05:14:03.869788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'273","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.808879+0000","last_change":"2024-04-03T03:38:24.759919+0000","last_active":"2024-04-03T05:14:15.808879+0000","last_peered":"2024-04-03T05:14:15.808879+0000","last_clean":"2024-04-03T05:14:15.808879+0000","last_became_active":"2024-04-03T03:38:24.759653+0000","last_became_peered":"2024-04-03T03:38:24.759653+0000","last_unstale":"2024-04-03T05:14:15.808879+0000","last_undegraded":"2024-04-03T05:14:15.808879+0000","last_fullsized":"2024-04-03T05:14:15.808879+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5305714,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":451,"num_read_kb":37025,"num_write":1084,"num_write_kb":41578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.632807+0000","last_change":"2024-04-03T03:38:28.738201+0000","last_active":"2024-04-03T05:14:17.632807+0000","last_peered":"2024-04-03T05:14:17.632807+0000","last_clean":"2024-04-03T05:14:17.632807+0000","last_became_active":"2024-04-03T03:38:28.735507+0000","last_became_peered":"2024-04-03T03:38:28.735507+0000","last_unstale":"2024-04-03T05:14:17.632807+0000","last_undegraded":"2024-04-03T05:14:17.632807+0000","last_fullsized":"2024-04-03T05:14:17.632807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'739","reported_seq":1483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.516339+0000","last_change":"2024-04-03T03:38:30.723361+0000","last_active":"2024-04-03T05:14:10.516339+0000","last_peered":"2024-04-03T05:14:10.516339+0000","last_clean":"2024-04-03T05:14:10.516339+0000","last_became_active":"2024-04-03T03:38:30.722613+0000","last_became_peered":"2024-04-03T03:38:30.722613+0000","last_unstale":"2024-04-03T05:14:10.516339+0000","last_undegraded":"2024-04-03T05:14:10.516339+0000","last_fullsized":"2024-04-03T05:14:10.516339+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1443,"num_read_kb":3262,"num_write":1372,"num_write_kb":1187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.098393+0000","last_change":"2024-04-03T03:38:32.747059+0000","last_active":"2024-04-03T05:13:53.098393+0000","last_peered":"2024-04-03T05:13:53.098393+0000","last_clean":"2024-04-03T05:13:53.098393+0000","last_became_active":"2024-04-03T03:38:32.746148+0000","last_became_peered":"2024-04-03T03:38:32.746148+0000","last_unstale":"2024-04-03T05:13:53.098393+0000","last_undegraded":"2024-04-03T05:13:53.098393+0000","last_fullsized":"2024-04-03T05:13:53.098393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'114","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.051316+0000","last_change":"2024-04-03T03:38:34.761254+0000","last_active":"2024-04-03T05:13:59.051316+0000","last_peered":"2024-04-03T05:13:59.051316+0000","last_clean":"2024-04-03T05:13:59.051316+0000","last_became_active":"2024-04-03T03:38:34.760522+0000","last_became_peered":"2024-04-03T03:38:34.760522+0000","last_unstale":"2024-04-03T05:13:59.051316+0000","last_undegraded":"2024-04-03T05:13:59.051316+0000","last_fullsized":"2024-04-03T05:13:59.051316+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":148,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'705","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:48.097084+0000","last_change":"2024-04-03T03:38:26.726518+0000","last_active":"2024-04-03T05:13:48.097084+0000","last_peered":"2024-04-03T05:13:48.097084+0000","last_clean":"2024-04-03T05:13:48.097084+0000","last_became_active":"2024-04-03T03:38:26.725330+0000","last_became_peered":"2024-04-03T03:38:26.725330+0000","last_unstale":"2024-04-03T05:13:48.097084+0000","last_undegraded":"2024-04-03T05:13:48.097084+0000","last_fullsized":"2024-04-03T05:13:48.097084+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":600,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3168,"num_read_kb":2822,"num_write":954,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:39.055784+0000","last_change":"2024-04-03T03:38:11.620060+0000","last_active":"2024-04-03T05:12:39.055784+0000","last_peered":"2024-04-03T05:12:39.055784+0000","last_clean":"2024-04-03T05:12:39.055784+0000","last_became_active":"2024-04-03T03:38:11.619474+0000","last_became_peered":"2024-04-03T03:38:11.619474+0000","last_unstale":"2024-04-03T05:12:39.055784+0000","last_undegraded":"2024-04-03T05:12:39.055784+0000","last_fullsized":"2024-04-03T05:12:39.055784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'329","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.448363+0000","last_change":"2024-04-03T03:38:24.745584+0000","last_active":"2024-04-03T05:14:14.448363+0000","last_peered":"2024-04-03T05:14:14.448363+0000","last_clean":"2024-04-03T05:14:14.448363+0000","last_became_active":"2024-04-03T03:38:24.745231+0000","last_became_peered":"2024-04-03T03:38:24.745231+0000","last_unstale":"2024-04-03T05:14:14.448363+0000","last_undegraded":"2024-04-03T05:14:14.448363+0000","last_fullsized":"2024-04-03T05:14:14.448363+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":22150,"num_write":1160,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:48.865862+0000","last_change":"2024-04-03T03:38:28.741133+0000","last_active":"2024-04-03T05:13:48.865862+0000","last_peered":"2024-04-03T05:13:48.865862+0000","last_clean":"2024-04-03T05:13:48.865862+0000","last_became_active":"2024-04-03T03:38:28.740595+0000","last_became_peered":"2024-04-03T03:38:28.740595+0000","last_unstale":"2024-04-03T05:13:48.865862+0000","last_undegraded":"2024-04-03T05:13:48.865862+0000","last_fullsized":"2024-04-03T05:13:48.865862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1191","reported_seq":3247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.900972+0000","last_change":"2024-04-03T03:38:30.725691+0000","last_active":"2024-04-03T05:14:14.900972+0000","last_peered":"2024-04-03T05:14:14.900972+0000","last_clean":"2024-04-03T05:14:14.900972+0000","last_became_active":"2024-04-03T03:38:30.719511+0000","last_became_peered":"2024-04-03T03:38:30.719511+0000","last_unstale":"2024-04-03T05:14:14.900972+0000","last_undegraded":"2024-04-03T05:14:14.900972+0000","last_fullsized":"2024-04-03T05:14:14.900972+0000","mapping_epoch":29,"log_start":"263'1100","ondisk_log_start":"263'1100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":1100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152942,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1863,"num_read_kb":3633,"num_write":1216,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.774444+0000","last_change":"2024-04-03T05:14:32.774498+0000","last_active":"2024-04-03T05:14:32.774444+0000","last_peered":"2024-04-03T05:14:32.774444+0000","last_clean":"2024-04-03T05:14:32.774444+0000","last_became_active":"2024-04-03T03:38:32.748061+0000","last_became_peered":"2024-04-03T03:38:32.748061+0000","last_unstale":"2024-04-03T05:14:32.774444+0000","last_undegraded":"2024-04-03T05:14:32.774444+0000","last_fullsized":"2024-04-03T05:14:32.774444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:32.774243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:32.774243+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.774243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:08.272229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'165","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.594652+0000","last_change":"2024-04-03T05:14:22.594652+0000","last_active":"2024-04-03T05:14:22.594652+0000","last_peered":"2024-04-03T05:14:22.594652+0000","last_clean":"2024-04-03T05:14:22.594652+0000","last_became_active":"2024-04-03T03:38:34.936635+0000","last_became_peered":"2024-04-03T03:38:34.936635+0000","last_unstale":"2024-04-03T05:14:22.594652+0000","last_undegraded":"2024-04-03T05:14:22.594652+0000","last_fullsized":"2024-04-03T05:14:22.594652+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'165","last_scrub_stamp":"2024-04-03T05:14:22.594244+0000","last_deep_scrub":"263'165","last_deep_scrub_stamp":"2024-04-03T05:14:22.594244+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.594244+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:31:56.893087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":219,"num_write":382,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'394","reported_seq":1831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.188793+0000","last_change":"2024-04-03T03:38:26.722334+0000","last_active":"2024-04-03T05:13:59.188793+0000","last_peered":"2024-04-03T05:13:59.188793+0000","last_clean":"2024-04-03T05:13:59.188793+0000","last_became_active":"2024-04-03T03:38:26.721536+0000","last_became_peered":"2024-04-03T03:38:26.721536+0000","last_unstale":"2024-04-03T05:13:59.188793+0000","last_undegraded":"2024-04-03T05:13:59.188793+0000","last_fullsized":"2024-04-03T05:13:59.188793+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2077,"num_read_kb":1939,"num_write":478,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:02.861363+0000","last_change":"2024-04-03T03:38:11.755773+0000","last_active":"2024-04-03T05:14:02.861363+0000","last_peered":"2024-04-03T05:14:02.861363+0000","last_clean":"2024-04-03T05:14:02.861363+0000","last_became_active":"2024-04-03T03:38:11.755301+0000","last_became_peered":"2024-04-03T03:38:11.755301+0000","last_unstale":"2024-04-03T05:14:02.861363+0000","last_undegraded":"2024-04-03T05:14:02.861363+0000","last_fullsized":"2024-04-03T05:14:02.861363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'314","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.562537+0000","last_change":"2024-04-03T03:38:24.720942+0000","last_active":"2024-04-03T05:14:10.562537+0000","last_peered":"2024-04-03T05:14:10.562537+0000","last_clean":"2024-04-03T05:14:10.562537+0000","last_became_active":"2024-04-03T03:38:24.720445+0000","last_became_peered":"2024-04-03T03:38:24.720445+0000","last_unstale":"2024-04-03T05:14:10.562537+0000","last_undegraded":"2024-04-03T05:14:10.562537+0000","last_fullsized":"2024-04-03T05:14:10.562537+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194358,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":20915,"num_write":1082,"num_write_kb":36230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.527332+0000","last_change":"2024-04-03T05:14:27.527393+0000","last_active":"2024-04-03T05:14:27.527332+0000","last_peered":"2024-04-03T05:14:27.527332+0000","last_clean":"2024-04-03T05:14:27.527332+0000","last_became_active":"2024-04-03T03:38:28.733750+0000","last_became_peered":"2024-04-03T03:38:28.733750+0000","last_unstale":"2024-04-03T05:14:27.527332+0000","last_undegraded":"2024-04-03T05:14:27.527332+0000","last_fullsized":"2024-04-03T05:14:27.527332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:27.527140+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:27.527140+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.527140+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:50:25.076608+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'331","reported_seq":2058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.746125+0000","last_change":"2024-04-03T03:38:30.824797+0000","last_active":"2024-04-03T05:14:00.746125+0000","last_peered":"2024-04-03T05:14:00.746125+0000","last_clean":"2024-04-03T05:14:00.746125+0000","last_became_active":"2024-04-03T03:38:30.824061+0000","last_became_peered":"2024-04-03T03:38:30.824061+0000","last_unstale":"2024-04-03T05:14:00.746125+0000","last_undegraded":"2024-04-03T05:14:00.746125+0000","last_fullsized":"2024-04-03T05:14:00.746125+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":319,"num_read_kb":311,"num_write":309,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.449010+0000","last_change":"2024-04-03T03:38:32.735866+0000","last_active":"2024-04-03T05:14:14.449010+0000","last_peered":"2024-04-03T05:14:14.449010+0000","last_clean":"2024-04-03T05:14:14.449010+0000","last_became_active":"2024-04-03T03:38:32.735151+0000","last_became_peered":"2024-04-03T03:38:32.735151+0000","last_unstale":"2024-04-03T05:14:14.449010+0000","last_undegraded":"2024-04-03T05:14:14.449010+0000","last_fullsized":"2024-04-03T05:14:14.449010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'196","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.153641+0000","last_change":"2024-04-03T05:14:32.153712+0000","last_active":"2024-04-03T05:14:32.153641+0000","last_peered":"2024-04-03T05:14:32.153641+0000","last_clean":"2024-04-03T05:14:32.153641+0000","last_became_active":"2024-04-03T03:38:34.731776+0000","last_became_peered":"2024-04-03T03:38:34.731776+0000","last_unstale":"2024-04-03T05:14:32.153641+0000","last_undegraded":"2024-04-03T05:14:32.153641+0000","last_fullsized":"2024-04-03T05:14:32.153641+0000","mapping_epoch":33,"log_start":"252'100","ondisk_log_start":"252'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-04-03T05:14:32.153424+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-04-03T05:14:32.153424+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.153424+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:04:00.407236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":349,"num_read_kb":358,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'385","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.627383+0000","last_change":"2024-04-03T05:14:32.627453+0000","last_active":"2024-04-03T05:14:32.627383+0000","last_peered":"2024-04-03T05:14:32.627383+0000","last_clean":"2024-04-03T05:14:32.627383+0000","last_became_active":"2024-04-03T03:38:26.727581+0000","last_became_peered":"2024-04-03T03:38:26.727581+0000","last_unstale":"2024-04-03T05:14:32.627383+0000","last_undegraded":"2024-04-03T05:14:32.627383+0000","last_fullsized":"2024-04-03T05:14:32.627383+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-04-03T05:14:32.627188+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-04-03T05:14:32.627188+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.627188+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:06:17.186544+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2147,"num_read_kb":2031,"num_write":458,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":635,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:03.869704+0000","last_change":"2024-04-03T03:38:11.614869+0000","last_active":"2024-04-03T05:14:03.869704+0000","last_peered":"2024-04-03T05:14:03.869704+0000","last_clean":"2024-04-03T05:14:03.869704+0000","last_became_active":"2024-04-03T03:38:11.613973+0000","last_became_peered":"2024-04-03T03:38:11.613973+0000","last_unstale":"2024-04-03T05:14:03.869704+0000","last_undegraded":"2024-04-03T05:14:03.869704+0000","last_fullsized":"2024-04-03T05:14:03.869704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'335","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.514268+0000","last_change":"2024-04-03T05:14:28.514369+0000","last_active":"2024-04-03T05:14:28.514268+0000","last_peered":"2024-04-03T05:14:28.514268+0000","last_clean":"2024-04-03T05:14:28.514268+0000","last_became_active":"2024-04-03T03:38:58.349561+0000","last_became_peered":"2024-04-03T03:38:58.349561+0000","last_unstale":"2024-04-03T05:14:28.514268+0000","last_undegraded":"2024-04-03T05:14:28.514268+0000","last_fullsized":"2024-04-03T05:14:28.514268+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-04-03T05:14:28.514073+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-04-03T05:14:28.514073+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.514073+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:56:01.820268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":496,"num_read_kb":36392,"num_write":1067,"num_write_kb":30181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:43.084118+0000","last_change":"2024-04-03T03:38:28.713016+0000","last_active":"2024-04-03T05:12:43.084118+0000","last_peered":"2024-04-03T05:12:43.084118+0000","last_clean":"2024-04-03T05:12:43.084118+0000","last_became_active":"2024-04-03T03:38:28.711551+0000","last_became_peered":"2024-04-03T03:38:28.711551+0000","last_unstale":"2024-04-03T05:12:43.084118+0000","last_undegraded":"2024-04-03T05:12:43.084118+0000","last_fullsized":"2024-04-03T05:12:43.084118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'182","reported_seq":777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:00.790348+0000","last_change":"2024-04-03T03:38:30.718183+0000","last_active":"2024-04-03T05:14:00.790348+0000","last_peered":"2024-04-03T05:14:00.790348+0000","last_clean":"2024-04-03T05:14:00.790348+0000","last_became_active":"2024-04-03T03:38:30.717437+0000","last_became_peered":"2024-04-03T03:38:30.717437+0000","last_unstale":"2024-04-03T05:14:00.790348+0000","last_undegraded":"2024-04-03T05:14:00.790348+0000","last_fullsized":"2024-04-03T05:14:00.790348+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":238,"num_read_kb":232,"num_write":176,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.289928+0000","last_change":"2024-04-03T05:14:26.289985+0000","last_active":"2024-04-03T05:14:26.289928+0000","last_peered":"2024-04-03T05:14:26.289928+0000","last_clean":"2024-04-03T05:14:26.289928+0000","last_became_active":"2024-04-03T03:38:32.739201+0000","last_became_peered":"2024-04-03T03:38:32.739201+0000","last_unstale":"2024-04-03T05:14:26.289928+0000","last_undegraded":"2024-04-03T05:14:26.289928+0000","last_fullsized":"2024-04-03T05:14:26.289928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:26.289723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:26.289723+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.289723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:39:59.552127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'111","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.265127+0000","last_change":"2024-04-03T05:14:26.265199+0000","last_active":"2024-04-03T05:14:26.265127+0000","last_peered":"2024-04-03T05:14:26.265127+0000","last_clean":"2024-04-03T05:14:26.265127+0000","last_became_active":"2024-04-03T03:38:34.749642+0000","last_became_peered":"2024-04-03T03:38:34.749642+0000","last_unstale":"2024-04-03T05:14:26.265127+0000","last_undegraded":"2024-04-03T05:14:26.265127+0000","last_fullsized":"2024-04-03T05:14:26.265127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-04-03T05:14:26.264937+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-04-03T05:14:26.264937+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.264937+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:55:51.281140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":197,"num_write":285,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'481","reported_seq":2130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.900613+0000","last_change":"2024-04-03T03:38:26.720851+0000","last_active":"2024-04-03T05:14:14.900613+0000","last_peered":"2024-04-03T05:14:14.900613+0000","last_clean":"2024-04-03T05:14:14.900613+0000","last_became_active":"2024-04-03T03:38:26.720476+0000","last_became_peered":"2024-04-03T03:38:26.720476+0000","last_unstale":"2024-04-03T05:14:14.900613+0000","last_undegraded":"2024-04-03T05:14:14.900613+0000","last_fullsized":"2024-04-03T05:14:14.900613+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2351,"num_write":586,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'318","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.526148+0000","last_change":"2024-04-03T03:38:24.749672+0000","last_active":"2024-04-03T05:14:10.526148+0000","last_peered":"2024-04-03T05:14:10.526148+0000","last_clean":"2024-04-03T05:14:10.526148+0000","last_became_active":"2024-04-03T03:38:24.748412+0000","last_became_peered":"2024-04-03T03:38:24.748412+0000","last_unstale":"2024-04-03T05:14:10.526148+0000","last_undegraded":"2024-04-03T05:14:10.526148+0000","last_fullsized":"2024-04-03T05:14:10.526148+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400935,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":679,"num_read_kb":11584,"num_write":1159,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:02.875764+0000","last_change":"2024-04-03T03:38:11.611219+0000","last_active":"2024-04-03T05:14:02.875764+0000","last_peered":"2024-04-03T05:14:02.875764+0000","last_clean":"2024-04-03T05:14:02.875764+0000","last_became_active":"2024-04-03T03:38:11.609995+0000","last_became_peered":"2024-04-03T03:38:11.609995+0000","last_unstale":"2024-04-03T05:14:02.875764+0000","last_undegraded":"2024-04-03T05:14:02.875764+0000","last_fullsized":"2024-04-03T05:14:02.875764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'3","reported_seq":843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.449585+0000","last_change":"2024-04-03T03:38:28.717488+0000","last_active":"2024-04-03T05:14:14.449585+0000","last_peered":"2024-04-03T05:14:14.449585+0000","last_clean":"2024-04-03T05:14:14.449585+0000","last_became_active":"2024-04-03T03:38:28.716761+0000","last_became_peered":"2024-04-03T03:38:28.716761+0000","last_unstale":"2024-04-03T05:14:14.449585+0000","last_undegraded":"2024-04-03T05:14:14.449585+0000","last_fullsized":"2024-04-03T05:14:14.449585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":482,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'618","reported_seq":1350,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.586669+0000","last_change":"2024-04-03T03:38:30.731606+0000","last_active":"2024-04-03T05:14:10.586669+0000","last_peered":"2024-04-03T05:14:10.586669+0000","last_clean":"2024-04-03T05:14:10.586669+0000","last_became_active":"2024-04-03T03:38:30.731186+0000","last_became_peered":"2024-04-03T03:38:30.731186+0000","last_unstale":"2024-04-03T05:14:10.586669+0000","last_undegraded":"2024-04-03T05:14:10.586669+0000","last_fullsized":"2024-04-03T05:14:10.586669+0000","mapping_epoch":29,"log_start":"263'600","ondisk_log_start":"263'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105089,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1067,"num_read_kb":2412,"num_write":850,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.705076+0000","last_change":"2024-04-03T05:14:29.705128+0000","last_active":"2024-04-03T05:14:29.705076+0000","last_peered":"2024-04-03T05:14:29.705076+0000","last_clean":"2024-04-03T05:14:29.705076+0000","last_became_active":"2024-04-03T03:38:32.725549+0000","last_became_peered":"2024-04-03T03:38:32.725549+0000","last_unstale":"2024-04-03T05:14:29.705076+0000","last_undegraded":"2024-04-03T05:14:29.705076+0000","last_fullsized":"2024-04-03T05:14:29.705076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:29.704889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:29.704889+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.704889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:18:48.023074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'104","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.211493+0000","last_change":"2024-04-03T05:14:24.211555+0000","last_active":"2024-04-03T05:14:24.211493+0000","last_peered":"2024-04-03T05:14:24.211493+0000","last_clean":"2024-04-03T05:14:24.211493+0000","last_became_active":"2024-04-03T03:38:34.939419+0000","last_became_peered":"2024-04-03T03:38:34.939419+0000","last_unstale":"2024-04-03T05:14:24.211493+0000","last_undegraded":"2024-04-03T05:14:24.211493+0000","last_fullsized":"2024-04-03T05:14:24.211493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-04-03T05:14:24.211297+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-04-03T05:14:24.211297+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.211297+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:21:35.674236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":118,"num_write":243,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'842","reported_seq":2348,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.449214+0000","last_change":"2024-04-03T03:38:26.732400+0000","last_active":"2024-04-03T05:14:14.449214+0000","last_peered":"2024-04-03T05:14:14.449214+0000","last_clean":"2024-04-03T05:14:14.449214+0000","last_became_active":"2024-04-03T03:38:26.731406+0000","last_became_peered":"2024-04-03T03:38:26.731406+0000","last_unstale":"2024-04-03T05:14:14.449214+0000","last_undegraded":"2024-04-03T05:14:14.449214+0000","last_fullsized":"2024-04-03T05:14:14.449214+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3757,"num_read_kb":3345,"num_write":1171,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'312","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.900500+0000","last_change":"2024-04-03T03:38:24.722172+0000","last_active":"2024-04-03T05:14:14.900500+0000","last_peered":"2024-04-03T05:14:14.900500+0000","last_clean":"2024-04-03T05:14:14.900500+0000","last_became_active":"2024-04-03T03:38:24.721685+0000","last_became_peered":"2024-04-03T03:38:24.721685+0000","last_unstale":"2024-04-03T05:14:14.900500+0000","last_undegraded":"2024-04-03T05:14:14.900500+0000","last_fullsized":"2024-04-03T05:14:14.900500+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266323,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":425,"num_read_kb":12382,"num_write":1218,"num_write_kb":30338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.632129+0000","last_change":"2024-04-03T03:38:11.618107+0000","last_active":"2024-04-03T05:14:17.632129+0000","last_peered":"2024-04-03T05:14:17.632129+0000","last_clean":"2024-04-03T05:14:17.632129+0000","last_became_active":"2024-04-03T03:38:11.617057+0000","last_became_peered":"2024-04-03T03:38:11.617057+0000","last_unstale":"2024-04-03T05:14:17.632129+0000","last_undegraded":"2024-04-03T05:14:17.632129+0000","last_fullsized":"2024-04-03T05:14:17.632129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.323855+0000","last_change":"2024-04-03T05:14:33.323915+0000","last_active":"2024-04-03T05:14:33.323855+0000","last_peered":"2024-04-03T05:14:33.323855+0000","last_clean":"2024-04-03T05:14:33.323855+0000","last_became_active":"2024-04-03T03:38:28.719394+0000","last_became_peered":"2024-04-03T03:38:28.719394+0000","last_unstale":"2024-04-03T05:14:33.323855+0000","last_undegraded":"2024-04-03T05:14:33.323855+0000","last_fullsized":"2024-04-03T05:14:33.323855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.323658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.323658+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.323658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:26.127102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'307","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.901313+0000","last_change":"2024-04-03T03:38:30.822163+0000","last_active":"2024-04-03T05:14:14.901313+0000","last_peered":"2024-04-03T05:14:14.901313+0000","last_clean":"2024-04-03T05:14:14.901313+0000","last_became_active":"2024-04-03T03:38:30.821297+0000","last_became_peered":"2024-04-03T03:38:30.821297+0000","last_unstale":"2024-04-03T05:14:14.901313+0000","last_undegraded":"2024-04-03T05:14:14.901313+0000","last_fullsized":"2024-04-03T05:14:14.901313+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":386,"num_write":374,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'555","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.253957+0000","last_change":"2024-04-03T05:14:29.254021+0000","last_active":"2024-04-03T05:14:29.253957+0000","last_peered":"2024-04-03T05:14:29.253957+0000","last_clean":"2024-04-03T05:14:29.253957+0000","last_became_active":"2024-04-03T03:38:32.747292+0000","last_became_peered":"2024-04-03T03:38:32.747292+0000","last_unstale":"2024-04-03T05:14:29.253957+0000","last_undegraded":"2024-04-03T05:14:29.253957+0000","last_fullsized":"2024-04-03T05:14:29.253957+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'555","last_scrub_stamp":"2024-04-03T05:14:29.253768+0000","last_deep_scrub":"263'555","last_deep_scrub_stamp":"2024-04-03T05:14:29.253768+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.253768+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:40:53.784055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'92","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.151466+0000","last_change":"2024-04-03T05:14:28.151634+0000","last_active":"2024-04-03T05:14:28.151466+0000","last_peered":"2024-04-03T05:14:28.151466+0000","last_clean":"2024-04-03T05:14:28.151466+0000","last_became_active":"2024-04-03T03:38:34.935593+0000","last_became_peered":"2024-04-03T03:38:34.935593+0000","last_unstale":"2024-04-03T05:14:28.151466+0000","last_undegraded":"2024-04-03T05:14:28.151466+0000","last_fullsized":"2024-04-03T05:14:28.151466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-04-03T05:14:28.151248+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-04-03T05:14:28.151248+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.151248+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:44.377270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":828,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":224,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'421","reported_seq":1890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:48.042169+0000","last_change":"2024-04-03T03:38:26.717074+0000","last_active":"2024-04-03T05:12:48.042169+0000","last_peered":"2024-04-03T05:12:48.042169+0000","last_clean":"2024-04-03T05:12:48.042169+0000","last_became_active":"2024-04-03T03:38:26.716004+0000","last_became_peered":"2024-04-03T03:38:26.716004+0000","last_unstale":"2024-04-03T05:12:48.042169+0000","last_undegraded":"2024-04-03T05:12:48.042169+0000","last_fullsized":"2024-04-03T05:12:48.042169+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":2164,"num_write":539,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'334","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.488009+0000","last_change":"2024-04-03T03:38:24.728339+0000","last_active":"2024-04-03T05:14:10.488009+0000","last_peered":"2024-04-03T05:14:10.488009+0000","last_clean":"2024-04-03T05:14:10.488009+0000","last_became_active":"2024-04-03T03:38:24.727736+0000","last_became_peered":"2024-04-03T03:38:24.727736+0000","last_unstale":"2024-04-03T05:14:10.488009+0000","last_undegraded":"2024-04-03T05:14:10.488009+0000","last_fullsized":"2024-04-03T05:14:10.488009+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262228,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":37309,"num_write":1217,"num_write_kb":23236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:32.869672+0000","last_change":"2024-04-03T03:38:11.613510+0000","last_active":"2024-04-03T05:13:32.869672+0000","last_peered":"2024-04-03T05:13:32.869672+0000","last_clean":"2024-04-03T05:13:32.869672+0000","last_became_active":"2024-04-03T03:38:11.613252+0000","last_became_peered":"2024-04-03T03:38:11.613252+0000","last_unstale":"2024-04-03T05:13:32.869672+0000","last_undegraded":"2024-04-03T05:13:32.869672+0000","last_fullsized":"2024-04-03T05:13:32.869672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.260050+0000","last_change":"2024-04-03T03:38:28.722584+0000","last_active":"2024-04-03T05:14:16.260050+0000","last_peered":"2024-04-03T05:14:16.260050+0000","last_clean":"2024-04-03T05:14:16.260050+0000","last_became_active":"2024-04-03T03:38:28.721796+0000","last_became_peered":"2024-04-03T03:38:28.721796+0000","last_unstale":"2024-04-03T05:14:16.260050+0000","last_undegraded":"2024-04-03T05:14:16.260050+0000","last_fullsized":"2024-04-03T05:14:16.260050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'166","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.260266+0000","last_change":"2024-04-03T03:38:30.719677+0000","last_active":"2024-04-03T05:14:16.260266+0000","last_peered":"2024-04-03T05:14:16.260266+0000","last_clean":"2024-04-03T05:14:16.260266+0000","last_became_active":"2024-04-03T03:38:30.718913+0000","last_became_peered":"2024-04-03T03:38:30.718913+0000","last_unstale":"2024-04-03T05:14:16.260266+0000","last_undegraded":"2024-04-03T05:14:16.260266+0000","last_fullsized":"2024-04-03T05:14:16.260266+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":144,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'554","reported_seq":2672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.809696+0000","last_change":"2024-04-03T03:38:32.744373+0000","last_active":"2024-04-03T05:14:15.809696+0000","last_peered":"2024-04-03T05:14:15.809696+0000","last_clean":"2024-04-03T05:14:15.809696+0000","last_became_active":"2024-04-03T03:38:32.743829+0000","last_became_peered":"2024-04-03T03:38:32.743829+0000","last_unstale":"2024-04-03T05:14:15.809696+0000","last_undegraded":"2024-04-03T05:14:15.809696+0000","last_fullsized":"2024-04-03T05:14:15.809696+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'94","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.265589+0000","last_change":"2024-04-03T05:14:26.265677+0000","last_active":"2024-04-03T05:14:26.265589+0000","last_peered":"2024-04-03T05:14:26.265589+0000","last_clean":"2024-04-03T05:14:26.265589+0000","last_became_active":"2024-04-03T03:38:34.746249+0000","last_became_peered":"2024-04-03T03:38:34.746249+0000","last_unstale":"2024-04-03T05:14:26.265589+0000","last_undegraded":"2024-04-03T05:14:26.265589+0000","last_fullsized":"2024-04-03T05:14:26.265589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'94","last_scrub_stamp":"2024-04-03T05:14:26.265394+0000","last_deep_scrub":"263'94","last_deep_scrub_stamp":"2024-04-03T05:14:26.265394+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.265394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:25:51.955446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":217,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1105","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.259360+0000","last_change":"2024-04-03T03:38:26.741936+0000","last_active":"2024-04-03T05:14:16.259360+0000","last_peered":"2024-04-03T05:14:16.259360+0000","last_clean":"2024-04-03T05:14:16.259360+0000","last_became_active":"2024-04-03T03:38:26.741272+0000","last_became_peered":"2024-04-03T03:38:26.741272+0000","last_unstale":"2024-04-03T05:14:16.259360+0000","last_undegraded":"2024-04-03T05:14:16.259360+0000","last_fullsized":"2024-04-03T05:14:16.259360+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4771,"num_read_kb":4189,"num_write":1521,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'320","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.539991+0000","last_change":"2024-04-03T03:38:24.747700+0000","last_active":"2024-04-03T05:14:10.539991+0000","last_peered":"2024-04-03T05:14:10.539991+0000","last_clean":"2024-04-03T05:14:10.539991+0000","last_became_active":"2024-04-03T03:38:24.747145+0000","last_became_peered":"2024-04-03T03:38:24.747145+0000","last_unstale":"2024-04-03T05:14:10.539991+0000","last_undegraded":"2024-04-03T05:14:10.539991+0000","last_fullsized":"2024-04-03T05:14:10.539991+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3601918,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":38174,"num_write":1065,"num_write_kb":41152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:34.044125+0000","last_change":"2024-04-03T03:38:11.618291+0000","last_active":"2024-04-03T05:13:34.044125+0000","last_peered":"2024-04-03T05:13:34.044125+0000","last_clean":"2024-04-03T05:13:34.044125+0000","last_became_active":"2024-04-03T03:38:11.617573+0000","last_became_peered":"2024-04-03T03:38:11.617573+0000","last_unstale":"2024-04-03T05:13:34.044125+0000","last_undegraded":"2024-04-03T05:13:34.044125+0000","last_fullsized":"2024-04-03T05:13:34.044125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.043331+0000","last_change":"2024-04-03T03:38:28.734000+0000","last_active":"2024-04-03T05:12:53.043331+0000","last_peered":"2024-04-03T05:12:53.043331+0000","last_clean":"2024-04-03T05:12:53.043331+0000","last_became_active":"2024-04-03T03:38:28.733237+0000","last_became_peered":"2024-04-03T03:38:28.733237+0000","last_unstale":"2024-04-03T05:12:53.043331+0000","last_undegraded":"2024-04-03T05:12:53.043331+0000","last_fullsized":"2024-04-03T05:12:53.043331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'796","reported_seq":1570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.632787+0000","last_change":"2024-04-03T03:38:30.823414+0000","last_active":"2024-04-03T05:14:17.632787+0000","last_peered":"2024-04-03T05:14:17.632787+0000","last_clean":"2024-04-03T05:14:17.632787+0000","last_became_active":"2024-04-03T03:38:30.822610+0000","last_became_peered":"2024-04-03T03:38:30.822610+0000","last_unstale":"2024-04-03T05:14:17.632787+0000","last_undegraded":"2024-04-03T05:14:17.632787+0000","last_fullsized":"2024-04-03T05:14:17.632787+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1404,"num_read_kb":3337,"num_write":1132,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.809335+0000","last_change":"2024-04-03T03:38:32.729501+0000","last_active":"2024-04-03T05:14:15.809335+0000","last_peered":"2024-04-03T05:14:15.809335+0000","last_clean":"2024-04-03T05:14:15.809335+0000","last_became_active":"2024-04-03T03:38:32.728874+0000","last_became_peered":"2024-04-03T03:38:32.728874+0000","last_unstale":"2024-04-03T05:14:15.809335+0000","last_undegraded":"2024-04-03T05:14:15.809335+0000","last_fullsized":"2024-04-03T05:14:15.809335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'106","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.338215+0000","last_change":"2024-04-03T05:14:24.338375+0000","last_active":"2024-04-03T05:14:24.338215+0000","last_peered":"2024-04-03T05:14:24.338215+0000","last_clean":"2024-04-03T05:14:24.338215+0000","last_became_active":"2024-04-03T03:38:34.756936+0000","last_became_peered":"2024-04-03T03:38:34.756936+0000","last_unstale":"2024-04-03T05:14:24.338215+0000","last_undegraded":"2024-04-03T05:14:24.338215+0000","last_fullsized":"2024-04-03T05:14:24.338215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-04-03T05:14:24.338001+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-04-03T05:14:24.338001+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.338001+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:46:06.133728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'144","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.233348+0000","last_change":"2024-04-03T05:14:25.233348+0000","last_active":"2024-04-03T05:14:25.233348+0000","last_peered":"2024-04-03T05:14:25.233348+0000","last_clean":"2024-04-03T05:14:25.233348+0000","last_became_active":"2024-04-03T03:38:34.759767+0000","last_became_peered":"2024-04-03T03:38:34.759767+0000","last_unstale":"2024-04-03T05:14:25.233348+0000","last_undegraded":"2024-04-03T05:14:25.233348+0000","last_fullsized":"2024-04-03T05:14:25.233348+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-04-03T05:14:25.233092+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-04-03T05:14:25.233092+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.233092+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:33:41.732896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":108,"num_write":250,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'826","reported_seq":2403,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.673981+0000","last_change":"2024-04-03T03:38:26.741454+0000","last_active":"2024-04-03T05:14:08.673981+0000","last_peered":"2024-04-03T05:14:08.673981+0000","last_clean":"2024-04-03T05:14:08.673981+0000","last_became_active":"2024-04-03T03:38:26.740732+0000","last_became_peered":"2024-04-03T03:38:26.740732+0000","last_unstale":"2024-04-03T05:14:08.673981+0000","last_undegraded":"2024-04-03T05:14:08.673981+0000","last_fullsized":"2024-04-03T05:14:08.673981+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3680,"num_read_kb":3271,"num_write":1116,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'362","reported_seq":1130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.540328+0000","last_change":"2024-04-03T03:38:24.741664+0000","last_active":"2024-04-03T05:14:10.540328+0000","last_peered":"2024-04-03T05:14:10.540328+0000","last_clean":"2024-04-03T05:14:10.540328+0000","last_became_active":"2024-04-03T03:38:24.740900+0000","last_became_peered":"2024-04-03T03:38:24.740900+0000","last_unstale":"2024-04-03T05:14:10.540328+0000","last_undegraded":"2024-04-03T05:14:10.540328+0000","last_fullsized":"2024-04-03T05:14:10.540328+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100573,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":621,"num_read_kb":65764,"num_write":1260,"num_write_kb":26843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:12.877483+0000","last_change":"2024-04-03T03:38:28.725751+0000","last_active":"2024-04-03T05:14:12.877483+0000","last_peered":"2024-04-03T05:14:12.877483+0000","last_clean":"2024-04-03T05:14:12.877483+0000","last_became_active":"2024-04-03T03:38:28.725020+0000","last_became_peered":"2024-04-03T03:38:28.725020+0000","last_unstale":"2024-04-03T05:14:12.877483+0000","last_undegraded":"2024-04-03T05:14:12.877483+0000","last_fullsized":"2024-04-03T05:14:12.877483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'309","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:13.060217+0000","last_change":"2024-04-03T03:38:30.730341+0000","last_active":"2024-04-03T05:14:13.060217+0000","last_peered":"2024-04-03T05:14:13.060217+0000","last_clean":"2024-04-03T05:14:13.060217+0000","last_became_active":"2024-04-03T03:38:30.729608+0000","last_became_peered":"2024-04-03T03:38:30.729608+0000","last_unstale":"2024-04-03T05:14:13.060217+0000","last_undegraded":"2024-04-03T05:14:13.060217+0000","last_fullsized":"2024-04-03T05:14:13.060217+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":1071,"num_write":390,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:13.060085+0000","last_change":"2024-04-03T03:38:32.746511+0000","last_active":"2024-04-03T05:14:13.060085+0000","last_peered":"2024-04-03T05:14:13.060085+0000","last_clean":"2024-04-03T05:14:13.060085+0000","last_became_active":"2024-04-03T03:38:32.744256+0000","last_became_peered":"2024-04-03T03:38:32.744256+0000","last_unstale":"2024-04-03T05:14:13.060085+0000","last_undegraded":"2024-04-03T05:14:13.060085+0000","last_fullsized":"2024-04-03T05:14:13.060085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'108","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.156495+0000","last_change":"2024-04-03T05:14:30.156559+0000","last_active":"2024-04-03T05:14:30.156495+0000","last_peered":"2024-04-03T05:14:30.156495+0000","last_clean":"2024-04-03T05:14:30.156495+0000","last_became_active":"2024-04-03T03:38:34.736176+0000","last_became_peered":"2024-04-03T03:38:34.736176+0000","last_unstale":"2024-04-03T05:14:30.156495+0000","last_undegraded":"2024-04-03T05:14:30.156495+0000","last_fullsized":"2024-04-03T05:14:30.156495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-04-03T05:14:30.156298+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-04-03T05:14:30.156298+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.156298+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:22:54.335172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":259,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'759","reported_seq":2572,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.876586+0000","last_change":"2024-04-03T03:38:26.720574+0000","last_active":"2024-04-03T05:14:07.876586+0000","last_peered":"2024-04-03T05:14:07.876586+0000","last_clean":"2024-04-03T05:14:07.876586+0000","last_became_active":"2024-04-03T03:38:26.720106+0000","last_became_peered":"2024-04-03T03:38:26.720106+0000","last_unstale":"2024-04-03T05:14:07.876586+0000","last_undegraded":"2024-04-03T05:14:07.876586+0000","last_fullsized":"2024-04-03T05:14:07.876586+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3508,"num_write":1155,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'344","reported_seq":1065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.838242+0000","last_change":"2024-04-03T05:14:25.838372+0000","last_active":"2024-04-03T05:14:25.838242+0000","last_peered":"2024-04-03T05:14:25.838242+0000","last_clean":"2024-04-03T05:14:25.838242+0000","last_became_active":"2024-04-03T03:38:57.882607+0000","last_became_peered":"2024-04-03T03:38:57.882607+0000","last_unstale":"2024-04-03T05:14:25.838242+0000","last_undegraded":"2024-04-03T05:14:25.838242+0000","last_fullsized":"2024-04-03T05:14:25.838242+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-04-03T05:14:25.838028+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-04-03T05:14:25.838028+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.838028+0000","objects_scrubbed":9,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:21.795448+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5935608,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":618,"num_read_kb":85965,"num_write":1280,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:13.060383+0000","last_change":"2024-04-03T03:38:28.723791+0000","last_active":"2024-04-03T05:14:13.060383+0000","last_peered":"2024-04-03T05:14:13.060383+0000","last_clean":"2024-04-03T05:14:13.060383+0000","last_became_active":"2024-04-03T03:38:28.723082+0000","last_became_peered":"2024-04-03T03:38:28.723082+0000","last_unstale":"2024-04-03T05:14:13.060383+0000","last_undegraded":"2024-04-03T05:14:13.060383+0000","last_fullsized":"2024-04-03T05:14:13.060383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:13.102301+0000","last_change":"2024-04-03T03:38:30.730377+0000","last_active":"2024-04-03T05:14:13.102301+0000","last_peered":"2024-04-03T05:14:13.102301+0000","last_clean":"2024-04-03T05:14:13.102301+0000","last_became_active":"2024-04-03T03:38:30.729412+0000","last_became_peered":"2024-04-03T03:38:30.729412+0000","last_unstale":"2024-04-03T05:14:13.102301+0000","last_undegraded":"2024-04-03T05:14:13.102301+0000","last_fullsized":"2024-04-03T05:14:13.102301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":60,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.816863+0000","last_change":"2024-04-03T05:14:33.816917+0000","last_active":"2024-04-03T05:14:33.816863+0000","last_peered":"2024-04-03T05:14:33.816863+0000","last_clean":"2024-04-03T05:14:33.816863+0000","last_became_active":"2024-04-03T03:38:32.747294+0000","last_became_peered":"2024-04-03T03:38:32.747294+0000","last_unstale":"2024-04-03T05:14:33.816863+0000","last_undegraded":"2024-04-03T05:14:33.816863+0000","last_fullsized":"2024-04-03T05:14:33.816863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.816656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.816656+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.816656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:32:17.430996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'98","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.270883+0000","last_change":"2024-04-03T05:14:30.270951+0000","last_active":"2024-04-03T05:14:30.270883+0000","last_peered":"2024-04-03T05:14:30.270883+0000","last_clean":"2024-04-03T05:14:30.270883+0000","last_became_active":"2024-04-03T03:38:34.737841+0000","last_became_peered":"2024-04-03T03:38:34.737841+0000","last_unstale":"2024-04-03T05:14:30.270883+0000","last_undegraded":"2024-04-03T05:14:30.270883+0000","last_fullsized":"2024-04-03T05:14:30.270883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'98","last_scrub_stamp":"2024-04-03T05:14:30.270694+0000","last_deep_scrub":"263'98","last_deep_scrub_stamp":"2024-04-03T05:14:30.270694+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.270694+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:32:59.118448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":225,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'410","reported_seq":1865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.059142+0000","last_change":"2024-04-03T03:38:26.720039+0000","last_active":"2024-04-03T05:14:08.059142+0000","last_peered":"2024-04-03T05:14:08.059142+0000","last_clean":"2024-04-03T05:14:08.059142+0000","last_became_active":"2024-04-03T03:38:26.715716+0000","last_became_peered":"2024-04-03T03:38:26.715716+0000","last_unstale":"2024-04-03T05:14:08.059142+0000","last_undegraded":"2024-04-03T05:14:08.059142+0000","last_fullsized":"2024-04-03T05:14:08.059142+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2104,"num_read_kb":1969,"num_write":502,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'456","reported_seq":1142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.584116+0000","last_change":"2024-04-03T03:38:24.742857+0000","last_active":"2024-04-03T05:14:10.584116+0000","last_peered":"2024-04-03T05:14:10.584116+0000","last_clean":"2024-04-03T05:14:10.584116+0000","last_became_active":"2024-04-03T03:38:24.737281+0000","last_became_peered":"2024-04-03T03:38:24.737281+0000","last_unstale":"2024-04-03T05:14:10.584116+0000","last_undegraded":"2024-04-03T05:14:10.584116+0000","last_fullsized":"2024-04-03T05:14:10.584116+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448109,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":780,"num_read_kb":29467,"num_write":1404,"num_write_kb":33665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.078032+0000","last_change":"2024-04-03T03:38:28.735969+0000","last_active":"2024-04-03T05:14:09.078032+0000","last_peered":"2024-04-03T05:14:09.078032+0000","last_clean":"2024-04-03T05:14:09.078032+0000","last_became_active":"2024-04-03T03:38:28.735156+0000","last_became_peered":"2024-04-03T03:38:28.735156+0000","last_unstale":"2024-04-03T05:14:09.078032+0000","last_undegraded":"2024-04-03T05:14:09.078032+0000","last_fullsized":"2024-04-03T05:14:09.078032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'324","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:13.060337+0000","last_change":"2024-04-03T03:38:30.734504+0000","last_active":"2024-04-03T05:14:13.060337+0000","last_peered":"2024-04-03T05:14:13.060337+0000","last_clean":"2024-04-03T05:14:13.060337+0000","last_became_active":"2024-04-03T03:38:30.733682+0000","last_became_peered":"2024-04-03T03:38:30.733682+0000","last_unstale":"2024-04-03T05:14:13.060337+0000","last_undegraded":"2024-04-03T05:14:13.060337+0000","last_fullsized":"2024-04-03T05:14:13.060337+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42201,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1138,"num_write":422,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.242447+0000","last_change":"2024-04-03T05:14:27.242501+0000","last_active":"2024-04-03T05:14:27.242447+0000","last_peered":"2024-04-03T05:14:27.242447+0000","last_clean":"2024-04-03T05:14:27.242447+0000","last_became_active":"2024-04-03T03:38:32.733728+0000","last_became_peered":"2024-04-03T03:38:32.733728+0000","last_unstale":"2024-04-03T05:14:27.242447+0000","last_undegraded":"2024-04-03T05:14:27.242447+0000","last_fullsized":"2024-04-03T05:14:27.242447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.242249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.242249+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.242249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:08.047349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'154","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.251598+0000","last_change":"2024-04-03T05:14:22.251667+0000","last_active":"2024-04-03T05:14:22.251598+0000","last_peered":"2024-04-03T05:14:22.251598+0000","last_clean":"2024-04-03T05:14:22.251598+0000","last_became_active":"2024-04-03T03:38:34.755929+0000","last_became_peered":"2024-04-03T03:38:34.755929+0000","last_unstale":"2024-04-03T05:14:22.251598+0000","last_undegraded":"2024-04-03T05:14:22.251598+0000","last_fullsized":"2024-04-03T05:14:22.251598+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-04-03T05:14:22.251370+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-04-03T05:14:22.251370+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.251370+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:21:59.675735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":91,"num_write":329,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'735","reported_seq":2110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.059092+0000","last_change":"2024-04-03T03:38:26.724380+0000","last_active":"2024-04-03T05:14:08.059092+0000","last_peered":"2024-04-03T05:14:08.059092+0000","last_clean":"2024-04-03T05:14:08.059092+0000","last_became_active":"2024-04-03T03:38:26.723758+0000","last_became_peered":"2024-04-03T03:38:26.723758+0000","last_unstale":"2024-04-03T05:14:08.059092+0000","last_undegraded":"2024-04-03T05:14:08.059092+0000","last_fullsized":"2024-04-03T05:14:08.059092+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3210,"num_read_kb":2838,"num_write":998,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'347","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.570905+0000","last_change":"2024-04-03T03:38:24.740315+0000","last_active":"2024-04-03T05:14:10.570905+0000","last_peered":"2024-04-03T05:14:10.570905+0000","last_clean":"2024-04-03T05:14:10.570905+0000","last_became_active":"2024-04-03T03:38:24.739968+0000","last_became_peered":"2024-04-03T03:38:24.739968+0000","last_unstale":"2024-04-03T05:14:10.570905+0000","last_undegraded":"2024-04-03T05:14:10.570905+0000","last_fullsized":"2024-04-03T05:14:10.570905+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303204,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":602,"num_read_kb":31745,"num_write":1185,"num_write_kb":30139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.274370+0000","last_change":"2024-04-03T05:14:29.274427+0000","last_active":"2024-04-03T05:14:29.274370+0000","last_peered":"2024-04-03T05:14:29.274370+0000","last_clean":"2024-04-03T05:14:29.274370+0000","last_became_active":"2024-04-03T03:38:28.723907+0000","last_became_peered":"2024-04-03T03:38:28.723907+0000","last_unstale":"2024-04-03T05:14:29.274370+0000","last_undegraded":"2024-04-03T05:14:29.274370+0000","last_fullsized":"2024-04-03T05:14:29.274370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:29.274155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:29.274155+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.274155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:51.335375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'313","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.079181+0000","last_change":"2024-04-03T03:38:30.733466+0000","last_active":"2024-04-03T05:14:14.079181+0000","last_peered":"2024-04-03T05:14:14.079181+0000","last_clean":"2024-04-03T05:14:14.079181+0000","last_became_active":"2024-04-03T03:38:30.732520+0000","last_became_peered":"2024-04-03T03:38:30.732520+0000","last_unstale":"2024-04-03T05:14:14.079181+0000","last_undegraded":"2024-04-03T05:14:14.079181+0000","last_fullsized":"2024-04-03T05:14:14.079181+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49780,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1180,"num_write":410,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.189242+0000","last_change":"2024-04-03T05:14:32.189296+0000","last_active":"2024-04-03T05:14:32.189242+0000","last_peered":"2024-04-03T05:14:32.189242+0000","last_clean":"2024-04-03T05:14:32.189242+0000","last_became_active":"2024-04-03T03:38:32.748621+0000","last_became_peered":"2024-04-03T03:38:32.748621+0000","last_unstale":"2024-04-03T05:14:32.189242+0000","last_undegraded":"2024-04-03T05:14:32.189242+0000","last_fullsized":"2024-04-03T05:14:32.189242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:32.189053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:32.189053+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.189053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:20:39.713325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'375","reported_seq":2041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.157815+0000","last_change":"2024-04-03T03:38:26.714514+0000","last_active":"2024-04-03T05:14:17.157815+0000","last_peered":"2024-04-03T05:14:17.157815+0000","last_clean":"2024-04-03T05:14:17.157815+0000","last_became_active":"2024-04-03T03:38:26.711974+0000","last_became_peered":"2024-04-03T03:38:26.711974+0000","last_unstale":"2024-04-03T05:14:17.157815+0000","last_undegraded":"2024-04-03T05:14:17.157815+0000","last_fullsized":"2024-04-03T05:14:17.157815+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2240,"num_write":411,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'349","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.569724+0000","last_change":"2024-04-03T03:38:24.717991+0000","last_active":"2024-04-03T05:14:10.569724+0000","last_peered":"2024-04-03T05:14:10.569724+0000","last_clean":"2024-04-03T05:14:10.569724+0000","last_became_active":"2024-04-03T03:38:24.715050+0000","last_became_peered":"2024-04-03T03:38:24.715050+0000","last_unstale":"2024-04-03T05:14:10.569724+0000","last_undegraded":"2024-04-03T05:14:10.569724+0000","last_fullsized":"2024-04-03T05:14:10.569724+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6617705,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":464,"num_read_kb":21769,"num_write":1174,"num_write_kb":53575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.088021+0000","last_change":"2024-04-03T03:38:28.717346+0000","last_active":"2024-04-03T05:12:58.088021+0000","last_peered":"2024-04-03T05:12:58.088021+0000","last_clean":"2024-04-03T05:12:58.088021+0000","last_became_active":"2024-04-03T03:38:28.716638+0000","last_became_peered":"2024-04-03T03:38:28.716638+0000","last_unstale":"2024-04-03T05:12:58.088021+0000","last_undegraded":"2024-04-03T05:12:58.088021+0000","last_fullsized":"2024-04-03T05:12:58.088021+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'509","reported_seq":1180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.449607+0000","last_change":"2024-04-03T03:38:30.726825+0000","last_active":"2024-04-03T05:14:10.449607+0000","last_peered":"2024-04-03T05:14:10.449607+0000","last_clean":"2024-04-03T05:14:10.449607+0000","last_became_active":"2024-04-03T03:38:30.725324+0000","last_became_peered":"2024-04-03T03:38:30.725324+0000","last_unstale":"2024-04-03T05:14:10.449607+0000","last_undegraded":"2024-04-03T05:14:10.449607+0000","last_fullsized":"2024-04-03T05:14:10.449607+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":885,"num_read_kb":2163,"num_write":714,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.270791+0000","last_change":"2024-04-03T05:14:30.270846+0000","last_active":"2024-04-03T05:14:30.270791+0000","last_peered":"2024-04-03T05:14:30.270791+0000","last_clean":"2024-04-03T05:14:30.270791+0000","last_became_active":"2024-04-03T03:38:32.730456+0000","last_became_peered":"2024-04-03T03:38:32.730456+0000","last_unstale":"2024-04-03T05:14:30.270791+0000","last_undegraded":"2024-04-03T05:14:30.270791+0000","last_fullsized":"2024-04-03T05:14:30.270791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:30.270588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:30.270588+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.270588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:28:22.839549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'161","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.147352+0000","last_change":"2024-04-03T05:14:26.147513+0000","last_active":"2024-04-03T05:14:26.147352+0000","last_peered":"2024-04-03T05:14:26.147352+0000","last_clean":"2024-04-03T05:14:26.147352+0000","last_became_active":"2024-04-03T03:38:34.939244+0000","last_became_peered":"2024-04-03T03:38:34.939244+0000","last_unstale":"2024-04-03T05:14:26.147352+0000","last_undegraded":"2024-04-03T05:14:26.147352+0000","last_fullsized":"2024-04-03T05:14:26.147352+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-04-03T05:14:26.147094+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-04-03T05:14:26.147094+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.147094+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:50.462110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":238,"num_write":361,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'563","reported_seq":2124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.191646+0000","last_change":"2024-04-03T03:38:26.723127+0000","last_active":"2024-04-03T05:13:59.191646+0000","last_peered":"2024-04-03T05:13:59.191646+0000","last_clean":"2024-04-03T05:13:59.191646+0000","last_became_active":"2024-04-03T03:38:26.718375+0000","last_became_peered":"2024-04-03T03:38:26.718375+0000","last_unstale":"2024-04-03T05:13:59.191646+0000","last_undegraded":"2024-04-03T05:13:59.191646+0000","last_fullsized":"2024-04-03T05:13:59.191646+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2911,"num_read_kb":2669,"num_write":774,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'320","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.559911+0000","last_change":"2024-04-03T03:38:24.730652+0000","last_active":"2024-04-03T05:14:10.559911+0000","last_peered":"2024-04-03T05:14:10.559911+0000","last_clean":"2024-04-03T05:14:10.559911+0000","last_became_active":"2024-04-03T03:38:24.730294+0000","last_became_peered":"2024-04-03T03:38:24.730294+0000","last_unstale":"2024-04-03T05:14:10.559911+0000","last_undegraded":"2024-04-03T05:14:10.559911+0000","last_fullsized":"2024-04-03T05:14:10.559911+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274297,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":474,"num_read_kb":62893,"num_write":1320,"num_write_kb":30207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.301408+0000","last_change":"2024-04-03T05:14:31.301463+0000","last_active":"2024-04-03T05:14:31.301408+0000","last_peered":"2024-04-03T05:14:31.301408+0000","last_clean":"2024-04-03T05:14:31.301408+0000","last_became_active":"2024-04-03T03:38:28.719692+0000","last_became_peered":"2024-04-03T03:38:28.719692+0000","last_unstale":"2024-04-03T05:14:31.301408+0000","last_undegraded":"2024-04-03T05:14:31.301408+0000","last_fullsized":"2024-04-03T05:14:31.301408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.301203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.301203+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.301203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:51.285253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'337","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.033643+0000","last_change":"2024-04-03T03:38:30.733396+0000","last_active":"2024-04-03T05:14:09.033643+0000","last_peered":"2024-04-03T05:14:09.033643+0000","last_clean":"2024-04-03T05:14:09.033643+0000","last_became_active":"2024-04-03T03:38:30.732529+0000","last_became_peered":"2024-04-03T03:38:30.732529+0000","last_unstale":"2024-04-03T05:14:09.033643+0000","last_undegraded":"2024-04-03T05:14:09.033643+0000","last_fullsized":"2024-04-03T05:14:09.033643+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":563,"num_read_kb":1112,"num_write":458,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.566913+0000","last_change":"2024-04-03T05:14:28.566972+0000","last_active":"2024-04-03T05:14:28.566913+0000","last_peered":"2024-04-03T05:14:28.566913+0000","last_clean":"2024-04-03T05:14:28.566913+0000","last_became_active":"2024-04-03T03:38:32.731752+0000","last_became_peered":"2024-04-03T03:38:32.731752+0000","last_unstale":"2024-04-03T05:14:28.566913+0000","last_undegraded":"2024-04-03T05:14:28.566913+0000","last_fullsized":"2024-04-03T05:14:28.566913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:28.566730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:28.566730+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.566730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:51.820450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'186","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.158184+0000","last_change":"2024-04-03T03:38:34.737380+0000","last_active":"2024-04-03T05:14:17.158184+0000","last_peered":"2024-04-03T05:14:17.158184+0000","last_clean":"2024-04-03T05:14:17.158184+0000","last_became_active":"2024-04-03T03:38:34.736663+0000","last_became_peered":"2024-04-03T03:38:34.736663+0000","last_unstale":"2024-04-03T05:14:17.158184+0000","last_undegraded":"2024-04-03T05:14:17.158184+0000","last_fullsized":"2024-04-03T05:14:17.158184+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:33.705619+0000","last_clean_scrub_stamp":"2024-04-03T03:38:33.705619+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":719,"num_read_kb":691,"num_write":524,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'751","reported_seq":2340,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.050944+0000","last_change":"2024-04-03T03:38:26.711611+0000","last_active":"2024-04-03T05:13:28.050944+0000","last_peered":"2024-04-03T05:13:28.050944+0000","last_clean":"2024-04-03T05:13:28.050944+0000","last_became_active":"2024-04-03T03:38:26.711214+0000","last_became_peered":"2024-04-03T03:38:26.711214+0000","last_unstale":"2024-04-03T05:13:28.050944+0000","last_undegraded":"2024-04-03T05:13:28.050944+0000","last_fullsized":"2024-04-03T05:13:28.050944+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3543,"num_read_kb":3207,"num_write":983,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'300","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.579915+0000","last_change":"2024-04-03T03:38:24.761914+0000","last_active":"2024-04-03T05:14:10.579915+0000","last_peered":"2024-04-03T05:14:10.579915+0000","last_clean":"2024-04-03T05:14:10.579915+0000","last_became_active":"2024-04-03T03:38:24.761330+0000","last_became_peered":"2024-04-03T03:38:24.761330+0000","last_unstale":"2024-04-03T05:14:10.579915+0000","last_undegraded":"2024-04-03T05:14:10.579915+0000","last_fullsized":"2024-04-03T05:14:10.579915+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4626676,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":410,"num_read_kb":53466,"num_write":1122,"num_write_kb":35897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.665655+0000","last_change":"2024-04-03T03:38:28.725003+0000","last_active":"2024-04-03T05:13:28.665655+0000","last_peered":"2024-04-03T05:13:28.665655+0000","last_clean":"2024-04-03T05:13:28.665655+0000","last_became_active":"2024-04-03T03:38:28.724296+0000","last_became_peered":"2024-04-03T03:38:28.724296+0000","last_unstale":"2024-04-03T05:13:28.665655+0000","last_undegraded":"2024-04-03T05:13:28.665655+0000","last_fullsized":"2024-04-03T05:13:28.665655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'308","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.809592+0000","last_change":"2024-04-03T03:38:30.822164+0000","last_active":"2024-04-03T05:14:15.809592+0000","last_peered":"2024-04-03T05:14:15.809592+0000","last_clean":"2024-04-03T05:14:15.809592+0000","last_became_active":"2024-04-03T03:38:30.821335+0000","last_became_peered":"2024-04-03T03:38:30.821335+0000","last_unstale":"2024-04-03T05:14:15.809592+0000","last_undegraded":"2024-04-03T05:14:15.809592+0000","last_fullsized":"2024-04-03T05:14:15.809592+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45080,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":1115,"num_write":402,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:57.864290+0000","last_change":"2024-04-03T03:38:32.731796+0000","last_active":"2024-04-03T05:12:57.864290+0000","last_peered":"2024-04-03T05:12:57.864290+0000","last_clean":"2024-04-03T05:12:57.864290+0000","last_became_active":"2024-04-03T03:38:32.730954+0000","last_became_peered":"2024-04-03T03:38:32.730954+0000","last_unstale":"2024-04-03T05:12:57.864290+0000","last_undegraded":"2024-04-03T05:12:57.864290+0000","last_fullsized":"2024-04-03T05:12:57.864290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'106","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.229393+0000","last_change":"2024-04-03T05:14:28.229531+0000","last_active":"2024-04-03T05:14:28.229393+0000","last_peered":"2024-04-03T05:14:28.229393+0000","last_clean":"2024-04-03T05:14:28.229393+0000","last_became_active":"2024-04-03T03:38:34.754544+0000","last_became_peered":"2024-04-03T03:38:34.754544+0000","last_unstale":"2024-04-03T05:14:28.229393+0000","last_undegraded":"2024-04-03T05:14:28.229393+0000","last_fullsized":"2024-04-03T05:14:28.229393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-04-03T05:14:28.229167+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-04-03T05:14:28.229167+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.229167+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:37.294628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":262,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'316","reported_seq":1733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:27.854870+0000","last_change":"2024-04-03T03:38:26.721787+0000","last_active":"2024-04-03T05:13:27.854870+0000","last_peered":"2024-04-03T05:13:27.854870+0000","last_clean":"2024-04-03T05:13:27.854870+0000","last_became_active":"2024-04-03T03:38:26.720984+0000","last_became_peered":"2024-04-03T03:38:26.720984+0000","last_unstale":"2024-04-03T05:13:27.854870+0000","last_undegraded":"2024-04-03T05:13:27.854870+0000","last_fullsized":"2024-04-03T05:13:27.854870+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1783,"num_read_kb":1722,"num_write":353,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'374","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.560275+0000","last_change":"2024-04-03T03:38:24.745501+0000","last_active":"2024-04-03T05:14:10.560275+0000","last_peered":"2024-04-03T05:14:10.560275+0000","last_clean":"2024-04-03T05:14:10.560275+0000","last_became_active":"2024-04-03T03:38:24.745183+0000","last_became_peered":"2024-04-03T03:38:24.745183+0000","last_unstale":"2024-04-03T05:14:10.560275+0000","last_undegraded":"2024-04-03T05:14:10.560275+0000","last_fullsized":"2024-04-03T05:14:10.560275+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5733043,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":528,"num_read_kb":13372,"num_write":1290,"num_write_kb":33178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.581746+0000","last_change":"2024-04-03T05:14:29.581798+0000","last_active":"2024-04-03T05:14:29.581746+0000","last_peered":"2024-04-03T05:14:29.581746+0000","last_clean":"2024-04-03T05:14:29.581746+0000","last_became_active":"2024-04-03T03:38:28.710708+0000","last_became_peered":"2024-04-03T03:38:28.710708+0000","last_unstale":"2024-04-03T05:14:29.581746+0000","last_undegraded":"2024-04-03T05:14:29.581746+0000","last_fullsized":"2024-04-03T05:14:29.581746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:29.581560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:29.581560+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.581560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:56:14.340545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'158","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.701372+0000","last_change":"2024-04-03T05:14:30.701450+0000","last_active":"2024-04-03T05:14:30.701372+0000","last_peered":"2024-04-03T05:14:30.701372+0000","last_clean":"2024-04-03T05:14:30.701372+0000","last_became_active":"2024-04-03T03:38:30.822452+0000","last_became_peered":"2024-04-03T03:38:30.822452+0000","last_unstale":"2024-04-03T05:14:30.701372+0000","last_undegraded":"2024-04-03T05:14:30.701372+0000","last_fullsized":"2024-04-03T05:14:30.701372+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-04-03T05:14:30.701180+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-04-03T05:14:30.701180+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.701180+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:17:50.340919+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":168,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12140,"num_omap_keys":36,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'526","reported_seq":4615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.267613+0000","last_change":"2024-04-03T05:14:25.267733+0000","last_active":"2024-04-03T05:14:25.267613+0000","last_peered":"2024-04-03T05:14:25.267613+0000","last_clean":"2024-04-03T05:14:25.267613+0000","last_became_active":"2024-04-03T03:38:32.734617+0000","last_became_peered":"2024-04-03T03:38:32.734617+0000","last_unstale":"2024-04-03T05:14:25.267613+0000","last_undegraded":"2024-04-03T05:14:25.267613+0000","last_fullsized":"2024-04-03T05:14:25.267613+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'526","last_scrub_stamp":"2024-04-03T05:14:25.267298+0000","last_deep_scrub":"263'526","last_deep_scrub_stamp":"2024-04-03T05:14:25.267298+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.267298+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:15:44.044015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'183","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.817411+0000","last_change":"2024-04-03T05:14:26.817474+0000","last_active":"2024-04-03T05:14:26.817411+0000","last_peered":"2024-04-03T05:14:26.817411+0000","last_clean":"2024-04-03T05:14:26.817411+0000","last_became_active":"2024-04-03T03:38:34.756694+0000","last_became_peered":"2024-04-03T03:38:34.756694+0000","last_unstale":"2024-04-03T05:14:26.817411+0000","last_undegraded":"2024-04-03T05:14:26.817411+0000","last_fullsized":"2024-04-03T05:14:26.817411+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-04-03T05:14:26.817208+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-04-03T05:14:26.817208+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.817208+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:13:30.094225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":410,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'389","reported_seq":2027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.665584+0000","last_change":"2024-04-03T03:38:26.745973+0000","last_active":"2024-04-03T05:13:28.665584+0000","last_peered":"2024-04-03T05:13:28.665584+0000","last_clean":"2024-04-03T05:13:28.665584+0000","last_became_active":"2024-04-03T03:38:26.744905+0000","last_became_peered":"2024-04-03T03:38:26.744905+0000","last_unstale":"2024-04-03T05:13:28.665584+0000","last_undegraded":"2024-04-03T05:13:28.665584+0000","last_fullsized":"2024-04-03T05:13:28.665584+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2315,"num_read_kb":2222,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'372","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.252631+0000","last_change":"2024-04-03T05:14:20.252870+0000","last_active":"2024-04-03T05:14:20.252631+0000","last_peered":"2024-04-03T05:14:20.252631+0000","last_clean":"2024-04-03T05:14:20.252631+0000","last_became_active":"2024-04-03T03:38:58.350828+0000","last_became_peered":"2024-04-03T03:38:58.350828+0000","last_unstale":"2024-04-03T05:14:20.252631+0000","last_undegraded":"2024-04-03T05:14:20.252631+0000","last_fullsized":"2024-04-03T05:14:20.252631+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-04-03T05:14:20.252422+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-04-03T05:14:20.252422+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.252422+0000","objects_scrubbed":9,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:50:54.930268+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9469383,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":544,"num_read_kb":21295,"num_write":1304,"num_write_kb":30213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:29.067193+0000","last_change":"2024-04-03T03:38:28.727247+0000","last_active":"2024-04-03T05:13:29.067193+0000","last_peered":"2024-04-03T05:13:29.067193+0000","last_clean":"2024-04-03T05:13:29.067193+0000","last_became_active":"2024-04-03T03:38:28.726412+0000","last_became_peered":"2024-04-03T03:38:28.726412+0000","last_unstale":"2024-04-03T05:13:29.067193+0000","last_undegraded":"2024-04-03T05:13:29.067193+0000","last_fullsized":"2024-04-03T05:13:29.067193+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'377","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.825508+0000","last_change":"2024-04-03T03:38:30.722458+0000","last_active":"2024-04-03T05:14:07.825508+0000","last_peered":"2024-04-03T05:14:07.825508+0000","last_clean":"2024-04-03T05:14:07.825508+0000","last_became_active":"2024-04-03T03:38:30.721642+0000","last_became_peered":"2024-04-03T03:38:30.721642+0000","last_unstale":"2024-04-03T05:14:07.825508+0000","last_undegraded":"2024-04-03T05:14:07.825508+0000","last_fullsized":"2024-04-03T05:14:07.825508+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44870,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":590,"num_read_kb":1131,"num_write":454,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:48.085274+0000","last_change":"2024-04-03T03:38:32.740223+0000","last_active":"2024-04-03T05:12:48.085274+0000","last_peered":"2024-04-03T05:12:48.085274+0000","last_clean":"2024-04-03T05:12:48.085274+0000","last_became_active":"2024-04-03T03:38:32.739496+0000","last_became_peered":"2024-04-03T03:38:32.739496+0000","last_unstale":"2024-04-03T05:12:48.085274+0000","last_undegraded":"2024-04-03T05:12:48.085274+0000","last_fullsized":"2024-04-03T05:12:48.085274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'93","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.772895+0000","last_change":"2024-04-03T05:14:28.773057+0000","last_active":"2024-04-03T05:14:28.772895+0000","last_peered":"2024-04-03T05:14:28.772895+0000","last_clean":"2024-04-03T05:14:28.772895+0000","last_became_active":"2024-04-03T03:38:34.751005+0000","last_became_peered":"2024-04-03T03:38:34.751005+0000","last_unstale":"2024-04-03T05:14:28.772895+0000","last_undegraded":"2024-04-03T05:14:28.772895+0000","last_fullsized":"2024-04-03T05:14:28.772895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'93","last_scrub_stamp":"2024-04-03T05:14:28.772679+0000","last_deep_scrub":"263'93","last_deep_scrub_stamp":"2024-04-03T05:14:28.772679+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.772679+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:51:16.361362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":214,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'780","reported_seq":2237,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.665460+0000","last_change":"2024-04-03T03:38:26.745971+0000","last_active":"2024-04-03T05:13:28.665460+0000","last_peered":"2024-04-03T05:13:28.665460+0000","last_clean":"2024-04-03T05:13:28.665460+0000","last_became_active":"2024-04-03T03:38:26.745135+0000","last_became_peered":"2024-04-03T03:38:26.745135+0000","last_unstale":"2024-04-03T05:13:28.665460+0000","last_undegraded":"2024-04-03T05:13:28.665460+0000","last_fullsized":"2024-04-03T05:13:28.665460+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3471,"num_read_kb":3079,"num_write":1070,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'292","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.570764+0000","last_change":"2024-04-03T03:38:24.744318+0000","last_active":"2024-04-03T05:14:10.570764+0000","last_peered":"2024-04-03T05:14:10.570764+0000","last_clean":"2024-04-03T05:14:10.570764+0000","last_became_active":"2024-04-03T03:38:24.743710+0000","last_became_peered":"2024-04-03T03:38:24.743710+0000","last_unstale":"2024-04-03T05:14:10.570764+0000","last_undegraded":"2024-04-03T05:14:10.570764+0000","last_fullsized":"2024-04-03T05:14:10.570764+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":414,"num_read_kb":32346,"num_write":1024,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.861206+0000","last_change":"2024-04-03T03:38:28.732955+0000","last_active":"2024-04-03T05:13:28.861206+0000","last_peered":"2024-04-03T05:13:28.861206+0000","last_clean":"2024-04-03T05:13:28.861206+0000","last_became_active":"2024-04-03T03:38:28.731547+0000","last_became_peered":"2024-04-03T03:38:28.731547+0000","last_unstale":"2024-04-03T05:13:28.861206+0000","last_undegraded":"2024-04-03T05:13:28.861206+0000","last_fullsized":"2024-04-03T05:13:28.861206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'314","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.942547+0000","last_change":"2024-04-03T03:38:30.733183+0000","last_active":"2024-04-03T05:14:07.942547+0000","last_peered":"2024-04-03T05:14:07.942547+0000","last_clean":"2024-04-03T05:14:07.942547+0000","last_became_active":"2024-04-03T03:38:30.732095+0000","last_became_peered":"2024-04-03T03:38:30.732095+0000","last_unstale":"2024-04-03T05:14:07.942547+0000","last_undegraded":"2024-04-03T05:14:07.942547+0000","last_fullsized":"2024-04-03T05:14:07.942547+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1184,"num_write":416,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.285076+0000","last_change":"2024-04-03T05:14:28.285133+0000","last_active":"2024-04-03T05:14:28.285076+0000","last_peered":"2024-04-03T05:14:28.285076+0000","last_clean":"2024-04-03T05:14:28.285076+0000","last_became_active":"2024-04-03T03:38:32.743994+0000","last_became_peered":"2024-04-03T03:38:32.743994+0000","last_unstale":"2024-04-03T05:14:28.285076+0000","last_undegraded":"2024-04-03T05:14:28.285076+0000","last_fullsized":"2024-04-03T05:14:28.285076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:28.284861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:28.284861+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.284861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:02:36.856459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'90","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.095153+0000","last_change":"2024-04-03T05:14:25.095237+0000","last_active":"2024-04-03T05:14:25.095153+0000","last_peered":"2024-04-03T05:14:25.095153+0000","last_clean":"2024-04-03T05:14:25.095153+0000","last_became_active":"2024-04-03T03:38:34.941122+0000","last_became_peered":"2024-04-03T03:38:34.941122+0000","last_unstale":"2024-04-03T05:14:25.095153+0000","last_undegraded":"2024-04-03T05:14:25.095153+0000","last_fullsized":"2024-04-03T05:14:25.095153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'90","last_scrub_stamp":"2024-04-03T05:14:25.094941+0000","last_deep_scrub":"263'90","last_deep_scrub_stamp":"2024-04-03T05:14:25.094941+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.094941+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:14:54.760676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'825","reported_seq":2458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.046097+0000","last_change":"2024-04-03T03:38:26.713100+0000","last_active":"2024-04-03T05:13:03.046097+0000","last_peered":"2024-04-03T05:13:03.046097+0000","last_clean":"2024-04-03T05:13:03.046097+0000","last_became_active":"2024-04-03T03:38:26.710804+0000","last_became_peered":"2024-04-03T03:38:26.710804+0000","last_unstale":"2024-04-03T05:13:03.046097+0000","last_undegraded":"2024-04-03T05:13:03.046097+0000","last_fullsized":"2024-04-03T05:13:03.046097+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3882,"num_read_kb":3472,"num_write":1106,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'370","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.563967+0000","last_change":"2024-04-03T03:38:24.727210+0000","last_active":"2024-04-03T05:14:10.563967+0000","last_peered":"2024-04-03T05:14:10.563967+0000","last_clean":"2024-04-03T05:14:10.563967+0000","last_became_active":"2024-04-03T03:38:24.726765+0000","last_became_peered":"2024-04-03T03:38:24.726765+0000","last_unstale":"2024-04-03T05:14:10.563967+0000","last_undegraded":"2024-04-03T05:14:10.563967+0000","last_fullsized":"2024-04-03T05:14:10.563967+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975468,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":544,"num_read_kb":31092,"num_write":1278,"num_write_kb":58109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:43.655306+0000","last_change":"2024-04-03T03:38:28.725916+0000","last_active":"2024-04-03T05:12:43.655306+0000","last_peered":"2024-04-03T05:12:43.655306+0000","last_clean":"2024-04-03T05:12:43.655306+0000","last_became_active":"2024-04-03T03:38:28.725139+0000","last_became_peered":"2024-04-03T03:38:28.725139+0000","last_unstale":"2024-04-03T05:12:43.655306+0000","last_undegraded":"2024-04-03T05:12:43.655306+0000","last_fullsized":"2024-04-03T05:12:43.655306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'259","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.191236+0000","last_change":"2024-04-03T03:38:30.721488+0000","last_active":"2024-04-03T05:14:10.191236+0000","last_peered":"2024-04-03T05:14:10.191236+0000","last_clean":"2024-04-03T05:14:10.191236+0000","last_became_active":"2024-04-03T03:38:30.719983+0000","last_became_peered":"2024-04-03T03:38:30.719983+0000","last_unstale":"2024-04-03T05:14:10.191236+0000","last_undegraded":"2024-04-03T05:14:10.191236+0000","last_fullsized":"2024-04-03T05:14:10.191236+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46477,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":1098,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.615281+0000","last_change":"2024-04-03T05:14:27.615333+0000","last_active":"2024-04-03T05:14:27.615281+0000","last_peered":"2024-04-03T05:14:27.615281+0000","last_clean":"2024-04-03T05:14:27.615281+0000","last_became_active":"2024-04-03T03:38:32.728438+0000","last_became_peered":"2024-04-03T03:38:32.728438+0000","last_unstale":"2024-04-03T05:14:27.615281+0000","last_undegraded":"2024-04-03T05:14:27.615281+0000","last_fullsized":"2024-04-03T05:14:27.615281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.615083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.615083+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.615083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:46:21.652566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'139","reported_seq":1191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.821692+0000","last_change":"2024-04-03T05:14:29.821852+0000","last_active":"2024-04-03T05:14:29.821692+0000","last_peered":"2024-04-03T05:14:29.821692+0000","last_clean":"2024-04-03T05:14:29.821692+0000","last_became_active":"2024-04-03T03:38:34.748329+0000","last_became_peered":"2024-04-03T03:38:34.748329+0000","last_unstale":"2024-04-03T05:14:29.821692+0000","last_undegraded":"2024-04-03T05:14:29.821692+0000","last_fullsized":"2024-04-03T05:14:29.821692+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-04-03T05:14:29.821474+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-04-03T05:14:29.821474+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.821474+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:03.047582+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":680,"num_read_kb":679,"num_write":303,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'715","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:43.655360+0000","last_change":"2024-04-03T03:38:26.746139+0000","last_active":"2024-04-03T05:12:43.655360+0000","last_peered":"2024-04-03T05:12:43.655360+0000","last_clean":"2024-04-03T05:12:43.655360+0000","last_became_active":"2024-04-03T03:38:26.742044+0000","last_became_peered":"2024-04-03T03:38:26.742044+0000","last_unstale":"2024-04-03T05:12:43.655360+0000","last_undegraded":"2024-04-03T05:12:43.655360+0000","last_fullsized":"2024-04-03T05:12:43.655360+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3199,"num_read_kb":2853,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'338","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.448612+0000","last_change":"2024-04-03T03:38:24.741033+0000","last_active":"2024-04-03T05:14:14.448612+0000","last_peered":"2024-04-03T05:14:14.448612+0000","last_clean":"2024-04-03T05:14:14.448612+0000","last_became_active":"2024-04-03T03:38:24.740329+0000","last_became_peered":"2024-04-03T03:38:24.740329+0000","last_unstale":"2024-04-03T05:14:14.448612+0000","last_undegraded":"2024-04-03T05:14:14.448612+0000","last_fullsized":"2024-04-03T05:14:14.448612+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050233,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":56728,"num_write":1264,"num_write_kb":35698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:12.867004+0000","last_change":"2024-04-03T03:38:28.726028+0000","last_active":"2024-04-03T05:13:12.867004+0000","last_peered":"2024-04-03T05:13:12.867004+0000","last_clean":"2024-04-03T05:13:12.867004+0000","last_became_active":"2024-04-03T03:38:28.725225+0000","last_became_peered":"2024-04-03T03:38:28.725225+0000","last_unstale":"2024-04-03T05:13:12.867004+0000","last_undegraded":"2024-04-03T05:13:12.867004+0000","last_fullsized":"2024-04-03T05:13:12.867004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'333","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.379020+0000","last_change":"2024-04-03T03:38:30.718060+0000","last_active":"2024-04-03T05:14:10.379020+0000","last_peered":"2024-04-03T05:14:10.379020+0000","last_clean":"2024-04-03T05:14:10.379020+0000","last_became_active":"2024-04-03T03:38:30.717323+0000","last_became_peered":"2024-04-03T03:38:30.717323+0000","last_unstale":"2024-04-03T05:14:10.379020+0000","last_undegraded":"2024-04-03T05:14:10.379020+0000","last_fullsized":"2024-04-03T05:14:10.379020+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41938,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1119,"num_write":416,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:33.093915+0000","last_change":"2024-04-03T03:38:32.743866+0000","last_active":"2024-04-03T05:13:33.093915+0000","last_peered":"2024-04-03T05:13:33.093915+0000","last_clean":"2024-04-03T05:13:33.093915+0000","last_became_active":"2024-04-03T03:38:32.743076+0000","last_became_peered":"2024-04-03T03:38:32.743076+0000","last_unstale":"2024-04-03T05:13:33.093915+0000","last_undegraded":"2024-04-03T05:13:33.093915+0000","last_fullsized":"2024-04-03T05:13:33.093915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:31.700076+0000","last_clean_scrub_stamp":"2024-04-03T03:38:31.700076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'78","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.535038+0000","last_change":"2024-04-03T05:14:22.535115+0000","last_active":"2024-04-03T05:14:22.535038+0000","last_peered":"2024-04-03T05:14:22.535038+0000","last_clean":"2024-04-03T05:14:22.535038+0000","last_became_active":"2024-04-03T03:38:34.749644+0000","last_became_peered":"2024-04-03T03:38:34.749644+0000","last_unstale":"2024-04-03T05:14:22.535038+0000","last_undegraded":"2024-04-03T05:14:22.535038+0000","last_fullsized":"2024-04-03T05:14:22.535038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-04-03T05:14:22.534825+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-04-03T05:14:22.534825+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.534825+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:40:34.618691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":90,"num_write":191,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'754","reported_seq":2411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:47.872382+0000","last_change":"2024-04-03T03:38:26.722653+0000","last_active":"2024-04-03T05:13:47.872382+0000","last_peered":"2024-04-03T05:13:47.872382+0000","last_clean":"2024-04-03T05:13:47.872382+0000","last_became_active":"2024-04-03T03:38:26.721951+0000","last_became_peered":"2024-04-03T03:38:26.721951+0000","last_unstale":"2024-04-03T05:13:47.872382+0000","last_undegraded":"2024-04-03T05:13:47.872382+0000","last_fullsized":"2024-04-03T05:13:47.872382+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3698,"num_read_kb":3347,"num_write":1000,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'304","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.157310+0000","last_change":"2024-04-03T03:38:24.742187+0000","last_active":"2024-04-03T05:14:17.157310+0000","last_peered":"2024-04-03T05:14:17.157310+0000","last_clean":"2024-04-03T05:14:17.157310+0000","last_became_active":"2024-04-03T03:38:24.741407+0000","last_became_peered":"2024-04-03T03:38:24.741407+0000","last_unstale":"2024-04-03T05:14:17.157310+0000","last_undegraded":"2024-04-03T05:14:17.157310+0000","last_fullsized":"2024-04-03T05:14:17.157310+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":24965,"num_write":1150,"num_write_kb":36078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1406","reported_seq":2748,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:47.872354+0000","last_change":"2024-04-03T03:38:26.719813+0000","last_active":"2024-04-03T05:13:47.872354+0000","last_peered":"2024-04-03T05:13:47.872354+0000","last_clean":"2024-04-03T05:13:47.872354+0000","last_became_active":"2024-04-03T03:38:26.719386+0000","last_became_peered":"2024-04-03T03:38:26.719386+0000","last_unstale":"2024-04-03T05:13:47.872354+0000","last_undegraded":"2024-04-03T05:13:47.872354+0000","last_fullsized":"2024-04-03T05:13:47.872354+0000","mapping_epoch":25,"log_start":"263'1300","ondisk_log_start":"263'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5587,"num_read_kb":4776,"num_write":2003,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'265","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.354998+0000","last_change":"2024-04-03T03:38:24.748771+0000","last_active":"2024-04-03T05:14:15.354998+0000","last_peered":"2024-04-03T05:14:15.354998+0000","last_clean":"2024-04-03T05:14:15.354998+0000","last_became_active":"2024-04-03T03:38:24.748369+0000","last_became_peered":"2024-04-03T03:38:24.748369+0000","last_unstale":"2024-04-03T05:14:15.354998+0000","last_undegraded":"2024-04-03T05:14:15.354998+0000","last_fullsized":"2024-04-03T05:14:15.354998+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050494,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":45141,"num_write":1016,"num_write_kb":24649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'761","reported_seq":2385,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:48.865795+0000","last_change":"2024-04-03T03:38:26.715097+0000","last_active":"2024-04-03T05:13:48.865795+0000","last_peered":"2024-04-03T05:13:48.865795+0000","last_clean":"2024-04-03T05:13:48.865795+0000","last_became_active":"2024-04-03T03:38:26.713821+0000","last_became_peered":"2024-04-03T03:38:26.713821+0000","last_unstale":"2024-04-03T05:13:48.865795+0000","last_undegraded":"2024-04-03T05:13:48.865795+0000","last_fullsized":"2024-04-03T05:13:48.865795+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3127,"num_write":983,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'367","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.711941+0000","last_change":"2024-04-03T03:38:24.741935+0000","last_active":"2024-04-03T05:14:16.711941+0000","last_peered":"2024-04-03T05:14:16.711941+0000","last_clean":"2024-04-03T05:14:16.711941+0000","last_became_active":"2024-04-03T03:38:24.741322+0000","last_became_peered":"2024-04-03T03:38:24.741322+0000","last_unstale":"2024-04-03T05:14:16.711941+0000","last_undegraded":"2024-04-03T05:14:16.711941+0000","last_fullsized":"2024-04-03T05:14:16.711941+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":110805,"num_write":1222,"num_write_kb":46785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'793","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:47.872193+0000","last_change":"2024-04-03T03:38:26.719415+0000","last_active":"2024-04-03T05:13:47.872193+0000","last_peered":"2024-04-03T05:13:47.872193+0000","last_clean":"2024-04-03T05:13:47.872193+0000","last_became_active":"2024-04-03T03:38:26.718895+0000","last_became_peered":"2024-04-03T03:38:26.718895+0000","last_unstale":"2024-04-03T05:13:47.872193+0000","last_undegraded":"2024-04-03T05:13:47.872193+0000","last_fullsized":"2024-04-03T05:13:47.872193+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3511,"num_read_kb":3115,"num_write":1065,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'355","reported_seq":1146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.281575+0000","last_change":"2024-04-03T05:14:22.281665+0000","last_active":"2024-04-03T05:14:22.281575+0000","last_peered":"2024-04-03T05:14:22.281575+0000","last_clean":"2024-04-03T05:14:22.281575+0000","last_became_active":"2024-04-03T03:38:58.349944+0000","last_became_peered":"2024-04-03T03:38:58.349944+0000","last_unstale":"2024-04-03T05:14:22.281575+0000","last_undegraded":"2024-04-03T05:14:22.281575+0000","last_fullsized":"2024-04-03T05:14:22.281575+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-04-03T05:14:22.281372+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-04-03T05:14:22.281372+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.281372+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:11.179395+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":861,"num_read_kb":89019,"num_write":1362,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1190","reported_seq":2756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:33.038450+0000","last_change":"2024-04-03T03:38:26.715473+0000","last_active":"2024-04-03T05:12:33.038450+0000","last_peered":"2024-04-03T05:12:33.038450+0000","last_clean":"2024-04-03T05:12:33.038450+0000","last_became_active":"2024-04-03T03:38:26.715042+0000","last_became_peered":"2024-04-03T03:38:26.715042+0000","last_unstale":"2024-04-03T05:12:33.038450+0000","last_undegraded":"2024-04-03T05:12:33.038450+0000","last_fullsized":"2024-04-03T05:12:33.038450+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5057,"num_read_kb":4409,"num_write":1655,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'301","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.069802+0000","last_change":"2024-04-03T05:14:24.070042+0000","last_active":"2024-04-03T05:14:24.069802+0000","last_peered":"2024-04-03T05:14:24.069802+0000","last_clean":"2024-04-03T05:14:24.069802+0000","last_became_active":"2024-04-03T03:38:58.350321+0000","last_became_peered":"2024-04-03T03:38:58.350321+0000","last_unstale":"2024-04-03T05:14:24.069802+0000","last_undegraded":"2024-04-03T05:14:24.069802+0000","last_fullsized":"2024-04-03T05:14:24.069802+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-04-03T05:14:24.069542+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-04-03T05:14:24.069542+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.069542+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:05:52.218774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550052,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":66631,"num_write":1085,"num_write_kb":28536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'742","reported_seq":2202,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.259889+0000","last_change":"2024-04-03T03:38:26.745737+0000","last_active":"2024-04-03T05:14:16.259889+0000","last_peered":"2024-04-03T05:14:16.259889+0000","last_clean":"2024-04-03T05:14:16.259889+0000","last_became_active":"2024-04-03T03:38:26.744330+0000","last_became_peered":"2024-04-03T03:38:26.744330+0000","last_unstale":"2024-04-03T05:14:16.259889+0000","last_undegraded":"2024-04-03T05:14:16.259889+0000","last_fullsized":"2024-04-03T05:14:16.259889+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3386,"num_read_kb":3032,"num_write":1008,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'326","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.559721+0000","last_change":"2024-04-03T03:38:24.708018+0000","last_active":"2024-04-03T05:14:10.559721+0000","last_peered":"2024-04-03T05:14:10.559721+0000","last_clean":"2024-04-03T05:14:10.559721+0000","last_became_active":"2024-04-03T03:38:24.707626+0000","last_became_peered":"2024-04-03T03:38:24.707626+0000","last_unstale":"2024-04-03T05:14:10.559721+0000","last_undegraded":"2024-04-03T05:14:10.559721+0000","last_fullsized":"2024-04-03T05:14:10.559721+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":9991,"num_write":1303,"num_write_kb":25388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'423","reported_seq":1813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.809691+0000","last_change":"2024-04-03T03:38:26.726283+0000","last_active":"2024-04-03T05:14:15.809691+0000","last_peered":"2024-04-03T05:14:15.809691+0000","last_clean":"2024-04-03T05:14:15.809691+0000","last_became_active":"2024-04-03T03:38:26.725513+0000","last_became_peered":"2024-04-03T03:38:26.725513+0000","last_unstale":"2024-04-03T05:14:15.809691+0000","last_undegraded":"2024-04-03T05:14:15.809691+0000","last_fullsized":"2024-04-03T05:14:15.809691+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2235,"num_read_kb":2034,"num_write":556,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'284","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.556438+0000","last_change":"2024-04-03T03:38:24.749614+0000","last_active":"2024-04-03T05:14:10.556438+0000","last_peered":"2024-04-03T05:14:10.556438+0000","last_clean":"2024-04-03T05:14:10.556438+0000","last_became_active":"2024-04-03T03:38:24.748923+0000","last_became_peered":"2024-04-03T03:38:24.748923+0000","last_unstale":"2024-04-03T05:14:10.556438+0000","last_undegraded":"2024-04-03T05:14:10.556438+0000","last_fullsized":"2024-04-03T05:14:10.556438+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306678,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":42672,"num_write":1032,"num_write_kb":23960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'702","reported_seq":2131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.157465+0000","last_change":"2024-04-03T03:38:26.717032+0000","last_active":"2024-04-03T05:14:17.157465+0000","last_peered":"2024-04-03T05:14:17.157465+0000","last_clean":"2024-04-03T05:14:17.157465+0000","last_became_active":"2024-04-03T03:38:26.716359+0000","last_became_peered":"2024-04-03T03:38:26.716359+0000","last_unstale":"2024-04-03T05:14:17.157465+0000","last_undegraded":"2024-04-03T05:14:17.157465+0000","last_fullsized":"2024-04-03T05:14:17.157465+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3142,"num_read_kb":2808,"num_write":934,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'337","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.574906+0000","last_change":"2024-04-03T03:38:24.718541+0000","last_active":"2024-04-03T05:14:10.574906+0000","last_peered":"2024-04-03T05:14:10.574906+0000","last_clean":"2024-04-03T05:14:10.574906+0000","last_became_active":"2024-04-03T03:38:24.716473+0000","last_became_peered":"2024-04-03T03:38:24.716473+0000","last_unstale":"2024-04-03T05:14:10.574906+0000","last_undegraded":"2024-04-03T05:14:10.574906+0000","last_fullsized":"2024-04-03T05:14:10.574906+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3764519,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":31436,"num_write":1237,"num_write_kb":38562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'397","reported_seq":1847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.101463+0000","last_change":"2024-04-03T03:38:26.717644+0000","last_active":"2024-04-03T05:14:08.101463+0000","last_peered":"2024-04-03T05:14:08.101463+0000","last_clean":"2024-04-03T05:14:08.101463+0000","last_became_active":"2024-04-03T03:38:26.716435+0000","last_became_peered":"2024-04-03T03:38:26.716435+0000","last_unstale":"2024-04-03T05:14:08.101463+0000","last_undegraded":"2024-04-03T05:14:08.101463+0000","last_fullsized":"2024-04-03T05:14:08.101463+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2146,"num_read_kb":2018,"num_write":509,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'422","reported_seq":1220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:13.872128+0000","last_change":"2024-04-03T03:38:24.741361+0000","last_active":"2024-04-03T05:14:13.872128+0000","last_peered":"2024-04-03T05:14:13.872128+0000","last_clean":"2024-04-03T05:14:13.872128+0000","last_became_active":"2024-04-03T03:38:24.740664+0000","last_became_peered":"2024-04-03T03:38:24.740664+0000","last_unstale":"2024-04-03T05:14:13.872128+0000","last_undegraded":"2024-04-03T05:14:13.872128+0000","last_fullsized":"2024-04-03T05:14:13.872128+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10717012,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":923,"num_read_kb":68467,"num_write":1504,"num_write_kb":54703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'407","reported_seq":1977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.674025+0000","last_change":"2024-04-03T03:38:26.752206+0000","last_active":"2024-04-03T05:14:08.674025+0000","last_peered":"2024-04-03T05:14:08.674025+0000","last_clean":"2024-04-03T05:14:08.674025+0000","last_became_active":"2024-04-03T03:38:26.751399+0000","last_became_peered":"2024-04-03T03:38:26.751399+0000","last_unstale":"2024-04-03T05:14:08.674025+0000","last_undegraded":"2024-04-03T05:14:08.674025+0000","last_fullsized":"2024-04-03T05:14:08.674025+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2116,"num_write":486,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'294","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.560501+0000","last_change":"2024-04-03T03:38:24.718194+0000","last_active":"2024-04-03T05:14:10.560501+0000","last_peered":"2024-04-03T05:14:10.560501+0000","last_clean":"2024-04-03T05:14:10.560501+0000","last_became_active":"2024-04-03T03:38:24.715106+0000","last_became_peered":"2024-04-03T03:38:24.715106+0000","last_unstale":"2024-04-03T05:14:10.560501+0000","last_undegraded":"2024-04-03T05:14:10.560501+0000","last_fullsized":"2024-04-03T05:14:10.560501+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642458,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":15103,"num_write":965,"num_write_kb":22507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'628","reported_seq":2278,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:59.184321+0000","last_change":"2024-04-03T03:38:26.717354+0000","last_active":"2024-04-03T05:13:59.184321+0000","last_peered":"2024-04-03T05:13:59.184321+0000","last_clean":"2024-04-03T05:13:59.184321+0000","last_became_active":"2024-04-03T03:38:26.717085+0000","last_became_peered":"2024-04-03T03:38:26.717085+0000","last_unstale":"2024-04-03T05:13:59.184321+0000","last_undegraded":"2024-04-03T05:13:59.184321+0000","last_fullsized":"2024-04-03T05:13:59.184321+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3119,"num_read_kb":2815,"num_write":838,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'344","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.583208+0000","last_change":"2024-04-03T03:38:24.755928+0000","last_active":"2024-04-03T05:14:10.583208+0000","last_peered":"2024-04-03T05:14:10.583208+0000","last_clean":"2024-04-03T05:14:10.583208+0000","last_became_active":"2024-04-03T03:38:24.755345+0000","last_became_peered":"2024-04-03T03:38:24.755345+0000","last_unstale":"2024-04-03T05:14:10.583208+0000","last_undegraded":"2024-04-03T05:14:10.583208+0000","last_fullsized":"2024-04-03T05:14:10.583208+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194329,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":14159,"num_write":1284,"num_write_kb":40251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'700","reported_seq":2139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.658917+0000","last_change":"2024-04-03T03:38:26.746104+0000","last_active":"2024-04-03T05:12:58.658917+0000","last_peered":"2024-04-03T05:12:58.658917+0000","last_clean":"2024-04-03T05:12:58.658917+0000","last_became_active":"2024-04-03T03:38:26.745102+0000","last_became_peered":"2024-04-03T03:38:26.745102+0000","last_unstale":"2024-04-03T05:12:58.658917+0000","last_undegraded":"2024-04-03T05:12:58.658917+0000","last_fullsized":"2024-04-03T05:12:58.658917+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3146,"num_read_kb":2819,"num_write":922,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'360","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.576035+0000","last_change":"2024-04-03T03:38:24.729779+0000","last_active":"2024-04-03T05:14:10.576035+0000","last_peered":"2024-04-03T05:14:10.576035+0000","last_clean":"2024-04-03T05:14:10.576035+0000","last_became_active":"2024-04-03T03:38:24.729149+0000","last_became_peered":"2024-04-03T03:38:24.729149+0000","last_unstale":"2024-04-03T05:14:10.576035+0000","last_undegraded":"2024-04-03T05:14:10.576035+0000","last_fullsized":"2024-04-03T05:14:10.576035+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3498280,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":538,"num_read_kb":15990,"num_write":1205,"num_write_kb":30672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'376","reported_seq":1993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:59.060513+0000","last_change":"2024-04-03T03:38:26.714537+0000","last_active":"2024-04-03T05:12:59.060513+0000","last_peered":"2024-04-03T05:12:59.060513+0000","last_clean":"2024-04-03T05:12:59.060513+0000","last_became_active":"2024-04-03T03:38:26.713796+0000","last_became_peered":"2024-04-03T03:38:26.713796+0000","last_unstale":"2024-04-03T05:12:59.060513+0000","last_undegraded":"2024-04-03T05:12:59.060513+0000","last_fullsized":"2024-04-03T05:12:59.060513+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2155,"num_read_kb":2080,"num_write":414,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'297","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.545025+0000","last_change":"2024-04-03T03:38:24.750293+0000","last_active":"2024-04-03T05:14:10.545025+0000","last_peered":"2024-04-03T05:14:10.545025+0000","last_clean":"2024-04-03T05:14:10.545025+0000","last_became_active":"2024-04-03T03:38:24.749152+0000","last_became_peered":"2024-04-03T03:38:24.749152+0000","last_unstale":"2024-04-03T05:14:10.545025+0000","last_undegraded":"2024-04-03T05:14:10.545025+0000","last_fullsized":"2024-04-03T05:14:10.545025+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":381,"num_read_kb":32536,"num_write":1044,"num_write_kb":42333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1009","reported_seq":2656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.087787+0000","last_change":"2024-04-03T03:38:26.729663+0000","last_active":"2024-04-03T05:12:58.087787+0000","last_peered":"2024-04-03T05:12:58.087787+0000","last_clean":"2024-04-03T05:12:58.087787+0000","last_became_active":"2024-04-03T03:38:26.729124+0000","last_became_peered":"2024-04-03T03:38:26.729124+0000","last_unstale":"2024-04-03T05:12:58.087787+0000","last_undegraded":"2024-04-03T05:12:58.087787+0000","last_fullsized":"2024-04-03T05:12:58.087787+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":900,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4687,"num_read_kb":4082,"num_write":1459,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'345","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.569496+0000","last_change":"2024-04-03T03:38:24.732372+0000","last_active":"2024-04-03T05:14:10.569496+0000","last_peered":"2024-04-03T05:14:10.569496+0000","last_clean":"2024-04-03T05:14:10.569496+0000","last_became_active":"2024-04-03T03:38:24.731586+0000","last_became_peered":"2024-04-03T03:38:24.731586+0000","last_unstale":"2024-04-03T05:14:10.569496+0000","last_undegraded":"2024-04-03T05:14:10.569496+0000","last_fullsized":"2024-04-03T05:14:10.569496+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282846,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":553,"num_read_kb":86610,"num_write":1391,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'364","reported_seq":1860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.044767+0000","last_change":"2024-04-03T03:38:26.728365+0000","last_active":"2024-04-03T05:12:58.044767+0000","last_peered":"2024-04-03T05:12:58.044767+0000","last_clean":"2024-04-03T05:12:58.044767+0000","last_became_active":"2024-04-03T03:38:26.728070+0000","last_became_peered":"2024-04-03T03:38:26.728070+0000","last_unstale":"2024-04-03T05:12:58.044767+0000","last_undegraded":"2024-04-03T05:12:58.044767+0000","last_fullsized":"2024-04-03T05:12:58.044767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2004,"num_read_kb":1922,"num_write":414,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'366","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.571430+0000","last_change":"2024-04-03T03:38:24.726372+0000","last_active":"2024-04-03T05:14:10.571430+0000","last_peered":"2024-04-03T05:14:10.571430+0000","last_clean":"2024-04-03T05:14:10.571430+0000","last_became_active":"2024-04-03T03:38:24.725969+0000","last_became_peered":"2024-04-03T03:38:24.725969+0000","last_unstale":"2024-04-03T05:14:10.571430+0000","last_undegraded":"2024-04-03T05:14:10.571430+0000","last_fullsized":"2024-04-03T05:14:10.571430+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360956,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":552,"num_read_kb":62664,"num_write":1296,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'466","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.079084+0000","last_change":"2024-04-03T03:38:26.706006+0000","last_active":"2024-04-03T05:14:14.079084+0000","last_peered":"2024-04-03T05:14:14.079084+0000","last_clean":"2024-04-03T05:14:14.079084+0000","last_became_active":"2024-04-03T03:38:26.705142+0000","last_became_peered":"2024-04-03T03:38:26.705142+0000","last_unstale":"2024-04-03T05:14:14.079084+0000","last_undegraded":"2024-04-03T05:14:14.079084+0000","last_fullsized":"2024-04-03T05:14:14.079084+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2439,"num_read_kb":2283,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'321","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.562021+0000","last_change":"2024-04-03T03:38:24.749516+0000","last_active":"2024-04-03T05:14:10.562021+0000","last_peered":"2024-04-03T05:14:10.562021+0000","last_clean":"2024-04-03T05:14:10.562021+0000","last_became_active":"2024-04-03T03:38:24.748843+0000","last_became_peered":"2024-04-03T03:38:24.748843+0000","last_unstale":"2024-04-03T05:14:10.562021+0000","last_undegraded":"2024-04-03T05:14:10.562021+0000","last_fullsized":"2024-04-03T05:14:10.562021+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":1436,"num_write":1076,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'325","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.559543+0000","last_change":"2024-04-03T03:38:24.740753+0000","last_active":"2024-04-03T05:14:10.559543+0000","last_peered":"2024-04-03T05:14:10.559543+0000","last_clean":"2024-04-03T05:14:10.559543+0000","last_became_active":"2024-04-03T03:38:24.737358+0000","last_became_peered":"2024-04-03T03:38:24.737358+0000","last_unstale":"2024-04-03T05:14:10.559543+0000","last_undegraded":"2024-04-03T05:14:10.559543+0000","last_fullsized":"2024-04-03T05:14:10.559543+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5528791,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":543,"num_read_kb":13846,"num_write":1342,"num_write_kb":46293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'651","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:08.090375+0000","last_change":"2024-04-03T03:38:26.718253+0000","last_active":"2024-04-03T05:13:08.090375+0000","last_peered":"2024-04-03T05:13:08.090375+0000","last_clean":"2024-04-03T05:13:08.090375+0000","last_became_active":"2024-04-03T03:38:26.717854+0000","last_became_peered":"2024-04-03T03:38:26.717854+0000","last_unstale":"2024-04-03T05:13:08.090375+0000","last_undegraded":"2024-04-03T05:13:08.090375+0000","last_fullsized":"2024-04-03T05:13:08.090375+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3358,"num_read_kb":3036,"num_write":900,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'386","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.582765+0000","last_change":"2024-04-03T03:38:24.730677+0000","last_active":"2024-04-03T05:14:10.582765+0000","last_peered":"2024-04-03T05:14:10.582765+0000","last_clean":"2024-04-03T05:14:10.582765+0000","last_became_active":"2024-04-03T03:38:24.730312+0000","last_became_peered":"2024-04-03T03:38:24.730312+0000","last_unstale":"2024-04-03T05:14:10.582765+0000","last_undegraded":"2024-04-03T05:14:10.582765+0000","last_fullsized":"2024-04-03T05:14:10.582765+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342930,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":661,"num_read_kb":19035,"num_write":1410,"num_write_kb":53256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'683","reported_seq":2063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:43.851321+0000","last_change":"2024-04-03T03:38:26.728858+0000","last_active":"2024-04-03T05:12:43.851321+0000","last_peered":"2024-04-03T05:12:43.851321+0000","last_clean":"2024-04-03T05:12:43.851321+0000","last_became_active":"2024-04-03T03:38:26.728038+0000","last_became_peered":"2024-04-03T03:38:26.728038+0000","last_unstale":"2024-04-03T05:12:43.851321+0000","last_undegraded":"2024-04-03T05:12:43.851321+0000","last_fullsized":"2024-04-03T05:12:43.851321+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3172,"num_read_kb":2837,"num_write":928,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":195556,"num_write":183,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5643,"num_read_kb":4008,"num_write":2168,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3956,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1288,"ondisk_log_size":1288,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":11006,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":12265,"num_read_kb":12111,"num_write":14239,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1890,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":22012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2616,"ondisk_log_size":2616,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":375,"ondisk_log_size":375,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1532186,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19519,"num_read_kb":39189,"num_write":16363,"num_write_kb":11731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":492614,"num_omap_keys":1148,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1800,"ondisk_log_size":1800,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1711,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1602,"num_read_kb":1902,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":189133,"num_read_kb":172083,"num_write":51171,"num_write_kb":17715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":5,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4089,"ondisk_log_size":4089,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":162411735,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":0,"num_read":35354,"num_read_kb":2539931,"num_write":77944,"num_write_kb":2266597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":246079488,"data_stored":246079488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3564,"ondisk_log_size":3564,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":216081,"num_write":183,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510604,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":352532,"kb_used_data":46476,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94019308,"statfs":{"total":96636764160,"available":96275771392,"internally_reserved":0,"allocated":47591424,"data_stored":45521294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":313391562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510606,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305720,"kb_used_data":44080,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94066120,"statfs":{"total":96636764160,"available":96323706880,"internally_reserved":0,"allocated":45137920,"data_stored":43104262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510603,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183136,"kb_used_data":35416,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94188704,"statfs":{"total":96636764160,"available":96449232896,"internally_reserved":0,"allocated":36265984,"data_stored":34171288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510602,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141844,"kb_used_data":38476,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94229996,"statfs":{"total":96636764160,"available":96491515904,"internally_reserved":0,"allocated":39399424,"data_stored":37369253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":105839047},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543309,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300868,"kb_used_data":48956,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94070972,"statfs":{"total":96636764160,"available":96328675328,"internally_reserved":0,"allocated":50130944,"data_stored":48057944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543309,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132128,"kb_used_data":38488,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94239712,"statfs":{"total":96636764160,"available":96501465088,"internally_reserved":0,"allocated":39411712,"data_stored":37394593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95877574},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543306,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":203096,"kb_used_data":41488,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94168744,"statfs":{"total":96636764160,"available":96428793856,"internally_reserved":0,"allocated":42483712,"data_stored":40444668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543307,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303500,"kb_used_data":47428,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94068340,"statfs":{"total":96636764160,"available":96325980160,"internally_reserved":0,"allocated":48566272,"data_stored":46507952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262207941},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28962816,"data_stored":28962816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32927744,"data_stored":32927744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24633344,"data_stored":24633344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32149504,"data_stored":32149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32997376,"data_stored":32997376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":31895552,"data_stored":31895552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29294592,"data_stored":29294592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":33218560,"data_stored":33218560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T05:14:38.479 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.479 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.479 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.480 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.480 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.480 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.480 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.480 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.480 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.481 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.481 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.481 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.481 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.481 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.481 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.481 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.482 INFO:tasks.ceph:pgid 64.17 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.482 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.482 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.482 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.482 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.482 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.482 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.482 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.483 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.483 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.483 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.483 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.483 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.483 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.483 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.484 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.484 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.484 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.484 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.484 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.484 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.484 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.485 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.485 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.485 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.485 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.485 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.485 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.485 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.486 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.486 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.486 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.486 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.486 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.486 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.486 INFO:tasks.ceph:pgid 64.7 last_scrub_stamp 2024-04-03T03:48:59.933523+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=48, tm_sec=59, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.487 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.487 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.487 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.487 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.487 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.487 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.487 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.488 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.488 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.488 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.488 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.488 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.488 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.488 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.489 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.489 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.489 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.489 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.489 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.489 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.489 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.489 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.489 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.490 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.490 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.490 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.490 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.490 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.490 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.490 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.491 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.491 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.491 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.491 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.491 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.491 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.491 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.491 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.491 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.492 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.492 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.492 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.492 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.492 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.492 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.492 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.493 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.493 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.493 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.493 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.493 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.493 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.493 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.493 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.494 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.494 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.494 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.494 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.494 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.494 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.494 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.494 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.495 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.495 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.495 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.495 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.495 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.495 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.495 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.496 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.496 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.496 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.496 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.496 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.496 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.496 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.497 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.497 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.497 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.497 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.497 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-03T03:38:03.047546+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=3, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.497 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.497 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.498 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.498 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.498 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.498 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.498 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.498 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.498 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.498 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.499 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.499 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.499 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.499 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.499 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.499 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.499 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.500 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.500 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.500 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.500 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.500 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.500 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.500 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.500 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.501 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.501 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.501 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.501 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.501 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.501 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.501 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.501 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.502 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.502 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.502 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.502 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.502 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.502 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.502 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.503 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.503 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.503 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.503 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.503 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.503 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.503 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.503 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.504 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.504 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.504 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.504 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.504 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.504 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.504 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.504 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.505 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.505 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.505 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.505 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.505 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.505 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.505 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-03T03:38:33.705619+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=33, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.505 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.506 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.506 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.506 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.506 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.506 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.506 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.506 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.507 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.507 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.507 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.507 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.507 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.507 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.507 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.507 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.508 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.508 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.508 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.508 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.508 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.508 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.508 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.508 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-03T03:38:31.700076+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=31, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.509 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.509 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.509 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.509 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.509 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.509 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.509 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.509 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.510 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.510 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.510 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.510 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.510 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.510 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.510 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.510 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.511 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.511 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.511 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.511 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.511 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.511 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.511 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.511 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.512 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.512 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.512 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.512 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.512 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.512 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.512 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.512 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.512 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.513 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:38.513 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-03T05:14:58.514 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-03T05:14:58.897 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:14:58.911 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-03T05:14:58.920 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":3162,"stamp":"2024-04-03T05:14:58.561088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198101438,"num_objects":887,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":887,"num_whiteouts":0,"num_read":263989,"num_read_kb":3180969,"num_write":162444,"num_write_kb":2577796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":158,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":669930,"num_omap_keys":1658,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13792,"ondisk_log_size":13792,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1926984,"kb_used_data":340808,"kb_used_omap":12,"kb_used_meta":1586099,"kb_avail":753047736,"statfs":{"total":773094113280,"available":771120881664,"internally_reserved":0,"allocated":348987392,"data_stored":332571254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1624165939},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44468,"num_omap_keys":134,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008335"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.670978+0000","last_change":"2024-04-03T04:18:51.297907+0000","last_active":"2024-04-03T05:13:53.670978+0000","last_peered":"2024-04-03T05:13:53.670978+0000","last_clean":"2024-04-03T05:13:53.670978+0000","last_became_active":"2024-04-03T04:18:51.297066+0000","last_became_peered":"2024-04-03T04:18:51.297066+0000","last_unstale":"2024-04-03T05:13:53.670978+0000","last_undegraded":"2024-04-03T05:13:53.670978+0000","last_fullsized":"2024-04-03T05:13:53.670978+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"258'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:55.454629+0000","last_change":"2024-04-03T05:14:55.454693+0000","last_active":"2024-04-03T05:14:55.454629+0000","last_peered":"2024-04-03T05:14:55.454629+0000","last_clean":"2024-04-03T05:14:55.454629+0000","last_became_active":"2024-04-03T03:55:53.274262+0000","last_became_peered":"2024-04-03T03:55:53.274262+0000","last_unstale":"2024-04-03T05:14:55.454629+0000","last_undegraded":"2024-04-03T05:14:55.454629+0000","last_fullsized":"2024-04-03T05:14:55.454629+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:55.454387+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:55.454387+0000","last_clean_scrub_stamp":"2024-04-03T05:14:55.454387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:21:42.508679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'2","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.439897+0000","last_change":"2024-04-03T05:14:43.440062+0000","last_active":"2024-04-03T05:14:43.439897+0000","last_peered":"2024-04-03T05:14:43.439897+0000","last_clean":"2024-04-03T05:14:43.439897+0000","last_became_active":"2024-04-03T03:55:45.807880+0000","last_became_peered":"2024-04-03T03:55:45.807880+0000","last_unstale":"2024-04-03T05:14:43.439897+0000","last_undegraded":"2024-04-03T05:14:43.439897+0000","last_fullsized":"2024-04-03T05:14:43.439897+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:43.439591+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:43.439591+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.439591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:00:00.526166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"263'26","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.265071+0000","last_change":"2024-04-03T05:14:21.265071+0000","last_active":"2024-04-03T05:14:21.265071+0000","last_peered":"2024-04-03T05:14:21.265071+0000","last_clean":"2024-04-03T05:14:21.265071+0000","last_became_active":"2024-04-03T03:49:00.987495+0000","last_became_peered":"2024-04-03T03:49:00.987495+0000","last_unstale":"2024-04-03T05:14:21.265071+0000","last_undegraded":"2024-04-03T05:14:21.265071+0000","last_fullsized":"2024-04-03T05:14:21.265071+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-04-03T05:14:21.264793+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-04-03T05:14:21.264793+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.264793+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:44:58.383385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":70,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.866894+0000","last_change":"2024-04-03T04:18:51.320955+0000","last_active":"2024-04-03T05:13:53.866894+0000","last_peered":"2024-04-03T05:13:53.866894+0000","last_clean":"2024-04-03T05:13:53.866894+0000","last_became_active":"2024-04-03T04:18:51.320118+0000","last_became_peered":"2024-04-03T04:18:51.320118+0000","last_unstale":"2024-04-03T05:13:53.866894+0000","last_undegraded":"2024-04-03T05:13:53.866894+0000","last_fullsized":"2024-04-03T05:13:53.866894+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.165992+0000","last_change":"2024-04-03T05:14:35.166055+0000","last_active":"2024-04-03T05:14:35.165992+0000","last_peered":"2024-04-03T05:14:35.165992+0000","last_clean":"2024-04-03T05:14:35.165992+0000","last_became_active":"2024-04-03T03:55:53.238473+0000","last_became_peered":"2024-04-03T03:55:53.238473+0000","last_unstale":"2024-04-03T05:14:35.165992+0000","last_undegraded":"2024-04-03T05:14:35.165992+0000","last_fullsized":"2024-04-03T05:14:35.165992+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:35.165781+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:35.165781+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.165781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:13:54.846919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"258'3","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.238725+0000","last_change":"2024-04-03T05:14:27.238725+0000","last_active":"2024-04-03T05:14:27.238725+0000","last_peered":"2024-04-03T05:14:27.238725+0000","last_clean":"2024-04-03T05:14:27.238725+0000","last_became_active":"2024-04-03T03:55:45.831610+0000","last_became_peered":"2024-04-03T03:55:45.831610+0000","last_unstale":"2024-04-03T05:14:27.238725+0000","last_undegraded":"2024-04-03T05:14:27.238725+0000","last_fullsized":"2024-04-03T05:14:27.238725+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-04-03T05:14:27.238085+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-04-03T05:14:27.238085+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.238085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:41:45.149752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"263'35","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.227454+0000","last_change":"2024-04-03T05:14:20.227526+0000","last_active":"2024-04-03T05:14:20.227454+0000","last_peered":"2024-04-03T05:14:20.227454+0000","last_clean":"2024-04-03T05:14:20.227454+0000","last_became_active":"2024-04-03T03:49:00.988912+0000","last_became_peered":"2024-04-03T03:49:00.988912+0000","last_unstale":"2024-04-03T05:14:20.227454+0000","last_undegraded":"2024-04-03T05:14:20.227454+0000","last_fullsized":"2024-04-03T05:14:20.227454+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-04-03T05:14:20.227243+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-04-03T05:14:20.227243+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.227243+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:12:02.335893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:08.047438+0000","last_change":"2024-04-03T04:18:51.365311+0000","last_active":"2024-04-03T05:13:08.047438+0000","last_peered":"2024-04-03T05:13:08.047438+0000","last_clean":"2024-04-03T05:13:08.047438+0000","last_became_active":"2024-04-03T04:18:51.364557+0000","last_became_peered":"2024-04-03T04:18:51.364557+0000","last_unstale":"2024-04-03T05:13:08.047438+0000","last_undegraded":"2024-04-03T05:13:08.047438+0000","last_fullsized":"2024-04-03T05:13:08.047438+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.738873+0000","last_change":"2024-04-03T05:14:32.738935+0000","last_active":"2024-04-03T05:14:32.738873+0000","last_peered":"2024-04-03T05:14:32.738873+0000","last_clean":"2024-04-03T05:14:32.738873+0000","last_became_active":"2024-04-03T03:55:53.269276+0000","last_became_peered":"2024-04-03T03:55:53.269276+0000","last_unstale":"2024-04-03T05:14:32.738873+0000","last_undegraded":"2024-04-03T05:14:32.738873+0000","last_fullsized":"2024-04-03T05:14:32.738873+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-04-03T05:14:32.738678+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-04-03T05:14:32.738678+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.738678+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:42.161639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'9","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.056890+0000","last_change":"2024-04-03T05:14:23.056951+0000","last_active":"2024-04-03T05:14:23.056890+0000","last_peered":"2024-04-03T05:14:23.056890+0000","last_clean":"2024-04-03T05:14:23.056890+0000","last_became_active":"2024-04-03T03:55:45.822526+0000","last_became_peered":"2024-04-03T03:55:45.822526+0000","last_unstale":"2024-04-03T05:14:23.056890+0000","last_undegraded":"2024-04-03T05:14:23.056890+0000","last_fullsized":"2024-04-03T05:14:23.056890+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-04-03T05:14:23.056684+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-04-03T05:14:23.056684+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.056684+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:33:14.906245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12606,"num_write":14,"num_write_kb":9534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"263'33","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.783144+0000","last_change":"2024-04-03T05:14:21.783310+0000","last_active":"2024-04-03T05:14:21.783144+0000","last_peered":"2024-04-03T05:14:21.783144+0000","last_clean":"2024-04-03T05:14:21.783144+0000","last_became_active":"2024-04-03T03:49:00.992254+0000","last_became_peered":"2024-04-03T03:49:00.992254+0000","last_unstale":"2024-04-03T05:14:21.783144+0000","last_undegraded":"2024-04-03T05:14:21.783144+0000","last_fullsized":"2024-04-03T05:14:21.783144+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-04-03T05:14:21.782914+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-04-03T05:14:21.782914+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.782914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:52.468078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":101,"num_write":55,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.089182+0000","last_change":"2024-04-03T04:18:51.373813+0000","last_active":"2024-04-03T05:13:03.089182+0000","last_peered":"2024-04-03T05:13:03.089182+0000","last_clean":"2024-04-03T05:13:03.089182+0000","last_became_active":"2024-04-03T04:18:51.373051+0000","last_became_peered":"2024-04-03T04:18:51.373051+0000","last_unstale":"2024-04-03T05:13:03.089182+0000","last_undegraded":"2024-04-03T05:13:03.089182+0000","last_fullsized":"2024-04-03T05:13:03.089182+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.348280+0000","last_change":"2024-04-03T05:14:49.348347+0000","last_active":"2024-04-03T05:14:49.348280+0000","last_peered":"2024-04-03T05:14:49.348280+0000","last_clean":"2024-04-03T05:14:49.348280+0000","last_became_active":"2024-04-03T03:55:53.274825+0000","last_became_peered":"2024-04-03T03:55:53.274825+0000","last_unstale":"2024-04-03T05:14:49.348280+0000","last_undegraded":"2024-04-03T05:14:49.348280+0000","last_fullsized":"2024-04-03T05:14:49.348280+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:49.348086+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:49.348086+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.348086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:00.038803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.229508+0000","last_change":"2024-04-03T05:14:18.229571+0000","last_active":"2024-04-03T05:14:18.229508+0000","last_peered":"2024-04-03T05:14:18.229508+0000","last_clean":"2024-04-03T05:14:18.229508+0000","last_became_active":"2024-04-03T03:55:45.809649+0000","last_became_peered":"2024-04-03T03:55:45.809649+0000","last_unstale":"2024-04-03T05:14:18.229508+0000","last_undegraded":"2024-04-03T05:14:18.229508+0000","last_fullsized":"2024-04-03T05:14:18.229508+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:18.229296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:18.229296+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.229296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:46:33.279503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"263'107","reported_seq":386,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.602336+0000","last_change":"2024-04-03T05:14:16.602380+0000","last_active":"2024-04-03T05:14:16.602336+0000","last_peered":"2024-04-03T05:14:16.602336+0000","last_clean":"2024-04-03T05:14:16.602336+0000","last_became_active":"2024-04-03T03:49:00.990318+0000","last_became_peered":"2024-04-03T03:49:00.990318+0000","last_unstale":"2024-04-03T05:14:16.602336+0000","last_undegraded":"2024-04-03T05:14:16.602336+0000","last_fullsized":"2024-04-03T05:14:16.602336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'107","last_scrub_stamp":"2024-04-03T05:14:16.602235+0000","last_deep_scrub":"263'107","last_deep_scrub_stamp":"2024-04-03T05:14:16.602235+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.602235+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:11:58.218122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":587,"num_read_kb":421,"num_write":142,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1976,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.040325+0000","last_change":"2024-04-03T05:14:53.040391+0000","last_active":"2024-04-03T05:14:53.040325+0000","last_peered":"2024-04-03T05:14:53.040325+0000","last_clean":"2024-04-03T05:14:53.040325+0000","last_became_active":"2024-04-03T04:18:51.316328+0000","last_became_peered":"2024-04-03T04:18:51.316328+0000","last_unstale":"2024-04-03T05:14:53.040325+0000","last_undegraded":"2024-04-03T05:14:53.040325+0000","last_fullsized":"2024-04-03T05:14:53.040325+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:53.040107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:53.040107+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.040107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:30:59.446619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.657087+0000","last_change":"2024-04-03T05:14:28.657148+0000","last_active":"2024-04-03T05:14:28.657087+0000","last_peered":"2024-04-03T05:14:28.657087+0000","last_clean":"2024-04-03T05:14:28.657087+0000","last_became_active":"2024-04-03T03:55:53.251965+0000","last_became_peered":"2024-04-03T03:55:53.251965+0000","last_unstale":"2024-04-03T05:14:28.657087+0000","last_undegraded":"2024-04-03T05:14:28.657087+0000","last_fullsized":"2024-04-03T05:14:28.657087+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:28.656893+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:28.656893+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.656893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:10:47.815121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4667,"num_write":4,"num_write_kb":4667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'4","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.436769+0000","last_change":"2024-04-03T05:14:17.436836+0000","last_active":"2024-04-03T05:14:17.436769+0000","last_peered":"2024-04-03T05:14:17.436769+0000","last_clean":"2024-04-03T05:14:17.436769+0000","last_became_active":"2024-04-03T03:55:45.811051+0000","last_became_peered":"2024-04-03T03:55:45.811051+0000","last_unstale":"2024-04-03T05:14:17.436769+0000","last_undegraded":"2024-04-03T05:14:17.436769+0000","last_fullsized":"2024-04-03T05:14:17.436769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:17.436576+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:17.436576+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.436576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:40:06.185116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"263'6","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.581532+0000","last_change":"2024-04-03T05:14:17.581595+0000","last_active":"2024-04-03T05:14:17.581532+0000","last_peered":"2024-04-03T05:14:17.581532+0000","last_clean":"2024-04-03T05:14:17.581532+0000","last_became_active":"2024-04-03T03:49:00.989383+0000","last_became_peered":"2024-04-03T03:49:00.989383+0000","last_unstale":"2024-04-03T05:14:17.581532+0000","last_undegraded":"2024-04-03T05:14:17.581532+0000","last_fullsized":"2024-04-03T05:14:17.581532+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:17.581351+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:17.581351+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.581351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:02:07.448735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.713628+0000","last_change":"2024-04-03T04:18:51.318126+0000","last_active":"2024-04-03T05:14:16.713628+0000","last_peered":"2024-04-03T05:14:16.713628+0000","last_clean":"2024-04-03T05:14:16.713628+0000","last_became_active":"2024-04-03T04:18:51.317417+0000","last_became_peered":"2024-04-03T04:18:51.317417+0000","last_unstale":"2024-04-03T05:14:16.713628+0000","last_undegraded":"2024-04-03T05:14:16.713628+0000","last_fullsized":"2024-04-03T05:14:16.713628+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"258'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:13.091107+0000","last_change":"2024-04-03T03:55:53.251802+0000","last_active":"2024-04-03T05:13:13.091107+0000","last_peered":"2024-04-03T05:13:13.091107+0000","last_clean":"2024-04-03T05:13:13.091107+0000","last_became_active":"2024-04-03T03:55:53.250769+0000","last_became_peered":"2024-04-03T03:55:53.250769+0000","last_unstale":"2024-04-03T05:13:13.091107+0000","last_undegraded":"2024-04-03T05:13:13.091107+0000","last_fullsized":"2024-04-03T05:13:13.091107+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'4","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.943160+0000","last_change":"2024-04-03T05:14:18.943224+0000","last_active":"2024-04-03T05:14:18.943160+0000","last_peered":"2024-04-03T05:14:18.943160+0000","last_clean":"2024-04-03T05:14:18.943160+0000","last_became_active":"2024-04-03T03:55:45.821160+0000","last_became_peered":"2024-04-03T03:55:45.821160+0000","last_unstale":"2024-04-03T05:14:18.943160+0000","last_undegraded":"2024-04-03T05:14:18.943160+0000","last_fullsized":"2024-04-03T05:14:18.943160+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:18.942964+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:18.942964+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.942964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:52.990964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"263'67","reported_seq":289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.790975+0000","last_change":"2024-04-03T05:14:20.791125+0000","last_active":"2024-04-03T05:14:20.790975+0000","last_peered":"2024-04-03T05:14:20.790975+0000","last_clean":"2024-04-03T05:14:20.790975+0000","last_became_active":"2024-04-03T03:49:00.994321+0000","last_became_peered":"2024-04-03T03:49:00.994321+0000","last_unstale":"2024-04-03T05:14:20.790975+0000","last_undegraded":"2024-04-03T05:14:20.790975+0000","last_fullsized":"2024-04-03T05:14:20.790975+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'67","last_scrub_stamp":"2024-04-03T05:14:20.790726+0000","last_deep_scrub":"263'67","last_deep_scrub_stamp":"2024-04-03T05:14:20.790726+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.790726+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:24:39.456393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":300,"num_write":80,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1980,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.214919+0000","last_change":"2024-04-03T05:14:43.214977+0000","last_active":"2024-04-03T05:14:43.214919+0000","last_peered":"2024-04-03T05:14:43.214919+0000","last_clean":"2024-04-03T05:14:43.214919+0000","last_became_active":"2024-04-03T04:18:51.311870+0000","last_became_peered":"2024-04-03T04:18:51.311870+0000","last_unstale":"2024-04-03T05:14:43.214919+0000","last_undegraded":"2024-04-03T05:14:43.214919+0000","last_fullsized":"2024-04-03T05:14:43.214919+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:43.214721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:43.214721+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.214721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:42:35.231876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.224832+0000","last_change":"2024-04-03T05:14:31.224887+0000","last_active":"2024-04-03T05:14:31.224832+0000","last_peered":"2024-04-03T05:14:31.224832+0000","last_clean":"2024-04-03T05:14:31.224832+0000","last_became_active":"2024-04-03T03:55:53.241200+0000","last_became_peered":"2024-04-03T03:55:53.241200+0000","last_unstale":"2024-04-03T05:14:31.224832+0000","last_undegraded":"2024-04-03T05:14:31.224832+0000","last_fullsized":"2024-04-03T05:14:31.224832+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.224625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.224625+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.224625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:53:38.375885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'11","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.645240+0000","last_change":"2024-04-03T05:14:19.645305+0000","last_active":"2024-04-03T05:14:19.645240+0000","last_peered":"2024-04-03T05:14:19.645240+0000","last_clean":"2024-04-03T05:14:19.645240+0000","last_became_active":"2024-04-03T03:55:45.835828+0000","last_became_peered":"2024-04-03T03:55:45.835828+0000","last_unstale":"2024-04-03T05:14:19.645240+0000","last_undegraded":"2024-04-03T05:14:19.645240+0000","last_fullsized":"2024-04-03T05:14:19.645240+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:19.645047+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:19.645047+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.645047+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:51:08.338883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12338,"num_write":9,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.975186+0000","last_change":"2024-04-03T05:14:19.975252+0000","last_active":"2024-04-03T05:14:19.975186+0000","last_peered":"2024-04-03T05:14:19.975186+0000","last_clean":"2024-04-03T05:14:19.975186+0000","last_became_active":"2024-04-03T03:49:00.988327+0000","last_became_peered":"2024-04-03T03:49:00.988327+0000","last_unstale":"2024-04-03T05:14:19.975186+0000","last_undegraded":"2024-04-03T05:14:19.975186+0000","last_fullsized":"2024-04-03T05:14:19.975186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-04-03T05:14:19.974985+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-04-03T05:14:19.974985+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.974985+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:49.996232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":175,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.010733+0000","last_change":"2024-04-03T05:14:52.010787+0000","last_active":"2024-04-03T05:14:52.010733+0000","last_peered":"2024-04-03T05:14:52.010733+0000","last_clean":"2024-04-03T05:14:52.010733+0000","last_became_active":"2024-04-03T04:18:51.299249+0000","last_became_peered":"2024-04-03T04:18:51.299249+0000","last_unstale":"2024-04-03T05:14:52.010733+0000","last_undegraded":"2024-04-03T05:14:52.010733+0000","last_fullsized":"2024-04-03T05:14:52.010733+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:52.010537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:52.010537+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.010537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:46:31.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'9","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:09.771967+0000","last_change":"2024-04-03T03:55:53.278378+0000","last_active":"2024-04-03T05:14:09.771967+0000","last_peered":"2024-04-03T05:14:09.771967+0000","last_clean":"2024-04-03T05:14:09.771967+0000","last_became_active":"2024-04-03T03:55:53.277505+0000","last_became_peered":"2024-04-03T03:55:53.277505+0000","last_unstale":"2024-04-03T05:14:09.771967+0000","last_undegraded":"2024-04-03T05:14:09.771967+0000","last_fullsized":"2024-04-03T05:14:09.771967+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"258'2","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.239327+0000","last_change":"2024-04-03T05:14:16.239400+0000","last_active":"2024-04-03T05:14:16.239327+0000","last_peered":"2024-04-03T05:14:16.239327+0000","last_clean":"2024-04-03T05:14:16.239327+0000","last_became_active":"2024-04-03T03:55:45.811093+0000","last_became_peered":"2024-04-03T03:55:45.811093+0000","last_unstale":"2024-04-03T05:14:16.239327+0000","last_undegraded":"2024-04-03T05:14:16.239327+0000","last_fullsized":"2024-04-03T05:14:16.239327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:16.239098+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:16.239098+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.239098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:00:03.108455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"263'33","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.289972+0000","last_change":"2024-04-03T05:14:23.290034+0000","last_active":"2024-04-03T05:14:23.289972+0000","last_peered":"2024-04-03T05:14:23.289972+0000","last_clean":"2024-04-03T05:14:23.289972+0000","last_became_active":"2024-04-03T03:49:00.973216+0000","last_became_peered":"2024-04-03T03:49:00.973216+0000","last_unstale":"2024-04-03T05:14:23.289972+0000","last_undegraded":"2024-04-03T05:14:23.289972+0000","last_fullsized":"2024-04-03T05:14:23.289972+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-04-03T05:14:23.289767+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-04-03T05:14:23.289767+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.289767+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:49:45.158570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"260'1","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.089066+0000","last_change":"2024-04-03T04:19:00.383020+0000","last_active":"2024-04-03T05:13:03.089066+0000","last_peered":"2024-04-03T05:13:03.089066+0000","last_clean":"2024-04-03T05:13:03.089066+0000","last_became_active":"2024-04-03T04:19:00.377208+0000","last_became_peered":"2024-04-03T04:19:00.377208+0000","last_unstale":"2024-04-03T05:13:03.089066+0000","last_undegraded":"2024-04-03T05:13:03.089066+0000","last_fullsized":"2024-04-03T05:13:03.089066+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.596999+0000","last_change":"2024-04-03T03:55:53.258982+0000","last_active":"2024-04-03T05:14:08.596999+0000","last_peered":"2024-04-03T05:14:08.596999+0000","last_clean":"2024-04-03T05:14:08.596999+0000","last_became_active":"2024-04-03T03:55:53.258699+0000","last_became_peered":"2024-04-03T03:55:53.258699+0000","last_unstale":"2024-04-03T05:14:08.596999+0000","last_undegraded":"2024-04-03T05:14:08.596999+0000","last_fullsized":"2024-04-03T05:14:08.596999+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'6","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.189199+0000","last_change":"2024-04-03T05:14:31.189266+0000","last_active":"2024-04-03T05:14:31.189199+0000","last_peered":"2024-04-03T05:14:31.189199+0000","last_clean":"2024-04-03T05:14:31.189199+0000","last_became_active":"2024-04-03T03:55:45.831660+0000","last_became_peered":"2024-04-03T03:55:45.831660+0000","last_unstale":"2024-04-03T05:14:31.189199+0000","last_undegraded":"2024-04-03T05:14:31.189199+0000","last_fullsized":"2024-04-03T05:14:31.189199+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:31.189001+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:31.189001+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.189001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:53:33.899568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"263'39","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.089578+0000","last_change":"2024-04-03T05:14:48.089673+0000","last_active":"2024-04-03T05:14:48.089578+0000","last_peered":"2024-04-03T05:14:48.089578+0000","last_clean":"2024-04-03T05:14:48.089578+0000","last_became_active":"2024-04-03T03:49:00.968902+0000","last_became_peered":"2024-04-03T03:49:00.968902+0000","last_unstale":"2024-04-03T05:14:48.089578+0000","last_undegraded":"2024-04-03T05:14:48.089578+0000","last_fullsized":"2024-04-03T05:14:48.089578+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-04-03T05:14:48.089332+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-04-03T05:14:48.089332+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.089332+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:26:11.376199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":106,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.810334+0000","last_change":"2024-04-03T04:18:51.368008+0000","last_active":"2024-04-03T05:14:15.810334+0000","last_peered":"2024-04-03T05:14:15.810334+0000","last_clean":"2024-04-03T05:14:15.810334+0000","last_became_active":"2024-04-03T04:18:51.367290+0000","last_became_peered":"2024-04-03T04:18:51.367290+0000","last_unstale":"2024-04-03T05:14:15.810334+0000","last_undegraded":"2024-04-03T05:14:15.810334+0000","last_fullsized":"2024-04-03T05:14:15.810334+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:18.859029+0000","last_change":"2024-04-03T03:55:53.249249+0000","last_active":"2024-04-03T05:13:18.859029+0000","last_peered":"2024-04-03T05:13:18.859029+0000","last_clean":"2024-04-03T05:13:18.859029+0000","last_became_active":"2024-04-03T03:55:53.247541+0000","last_became_peered":"2024-04-03T03:55:53.247541+0000","last_unstale":"2024-04-03T05:13:18.859029+0000","last_undegraded":"2024-04-03T05:13:18.859029+0000","last_fullsized":"2024-04-03T05:13:18.859029+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"258'4","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.219803+0000","last_change":"2024-04-03T05:14:15.219826+0000","last_active":"2024-04-03T05:14:15.219803+0000","last_peered":"2024-04-03T05:14:15.219803+0000","last_clean":"2024-04-03T05:14:15.219803+0000","last_became_active":"2024-04-03T03:55:45.819664+0000","last_became_peered":"2024-04-03T03:55:45.819664+0000","last_unstale":"2024-04-03T05:14:15.219803+0000","last_undegraded":"2024-04-03T05:14:15.219803+0000","last_fullsized":"2024-04-03T05:14:15.219803+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'4","last_scrub_stamp":"2024-04-03T05:14:15.219711+0000","last_deep_scrub":"258'4","last_deep_scrub_stamp":"2024-04-03T05:14:15.219711+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.219711+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:39.431443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"263'13","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.596552+0000","last_change":"2024-04-03T05:14:21.596703+0000","last_active":"2024-04-03T05:14:21.596552+0000","last_peered":"2024-04-03T05:14:21.596552+0000","last_clean":"2024-04-03T05:14:21.596552+0000","last_became_active":"2024-04-03T03:49:00.961782+0000","last_became_peered":"2024-04-03T03:49:00.961782+0000","last_unstale":"2024-04-03T05:14:21.596552+0000","last_undegraded":"2024-04-03T05:14:21.596552+0000","last_fullsized":"2024-04-03T05:14:21.596552+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-04-03T05:14:21.596278+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-04-03T05:14:21.596278+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.596278+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:28:32.878479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.261181+0000","last_change":"2024-04-03T04:18:51.305071+0000","last_active":"2024-04-03T05:14:16.261181+0000","last_peered":"2024-04-03T05:14:16.261181+0000","last_clean":"2024-04-03T05:14:16.261181+0000","last_became_active":"2024-04-03T04:18:51.304323+0000","last_became_peered":"2024-04-03T04:18:51.304323+0000","last_unstale":"2024-04-03T05:14:16.261181+0000","last_undegraded":"2024-04-03T05:14:16.261181+0000","last_fullsized":"2024-04-03T05:14:16.261181+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'9","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.597352+0000","last_change":"2024-04-03T03:55:53.260481+0000","last_active":"2024-04-03T05:14:08.597352+0000","last_peered":"2024-04-03T05:14:08.597352+0000","last_clean":"2024-04-03T05:14:08.597352+0000","last_became_active":"2024-04-03T03:55:53.255231+0000","last_became_peered":"2024-04-03T03:55:53.255231+0000","last_unstale":"2024-04-03T05:14:08.597352+0000","last_undegraded":"2024-04-03T05:14:08.597352+0000","last_fullsized":"2024-04-03T05:14:08.597352+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.797480+0000","last_change":"2024-04-03T05:14:19.797532+0000","last_active":"2024-04-03T05:14:19.797480+0000","last_peered":"2024-04-03T05:14:19.797480+0000","last_clean":"2024-04-03T05:14:19.797480+0000","last_became_active":"2024-04-03T03:55:45.829412+0000","last_became_peered":"2024-04-03T03:55:45.829412+0000","last_unstale":"2024-04-03T05:14:19.797480+0000","last_undegraded":"2024-04-03T05:14:19.797480+0000","last_fullsized":"2024-04-03T05:14:19.797480+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:19.797275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:19.797275+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.797275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:12:11.890163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"263'19","reported_seq":121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.576493+0000","last_change":"2024-04-03T05:14:17.576536+0000","last_active":"2024-04-03T05:14:17.576493+0000","last_peered":"2024-04-03T05:14:17.576493+0000","last_clean":"2024-04-03T05:14:17.576493+0000","last_became_active":"2024-04-03T03:49:00.981577+0000","last_became_peered":"2024-04-03T03:49:00.981577+0000","last_unstale":"2024-04-03T05:14:17.576493+0000","last_undegraded":"2024-04-03T05:14:17.576493+0000","last_fullsized":"2024-04-03T05:14:17.576493+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-04-03T05:14:17.576374+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-04-03T05:14:17.576374+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.576374+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:47.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.810415+0000","last_change":"2024-04-03T04:18:51.373777+0000","last_active":"2024-04-03T05:14:15.810415+0000","last_peered":"2024-04-03T05:14:15.810415+0000","last_clean":"2024-04-03T05:14:15.810415+0000","last_became_active":"2024-04-03T04:18:51.372963+0000","last_became_peered":"2024-04-03T04:18:51.372963+0000","last_unstale":"2024-04-03T05:14:15.810415+0000","last_undegraded":"2024-04-03T05:14:15.810415+0000","last_fullsized":"2024-04-03T05:14:15.810415+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.391523+0000","last_change":"2024-04-03T05:14:48.391591+0000","last_active":"2024-04-03T05:14:48.391523+0000","last_peered":"2024-04-03T05:14:48.391523+0000","last_clean":"2024-04-03T05:14:48.391523+0000","last_became_active":"2024-04-03T03:55:53.268903+0000","last_became_peered":"2024-04-03T03:55:53.268903+0000","last_unstale":"2024-04-03T05:14:48.391523+0000","last_undegraded":"2024-04-03T05:14:48.391523+0000","last_fullsized":"2024-04-03T05:14:48.391523+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-04-03T05:14:48.391314+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-04-03T05:14:48.391314+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.391314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:08:41.058813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'2","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.468487+0000","last_change":"2024-04-03T05:14:45.468552+0000","last_active":"2024-04-03T05:14:45.468487+0000","last_peered":"2024-04-03T05:14:45.468487+0000","last_clean":"2024-04-03T05:14:45.468487+0000","last_became_active":"2024-04-03T03:55:45.834865+0000","last_became_peered":"2024-04-03T03:55:45.834865+0000","last_unstale":"2024-04-03T05:14:45.468487+0000","last_undegraded":"2024-04-03T05:14:45.468487+0000","last_fullsized":"2024-04-03T05:14:45.468487+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:45.468285+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:45.468285+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.468285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:25:09.871125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"263'64","reported_seq":239,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.590706+0000","last_change":"2024-04-03T05:14:20.590768+0000","last_active":"2024-04-03T05:14:20.590706+0000","last_peered":"2024-04-03T05:14:20.590706+0000","last_clean":"2024-04-03T05:14:20.590706+0000","last_became_active":"2024-04-03T03:49:00.971042+0000","last_became_peered":"2024-04-03T03:49:00.971042+0000","last_unstale":"2024-04-03T05:14:20.590706+0000","last_undegraded":"2024-04-03T05:14:20.590706+0000","last_fullsized":"2024-04-03T05:14:20.590706+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-04-03T05:14:20.590514+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-04-03T05:14:20.590514+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.590514+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:29:07.571711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":214,"num_write":97,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:56.493133+0000","last_change":"2024-04-03T05:14:56.493186+0000","last_active":"2024-04-03T05:14:56.493133+0000","last_peered":"2024-04-03T05:14:56.493133+0000","last_clean":"2024-04-03T05:14:56.493133+0000","last_became_active":"2024-04-03T04:18:51.307933+0000","last_became_peered":"2024-04-03T04:18:51.307933+0000","last_unstale":"2024-04-03T05:14:56.493133+0000","last_undegraded":"2024-04-03T05:14:56.493133+0000","last_fullsized":"2024-04-03T05:14:56.493133+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:56.492933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:56.492933+0000","last_clean_scrub_stamp":"2024-04-03T05:14:56.492933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:05:31.267557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.205908+0000","last_change":"2024-04-03T05:14:39.206018+0000","last_active":"2024-04-03T05:14:39.205908+0000","last_peered":"2024-04-03T05:14:39.205908+0000","last_clean":"2024-04-03T05:14:39.205908+0000","last_became_active":"2024-04-03T03:55:53.266957+0000","last_became_peered":"2024-04-03T03:55:53.266957+0000","last_unstale":"2024-04-03T05:14:39.205908+0000","last_undegraded":"2024-04-03T05:14:39.205908+0000","last_fullsized":"2024-04-03T05:14:39.205908+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:39.205624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:39.205624+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.205624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:09:20.764053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'2","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.252771+0000","last_change":"2024-04-03T05:14:23.252891+0000","last_active":"2024-04-03T05:14:23.252771+0000","last_peered":"2024-04-03T05:14:23.252771+0000","last_clean":"2024-04-03T05:14:23.252771+0000","last_became_active":"2024-04-03T03:55:45.829247+0000","last_became_peered":"2024-04-03T03:55:45.829247+0000","last_unstale":"2024-04-03T05:14:23.252771+0000","last_undegraded":"2024-04-03T05:14:23.252771+0000","last_fullsized":"2024-04-03T05:14:23.252771+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:23.252480+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:23.252480+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.252480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:45.549115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"263'66","reported_seq":236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.575622+0000","last_change":"2024-04-03T05:14:15.575655+0000","last_active":"2024-04-03T05:14:15.575622+0000","last_peered":"2024-04-03T05:14:15.575622+0000","last_clean":"2024-04-03T05:14:15.575622+0000","last_became_active":"2024-04-03T03:49:00.990969+0000","last_became_peered":"2024-04-03T03:49:00.990969+0000","last_unstale":"2024-04-03T05:14:15.575622+0000","last_undegraded":"2024-04-03T05:14:15.575622+0000","last_fullsized":"2024-04-03T05:14:15.575622+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-04-03T05:14:15.575468+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-04-03T05:14:15.575468+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.575468+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:10:53.811160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":193,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.901431+0000","last_change":"2024-04-03T04:18:51.311760+0000","last_active":"2024-04-03T05:14:14.901431+0000","last_peered":"2024-04-03T05:14:14.901431+0000","last_clean":"2024-04-03T05:14:14.901431+0000","last_became_active":"2024-04-03T04:18:51.310856+0000","last_became_peered":"2024-04-03T04:18:51.310856+0000","last_unstale":"2024-04-03T05:14:14.901431+0000","last_undegraded":"2024-04-03T05:14:14.901431+0000","last_fullsized":"2024-04-03T05:14:14.901431+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'6","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.547397+0000","last_change":"2024-04-03T05:14:24.547531+0000","last_active":"2024-04-03T05:14:24.547397+0000","last_peered":"2024-04-03T05:14:24.547397+0000","last_clean":"2024-04-03T05:14:24.547397+0000","last_became_active":"2024-04-03T03:55:53.240485+0000","last_became_peered":"2024-04-03T03:55:53.240485+0000","last_unstale":"2024-04-03T05:14:24.547397+0000","last_undegraded":"2024-04-03T05:14:24.547397+0000","last_fullsized":"2024-04-03T05:14:24.547397+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:24.547121+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:24.547121+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.547121+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:34:01.732381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.818563+0000","last_change":"2024-04-03T05:14:23.818669+0000","last_active":"2024-04-03T05:14:23.818563+0000","last_peered":"2024-04-03T05:14:23.818563+0000","last_clean":"2024-04-03T05:14:23.818563+0000","last_became_active":"2024-04-03T03:55:45.833049+0000","last_became_peered":"2024-04-03T03:55:45.833049+0000","last_unstale":"2024-04-03T05:14:23.818563+0000","last_undegraded":"2024-04-03T05:14:23.818563+0000","last_fullsized":"2024-04-03T05:14:23.818563+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:23.818338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:23.818338+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.818338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:09:23.603846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"263'54","reported_seq":215,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.195113+0000","last_change":"2024-04-03T05:14:19.195179+0000","last_active":"2024-04-03T05:14:19.195113+0000","last_peered":"2024-04-03T05:14:19.195113+0000","last_clean":"2024-04-03T05:14:19.195113+0000","last_became_active":"2024-04-03T03:49:00.969239+0000","last_became_peered":"2024-04-03T03:49:00.969239+0000","last_unstale":"2024-04-03T05:14:19.195113+0000","last_undegraded":"2024-04-03T05:14:19.195113+0000","last_fullsized":"2024-04-03T05:14:19.195113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'54","last_scrub_stamp":"2024-04-03T05:14:19.194918+0000","last_deep_scrub":"263'54","last_deep_scrub_stamp":"2024-04-03T05:14:19.194918+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.194918+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:32:09.246304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":93,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.011006+0000","last_change":"2024-04-03T05:14:54.011006+0000","last_active":"2024-04-03T05:14:54.011006+0000","last_peered":"2024-04-03T05:14:54.011006+0000","last_clean":"2024-04-03T05:14:54.011006+0000","last_became_active":"2024-04-03T04:18:51.318231+0000","last_became_peered":"2024-04-03T04:18:51.318231+0000","last_unstale":"2024-04-03T05:14:54.011006+0000","last_undegraded":"2024-04-03T05:14:54.011006+0000","last_fullsized":"2024-04-03T05:14:54.011006+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:54.010659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:54.010659+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.010659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:32:00.903876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.455511+0000","last_change":"2024-04-03T03:55:53.279237+0000","last_active":"2024-04-03T05:14:10.455511+0000","last_peered":"2024-04-03T05:14:10.455511+0000","last_clean":"2024-04-03T05:14:10.455511+0000","last_became_active":"2024-04-03T03:55:53.278529+0000","last_became_peered":"2024-04-03T03:55:53.278529+0000","last_unstale":"2024-04-03T05:14:10.455511+0000","last_undegraded":"2024-04-03T05:14:10.455511+0000","last_fullsized":"2024-04-03T05:14:10.455511+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'2","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.911230+0000","last_change":"2024-04-03T05:14:15.911278+0000","last_active":"2024-04-03T05:14:15.911230+0000","last_peered":"2024-04-03T05:14:15.911230+0000","last_clean":"2024-04-03T05:14:15.911230+0000","last_became_active":"2024-04-03T03:55:45.820737+0000","last_became_peered":"2024-04-03T03:55:45.820737+0000","last_unstale":"2024-04-03T05:14:15.911230+0000","last_undegraded":"2024-04-03T05:14:15.911230+0000","last_fullsized":"2024-04-03T05:14:15.911230+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:15.911138+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:15.911138+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.911138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:35:35.324319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"263'71","reported_seq":258,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.486256+0000","last_change":"2024-04-03T05:14:18.486381+0000","last_active":"2024-04-03T05:14:18.486256+0000","last_peered":"2024-04-03T05:14:18.486256+0000","last_clean":"2024-04-03T05:14:18.486256+0000","last_became_active":"2024-04-03T03:49:00.987062+0000","last_became_peered":"2024-04-03T03:49:00.987062+0000","last_unstale":"2024-04-03T05:14:18.486256+0000","last_undegraded":"2024-04-03T05:14:18.486256+0000","last_fullsized":"2024-04-03T05:14:18.486256+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'71","last_scrub_stamp":"2024-04-03T05:14:18.485978+0000","last_deep_scrub":"263'71","last_deep_scrub_stamp":"2024-04-03T05:14:18.485978+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.485978+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:34:39.263878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":233,"num_write":115,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.810379+0000","last_change":"2024-04-03T04:18:51.320211+0000","last_active":"2024-04-03T05:14:15.810379+0000","last_peered":"2024-04-03T05:14:15.810379+0000","last_clean":"2024-04-03T05:14:15.810379+0000","last_became_active":"2024-04-03T04:18:51.319383+0000","last_became_peered":"2024-04-03T04:18:51.319383+0000","last_unstale":"2024-04-03T05:14:15.810379+0000","last_undegraded":"2024-04-03T05:14:15.810379+0000","last_fullsized":"2024-04-03T05:14:15.810379+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'11","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.060226+0000","last_change":"2024-04-03T05:14:51.060301+0000","last_active":"2024-04-03T05:14:51.060226+0000","last_peered":"2024-04-03T05:14:51.060226+0000","last_clean":"2024-04-03T05:14:51.060226+0000","last_became_active":"2024-04-03T03:55:53.279910+0000","last_became_peered":"2024-04-03T03:55:53.279910+0000","last_unstale":"2024-04-03T05:14:51.060226+0000","last_undegraded":"2024-04-03T05:14:51.060226+0000","last_fullsized":"2024-04-03T05:14:51.060226+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:51.060038+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:51.060038+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.060038+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:56:02.111472+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":19,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'6","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.446915+0000","last_change":"2024-04-03T05:14:20.447085+0000","last_active":"2024-04-03T05:14:20.446915+0000","last_peered":"2024-04-03T05:14:20.446915+0000","last_clean":"2024-04-03T05:14:20.446915+0000","last_became_active":"2024-04-03T03:55:45.840884+0000","last_became_peered":"2024-04-03T03:55:45.840884+0000","last_unstale":"2024-04-03T05:14:20.446915+0000","last_undegraded":"2024-04-03T05:14:20.446915+0000","last_fullsized":"2024-04-03T05:14:20.446915+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:20.446700+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:20.446700+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.446700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:38:24.233173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"263'34","reported_seq":153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.003460+0000","last_change":"2024-04-03T05:14:21.003529+0000","last_active":"2024-04-03T05:14:21.003460+0000","last_peered":"2024-04-03T05:14:21.003460+0000","last_clean":"2024-04-03T05:14:21.003460+0000","last_became_active":"2024-04-03T03:49:00.966982+0000","last_became_peered":"2024-04-03T03:49:00.966982+0000","last_unstale":"2024-04-03T05:14:21.003460+0000","last_undegraded":"2024-04-03T05:14:21.003460+0000","last_fullsized":"2024-04-03T05:14:21.003460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-04-03T05:14:21.003253+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-04-03T05:14:21.003253+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.003253+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:55:19.768847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"261'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.043483+0000","last_change":"2024-04-03T04:18:51.315214+0000","last_active":"2024-04-03T05:12:53.043483+0000","last_peered":"2024-04-03T05:12:53.043483+0000","last_clean":"2024-04-03T05:12:53.043483+0000","last_became_active":"2024-04-03T04:18:51.314416+0000","last_became_peered":"2024-04-03T04:18:51.314416+0000","last_unstale":"2024-04-03T05:12:53.043483+0000","last_undegraded":"2024-04-03T05:12:53.043483+0000","last_fullsized":"2024-04-03T05:12:53.043483+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'11","reported_seq":86,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.446764+0000","last_change":"2024-04-03T05:14:46.446828+0000","last_active":"2024-04-03T05:14:46.446764+0000","last_peered":"2024-04-03T05:14:46.446764+0000","last_clean":"2024-04-03T05:14:46.446764+0000","last_became_active":"2024-04-03T03:55:53.248092+0000","last_became_peered":"2024-04-03T03:55:53.248092+0000","last_unstale":"2024-04-03T05:14:46.446764+0000","last_undegraded":"2024-04-03T05:14:46.446764+0000","last_fullsized":"2024-04-03T05:14:46.446764+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:46.446558+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:46.446558+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.446558+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:25:20.293058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"258'2","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.713377+0000","last_change":"2024-04-03T03:55:45.830497+0000","last_active":"2024-04-03T05:14:16.713377+0000","last_peered":"2024-04-03T05:14:16.713377+0000","last_clean":"2024-04-03T05:14:16.713377+0000","last_became_active":"2024-04-03T03:55:45.829835+0000","last_became_peered":"2024-04-03T03:55:45.829835+0000","last_unstale":"2024-04-03T05:14:16.713377+0000","last_undegraded":"2024-04-03T05:14:16.713377+0000","last_fullsized":"2024-04-03T05:14:16.713377+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:44.773521+0000","last_clean_scrub_stamp":"2024-04-03T03:55:44.773521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"263'30","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.254490+0000","last_change":"2024-04-03T05:14:27.254552+0000","last_active":"2024-04-03T05:14:27.254490+0000","last_peered":"2024-04-03T05:14:27.254490+0000","last_clean":"2024-04-03T05:14:27.254490+0000","last_became_active":"2024-04-03T03:49:00.983761+0000","last_became_peered":"2024-04-03T03:49:00.983761+0000","last_unstale":"2024-04-03T05:14:27.254490+0000","last_undegraded":"2024-04-03T05:14:27.254490+0000","last_fullsized":"2024-04-03T05:14:27.254490+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-04-03T05:14:27.254297+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-04-03T05:14:27.254297+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.254297+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:58:42.410817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.043535+0000","last_change":"2024-04-03T04:18:51.320209+0000","last_active":"2024-04-03T05:12:53.043535+0000","last_peered":"2024-04-03T05:12:53.043535+0000","last_clean":"2024-04-03T05:12:53.043535+0000","last_became_active":"2024-04-03T04:18:51.319470+0000","last_became_peered":"2024-04-03T04:18:51.319470+0000","last_unstale":"2024-04-03T05:12:53.043535+0000","last_undegraded":"2024-04-03T05:12:53.043535+0000","last_fullsized":"2024-04-03T05:12:53.043535+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'7","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.633787+0000","last_change":"2024-04-03T03:55:53.258437+0000","last_active":"2024-04-03T05:14:17.633787+0000","last_peered":"2024-04-03T05:14:17.633787+0000","last_clean":"2024-04-03T05:14:17.633787+0000","last_became_active":"2024-04-03T03:55:53.257856+0000","last_became_peered":"2024-04-03T03:55:53.257856+0000","last_unstale":"2024-04-03T05:14:17.633787+0000","last_undegraded":"2024-04-03T05:14:17.633787+0000","last_fullsized":"2024-04-03T05:14:17.633787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":16434,"num_write":11,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'14","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.113680+0000","last_change":"2024-04-03T05:14:27.113680+0000","last_active":"2024-04-03T05:14:27.113680+0000","last_peered":"2024-04-03T05:14:27.113680+0000","last_clean":"2024-04-03T05:14:27.113680+0000","last_became_active":"2024-04-03T03:55:45.829711+0000","last_became_peered":"2024-04-03T03:55:45.829711+0000","last_unstale":"2024-04-03T05:14:27.113680+0000","last_undegraded":"2024-04-03T05:14:27.113680+0000","last_fullsized":"2024-04-03T05:14:27.113680+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-04-03T05:14:27.113418+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-04-03T05:14:27.113418+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.113418+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:00:20.265172+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":20484,"num_write":20,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"263'38","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.342198+0000","last_change":"2024-04-03T05:14:20.342198+0000","last_active":"2024-04-03T05:14:20.342198+0000","last_peered":"2024-04-03T05:14:20.342198+0000","last_clean":"2024-04-03T05:14:20.342198+0000","last_became_active":"2024-04-03T03:49:00.987174+0000","last_became_peered":"2024-04-03T03:49:00.987174+0000","last_unstale":"2024-04-03T05:14:20.342198+0000","last_undegraded":"2024-04-03T05:14:20.342198+0000","last_fullsized":"2024-04-03T05:14:20.342198+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-04-03T05:14:20.341945+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-04-03T05:14:20.341945+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.341945+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:38.153173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:53.043626+0000","last_change":"2024-04-03T04:18:51.321162+0000","last_active":"2024-04-03T05:12:53.043626+0000","last_peered":"2024-04-03T05:12:53.043626+0000","last_clean":"2024-04-03T05:12:53.043626+0000","last_became_active":"2024-04-03T04:18:51.320359+0000","last_became_peered":"2024-04-03T04:18:51.320359+0000","last_unstale":"2024-04-03T05:12:53.043626+0000","last_undegraded":"2024-04-03T05:12:53.043626+0000","last_fullsized":"2024-04-03T05:12:53.043626+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"258'2","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.502674+0000","last_change":"2024-04-03T05:14:54.502674+0000","last_active":"2024-04-03T05:14:54.502674+0000","last_peered":"2024-04-03T05:14:54.502674+0000","last_clean":"2024-04-03T05:14:54.502674+0000","last_became_active":"2024-04-03T03:55:53.274653+0000","last_became_peered":"2024-04-03T03:55:53.274653+0000","last_unstale":"2024-04-03T05:14:54.502674+0000","last_undegraded":"2024-04-03T05:14:54.502674+0000","last_fullsized":"2024-04-03T05:14:54.502674+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:54.502395+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:54.502395+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.502395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:00:26.169798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.428145+0000","last_change":"2024-04-03T05:14:44.428201+0000","last_active":"2024-04-03T05:14:44.428145+0000","last_peered":"2024-04-03T05:14:44.428145+0000","last_clean":"2024-04-03T05:14:44.428145+0000","last_became_active":"2024-04-03T03:55:45.832127+0000","last_became_peered":"2024-04-03T03:55:45.832127+0000","last_unstale":"2024-04-03T05:14:44.428145+0000","last_undegraded":"2024-04-03T05:14:44.428145+0000","last_fullsized":"2024-04-03T05:14:44.428145+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:44.427934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:44.427934+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.427934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:59:22.452340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"263'16","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.516914+0000","last_change":"2024-04-03T05:14:17.516914+0000","last_active":"2024-04-03T05:14:17.516914+0000","last_peered":"2024-04-03T05:14:17.516914+0000","last_clean":"2024-04-03T05:14:17.516914+0000","last_became_active":"2024-04-03T03:49:00.987993+0000","last_became_peered":"2024-04-03T03:49:00.987993+0000","last_unstale":"2024-04-03T05:14:17.516914+0000","last_undegraded":"2024-04-03T05:14:17.516914+0000","last_fullsized":"2024-04-03T05:14:17.516914+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-04-03T05:14:17.516663+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-04-03T05:14:17.516663+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.516663+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:02:59.257046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:07.866506+0000","last_change":"2024-04-03T04:18:51.373972+0000","last_active":"2024-04-03T05:13:07.866506+0000","last_peered":"2024-04-03T05:13:07.866506+0000","last_clean":"2024-04-03T05:13:07.866506+0000","last_became_active":"2024-04-03T04:18:51.373189+0000","last_became_peered":"2024-04-03T04:18:51.373189+0000","last_unstale":"2024-04-03T05:13:07.866506+0000","last_undegraded":"2024-04-03T05:13:07.866506+0000","last_fullsized":"2024-04-03T05:13:07.866506+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'4","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.262833+0000","last_change":"2024-04-03T05:14:39.262897+0000","last_active":"2024-04-03T05:14:39.262833+0000","last_peered":"2024-04-03T05:14:39.262833+0000","last_clean":"2024-04-03T05:14:39.262833+0000","last_became_active":"2024-04-03T03:55:53.243858+0000","last_became_peered":"2024-04-03T03:55:53.243858+0000","last_unstale":"2024-04-03T05:14:39.262833+0000","last_undegraded":"2024-04-03T05:14:39.262833+0000","last_fullsized":"2024-04-03T05:14:39.262833+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:39.262646+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:39.262646+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.262646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:26:13.319997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'8","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.301561+0000","last_change":"2024-04-03T05:14:22.301561+0000","last_active":"2024-04-03T05:14:22.301561+0000","last_peered":"2024-04-03T05:14:22.301561+0000","last_clean":"2024-04-03T05:14:22.301561+0000","last_became_active":"2024-04-03T03:55:45.815910+0000","last_became_peered":"2024-04-03T03:55:45.815910+0000","last_unstale":"2024-04-03T05:14:22.301561+0000","last_undegraded":"2024-04-03T05:14:22.301561+0000","last_fullsized":"2024-04-03T05:14:22.301561+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:22.301288+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:22.301288+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.301288+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:28.061626+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"263'51","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.161207+0000","last_change":"2024-04-03T05:14:17.161207+0000","last_active":"2024-04-03T05:14:17.161207+0000","last_peered":"2024-04-03T05:14:17.161207+0000","last_clean":"2024-04-03T05:14:17.161207+0000","last_became_active":"2024-04-03T03:49:00.965454+0000","last_became_peered":"2024-04-03T03:49:00.965454+0000","last_unstale":"2024-04-03T05:14:17.161207+0000","last_undegraded":"2024-04-03T05:14:17.161207+0000","last_fullsized":"2024-04-03T05:14:17.161207+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-04-03T05:14:17.160932+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-04-03T05:14:17.160932+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.160932+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:02:36.721077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":162,"num_write":91,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:04.061516+0000","last_change":"2024-04-03T04:18:51.367810+0000","last_active":"2024-04-03T05:13:04.061516+0000","last_peered":"2024-04-03T05:13:04.061516+0000","last_clean":"2024-04-03T05:13:04.061516+0000","last_became_active":"2024-04-03T04:18:51.367071+0000","last_became_peered":"2024-04-03T04:18:51.367071+0000","last_unstale":"2024-04-03T05:13:04.061516+0000","last_undegraded":"2024-04-03T05:13:04.061516+0000","last_fullsized":"2024-04-03T05:13:04.061516+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"258'2","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.596827+0000","last_change":"2024-04-03T05:14:23.596893+0000","last_active":"2024-04-03T05:14:23.596827+0000","last_peered":"2024-04-03T05:14:23.596827+0000","last_clean":"2024-04-03T05:14:23.596827+0000","last_became_active":"2024-04-03T03:55:53.265100+0000","last_became_peered":"2024-04-03T03:55:53.265100+0000","last_unstale":"2024-04-03T05:14:23.596827+0000","last_undegraded":"2024-04-03T05:14:23.596827+0000","last_fullsized":"2024-04-03T05:14:23.596827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:23.596633+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:23.596633+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.596633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:33:10.162116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'8","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.790209+0000","last_change":"2024-04-03T05:14:17.790327+0000","last_active":"2024-04-03T05:14:17.790209+0000","last_peered":"2024-04-03T05:14:17.790209+0000","last_clean":"2024-04-03T05:14:17.790209+0000","last_became_active":"2024-04-03T03:55:45.822292+0000","last_became_peered":"2024-04-03T03:55:45.822292+0000","last_unstale":"2024-04-03T05:14:17.790209+0000","last_undegraded":"2024-04-03T05:14:17.790209+0000","last_fullsized":"2024-04-03T05:14:17.790209+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:17.789970+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:17.789970+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.789970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:00:22.608204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"263'28","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.615807+0000","last_change":"2024-04-03T05:14:18.615807+0000","last_active":"2024-04-03T05:14:18.615807+0000","last_peered":"2024-04-03T05:14:18.615807+0000","last_clean":"2024-04-03T05:14:18.615807+0000","last_became_active":"2024-04-03T03:49:00.981338+0000","last_became_peered":"2024-04-03T03:49:00.981338+0000","last_unstale":"2024-04-03T05:14:18.615807+0000","last_undegraded":"2024-04-03T05:14:18.615807+0000","last_fullsized":"2024-04-03T05:14:18.615807+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-04-03T05:14:18.615526+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-04-03T05:14:18.615526+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.615526+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:26:42.378669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.659953+0000","last_change":"2024-04-03T04:18:51.309156+0000","last_active":"2024-04-03T05:13:03.659953+0000","last_peered":"2024-04-03T05:13:03.659953+0000","last_clean":"2024-04-03T05:13:03.659953+0000","last_became_active":"2024-04-03T04:18:51.308461+0000","last_became_peered":"2024-04-03T04:18:51.308461+0000","last_unstale":"2024-04-03T05:13:03.659953+0000","last_undegraded":"2024-04-03T05:13:03.659953+0000","last_fullsized":"2024-04-03T05:13:03.659953+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.206357+0000","last_change":"2024-04-03T05:14:35.206443+0000","last_active":"2024-04-03T05:14:35.206357+0000","last_peered":"2024-04-03T05:14:35.206357+0000","last_clean":"2024-04-03T05:14:35.206357+0000","last_became_active":"2024-04-03T03:55:53.243822+0000","last_became_peered":"2024-04-03T03:55:53.243822+0000","last_unstale":"2024-04-03T05:14:35.206357+0000","last_undegraded":"2024-04-03T05:14:35.206357+0000","last_fullsized":"2024-04-03T05:14:35.206357+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:35.206168+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:35.206168+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.206168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:13:22.172343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'4","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.270479+0000","last_change":"2024-04-03T05:14:17.270479+0000","last_active":"2024-04-03T05:14:17.270479+0000","last_peered":"2024-04-03T05:14:17.270479+0000","last_clean":"2024-04-03T05:14:17.270479+0000","last_became_active":"2024-04-03T03:55:45.819117+0000","last_became_peered":"2024-04-03T03:55:45.819117+0000","last_unstale":"2024-04-03T05:14:17.270479+0000","last_undegraded":"2024-04-03T05:14:17.270479+0000","last_fullsized":"2024-04-03T05:14:17.270479+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:17.270342+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:17.270342+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.270342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:39:43.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"263'9","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.532743+0000","last_change":"2024-04-03T05:14:16.532814+0000","last_active":"2024-04-03T05:14:16.532743+0000","last_peered":"2024-04-03T05:14:16.532743+0000","last_clean":"2024-04-03T05:14:16.532743+0000","last_became_active":"2024-04-03T03:49:00.991393+0000","last_became_peered":"2024-04-03T03:49:00.991393+0000","last_unstale":"2024-04-03T05:14:16.532743+0000","last_undegraded":"2024-04-03T05:14:16.532743+0000","last_fullsized":"2024-04-03T05:14:16.532743+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-04-03T05:14:16.532534+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-04-03T05:14:16.532534+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.532534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:38:21.117233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:19.064871+0000","last_change":"2024-04-03T04:18:51.316420+0000","last_active":"2024-04-03T05:13:19.064871+0000","last_peered":"2024-04-03T05:13:19.064871+0000","last_clean":"2024-04-03T05:13:19.064871+0000","last_became_active":"2024-04-03T04:18:51.315679+0000","last_became_peered":"2024-04-03T04:18:51.315679+0000","last_unstale":"2024-04-03T05:13:19.064871+0000","last_undegraded":"2024-04-03T05:13:19.064871+0000","last_fullsized":"2024-04-03T05:13:19.064871+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"258'4","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.260745+0000","last_change":"2024-04-03T03:55:53.278183+0000","last_active":"2024-04-03T05:14:16.260745+0000","last_peered":"2024-04-03T05:14:16.260745+0000","last_clean":"2024-04-03T05:14:16.260745+0000","last_became_active":"2024-04-03T03:55:53.277402+0000","last_became_peered":"2024-04-03T03:55:53.277402+0000","last_unstale":"2024-04-03T05:14:16.260745+0000","last_undegraded":"2024-04-03T05:14:16.260745+0000","last_fullsized":"2024-04-03T05:14:16.260745+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":3,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'8","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.423054+0000","last_change":"2024-04-03T05:14:18.423124+0000","last_active":"2024-04-03T05:14:18.423054+0000","last_peered":"2024-04-03T05:14:18.423054+0000","last_clean":"2024-04-03T05:14:18.423054+0000","last_became_active":"2024-04-03T03:55:45.814319+0000","last_became_peered":"2024-04-03T03:55:45.814319+0000","last_unstale":"2024-04-03T05:14:18.423054+0000","last_undegraded":"2024-04-03T05:14:18.423054+0000","last_fullsized":"2024-04-03T05:14:18.423054+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:18.422837+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:18.422837+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.422837+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:11:35.323066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"263'34","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.501763+0000","last_change":"2024-04-03T05:14:30.501826+0000","last_active":"2024-04-03T05:14:30.501763+0000","last_peered":"2024-04-03T05:14:30.501763+0000","last_clean":"2024-04-03T05:14:30.501763+0000","last_became_active":"2024-04-03T03:49:00.979122+0000","last_became_peered":"2024-04-03T03:49:00.979122+0000","last_unstale":"2024-04-03T05:14:30.501763+0000","last_undegraded":"2024-04-03T05:14:30.501763+0000","last_fullsized":"2024-04-03T05:14:30.501763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-04-03T05:14:30.501563+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-04-03T05:14:30.501563+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.501563+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:08:28.157076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":103,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:52.862947+0000","last_change":"2024-04-03T04:18:51.318648+0000","last_active":"2024-04-03T05:12:52.862947+0000","last_peered":"2024-04-03T05:12:52.862947+0000","last_clean":"2024-04-03T05:12:52.862947+0000","last_became_active":"2024-04-03T04:18:51.318018+0000","last_became_peered":"2024-04-03T04:18:51.318018+0000","last_unstale":"2024-04-03T05:12:52.862947+0000","last_undegraded":"2024-04-03T05:12:52.862947+0000","last_fullsized":"2024-04-03T05:12:52.862947+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'7","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.449829+0000","last_change":"2024-04-03T03:55:53.255437+0000","last_active":"2024-04-03T05:14:14.449829+0000","last_peered":"2024-04-03T05:14:14.449829+0000","last_clean":"2024-04-03T05:14:14.449829+0000","last_became_active":"2024-04-03T03:55:53.254546+0000","last_became_peered":"2024-04-03T03:55:53.254546+0000","last_unstale":"2024-04-03T05:14:14.449829+0000","last_undegraded":"2024-04-03T05:14:14.449829+0000","last_fullsized":"2024-04-03T05:14:14.449829+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.967998+0000","last_change":"2024-04-03T05:14:16.968043+0000","last_active":"2024-04-03T05:14:16.967998+0000","last_peered":"2024-04-03T05:14:16.967998+0000","last_clean":"2024-04-03T05:14:16.967998+0000","last_became_active":"2024-04-03T03:55:45.820294+0000","last_became_peered":"2024-04-03T03:55:45.820294+0000","last_unstale":"2024-04-03T05:14:16.967998+0000","last_undegraded":"2024-04-03T05:14:16.967998+0000","last_fullsized":"2024-04-03T05:14:16.967998+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-04-03T05:14:16.967919+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-04-03T05:14:16.967919+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.967919+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:45:58.471685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18434,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"263'22","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.255113+0000","last_change":"2024-04-03T05:14:23.255191+0000","last_active":"2024-04-03T05:14:23.255113+0000","last_peered":"2024-04-03T05:14:23.255113+0000","last_clean":"2024-04-03T05:14:23.255113+0000","last_became_active":"2024-04-03T03:49:00.979598+0000","last_became_peered":"2024-04-03T03:49:00.979598+0000","last_unstale":"2024-04-03T05:14:23.255113+0000","last_undegraded":"2024-04-03T05:14:23.255113+0000","last_fullsized":"2024-04-03T05:14:23.255113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'22","last_scrub_stamp":"2024-04-03T05:14:23.254887+0000","last_deep_scrub":"263'22","last_deep_scrub_stamp":"2024-04-03T05:14:23.254887+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.254887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:57:20.929131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":52,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.089111+0000","last_change":"2024-04-03T04:18:51.367266+0000","last_active":"2024-04-03T05:13:03.089111+0000","last_peered":"2024-04-03T05:13:03.089111+0000","last_clean":"2024-04-03T05:13:03.089111+0000","last_became_active":"2024-04-03T04:18:51.366501+0000","last_became_peered":"2024-04-03T04:18:51.366501+0000","last_unstale":"2024-04-03T05:13:03.089111+0000","last_undegraded":"2024-04-03T05:13:03.089111+0000","last_fullsized":"2024-04-03T05:13:03.089111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'11","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.423373+0000","last_change":"2024-04-03T05:14:47.423453+0000","last_active":"2024-04-03T05:14:47.423373+0000","last_peered":"2024-04-03T05:14:47.423373+0000","last_clean":"2024-04-03T05:14:47.423373+0000","last_became_active":"2024-04-03T03:55:53.266771+0000","last_became_peered":"2024-04-03T03:55:53.266771+0000","last_unstale":"2024-04-03T05:14:47.423373+0000","last_undegraded":"2024-04-03T05:14:47.423373+0000","last_fullsized":"2024-04-03T05:14:47.423373+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:47.423149+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:47.423149+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.423149+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:53:32.932026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":19,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'3","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.065902+0000","last_change":"2024-04-03T05:14:49.065970+0000","last_active":"2024-04-03T05:14:49.065902+0000","last_peered":"2024-04-03T05:14:49.065902+0000","last_clean":"2024-04-03T05:14:49.065902+0000","last_became_active":"2024-04-03T03:55:45.836623+0000","last_became_peered":"2024-04-03T03:55:45.836623+0000","last_unstale":"2024-04-03T05:14:49.065902+0000","last_undegraded":"2024-04-03T05:14:49.065902+0000","last_fullsized":"2024-04-03T05:14:49.065902+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-04-03T05:14:49.065663+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-04-03T05:14:49.065663+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.065663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:25:53.324907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"263'70","reported_seq":243,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.399386+0000","last_change":"2024-04-03T05:14:42.399446+0000","last_active":"2024-04-03T05:14:42.399386+0000","last_peered":"2024-04-03T05:14:42.399386+0000","last_clean":"2024-04-03T05:14:42.399386+0000","last_became_active":"2024-04-03T03:49:00.978563+0000","last_became_peered":"2024-04-03T03:49:00.978563+0000","last_unstale":"2024-04-03T05:14:42.399386+0000","last_undegraded":"2024-04-03T05:14:42.399386+0000","last_fullsized":"2024-04-03T05:14:42.399386+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'70","last_scrub_stamp":"2024-04-03T05:14:42.399194+0000","last_deep_scrub":"263'70","last_deep_scrub_stamp":"2024-04-03T05:14:42.399194+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.399194+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:04:14.620157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":197,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:23.092511+0000","last_change":"2024-04-03T04:18:51.311769+0000","last_active":"2024-04-03T05:13:23.092511+0000","last_peered":"2024-04-03T05:13:23.092511+0000","last_clean":"2024-04-03T05:13:23.092511+0000","last_became_active":"2024-04-03T04:18:51.311005+0000","last_became_peered":"2024-04-03T04:18:51.311005+0000","last_unstale":"2024-04-03T05:13:23.092511+0000","last_undegraded":"2024-04-03T05:13:23.092511+0000","last_fullsized":"2024-04-03T05:13:23.092511+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"258'3","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.815193+0000","last_change":"2024-04-03T05:14:35.815260+0000","last_active":"2024-04-03T05:14:35.815193+0000","last_peered":"2024-04-03T05:14:35.815193+0000","last_clean":"2024-04-03T05:14:35.815193+0000","last_became_active":"2024-04-03T03:55:53.251863+0000","last_became_peered":"2024-04-03T03:55:53.251863+0000","last_unstale":"2024-04-03T05:14:35.815193+0000","last_undegraded":"2024-04-03T05:14:35.815193+0000","last_fullsized":"2024-04-03T05:14:35.815193+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-04-03T05:14:35.814988+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-04-03T05:14:35.814988+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.814988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:02:35.981117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.207038+0000","last_change":"2024-04-03T05:14:19.207099+0000","last_active":"2024-04-03T05:14:19.207038+0000","last_peered":"2024-04-03T05:14:19.207038+0000","last_clean":"2024-04-03T05:14:19.207038+0000","last_became_active":"2024-04-03T03:55:45.823003+0000","last_became_peered":"2024-04-03T03:55:45.823003+0000","last_unstale":"2024-04-03T05:14:19.207038+0000","last_undegraded":"2024-04-03T05:14:19.207038+0000","last_fullsized":"2024-04-03T05:14:19.207038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:19.206826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:19.206826+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.206826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:47:42.400975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"263'42","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.827228+0000","last_change":"2024-04-03T05:14:22.827287+0000","last_active":"2024-04-03T05:14:22.827228+0000","last_peered":"2024-04-03T05:14:22.827228+0000","last_clean":"2024-04-03T05:14:22.827228+0000","last_became_active":"2024-04-03T03:49:00.981940+0000","last_became_peered":"2024-04-03T03:49:00.981940+0000","last_unstale":"2024-04-03T05:14:22.827228+0000","last_undegraded":"2024-04-03T05:14:22.827228+0000","last_fullsized":"2024-04-03T05:14:22.827228+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-04-03T05:14:22.827034+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-04-03T05:14:22.827034+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.827034+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:48:11.329544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"260'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.660202+0000","last_change":"2024-04-03T04:18:51.302485+0000","last_active":"2024-04-03T05:13:03.660202+0000","last_peered":"2024-04-03T05:13:03.660202+0000","last_clean":"2024-04-03T05:13:03.660202+0000","last_became_active":"2024-04-03T04:18:51.301260+0000","last_became_peered":"2024-04-03T04:18:51.301260+0000","last_unstale":"2024-04-03T05:13:03.660202+0000","last_undegraded":"2024-04-03T05:13:03.660202+0000","last_fullsized":"2024-04-03T05:13:03.660202+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.455355+0000","last_change":"2024-04-03T03:55:53.257731+0000","last_active":"2024-04-03T05:14:10.455355+0000","last_peered":"2024-04-03T05:14:10.455355+0000","last_clean":"2024-04-03T05:14:10.455355+0000","last_became_active":"2024-04-03T03:55:53.257421+0000","last_became_peered":"2024-04-03T03:55:53.257421+0000","last_unstale":"2024-04-03T05:14:10.455355+0000","last_undegraded":"2024-04-03T05:14:10.455355+0000","last_fullsized":"2024-04-03T05:14:10.455355+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.581955+0000","last_change":"2024-04-03T05:14:15.581955+0000","last_active":"2024-04-03T05:14:15.581955+0000","last_peered":"2024-04-03T05:14:15.581955+0000","last_clean":"2024-04-03T05:14:15.581955+0000","last_became_active":"2024-04-03T03:55:45.822134+0000","last_became_peered":"2024-04-03T03:55:45.822134+0000","last_unstale":"2024-04-03T05:14:15.581955+0000","last_undegraded":"2024-04-03T05:14:15.581955+0000","last_fullsized":"2024-04-03T05:14:15.581955+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:15.581753+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:15.581753+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.581753+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:13:39.514734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"263'37","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.295589+0000","last_change":"2024-04-03T05:14:31.295589+0000","last_active":"2024-04-03T05:14:31.295589+0000","last_peered":"2024-04-03T05:14:31.295589+0000","last_clean":"2024-04-03T05:14:31.295589+0000","last_became_active":"2024-04-03T03:49:00.989509+0000","last_became_peered":"2024-04-03T03:49:00.989509+0000","last_unstale":"2024-04-03T05:14:31.295589+0000","last_undegraded":"2024-04-03T05:14:31.295589+0000","last_fullsized":"2024-04-03T05:14:31.295589+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-04-03T05:14:31.295305+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-04-03T05:14:31.295305+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.295305+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:06:48.153827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:04.061712+0000","last_change":"2024-04-03T04:18:51.367656+0000","last_active":"2024-04-03T05:13:04.061712+0000","last_peered":"2024-04-03T05:13:04.061712+0000","last_clean":"2024-04-03T05:13:04.061712+0000","last_became_active":"2024-04-03T04:18:51.366898+0000","last_became_peered":"2024-04-03T04:18:51.366898+0000","last_unstale":"2024-04-03T05:13:04.061712+0000","last_undegraded":"2024-04-03T05:13:04.061712+0000","last_fullsized":"2024-04-03T05:13:04.061712+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:53.866962+0000","last_change":"2024-04-03T03:55:53.273186+0000","last_active":"2024-04-03T05:13:53.866962+0000","last_peered":"2024-04-03T05:13:53.866962+0000","last_clean":"2024-04-03T05:13:53.866962+0000","last_became_active":"2024-04-03T03:55:53.272757+0000","last_became_peered":"2024-04-03T03:55:53.272757+0000","last_unstale":"2024-04-03T05:13:53.866962+0000","last_undegraded":"2024-04-03T05:13:53.866962+0000","last_fullsized":"2024-04-03T05:13:53.866962+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.778706+0000","last_change":"2024-04-03T05:14:27.778761+0000","last_active":"2024-04-03T05:14:27.778706+0000","last_peered":"2024-04-03T05:14:27.778706+0000","last_clean":"2024-04-03T05:14:27.778706+0000","last_became_active":"2024-04-03T03:55:45.834364+0000","last_became_peered":"2024-04-03T03:55:45.834364+0000","last_unstale":"2024-04-03T05:14:27.778706+0000","last_undegraded":"2024-04-03T05:14:27.778706+0000","last_fullsized":"2024-04-03T05:14:27.778706+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.778514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.778514+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.778514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:44:07.258462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"263'29","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.843494+0000","last_change":"2024-04-03T05:14:24.843494+0000","last_active":"2024-04-03T05:14:24.843494+0000","last_peered":"2024-04-03T05:14:24.843494+0000","last_clean":"2024-04-03T05:14:24.843494+0000","last_became_active":"2024-04-03T03:49:00.974654+0000","last_became_peered":"2024-04-03T03:49:00.974654+0000","last_unstale":"2024-04-03T05:14:24.843494+0000","last_undegraded":"2024-04-03T05:14:24.843494+0000","last_fullsized":"2024-04-03T05:14:24.843494+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-04-03T05:14:24.843104+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-04-03T05:14:24.843104+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.843104+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:36:52.914225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:08.856641+0000","last_change":"2024-04-03T04:18:51.323217+0000","last_active":"2024-04-03T05:13:08.856641+0000","last_peered":"2024-04-03T05:13:08.856641+0000","last_clean":"2024-04-03T05:13:08.856641+0000","last_became_active":"2024-04-03T04:18:51.322311+0000","last_became_peered":"2024-04-03T04:18:51.322311+0000","last_unstale":"2024-04-03T05:13:08.856641+0000","last_undegraded":"2024-04-03T05:13:08.856641+0000","last_fullsized":"2024-04-03T05:13:08.856641+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.598546+0000","last_change":"2024-04-03T03:55:53.256346+0000","last_active":"2024-04-03T05:14:08.598546+0000","last_peered":"2024-04-03T05:14:08.598546+0000","last_clean":"2024-04-03T05:14:08.598546+0000","last_became_active":"2024-04-03T03:55:53.255322+0000","last_became_peered":"2024-04-03T03:55:53.255322+0000","last_unstale":"2024-04-03T05:14:08.598546+0000","last_undegraded":"2024-04-03T05:14:08.598546+0000","last_fullsized":"2024-04-03T05:14:08.598546+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:55:52.204510+0000","last_clean_scrub_stamp":"2024-04-03T03:55:52.204510+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":90,"num_write":10,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'2","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.524694+0000","last_change":"2024-04-03T05:14:16.524760+0000","last_active":"2024-04-03T05:14:16.524694+0000","last_peered":"2024-04-03T05:14:16.524694+0000","last_clean":"2024-04-03T05:14:16.524694+0000","last_became_active":"2024-04-03T03:55:45.825324+0000","last_became_peered":"2024-04-03T03:55:45.825324+0000","last_unstale":"2024-04-03T05:14:16.524694+0000","last_undegraded":"2024-04-03T05:14:16.524694+0000","last_fullsized":"2024-04-03T05:14:16.524694+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:16.524499+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:16.524499+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.524499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:06:55.683539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"263'10","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.922456+0000","last_change":"2024-04-03T05:14:17.922456+0000","last_active":"2024-04-03T05:14:17.922456+0000","last_peered":"2024-04-03T05:14:17.922456+0000","last_clean":"2024-04-03T05:14:17.922456+0000","last_became_active":"2024-04-03T03:49:00.988511+0000","last_became_peered":"2024-04-03T03:49:00.988511+0000","last_unstale":"2024-04-03T05:14:17.922456+0000","last_undegraded":"2024-04-03T05:14:17.922456+0000","last_fullsized":"2024-04-03T05:14:17.922456+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-04-03T05:14:17.922164+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-04-03T05:14:17.922164+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.922164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:09:03.267120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:57.533076+0000","last_change":"2024-04-03T05:14:57.533128+0000","last_active":"2024-04-03T05:14:57.533076+0000","last_peered":"2024-04-03T05:14:57.533076+0000","last_clean":"2024-04-03T05:14:57.533076+0000","last_became_active":"2024-04-03T04:18:51.310903+0000","last_became_peered":"2024-04-03T04:18:51.310903+0000","last_unstale":"2024-04-03T05:14:57.533076+0000","last_undegraded":"2024-04-03T05:14:57.533076+0000","last_fullsized":"2024-04-03T05:14:57.533076+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:57.532876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:57.532876+0000","last_clean_scrub_stamp":"2024-04-03T05:14:57.532876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:41:43.066957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'4","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.816391+0000","last_change":"2024-04-03T05:14:31.816522+0000","last_active":"2024-04-03T05:14:31.816391+0000","last_peered":"2024-04-03T05:14:31.816391+0000","last_clean":"2024-04-03T05:14:31.816391+0000","last_became_active":"2024-04-03T03:55:53.248897+0000","last_became_peered":"2024-04-03T03:55:53.248897+0000","last_unstale":"2024-04-03T05:14:31.816391+0000","last_undegraded":"2024-04-03T05:14:31.816391+0000","last_fullsized":"2024-04-03T05:14:31.816391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:31.816146+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:31.816146+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.816146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:02:36.972838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.378896+0000","last_change":"2024-04-03T05:14:35.378955+0000","last_active":"2024-04-03T05:14:35.378896+0000","last_peered":"2024-04-03T05:14:35.378896+0000","last_clean":"2024-04-03T05:14:35.378896+0000","last_became_active":"2024-04-03T03:55:45.822406+0000","last_became_peered":"2024-04-03T03:55:45.822406+0000","last_unstale":"2024-04-03T05:14:35.378896+0000","last_undegraded":"2024-04-03T05:14:35.378896+0000","last_fullsized":"2024-04-03T05:14:35.378896+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:35.378674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:35.378674+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.378674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:50.015655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"263'32","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.310176+0000","last_change":"2024-04-03T05:14:21.310176+0000","last_active":"2024-04-03T05:14:21.310176+0000","last_peered":"2024-04-03T05:14:21.310176+0000","last_clean":"2024-04-03T05:14:21.310176+0000","last_became_active":"2024-04-03T03:49:00.983502+0000","last_became_peered":"2024-04-03T03:49:00.983502+0000","last_unstale":"2024-04-03T05:14:21.310176+0000","last_undegraded":"2024-04-03T05:14:21.310176+0000","last_fullsized":"2024-04-03T05:14:21.310176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-04-03T05:14:21.309909+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-04-03T05:14:21.309909+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.309909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:33:21.060923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":91,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:03.660045+0000","last_change":"2024-04-03T04:18:51.320361+0000","last_active":"2024-04-03T05:13:03.660045+0000","last_peered":"2024-04-03T05:13:03.660045+0000","last_clean":"2024-04-03T05:13:03.660045+0000","last_became_active":"2024-04-03T04:18:51.319585+0000","last_became_peered":"2024-04-03T04:18:51.319585+0000","last_unstale":"2024-04-03T05:13:03.660045+0000","last_undegraded":"2024-04-03T05:13:03.660045+0000","last_fullsized":"2024-04-03T05:13:03.660045+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.078865+0000","last_change":"2024-04-03T05:14:50.079000+0000","last_active":"2024-04-03T05:14:50.078865+0000","last_peered":"2024-04-03T05:14:50.078865+0000","last_clean":"2024-04-03T05:14:50.078865+0000","last_became_active":"2024-04-03T03:55:53.253313+0000","last_became_peered":"2024-04-03T03:55:53.253313+0000","last_unstale":"2024-04-03T05:14:50.078865+0000","last_undegraded":"2024-04-03T05:14:50.078865+0000","last_fullsized":"2024-04-03T05:14:50.078865+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:50.078639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:50.078639+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.078639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:45:20.489308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.795872+0000","last_change":"2024-04-03T05:14:18.795955+0000","last_active":"2024-04-03T05:14:18.795872+0000","last_peered":"2024-04-03T05:14:18.795872+0000","last_clean":"2024-04-03T05:14:18.795872+0000","last_became_active":"2024-04-03T03:55:45.820786+0000","last_became_peered":"2024-04-03T03:55:45.820786+0000","last_unstale":"2024-04-03T05:14:18.795872+0000","last_undegraded":"2024-04-03T05:14:18.795872+0000","last_fullsized":"2024-04-03T05:14:18.795872+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:18.795665+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:18.795665+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.795665+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:35:11.045049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"263'69","reported_seq":252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.176593+0000","last_change":"2024-04-03T05:14:18.176593+0000","last_active":"2024-04-03T05:14:18.176593+0000","last_peered":"2024-04-03T05:14:18.176593+0000","last_clean":"2024-04-03T05:14:18.176593+0000","last_became_active":"2024-04-03T03:49:00.961318+0000","last_became_peered":"2024-04-03T03:49:00.961318+0000","last_unstale":"2024-04-03T05:14:18.176593+0000","last_undegraded":"2024-04-03T05:14:18.176593+0000","last_fullsized":"2024-04-03T05:14:18.176593+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'69","last_scrub_stamp":"2024-04-03T05:14:18.176318+0000","last_deep_scrub":"263'69","last_deep_scrub_stamp":"2024-04-03T05:14:18.176318+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.176318+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:57:25.774114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":306,"num_read_kb":217,"num_write":109,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:04.037436+0000","last_change":"2024-04-03T04:18:51.318872+0000","last_active":"2024-04-03T05:13:04.037436+0000","last_peered":"2024-04-03T05:13:04.037436+0000","last_clean":"2024-04-03T05:13:04.037436+0000","last_became_active":"2024-04-03T04:18:51.318123+0000","last_became_peered":"2024-04-03T04:18:51.318123+0000","last_unstale":"2024-04-03T05:13:04.037436+0000","last_undegraded":"2024-04-03T05:13:04.037436+0000","last_fullsized":"2024-04-03T05:13:04.037436+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T04:18:50.268136+0000","last_clean_scrub_stamp":"2024-04-03T04:18:50.268136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.572904+0000","last_change":"2024-04-03T05:14:27.572960+0000","last_active":"2024-04-03T05:14:27.572904+0000","last_peered":"2024-04-03T05:14:27.572904+0000","last_clean":"2024-04-03T05:14:27.572904+0000","last_became_active":"2024-04-03T03:55:53.272979+0000","last_became_peered":"2024-04-03T03:55:53.272979+0000","last_unstale":"2024-04-03T05:14:27.572904+0000","last_undegraded":"2024-04-03T05:14:27.572904+0000","last_fullsized":"2024-04-03T05:14:27.572904+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.572704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.572704+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.572704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:55.190017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"258'2","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.383397+0000","last_change":"2024-04-03T05:14:19.383521+0000","last_active":"2024-04-03T05:14:19.383397+0000","last_peered":"2024-04-03T05:14:19.383397+0000","last_clean":"2024-04-03T05:14:19.383397+0000","last_became_active":"2024-04-03T03:55:45.807410+0000","last_became_peered":"2024-04-03T03:55:45.807410+0000","last_unstale":"2024-04-03T05:14:19.383397+0000","last_undegraded":"2024-04-03T05:14:19.383397+0000","last_fullsized":"2024-04-03T05:14:19.383397+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:19.383065+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:19.383065+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.383065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:31.309704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"263'45","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.487332+0000","last_change":"2024-04-03T05:14:32.487398+0000","last_active":"2024-04-03T05:14:32.487332+0000","last_peered":"2024-04-03T05:14:32.487332+0000","last_clean":"2024-04-03T05:14:32.487332+0000","last_became_active":"2024-04-03T03:49:00.978547+0000","last_became_peered":"2024-04-03T03:49:00.978547+0000","last_unstale":"2024-04-03T05:14:32.487332+0000","last_undegraded":"2024-04-03T05:14:32.487332+0000","last_fullsized":"2024-04-03T05:14:32.487332+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'45","last_scrub_stamp":"2024-04-03T05:14:32.487125+0000","last_deep_scrub":"263'45","last_deep_scrub_stamp":"2024-04-03T05:14:32.487125+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.487125+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:30:00.068417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":127,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'414","reported_seq":1115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.866159+0000","last_change":"2024-04-03T05:14:50.866285+0000","last_active":"2024-04-03T05:14:50.866159+0000","last_peered":"2024-04-03T05:14:50.866159+0000","last_clean":"2024-04-03T05:14:50.866159+0000","last_became_active":"2024-04-03T03:38:24.753446+0000","last_became_peered":"2024-04-03T03:38:24.753446+0000","last_unstale":"2024-04-03T05:14:50.866159+0000","last_undegraded":"2024-04-03T05:14:50.866159+0000","last_fullsized":"2024-04-03T05:14:50.866159+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'414","last_scrub_stamp":"2024-04-03T05:14:50.865940+0000","last_deep_scrub":"263'414","last_deep_scrub_stamp":"2024-04-03T05:14:50.865940+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.865940+0000","objects_scrubbed":11,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:53:54.550715+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8977164,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":672,"num_read_kb":35431,"num_write":1374,"num_write_kb":27233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'365","reported_seq":1900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.445171+0000","last_change":"2024-04-03T05:14:43.445267+0000","last_active":"2024-04-03T05:14:43.445171+0000","last_peered":"2024-04-03T05:14:43.445171+0000","last_clean":"2024-04-03T05:14:43.445171+0000","last_became_active":"2024-04-03T03:38:26.750879+0000","last_became_peered":"2024-04-03T03:38:26.750879+0000","last_unstale":"2024-04-03T05:14:43.445171+0000","last_undegraded":"2024-04-03T05:14:43.445171+0000","last_fullsized":"2024-04-03T05:14:43.445171+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-04-03T05:14:43.444983+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-04-03T05:14:43.444983+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.444983+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:10:56.419620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2014,"num_read_kb":1942,"num_write":406,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'333","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.572680+0000","last_change":"2024-04-03T05:14:50.572839+0000","last_active":"2024-04-03T05:14:50.572680+0000","last_peered":"2024-04-03T05:14:50.572680+0000","last_clean":"2024-04-03T05:14:50.572680+0000","last_became_active":"2024-04-03T03:38:24.722769+0000","last_became_peered":"2024-04-03T03:38:24.722769+0000","last_unstale":"2024-04-03T05:14:50.572680+0000","last_undegraded":"2024-04-03T05:14:50.572680+0000","last_fullsized":"2024-04-03T05:14:50.572680+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-04-03T05:14:50.572466+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-04-03T05:14:50.572466+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.572466+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:53:24.797108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586810,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":606,"num_read_kb":76325,"num_write":1300,"num_write_kb":34753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'863","reported_seq":2525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.885194+0000","last_change":"2024-04-03T05:14:38.885260+0000","last_active":"2024-04-03T05:14:38.885194+0000","last_peered":"2024-04-03T05:14:38.885194+0000","last_clean":"2024-04-03T05:14:38.885194+0000","last_became_active":"2024-04-03T03:38:26.724640+0000","last_became_peered":"2024-04-03T03:38:26.724640+0000","last_unstale":"2024-04-03T05:14:38.885194+0000","last_undegraded":"2024-04-03T05:14:38.885194+0000","last_fullsized":"2024-04-03T05:14:38.885194+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'863","last_scrub_stamp":"2024-04-03T05:14:38.885007+0000","last_deep_scrub":"263'863","last_deep_scrub_stamp":"2024-04-03T05:14:38.885007+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.885007+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":800,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:35:32.648007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3968,"num_read_kb":3559,"num_write":1184,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'315","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:57.202707+0000","last_change":"2024-04-03T05:14:57.202795+0000","last_active":"2024-04-03T05:14:57.202707+0000","last_peered":"2024-04-03T05:14:57.202707+0000","last_clean":"2024-04-03T05:14:57.202707+0000","last_became_active":"2024-04-03T03:38:24.711028+0000","last_became_peered":"2024-04-03T03:38:24.711028+0000","last_unstale":"2024-04-03T05:14:57.202707+0000","last_undegraded":"2024-04-03T05:14:57.202707+0000","last_fullsized":"2024-04-03T05:14:57.202707+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-04-03T05:14:57.202507+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-04-03T05:14:57.202507+0000","last_clean_scrub_stamp":"2024-04-03T05:14:57.202507+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:33:13.005410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174583,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":16599,"num_write":1026,"num_write_kb":26343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'713","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.751614+0000","last_change":"2024-04-03T05:14:34.751690+0000","last_active":"2024-04-03T05:14:34.751614+0000","last_peered":"2024-04-03T05:14:34.751614+0000","last_clean":"2024-04-03T05:14:34.751614+0000","last_became_active":"2024-04-03T03:38:26.745277+0000","last_became_peered":"2024-04-03T03:38:26.745277+0000","last_unstale":"2024-04-03T05:14:34.751614+0000","last_undegraded":"2024-04-03T05:14:34.751614+0000","last_fullsized":"2024-04-03T05:14:34.751614+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'713","last_scrub_stamp":"2024-04-03T05:14:34.751404+0000","last_deep_scrub":"263'713","last_deep_scrub_stamp":"2024-04-03T05:14:34.751404+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.751404+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:57:11.797760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3170,"num_read_kb":2825,"num_write":964,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1651,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'389","reported_seq":1110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.412882+0000","last_change":"2024-04-03T05:14:44.412882+0000","last_active":"2024-04-03T05:14:44.412882+0000","last_peered":"2024-04-03T05:14:44.412882+0000","last_clean":"2024-04-03T05:14:44.412882+0000","last_became_active":"2024-04-03T03:38:24.756927+0000","last_became_peered":"2024-04-03T03:38:24.756927+0000","last_unstale":"2024-04-03T05:14:44.412882+0000","last_undegraded":"2024-04-03T05:14:44.412882+0000","last_fullsized":"2024-04-03T05:14:44.412882+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-04-03T05:14:44.412430+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-04-03T05:14:44.412430+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.412430+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:51:44.234807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":48559,"num_write":1381,"num_write_kb":35333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'579","reported_seq":2227,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.208870+0000","last_change":"2024-04-03T05:14:44.208941+0000","last_active":"2024-04-03T05:14:44.208870+0000","last_peered":"2024-04-03T05:14:44.208870+0000","last_clean":"2024-04-03T05:14:44.208870+0000","last_became_active":"2024-04-03T03:38:26.729866+0000","last_became_peered":"2024-04-03T03:38:26.729866+0000","last_unstale":"2024-04-03T05:14:44.208870+0000","last_undegraded":"2024-04-03T05:14:44.208870+0000","last_fullsized":"2024-04-03T05:14:44.208870+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'579","last_scrub_stamp":"2024-04-03T05:14:44.208660+0000","last_deep_scrub":"263'579","last_deep_scrub_stamp":"2024-04-03T05:14:44.208660+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.208660+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:06:03.005150+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2799,"num_write":801,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2635,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'407","reported_seq":1314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.582990+0000","last_change":"2024-04-03T03:38:24.748987+0000","last_active":"2024-04-03T05:14:10.582990+0000","last_peered":"2024-04-03T05:14:10.582990+0000","last_clean":"2024-04-03T05:14:10.582990+0000","last_became_active":"2024-04-03T03:38:24.748338+0000","last_became_peered":"2024-04-03T03:38:24.748338+0000","last_unstale":"2024-04-03T05:14:10.582990+0000","last_undegraded":"2024-04-03T05:14:10.582990+0000","last_fullsized":"2024-04-03T05:14:10.582990+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1354628,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1249,"num_read_kb":39095,"num_write":1674,"num_write_kb":52242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'479","reported_seq":1936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.207315+0000","last_change":"2024-04-03T05:14:39.207315+0000","last_active":"2024-04-03T05:14:39.207315+0000","last_peered":"2024-04-03T05:14:39.207315+0000","last_clean":"2024-04-03T05:14:39.207315+0000","last_became_active":"2024-04-03T03:38:26.719805+0000","last_became_peered":"2024-04-03T03:38:26.719805+0000","last_unstale":"2024-04-03T05:14:39.207315+0000","last_undegraded":"2024-04-03T05:14:39.207315+0000","last_fullsized":"2024-04-03T05:14:39.207315+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-04-03T05:14:39.207044+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-04-03T05:14:39.207044+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.207044+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:17:57.511774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2340,"num_read_kb":2138,"num_write":626,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'359","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.314921+0000","last_change":"2024-04-03T05:14:48.315028+0000","last_active":"2024-04-03T05:14:48.314921+0000","last_peered":"2024-04-03T05:14:48.314921+0000","last_clean":"2024-04-03T05:14:48.314921+0000","last_became_active":"2024-04-03T03:38:24.749192+0000","last_became_peered":"2024-04-03T03:38:24.749192+0000","last_unstale":"2024-04-03T05:14:48.314921+0000","last_undegraded":"2024-04-03T05:14:48.314921+0000","last_fullsized":"2024-04-03T05:14:48.314921+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-04-03T05:14:48.314718+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-04-03T05:14:48.314718+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.314718+0000","objects_scrubbed":11,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:09:20.121325+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4003555,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":459,"num_read_kb":24946,"num_write":1297,"num_write_kb":50928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'295","reported_seq":1660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.722488+0000","last_change":"2024-04-03T05:14:36.722555+0000","last_active":"2024-04-03T05:14:36.722488+0000","last_peered":"2024-04-03T05:14:36.722488+0000","last_clean":"2024-04-03T05:14:36.722488+0000","last_became_active":"2024-04-03T03:38:26.744762+0000","last_became_peered":"2024-04-03T03:38:26.744762+0000","last_unstale":"2024-04-03T05:14:36.722488+0000","last_undegraded":"2024-04-03T05:14:36.722488+0000","last_fullsized":"2024-04-03T05:14:36.722488+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'295","last_scrub_stamp":"2024-04-03T05:14:36.722295+0000","last_deep_scrub":"263'295","last_deep_scrub_stamp":"2024-04-03T05:14:36.722295+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.722295+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:55:03.237199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1674,"num_read_kb":1613,"num_write":327,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'333","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.579889+0000","last_change":"2024-04-03T03:38:24.730594+0000","last_active":"2024-04-03T05:14:10.579889+0000","last_peered":"2024-04-03T05:14:10.579889+0000","last_clean":"2024-04-03T05:14:10.579889+0000","last_became_active":"2024-04-03T03:38:24.728188+0000","last_became_peered":"2024-04-03T03:38:24.728188+0000","last_unstale":"2024-04-03T05:14:10.579889+0000","last_undegraded":"2024-04-03T05:14:10.579889+0000","last_fullsized":"2024-04-03T05:14:10.579889+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149405,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":546,"num_read_kb":30992,"num_write":1174,"num_write_kb":37947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'736","reported_seq":2245,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.434540+0000","last_change":"2024-04-03T05:14:38.434701+0000","last_active":"2024-04-03T05:14:38.434540+0000","last_peered":"2024-04-03T05:14:38.434540+0000","last_clean":"2024-04-03T05:14:38.434540+0000","last_became_active":"2024-04-03T03:38:26.722053+0000","last_became_peered":"2024-04-03T03:38:26.722053+0000","last_unstale":"2024-04-03T05:14:38.434540+0000","last_undegraded":"2024-04-03T05:14:38.434540+0000","last_fullsized":"2024-04-03T05:14:38.434540+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'736","last_scrub_stamp":"2024-04-03T05:14:38.434324+0000","last_deep_scrub":"263'736","last_deep_scrub_stamp":"2024-04-03T05:14:38.434324+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.434324+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:11:18.939280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3332,"num_read_kb":2987,"num_write":969,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'347","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.569804+0000","last_change":"2024-04-03T03:38:24.749214+0000","last_active":"2024-04-03T05:14:10.569804+0000","last_peered":"2024-04-03T05:14:10.569804+0000","last_clean":"2024-04-03T05:14:10.569804+0000","last_became_active":"2024-04-03T03:38:24.748669+0000","last_became_peered":"2024-04-03T03:38:24.748669+0000","last_unstale":"2024-04-03T05:14:10.569804+0000","last_undegraded":"2024-04-03T05:14:10.569804+0000","last_fullsized":"2024-04-03T05:14:10.569804+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1960097,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":30925,"num_write":1242,"num_write_kb":34378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'467","reported_seq":1995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.475999+0000","last_change":"2024-04-03T05:14:37.476076+0000","last_active":"2024-04-03T05:14:37.475999+0000","last_peered":"2024-04-03T05:14:37.475999+0000","last_clean":"2024-04-03T05:14:37.475999+0000","last_became_active":"2024-04-03T03:38:26.711993+0000","last_became_peered":"2024-04-03T03:38:26.711993+0000","last_unstale":"2024-04-03T05:14:37.475999+0000","last_undegraded":"2024-04-03T05:14:37.475999+0000","last_fullsized":"2024-04-03T05:14:37.475999+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'467","last_scrub_stamp":"2024-04-03T05:14:37.475790+0000","last_deep_scrub":"263'467","last_deep_scrub_stamp":"2024-04-03T05:14:37.475790+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.475790+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:29:23.922936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2333,"num_write":597,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'427","reported_seq":1882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.673880+0000","last_change":"2024-04-03T03:38:26.741314+0000","last_active":"2024-04-03T05:14:08.673880+0000","last_peered":"2024-04-03T05:14:08.673880+0000","last_clean":"2024-04-03T05:14:08.673880+0000","last_became_active":"2024-04-03T03:38:26.740542+0000","last_became_peered":"2024-04-03T03:38:26.740542+0000","last_unstale":"2024-04-03T05:14:08.673880+0000","last_undegraded":"2024-04-03T05:14:08.673880+0000","last_fullsized":"2024-04-03T05:14:08.673880+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2192,"num_read_kb":2031,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'347","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.859682+0000","last_change":"2024-04-03T05:14:46.859799+0000","last_active":"2024-04-03T05:14:46.859682+0000","last_peered":"2024-04-03T05:14:46.859682+0000","last_clean":"2024-04-03T05:14:46.859682+0000","last_became_active":"2024-04-03T03:38:24.761424+0000","last_became_peered":"2024-04-03T03:38:24.761424+0000","last_unstale":"2024-04-03T05:14:46.859682+0000","last_undegraded":"2024-04-03T05:14:46.859682+0000","last_fullsized":"2024-04-03T05:14:46.859682+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-04-03T05:14:46.859475+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-04-03T05:14:46.859475+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.859475+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:30:55.297131+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342126,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":4079,"num_write":1247,"num_write_kb":13920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'365","reported_seq":1762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.860694+0000","last_change":"2024-04-03T05:14:40.860794+0000","last_active":"2024-04-03T05:14:40.860694+0000","last_peered":"2024-04-03T05:14:40.860694+0000","last_clean":"2024-04-03T05:14:40.860694+0000","last_became_active":"2024-04-03T03:38:26.723638+0000","last_became_peered":"2024-04-03T03:38:26.723638+0000","last_unstale":"2024-04-03T05:14:40.860694+0000","last_undegraded":"2024-04-03T05:14:40.860694+0000","last_fullsized":"2024-04-03T05:14:40.860694+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-04-03T05:14:40.860502+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-04-03T05:14:40.860502+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.860502+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:32:09.070447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1899,"num_read_kb":1790,"num_write":424,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'351","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.230888+0000","last_change":"2024-04-03T05:14:38.231008+0000","last_active":"2024-04-03T05:14:38.230888+0000","last_peered":"2024-04-03T05:14:38.230888+0000","last_clean":"2024-04-03T05:14:38.230888+0000","last_became_active":"2024-04-03T03:38:58.349885+0000","last_became_peered":"2024-04-03T03:38:58.349885+0000","last_unstale":"2024-04-03T05:14:38.230888+0000","last_undegraded":"2024-04-03T05:14:38.230888+0000","last_fullsized":"2024-04-03T05:14:38.230888+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-04-03T05:14:38.230676+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-04-03T05:14:38.230676+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.230676+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:06:03.387049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502701,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":66677,"num_write":1253,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'453","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.433075+0000","last_change":"2024-04-03T05:14:42.433138+0000","last_active":"2024-04-03T05:14:42.433075+0000","last_peered":"2024-04-03T05:14:42.433075+0000","last_clean":"2024-04-03T05:14:42.433075+0000","last_became_active":"2024-04-03T03:38:26.709613+0000","last_became_peered":"2024-04-03T03:38:26.709613+0000","last_unstale":"2024-04-03T05:14:42.433075+0000","last_undegraded":"2024-04-03T05:14:42.433075+0000","last_fullsized":"2024-04-03T05:14:42.433075+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-04-03T05:14:42.432892+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-04-03T05:14:42.432892+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.432892+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:02:32.705873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2380,"num_write":570,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'353","reported_seq":1065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.195515+0000","last_change":"2024-04-03T05:14:44.195637+0000","last_active":"2024-04-03T05:14:44.195515+0000","last_peered":"2024-04-03T05:14:44.195515+0000","last_clean":"2024-04-03T05:14:44.195515+0000","last_became_active":"2024-04-03T03:38:24.761284+0000","last_became_peered":"2024-04-03T03:38:24.761284+0000","last_unstale":"2024-04-03T05:14:44.195515+0000","last_undegraded":"2024-04-03T05:14:44.195515+0000","last_fullsized":"2024-04-03T05:14:44.195515+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-04-03T05:14:44.195321+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-04-03T05:14:44.195321+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.195321+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:02:22.125464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":65082,"num_write":1201,"num_write_kb":43379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'451","reported_seq":2422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.454544+0000","last_change":"2024-04-03T05:14:38.454618+0000","last_active":"2024-04-03T05:14:38.454544+0000","last_peered":"2024-04-03T05:14:38.454544+0000","last_clean":"2024-04-03T05:14:38.454544+0000","last_became_active":"2024-04-03T03:38:26.711748+0000","last_became_peered":"2024-04-03T03:38:26.711748+0000","last_unstale":"2024-04-03T05:14:38.454544+0000","last_undegraded":"2024-04-03T05:14:38.454544+0000","last_fullsized":"2024-04-03T05:14:38.454544+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-04-03T05:14:38.454435+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-04-03T05:14:38.454435+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.454435+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:08:51.014215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2976,"num_read_kb":2877,"num_write":500,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6701,"num_omap_keys":28,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'299","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.641110+0000","last_change":"2024-04-03T05:14:52.641216+0000","last_active":"2024-04-03T05:14:52.641110+0000","last_peered":"2024-04-03T05:14:52.641110+0000","last_clean":"2024-04-03T05:14:52.641110+0000","last_became_active":"2024-04-03T03:38:24.742574+0000","last_became_peered":"2024-04-03T03:38:24.742574+0000","last_unstale":"2024-04-03T05:14:52.641110+0000","last_undegraded":"2024-04-03T05:14:52.641110+0000","last_fullsized":"2024-04-03T05:14:52.641110+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-04-03T05:14:52.640905+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-04-03T05:14:52.640905+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.640905+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:12.639513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399089,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":46919,"num_write":1114,"num_write_kb":37595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'342","reported_seq":1763,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.397432+0000","last_change":"2024-04-03T05:14:41.397502+0000","last_active":"2024-04-03T05:14:41.397432+0000","last_peered":"2024-04-03T05:14:41.397432+0000","last_clean":"2024-04-03T05:14:41.397432+0000","last_became_active":"2024-04-03T03:38:26.743735+0000","last_became_peered":"2024-04-03T03:38:26.743735+0000","last_unstale":"2024-04-03T05:14:41.397432+0000","last_undegraded":"2024-04-03T05:14:41.397432+0000","last_fullsized":"2024-04-03T05:14:41.397432+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-04-03T05:14:41.397242+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-04-03T05:14:41.397242+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.397242+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:40:08.131190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1802,"num_read_kb":1729,"num_write":383,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'346","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.492241+0000","last_change":"2024-04-03T03:38:24.726007+0000","last_active":"2024-04-03T05:14:10.492241+0000","last_peered":"2024-04-03T05:14:10.492241+0000","last_clean":"2024-04-03T05:14:10.492241+0000","last_became_active":"2024-04-03T03:38:24.725557+0000","last_became_peered":"2024-04-03T03:38:24.725557+0000","last_unstale":"2024-04-03T05:14:10.492241+0000","last_undegraded":"2024-04-03T05:14:10.492241+0000","last_fullsized":"2024-04-03T05:14:10.492241+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456508,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":495,"num_read_kb":4167,"num_write":1155,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'335","reported_seq":1772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.581190+0000","last_change":"2024-04-03T05:14:45.581251+0000","last_active":"2024-04-03T05:14:45.581190+0000","last_peered":"2024-04-03T05:14:45.581190+0000","last_clean":"2024-04-03T05:14:45.581190+0000","last_became_active":"2024-04-03T03:38:26.744977+0000","last_became_peered":"2024-04-03T03:38:26.744977+0000","last_unstale":"2024-04-03T05:14:45.581190+0000","last_undegraded":"2024-04-03T05:14:45.581190+0000","last_fullsized":"2024-04-03T05:14:45.581190+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-04-03T05:14:45.581007+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-04-03T05:14:45.581007+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.581007+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:51:18.049040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1755,"num_write":385,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'292","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.448617+0000","last_change":"2024-04-03T03:38:24.725895+0000","last_active":"2024-04-03T05:14:14.448617+0000","last_peered":"2024-04-03T05:14:14.448617+0000","last_clean":"2024-04-03T05:14:14.448617+0000","last_became_active":"2024-04-03T03:38:24.725410+0000","last_became_peered":"2024-04-03T03:38:24.725410+0000","last_unstale":"2024-04-03T05:14:14.448617+0000","last_undegraded":"2024-04-03T05:14:14.448617+0000","last_fullsized":"2024-04-03T05:14:14.448617+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":543,"num_read_kb":79698,"num_write":993,"num_write_kb":41581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'140","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.593760+0000","last_change":"2024-04-03T05:14:25.593823+0000","last_active":"2024-04-03T05:14:25.593760+0000","last_peered":"2024-04-03T05:14:25.593760+0000","last_clean":"2024-04-03T05:14:25.593760+0000","last_became_active":"2024-04-03T03:38:34.738565+0000","last_became_peered":"2024-04-03T03:38:34.738565+0000","last_unstale":"2024-04-03T05:14:25.593760+0000","last_undegraded":"2024-04-03T05:14:25.593760+0000","last_fullsized":"2024-04-03T05:14:25.593760+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-04-03T05:14:25.593574+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-04-03T05:14:25.593574+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.593574+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:12:17.516873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":345,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'373","reported_seq":1834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.038166+0000","last_change":"2024-04-03T05:14:22.038166+0000","last_active":"2024-04-03T05:14:22.038166+0000","last_peered":"2024-04-03T05:14:22.038166+0000","last_clean":"2024-04-03T05:14:22.038166+0000","last_became_active":"2024-04-03T03:39:58.989982+0000","last_became_peered":"2024-04-03T03:39:58.989982+0000","last_unstale":"2024-04-03T05:14:22.038166+0000","last_undegraded":"2024-04-03T05:14:22.038166+0000","last_fullsized":"2024-04-03T05:14:22.038166+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'373","last_scrub_stamp":"2024-04-03T05:14:22.037900+0000","last_deep_scrub":"263'373","last_deep_scrub_stamp":"2024-04-03T05:14:22.037900+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.037900+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:40:14.362011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2119,"num_read_kb":1999,"num_write":436,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'348","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.569260+0000","last_change":"2024-04-03T03:38:24.750884+0000","last_active":"2024-04-03T05:14:10.569260+0000","last_peered":"2024-04-03T05:14:10.569260+0000","last_clean":"2024-04-03T05:14:10.569260+0000","last_became_active":"2024-04-03T03:38:24.750235+0000","last_became_peered":"2024-04-03T03:38:24.750235+0000","last_unstale":"2024-04-03T05:14:10.569260+0000","last_undegraded":"2024-04-03T05:14:10.569260+0000","last_fullsized":"2024-04-03T05:14:10.569260+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":98321,"num_write":1208,"num_write_kb":49383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.406569+0000","last_change":"2024-04-03T05:14:45.406622+0000","last_active":"2024-04-03T05:14:45.406569+0000","last_peered":"2024-04-03T05:14:45.406569+0000","last_clean":"2024-04-03T05:14:45.406569+0000","last_became_active":"2024-04-03T03:38:28.725801+0000","last_became_peered":"2024-04-03T03:38:28.725801+0000","last_unstale":"2024-04-03T05:14:45.406569+0000","last_undegraded":"2024-04-03T05:14:45.406569+0000","last_fullsized":"2024-04-03T05:14:45.406569+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:45.406366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:45.406366+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.406366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:50:06.900565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'354","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.232704+0000","last_change":"2024-04-03T05:14:49.232786+0000","last_active":"2024-04-03T05:14:49.232704+0000","last_peered":"2024-04-03T05:14:49.232704+0000","last_clean":"2024-04-03T05:14:49.232704+0000","last_became_active":"2024-04-03T03:38:30.726684+0000","last_became_peered":"2024-04-03T03:38:30.726684+0000","last_unstale":"2024-04-03T05:14:49.232704+0000","last_undegraded":"2024-04-03T05:14:49.232704+0000","last_fullsized":"2024-04-03T05:14:49.232704+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-04-03T05:14:49.232517+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-04-03T05:14:49.232517+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.232517+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:22:38.826152+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46296,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":564,"num_read_kb":1147,"num_write":428,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.862433+0000","last_change":"2024-04-03T05:14:34.862524+0000","last_active":"2024-04-03T05:14:34.862433+0000","last_peered":"2024-04-03T05:14:34.862433+0000","last_clean":"2024-04-03T05:14:34.862433+0000","last_became_active":"2024-04-03T03:38:32.745434+0000","last_became_peered":"2024-04-03T03:38:32.745434+0000","last_unstale":"2024-04-03T05:14:34.862433+0000","last_undegraded":"2024-04-03T05:14:34.862433+0000","last_fullsized":"2024-04-03T05:14:34.862433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:34.862224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:34.862224+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.862224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:19:24.722534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2400","reported_seq":4234,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.260141+0000","last_change":"2024-04-03T05:14:21.260225+0000","last_active":"2024-04-03T05:14:21.260141+0000","last_peered":"2024-04-03T05:14:21.260141+0000","last_clean":"2024-04-03T05:14:21.260141+0000","last_became_active":"2024-04-03T03:38:34.757256+0000","last_became_peered":"2024-04-03T03:38:34.757256+0000","last_unstale":"2024-04-03T05:14:21.260141+0000","last_undegraded":"2024-04-03T05:14:21.260141+0000","last_fullsized":"2024-04-03T05:14:21.260141+0000","mapping_epoch":33,"log_start":"263'2300","ondisk_log_start":"263'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2400","last_scrub_stamp":"2024-04-03T05:14:21.259923+0000","last_deep_scrub":"263'2400","last_deep_scrub_stamp":"2024-04-03T05:14:21.259923+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.259923+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":2300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:05:50.752828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5948,"num_read_kb":5953,"num_write":4769,"num_write_kb":1764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'433","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.392534+0000","last_change":"2024-04-03T05:14:37.392592+0000","last_active":"2024-04-03T05:14:37.392534+0000","last_peered":"2024-04-03T05:14:37.392534+0000","last_clean":"2024-04-03T05:14:37.392534+0000","last_became_active":"2024-04-03T03:38:26.724537+0000","last_became_peered":"2024-04-03T03:38:26.724537+0000","last_unstale":"2024-04-03T05:14:37.392534+0000","last_undegraded":"2024-04-03T05:14:37.392534+0000","last_fullsized":"2024-04-03T05:14:37.392534+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-04-03T05:14:37.392344+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-04-03T05:14:37.392344+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.392344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:19:58.926821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2269,"num_read_kb":2119,"num_write":527,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'354","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.525722+0000","last_change":"2024-04-03T05:14:20.525722+0000","last_active":"2024-04-03T05:14:20.525722+0000","last_peered":"2024-04-03T05:14:20.525722+0000","last_clean":"2024-04-03T05:14:20.525722+0000","last_became_active":"2024-04-03T03:38:57.870251+0000","last_became_peered":"2024-04-03T03:38:57.870251+0000","last_unstale":"2024-04-03T05:14:20.525722+0000","last_undegraded":"2024-04-03T05:14:20.525722+0000","last_fullsized":"2024-04-03T05:14:20.525722+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-04-03T05:14:20.525419+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-04-03T05:14:20.525419+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.525419+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:42:39.785681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":658,"num_read_kb":14924,"num_write":1423,"num_write_kb":20295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.230698+0000","last_change":"2024-04-03T05:14:51.230791+0000","last_active":"2024-04-03T05:14:51.230698+0000","last_peered":"2024-04-03T05:14:51.230698+0000","last_clean":"2024-04-03T05:14:51.230698+0000","last_became_active":"2024-04-03T03:38:28.728632+0000","last_became_peered":"2024-04-03T03:38:28.728632+0000","last_unstale":"2024-04-03T05:14:51.230698+0000","last_undegraded":"2024-04-03T05:14:51.230698+0000","last_fullsized":"2024-04-03T05:14:51.230698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:51.230369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:51.230369+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.230369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:19:39.166883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'124","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.715883+0000","last_change":"2024-04-03T05:14:31.715959+0000","last_active":"2024-04-03T05:14:31.715883+0000","last_peered":"2024-04-03T05:14:31.715883+0000","last_clean":"2024-04-03T05:14:31.715883+0000","last_became_active":"2024-04-03T03:38:30.730797+0000","last_became_peered":"2024-04-03T03:38:30.730797+0000","last_unstale":"2024-04-03T05:14:31.715883+0000","last_undegraded":"2024-04-03T05:14:31.715883+0000","last_fullsized":"2024-04-03T05:14:31.715883+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-04-03T05:14:31.715693+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-04-03T05:14:31.715693+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.715693+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:48.930887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":139,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.582186+0000","last_change":"2024-04-03T05:14:26.582301+0000","last_active":"2024-04-03T05:14:26.582186+0000","last_peered":"2024-04-03T05:14:26.582186+0000","last_clean":"2024-04-03T05:14:26.582186+0000","last_became_active":"2024-04-03T03:38:32.732994+0000","last_became_peered":"2024-04-03T03:38:32.732994+0000","last_unstale":"2024-04-03T05:14:26.582186+0000","last_undegraded":"2024-04-03T05:14:26.582186+0000","last_fullsized":"2024-04-03T05:14:26.582186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:26.581951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:26.581951+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.581951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:09:39.194706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'109","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.293430+0000","last_change":"2024-04-03T05:14:28.293503+0000","last_active":"2024-04-03T05:14:28.293430+0000","last_peered":"2024-04-03T05:14:28.293430+0000","last_clean":"2024-04-03T05:14:28.293430+0000","last_became_active":"2024-04-03T03:38:34.746126+0000","last_became_peered":"2024-04-03T03:38:34.746126+0000","last_unstale":"2024-04-03T05:14:28.293430+0000","last_undegraded":"2024-04-03T05:14:28.293430+0000","last_fullsized":"2024-04-03T05:14:28.293430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'109","last_scrub_stamp":"2024-04-03T05:14:28.293256+0000","last_deep_scrub":"263'109","last_deep_scrub_stamp":"2024-04-03T05:14:28.293256+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.293256+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:21:21.785941+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":113,"num_write":252,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'391","reported_seq":1882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.270002+0000","last_change":"2024-04-03T05:14:50.270130+0000","last_active":"2024-04-03T05:14:50.270002+0000","last_peered":"2024-04-03T05:14:50.270002+0000","last_clean":"2024-04-03T05:14:50.270002+0000","last_became_active":"2024-04-03T03:38:26.724468+0000","last_became_peered":"2024-04-03T03:38:26.724468+0000","last_unstale":"2024-04-03T05:14:50.270002+0000","last_undegraded":"2024-04-03T05:14:50.270002+0000","last_fullsized":"2024-04-03T05:14:50.270002+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'391","last_scrub_stamp":"2024-04-03T05:14:50.269781+0000","last_deep_scrub":"263'391","last_deep_scrub_stamp":"2024-04-03T05:14:50.269781+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.269781+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:54:02.827869+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1964,"num_write":459,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'331","reported_seq":1160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.574816+0000","last_change":"2024-04-03T03:38:24.733041+0000","last_active":"2024-04-03T05:14:10.574816+0000","last_peered":"2024-04-03T05:14:10.574816+0000","last_clean":"2024-04-03T05:14:10.574816+0000","last_became_active":"2024-04-03T03:38:24.732182+0000","last_became_peered":"2024-04-03T03:38:24.732182+0000","last_unstale":"2024-04-03T05:14:10.574816+0000","last_undegraded":"2024-04-03T05:14:10.574816+0000","last_fullsized":"2024-04-03T05:14:10.574816+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5549602,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":861,"num_read_kb":9858,"num_write":1206,"num_write_kb":55489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.209861+0000","last_change":"2024-04-03T05:14:53.209934+0000","last_active":"2024-04-03T05:14:53.209861+0000","last_peered":"2024-04-03T05:14:53.209861+0000","last_clean":"2024-04-03T05:14:53.209861+0000","last_became_active":"2024-04-03T03:38:28.733142+0000","last_became_peered":"2024-04-03T03:38:28.733142+0000","last_unstale":"2024-04-03T05:14:53.209861+0000","last_undegraded":"2024-04-03T05:14:53.209861+0000","last_fullsized":"2024-04-03T05:14:53.209861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:53.209652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:53.209652+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.209652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:38:46.766205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'177","reported_seq":775,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.513155+0000","last_change":"2024-04-03T05:14:21.513155+0000","last_active":"2024-04-03T05:14:21.513155+0000","last_peered":"2024-04-03T05:14:21.513155+0000","last_clean":"2024-04-03T05:14:21.513155+0000","last_became_active":"2024-04-03T03:38:30.734934+0000","last_became_peered":"2024-04-03T03:38:30.734934+0000","last_unstale":"2024-04-03T05:14:21.513155+0000","last_undegraded":"2024-04-03T05:14:21.513155+0000","last_fullsized":"2024-04-03T05:14:21.513155+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-04-03T05:14:21.512906+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-04-03T05:14:21.512906+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.512906+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:17:22.689201+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'516","reported_seq":2446,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.845032+0000","last_change":"2024-04-03T05:14:30.845096+0000","last_active":"2024-04-03T05:14:30.845032+0000","last_peered":"2024-04-03T05:14:30.845032+0000","last_clean":"2024-04-03T05:14:30.845032+0000","last_became_active":"2024-04-03T03:38:32.748836+0000","last_became_peered":"2024-04-03T03:38:32.748836+0000","last_unstale":"2024-04-03T05:14:30.845032+0000","last_undegraded":"2024-04-03T05:14:30.845032+0000","last_fullsized":"2024-04-03T05:14:30.845032+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'516","last_scrub_stamp":"2024-04-03T05:14:30.844834+0000","last_deep_scrub":"263'516","last_deep_scrub_stamp":"2024-04-03T05:14:30.844834+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.844834+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:48.358869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'105","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.496669+0000","last_change":"2024-04-03T05:14:21.496732+0000","last_active":"2024-04-03T05:14:21.496669+0000","last_peered":"2024-04-03T05:14:21.496669+0000","last_clean":"2024-04-03T05:14:21.496669+0000","last_became_active":"2024-04-03T03:38:34.940390+0000","last_became_peered":"2024-04-03T03:38:34.940390+0000","last_unstale":"2024-04-03T05:14:21.496669+0000","last_undegraded":"2024-04-03T05:14:21.496669+0000","last_fullsized":"2024-04-03T05:14:21.496669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-04-03T05:14:21.496472+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-04-03T05:14:21.496472+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.496472+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:47.773784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'571","reported_seq":2257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.272649+0000","last_change":"2024-04-03T05:14:50.272724+0000","last_active":"2024-04-03T05:14:50.272649+0000","last_peered":"2024-04-03T05:14:50.272649+0000","last_clean":"2024-04-03T05:14:50.272649+0000","last_became_active":"2024-04-03T03:38:26.717394+0000","last_became_peered":"2024-04-03T03:38:26.717394+0000","last_unstale":"2024-04-03T05:14:50.272649+0000","last_undegraded":"2024-04-03T05:14:50.272649+0000","last_fullsized":"2024-04-03T05:14:50.272649+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'571","last_scrub_stamp":"2024-04-03T05:14:50.272451+0000","last_deep_scrub":"263'571","last_deep_scrub_stamp":"2024-04-03T05:14:50.272451+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.272451+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:44:31.806317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2983,"num_read_kb":2733,"num_write":743,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1913,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'339","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.146618+0000","last_change":"2024-04-03T05:14:45.146719+0000","last_active":"2024-04-03T05:14:45.146618+0000","last_peered":"2024-04-03T05:14:45.146618+0000","last_clean":"2024-04-03T05:14:45.146618+0000","last_became_active":"2024-04-03T03:38:24.761913+0000","last_became_peered":"2024-04-03T03:38:24.761913+0000","last_unstale":"2024-04-03T05:14:45.146618+0000","last_undegraded":"2024-04-03T05:14:45.146618+0000","last_fullsized":"2024-04-03T05:14:45.146618+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-04-03T05:14:45.146412+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-04-03T05:14:45.146412+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.146412+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:10:44.076698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":83387,"num_write":1167,"num_write_kb":33117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.343101+0000","last_change":"2024-04-03T05:14:47.343152+0000","last_active":"2024-04-03T05:14:47.343101+0000","last_peered":"2024-04-03T05:14:47.343101+0000","last_clean":"2024-04-03T05:14:47.343101+0000","last_became_active":"2024-04-03T03:38:28.730711+0000","last_became_peered":"2024-04-03T03:38:28.730711+0000","last_unstale":"2024-04-03T05:14:47.343101+0000","last_undegraded":"2024-04-03T05:14:47.343101+0000","last_fullsized":"2024-04-03T05:14:47.343101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:47.342904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:47.342904+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.342904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:15:43.463095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'306","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.853179+0000","last_change":"2024-04-03T05:14:36.853257+0000","last_active":"2024-04-03T05:14:36.853179+0000","last_peered":"2024-04-03T05:14:36.853179+0000","last_clean":"2024-04-03T05:14:36.853179+0000","last_became_active":"2024-04-03T03:38:30.824397+0000","last_became_peered":"2024-04-03T03:38:30.824397+0000","last_unstale":"2024-04-03T05:14:36.853179+0000","last_undegraded":"2024-04-03T05:14:36.853179+0000","last_fullsized":"2024-04-03T05:14:36.853179+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-04-03T05:14:36.852984+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-04-03T05:14:36.852984+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.852984+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:41:01.357277+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45592,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":493,"num_read_kb":1098,"num_write":394,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'553","reported_seq":4250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.189324+0000","last_change":"2024-04-03T05:14:36.189387+0000","last_active":"2024-04-03T05:14:36.189324+0000","last_peered":"2024-04-03T05:14:36.189324+0000","last_clean":"2024-04-03T05:14:36.189324+0000","last_became_active":"2024-04-03T03:38:32.743645+0000","last_became_peered":"2024-04-03T03:38:32.743645+0000","last_unstale":"2024-04-03T05:14:36.189324+0000","last_undegraded":"2024-04-03T05:14:36.189324+0000","last_fullsized":"2024-04-03T05:14:36.189324+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'553","last_scrub_stamp":"2024-04-03T05:14:36.189129+0000","last_deep_scrub":"263'553","last_deep_scrub_stamp":"2024-04-03T05:14:36.189129+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.189129+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:07:23.200679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1050","reported_seq":2437,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.456675+0000","last_change":"2024-04-03T05:14:39.456794+0000","last_active":"2024-04-03T05:14:39.456675+0000","last_peered":"2024-04-03T05:14:39.456675+0000","last_clean":"2024-04-03T05:14:39.456675+0000","last_became_active":"2024-04-03T03:38:26.726039+0000","last_became_peered":"2024-04-03T03:38:26.726039+0000","last_unstale":"2024-04-03T05:14:39.456675+0000","last_undegraded":"2024-04-03T05:14:39.456675+0000","last_fullsized":"2024-04-03T05:14:39.456675+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1050","last_scrub_stamp":"2024-04-03T05:14:39.456345+0000","last_deep_scrub":"263'1050","last_deep_scrub_stamp":"2024-04-03T05:14:39.456345+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.456345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:03:32.110634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4374,"num_read_kb":3788,"num_write":1482,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'382","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.829428+0000","last_change":"2024-04-03T05:14:52.829537+0000","last_active":"2024-04-03T05:14:52.829428+0000","last_peered":"2024-04-03T05:14:52.829428+0000","last_clean":"2024-04-03T05:14:52.829428+0000","last_became_active":"2024-04-03T03:38:24.752543+0000","last_became_peered":"2024-04-03T03:38:24.752543+0000","last_unstale":"2024-04-03T05:14:52.829428+0000","last_undegraded":"2024-04-03T05:14:52.829428+0000","last_fullsized":"2024-04-03T05:14:52.829428+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-04-03T05:14:52.829207+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-04-03T05:14:52.829207+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.829207+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:37:57.191995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":24937,"num_write":1159,"num_write_kb":21782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.893372+0000","last_change":"2024-04-03T05:14:43.893423+0000","last_active":"2024-04-03T05:14:43.893372+0000","last_peered":"2024-04-03T05:14:43.893372+0000","last_clean":"2024-04-03T05:14:43.893372+0000","last_became_active":"2024-04-03T03:38:28.737738+0000","last_became_peered":"2024-04-03T03:38:28.737738+0000","last_unstale":"2024-04-03T05:14:43.893372+0000","last_undegraded":"2024-04-03T05:14:43.893372+0000","last_fullsized":"2024-04-03T05:14:43.893372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:43.893182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:43.893182+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.893182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:52.083340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'430","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.347824+0000","last_change":"2024-04-03T05:14:32.347919+0000","last_active":"2024-04-03T05:14:32.347824+0000","last_peered":"2024-04-03T05:14:32.347824+0000","last_clean":"2024-04-03T05:14:32.347824+0000","last_became_active":"2024-04-03T03:38:30.822389+0000","last_became_peered":"2024-04-03T03:38:30.822389+0000","last_unstale":"2024-04-03T05:14:32.347824+0000","last_undegraded":"2024-04-03T05:14:32.347824+0000","last_fullsized":"2024-04-03T05:14:32.347824+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'430","last_scrub_stamp":"2024-04-03T05:14:32.347631+0000","last_deep_scrub":"263'430","last_deep_scrub_stamp":"2024-04-03T05:14:32.347631+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.347631+0000","objects_scrubbed":10,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:40:47.707333+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42966,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":673,"num_read_kb":1254,"num_write":506,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.536334+0000","last_change":"2024-04-03T05:14:43.536385+0000","last_active":"2024-04-03T05:14:43.536334+0000","last_peered":"2024-04-03T05:14:43.536334+0000","last_clean":"2024-04-03T05:14:43.536334+0000","last_became_active":"2024-04-03T03:38:32.730901+0000","last_became_peered":"2024-04-03T03:38:32.730901+0000","last_unstale":"2024-04-03T05:14:43.536334+0000","last_undegraded":"2024-04-03T05:14:43.536334+0000","last_fullsized":"2024-04-03T05:14:43.536334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:43.536127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:43.536127+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.536127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:06:34.309013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'542","reported_seq":1381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.293225+0000","last_change":"2024-04-03T05:14:25.293225+0000","last_active":"2024-04-03T05:14:25.293225+0000","last_peered":"2024-04-03T05:14:25.293225+0000","last_clean":"2024-04-03T05:14:25.293225+0000","last_became_active":"2024-04-03T03:38:34.754300+0000","last_became_peered":"2024-04-03T03:38:34.754300+0000","last_unstale":"2024-04-03T05:14:25.293225+0000","last_undegraded":"2024-04-03T05:14:25.293225+0000","last_fullsized":"2024-04-03T05:14:25.293225+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'542","last_scrub_stamp":"2024-04-03T05:14:25.292797+0000","last_deep_scrub":"263'542","last_deep_scrub_stamp":"2024-04-03T05:14:25.292797+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.292797+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:23:55.184793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1265,"num_read_kb":1263,"num_write":1135,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'845","reported_seq":2451,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.664803+0000","last_change":"2024-04-03T05:14:41.664891+0000","last_active":"2024-04-03T05:14:41.664803+0000","last_peered":"2024-04-03T05:14:41.664803+0000","last_clean":"2024-04-03T05:14:41.664803+0000","last_became_active":"2024-04-03T03:38:26.742328+0000","last_became_peered":"2024-04-03T03:38:26.742328+0000","last_unstale":"2024-04-03T05:14:41.664803+0000","last_undegraded":"2024-04-03T05:14:41.664803+0000","last_fullsized":"2024-04-03T05:14:41.664803+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'845","last_scrub_stamp":"2024-04-03T05:14:41.664599+0000","last_deep_scrub":"263'845","last_deep_scrub_stamp":"2024-04-03T05:14:41.664599+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.664599+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:14:36.522629+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3790,"num_read_kb":3360,"num_write":1145,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1196,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'387","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.579950+0000","last_change":"2024-04-03T05:14:26.580048+0000","last_active":"2024-04-03T05:14:26.579950+0000","last_peered":"2024-04-03T05:14:26.579950+0000","last_clean":"2024-04-03T05:14:26.579950+0000","last_became_active":"2024-04-03T03:38:58.348120+0000","last_became_peered":"2024-04-03T03:38:58.348120+0000","last_unstale":"2024-04-03T05:14:26.579950+0000","last_undegraded":"2024-04-03T05:14:26.579950+0000","last_fullsized":"2024-04-03T05:14:26.579950+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'387","last_scrub_stamp":"2024-04-03T05:14:26.579740+0000","last_deep_scrub":"263'387","last_deep_scrub_stamp":"2024-04-03T05:14:26.579740+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.579740+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:30:30.667472+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491014,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":692,"num_read_kb":8001,"num_write":1323,"num_write_kb":23217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.472962+0000","last_change":"2024-04-03T05:14:33.473025+0000","last_active":"2024-04-03T05:14:33.472962+0000","last_peered":"2024-04-03T05:14:33.472962+0000","last_clean":"2024-04-03T05:14:33.472962+0000","last_became_active":"2024-04-03T03:38:28.729832+0000","last_became_peered":"2024-04-03T03:38:28.729832+0000","last_unstale":"2024-04-03T05:14:33.472962+0000","last_undegraded":"2024-04-03T05:14:33.472962+0000","last_fullsized":"2024-04-03T05:14:33.472962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.472762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.472762+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.472762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:14:38.186211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'312","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.057576+0000","last_change":"2024-04-03T03:38:30.721619+0000","last_active":"2024-04-03T05:14:08.057576+0000","last_peered":"2024-04-03T05:14:08.057576+0000","last_clean":"2024-04-03T05:14:08.057576+0000","last_became_active":"2024-04-03T03:38:30.720884+0000","last_became_peered":"2024-04-03T03:38:30.720884+0000","last_unstale":"2024-04-03T05:14:08.057576+0000","last_undegraded":"2024-04-03T05:14:08.057576+0000","last_fullsized":"2024-04-03T05:14:08.057576+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1184,"num_write":408,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.139944+0000","last_change":"2024-04-03T05:14:37.139999+0000","last_active":"2024-04-03T05:14:37.139944+0000","last_peered":"2024-04-03T05:14:37.139944+0000","last_clean":"2024-04-03T05:14:37.139944+0000","last_became_active":"2024-04-03T03:38:32.741770+0000","last_became_peered":"2024-04-03T03:38:32.741770+0000","last_unstale":"2024-04-03T05:14:37.139944+0000","last_undegraded":"2024-04-03T05:14:37.139944+0000","last_fullsized":"2024-04-03T05:14:37.139944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:37.139752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:37.139752+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.139752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:00:02.448643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'86","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.314643+0000","last_change":"2024-04-03T05:14:32.314643+0000","last_active":"2024-04-03T05:14:32.314643+0000","last_peered":"2024-04-03T05:14:32.314643+0000","last_clean":"2024-04-03T05:14:32.314643+0000","last_became_active":"2024-04-03T03:38:34.733896+0000","last_became_peered":"2024-04-03T03:38:34.733896+0000","last_unstale":"2024-04-03T05:14:32.314643+0000","last_undegraded":"2024-04-03T05:14:32.314643+0000","last_fullsized":"2024-04-03T05:14:32.314643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-04-03T05:14:32.314378+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-04-03T05:14:32.314378+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.314378+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:45.957383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'718","reported_seq":2139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.222593+0000","last_change":"2024-04-03T05:14:37.222723+0000","last_active":"2024-04-03T05:14:37.222593+0000","last_peered":"2024-04-03T05:14:37.222593+0000","last_clean":"2024-04-03T05:14:37.222593+0000","last_became_active":"2024-04-03T03:38:26.734518+0000","last_became_peered":"2024-04-03T03:38:26.734518+0000","last_unstale":"2024-04-03T05:14:37.222593+0000","last_undegraded":"2024-04-03T05:14:37.222593+0000","last_fullsized":"2024-04-03T05:14:37.222593+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'718","last_scrub_stamp":"2024-04-03T05:14:37.222276+0000","last_deep_scrub":"263'718","last_deep_scrub_stamp":"2024-04-03T05:14:37.222276+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.222276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:10:21.823195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3204,"num_read_kb":2862,"num_write":964,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'359","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.812037+0000","last_change":"2024-04-03T05:14:48.812191+0000","last_active":"2024-04-03T05:14:48.812037+0000","last_peered":"2024-04-03T05:14:48.812037+0000","last_clean":"2024-04-03T05:14:48.812037+0000","last_became_active":"2024-04-03T03:38:24.758401+0000","last_became_peered":"2024-04-03T03:38:24.758401+0000","last_unstale":"2024-04-03T05:14:48.812037+0000","last_undegraded":"2024-04-03T05:14:48.812037+0000","last_fullsized":"2024-04-03T05:14:48.812037+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-04-03T05:14:48.811767+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-04-03T05:14:48.811767+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.811767+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:12:42.853492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":692,"num_read_kb":12991,"num_write":1287,"num_write_kb":25567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.469176+0000","last_change":"2024-04-03T05:14:31.469228+0000","last_active":"2024-04-03T05:14:31.469176+0000","last_peered":"2024-04-03T05:14:31.469176+0000","last_clean":"2024-04-03T05:14:31.469176+0000","last_became_active":"2024-04-03T03:38:28.731257+0000","last_became_peered":"2024-04-03T03:38:28.731257+0000","last_unstale":"2024-04-03T05:14:31.469176+0000","last_undegraded":"2024-04-03T05:14:31.469176+0000","last_fullsized":"2024-04-03T05:14:31.469176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.468968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.468968+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.468968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:53:21.461796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'348","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.820289+0000","last_change":"2024-04-03T05:14:49.820410+0000","last_active":"2024-04-03T05:14:49.820289+0000","last_peered":"2024-04-03T05:14:49.820289+0000","last_clean":"2024-04-03T05:14:49.820289+0000","last_became_active":"2024-04-03T03:38:30.732417+0000","last_became_peered":"2024-04-03T03:38:30.732417+0000","last_unstale":"2024-04-03T05:14:49.820289+0000","last_undegraded":"2024-04-03T05:14:49.820289+0000","last_fullsized":"2024-04-03T05:14:49.820289+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-04-03T05:14:49.820104+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-04-03T05:14:49.820104+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.820104+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:54:13.985852+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50822,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":1115,"num_write":422,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'545","reported_seq":3047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.179716+0000","last_change":"2024-04-03T05:14:34.179780+0000","last_active":"2024-04-03T05:14:34.179716+0000","last_peered":"2024-04-03T05:14:34.179716+0000","last_clean":"2024-04-03T05:14:34.179716+0000","last_became_active":"2024-04-03T03:38:32.746029+0000","last_became_peered":"2024-04-03T03:38:32.746029+0000","last_unstale":"2024-04-03T05:14:34.179716+0000","last_undegraded":"2024-04-03T05:14:34.179716+0000","last_fullsized":"2024-04-03T05:14:34.179716+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'545","last_scrub_stamp":"2024-04-03T05:14:34.179529+0000","last_deep_scrub":"263'545","last_deep_scrub_stamp":"2024-04-03T05:14:34.179529+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.179529+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:50:40.090221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'95","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.300483+0000","last_change":"2024-04-03T05:14:29.300618+0000","last_active":"2024-04-03T05:14:29.300483+0000","last_peered":"2024-04-03T05:14:29.300483+0000","last_clean":"2024-04-03T05:14:29.300483+0000","last_became_active":"2024-04-03T03:38:34.741505+0000","last_became_peered":"2024-04-03T03:38:34.741505+0000","last_unstale":"2024-04-03T05:14:29.300483+0000","last_undegraded":"2024-04-03T05:14:29.300483+0000","last_fullsized":"2024-04-03T05:14:29.300483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-04-03T05:14:29.300259+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-04-03T05:14:29.300259+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.300259+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:41:52.092733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'446","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.245453+0000","last_change":"2024-04-03T05:14:42.245529+0000","last_active":"2024-04-03T05:14:42.245453+0000","last_peered":"2024-04-03T05:14:42.245453+0000","last_clean":"2024-04-03T05:14:42.245453+0000","last_became_active":"2024-04-03T03:38:26.731734+0000","last_became_peered":"2024-04-03T03:38:26.731734+0000","last_unstale":"2024-04-03T05:14:42.245453+0000","last_undegraded":"2024-04-03T05:14:42.245453+0000","last_fullsized":"2024-04-03T05:14:42.245453+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-04-03T05:14:42.245239+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-04-03T05:14:42.245239+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.245239+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:20:17.315413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2428,"num_write":531,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2066,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'311","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.352659+0000","last_change":"2024-04-03T05:14:52.352771+0000","last_active":"2024-04-03T05:14:52.352659+0000","last_peered":"2024-04-03T05:14:52.352659+0000","last_clean":"2024-04-03T05:14:52.352659+0000","last_became_active":"2024-04-03T03:38:24.748646+0000","last_became_peered":"2024-04-03T03:38:24.748646+0000","last_unstale":"2024-04-03T05:14:52.352659+0000","last_undegraded":"2024-04-03T05:14:52.352659+0000","last_fullsized":"2024-04-03T05:14:52.352659+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-04-03T05:14:52.352465+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-04-03T05:14:52.352465+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.352465+0000","objects_scrubbed":8,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:43:28.678637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262207,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":9924,"num_write":1193,"num_write_kb":21025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"263'6","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.500813+0000","last_change":"2024-04-03T05:14:29.500877+0000","last_active":"2024-04-03T05:14:29.500813+0000","last_peered":"2024-04-03T05:14:29.500813+0000","last_clean":"2024-04-03T05:14:29.500813+0000","last_became_active":"2024-04-03T03:38:28.733096+0000","last_became_peered":"2024-04-03T03:38:28.733096+0000","last_unstale":"2024-04-03T05:14:29.500813+0000","last_undegraded":"2024-04-03T05:14:29.500813+0000","last_fullsized":"2024-04-03T05:14:29.500813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:29.500623+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:29.500623+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.500623+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:45:34.140345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":788,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'509","reported_seq":1200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.207079+0000","last_change":"2024-04-03T05:14:53.207220+0000","last_active":"2024-04-03T05:14:53.207079+0000","last_peered":"2024-04-03T05:14:53.207079+0000","last_clean":"2024-04-03T05:14:53.207079+0000","last_became_active":"2024-04-03T03:38:30.729624+0000","last_became_peered":"2024-04-03T03:38:30.729624+0000","last_unstale":"2024-04-03T05:14:53.207079+0000","last_undegraded":"2024-04-03T05:14:53.207079+0000","last_fullsized":"2024-04-03T05:14:53.207079+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-04-03T05:14:53.206869+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-04-03T05:14:53.206869+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.206869+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:36:09.340149+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99740,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":863,"num_read_kb":2054,"num_write":690,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.563232+0000","last_change":"2024-04-03T05:14:18.563335+0000","last_active":"2024-04-03T05:14:18.563232+0000","last_peered":"2024-04-03T05:14:18.563232+0000","last_clean":"2024-04-03T05:14:18.563232+0000","last_became_active":"2024-04-03T03:38:32.746634+0000","last_became_peered":"2024-04-03T03:38:32.746634+0000","last_unstale":"2024-04-03T05:14:18.563232+0000","last_undegraded":"2024-04-03T05:14:18.563232+0000","last_fullsized":"2024-04-03T05:14:18.563232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:18.563005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:18.563005+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.563005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:17.147799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'92","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.597309+0000","last_change":"2024-04-03T05:14:26.597470+0000","last_active":"2024-04-03T05:14:26.597309+0000","last_peered":"2024-04-03T05:14:26.597309+0000","last_clean":"2024-04-03T05:14:26.597309+0000","last_became_active":"2024-04-03T03:38:34.730714+0000","last_became_peered":"2024-04-03T03:38:34.730714+0000","last_unstale":"2024-04-03T05:14:26.597309+0000","last_undegraded":"2024-04-03T05:14:26.597309+0000","last_fullsized":"2024-04-03T05:14:26.597309+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-04-03T05:14:26.597062+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-04-03T05:14:26.597062+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.597062+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:36.950593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":214,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'708","reported_seq":2251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.445488+0000","last_change":"2024-04-03T05:14:19.445558+0000","last_active":"2024-04-03T05:14:19.445488+0000","last_peered":"2024-04-03T05:14:19.445488+0000","last_clean":"2024-04-03T05:14:19.445488+0000","last_became_active":"2024-04-03T03:39:58.684099+0000","last_became_peered":"2024-04-03T03:39:58.684099+0000","last_unstale":"2024-04-03T05:14:19.445488+0000","last_undegraded":"2024-04-03T05:14:19.445488+0000","last_fullsized":"2024-04-03T05:14:19.445488+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'708","last_scrub_stamp":"2024-04-03T05:14:19.445286+0000","last_deep_scrub":"263'708","last_deep_scrub_stamp":"2024-04-03T05:14:19.445286+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.445286+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:37:12.157533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3233,"num_read_kb":2920,"num_write":926,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'339","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.492469+0000","last_change":"2024-04-03T05:14:22.492712+0000","last_active":"2024-04-03T05:14:22.492469+0000","last_peered":"2024-04-03T05:14:22.492469+0000","last_clean":"2024-04-03T05:14:22.492469+0000","last_became_active":"2024-04-03T03:38:57.880334+0000","last_became_peered":"2024-04-03T03:38:57.880334+0000","last_unstale":"2024-04-03T05:14:22.492469+0000","last_undegraded":"2024-04-03T05:14:22.492469+0000","last_fullsized":"2024-04-03T05:14:22.492469+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-04-03T05:14:22.492212+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-04-03T05:14:22.492212+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.492212+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:58:23.552426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263916,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":538,"num_read_kb":83385,"num_write":1176,"num_write_kb":48172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.536505+0000","last_change":"2024-04-03T05:14:25.536556+0000","last_active":"2024-04-03T05:14:25.536505+0000","last_peered":"2024-04-03T05:14:25.536505+0000","last_clean":"2024-04-03T05:14:25.536505+0000","last_became_active":"2024-04-03T03:38:28.735217+0000","last_became_peered":"2024-04-03T03:38:28.735217+0000","last_unstale":"2024-04-03T05:14:25.536505+0000","last_undegraded":"2024-04-03T05:14:25.536505+0000","last_fullsized":"2024-04-03T05:14:25.536505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:25.536310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:25.536310+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.536310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:06:47.226136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'354","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.596048+0000","last_change":"2024-04-03T05:14:48.596129+0000","last_active":"2024-04-03T05:14:48.596048+0000","last_peered":"2024-04-03T05:14:48.596048+0000","last_clean":"2024-04-03T05:14:48.596048+0000","last_became_active":"2024-04-03T03:38:30.716983+0000","last_became_peered":"2024-04-03T03:38:30.716983+0000","last_unstale":"2024-04-03T05:14:48.596048+0000","last_undegraded":"2024-04-03T05:14:48.596048+0000","last_fullsized":"2024-04-03T05:14:48.596048+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-04-03T05:14:48.595852+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-04-03T05:14:48.595852+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.595852+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:18:19.906164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56711,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":610,"num_read_kb":1386,"num_write":534,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.281384+0000","last_change":"2024-04-03T05:14:38.281435+0000","last_active":"2024-04-03T05:14:38.281384+0000","last_peered":"2024-04-03T05:14:38.281384+0000","last_clean":"2024-04-03T05:14:38.281384+0000","last_became_active":"2024-04-03T03:38:32.737619+0000","last_became_peered":"2024-04-03T03:38:32.737619+0000","last_unstale":"2024-04-03T05:14:38.281384+0000","last_undegraded":"2024-04-03T05:14:38.281384+0000","last_fullsized":"2024-04-03T05:14:38.281384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:38.281203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:38.281203+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.281203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:28:38.298700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'105","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.123126+0000","last_change":"2024-04-03T05:14:29.123126+0000","last_active":"2024-04-03T05:14:29.123126+0000","last_peered":"2024-04-03T05:14:29.123126+0000","last_clean":"2024-04-03T05:14:29.123126+0000","last_became_active":"2024-04-03T03:38:34.754907+0000","last_became_peered":"2024-04-03T03:38:34.754907+0000","last_unstale":"2024-04-03T05:14:29.123126+0000","last_undegraded":"2024-04-03T05:14:29.123126+0000","last_fullsized":"2024-04-03T05:14:29.123126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-04-03T05:14:29.122845+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-04-03T05:14:29.122845+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.122845+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:57.447948+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":237,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'876","reported_seq":2631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:12:58.659013+0000","last_change":"2024-04-03T03:38:26.741422+0000","last_active":"2024-04-03T05:12:58.659013+0000","last_peered":"2024-04-03T05:12:58.659013+0000","last_clean":"2024-04-03T05:12:58.659013+0000","last_became_active":"2024-04-03T03:38:26.740674+0000","last_became_peered":"2024-04-03T03:38:26.740674+0000","last_unstale":"2024-04-03T05:12:58.659013+0000","last_undegraded":"2024-04-03T05:12:58.659013+0000","last_fullsized":"2024-04-03T05:12:58.659013+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4230,"num_read_kb":3805,"num_write":1201,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'306","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.527258+0000","last_change":"2024-04-03T05:14:24.527258+0000","last_active":"2024-04-03T05:14:24.527258+0000","last_peered":"2024-04-03T05:14:24.527258+0000","last_clean":"2024-04-03T05:14:24.527258+0000","last_became_active":"2024-04-03T03:38:58.344044+0000","last_became_peered":"2024-04-03T03:38:58.344044+0000","last_unstale":"2024-04-03T05:14:24.527258+0000","last_undegraded":"2024-04-03T05:14:24.527258+0000","last_fullsized":"2024-04-03T05:14:24.527258+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-04-03T05:14:24.526901+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-04-03T05:14:24.526901+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.526901+0000","objects_scrubbed":14,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:03.910729+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6735876,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":460,"num_read_kb":45119,"num_write":1136,"num_write_kb":60620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.619699+0000","last_change":"2024-04-03T05:14:31.619805+0000","last_active":"2024-04-03T05:14:31.619699+0000","last_peered":"2024-04-03T05:14:31.619699+0000","last_clean":"2024-04-03T05:14:31.619699+0000","last_became_active":"2024-04-03T03:38:28.715394+0000","last_became_peered":"2024-04-03T03:38:28.715394+0000","last_unstale":"2024-04-03T05:14:31.619699+0000","last_undegraded":"2024-04-03T05:14:31.619699+0000","last_fullsized":"2024-04-03T05:14:31.619699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.619467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.619467+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.619467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:50:24.136880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'342","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.542366+0000","last_change":"2024-04-03T05:14:23.542474+0000","last_active":"2024-04-03T05:14:23.542366+0000","last_peered":"2024-04-03T05:14:23.542366+0000","last_clean":"2024-04-03T05:14:23.542366+0000","last_became_active":"2024-04-03T03:38:30.733001+0000","last_became_peered":"2024-04-03T03:38:30.733001+0000","last_unstale":"2024-04-03T05:14:23.542366+0000","last_undegraded":"2024-04-03T05:14:23.542366+0000","last_fullsized":"2024-04-03T05:14:23.542366+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-04-03T05:14:23.542156+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-04-03T05:14:23.542156+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.542156+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:43:59.797131+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1151,"num_write":432,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'500","reported_seq":2377,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.539449+0000","last_change":"2024-04-03T05:14:19.539513+0000","last_active":"2024-04-03T05:14:19.539449+0000","last_peered":"2024-04-03T05:14:19.539449+0000","last_clean":"2024-04-03T05:14:19.539449+0000","last_became_active":"2024-04-03T03:38:32.740883+0000","last_became_peered":"2024-04-03T03:38:32.740883+0000","last_unstale":"2024-04-03T05:14:19.539449+0000","last_undegraded":"2024-04-03T05:14:19.539449+0000","last_fullsized":"2024-04-03T05:14:19.539449+0000","mapping_epoch":31,"log_start":"258'400","ondisk_log_start":"258'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'500","last_scrub_stamp":"2024-04-03T05:14:19.539252+0000","last_deep_scrub":"263'500","last_deep_scrub_stamp":"2024-04-03T05:14:19.539252+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.539252+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:02:16.078882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'93","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.635841+0000","last_change":"2024-04-03T05:14:25.635841+0000","last_active":"2024-04-03T05:14:25.635841+0000","last_peered":"2024-04-03T05:14:25.635841+0000","last_clean":"2024-04-03T05:14:25.635841+0000","last_became_active":"2024-04-03T03:38:34.748128+0000","last_became_peered":"2024-04-03T03:38:34.748128+0000","last_unstale":"2024-04-03T05:14:25.635841+0000","last_undegraded":"2024-04-03T05:14:25.635841+0000","last_fullsized":"2024-04-03T05:14:25.635841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'93","last_scrub_stamp":"2024-04-03T05:14:25.635545+0000","last_deep_scrub":"263'93","last_deep_scrub_stamp":"2024-04-03T05:14:25.635545+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.635545+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:51:27.121684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":229,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'413","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.580039+0000","last_change":"2024-04-03T05:14:47.580112+0000","last_active":"2024-04-03T05:14:47.580039+0000","last_peered":"2024-04-03T05:14:47.580039+0000","last_clean":"2024-04-03T05:14:47.580039+0000","last_became_active":"2024-04-03T03:38:26.742254+0000","last_became_peered":"2024-04-03T03:38:26.742254+0000","last_unstale":"2024-04-03T05:14:47.580039+0000","last_undegraded":"2024-04-03T05:14:47.580039+0000","last_fullsized":"2024-04-03T05:14:47.580039+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-04-03T05:14:47.579767+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-04-03T05:14:47.579767+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.579767+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:49:16.724164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2115,"num_read_kb":2003,"num_write":485,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'358","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.639750+0000","last_change":"2024-04-03T05:14:50.639850+0000","last_active":"2024-04-03T05:14:50.639750+0000","last_peered":"2024-04-03T05:14:50.639750+0000","last_clean":"2024-04-03T05:14:50.639750+0000","last_became_active":"2024-04-03T03:38:24.710396+0000","last_became_peered":"2024-04-03T03:38:24.710396+0000","last_unstale":"2024-04-03T05:14:50.639750+0000","last_undegraded":"2024-04-03T05:14:50.639750+0000","last_fullsized":"2024-04-03T05:14:50.639750+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-04-03T05:14:50.639528+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-04-03T05:14:50.639528+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.639528+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:02:38.795244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288129,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":39636,"num_write":1279,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.348269+0000","last_change":"2024-04-03T05:14:51.348358+0000","last_active":"2024-04-03T05:14:51.348269+0000","last_peered":"2024-04-03T05:14:51.348269+0000","last_clean":"2024-04-03T05:14:51.348269+0000","last_became_active":"2024-04-03T03:38:28.734894+0000","last_became_peered":"2024-04-03T03:38:28.734894+0000","last_unstale":"2024-04-03T05:14:51.348269+0000","last_undegraded":"2024-04-03T05:14:51.348269+0000","last_fullsized":"2024-04-03T05:14:51.348269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:51.348059+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:51.348059+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.348059+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:54:56.812110+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":632,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'131","reported_seq":706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.261829+0000","last_change":"2024-04-03T05:14:40.261912+0000","last_active":"2024-04-03T05:14:40.261829+0000","last_peered":"2024-04-03T05:14:40.261829+0000","last_clean":"2024-04-03T05:14:40.261829+0000","last_became_active":"2024-04-03T03:38:30.821224+0000","last_became_peered":"2024-04-03T03:38:30.821224+0000","last_unstale":"2024-04-03T05:14:40.261829+0000","last_undegraded":"2024-04-03T05:14:40.261829+0000","last_fullsized":"2024-04-03T05:14:40.261829+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-04-03T05:14:40.261652+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-04-03T05:14:40.261652+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.261652+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:52:43.682995+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'526","reported_seq":2482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.280786+0000","last_change":"2024-04-03T05:14:30.280848+0000","last_active":"2024-04-03T05:14:30.280786+0000","last_peered":"2024-04-03T05:14:30.280786+0000","last_clean":"2024-04-03T05:14:30.280786+0000","last_became_active":"2024-04-03T03:38:32.747078+0000","last_became_peered":"2024-04-03T03:38:32.747078+0000","last_unstale":"2024-04-03T05:14:30.280786+0000","last_undegraded":"2024-04-03T05:14:30.280786+0000","last_fullsized":"2024-04-03T05:14:30.280786+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'526","last_scrub_stamp":"2024-04-03T05:14:30.280590+0000","last_deep_scrub":"263'526","last_deep_scrub_stamp":"2024-04-03T05:14:30.280590+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.280590+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:41.204577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'100","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.533167+0000","last_change":"2024-04-03T05:14:23.533167+0000","last_active":"2024-04-03T05:14:23.533167+0000","last_peered":"2024-04-03T05:14:23.533167+0000","last_clean":"2024-04-03T05:14:23.533167+0000","last_became_active":"2024-04-03T03:38:34.739554+0000","last_became_peered":"2024-04-03T03:38:34.739554+0000","last_unstale":"2024-04-03T05:14:23.533167+0000","last_undegraded":"2024-04-03T05:14:23.533167+0000","last_fullsized":"2024-04-03T05:14:23.533167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'100","last_scrub_stamp":"2024-04-03T05:14:23.532876+0000","last_deep_scrub":"263'100","last_deep_scrub_stamp":"2024-04-03T05:14:23.532876+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.532876+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:47.184410+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'348","reported_seq":1762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.611008+0000","last_change":"2024-04-03T05:14:30.611179+0000","last_active":"2024-04-03T05:14:30.611008+0000","last_peered":"2024-04-03T05:14:30.611008+0000","last_clean":"2024-04-03T05:14:30.611008+0000","last_became_active":"2024-04-03T03:38:26.729241+0000","last_became_peered":"2024-04-03T03:38:26.729241+0000","last_unstale":"2024-04-03T05:14:30.611008+0000","last_undegraded":"2024-04-03T05:14:30.611008+0000","last_fullsized":"2024-04-03T05:14:30.611008+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-04-03T05:14:30.610796+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-04-03T05:14:30.610796+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.610796+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:09:37.419874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1840,"num_read_kb":1751,"num_write":396,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'307","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.544844+0000","last_change":"2024-04-03T03:38:24.715501+0000","last_active":"2024-04-03T05:14:10.544844+0000","last_peered":"2024-04-03T05:14:10.544844+0000","last_clean":"2024-04-03T05:14:10.544844+0000","last_became_active":"2024-04-03T03:38:24.709105+0000","last_became_peered":"2024-04-03T03:38:24.709105+0000","last_unstale":"2024-04-03T05:14:10.544844+0000","last_undegraded":"2024-04-03T05:14:10.544844+0000","last_fullsized":"2024-04-03T05:14:10.544844+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2161470,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":67615,"num_write":1075,"num_write_kb":19160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.615602+0000","last_change":"2024-04-03T05:14:46.615729+0000","last_active":"2024-04-03T05:14:46.615602+0000","last_peered":"2024-04-03T05:14:46.615602+0000","last_clean":"2024-04-03T05:14:46.615602+0000","last_became_active":"2024-04-03T03:38:28.729835+0000","last_became_peered":"2024-04-03T03:38:28.729835+0000","last_unstale":"2024-04-03T05:14:46.615602+0000","last_undegraded":"2024-04-03T05:14:46.615602+0000","last_fullsized":"2024-04-03T05:14:46.615602+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:46.615351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:46.615351+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.615351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:23:42.065678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'519","reported_seq":1189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.380435+0000","last_change":"2024-04-03T05:14:33.380521+0000","last_active":"2024-04-03T05:14:33.380435+0000","last_peered":"2024-04-03T05:14:33.380435+0000","last_clean":"2024-04-03T05:14:33.380435+0000","last_became_active":"2024-04-03T03:38:30.729797+0000","last_became_peered":"2024-04-03T03:38:30.729797+0000","last_unstale":"2024-04-03T05:14:33.380435+0000","last_undegraded":"2024-04-03T05:14:33.380435+0000","last_fullsized":"2024-04-03T05:14:33.380435+0000","mapping_epoch":29,"log_start":"263'500","ondisk_log_start":"263'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'519","last_scrub_stamp":"2024-04-03T05:14:33.380246+0000","last_deep_scrub":"263'519","last_deep_scrub_stamp":"2024-04-03T05:14:33.380246+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.380246+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:28:22.253810+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1388,"num_read_kb":1975,"num_write":1982,"num_write_kb":1776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":480474,"num_omap_keys":1112,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.264992+0000","last_change":"2024-04-03T05:14:24.265046+0000","last_active":"2024-04-03T05:14:24.264992+0000","last_peered":"2024-04-03T05:14:24.264992+0000","last_clean":"2024-04-03T05:14:24.264992+0000","last_became_active":"2024-04-03T03:38:32.738974+0000","last_became_peered":"2024-04-03T03:38:32.738974+0000","last_unstale":"2024-04-03T05:14:24.264992+0000","last_undegraded":"2024-04-03T05:14:24.264992+0000","last_fullsized":"2024-04-03T05:14:24.264992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:24.264793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:24.264793+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.264793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:39:12.004063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'127","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.621498+0000","last_change":"2024-04-03T05:14:24.621498+0000","last_active":"2024-04-03T05:14:24.621498+0000","last_peered":"2024-04-03T05:14:24.621498+0000","last_clean":"2024-04-03T05:14:24.621498+0000","last_became_active":"2024-04-03T03:38:34.755358+0000","last_became_peered":"2024-04-03T03:38:34.755358+0000","last_unstale":"2024-04-03T05:14:24.621498+0000","last_undegraded":"2024-04-03T05:14:24.621498+0000","last_fullsized":"2024-04-03T05:14:24.621498+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-04-03T05:14:24.621251+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-04-03T05:14:24.621251+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.621251+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:00:25.765195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":275,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'757","reported_seq":2273,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.277004+0000","last_change":"2024-04-03T05:14:35.277004+0000","last_active":"2024-04-03T05:14:35.277004+0000","last_peered":"2024-04-03T05:14:35.277004+0000","last_clean":"2024-04-03T05:14:35.277004+0000","last_became_active":"2024-04-03T03:38:26.747883+0000","last_became_peered":"2024-04-03T03:38:26.747883+0000","last_unstale":"2024-04-03T05:14:35.277004+0000","last_undegraded":"2024-04-03T05:14:35.277004+0000","last_fullsized":"2024-04-03T05:14:35.277004+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-04-03T05:14:35.276741+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-04-03T05:14:35.276741+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.276741+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:09:05.702739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3405,"num_read_kb":3046,"num_write":999,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'119","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.861605+0000","last_change":"2024-04-03T05:14:53.861676+0000","last_active":"2024-04-03T05:14:53.861605+0000","last_peered":"2024-04-03T05:14:53.861605+0000","last_clean":"2024-04-03T05:14:53.861605+0000","last_became_active":"2024-04-03T03:38:04.255147+0000","last_became_peered":"2024-04-03T03:38:04.255147+0000","last_unstale":"2024-04-03T05:14:53.861605+0000","last_undegraded":"2024-04-03T05:14:53.861605+0000","last_fullsized":"2024-04-03T05:14:53.861605+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-04-03T05:14:53.861415+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-04-03T05:14:53.861415+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.861415+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:57:50.031534+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:03.869788+0000","last_change":"2024-04-03T03:38:11.616774+0000","last_active":"2024-04-03T05:14:03.869788+0000","last_peered":"2024-04-03T05:14:03.869788+0000","last_clean":"2024-04-03T05:14:03.869788+0000","last_became_active":"2024-04-03T03:38:11.615990+0000","last_became_peered":"2024-04-03T03:38:11.615990+0000","last_unstale":"2024-04-03T05:14:03.869788+0000","last_undegraded":"2024-04-03T05:14:03.869788+0000","last_fullsized":"2024-04-03T05:14:03.869788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'273","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.808879+0000","last_change":"2024-04-03T03:38:24.759919+0000","last_active":"2024-04-03T05:14:15.808879+0000","last_peered":"2024-04-03T05:14:15.808879+0000","last_clean":"2024-04-03T05:14:15.808879+0000","last_became_active":"2024-04-03T03:38:24.759653+0000","last_became_peered":"2024-04-03T03:38:24.759653+0000","last_unstale":"2024-04-03T05:14:15.808879+0000","last_undegraded":"2024-04-03T05:14:15.808879+0000","last_fullsized":"2024-04-03T05:14:15.808879+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5305714,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":451,"num_read_kb":37025,"num_write":1084,"num_write_kb":41578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.899034+0000","last_change":"2024-04-03T05:14:41.899090+0000","last_active":"2024-04-03T05:14:41.899034+0000","last_peered":"2024-04-03T05:14:41.899034+0000","last_clean":"2024-04-03T05:14:41.899034+0000","last_became_active":"2024-04-03T03:38:28.735507+0000","last_became_peered":"2024-04-03T03:38:28.735507+0000","last_unstale":"2024-04-03T05:14:41.899034+0000","last_undegraded":"2024-04-03T05:14:41.899034+0000","last_fullsized":"2024-04-03T05:14:41.899034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:41.898834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:41.898834+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.898834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:50:34.267851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'743","reported_seq":1495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.337866+0000","last_change":"2024-04-03T05:14:34.337951+0000","last_active":"2024-04-03T05:14:34.337866+0000","last_peered":"2024-04-03T05:14:34.337866+0000","last_clean":"2024-04-03T05:14:34.337866+0000","last_became_active":"2024-04-03T03:38:30.722613+0000","last_became_peered":"2024-04-03T03:38:30.722613+0000","last_unstale":"2024-04-03T05:14:34.337866+0000","last_undegraded":"2024-04-03T05:14:34.337866+0000","last_fullsized":"2024-04-03T05:14:34.337866+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'743","last_scrub_stamp":"2024-04-03T05:14:34.337675+0000","last_deep_scrub":"263'743","last_deep_scrub_stamp":"2024-04-03T05:14:34.337675+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.337675+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:22.454088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1443,"num_read_kb":3262,"num_write":1372,"num_write_kb":1187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89356,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.221693+0000","last_change":"2024-04-03T05:14:33.221748+0000","last_active":"2024-04-03T05:14:33.221693+0000","last_peered":"2024-04-03T05:14:33.221693+0000","last_clean":"2024-04-03T05:14:33.221693+0000","last_became_active":"2024-04-03T03:38:32.746148+0000","last_became_peered":"2024-04-03T03:38:32.746148+0000","last_unstale":"2024-04-03T05:14:33.221693+0000","last_undegraded":"2024-04-03T05:14:33.221693+0000","last_fullsized":"2024-04-03T05:14:33.221693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.221493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.221493+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.221493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:11:50.545960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'116","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.237415+0000","last_change":"2024-04-03T05:14:36.237555+0000","last_active":"2024-04-03T05:14:36.237415+0000","last_peered":"2024-04-03T05:14:36.237415+0000","last_clean":"2024-04-03T05:14:36.237415+0000","last_became_active":"2024-04-03T03:38:34.760522+0000","last_became_peered":"2024-04-03T03:38:34.760522+0000","last_unstale":"2024-04-03T05:14:36.237415+0000","last_undegraded":"2024-04-03T05:14:36.237415+0000","last_fullsized":"2024-04-03T05:14:36.237415+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-04-03T05:14:36.237184+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-04-03T05:14:36.237184+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.237184+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:14:12.077097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":148,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'707","reported_seq":2098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.201518+0000","last_change":"2024-04-03T05:14:48.201600+0000","last_active":"2024-04-03T05:14:48.201518+0000","last_peered":"2024-04-03T05:14:48.201518+0000","last_clean":"2024-04-03T05:14:48.201518+0000","last_became_active":"2024-04-03T03:38:26.725330+0000","last_became_peered":"2024-04-03T03:38:26.725330+0000","last_unstale":"2024-04-03T05:14:48.201518+0000","last_undegraded":"2024-04-03T05:14:48.201518+0000","last_fullsized":"2024-04-03T05:14:48.201518+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'707","last_scrub_stamp":"2024-04-03T05:14:48.201318+0000","last_deep_scrub":"263'707","last_deep_scrub_stamp":"2024-04-03T05:14:48.201318+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.201318+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:25.098807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3168,"num_read_kb":2822,"num_write":954,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.631957+0000","last_change":"2024-04-03T03:38:11.620060+0000","last_active":"2024-04-03T05:14:17.631957+0000","last_peered":"2024-04-03T05:14:17.631957+0000","last_clean":"2024-04-03T05:14:17.631957+0000","last_became_active":"2024-04-03T03:38:11.619474+0000","last_became_peered":"2024-04-03T03:38:11.619474+0000","last_unstale":"2024-04-03T05:14:17.631957+0000","last_undegraded":"2024-04-03T05:14:17.631957+0000","last_fullsized":"2024-04-03T05:14:17.631957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'329","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.448363+0000","last_change":"2024-04-03T03:38:24.745584+0000","last_active":"2024-04-03T05:14:14.448363+0000","last_peered":"2024-04-03T05:14:14.448363+0000","last_clean":"2024-04-03T05:14:14.448363+0000","last_became_active":"2024-04-03T03:38:24.745231+0000","last_became_peered":"2024-04-03T03:38:24.745231+0000","last_unstale":"2024-04-03T05:14:14.448363+0000","last_undegraded":"2024-04-03T05:14:14.448363+0000","last_fullsized":"2024-04-03T05:14:14.448363+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":22150,"num_write":1160,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:48.865862+0000","last_change":"2024-04-03T03:38:28.741133+0000","last_active":"2024-04-03T05:13:48.865862+0000","last_peered":"2024-04-03T05:13:48.865862+0000","last_clean":"2024-04-03T05:13:48.865862+0000","last_became_active":"2024-04-03T03:38:28.740595+0000","last_became_peered":"2024-04-03T03:38:28.740595+0000","last_unstale":"2024-04-03T05:13:48.865862+0000","last_undegraded":"2024-04-03T05:13:48.865862+0000","last_fullsized":"2024-04-03T05:13:48.865862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:27.688762+0000","last_clean_scrub_stamp":"2024-04-03T03:38:27.688762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1199","reported_seq":3263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.599336+0000","last_change":"2024-04-03T05:14:37.599428+0000","last_active":"2024-04-03T05:14:37.599336+0000","last_peered":"2024-04-03T05:14:37.599336+0000","last_clean":"2024-04-03T05:14:37.599336+0000","last_became_active":"2024-04-03T03:38:30.719511+0000","last_became_peered":"2024-04-03T03:38:30.719511+0000","last_unstale":"2024-04-03T05:14:37.599336+0000","last_undegraded":"2024-04-03T05:14:37.599336+0000","last_fullsized":"2024-04-03T05:14:37.599336+0000","mapping_epoch":29,"log_start":"263'1100","ondisk_log_start":"263'1100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1199","last_scrub_stamp":"2024-04-03T05:14:37.599136+0000","last_deep_scrub":"263'1199","last_deep_scrub_stamp":"2024-04-03T05:14:37.599136+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.599136+0000","objects_scrubbed":12,"log_size":99,"log_dups_size":1100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:39:34.119832+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152942,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1863,"num_read_kb":3633,"num_write":1216,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.774498+0000","last_change":"2024-04-03T05:14:32.774498+0000","last_active":"2024-04-03T05:14:32.774498+0000","last_peered":"2024-04-03T05:14:32.774498+0000","last_clean":"2024-04-03T05:14:32.774498+0000","last_became_active":"2024-04-03T03:38:32.748061+0000","last_became_peered":"2024-04-03T03:38:32.748061+0000","last_unstale":"2024-04-03T05:14:32.774498+0000","last_undegraded":"2024-04-03T05:14:32.774498+0000","last_fullsized":"2024-04-03T05:14:32.774498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:32.774243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:32.774243+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.774243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:08.272229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'165","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.594652+0000","last_change":"2024-04-03T05:14:22.594652+0000","last_active":"2024-04-03T05:14:22.594652+0000","last_peered":"2024-04-03T05:14:22.594652+0000","last_clean":"2024-04-03T05:14:22.594652+0000","last_became_active":"2024-04-03T03:38:34.936635+0000","last_became_peered":"2024-04-03T03:38:34.936635+0000","last_unstale":"2024-04-03T05:14:22.594652+0000","last_undegraded":"2024-04-03T05:14:22.594652+0000","last_fullsized":"2024-04-03T05:14:22.594652+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'165","last_scrub_stamp":"2024-04-03T05:14:22.594244+0000","last_deep_scrub":"263'165","last_deep_scrub_stamp":"2024-04-03T05:14:22.594244+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.594244+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:31:56.893087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":219,"num_write":382,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'396","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.629074+0000","last_change":"2024-04-03T05:14:36.629142+0000","last_active":"2024-04-03T05:14:36.629074+0000","last_peered":"2024-04-03T05:14:36.629074+0000","last_clean":"2024-04-03T05:14:36.629074+0000","last_became_active":"2024-04-03T03:38:26.721536+0000","last_became_peered":"2024-04-03T03:38:26.721536+0000","last_unstale":"2024-04-03T05:14:36.629074+0000","last_undegraded":"2024-04-03T05:14:36.629074+0000","last_fullsized":"2024-04-03T05:14:36.629074+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-04-03T05:14:36.628883+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-04-03T05:14:36.628883+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.628883+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:53:04.082202+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2077,"num_read_kb":1939,"num_write":478,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":546,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.465874+0000","last_change":"2024-04-03T05:14:34.465974+0000","last_active":"2024-04-03T05:14:34.465874+0000","last_peered":"2024-04-03T05:14:34.465874+0000","last_clean":"2024-04-03T05:14:34.465874+0000","last_became_active":"2024-04-03T03:38:11.755301+0000","last_became_peered":"2024-04-03T03:38:11.755301+0000","last_unstale":"2024-04-03T05:14:34.465874+0000","last_undegraded":"2024-04-03T05:14:34.465874+0000","last_fullsized":"2024-04-03T05:14:34.465874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:34.465584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:34.465584+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.465584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:25.305170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'314","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.524635+0000","last_change":"2024-04-03T05:14:48.524635+0000","last_active":"2024-04-03T05:14:48.524635+0000","last_peered":"2024-04-03T05:14:48.524635+0000","last_clean":"2024-04-03T05:14:48.524635+0000","last_became_active":"2024-04-03T03:38:24.720445+0000","last_became_peered":"2024-04-03T03:38:24.720445+0000","last_unstale":"2024-04-03T05:14:48.524635+0000","last_undegraded":"2024-04-03T05:14:48.524635+0000","last_fullsized":"2024-04-03T05:14:48.524635+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-04-03T05:14:48.524349+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-04-03T05:14:48.524349+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.524349+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:40:11.390177+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194358,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":20915,"num_write":1082,"num_write_kb":36230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.527332+0000","last_change":"2024-04-03T05:14:27.527393+0000","last_active":"2024-04-03T05:14:27.527332+0000","last_peered":"2024-04-03T05:14:27.527332+0000","last_clean":"2024-04-03T05:14:27.527332+0000","last_became_active":"2024-04-03T03:38:28.733750+0000","last_became_peered":"2024-04-03T03:38:28.733750+0000","last_unstale":"2024-04-03T05:14:27.527332+0000","last_undegraded":"2024-04-03T05:14:27.527332+0000","last_fullsized":"2024-04-03T05:14:27.527332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:27.527140+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:27.527140+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.527140+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:50:25.076608+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'331","reported_seq":2059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.632928+0000","last_change":"2024-04-03T03:38:30.824797+0000","last_active":"2024-04-03T05:14:17.632928+0000","last_peered":"2024-04-03T05:14:17.632928+0000","last_clean":"2024-04-03T05:14:17.632928+0000","last_became_active":"2024-04-03T03:38:30.824061+0000","last_became_peered":"2024-04-03T03:38:30.824061+0000","last_unstale":"2024-04-03T05:14:17.632928+0000","last_undegraded":"2024-04-03T05:14:17.632928+0000","last_fullsized":"2024-04-03T05:14:17.632928+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":319,"num_read_kb":311,"num_write":309,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.274808+0000","last_change":"2024-04-03T05:14:40.274859+0000","last_active":"2024-04-03T05:14:40.274808+0000","last_peered":"2024-04-03T05:14:40.274808+0000","last_clean":"2024-04-03T05:14:40.274808+0000","last_became_active":"2024-04-03T03:38:32.735151+0000","last_became_peered":"2024-04-03T03:38:32.735151+0000","last_unstale":"2024-04-03T05:14:40.274808+0000","last_undegraded":"2024-04-03T05:14:40.274808+0000","last_fullsized":"2024-04-03T05:14:40.274808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:40.274606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:40.274606+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.274606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:10:22.499028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'196","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.153641+0000","last_change":"2024-04-03T05:14:32.153712+0000","last_active":"2024-04-03T05:14:32.153641+0000","last_peered":"2024-04-03T05:14:32.153641+0000","last_clean":"2024-04-03T05:14:32.153641+0000","last_became_active":"2024-04-03T03:38:34.731776+0000","last_became_peered":"2024-04-03T03:38:34.731776+0000","last_unstale":"2024-04-03T05:14:32.153641+0000","last_undegraded":"2024-04-03T05:14:32.153641+0000","last_fullsized":"2024-04-03T05:14:32.153641+0000","mapping_epoch":33,"log_start":"252'100","ondisk_log_start":"252'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-04-03T05:14:32.153424+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-04-03T05:14:32.153424+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.153424+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:04:00.407236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":349,"num_read_kb":358,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'385","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.627383+0000","last_change":"2024-04-03T05:14:32.627453+0000","last_active":"2024-04-03T05:14:32.627383+0000","last_peered":"2024-04-03T05:14:32.627383+0000","last_clean":"2024-04-03T05:14:32.627383+0000","last_became_active":"2024-04-03T03:38:26.727581+0000","last_became_peered":"2024-04-03T03:38:26.727581+0000","last_unstale":"2024-04-03T05:14:32.627383+0000","last_undegraded":"2024-04-03T05:14:32.627383+0000","last_fullsized":"2024-04-03T05:14:32.627383+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-04-03T05:14:32.627188+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-04-03T05:14:32.627188+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.627188+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:06:17.186544+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2147,"num_read_kb":2031,"num_write":458,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":635,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":547,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.332314+0000","last_change":"2024-04-03T05:14:53.332431+0000","last_active":"2024-04-03T05:14:53.332314+0000","last_peered":"2024-04-03T05:14:53.332314+0000","last_clean":"2024-04-03T05:14:53.332314+0000","last_became_active":"2024-04-03T03:38:11.613973+0000","last_became_peered":"2024-04-03T03:38:11.613973+0000","last_unstale":"2024-04-03T05:14:53.332314+0000","last_undegraded":"2024-04-03T05:14:53.332314+0000","last_fullsized":"2024-04-03T05:14:53.332314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:53.332067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:53.332067+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.332067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:16:12.388040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'335","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.514369+0000","last_change":"2024-04-03T05:14:28.514369+0000","last_active":"2024-04-03T05:14:28.514369+0000","last_peered":"2024-04-03T05:14:28.514369+0000","last_clean":"2024-04-03T05:14:28.514369+0000","last_became_active":"2024-04-03T03:38:58.349561+0000","last_became_peered":"2024-04-03T03:38:58.349561+0000","last_unstale":"2024-04-03T05:14:28.514369+0000","last_undegraded":"2024-04-03T05:14:28.514369+0000","last_fullsized":"2024-04-03T05:14:28.514369+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-04-03T05:14:28.514073+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-04-03T05:14:28.514073+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.514073+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:56:01.820268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":496,"num_read_kb":36392,"num_write":1067,"num_write_kb":30181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.195446+0000","last_change":"2024-04-03T05:14:43.195446+0000","last_active":"2024-04-03T05:14:43.195446+0000","last_peered":"2024-04-03T05:14:43.195446+0000","last_clean":"2024-04-03T05:14:43.195446+0000","last_became_active":"2024-04-03T03:38:28.711551+0000","last_became_peered":"2024-04-03T03:38:28.711551+0000","last_unstale":"2024-04-03T05:14:43.195446+0000","last_undegraded":"2024-04-03T05:14:43.195446+0000","last_fullsized":"2024-04-03T05:14:43.195446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:43.195182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:43.195182+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.195182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:23:25.576316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'189","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:57.196487+0000","last_change":"2024-04-03T05:14:57.196594+0000","last_active":"2024-04-03T05:14:57.196487+0000","last_peered":"2024-04-03T05:14:57.196487+0000","last_clean":"2024-04-03T05:14:57.196487+0000","last_became_active":"2024-04-03T03:38:30.717437+0000","last_became_peered":"2024-04-03T03:38:30.717437+0000","last_unstale":"2024-04-03T05:14:57.196487+0000","last_undegraded":"2024-04-03T05:14:57.196487+0000","last_fullsized":"2024-04-03T05:14:57.196487+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-04-03T05:14:57.196273+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-04-03T05:14:57.196273+0000","last_clean_scrub_stamp":"2024-04-03T05:14:57.196273+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:12:02.436051+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":238,"num_read_kb":232,"num_write":176,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.289928+0000","last_change":"2024-04-03T05:14:26.289985+0000","last_active":"2024-04-03T05:14:26.289928+0000","last_peered":"2024-04-03T05:14:26.289928+0000","last_clean":"2024-04-03T05:14:26.289928+0000","last_became_active":"2024-04-03T03:38:32.739201+0000","last_became_peered":"2024-04-03T03:38:32.739201+0000","last_unstale":"2024-04-03T05:14:26.289928+0000","last_undegraded":"2024-04-03T05:14:26.289928+0000","last_fullsized":"2024-04-03T05:14:26.289928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:26.289723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:26.289723+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.289723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:39:59.552127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'111","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.265127+0000","last_change":"2024-04-03T05:14:26.265199+0000","last_active":"2024-04-03T05:14:26.265127+0000","last_peered":"2024-04-03T05:14:26.265127+0000","last_clean":"2024-04-03T05:14:26.265127+0000","last_became_active":"2024-04-03T03:38:34.749642+0000","last_became_peered":"2024-04-03T03:38:34.749642+0000","last_unstale":"2024-04-03T05:14:26.265127+0000","last_undegraded":"2024-04-03T05:14:26.265127+0000","last_fullsized":"2024-04-03T05:14:26.265127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-04-03T05:14:26.264937+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-04-03T05:14:26.264937+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.264937+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:55:51.281140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":197,"num_write":285,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'483","reported_seq":2140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.543646+0000","last_change":"2024-04-03T05:14:38.543709+0000","last_active":"2024-04-03T05:14:38.543646+0000","last_peered":"2024-04-03T05:14:38.543646+0000","last_clean":"2024-04-03T05:14:38.543646+0000","last_became_active":"2024-04-03T03:38:26.720476+0000","last_became_peered":"2024-04-03T03:38:26.720476+0000","last_unstale":"2024-04-03T05:14:38.543646+0000","last_undegraded":"2024-04-03T05:14:38.543646+0000","last_fullsized":"2024-04-03T05:14:38.543646+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'483","last_scrub_stamp":"2024-04-03T05:14:38.543456+0000","last_deep_scrub":"263'483","last_deep_scrub_stamp":"2024-04-03T05:14:38.543456+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.543456+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:23:12.739628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2351,"num_write":586,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'318","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.327400+0000","last_change":"2024-04-03T05:14:50.327487+0000","last_active":"2024-04-03T05:14:50.327400+0000","last_peered":"2024-04-03T05:14:50.327400+0000","last_clean":"2024-04-03T05:14:50.327400+0000","last_became_active":"2024-04-03T03:38:24.748412+0000","last_became_peered":"2024-04-03T03:38:24.748412+0000","last_unstale":"2024-04-03T05:14:50.327400+0000","last_undegraded":"2024-04-03T05:14:50.327400+0000","last_fullsized":"2024-04-03T05:14:50.327400+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-04-03T05:14:50.327210+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-04-03T05:14:50.327210+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.327210+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:01:59.641695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400935,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":679,"num_read_kb":11584,"num_write":1159,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":549,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.501996+0000","last_change":"2024-04-03T05:14:45.502051+0000","last_active":"2024-04-03T05:14:45.501996+0000","last_peered":"2024-04-03T05:14:45.501996+0000","last_clean":"2024-04-03T05:14:45.501996+0000","last_became_active":"2024-04-03T03:38:11.609995+0000","last_became_peered":"2024-04-03T03:38:11.609995+0000","last_unstale":"2024-04-03T05:14:45.501996+0000","last_undegraded":"2024-04-03T05:14:45.501996+0000","last_fullsized":"2024-04-03T05:14:45.501996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:45.501801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:45.501801+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.501801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:54:46.328534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"263'4","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.240975+0000","last_change":"2024-04-03T05:14:47.241169+0000","last_active":"2024-04-03T05:14:47.240975+0000","last_peered":"2024-04-03T05:14:47.240975+0000","last_clean":"2024-04-03T05:14:47.240975+0000","last_became_active":"2024-04-03T03:38:28.716761+0000","last_became_peered":"2024-04-03T03:38:28.716761+0000","last_unstale":"2024-04-03T05:14:47.240975+0000","last_undegraded":"2024-04-03T05:14:47.240975+0000","last_fullsized":"2024-04-03T05:14:47.240975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:47.240751+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:47.240751+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.240751+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:20:21.061216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":482,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'628","reported_seq":1369,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:55.252046+0000","last_change":"2024-04-03T05:14:55.252046+0000","last_active":"2024-04-03T05:14:55.252046+0000","last_peered":"2024-04-03T05:14:55.252046+0000","last_clean":"2024-04-03T05:14:55.252046+0000","last_became_active":"2024-04-03T03:38:30.731186+0000","last_became_peered":"2024-04-03T03:38:30.731186+0000","last_unstale":"2024-04-03T05:14:55.252046+0000","last_undegraded":"2024-04-03T05:14:55.252046+0000","last_fullsized":"2024-04-03T05:14:55.252046+0000","mapping_epoch":29,"log_start":"263'600","ondisk_log_start":"263'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'628","last_scrub_stamp":"2024-04-03T05:14:55.251734+0000","last_deep_scrub":"263'628","last_deep_scrub_stamp":"2024-04-03T05:14:55.251734+0000","last_clean_scrub_stamp":"2024-04-03T05:14:55.251734+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:02:44.397018+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105089,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1067,"num_read_kb":2412,"num_write":850,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.705076+0000","last_change":"2024-04-03T05:14:29.705128+0000","last_active":"2024-04-03T05:14:29.705076+0000","last_peered":"2024-04-03T05:14:29.705076+0000","last_clean":"2024-04-03T05:14:29.705076+0000","last_became_active":"2024-04-03T03:38:32.725549+0000","last_became_peered":"2024-04-03T03:38:32.725549+0000","last_unstale":"2024-04-03T05:14:29.705076+0000","last_undegraded":"2024-04-03T05:14:29.705076+0000","last_fullsized":"2024-04-03T05:14:29.705076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:29.704889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:29.704889+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.704889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:18:48.023074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'104","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.211493+0000","last_change":"2024-04-03T05:14:24.211555+0000","last_active":"2024-04-03T05:14:24.211493+0000","last_peered":"2024-04-03T05:14:24.211493+0000","last_clean":"2024-04-03T05:14:24.211493+0000","last_became_active":"2024-04-03T03:38:34.939419+0000","last_became_peered":"2024-04-03T03:38:34.939419+0000","last_unstale":"2024-04-03T05:14:24.211493+0000","last_undegraded":"2024-04-03T05:14:24.211493+0000","last_fullsized":"2024-04-03T05:14:24.211493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-04-03T05:14:24.211297+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-04-03T05:14:24.211297+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.211297+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:21:35.674236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":118,"num_write":243,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'845","reported_seq":2359,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.280826+0000","last_change":"2024-04-03T05:14:41.280894+0000","last_active":"2024-04-03T05:14:41.280826+0000","last_peered":"2024-04-03T05:14:41.280826+0000","last_clean":"2024-04-03T05:14:41.280826+0000","last_became_active":"2024-04-03T03:38:26.731406+0000","last_became_peered":"2024-04-03T03:38:26.731406+0000","last_unstale":"2024-04-03T05:14:41.280826+0000","last_undegraded":"2024-04-03T05:14:41.280826+0000","last_fullsized":"2024-04-03T05:14:41.280826+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'845","last_scrub_stamp":"2024-04-03T05:14:41.280656+0000","last_deep_scrub":"263'845","last_deep_scrub_stamp":"2024-04-03T05:14:41.280656+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.280656+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:26:59.185989+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3757,"num_read_kb":3345,"num_write":1171,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":623,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'312","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.562642+0000","last_change":"2024-04-03T05:14:49.562853+0000","last_active":"2024-04-03T05:14:49.562642+0000","last_peered":"2024-04-03T05:14:49.562642+0000","last_clean":"2024-04-03T05:14:49.562642+0000","last_became_active":"2024-04-03T03:38:24.721685+0000","last_became_peered":"2024-04-03T03:38:24.721685+0000","last_unstale":"2024-04-03T05:14:49.562642+0000","last_undegraded":"2024-04-03T05:14:49.562642+0000","last_fullsized":"2024-04-03T05:14:49.562642+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-04-03T05:14:49.562415+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-04-03T05:14:49.562415+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.562415+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:42:30.758765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266323,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":425,"num_read_kb":12382,"num_write":1218,"num_write_kb":30338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.632129+0000","last_change":"2024-04-03T03:38:11.618107+0000","last_active":"2024-04-03T05:14:17.632129+0000","last_peered":"2024-04-03T05:14:17.632129+0000","last_clean":"2024-04-03T05:14:17.632129+0000","last_became_active":"2024-04-03T03:38:11.617057+0000","last_became_peered":"2024-04-03T03:38:11.617057+0000","last_unstale":"2024-04-03T05:14:17.632129+0000","last_undegraded":"2024-04-03T05:14:17.632129+0000","last_fullsized":"2024-04-03T05:14:17.632129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:10.594495+0000","last_clean_scrub_stamp":"2024-04-03T03:38:10.594495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.323855+0000","last_change":"2024-04-03T05:14:33.323915+0000","last_active":"2024-04-03T05:14:33.323855+0000","last_peered":"2024-04-03T05:14:33.323855+0000","last_clean":"2024-04-03T05:14:33.323855+0000","last_became_active":"2024-04-03T03:38:28.719394+0000","last_became_peered":"2024-04-03T03:38:28.719394+0000","last_unstale":"2024-04-03T05:14:33.323855+0000","last_undegraded":"2024-04-03T05:14:33.323855+0000","last_fullsized":"2024-04-03T05:14:33.323855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.323658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.323658+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.323658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:26.127102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'316","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.600163+0000","last_change":"2024-04-03T05:14:41.600245+0000","last_active":"2024-04-03T05:14:41.600163+0000","last_peered":"2024-04-03T05:14:41.600163+0000","last_clean":"2024-04-03T05:14:41.600163+0000","last_became_active":"2024-04-03T03:38:30.821297+0000","last_became_peered":"2024-04-03T03:38:30.821297+0000","last_unstale":"2024-04-03T05:14:41.600163+0000","last_undegraded":"2024-04-03T05:14:41.600163+0000","last_fullsized":"2024-04-03T05:14:41.600163+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-04-03T05:14:41.599966+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-04-03T05:14:41.599966+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.599966+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:20:40.235969+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":386,"num_write":374,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5650,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'555","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.253957+0000","last_change":"2024-04-03T05:14:29.254021+0000","last_active":"2024-04-03T05:14:29.253957+0000","last_peered":"2024-04-03T05:14:29.253957+0000","last_clean":"2024-04-03T05:14:29.253957+0000","last_became_active":"2024-04-03T03:38:32.747292+0000","last_became_peered":"2024-04-03T03:38:32.747292+0000","last_unstale":"2024-04-03T05:14:29.253957+0000","last_undegraded":"2024-04-03T05:14:29.253957+0000","last_fullsized":"2024-04-03T05:14:29.253957+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'555","last_scrub_stamp":"2024-04-03T05:14:29.253768+0000","last_deep_scrub":"263'555","last_deep_scrub_stamp":"2024-04-03T05:14:29.253768+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.253768+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:40:53.784055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'92","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.151466+0000","last_change":"2024-04-03T05:14:28.151634+0000","last_active":"2024-04-03T05:14:28.151466+0000","last_peered":"2024-04-03T05:14:28.151466+0000","last_clean":"2024-04-03T05:14:28.151466+0000","last_became_active":"2024-04-03T03:38:34.935593+0000","last_became_peered":"2024-04-03T03:38:34.935593+0000","last_unstale":"2024-04-03T05:14:28.151466+0000","last_undegraded":"2024-04-03T05:14:28.151466+0000","last_fullsized":"2024-04-03T05:14:28.151466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-04-03T05:14:28.151248+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-04-03T05:14:28.151248+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.151248+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:44.377270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":828,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":224,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'421","reported_seq":1899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.233120+0000","last_change":"2024-04-03T05:14:52.233247+0000","last_active":"2024-04-03T05:14:52.233120+0000","last_peered":"2024-04-03T05:14:52.233120+0000","last_clean":"2024-04-03T05:14:52.233120+0000","last_became_active":"2024-04-03T03:38:26.716004+0000","last_became_peered":"2024-04-03T03:38:26.716004+0000","last_unstale":"2024-04-03T05:14:52.233120+0000","last_undegraded":"2024-04-03T05:14:52.233120+0000","last_fullsized":"2024-04-03T05:14:52.233120+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'421","last_scrub_stamp":"2024-04-03T05:14:52.232895+0000","last_deep_scrub":"263'421","last_deep_scrub_stamp":"2024-04-03T05:14:52.232895+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.232895+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:29.994818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":2164,"num_write":539,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'334","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.488009+0000","last_change":"2024-04-03T03:38:24.728339+0000","last_active":"2024-04-03T05:14:10.488009+0000","last_peered":"2024-04-03T05:14:10.488009+0000","last_clean":"2024-04-03T05:14:10.488009+0000","last_became_active":"2024-04-03T03:38:24.727736+0000","last_became_peered":"2024-04-03T03:38:24.727736+0000","last_unstale":"2024-04-03T05:14:10.488009+0000","last_undegraded":"2024-04-03T05:14:10.488009+0000","last_fullsized":"2024-04-03T05:14:10.488009+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262228,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":37309,"num_write":1217,"num_write_kb":23236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":547,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.539124+0000","last_change":"2024-04-03T05:14:46.539176+0000","last_active":"2024-04-03T05:14:46.539124+0000","last_peered":"2024-04-03T05:14:46.539124+0000","last_clean":"2024-04-03T05:14:46.539124+0000","last_became_active":"2024-04-03T03:38:11.613252+0000","last_became_peered":"2024-04-03T03:38:11.613252+0000","last_unstale":"2024-04-03T05:14:46.539124+0000","last_undegraded":"2024-04-03T05:14:46.539124+0000","last_fullsized":"2024-04-03T05:14:46.539124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:46.538925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:46.538925+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.538925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:57.842788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.694419+0000","last_change":"2024-04-03T05:14:40.694477+0000","last_active":"2024-04-03T05:14:40.694419+0000","last_peered":"2024-04-03T05:14:40.694419+0000","last_clean":"2024-04-03T05:14:40.694419+0000","last_became_active":"2024-04-03T03:38:28.721796+0000","last_became_peered":"2024-04-03T03:38:28.721796+0000","last_unstale":"2024-04-03T05:14:40.694419+0000","last_undegraded":"2024-04-03T05:14:40.694419+0000","last_fullsized":"2024-04-03T05:14:40.694419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:40.694210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:40.694210+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.694210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:14.210078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'172","reported_seq":771,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.783442+0000","last_change":"2024-04-03T05:14:33.783527+0000","last_active":"2024-04-03T05:14:33.783442+0000","last_peered":"2024-04-03T05:14:33.783442+0000","last_clean":"2024-04-03T05:14:33.783442+0000","last_became_active":"2024-04-03T03:38:30.718913+0000","last_became_peered":"2024-04-03T03:38:30.718913+0000","last_unstale":"2024-04-03T05:14:33.783442+0000","last_undegraded":"2024-04-03T05:14:33.783442+0000","last_fullsized":"2024-04-03T05:14:33.783442+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-04-03T05:14:33.783242+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-04-03T05:14:33.783242+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.783242+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:27:44.505546+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":144,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'554","reported_seq":2680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.169371+0000","last_change":"2024-04-03T05:14:34.169432+0000","last_active":"2024-04-03T05:14:34.169371+0000","last_peered":"2024-04-03T05:14:34.169371+0000","last_clean":"2024-04-03T05:14:34.169371+0000","last_became_active":"2024-04-03T03:38:32.743829+0000","last_became_peered":"2024-04-03T03:38:32.743829+0000","last_unstale":"2024-04-03T05:14:34.169371+0000","last_undegraded":"2024-04-03T05:14:34.169371+0000","last_fullsized":"2024-04-03T05:14:34.169371+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'554","last_scrub_stamp":"2024-04-03T05:14:34.169176+0000","last_deep_scrub":"263'554","last_deep_scrub_stamp":"2024-04-03T05:14:34.169176+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.169176+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:03:02.748798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'94","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.265589+0000","last_change":"2024-04-03T05:14:26.265677+0000","last_active":"2024-04-03T05:14:26.265589+0000","last_peered":"2024-04-03T05:14:26.265589+0000","last_clean":"2024-04-03T05:14:26.265589+0000","last_became_active":"2024-04-03T03:38:34.746249+0000","last_became_peered":"2024-04-03T03:38:34.746249+0000","last_unstale":"2024-04-03T05:14:26.265589+0000","last_undegraded":"2024-04-03T05:14:26.265589+0000","last_fullsized":"2024-04-03T05:14:26.265589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'94","last_scrub_stamp":"2024-04-03T05:14:26.265394+0000","last_deep_scrub":"263'94","last_deep_scrub_stamp":"2024-04-03T05:14:26.265394+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.265394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:25:51.955446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":217,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1105","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.259360+0000","last_change":"2024-04-03T03:38:26.741936+0000","last_active":"2024-04-03T05:14:16.259360+0000","last_peered":"2024-04-03T05:14:16.259360+0000","last_clean":"2024-04-03T05:14:16.259360+0000","last_became_active":"2024-04-03T03:38:26.741272+0000","last_became_peered":"2024-04-03T03:38:26.741272+0000","last_unstale":"2024-04-03T05:14:16.259360+0000","last_undegraded":"2024-04-03T05:14:16.259360+0000","last_fullsized":"2024-04-03T05:14:16.259360+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4771,"num_read_kb":4189,"num_write":1521,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'320","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.539991+0000","last_change":"2024-04-03T03:38:24.747700+0000","last_active":"2024-04-03T05:14:10.539991+0000","last_peered":"2024-04-03T05:14:10.539991+0000","last_clean":"2024-04-03T05:14:10.539991+0000","last_became_active":"2024-04-03T03:38:24.747145+0000","last_became_peered":"2024-04-03T03:38:24.747145+0000","last_unstale":"2024-04-03T05:14:10.539991+0000","last_undegraded":"2024-04-03T05:14:10.539991+0000","last_fullsized":"2024-04-03T05:14:10.539991+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3601918,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":38174,"num_write":1065,"num_write_kb":41152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.154809+0000","last_change":"2024-04-03T05:14:40.154865+0000","last_active":"2024-04-03T05:14:40.154809+0000","last_peered":"2024-04-03T05:14:40.154809+0000","last_clean":"2024-04-03T05:14:40.154809+0000","last_became_active":"2024-04-03T03:38:11.617573+0000","last_became_peered":"2024-04-03T03:38:11.617573+0000","last_unstale":"2024-04-03T05:14:40.154809+0000","last_undegraded":"2024-04-03T05:14:40.154809+0000","last_fullsized":"2024-04-03T05:14:40.154809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:40.154593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:40.154593+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.154593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:14:09.469907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:55.212176+0000","last_change":"2024-04-03T05:14:55.212232+0000","last_active":"2024-04-03T05:14:55.212176+0000","last_peered":"2024-04-03T05:14:55.212176+0000","last_clean":"2024-04-03T05:14:55.212176+0000","last_became_active":"2024-04-03T03:38:28.733237+0000","last_became_peered":"2024-04-03T03:38:28.733237+0000","last_unstale":"2024-04-03T05:14:55.212176+0000","last_undegraded":"2024-04-03T05:14:55.212176+0000","last_fullsized":"2024-04-03T05:14:55.212176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:55.211965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:55.211965+0000","last_clean_scrub_stamp":"2024-04-03T05:14:55.211965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:50:19.677511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'805","reported_seq":1587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.872778+0000","last_change":"2024-04-03T05:14:51.872871+0000","last_active":"2024-04-03T05:14:51.872778+0000","last_peered":"2024-04-03T05:14:51.872778+0000","last_clean":"2024-04-03T05:14:51.872778+0000","last_became_active":"2024-04-03T03:38:30.822610+0000","last_became_peered":"2024-04-03T03:38:30.822610+0000","last_unstale":"2024-04-03T05:14:51.872778+0000","last_undegraded":"2024-04-03T05:14:51.872778+0000","last_fullsized":"2024-04-03T05:14:51.872778+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-04-03T05:14:51.872585+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-04-03T05:14:51.872585+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.872585+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:42:57.316323+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1404,"num_read_kb":3337,"num_write":1132,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.180217+0000","last_change":"2024-04-03T05:14:38.180253+0000","last_active":"2024-04-03T05:14:38.180217+0000","last_peered":"2024-04-03T05:14:38.180217+0000","last_clean":"2024-04-03T05:14:38.180217+0000","last_became_active":"2024-04-03T03:38:32.728874+0000","last_became_peered":"2024-04-03T03:38:32.728874+0000","last_unstale":"2024-04-03T05:14:38.180217+0000","last_undegraded":"2024-04-03T05:14:38.180217+0000","last_fullsized":"2024-04-03T05:14:38.180217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:38.180096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:38.180096+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.180096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:46.583547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'106","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.338215+0000","last_change":"2024-04-03T05:14:24.338375+0000","last_active":"2024-04-03T05:14:24.338215+0000","last_peered":"2024-04-03T05:14:24.338215+0000","last_clean":"2024-04-03T05:14:24.338215+0000","last_became_active":"2024-04-03T03:38:34.756936+0000","last_became_peered":"2024-04-03T03:38:34.756936+0000","last_unstale":"2024-04-03T05:14:24.338215+0000","last_undegraded":"2024-04-03T05:14:24.338215+0000","last_fullsized":"2024-04-03T05:14:24.338215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-04-03T05:14:24.338001+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-04-03T05:14:24.338001+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.338001+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:46:06.133728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'144","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.233348+0000","last_change":"2024-04-03T05:14:25.233348+0000","last_active":"2024-04-03T05:14:25.233348+0000","last_peered":"2024-04-03T05:14:25.233348+0000","last_clean":"2024-04-03T05:14:25.233348+0000","last_became_active":"2024-04-03T03:38:34.759767+0000","last_became_peered":"2024-04-03T03:38:34.759767+0000","last_unstale":"2024-04-03T05:14:25.233348+0000","last_undegraded":"2024-04-03T05:14:25.233348+0000","last_fullsized":"2024-04-03T05:14:25.233348+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-04-03T05:14:25.233092+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-04-03T05:14:25.233092+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.233092+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:33:41.732896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":108,"num_write":250,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'826","reported_seq":2403,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:08.673981+0000","last_change":"2024-04-03T03:38:26.741454+0000","last_active":"2024-04-03T05:14:08.673981+0000","last_peered":"2024-04-03T05:14:08.673981+0000","last_clean":"2024-04-03T05:14:08.673981+0000","last_became_active":"2024-04-03T03:38:26.740732+0000","last_became_peered":"2024-04-03T03:38:26.740732+0000","last_unstale":"2024-04-03T05:14:08.673981+0000","last_undegraded":"2024-04-03T05:14:08.673981+0000","last_fullsized":"2024-04-03T05:14:08.673981+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3680,"num_read_kb":3271,"num_write":1116,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'362","reported_seq":1139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.620319+0000","last_change":"2024-04-03T05:14:51.620422+0000","last_active":"2024-04-03T05:14:51.620319+0000","last_peered":"2024-04-03T05:14:51.620319+0000","last_clean":"2024-04-03T05:14:51.620319+0000","last_became_active":"2024-04-03T03:38:24.740900+0000","last_became_peered":"2024-04-03T03:38:24.740900+0000","last_unstale":"2024-04-03T05:14:51.620319+0000","last_undegraded":"2024-04-03T05:14:51.620319+0000","last_fullsized":"2024-04-03T05:14:51.620319+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-04-03T05:14:51.620123+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-04-03T05:14:51.620123+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.620123+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:01:58.064198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100573,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":621,"num_read_kb":65764,"num_write":1260,"num_write_kb":26843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.609710+0000","last_change":"2024-04-03T05:14:33.609771+0000","last_active":"2024-04-03T05:14:33.609710+0000","last_peered":"2024-04-03T05:14:33.609710+0000","last_clean":"2024-04-03T05:14:33.609710+0000","last_became_active":"2024-04-03T03:38:28.725020+0000","last_became_peered":"2024-04-03T03:38:28.725020+0000","last_unstale":"2024-04-03T05:14:33.609710+0000","last_undegraded":"2024-04-03T05:14:33.609710+0000","last_fullsized":"2024-04-03T05:14:33.609710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.609472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.609472+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.609472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:45:03.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'315","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.226128+0000","last_change":"2024-04-03T05:14:44.226324+0000","last_active":"2024-04-03T05:14:44.226128+0000","last_peered":"2024-04-03T05:14:44.226128+0000","last_clean":"2024-04-03T05:14:44.226128+0000","last_became_active":"2024-04-03T03:38:30.729608+0000","last_became_peered":"2024-04-03T03:38:30.729608+0000","last_unstale":"2024-04-03T05:14:44.226128+0000","last_undegraded":"2024-04-03T05:14:44.226128+0000","last_fullsized":"2024-04-03T05:14:44.226128+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-04-03T05:14:44.225905+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-04-03T05:14:44.225905+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.225905+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:41:42.032295+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":1071,"num_write":390,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.147656+0000","last_change":"2024-04-03T05:14:33.147720+0000","last_active":"2024-04-03T05:14:33.147656+0000","last_peered":"2024-04-03T05:14:33.147656+0000","last_clean":"2024-04-03T05:14:33.147656+0000","last_became_active":"2024-04-03T03:38:32.744256+0000","last_became_peered":"2024-04-03T03:38:32.744256+0000","last_unstale":"2024-04-03T05:14:33.147656+0000","last_undegraded":"2024-04-03T05:14:33.147656+0000","last_fullsized":"2024-04-03T05:14:33.147656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.147448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.147448+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.147448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:25:04.586669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'108","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.156559+0000","last_change":"2024-04-03T05:14:30.156559+0000","last_active":"2024-04-03T05:14:30.156559+0000","last_peered":"2024-04-03T05:14:30.156559+0000","last_clean":"2024-04-03T05:14:30.156559+0000","last_became_active":"2024-04-03T03:38:34.736176+0000","last_became_peered":"2024-04-03T03:38:34.736176+0000","last_unstale":"2024-04-03T05:14:30.156559+0000","last_undegraded":"2024-04-03T05:14:30.156559+0000","last_fullsized":"2024-04-03T05:14:30.156559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-04-03T05:14:30.156298+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-04-03T05:14:30.156298+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.156298+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:22:54.335172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":259,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'761","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.547731+0000","last_change":"2024-04-03T05:14:40.547802+0000","last_active":"2024-04-03T05:14:40.547731+0000","last_peered":"2024-04-03T05:14:40.547731+0000","last_clean":"2024-04-03T05:14:40.547731+0000","last_became_active":"2024-04-03T03:38:26.720106+0000","last_became_peered":"2024-04-03T03:38:26.720106+0000","last_unstale":"2024-04-03T05:14:40.547731+0000","last_undegraded":"2024-04-03T05:14:40.547731+0000","last_fullsized":"2024-04-03T05:14:40.547731+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-04-03T05:14:40.547541+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-04-03T05:14:40.547541+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.547541+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:15:41.406155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3508,"num_write":1155,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2379,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'344","reported_seq":1065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.838242+0000","last_change":"2024-04-03T05:14:25.838372+0000","last_active":"2024-04-03T05:14:25.838242+0000","last_peered":"2024-04-03T05:14:25.838242+0000","last_clean":"2024-04-03T05:14:25.838242+0000","last_became_active":"2024-04-03T03:38:57.882607+0000","last_became_peered":"2024-04-03T03:38:57.882607+0000","last_unstale":"2024-04-03T05:14:25.838242+0000","last_undegraded":"2024-04-03T05:14:25.838242+0000","last_fullsized":"2024-04-03T05:14:25.838242+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-04-03T05:14:25.838028+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-04-03T05:14:25.838028+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.838028+0000","objects_scrubbed":9,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:21.795448+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5935608,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":618,"num_read_kb":85965,"num_write":1280,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.245501+0000","last_change":"2024-04-03T05:14:49.245554+0000","last_active":"2024-04-03T05:14:49.245501+0000","last_peered":"2024-04-03T05:14:49.245501+0000","last_clean":"2024-04-03T05:14:49.245501+0000","last_became_active":"2024-04-03T03:38:28.723082+0000","last_became_peered":"2024-04-03T03:38:28.723082+0000","last_unstale":"2024-04-03T05:14:49.245501+0000","last_undegraded":"2024-04-03T05:14:49.245501+0000","last_fullsized":"2024-04-03T05:14:49.245501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:49.245312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:49.245312+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.245312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:02:58.629798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'64","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.232164+0000","last_change":"2024-04-03T05:14:51.232243+0000","last_active":"2024-04-03T05:14:51.232164+0000","last_peered":"2024-04-03T05:14:51.232164+0000","last_clean":"2024-04-03T05:14:51.232164+0000","last_became_active":"2024-04-03T03:38:30.729412+0000","last_became_peered":"2024-04-03T03:38:30.729412+0000","last_unstale":"2024-04-03T05:14:51.232164+0000","last_undegraded":"2024-04-03T05:14:51.232164+0000","last_fullsized":"2024-04-03T05:14:51.232164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-04-03T05:14:51.231966+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-04-03T05:14:51.231966+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.231966+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:26:41.484570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":60,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.816863+0000","last_change":"2024-04-03T05:14:33.816917+0000","last_active":"2024-04-03T05:14:33.816863+0000","last_peered":"2024-04-03T05:14:33.816863+0000","last_clean":"2024-04-03T05:14:33.816863+0000","last_became_active":"2024-04-03T03:38:32.747294+0000","last_became_peered":"2024-04-03T03:38:32.747294+0000","last_unstale":"2024-04-03T05:14:33.816863+0000","last_undegraded":"2024-04-03T05:14:33.816863+0000","last_fullsized":"2024-04-03T05:14:33.816863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.816656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.816656+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.816656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:32:17.430996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'98","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.270883+0000","last_change":"2024-04-03T05:14:30.270951+0000","last_active":"2024-04-03T05:14:30.270883+0000","last_peered":"2024-04-03T05:14:30.270883+0000","last_clean":"2024-04-03T05:14:30.270883+0000","last_became_active":"2024-04-03T03:38:34.737841+0000","last_became_peered":"2024-04-03T03:38:34.737841+0000","last_unstale":"2024-04-03T05:14:30.270883+0000","last_undegraded":"2024-04-03T05:14:30.270883+0000","last_fullsized":"2024-04-03T05:14:30.270883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'98","last_scrub_stamp":"2024-04-03T05:14:30.270694+0000","last_deep_scrub":"263'98","last_deep_scrub_stamp":"2024-04-03T05:14:30.270694+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.270694+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:32:59.118448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":225,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'411","reported_seq":1874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.295304+0000","last_change":"2024-04-03T05:14:48.295437+0000","last_active":"2024-04-03T05:14:48.295304+0000","last_peered":"2024-04-03T05:14:48.295304+0000","last_clean":"2024-04-03T05:14:48.295304+0000","last_became_active":"2024-04-03T03:38:26.715716+0000","last_became_peered":"2024-04-03T03:38:26.715716+0000","last_unstale":"2024-04-03T05:14:48.295304+0000","last_undegraded":"2024-04-03T05:14:48.295304+0000","last_fullsized":"2024-04-03T05:14:48.295304+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-04-03T05:14:48.295075+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-04-03T05:14:48.295075+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.295075+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":300,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:06:08.835194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2104,"num_read_kb":1969,"num_write":502,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":556,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'456","reported_seq":1142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.584116+0000","last_change":"2024-04-03T03:38:24.742857+0000","last_active":"2024-04-03T05:14:10.584116+0000","last_peered":"2024-04-03T05:14:10.584116+0000","last_clean":"2024-04-03T05:14:10.584116+0000","last_became_active":"2024-04-03T03:38:24.737281+0000","last_became_peered":"2024-04-03T03:38:24.737281+0000","last_unstale":"2024-04-03T05:14:10.584116+0000","last_undegraded":"2024-04-03T05:14:10.584116+0000","last_fullsized":"2024-04-03T05:14:10.584116+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448109,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":780,"num_read_kb":29467,"num_write":1404,"num_write_kb":33665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.862657+0000","last_change":"2024-04-03T05:14:39.862722+0000","last_active":"2024-04-03T05:14:39.862657+0000","last_peered":"2024-04-03T05:14:39.862657+0000","last_clean":"2024-04-03T05:14:39.862657+0000","last_became_active":"2024-04-03T03:38:28.735156+0000","last_became_peered":"2024-04-03T03:38:28.735156+0000","last_unstale":"2024-04-03T05:14:39.862657+0000","last_undegraded":"2024-04-03T05:14:39.862657+0000","last_fullsized":"2024-04-03T05:14:39.862657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:39.862425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:39.862425+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.862425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:50:40.422410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'329","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.219704+0000","last_change":"2024-04-03T05:14:42.219797+0000","last_active":"2024-04-03T05:14:42.219704+0000","last_peered":"2024-04-03T05:14:42.219704+0000","last_clean":"2024-04-03T05:14:42.219704+0000","last_became_active":"2024-04-03T03:38:30.733682+0000","last_became_peered":"2024-04-03T03:38:30.733682+0000","last_unstale":"2024-04-03T05:14:42.219704+0000","last_undegraded":"2024-04-03T05:14:42.219704+0000","last_fullsized":"2024-04-03T05:14:42.219704+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-04-03T05:14:42.219507+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-04-03T05:14:42.219507+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.219507+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:46:12.542793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42201,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1138,"num_write":422,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.242447+0000","last_change":"2024-04-03T05:14:27.242501+0000","last_active":"2024-04-03T05:14:27.242447+0000","last_peered":"2024-04-03T05:14:27.242447+0000","last_clean":"2024-04-03T05:14:27.242447+0000","last_became_active":"2024-04-03T03:38:32.733728+0000","last_became_peered":"2024-04-03T03:38:32.733728+0000","last_unstale":"2024-04-03T05:14:27.242447+0000","last_undegraded":"2024-04-03T05:14:27.242447+0000","last_fullsized":"2024-04-03T05:14:27.242447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.242249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.242249+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.242249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:08.047349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'154","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.251598+0000","last_change":"2024-04-03T05:14:22.251667+0000","last_active":"2024-04-03T05:14:22.251598+0000","last_peered":"2024-04-03T05:14:22.251598+0000","last_clean":"2024-04-03T05:14:22.251598+0000","last_became_active":"2024-04-03T03:38:34.755929+0000","last_became_peered":"2024-04-03T03:38:34.755929+0000","last_unstale":"2024-04-03T05:14:22.251598+0000","last_undegraded":"2024-04-03T05:14:22.251598+0000","last_fullsized":"2024-04-03T05:14:22.251598+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-04-03T05:14:22.251370+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-04-03T05:14:22.251370+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.251370+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:21:59.675735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":91,"num_write":329,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'736","reported_seq":2119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.257055+0000","last_change":"2024-04-03T05:14:46.257183+0000","last_active":"2024-04-03T05:14:46.257055+0000","last_peered":"2024-04-03T05:14:46.257055+0000","last_clean":"2024-04-03T05:14:46.257055+0000","last_became_active":"2024-04-03T03:38:26.723758+0000","last_became_peered":"2024-04-03T03:38:26.723758+0000","last_unstale":"2024-04-03T05:14:46.257055+0000","last_undegraded":"2024-04-03T05:14:46.257055+0000","last_fullsized":"2024-04-03T05:14:46.257055+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'736","last_scrub_stamp":"2024-04-03T05:14:46.256842+0000","last_deep_scrub":"263'736","last_deep_scrub_stamp":"2024-04-03T05:14:46.256842+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.256842+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:36.984427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3210,"num_read_kb":2838,"num_write":998,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'347","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.570905+0000","last_change":"2024-04-03T03:38:24.740315+0000","last_active":"2024-04-03T05:14:10.570905+0000","last_peered":"2024-04-03T05:14:10.570905+0000","last_clean":"2024-04-03T05:14:10.570905+0000","last_became_active":"2024-04-03T03:38:24.739968+0000","last_became_peered":"2024-04-03T03:38:24.739968+0000","last_unstale":"2024-04-03T05:14:10.570905+0000","last_undegraded":"2024-04-03T05:14:10.570905+0000","last_fullsized":"2024-04-03T05:14:10.570905+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303204,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":602,"num_read_kb":31745,"num_write":1185,"num_write_kb":30139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.274370+0000","last_change":"2024-04-03T05:14:29.274427+0000","last_active":"2024-04-03T05:14:29.274370+0000","last_peered":"2024-04-03T05:14:29.274370+0000","last_clean":"2024-04-03T05:14:29.274370+0000","last_became_active":"2024-04-03T03:38:28.723907+0000","last_became_peered":"2024-04-03T03:38:28.723907+0000","last_unstale":"2024-04-03T05:14:29.274370+0000","last_undegraded":"2024-04-03T05:14:29.274370+0000","last_fullsized":"2024-04-03T05:14:29.274370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:29.274155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:29.274155+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.274155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:51.335375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'317","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.823849+0000","last_change":"2024-04-03T05:14:47.823922+0000","last_active":"2024-04-03T05:14:47.823849+0000","last_peered":"2024-04-03T05:14:47.823849+0000","last_clean":"2024-04-03T05:14:47.823849+0000","last_became_active":"2024-04-03T03:38:30.732520+0000","last_became_peered":"2024-04-03T03:38:30.732520+0000","last_unstale":"2024-04-03T05:14:47.823849+0000","last_undegraded":"2024-04-03T05:14:47.823849+0000","last_fullsized":"2024-04-03T05:14:47.823849+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-04-03T05:14:47.823673+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-04-03T05:14:47.823673+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.823673+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:49:58.358283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49780,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1180,"num_write":410,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.189242+0000","last_change":"2024-04-03T05:14:32.189296+0000","last_active":"2024-04-03T05:14:32.189242+0000","last_peered":"2024-04-03T05:14:32.189242+0000","last_clean":"2024-04-03T05:14:32.189242+0000","last_became_active":"2024-04-03T03:38:32.748621+0000","last_became_peered":"2024-04-03T03:38:32.748621+0000","last_unstale":"2024-04-03T05:14:32.189242+0000","last_undegraded":"2024-04-03T05:14:32.189242+0000","last_fullsized":"2024-04-03T05:14:32.189242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:32.189053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:32.189053+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.189053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:20:39.713325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'377","reported_seq":2051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.136705+0000","last_change":"2024-04-03T05:14:46.136771+0000","last_active":"2024-04-03T05:14:46.136705+0000","last_peered":"2024-04-03T05:14:46.136705+0000","last_clean":"2024-04-03T05:14:46.136705+0000","last_became_active":"2024-04-03T03:38:26.711974+0000","last_became_peered":"2024-04-03T03:38:26.711974+0000","last_unstale":"2024-04-03T05:14:46.136705+0000","last_undegraded":"2024-04-03T05:14:46.136705+0000","last_fullsized":"2024-04-03T05:14:46.136705+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-04-03T05:14:46.136508+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-04-03T05:14:46.136508+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.136508+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:29:26.657175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2240,"num_write":411,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'349","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.569724+0000","last_change":"2024-04-03T03:38:24.717991+0000","last_active":"2024-04-03T05:14:10.569724+0000","last_peered":"2024-04-03T05:14:10.569724+0000","last_clean":"2024-04-03T05:14:10.569724+0000","last_became_active":"2024-04-03T03:38:24.715050+0000","last_became_peered":"2024-04-03T03:38:24.715050+0000","last_unstale":"2024-04-03T05:14:10.569724+0000","last_undegraded":"2024-04-03T05:14:10.569724+0000","last_fullsized":"2024-04-03T05:14:10.569724+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6617705,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":464,"num_read_kb":21769,"num_write":1174,"num_write_kb":53575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.212568+0000","last_change":"2024-04-03T05:14:45.212568+0000","last_active":"2024-04-03T05:14:45.212568+0000","last_peered":"2024-04-03T05:14:45.212568+0000","last_clean":"2024-04-03T05:14:45.212568+0000","last_became_active":"2024-04-03T03:38:28.716638+0000","last_became_peered":"2024-04-03T03:38:28.716638+0000","last_unstale":"2024-04-03T05:14:45.212568+0000","last_undegraded":"2024-04-03T05:14:45.212568+0000","last_fullsized":"2024-04-03T05:14:45.212568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:45.212324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:45.212324+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.212324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:22:12.859807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'514","reported_seq":1193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.511174+0000","last_change":"2024-04-03T05:14:39.511246+0000","last_active":"2024-04-03T05:14:39.511174+0000","last_peered":"2024-04-03T05:14:39.511174+0000","last_clean":"2024-04-03T05:14:39.511174+0000","last_became_active":"2024-04-03T03:38:30.725324+0000","last_became_peered":"2024-04-03T03:38:30.725324+0000","last_unstale":"2024-04-03T05:14:39.511174+0000","last_undegraded":"2024-04-03T05:14:39.511174+0000","last_fullsized":"2024-04-03T05:14:39.511174+0000","mapping_epoch":29,"log_start":"263'500","ondisk_log_start":"263'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'514","last_scrub_stamp":"2024-04-03T05:14:39.511001+0000","last_deep_scrub":"263'514","last_deep_scrub_stamp":"2024-04-03T05:14:39.511001+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.511001+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:27:25.632511+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":885,"num_read_kb":2163,"num_write":714,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.270791+0000","last_change":"2024-04-03T05:14:30.270846+0000","last_active":"2024-04-03T05:14:30.270791+0000","last_peered":"2024-04-03T05:14:30.270791+0000","last_clean":"2024-04-03T05:14:30.270791+0000","last_became_active":"2024-04-03T03:38:32.730456+0000","last_became_peered":"2024-04-03T03:38:32.730456+0000","last_unstale":"2024-04-03T05:14:30.270791+0000","last_undegraded":"2024-04-03T05:14:30.270791+0000","last_fullsized":"2024-04-03T05:14:30.270791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:30.270588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:30.270588+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.270588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:28:22.839549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'161","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.147352+0000","last_change":"2024-04-03T05:14:26.147513+0000","last_active":"2024-04-03T05:14:26.147352+0000","last_peered":"2024-04-03T05:14:26.147352+0000","last_clean":"2024-04-03T05:14:26.147352+0000","last_became_active":"2024-04-03T03:38:34.939244+0000","last_became_peered":"2024-04-03T03:38:34.939244+0000","last_unstale":"2024-04-03T05:14:26.147352+0000","last_undegraded":"2024-04-03T05:14:26.147352+0000","last_fullsized":"2024-04-03T05:14:26.147352+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-04-03T05:14:26.147094+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-04-03T05:14:26.147094+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.147094+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:50.462110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":238,"num_write":361,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'566","reported_seq":2136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.229963+0000","last_change":"2024-04-03T05:14:52.229963+0000","last_active":"2024-04-03T05:14:52.229963+0000","last_peered":"2024-04-03T05:14:52.229963+0000","last_clean":"2024-04-03T05:14:52.229963+0000","last_became_active":"2024-04-03T03:38:26.718375+0000","last_became_peered":"2024-04-03T03:38:26.718375+0000","last_unstale":"2024-04-03T05:14:52.229963+0000","last_undegraded":"2024-04-03T05:14:52.229963+0000","last_fullsized":"2024-04-03T05:14:52.229963+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'566","last_scrub_stamp":"2024-04-03T05:14:52.229713+0000","last_deep_scrub":"263'566","last_deep_scrub_stamp":"2024-04-03T05:14:52.229713+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.229713+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:16:00.784742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2911,"num_read_kb":2669,"num_write":774,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2394,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'320","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.572722+0000","last_change":"2024-04-03T05:14:51.572830+0000","last_active":"2024-04-03T05:14:51.572722+0000","last_peered":"2024-04-03T05:14:51.572722+0000","last_clean":"2024-04-03T05:14:51.572722+0000","last_became_active":"2024-04-03T03:38:24.730294+0000","last_became_peered":"2024-04-03T03:38:24.730294+0000","last_unstale":"2024-04-03T05:14:51.572722+0000","last_undegraded":"2024-04-03T05:14:51.572722+0000","last_fullsized":"2024-04-03T05:14:51.572722+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-04-03T05:14:51.572520+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-04-03T05:14:51.572520+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.572520+0000","objects_scrubbed":10,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:05:41.968418+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274297,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":474,"num_read_kb":62893,"num_write":1320,"num_write_kb":30207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.301408+0000","last_change":"2024-04-03T05:14:31.301463+0000","last_active":"2024-04-03T05:14:31.301408+0000","last_peered":"2024-04-03T05:14:31.301408+0000","last_clean":"2024-04-03T05:14:31.301408+0000","last_became_active":"2024-04-03T03:38:28.719692+0000","last_became_peered":"2024-04-03T03:38:28.719692+0000","last_unstale":"2024-04-03T05:14:31.301408+0000","last_undegraded":"2024-04-03T05:14:31.301408+0000","last_fullsized":"2024-04-03T05:14:31.301408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.301203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.301203+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.301203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:51.285253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'345","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.879929+0000","last_change":"2024-04-03T05:14:45.880117+0000","last_active":"2024-04-03T05:14:45.879929+0000","last_peered":"2024-04-03T05:14:45.879929+0000","last_clean":"2024-04-03T05:14:45.879929+0000","last_became_active":"2024-04-03T03:38:30.732529+0000","last_became_peered":"2024-04-03T03:38:30.732529+0000","last_unstale":"2024-04-03T05:14:45.879929+0000","last_undegraded":"2024-04-03T05:14:45.879929+0000","last_fullsized":"2024-04-03T05:14:45.879929+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-04-03T05:14:45.879706+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-04-03T05:14:45.879706+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.879706+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:44:36.980268+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":563,"num_read_kb":1112,"num_write":458,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.566913+0000","last_change":"2024-04-03T05:14:28.566972+0000","last_active":"2024-04-03T05:14:28.566913+0000","last_peered":"2024-04-03T05:14:28.566913+0000","last_clean":"2024-04-03T05:14:28.566913+0000","last_became_active":"2024-04-03T03:38:32.731752+0000","last_became_peered":"2024-04-03T03:38:32.731752+0000","last_unstale":"2024-04-03T05:14:28.566913+0000","last_undegraded":"2024-04-03T05:14:28.566913+0000","last_fullsized":"2024-04-03T05:14:28.566913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:28.566730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:28.566730+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.566730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:51.820450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'190","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.287079+0000","last_change":"2024-04-03T05:14:34.287156+0000","last_active":"2024-04-03T05:14:34.287079+0000","last_peered":"2024-04-03T05:14:34.287079+0000","last_clean":"2024-04-03T05:14:34.287079+0000","last_became_active":"2024-04-03T03:38:34.736663+0000","last_became_peered":"2024-04-03T03:38:34.736663+0000","last_unstale":"2024-04-03T05:14:34.287079+0000","last_undegraded":"2024-04-03T05:14:34.287079+0000","last_fullsized":"2024-04-03T05:14:34.287079+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-04-03T05:14:34.286879+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-04-03T05:14:34.286879+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.286879+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:47.107632+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":719,"num_read_kb":691,"num_write":524,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'751","reported_seq":2340,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:13:28.050944+0000","last_change":"2024-04-03T03:38:26.711611+0000","last_active":"2024-04-03T05:13:28.050944+0000","last_peered":"2024-04-03T05:13:28.050944+0000","last_clean":"2024-04-03T05:13:28.050944+0000","last_became_active":"2024-04-03T03:38:26.711214+0000","last_became_peered":"2024-04-03T03:38:26.711214+0000","last_unstale":"2024-04-03T05:13:28.050944+0000","last_undegraded":"2024-04-03T05:13:28.050944+0000","last_fullsized":"2024-04-03T05:13:28.050944+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:25.682394+0000","last_clean_scrub_stamp":"2024-04-03T03:38:25.682394+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3543,"num_read_kb":3207,"num_write":983,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'300","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.646361+0000","last_change":"2024-04-03T05:14:53.646449+0000","last_active":"2024-04-03T05:14:53.646361+0000","last_peered":"2024-04-03T05:14:53.646361+0000","last_clean":"2024-04-03T05:14:53.646361+0000","last_became_active":"2024-04-03T03:38:24.761330+0000","last_became_peered":"2024-04-03T03:38:24.761330+0000","last_unstale":"2024-04-03T05:14:53.646361+0000","last_undegraded":"2024-04-03T05:14:53.646361+0000","last_fullsized":"2024-04-03T05:14:53.646361+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-04-03T05:14:53.646133+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-04-03T05:14:53.646133+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.646133+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:48:55.991241+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4626676,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":410,"num_read_kb":53466,"num_write":1122,"num_write_kb":35897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.641798+0000","last_change":"2024-04-03T05:14:42.641854+0000","last_active":"2024-04-03T05:14:42.641798+0000","last_peered":"2024-04-03T05:14:42.641798+0000","last_clean":"2024-04-03T05:14:42.641798+0000","last_became_active":"2024-04-03T03:38:28.724296+0000","last_became_peered":"2024-04-03T03:38:28.724296+0000","last_unstale":"2024-04-03T05:14:42.641798+0000","last_undegraded":"2024-04-03T05:14:42.641798+0000","last_fullsized":"2024-04-03T05:14:42.641798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:42.641604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:42.641604+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.641604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:30:36.878798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'314","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.257381+0000","last_change":"2024-04-03T05:14:41.257456+0000","last_active":"2024-04-03T05:14:41.257381+0000","last_peered":"2024-04-03T05:14:41.257381+0000","last_clean":"2024-04-03T05:14:41.257381+0000","last_became_active":"2024-04-03T03:38:30.821335+0000","last_became_peered":"2024-04-03T03:38:30.821335+0000","last_unstale":"2024-04-03T05:14:41.257381+0000","last_undegraded":"2024-04-03T05:14:41.257381+0000","last_fullsized":"2024-04-03T05:14:41.257381+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-04-03T05:14:41.257199+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-04-03T05:14:41.257199+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.257199+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:26:24.431127+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45080,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":1115,"num_write":402,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.504584+0000","last_change":"2024-04-03T05:14:53.504584+0000","last_active":"2024-04-03T05:14:53.504584+0000","last_peered":"2024-04-03T05:14:53.504584+0000","last_clean":"2024-04-03T05:14:53.504584+0000","last_became_active":"2024-04-03T03:38:32.730954+0000","last_became_peered":"2024-04-03T03:38:32.730954+0000","last_unstale":"2024-04-03T05:14:53.504584+0000","last_undegraded":"2024-04-03T05:14:53.504584+0000","last_fullsized":"2024-04-03T05:14:53.504584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:53.504332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:53.504332+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.504332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:03:47.090395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'106","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.229393+0000","last_change":"2024-04-03T05:14:28.229531+0000","last_active":"2024-04-03T05:14:28.229393+0000","last_peered":"2024-04-03T05:14:28.229393+0000","last_clean":"2024-04-03T05:14:28.229393+0000","last_became_active":"2024-04-03T03:38:34.754544+0000","last_became_peered":"2024-04-03T03:38:34.754544+0000","last_unstale":"2024-04-03T05:14:28.229393+0000","last_undegraded":"2024-04-03T05:14:28.229393+0000","last_fullsized":"2024-04-03T05:14:28.229393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-04-03T05:14:28.229167+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-04-03T05:14:28.229167+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.229167+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:37.294628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":262,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'319","reported_seq":1744,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.386471+0000","last_change":"2024-04-03T05:14:40.386554+0000","last_active":"2024-04-03T05:14:40.386471+0000","last_peered":"2024-04-03T05:14:40.386471+0000","last_clean":"2024-04-03T05:14:40.386471+0000","last_became_active":"2024-04-03T03:38:26.720984+0000","last_became_peered":"2024-04-03T03:38:26.720984+0000","last_unstale":"2024-04-03T05:14:40.386471+0000","last_undegraded":"2024-04-03T05:14:40.386471+0000","last_fullsized":"2024-04-03T05:14:40.386471+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-04-03T05:14:40.386242+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-04-03T05:14:40.386242+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.386242+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:21:35.765971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1783,"num_read_kb":1722,"num_write":353,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'374","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.560275+0000","last_change":"2024-04-03T03:38:24.745501+0000","last_active":"2024-04-03T05:14:10.560275+0000","last_peered":"2024-04-03T05:14:10.560275+0000","last_clean":"2024-04-03T05:14:10.560275+0000","last_became_active":"2024-04-03T03:38:24.745183+0000","last_became_peered":"2024-04-03T03:38:24.745183+0000","last_unstale":"2024-04-03T05:14:10.560275+0000","last_undegraded":"2024-04-03T05:14:10.560275+0000","last_fullsized":"2024-04-03T05:14:10.560275+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5733043,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":528,"num_read_kb":13372,"num_write":1290,"num_write_kb":33178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.581746+0000","last_change":"2024-04-03T05:14:29.581798+0000","last_active":"2024-04-03T05:14:29.581746+0000","last_peered":"2024-04-03T05:14:29.581746+0000","last_clean":"2024-04-03T05:14:29.581746+0000","last_became_active":"2024-04-03T03:38:28.710708+0000","last_became_peered":"2024-04-03T03:38:28.710708+0000","last_unstale":"2024-04-03T05:14:29.581746+0000","last_undegraded":"2024-04-03T05:14:29.581746+0000","last_fullsized":"2024-04-03T05:14:29.581746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:29.581560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:29.581560+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.581560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:56:14.340545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'158","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.701372+0000","last_change":"2024-04-03T05:14:30.701450+0000","last_active":"2024-04-03T05:14:30.701372+0000","last_peered":"2024-04-03T05:14:30.701372+0000","last_clean":"2024-04-03T05:14:30.701372+0000","last_became_active":"2024-04-03T03:38:30.822452+0000","last_became_peered":"2024-04-03T03:38:30.822452+0000","last_unstale":"2024-04-03T05:14:30.701372+0000","last_undegraded":"2024-04-03T05:14:30.701372+0000","last_fullsized":"2024-04-03T05:14:30.701372+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-04-03T05:14:30.701180+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-04-03T05:14:30.701180+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.701180+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:17:50.340919+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":168,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12140,"num_omap_keys":36,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'526","reported_seq":4615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.267613+0000","last_change":"2024-04-03T05:14:25.267733+0000","last_active":"2024-04-03T05:14:25.267613+0000","last_peered":"2024-04-03T05:14:25.267613+0000","last_clean":"2024-04-03T05:14:25.267613+0000","last_became_active":"2024-04-03T03:38:32.734617+0000","last_became_peered":"2024-04-03T03:38:32.734617+0000","last_unstale":"2024-04-03T05:14:25.267613+0000","last_undegraded":"2024-04-03T05:14:25.267613+0000","last_fullsized":"2024-04-03T05:14:25.267613+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'526","last_scrub_stamp":"2024-04-03T05:14:25.267298+0000","last_deep_scrub":"263'526","last_deep_scrub_stamp":"2024-04-03T05:14:25.267298+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.267298+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:15:44.044015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'183","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.817411+0000","last_change":"2024-04-03T05:14:26.817474+0000","last_active":"2024-04-03T05:14:26.817411+0000","last_peered":"2024-04-03T05:14:26.817411+0000","last_clean":"2024-04-03T05:14:26.817411+0000","last_became_active":"2024-04-03T03:38:34.756694+0000","last_became_peered":"2024-04-03T03:38:34.756694+0000","last_unstale":"2024-04-03T05:14:26.817411+0000","last_undegraded":"2024-04-03T05:14:26.817411+0000","last_fullsized":"2024-04-03T05:14:26.817411+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-04-03T05:14:26.817208+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-04-03T05:14:26.817208+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.817208+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:13:30.094225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":410,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'392","reported_seq":2038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.730297+0000","last_change":"2024-04-03T05:14:37.730367+0000","last_active":"2024-04-03T05:14:37.730297+0000","last_peered":"2024-04-03T05:14:37.730297+0000","last_clean":"2024-04-03T05:14:37.730297+0000","last_became_active":"2024-04-03T03:38:26.744905+0000","last_became_peered":"2024-04-03T03:38:26.744905+0000","last_unstale":"2024-04-03T05:14:37.730297+0000","last_undegraded":"2024-04-03T05:14:37.730297+0000","last_fullsized":"2024-04-03T05:14:37.730297+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-04-03T05:14:37.730111+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-04-03T05:14:37.730111+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.730111+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:43:07.781322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2315,"num_read_kb":2222,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1435,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'372","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.252631+0000","last_change":"2024-04-03T05:14:20.252870+0000","last_active":"2024-04-03T05:14:20.252631+0000","last_peered":"2024-04-03T05:14:20.252631+0000","last_clean":"2024-04-03T05:14:20.252631+0000","last_became_active":"2024-04-03T03:38:58.350828+0000","last_became_peered":"2024-04-03T03:38:58.350828+0000","last_unstale":"2024-04-03T05:14:20.252631+0000","last_undegraded":"2024-04-03T05:14:20.252631+0000","last_fullsized":"2024-04-03T05:14:20.252631+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-04-03T05:14:20.252422+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-04-03T05:14:20.252422+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.252422+0000","objects_scrubbed":9,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:50:54.930268+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9469383,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":544,"num_read_kb":21295,"num_write":1304,"num_write_kb":30213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.879862+0000","last_change":"2024-04-03T05:14:37.879919+0000","last_active":"2024-04-03T05:14:37.879862+0000","last_peered":"2024-04-03T05:14:37.879862+0000","last_clean":"2024-04-03T05:14:37.879862+0000","last_became_active":"2024-04-03T03:38:28.726412+0000","last_became_peered":"2024-04-03T03:38:28.726412+0000","last_unstale":"2024-04-03T05:14:37.879862+0000","last_undegraded":"2024-04-03T05:14:37.879862+0000","last_fullsized":"2024-04-03T05:14:37.879862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:37.879666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:37.879666+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.879666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:28.818586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'387","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.398393+0000","last_change":"2024-04-03T05:14:36.398516+0000","last_active":"2024-04-03T05:14:36.398393+0000","last_peered":"2024-04-03T05:14:36.398393+0000","last_clean":"2024-04-03T05:14:36.398393+0000","last_became_active":"2024-04-03T03:38:30.721642+0000","last_became_peered":"2024-04-03T03:38:30.721642+0000","last_unstale":"2024-04-03T05:14:36.398393+0000","last_undegraded":"2024-04-03T05:14:36.398393+0000","last_fullsized":"2024-04-03T05:14:36.398393+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'387","last_scrub_stamp":"2024-04-03T05:14:36.398185+0000","last_deep_scrub":"263'387","last_deep_scrub_stamp":"2024-04-03T05:14:36.398185+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.398185+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:47.544229+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44870,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":590,"num_read_kb":1131,"num_write":454,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.262333+0000","last_change":"2024-04-03T05:14:37.262459+0000","last_active":"2024-04-03T05:14:37.262333+0000","last_peered":"2024-04-03T05:14:37.262333+0000","last_clean":"2024-04-03T05:14:37.262333+0000","last_became_active":"2024-04-03T03:38:32.739496+0000","last_became_peered":"2024-04-03T03:38:32.739496+0000","last_unstale":"2024-04-03T05:14:37.262333+0000","last_undegraded":"2024-04-03T05:14:37.262333+0000","last_fullsized":"2024-04-03T05:14:37.262333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:37.262108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:37.262108+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.262108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:24:14.833620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'93","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.772895+0000","last_change":"2024-04-03T05:14:28.773057+0000","last_active":"2024-04-03T05:14:28.772895+0000","last_peered":"2024-04-03T05:14:28.772895+0000","last_clean":"2024-04-03T05:14:28.772895+0000","last_became_active":"2024-04-03T03:38:34.751005+0000","last_became_peered":"2024-04-03T03:38:34.751005+0000","last_unstale":"2024-04-03T05:14:28.772895+0000","last_undegraded":"2024-04-03T05:14:28.772895+0000","last_fullsized":"2024-04-03T05:14:28.772895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'93","last_scrub_stamp":"2024-04-03T05:14:28.772679+0000","last_deep_scrub":"263'93","last_deep_scrub_stamp":"2024-04-03T05:14:28.772679+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.772679+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:51:16.361362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":214,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'781","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.668498+0000","last_change":"2024-04-03T05:14:39.668563+0000","last_active":"2024-04-03T05:14:39.668498+0000","last_peered":"2024-04-03T05:14:39.668498+0000","last_clean":"2024-04-03T05:14:39.668498+0000","last_became_active":"2024-04-03T03:38:26.745135+0000","last_became_peered":"2024-04-03T03:38:26.745135+0000","last_unstale":"2024-04-03T05:14:39.668498+0000","last_undegraded":"2024-04-03T05:14:39.668498+0000","last_fullsized":"2024-04-03T05:14:39.668498+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'781","last_scrub_stamp":"2024-04-03T05:14:39.668301+0000","last_deep_scrub":"263'781","last_deep_scrub_stamp":"2024-04-03T05:14:39.668301+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.668301+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:08:38.214904+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3471,"num_read_kb":3079,"num_write":1070,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'292","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.570764+0000","last_change":"2024-04-03T03:38:24.744318+0000","last_active":"2024-04-03T05:14:10.570764+0000","last_peered":"2024-04-03T05:14:10.570764+0000","last_clean":"2024-04-03T05:14:10.570764+0000","last_became_active":"2024-04-03T03:38:24.743710+0000","last_became_peered":"2024-04-03T03:38:24.743710+0000","last_unstale":"2024-04-03T05:14:10.570764+0000","last_undegraded":"2024-04-03T05:14:10.570764+0000","last_fullsized":"2024-04-03T05:14:10.570764+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":414,"num_read_kb":32346,"num_write":1024,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.295519+0000","last_change":"2024-04-03T05:14:49.295591+0000","last_active":"2024-04-03T05:14:49.295519+0000","last_peered":"2024-04-03T05:14:49.295519+0000","last_clean":"2024-04-03T05:14:49.295519+0000","last_became_active":"2024-04-03T03:38:28.731547+0000","last_became_peered":"2024-04-03T03:38:28.731547+0000","last_unstale":"2024-04-03T05:14:49.295519+0000","last_undegraded":"2024-04-03T05:14:49.295519+0000","last_fullsized":"2024-04-03T05:14:49.295519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:49.295315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:49.295315+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.295315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:59:58.830081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'314","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:07.942547+0000","last_change":"2024-04-03T03:38:30.733183+0000","last_active":"2024-04-03T05:14:07.942547+0000","last_peered":"2024-04-03T05:14:07.942547+0000","last_clean":"2024-04-03T05:14:07.942547+0000","last_became_active":"2024-04-03T03:38:30.732095+0000","last_became_peered":"2024-04-03T03:38:30.732095+0000","last_unstale":"2024-04-03T05:14:07.942547+0000","last_undegraded":"2024-04-03T05:14:07.942547+0000","last_fullsized":"2024-04-03T05:14:07.942547+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1184,"num_write":416,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.285076+0000","last_change":"2024-04-03T05:14:28.285133+0000","last_active":"2024-04-03T05:14:28.285076+0000","last_peered":"2024-04-03T05:14:28.285076+0000","last_clean":"2024-04-03T05:14:28.285076+0000","last_became_active":"2024-04-03T03:38:32.743994+0000","last_became_peered":"2024-04-03T03:38:32.743994+0000","last_unstale":"2024-04-03T05:14:28.285076+0000","last_undegraded":"2024-04-03T05:14:28.285076+0000","last_fullsized":"2024-04-03T05:14:28.285076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:28.284861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:28.284861+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.284861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:02:36.856459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'90","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.095153+0000","last_change":"2024-04-03T05:14:25.095237+0000","last_active":"2024-04-03T05:14:25.095153+0000","last_peered":"2024-04-03T05:14:25.095153+0000","last_clean":"2024-04-03T05:14:25.095153+0000","last_became_active":"2024-04-03T03:38:34.941122+0000","last_became_peered":"2024-04-03T03:38:34.941122+0000","last_unstale":"2024-04-03T05:14:25.095153+0000","last_undegraded":"2024-04-03T05:14:25.095153+0000","last_fullsized":"2024-04-03T05:14:25.095153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'90","last_scrub_stamp":"2024-04-03T05:14:25.094941+0000","last_deep_scrub":"263'90","last_deep_scrub_stamp":"2024-04-03T05:14:25.094941+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.094941+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:14:54.760676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'828","reported_seq":2469,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:56.239900+0000","last_change":"2024-04-03T05:14:56.240071+0000","last_active":"2024-04-03T05:14:56.239900+0000","last_peered":"2024-04-03T05:14:56.239900+0000","last_clean":"2024-04-03T05:14:56.239900+0000","last_became_active":"2024-04-03T03:38:26.710804+0000","last_became_peered":"2024-04-03T03:38:26.710804+0000","last_unstale":"2024-04-03T05:14:56.239900+0000","last_undegraded":"2024-04-03T05:14:56.239900+0000","last_fullsized":"2024-04-03T05:14:56.239900+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'828","last_scrub_stamp":"2024-04-03T05:14:56.239684+0000","last_deep_scrub":"263'828","last_deep_scrub_stamp":"2024-04-03T05:14:56.239684+0000","last_clean_scrub_stamp":"2024-04-03T05:14:56.239684+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:20:11.483374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3882,"num_read_kb":3472,"num_write":1106,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":949,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'370","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.808999+0000","last_change":"2024-04-03T03:38:24.727210+0000","last_active":"2024-04-03T05:14:15.808999+0000","last_peered":"2024-04-03T05:14:15.808999+0000","last_clean":"2024-04-03T05:14:15.808999+0000","last_became_active":"2024-04-03T03:38:24.726765+0000","last_became_peered":"2024-04-03T03:38:24.726765+0000","last_unstale":"2024-04-03T05:14:15.808999+0000","last_undegraded":"2024-04-03T05:14:15.808999+0000","last_fullsized":"2024-04-03T05:14:15.808999+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975468,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":544,"num_read_kb":31092,"num_write":1278,"num_write_kb":58109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.607558+0000","last_change":"2024-04-03T05:14:44.607643+0000","last_active":"2024-04-03T05:14:44.607558+0000","last_peered":"2024-04-03T05:14:44.607558+0000","last_clean":"2024-04-03T05:14:44.607558+0000","last_became_active":"2024-04-03T03:38:28.725139+0000","last_became_peered":"2024-04-03T03:38:28.725139+0000","last_unstale":"2024-04-03T05:14:44.607558+0000","last_undegraded":"2024-04-03T05:14:44.607558+0000","last_fullsized":"2024-04-03T05:14:44.607558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:44.607355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:44.607355+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.607355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:50:46.231711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'259","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.191236+0000","last_change":"2024-04-03T03:38:30.721488+0000","last_active":"2024-04-03T05:14:10.191236+0000","last_peered":"2024-04-03T05:14:10.191236+0000","last_clean":"2024-04-03T05:14:10.191236+0000","last_became_active":"2024-04-03T03:38:30.719983+0000","last_became_peered":"2024-04-03T03:38:30.719983+0000","last_unstale":"2024-04-03T05:14:10.191236+0000","last_undegraded":"2024-04-03T05:14:10.191236+0000","last_fullsized":"2024-04-03T05:14:10.191236+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46477,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":1098,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.615281+0000","last_change":"2024-04-03T05:14:27.615333+0000","last_active":"2024-04-03T05:14:27.615281+0000","last_peered":"2024-04-03T05:14:27.615281+0000","last_clean":"2024-04-03T05:14:27.615281+0000","last_became_active":"2024-04-03T03:38:32.728438+0000","last_became_peered":"2024-04-03T03:38:32.728438+0000","last_unstale":"2024-04-03T05:14:27.615281+0000","last_undegraded":"2024-04-03T05:14:27.615281+0000","last_fullsized":"2024-04-03T05:14:27.615281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.615083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.615083+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.615083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:46:21.652566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'139","reported_seq":1191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.821692+0000","last_change":"2024-04-03T05:14:29.821852+0000","last_active":"2024-04-03T05:14:29.821692+0000","last_peered":"2024-04-03T05:14:29.821692+0000","last_clean":"2024-04-03T05:14:29.821692+0000","last_became_active":"2024-04-03T03:38:34.748329+0000","last_became_peered":"2024-04-03T03:38:34.748329+0000","last_unstale":"2024-04-03T05:14:29.821692+0000","last_undegraded":"2024-04-03T05:14:29.821692+0000","last_fullsized":"2024-04-03T05:14:29.821692+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-04-03T05:14:29.821474+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-04-03T05:14:29.821474+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.821474+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:03.047582+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":680,"num_read_kb":679,"num_write":303,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'715","reported_seq":2152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.602351+0000","last_change":"2024-04-03T05:14:49.602450+0000","last_active":"2024-04-03T05:14:49.602351+0000","last_peered":"2024-04-03T05:14:49.602351+0000","last_clean":"2024-04-03T05:14:49.602351+0000","last_became_active":"2024-04-03T03:38:26.742044+0000","last_became_peered":"2024-04-03T03:38:26.742044+0000","last_unstale":"2024-04-03T05:14:49.602351+0000","last_undegraded":"2024-04-03T05:14:49.602351+0000","last_fullsized":"2024-04-03T05:14:49.602351+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'715","last_scrub_stamp":"2024-04-03T05:14:49.602155+0000","last_deep_scrub":"263'715","last_deep_scrub_stamp":"2024-04-03T05:14:49.602155+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.602155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:14:03.008984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3199,"num_read_kb":2853,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'338","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:14.448612+0000","last_change":"2024-04-03T03:38:24.741033+0000","last_active":"2024-04-03T05:14:14.448612+0000","last_peered":"2024-04-03T05:14:14.448612+0000","last_clean":"2024-04-03T05:14:14.448612+0000","last_became_active":"2024-04-03T03:38:24.740329+0000","last_became_peered":"2024-04-03T03:38:24.740329+0000","last_unstale":"2024-04-03T05:14:14.448612+0000","last_undegraded":"2024-04-03T05:14:14.448612+0000","last_fullsized":"2024-04-03T05:14:14.448612+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050233,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":56728,"num_write":1264,"num_write_kb":35698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.621352+0000","last_change":"2024-04-03T05:14:35.621415+0000","last_active":"2024-04-03T05:14:35.621352+0000","last_peered":"2024-04-03T05:14:35.621352+0000","last_clean":"2024-04-03T05:14:35.621352+0000","last_became_active":"2024-04-03T03:38:28.725225+0000","last_became_peered":"2024-04-03T03:38:28.725225+0000","last_unstale":"2024-04-03T05:14:35.621352+0000","last_undegraded":"2024-04-03T05:14:35.621352+0000","last_fullsized":"2024-04-03T05:14:35.621352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:35.621162+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:35.621162+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.621162+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:33:10.739210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'333","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.379020+0000","last_change":"2024-04-03T03:38:30.718060+0000","last_active":"2024-04-03T05:14:10.379020+0000","last_peered":"2024-04-03T05:14:10.379020+0000","last_clean":"2024-04-03T05:14:10.379020+0000","last_became_active":"2024-04-03T03:38:30.717323+0000","last_became_peered":"2024-04-03T03:38:30.717323+0000","last_unstale":"2024-04-03T05:14:10.379020+0000","last_undegraded":"2024-04-03T05:14:10.379020+0000","last_fullsized":"2024-04-03T05:14:10.379020+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:29.694457+0000","last_clean_scrub_stamp":"2024-04-03T03:38:29.694457+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41938,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1119,"num_write":416,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.222763+0000","last_change":"2024-04-03T05:14:36.222883+0000","last_active":"2024-04-03T05:14:36.222763+0000","last_peered":"2024-04-03T05:14:36.222763+0000","last_clean":"2024-04-03T05:14:36.222763+0000","last_became_active":"2024-04-03T03:38:32.743076+0000","last_became_peered":"2024-04-03T03:38:32.743076+0000","last_unstale":"2024-04-03T05:14:36.222763+0000","last_undegraded":"2024-04-03T05:14:36.222763+0000","last_fullsized":"2024-04-03T05:14:36.222763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:36.222537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:36.222537+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.222537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:14:35.938418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'78","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.535115+0000","last_change":"2024-04-03T05:14:22.535115+0000","last_active":"2024-04-03T05:14:22.535115+0000","last_peered":"2024-04-03T05:14:22.535115+0000","last_clean":"2024-04-03T05:14:22.535115+0000","last_became_active":"2024-04-03T03:38:34.749644+0000","last_became_peered":"2024-04-03T03:38:34.749644+0000","last_unstale":"2024-04-03T05:14:22.535115+0000","last_undegraded":"2024-04-03T05:14:22.535115+0000","last_fullsized":"2024-04-03T05:14:22.535115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-04-03T05:14:22.534825+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-04-03T05:14:22.534825+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.534825+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:40:34.618691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":90,"num_write":191,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'756","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.575369+0000","last_change":"2024-04-03T05:14:34.575435+0000","last_active":"2024-04-03T05:14:34.575369+0000","last_peered":"2024-04-03T05:14:34.575369+0000","last_clean":"2024-04-03T05:14:34.575369+0000","last_became_active":"2024-04-03T03:38:26.721951+0000","last_became_peered":"2024-04-03T03:38:26.721951+0000","last_unstale":"2024-04-03T05:14:34.575369+0000","last_undegraded":"2024-04-03T05:14:34.575369+0000","last_fullsized":"2024-04-03T05:14:34.575369+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'756","last_scrub_stamp":"2024-04-03T05:14:34.575178+0000","last_deep_scrub":"263'756","last_deep_scrub_stamp":"2024-04-03T05:14:34.575178+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.575178+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:28:43.629233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3698,"num_read_kb":3347,"num_write":1000,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2630,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'304","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.183387+0000","last_change":"2024-04-03T05:14:41.183595+0000","last_active":"2024-04-03T05:14:41.183387+0000","last_peered":"2024-04-03T05:14:41.183387+0000","last_clean":"2024-04-03T05:14:41.183387+0000","last_became_active":"2024-04-03T03:38:24.741407+0000","last_became_peered":"2024-04-03T03:38:24.741407+0000","last_unstale":"2024-04-03T05:14:41.183387+0000","last_undegraded":"2024-04-03T05:14:41.183387+0000","last_fullsized":"2024-04-03T05:14:41.183387+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-04-03T05:14:41.183060+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-04-03T05:14:41.183060+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.183060+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:08:50.383669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":24965,"num_write":1150,"num_write_kb":36078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1408","reported_seq":2758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.571664+0000","last_change":"2024-04-03T05:14:42.571727+0000","last_active":"2024-04-03T05:14:42.571664+0000","last_peered":"2024-04-03T05:14:42.571664+0000","last_clean":"2024-04-03T05:14:42.571664+0000","last_became_active":"2024-04-03T03:38:26.719386+0000","last_became_peered":"2024-04-03T03:38:26.719386+0000","last_unstale":"2024-04-03T05:14:42.571664+0000","last_undegraded":"2024-04-03T05:14:42.571664+0000","last_fullsized":"2024-04-03T05:14:42.571664+0000","mapping_epoch":25,"log_start":"263'1300","ondisk_log_start":"263'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1408","last_scrub_stamp":"2024-04-03T05:14:42.571459+0000","last_deep_scrub":"263'1408","last_deep_scrub_stamp":"2024-04-03T05:14:42.571459+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.571459+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":1300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:57:22.982576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5587,"num_read_kb":4776,"num_write":2003,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'265","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.494584+0000","last_change":"2024-04-03T05:14:36.494678+0000","last_active":"2024-04-03T05:14:36.494584+0000","last_peered":"2024-04-03T05:14:36.494584+0000","last_clean":"2024-04-03T05:14:36.494584+0000","last_became_active":"2024-04-03T03:38:24.748369+0000","last_became_peered":"2024-04-03T03:38:24.748369+0000","last_unstale":"2024-04-03T05:14:36.494584+0000","last_undegraded":"2024-04-03T05:14:36.494584+0000","last_fullsized":"2024-04-03T05:14:36.494584+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'265","last_scrub_stamp":"2024-04-03T05:14:36.494353+0000","last_deep_scrub":"263'265","last_deep_scrub_stamp":"2024-04-03T05:14:36.494353+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.494353+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:28:34.312534+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050494,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":45141,"num_write":1016,"num_write_kb":24649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'763","reported_seq":2395,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.493269+0000","last_change":"2024-04-03T05:14:40.493335+0000","last_active":"2024-04-03T05:14:40.493269+0000","last_peered":"2024-04-03T05:14:40.493269+0000","last_clean":"2024-04-03T05:14:40.493269+0000","last_became_active":"2024-04-03T03:38:26.713821+0000","last_became_peered":"2024-04-03T03:38:26.713821+0000","last_unstale":"2024-04-03T05:14:40.493269+0000","last_undegraded":"2024-04-03T05:14:40.493269+0000","last_fullsized":"2024-04-03T05:14:40.493269+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-04-03T05:14:40.493077+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-04-03T05:14:40.493077+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.493077+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:32:57.230029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3127,"num_write":983,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'367","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.711941+0000","last_change":"2024-04-03T03:38:24.741935+0000","last_active":"2024-04-03T05:14:16.711941+0000","last_peered":"2024-04-03T05:14:16.711941+0000","last_clean":"2024-04-03T05:14:16.711941+0000","last_became_active":"2024-04-03T03:38:24.741322+0000","last_became_peered":"2024-04-03T03:38:24.741322+0000","last_unstale":"2024-04-03T05:14:16.711941+0000","last_undegraded":"2024-04-03T05:14:16.711941+0000","last_fullsized":"2024-04-03T05:14:16.711941+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":110805,"num_write":1222,"num_write_kb":46785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'796","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.540276+0000","last_change":"2024-04-03T05:14:44.540357+0000","last_active":"2024-04-03T05:14:44.540276+0000","last_peered":"2024-04-03T05:14:44.540276+0000","last_clean":"2024-04-03T05:14:44.540276+0000","last_became_active":"2024-04-03T03:38:26.718895+0000","last_became_peered":"2024-04-03T03:38:26.718895+0000","last_unstale":"2024-04-03T05:14:44.540276+0000","last_undegraded":"2024-04-03T05:14:44.540276+0000","last_fullsized":"2024-04-03T05:14:44.540276+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-04-03T05:14:44.540078+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-04-03T05:14:44.540078+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.540078+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:11:23.316758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3511,"num_read_kb":3115,"num_write":1065,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'355","reported_seq":1147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.281665+0000","last_change":"2024-04-03T05:14:22.281665+0000","last_active":"2024-04-03T05:14:22.281665+0000","last_peered":"2024-04-03T05:14:22.281665+0000","last_clean":"2024-04-03T05:14:22.281665+0000","last_became_active":"2024-04-03T03:38:58.349944+0000","last_became_peered":"2024-04-03T03:38:58.349944+0000","last_unstale":"2024-04-03T05:14:22.281665+0000","last_undegraded":"2024-04-03T05:14:22.281665+0000","last_fullsized":"2024-04-03T05:14:22.281665+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-04-03T05:14:22.281372+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-04-03T05:14:22.281372+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.281372+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:11.179395+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":861,"num_read_kb":89019,"num_write":1362,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1191","reported_seq":2766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.254135+0000","last_change":"2024-04-03T05:14:54.254307+0000","last_active":"2024-04-03T05:14:54.254135+0000","last_peered":"2024-04-03T05:14:54.254135+0000","last_clean":"2024-04-03T05:14:54.254135+0000","last_became_active":"2024-04-03T03:38:26.715042+0000","last_became_peered":"2024-04-03T03:38:26.715042+0000","last_unstale":"2024-04-03T05:14:54.254135+0000","last_undegraded":"2024-04-03T05:14:54.254135+0000","last_fullsized":"2024-04-03T05:14:54.254135+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1191","last_scrub_stamp":"2024-04-03T05:14:54.253919+0000","last_deep_scrub":"263'1191","last_deep_scrub_stamp":"2024-04-03T05:14:54.253919+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.253919+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":1100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:26:25.573770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5057,"num_read_kb":4409,"num_write":1655,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1663,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'301","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.069802+0000","last_change":"2024-04-03T05:14:24.070042+0000","last_active":"2024-04-03T05:14:24.069802+0000","last_peered":"2024-04-03T05:14:24.069802+0000","last_clean":"2024-04-03T05:14:24.069802+0000","last_became_active":"2024-04-03T03:38:58.350321+0000","last_became_peered":"2024-04-03T03:38:58.350321+0000","last_unstale":"2024-04-03T05:14:24.069802+0000","last_undegraded":"2024-04-03T05:14:24.069802+0000","last_fullsized":"2024-04-03T05:14:24.069802+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-04-03T05:14:24.069542+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-04-03T05:14:24.069542+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.069542+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:05:52.218774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550052,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":66631,"num_write":1085,"num_write_kb":28536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'744","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.638883+0000","last_change":"2024-04-03T05:14:43.638950+0000","last_active":"2024-04-03T05:14:43.638883+0000","last_peered":"2024-04-03T05:14:43.638883+0000","last_clean":"2024-04-03T05:14:43.638883+0000","last_became_active":"2024-04-03T03:38:26.744330+0000","last_became_peered":"2024-04-03T03:38:26.744330+0000","last_unstale":"2024-04-03T05:14:43.638883+0000","last_undegraded":"2024-04-03T05:14:43.638883+0000","last_fullsized":"2024-04-03T05:14:43.638883+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'744","last_scrub_stamp":"2024-04-03T05:14:43.638672+0000","last_deep_scrub":"263'744","last_deep_scrub_stamp":"2024-04-03T05:14:43.638672+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.638672+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:45:53.347894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3386,"num_read_kb":3032,"num_write":1008,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":401,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'326","reported_seq":1015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.520251+0000","last_change":"2024-04-03T05:14:47.520364+0000","last_active":"2024-04-03T05:14:47.520251+0000","last_peered":"2024-04-03T05:14:47.520251+0000","last_clean":"2024-04-03T05:14:47.520251+0000","last_became_active":"2024-04-03T03:38:24.707626+0000","last_became_peered":"2024-04-03T03:38:24.707626+0000","last_unstale":"2024-04-03T05:14:47.520251+0000","last_undegraded":"2024-04-03T05:14:47.520251+0000","last_fullsized":"2024-04-03T05:14:47.520251+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-04-03T05:14:47.520049+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-04-03T05:14:47.520049+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.520049+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:17:14.577095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":9991,"num_write":1303,"num_write_kb":25388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'428","reported_seq":1826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.229856+0000","last_change":"2024-04-03T05:14:45.229936+0000","last_active":"2024-04-03T05:14:45.229856+0000","last_peered":"2024-04-03T05:14:45.229856+0000","last_clean":"2024-04-03T05:14:45.229856+0000","last_became_active":"2024-04-03T03:38:26.725513+0000","last_became_peered":"2024-04-03T03:38:26.725513+0000","last_unstale":"2024-04-03T05:14:45.229856+0000","last_undegraded":"2024-04-03T05:14:45.229856+0000","last_fullsized":"2024-04-03T05:14:45.229856+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-04-03T05:14:45.229671+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-04-03T05:14:45.229671+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.229671+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:19:06.343396+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2235,"num_read_kb":2034,"num_write":556,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":637,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'284","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.181156+0000","last_change":"2024-04-03T05:14:42.181259+0000","last_active":"2024-04-03T05:14:42.181156+0000","last_peered":"2024-04-03T05:14:42.181156+0000","last_clean":"2024-04-03T05:14:42.181156+0000","last_became_active":"2024-04-03T03:38:24.748923+0000","last_became_peered":"2024-04-03T03:38:24.748923+0000","last_unstale":"2024-04-03T05:14:42.181156+0000","last_undegraded":"2024-04-03T05:14:42.181156+0000","last_fullsized":"2024-04-03T05:14:42.181156+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-04-03T05:14:42.180927+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-04-03T05:14:42.180927+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.180927+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:59:06.333314+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306678,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":42672,"num_write":1032,"num_write_kb":23960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'707","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.139677+0000","last_change":"2024-04-03T05:14:47.139769+0000","last_active":"2024-04-03T05:14:47.139677+0000","last_peered":"2024-04-03T05:14:47.139677+0000","last_clean":"2024-04-03T05:14:47.139677+0000","last_became_active":"2024-04-03T03:38:26.716359+0000","last_became_peered":"2024-04-03T03:38:26.716359+0000","last_unstale":"2024-04-03T05:14:47.139677+0000","last_undegraded":"2024-04-03T05:14:47.139677+0000","last_fullsized":"2024-04-03T05:14:47.139677+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'707","last_scrub_stamp":"2024-04-03T05:14:47.139444+0000","last_deep_scrub":"263'707","last_deep_scrub_stamp":"2024-04-03T05:14:47.139444+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.139444+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:41:32.088135+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3142,"num_read_kb":2808,"num_write":934,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":794,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'337","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.574906+0000","last_change":"2024-04-03T03:38:24.718541+0000","last_active":"2024-04-03T05:14:10.574906+0000","last_peered":"2024-04-03T05:14:10.574906+0000","last_clean":"2024-04-03T05:14:10.574906+0000","last_became_active":"2024-04-03T03:38:24.716473+0000","last_became_peered":"2024-04-03T03:38:24.716473+0000","last_unstale":"2024-04-03T05:14:10.574906+0000","last_undegraded":"2024-04-03T05:14:10.574906+0000","last_fullsized":"2024-04-03T05:14:10.574906+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3764519,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":31436,"num_write":1237,"num_write_kb":38562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'398","reported_seq":1856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:56.233092+0000","last_change":"2024-04-03T05:14:56.233250+0000","last_active":"2024-04-03T05:14:56.233092+0000","last_peered":"2024-04-03T05:14:56.233092+0000","last_clean":"2024-04-03T05:14:56.233092+0000","last_became_active":"2024-04-03T03:38:26.716435+0000","last_became_peered":"2024-04-03T03:38:26.716435+0000","last_unstale":"2024-04-03T05:14:56.233092+0000","last_undegraded":"2024-04-03T05:14:56.233092+0000","last_fullsized":"2024-04-03T05:14:56.233092+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-04-03T05:14:56.232775+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-04-03T05:14:56.232775+0000","last_clean_scrub_stamp":"2024-04-03T05:14:56.232775+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:10:52.625793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2146,"num_read_kb":2018,"num_write":509,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'422","reported_seq":1220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:13.872128+0000","last_change":"2024-04-03T03:38:24.741361+0000","last_active":"2024-04-03T05:14:13.872128+0000","last_peered":"2024-04-03T05:14:13.872128+0000","last_clean":"2024-04-03T05:14:13.872128+0000","last_became_active":"2024-04-03T03:38:24.740664+0000","last_became_peered":"2024-04-03T03:38:24.740664+0000","last_unstale":"2024-04-03T05:14:13.872128+0000","last_undegraded":"2024-04-03T05:14:13.872128+0000","last_fullsized":"2024-04-03T05:14:13.872128+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10717012,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":923,"num_read_kb":68467,"num_write":1504,"num_write_kb":54703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'408","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.704092+0000","last_change":"2024-04-03T05:14:38.704159+0000","last_active":"2024-04-03T05:14:38.704092+0000","last_peered":"2024-04-03T05:14:38.704092+0000","last_clean":"2024-04-03T05:14:38.704092+0000","last_became_active":"2024-04-03T03:38:26.751399+0000","last_became_peered":"2024-04-03T03:38:26.751399+0000","last_unstale":"2024-04-03T05:14:38.704092+0000","last_undegraded":"2024-04-03T05:14:38.704092+0000","last_fullsized":"2024-04-03T05:14:38.704092+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-04-03T05:14:38.703897+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-04-03T05:14:38.703897+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.703897+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:30:31.421072+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2116,"num_write":486,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'294","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.560501+0000","last_change":"2024-04-03T03:38:24.718194+0000","last_active":"2024-04-03T05:14:10.560501+0000","last_peered":"2024-04-03T05:14:10.560501+0000","last_clean":"2024-04-03T05:14:10.560501+0000","last_became_active":"2024-04-03T03:38:24.715106+0000","last_became_peered":"2024-04-03T03:38:24.715106+0000","last_unstale":"2024-04-03T05:14:10.560501+0000","last_undegraded":"2024-04-03T05:14:10.560501+0000","last_fullsized":"2024-04-03T05:14:10.560501+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642458,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":15103,"num_write":965,"num_write_kb":22507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'630","reported_seq":2288,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.417899+0000","last_change":"2024-04-03T05:14:39.417964+0000","last_active":"2024-04-03T05:14:39.417899+0000","last_peered":"2024-04-03T05:14:39.417899+0000","last_clean":"2024-04-03T05:14:39.417899+0000","last_became_active":"2024-04-03T03:38:26.717085+0000","last_became_peered":"2024-04-03T03:38:26.717085+0000","last_unstale":"2024-04-03T05:14:39.417899+0000","last_undegraded":"2024-04-03T05:14:39.417899+0000","last_fullsized":"2024-04-03T05:14:39.417899+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'630","last_scrub_stamp":"2024-04-03T05:14:39.417694+0000","last_deep_scrub":"263'630","last_deep_scrub_stamp":"2024-04-03T05:14:39.417694+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.417694+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:13:02.978944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3119,"num_read_kb":2815,"num_write":838,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'344","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.369461+0000","last_change":"2024-04-03T05:14:46.369715+0000","last_active":"2024-04-03T05:14:46.369461+0000","last_peered":"2024-04-03T05:14:46.369461+0000","last_clean":"2024-04-03T05:14:46.369461+0000","last_became_active":"2024-04-03T03:38:24.755345+0000","last_became_peered":"2024-04-03T03:38:24.755345+0000","last_unstale":"2024-04-03T05:14:46.369461+0000","last_undegraded":"2024-04-03T05:14:46.369461+0000","last_fullsized":"2024-04-03T05:14:46.369461+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-04-03T05:14:46.369226+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-04-03T05:14:46.369226+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.369226+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:50:14.322251+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194329,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":14159,"num_write":1284,"num_write_kb":40251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'703","reported_seq":2150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.715139+0000","last_change":"2024-04-03T05:14:35.715213+0000","last_active":"2024-04-03T05:14:35.715139+0000","last_peered":"2024-04-03T05:14:35.715139+0000","last_clean":"2024-04-03T05:14:35.715139+0000","last_became_active":"2024-04-03T03:38:26.745102+0000","last_became_peered":"2024-04-03T03:38:26.745102+0000","last_unstale":"2024-04-03T05:14:35.715139+0000","last_undegraded":"2024-04-03T05:14:35.715139+0000","last_fullsized":"2024-04-03T05:14:35.715139+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'703","last_scrub_stamp":"2024-04-03T05:14:35.714946+0000","last_deep_scrub":"263'703","last_deep_scrub_stamp":"2024-04-03T05:14:35.714946+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.714946+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:24:00.065707+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3146,"num_read_kb":2819,"num_write":922,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":951,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'360","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.576035+0000","last_change":"2024-04-03T03:38:24.729779+0000","last_active":"2024-04-03T05:14:10.576035+0000","last_peered":"2024-04-03T05:14:10.576035+0000","last_clean":"2024-04-03T05:14:10.576035+0000","last_became_active":"2024-04-03T03:38:24.729149+0000","last_became_peered":"2024-04-03T03:38:24.729149+0000","last_unstale":"2024-04-03T05:14:10.576035+0000","last_undegraded":"2024-04-03T05:14:10.576035+0000","last_fullsized":"2024-04-03T05:14:10.576035+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3498280,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":538,"num_read_kb":15990,"num_write":1205,"num_write_kb":30672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'377","reported_seq":2002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.889571+0000","last_change":"2024-04-03T05:14:42.889640+0000","last_active":"2024-04-03T05:14:42.889571+0000","last_peered":"2024-04-03T05:14:42.889571+0000","last_clean":"2024-04-03T05:14:42.889571+0000","last_became_active":"2024-04-03T03:38:26.713796+0000","last_became_peered":"2024-04-03T03:38:26.713796+0000","last_unstale":"2024-04-03T05:14:42.889571+0000","last_undegraded":"2024-04-03T05:14:42.889571+0000","last_fullsized":"2024-04-03T05:14:42.889571+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-04-03T05:14:42.889374+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-04-03T05:14:42.889374+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.889374+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:08:07.315889+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2155,"num_read_kb":2080,"num_write":414,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'297","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.173559+0000","last_change":"2024-04-03T05:14:43.173645+0000","last_active":"2024-04-03T05:14:43.173559+0000","last_peered":"2024-04-03T05:14:43.173559+0000","last_clean":"2024-04-03T05:14:43.173559+0000","last_became_active":"2024-04-03T03:38:24.749152+0000","last_became_peered":"2024-04-03T03:38:24.749152+0000","last_unstale":"2024-04-03T05:14:43.173559+0000","last_undegraded":"2024-04-03T05:14:43.173559+0000","last_fullsized":"2024-04-03T05:14:43.173559+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-04-03T05:14:43.173314+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-04-03T05:14:43.173314+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.173314+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:25:55.157887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":381,"num_read_kb":32536,"num_write":1044,"num_write_kb":42333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1010","reported_seq":2665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.256644+0000","last_change":"2024-04-03T05:14:46.256798+0000","last_active":"2024-04-03T05:14:46.256644+0000","last_peered":"2024-04-03T05:14:46.256644+0000","last_clean":"2024-04-03T05:14:46.256644+0000","last_became_active":"2024-04-03T03:38:26.729124+0000","last_became_peered":"2024-04-03T03:38:26.729124+0000","last_unstale":"2024-04-03T05:14:46.256644+0000","last_undegraded":"2024-04-03T05:14:46.256644+0000","last_fullsized":"2024-04-03T05:14:46.256644+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1010","last_scrub_stamp":"2024-04-03T05:14:46.256335+0000","last_deep_scrub":"263'1010","last_deep_scrub_stamp":"2024-04-03T05:14:46.256335+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.256335+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":900,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:57:56.531035+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4687,"num_read_kb":4082,"num_write":1459,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'345","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.569496+0000","last_change":"2024-04-03T03:38:24.732372+0000","last_active":"2024-04-03T05:14:10.569496+0000","last_peered":"2024-04-03T05:14:10.569496+0000","last_clean":"2024-04-03T05:14:10.569496+0000","last_became_active":"2024-04-03T03:38:24.731586+0000","last_became_peered":"2024-04-03T03:38:24.731586+0000","last_unstale":"2024-04-03T05:14:10.569496+0000","last_undegraded":"2024-04-03T05:14:10.569496+0000","last_fullsized":"2024-04-03T05:14:10.569496+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282846,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":553,"num_read_kb":86610,"num_write":1391,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'367","reported_seq":1871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.265738+0000","last_change":"2024-04-03T05:14:47.265816+0000","last_active":"2024-04-03T05:14:47.265738+0000","last_peered":"2024-04-03T05:14:47.265738+0000","last_clean":"2024-04-03T05:14:47.265738+0000","last_became_active":"2024-04-03T03:38:26.728070+0000","last_became_peered":"2024-04-03T03:38:26.728070+0000","last_unstale":"2024-04-03T05:14:47.265738+0000","last_undegraded":"2024-04-03T05:14:47.265738+0000","last_fullsized":"2024-04-03T05:14:47.265738+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-04-03T05:14:47.265527+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-04-03T05:14:47.265527+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.265527+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:33:55.186925+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2004,"num_read_kb":1922,"num_write":414,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":964,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'366","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.476360+0000","last_change":"2024-04-03T05:14:35.476477+0000","last_active":"2024-04-03T05:14:35.476360+0000","last_peered":"2024-04-03T05:14:35.476360+0000","last_clean":"2024-04-03T05:14:35.476360+0000","last_became_active":"2024-04-03T03:38:24.725969+0000","last_became_peered":"2024-04-03T03:38:24.725969+0000","last_unstale":"2024-04-03T05:14:35.476360+0000","last_undegraded":"2024-04-03T05:14:35.476360+0000","last_fullsized":"2024-04-03T05:14:35.476360+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-04-03T05:14:35.476124+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-04-03T05:14:35.476124+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.476124+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:50:57.988501+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360956,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":552,"num_read_kb":62664,"num_write":1296,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'467","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.889009+0000","last_change":"2024-04-03T05:14:44.889075+0000","last_active":"2024-04-03T05:14:44.889009+0000","last_peered":"2024-04-03T05:14:44.889009+0000","last_clean":"2024-04-03T05:14:44.889009+0000","last_became_active":"2024-04-03T03:38:26.705142+0000","last_became_peered":"2024-04-03T03:38:26.705142+0000","last_unstale":"2024-04-03T05:14:44.889009+0000","last_undegraded":"2024-04-03T05:14:44.889009+0000","last_fullsized":"2024-04-03T05:14:44.889009+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'467","last_scrub_stamp":"2024-04-03T05:14:44.888820+0000","last_deep_scrub":"263'467","last_deep_scrub_stamp":"2024-04-03T05:14:44.888820+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.888820+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:06:13.346374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2439,"num_read_kb":2283,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'321","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.562021+0000","last_change":"2024-04-03T03:38:24.749516+0000","last_active":"2024-04-03T05:14:10.562021+0000","last_peered":"2024-04-03T05:14:10.562021+0000","last_clean":"2024-04-03T05:14:10.562021+0000","last_became_active":"2024-04-03T03:38:24.748843+0000","last_became_peered":"2024-04-03T03:38:24.748843+0000","last_unstale":"2024-04-03T05:14:10.562021+0000","last_undegraded":"2024-04-03T05:14:10.562021+0000","last_fullsized":"2024-04-03T05:14:10.562021+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":1436,"num_write":1076,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'325","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:10.559543+0000","last_change":"2024-04-03T03:38:24.740753+0000","last_active":"2024-04-03T05:14:10.559543+0000","last_peered":"2024-04-03T05:14:10.559543+0000","last_clean":"2024-04-03T05:14:10.559543+0000","last_became_active":"2024-04-03T03:38:24.737358+0000","last_became_peered":"2024-04-03T03:38:24.737358+0000","last_unstale":"2024-04-03T05:14:10.559543+0000","last_undegraded":"2024-04-03T05:14:10.559543+0000","last_fullsized":"2024-04-03T05:14:10.559543+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T03:38:23.661847+0000","last_clean_scrub_stamp":"2024-04-03T03:38:23.661847+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5528791,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":543,"num_read_kb":13846,"num_write":1342,"num_write_kb":46293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'653","reported_seq":2349,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.210045+0000","last_change":"2024-04-03T05:14:54.210110+0000","last_active":"2024-04-03T05:14:54.210045+0000","last_peered":"2024-04-03T05:14:54.210045+0000","last_clean":"2024-04-03T05:14:54.210045+0000","last_became_active":"2024-04-03T03:38:26.717854+0000","last_became_peered":"2024-04-03T03:38:26.717854+0000","last_unstale":"2024-04-03T05:14:54.210045+0000","last_undegraded":"2024-04-03T05:14:54.210045+0000","last_fullsized":"2024-04-03T05:14:54.210045+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'653","last_scrub_stamp":"2024-04-03T05:14:54.209856+0000","last_deep_scrub":"263'653","last_deep_scrub_stamp":"2024-04-03T05:14:54.209856+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.209856+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:30:34.144339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3358,"num_read_kb":3036,"num_write":900,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'386","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.538889+0000","last_change":"2024-04-03T05:14:52.539008+0000","last_active":"2024-04-03T05:14:52.538889+0000","last_peered":"2024-04-03T05:14:52.538889+0000","last_clean":"2024-04-03T05:14:52.538889+0000","last_became_active":"2024-04-03T03:38:24.730312+0000","last_became_peered":"2024-04-03T03:38:24.730312+0000","last_unstale":"2024-04-03T05:14:52.538889+0000","last_undegraded":"2024-04-03T05:14:52.538889+0000","last_fullsized":"2024-04-03T05:14:52.538889+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-04-03T05:14:52.538689+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-04-03T05:14:52.538689+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.538689+0000","objects_scrubbed":11,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:29.371664+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342930,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":661,"num_read_kb":19035,"num_write":1410,"num_write_kb":53256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'684","reported_seq":2072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.473935+0000","last_change":"2024-04-03T05:14:41.474091+0000","last_active":"2024-04-03T05:14:41.473935+0000","last_peered":"2024-04-03T05:14:41.473935+0000","last_clean":"2024-04-03T05:14:41.473935+0000","last_became_active":"2024-04-03T03:38:26.728038+0000","last_became_peered":"2024-04-03T03:38:26.728038+0000","last_unstale":"2024-04-03T05:14:41.473935+0000","last_undegraded":"2024-04-03T05:14:41.473935+0000","last_fullsized":"2024-04-03T05:14:41.473935+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'684","last_scrub_stamp":"2024-04-03T05:14:41.473712+0000","last_deep_scrub":"263'684","last_deep_scrub_stamp":"2024-04-03T05:14:41.473712+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.473712+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:42:30.144906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3172,"num_read_kb":2837,"num_write":928,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2155,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":195556,"num_write":183,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5643,"num_read_kb":4008,"num_write":2168,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3956,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1288,"ondisk_log_size":1288,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":11006,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":12265,"num_read_kb":12111,"num_write":14239,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1890,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":22012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2622,"ondisk_log_size":2622,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":375,"ondisk_log_size":375,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1532186,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19519,"num_read_kb":39189,"num_write":16363,"num_write_kb":11731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":625102,"num_omap_keys":1470,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1538,"ondisk_log_size":1538,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1711,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1602,"num_read_kb":1902,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":189133,"num_read_kb":172083,"num_write":51171,"num_write_kb":17715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":38982,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4094,"ondisk_log_size":4094,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":162411735,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":0,"num_read":35354,"num_read_kb":2539931,"num_write":77944,"num_write_kb":2266597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":246079488,"data_stored":246079488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3564,"ondisk_log_size":3564,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":216081,"num_write":183,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510608,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":352532,"kb_used_data":46476,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94019308,"statfs":{"total":96636764160,"available":96275771392,"internally_reserved":0,"allocated":47591424,"data_stored":45521294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":313391562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510610,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305720,"kb_used_data":44080,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94066120,"statfs":{"total":96636764160,"available":96323706880,"internally_reserved":0,"allocated":45137920,"data_stored":43104262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510607,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183136,"kb_used_data":35416,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94188704,"statfs":{"total":96636764160,"available":96449232896,"internally_reserved":0,"allocated":36265984,"data_stored":34171288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510606,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141844,"kb_used_data":38476,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94229996,"statfs":{"total":96636764160,"available":96491515904,"internally_reserved":0,"allocated":39399424,"data_stored":37369253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":105839047},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543314,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305028,"kb_used_data":48956,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94066812,"statfs":{"total":96636764160,"available":96324415488,"internally_reserved":0,"allocated":50130944,"data_stored":48057944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543314,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132128,"kb_used_data":38488,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94239712,"statfs":{"total":96636764160,"available":96501465088,"internally_reserved":0,"allocated":39411712,"data_stored":37394593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95877574},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543311,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":203096,"kb_used_data":41488,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94168744,"statfs":{"total":96636764160,"available":96428793856,"internally_reserved":0,"allocated":42483712,"data_stored":40444668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543312,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303500,"kb_used_data":47428,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94068340,"statfs":{"total":96636764160,"available":96325980160,"internally_reserved":0,"allocated":48566272,"data_stored":46507952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262207941},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28962816,"data_stored":28962816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32927744,"data_stored":32927744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24633344,"data_stored":24633344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32149504,"data_stored":32149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32997376,"data_stored":32997376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":31895552,"data_stored":31895552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29294592,"data_stored":29294592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":33218560,"data_stored":33218560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T05:14:58.981 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.981 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.981 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.981 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.981 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.982 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.982 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.982 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.982 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.982 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.982 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.983 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.983 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.983 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.983 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.983 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.983 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.984 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.984 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-04-03T03:55:44.773521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.984 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.984 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.984 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.984 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.984 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.985 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.985 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.985 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.985 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.985 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.986 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.986 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.986 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.986 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.986 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.987 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.987 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.987 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-04-03T03:55:52.204510+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=55, tm_sec=52, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.987 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.987 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-04-03T04:18:50.268136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=4, tm_min=18, tm_sec=50, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.988 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.988 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.988 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.988 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.988 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.988 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.988 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.989 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.989 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.990 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.990 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.990 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.991 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.991 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.991 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.991 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-03T03:38:27.688762+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=27, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.991 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.991 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-03T03:38:10.594495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=10, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.992 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.992 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.992 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.992 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.992 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.993 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.993 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.993 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-03T03:38:25.682394+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=25, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.993 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.993 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.993 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.994 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.994 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.994 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.994 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-03T03:38:29.694457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=29, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.994 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.995 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.995 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.995 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.995 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.995 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.995 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.996 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-03T03:38:23.661847+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=3, tm_min=38, tm_sec=23, tm_wday=2, tm_yday=94, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=3, tm_hour=5, tm_min=14, tm_sec=12, tm_wday=2, tm_yday=94, tm_isdst=0) 2024-04-03T05:14:58.996 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-03T05:15:18.997 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-03T05:15:19.335 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-03T05:15:19.341 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-04-03T05:15:19.352 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":3172,"stamp":"2024-04-03T05:15:18.575683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198101438,"num_objects":887,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":887,"num_whiteouts":0,"num_read":263989,"num_read_kb":3180969,"num_write":162444,"num_write_kb":2577796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":158,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677752,"num_omap_keys":1687,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13836,"ondisk_log_size":13836,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1926984,"kb_used_data":340808,"kb_used_omap":12,"kb_used_meta":1586099,"kb_avail":753047736,"statfs":{"total":773094113280,"available":771120881664,"internally_reserved":0,"allocated":348987392,"data_stored":332571254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1624165939},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008054"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:01.729491+0000","last_change":"2024-04-03T05:15:01.729544+0000","last_active":"2024-04-03T05:15:01.729491+0000","last_peered":"2024-04-03T05:15:01.729491+0000","last_clean":"2024-04-03T05:15:01.729491+0000","last_became_active":"2024-04-03T04:18:51.297066+0000","last_became_peered":"2024-04-03T04:18:51.297066+0000","last_unstale":"2024-04-03T05:15:01.729491+0000","last_undegraded":"2024-04-03T05:15:01.729491+0000","last_fullsized":"2024-04-03T05:15:01.729491+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:01.729295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:01.729295+0000","last_clean_scrub_stamp":"2024-04-03T05:15:01.729295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:45:10.311711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"258'2","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:55.454629+0000","last_change":"2024-04-03T05:14:55.454693+0000","last_active":"2024-04-03T05:14:55.454629+0000","last_peered":"2024-04-03T05:14:55.454629+0000","last_clean":"2024-04-03T05:14:55.454629+0000","last_became_active":"2024-04-03T03:55:53.274262+0000","last_became_peered":"2024-04-03T03:55:53.274262+0000","last_unstale":"2024-04-03T05:14:55.454629+0000","last_undegraded":"2024-04-03T05:14:55.454629+0000","last_fullsized":"2024-04-03T05:14:55.454629+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:55.454387+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:55.454387+0000","last_clean_scrub_stamp":"2024-04-03T05:14:55.454387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:21:42.508679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'2","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.439897+0000","last_change":"2024-04-03T05:14:43.440062+0000","last_active":"2024-04-03T05:14:43.439897+0000","last_peered":"2024-04-03T05:14:43.439897+0000","last_clean":"2024-04-03T05:14:43.439897+0000","last_became_active":"2024-04-03T03:55:45.807880+0000","last_became_peered":"2024-04-03T03:55:45.807880+0000","last_unstale":"2024-04-03T05:14:43.439897+0000","last_undegraded":"2024-04-03T05:14:43.439897+0000","last_fullsized":"2024-04-03T05:14:43.439897+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:43.439591+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:43.439591+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.439591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:00:00.526166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"263'26","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.265071+0000","last_change":"2024-04-03T05:14:21.265071+0000","last_active":"2024-04-03T05:14:21.265071+0000","last_peered":"2024-04-03T05:14:21.265071+0000","last_clean":"2024-04-03T05:14:21.265071+0000","last_became_active":"2024-04-03T03:49:00.987495+0000","last_became_peered":"2024-04-03T03:49:00.987495+0000","last_unstale":"2024-04-03T05:14:21.265071+0000","last_undegraded":"2024-04-03T05:14:21.265071+0000","last_fullsized":"2024-04-03T05:14:21.265071+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-04-03T05:14:21.264793+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-04-03T05:14:21.264793+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.264793+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:44:58.383385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":70,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:07.338954+0000","last_change":"2024-04-03T05:15:07.339007+0000","last_active":"2024-04-03T05:15:07.338954+0000","last_peered":"2024-04-03T05:15:07.338954+0000","last_clean":"2024-04-03T05:15:07.338954+0000","last_became_active":"2024-04-03T04:18:51.320118+0000","last_became_peered":"2024-04-03T04:18:51.320118+0000","last_unstale":"2024-04-03T05:15:07.338954+0000","last_undegraded":"2024-04-03T05:15:07.338954+0000","last_fullsized":"2024-04-03T05:15:07.338954+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:07.338756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:07.338756+0000","last_clean_scrub_stamp":"2024-04-03T05:15:07.338756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:39:54.016482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.165992+0000","last_change":"2024-04-03T05:14:35.166055+0000","last_active":"2024-04-03T05:14:35.165992+0000","last_peered":"2024-04-03T05:14:35.165992+0000","last_clean":"2024-04-03T05:14:35.165992+0000","last_became_active":"2024-04-03T03:55:53.238473+0000","last_became_peered":"2024-04-03T03:55:53.238473+0000","last_unstale":"2024-04-03T05:14:35.165992+0000","last_undegraded":"2024-04-03T05:14:35.165992+0000","last_fullsized":"2024-04-03T05:14:35.165992+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:35.165781+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:35.165781+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.165781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:13:54.846919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"258'3","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.238725+0000","last_change":"2024-04-03T05:14:27.238725+0000","last_active":"2024-04-03T05:14:27.238725+0000","last_peered":"2024-04-03T05:14:27.238725+0000","last_clean":"2024-04-03T05:14:27.238725+0000","last_became_active":"2024-04-03T03:55:45.831610+0000","last_became_peered":"2024-04-03T03:55:45.831610+0000","last_unstale":"2024-04-03T05:14:27.238725+0000","last_undegraded":"2024-04-03T05:14:27.238725+0000","last_fullsized":"2024-04-03T05:14:27.238725+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-04-03T05:14:27.238085+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-04-03T05:14:27.238085+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.238085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:41:45.149752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"263'35","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.227454+0000","last_change":"2024-04-03T05:14:20.227526+0000","last_active":"2024-04-03T05:14:20.227454+0000","last_peered":"2024-04-03T05:14:20.227454+0000","last_clean":"2024-04-03T05:14:20.227454+0000","last_became_active":"2024-04-03T03:49:00.988912+0000","last_became_peered":"2024-04-03T03:49:00.988912+0000","last_unstale":"2024-04-03T05:14:20.227454+0000","last_undegraded":"2024-04-03T05:14:20.227454+0000","last_fullsized":"2024-04-03T05:14:20.227454+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-04-03T05:14:20.227243+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-04-03T05:14:20.227243+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.227243+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:12:02.335893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:14.390269+0000","last_change":"2024-04-03T05:15:14.390370+0000","last_active":"2024-04-03T05:15:14.390269+0000","last_peered":"2024-04-03T05:15:14.390269+0000","last_clean":"2024-04-03T05:15:14.390269+0000","last_became_active":"2024-04-03T04:18:51.364557+0000","last_became_peered":"2024-04-03T04:18:51.364557+0000","last_unstale":"2024-04-03T05:15:14.390269+0000","last_undegraded":"2024-04-03T05:15:14.390269+0000","last_fullsized":"2024-04-03T05:15:14.390269+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:14.389979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:14.389979+0000","last_clean_scrub_stamp":"2024-04-03T05:15:14.389979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:52:00.896986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.738935+0000","last_change":"2024-04-03T05:14:32.738935+0000","last_active":"2024-04-03T05:14:32.738935+0000","last_peered":"2024-04-03T05:14:32.738935+0000","last_clean":"2024-04-03T05:14:32.738935+0000","last_became_active":"2024-04-03T03:55:53.269276+0000","last_became_peered":"2024-04-03T03:55:53.269276+0000","last_unstale":"2024-04-03T05:14:32.738935+0000","last_undegraded":"2024-04-03T05:14:32.738935+0000","last_fullsized":"2024-04-03T05:14:32.738935+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-04-03T05:14:32.738678+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-04-03T05:14:32.738678+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.738678+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:58:42.161639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'9","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.056890+0000","last_change":"2024-04-03T05:14:23.056951+0000","last_active":"2024-04-03T05:14:23.056890+0000","last_peered":"2024-04-03T05:14:23.056890+0000","last_clean":"2024-04-03T05:14:23.056890+0000","last_became_active":"2024-04-03T03:55:45.822526+0000","last_became_peered":"2024-04-03T03:55:45.822526+0000","last_unstale":"2024-04-03T05:14:23.056890+0000","last_undegraded":"2024-04-03T05:14:23.056890+0000","last_fullsized":"2024-04-03T05:14:23.056890+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-04-03T05:14:23.056684+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-04-03T05:14:23.056684+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.056684+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:33:14.906245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12606,"num_write":14,"num_write_kb":9534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"263'33","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.783144+0000","last_change":"2024-04-03T05:14:21.783310+0000","last_active":"2024-04-03T05:14:21.783144+0000","last_peered":"2024-04-03T05:14:21.783144+0000","last_clean":"2024-04-03T05:14:21.783144+0000","last_became_active":"2024-04-03T03:49:00.992254+0000","last_became_peered":"2024-04-03T03:49:00.992254+0000","last_unstale":"2024-04-03T05:14:21.783144+0000","last_undegraded":"2024-04-03T05:14:21.783144+0000","last_fullsized":"2024-04-03T05:14:21.783144+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-04-03T05:14:21.782914+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-04-03T05:14:21.782914+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.782914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:52.468078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":101,"num_write":55,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:11.036594+0000","last_change":"2024-04-03T05:15:11.036659+0000","last_active":"2024-04-03T05:15:11.036594+0000","last_peered":"2024-04-03T05:15:11.036594+0000","last_clean":"2024-04-03T05:15:11.036594+0000","last_became_active":"2024-04-03T04:18:51.373051+0000","last_became_peered":"2024-04-03T04:18:51.373051+0000","last_unstale":"2024-04-03T05:15:11.036594+0000","last_undegraded":"2024-04-03T05:15:11.036594+0000","last_fullsized":"2024-04-03T05:15:11.036594+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:11.036385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:11.036385+0000","last_clean_scrub_stamp":"2024-04-03T05:15:11.036385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:59:43.582512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.348280+0000","last_change":"2024-04-03T05:14:49.348347+0000","last_active":"2024-04-03T05:14:49.348280+0000","last_peered":"2024-04-03T05:14:49.348280+0000","last_clean":"2024-04-03T05:14:49.348280+0000","last_became_active":"2024-04-03T03:55:53.274825+0000","last_became_peered":"2024-04-03T03:55:53.274825+0000","last_unstale":"2024-04-03T05:14:49.348280+0000","last_undegraded":"2024-04-03T05:14:49.348280+0000","last_fullsized":"2024-04-03T05:14:49.348280+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:49.348086+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:49.348086+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.348086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:56:00.038803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.229508+0000","last_change":"2024-04-03T05:14:18.229571+0000","last_active":"2024-04-03T05:14:18.229508+0000","last_peered":"2024-04-03T05:14:18.229508+0000","last_clean":"2024-04-03T05:14:18.229508+0000","last_became_active":"2024-04-03T03:55:45.809649+0000","last_became_peered":"2024-04-03T03:55:45.809649+0000","last_unstale":"2024-04-03T05:14:18.229508+0000","last_undegraded":"2024-04-03T05:14:18.229508+0000","last_fullsized":"2024-04-03T05:14:18.229508+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:18.229296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:18.229296+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.229296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:46:33.279503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"263'107","reported_seq":386,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.602336+0000","last_change":"2024-04-03T05:14:16.602380+0000","last_active":"2024-04-03T05:14:16.602336+0000","last_peered":"2024-04-03T05:14:16.602336+0000","last_clean":"2024-04-03T05:14:16.602336+0000","last_became_active":"2024-04-03T03:49:00.990318+0000","last_became_peered":"2024-04-03T03:49:00.990318+0000","last_unstale":"2024-04-03T05:14:16.602336+0000","last_undegraded":"2024-04-03T05:14:16.602336+0000","last_fullsized":"2024-04-03T05:14:16.602336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'107","last_scrub_stamp":"2024-04-03T05:14:16.602235+0000","last_deep_scrub":"263'107","last_deep_scrub_stamp":"2024-04-03T05:14:16.602235+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.602235+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:11:58.218122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":587,"num_read_kb":421,"num_write":142,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1976,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.040325+0000","last_change":"2024-04-03T05:14:53.040391+0000","last_active":"2024-04-03T05:14:53.040325+0000","last_peered":"2024-04-03T05:14:53.040325+0000","last_clean":"2024-04-03T05:14:53.040325+0000","last_became_active":"2024-04-03T04:18:51.316328+0000","last_became_peered":"2024-04-03T04:18:51.316328+0000","last_unstale":"2024-04-03T05:14:53.040325+0000","last_undegraded":"2024-04-03T05:14:53.040325+0000","last_fullsized":"2024-04-03T05:14:53.040325+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:53.040107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:53.040107+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.040107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:30:59.446619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.657087+0000","last_change":"2024-04-03T05:14:28.657148+0000","last_active":"2024-04-03T05:14:28.657087+0000","last_peered":"2024-04-03T05:14:28.657087+0000","last_clean":"2024-04-03T05:14:28.657087+0000","last_became_active":"2024-04-03T03:55:53.251965+0000","last_became_peered":"2024-04-03T03:55:53.251965+0000","last_unstale":"2024-04-03T05:14:28.657087+0000","last_undegraded":"2024-04-03T05:14:28.657087+0000","last_fullsized":"2024-04-03T05:14:28.657087+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:28.656893+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:28.656893+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.656893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:10:47.815121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4667,"num_write":4,"num_write_kb":4667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'4","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.436769+0000","last_change":"2024-04-03T05:14:17.436836+0000","last_active":"2024-04-03T05:14:17.436769+0000","last_peered":"2024-04-03T05:14:17.436769+0000","last_clean":"2024-04-03T05:14:17.436769+0000","last_became_active":"2024-04-03T03:55:45.811051+0000","last_became_peered":"2024-04-03T03:55:45.811051+0000","last_unstale":"2024-04-03T05:14:17.436769+0000","last_undegraded":"2024-04-03T05:14:17.436769+0000","last_fullsized":"2024-04-03T05:14:17.436769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:17.436576+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:17.436576+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.436576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:40:06.185116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"263'6","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.581532+0000","last_change":"2024-04-03T05:14:17.581595+0000","last_active":"2024-04-03T05:14:17.581532+0000","last_peered":"2024-04-03T05:14:17.581532+0000","last_clean":"2024-04-03T05:14:17.581532+0000","last_became_active":"2024-04-03T03:49:00.989383+0000","last_became_peered":"2024-04-03T03:49:00.989383+0000","last_unstale":"2024-04-03T05:14:17.581532+0000","last_undegraded":"2024-04-03T05:14:17.581532+0000","last_fullsized":"2024-04-03T05:14:17.581532+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:17.581351+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:17.581351+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.581351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:02:07.448735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:06.302843+0000","last_change":"2024-04-03T05:15:06.302963+0000","last_active":"2024-04-03T05:15:06.302843+0000","last_peered":"2024-04-03T05:15:06.302843+0000","last_clean":"2024-04-03T05:15:06.302843+0000","last_became_active":"2024-04-03T04:18:51.317417+0000","last_became_peered":"2024-04-03T04:18:51.317417+0000","last_unstale":"2024-04-03T05:15:06.302843+0000","last_undegraded":"2024-04-03T05:15:06.302843+0000","last_fullsized":"2024-04-03T05:15:06.302843+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:06.302541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:06.302541+0000","last_clean_scrub_stamp":"2024-04-03T05:15:06.302541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:31:48.717640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"258'2","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:06.198165+0000","last_change":"2024-04-03T05:15:06.198231+0000","last_active":"2024-04-03T05:15:06.198165+0000","last_peered":"2024-04-03T05:15:06.198165+0000","last_clean":"2024-04-03T05:15:06.198165+0000","last_became_active":"2024-04-03T03:55:53.250769+0000","last_became_peered":"2024-04-03T03:55:53.250769+0000","last_unstale":"2024-04-03T05:15:06.198165+0000","last_undegraded":"2024-04-03T05:15:06.198165+0000","last_fullsized":"2024-04-03T05:15:06.198165+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:15:06.197950+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:15:06.197950+0000","last_clean_scrub_stamp":"2024-04-03T05:15:06.197950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:41:20.338344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'4","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.943160+0000","last_change":"2024-04-03T05:14:18.943224+0000","last_active":"2024-04-03T05:14:18.943160+0000","last_peered":"2024-04-03T05:14:18.943160+0000","last_clean":"2024-04-03T05:14:18.943160+0000","last_became_active":"2024-04-03T03:55:45.821160+0000","last_became_peered":"2024-04-03T03:55:45.821160+0000","last_unstale":"2024-04-03T05:14:18.943160+0000","last_undegraded":"2024-04-03T05:14:18.943160+0000","last_fullsized":"2024-04-03T05:14:18.943160+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:18.942964+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:18.942964+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.942964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:52.990964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"263'67","reported_seq":289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.790975+0000","last_change":"2024-04-03T05:14:20.791125+0000","last_active":"2024-04-03T05:14:20.790975+0000","last_peered":"2024-04-03T05:14:20.790975+0000","last_clean":"2024-04-03T05:14:20.790975+0000","last_became_active":"2024-04-03T03:49:00.994321+0000","last_became_peered":"2024-04-03T03:49:00.994321+0000","last_unstale":"2024-04-03T05:14:20.790975+0000","last_undegraded":"2024-04-03T05:14:20.790975+0000","last_fullsized":"2024-04-03T05:14:20.790975+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'67","last_scrub_stamp":"2024-04-03T05:14:20.790726+0000","last_deep_scrub":"263'67","last_deep_scrub_stamp":"2024-04-03T05:14:20.790726+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.790726+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:24:39.456393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":300,"num_write":80,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1980,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.214919+0000","last_change":"2024-04-03T05:14:43.214977+0000","last_active":"2024-04-03T05:14:43.214919+0000","last_peered":"2024-04-03T05:14:43.214919+0000","last_clean":"2024-04-03T05:14:43.214919+0000","last_became_active":"2024-04-03T04:18:51.311870+0000","last_became_peered":"2024-04-03T04:18:51.311870+0000","last_unstale":"2024-04-03T05:14:43.214919+0000","last_undegraded":"2024-04-03T05:14:43.214919+0000","last_fullsized":"2024-04-03T05:14:43.214919+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:43.214721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:43.214721+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.214721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:42:35.231876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.224832+0000","last_change":"2024-04-03T05:14:31.224887+0000","last_active":"2024-04-03T05:14:31.224832+0000","last_peered":"2024-04-03T05:14:31.224832+0000","last_clean":"2024-04-03T05:14:31.224832+0000","last_became_active":"2024-04-03T03:55:53.241200+0000","last_became_peered":"2024-04-03T03:55:53.241200+0000","last_unstale":"2024-04-03T05:14:31.224832+0000","last_undegraded":"2024-04-03T05:14:31.224832+0000","last_fullsized":"2024-04-03T05:14:31.224832+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.224625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.224625+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.224625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:53:38.375885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'11","reported_seq":90,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.645240+0000","last_change":"2024-04-03T05:14:19.645305+0000","last_active":"2024-04-03T05:14:19.645240+0000","last_peered":"2024-04-03T05:14:19.645240+0000","last_clean":"2024-04-03T05:14:19.645240+0000","last_became_active":"2024-04-03T03:55:45.835828+0000","last_became_peered":"2024-04-03T03:55:45.835828+0000","last_unstale":"2024-04-03T05:14:19.645240+0000","last_undegraded":"2024-04-03T05:14:19.645240+0000","last_fullsized":"2024-04-03T05:14:19.645240+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:19.645047+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:19.645047+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.645047+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:51:08.338883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12338,"num_write":9,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.975186+0000","last_change":"2024-04-03T05:14:19.975252+0000","last_active":"2024-04-03T05:14:19.975186+0000","last_peered":"2024-04-03T05:14:19.975186+0000","last_clean":"2024-04-03T05:14:19.975186+0000","last_became_active":"2024-04-03T03:49:00.988327+0000","last_became_peered":"2024-04-03T03:49:00.988327+0000","last_unstale":"2024-04-03T05:14:19.975186+0000","last_undegraded":"2024-04-03T05:14:19.975186+0000","last_fullsized":"2024-04-03T05:14:19.975186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-04-03T05:14:19.974985+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-04-03T05:14:19.974985+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.974985+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:46:49.996232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":175,"num_write":99,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.010733+0000","last_change":"2024-04-03T05:14:52.010787+0000","last_active":"2024-04-03T05:14:52.010733+0000","last_peered":"2024-04-03T05:14:52.010733+0000","last_clean":"2024-04-03T05:14:52.010733+0000","last_became_active":"2024-04-03T04:18:51.299249+0000","last_became_peered":"2024-04-03T04:18:51.299249+0000","last_unstale":"2024-04-03T05:14:52.010733+0000","last_undegraded":"2024-04-03T05:14:52.010733+0000","last_fullsized":"2024-04-03T05:14:52.010733+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:52.010537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:52.010537+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.010537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:46:31.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'10","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:00.730035+0000","last_change":"2024-04-03T05:15:00.730113+0000","last_active":"2024-04-03T05:15:00.730035+0000","last_peered":"2024-04-03T05:15:00.730035+0000","last_clean":"2024-04-03T05:15:00.730035+0000","last_became_active":"2024-04-03T03:55:53.277505+0000","last_became_peered":"2024-04-03T03:55:53.277505+0000","last_unstale":"2024-04-03T05:15:00.730035+0000","last_undegraded":"2024-04-03T05:15:00.730035+0000","last_fullsized":"2024-04-03T05:15:00.730035+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-04-03T05:15:00.729828+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-04-03T05:15:00.729828+0000","last_clean_scrub_stamp":"2024-04-03T05:15:00.729828+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:01:30.173845+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"258'2","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.239327+0000","last_change":"2024-04-03T05:14:16.239400+0000","last_active":"2024-04-03T05:14:16.239327+0000","last_peered":"2024-04-03T05:14:16.239327+0000","last_clean":"2024-04-03T05:14:16.239327+0000","last_became_active":"2024-04-03T03:55:45.811093+0000","last_became_peered":"2024-04-03T03:55:45.811093+0000","last_unstale":"2024-04-03T05:14:16.239327+0000","last_undegraded":"2024-04-03T05:14:16.239327+0000","last_fullsized":"2024-04-03T05:14:16.239327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:16.239098+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:16.239098+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.239098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:00:03.108455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"263'33","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.289972+0000","last_change":"2024-04-03T05:14:23.290034+0000","last_active":"2024-04-03T05:14:23.289972+0000","last_peered":"2024-04-03T05:14:23.289972+0000","last_clean":"2024-04-03T05:14:23.289972+0000","last_became_active":"2024-04-03T03:49:00.973216+0000","last_became_peered":"2024-04-03T03:49:00.973216+0000","last_unstale":"2024-04-03T05:14:23.289972+0000","last_undegraded":"2024-04-03T05:14:23.289972+0000","last_fullsized":"2024-04-03T05:14:23.289972+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-04-03T05:14:23.289767+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-04-03T05:14:23.289767+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.289767+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:49:45.158570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:12.072830+0000","last_change":"2024-04-03T05:15:12.072897+0000","last_active":"2024-04-03T05:15:12.072830+0000","last_peered":"2024-04-03T05:15:12.072830+0000","last_clean":"2024-04-03T05:15:12.072830+0000","last_became_active":"2024-04-03T04:19:00.377208+0000","last_became_peered":"2024-04-03T04:19:00.377208+0000","last_unstale":"2024-04-03T05:15:12.072830+0000","last_undegraded":"2024-04-03T05:15:12.072830+0000","last_fullsized":"2024-04-03T05:15:12.072830+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:15:12.072629+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:15:12.072629+0000","last_clean_scrub_stamp":"2024-04-03T05:15:12.072629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:29:32.385465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:05.920855+0000","last_change":"2024-04-03T05:15:05.920979+0000","last_active":"2024-04-03T05:15:05.920855+0000","last_peered":"2024-04-03T05:15:05.920855+0000","last_clean":"2024-04-03T05:15:05.920855+0000","last_became_active":"2024-04-03T03:55:53.258699+0000","last_became_peered":"2024-04-03T03:55:53.258699+0000","last_unstale":"2024-04-03T05:15:05.920855+0000","last_undegraded":"2024-04-03T05:15:05.920855+0000","last_fullsized":"2024-04-03T05:15:05.920855+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:15:05.920536+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:15:05.920536+0000","last_clean_scrub_stamp":"2024-04-03T05:15:05.920536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:07:21.653001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'6","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.189199+0000","last_change":"2024-04-03T05:14:31.189266+0000","last_active":"2024-04-03T05:14:31.189199+0000","last_peered":"2024-04-03T05:14:31.189199+0000","last_clean":"2024-04-03T05:14:31.189199+0000","last_became_active":"2024-04-03T03:55:45.831660+0000","last_became_peered":"2024-04-03T03:55:45.831660+0000","last_unstale":"2024-04-03T05:14:31.189199+0000","last_undegraded":"2024-04-03T05:14:31.189199+0000","last_fullsized":"2024-04-03T05:14:31.189199+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:31.189001+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:31.189001+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.189001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:53:33.899568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"263'39","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.089578+0000","last_change":"2024-04-03T05:14:48.089673+0000","last_active":"2024-04-03T05:14:48.089578+0000","last_peered":"2024-04-03T05:14:48.089578+0000","last_clean":"2024-04-03T05:14:48.089578+0000","last_became_active":"2024-04-03T03:49:00.968902+0000","last_became_peered":"2024-04-03T03:49:00.968902+0000","last_unstale":"2024-04-03T05:14:48.089578+0000","last_undegraded":"2024-04-03T05:14:48.089578+0000","last_fullsized":"2024-04-03T05:14:48.089578+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-04-03T05:14:48.089332+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-04-03T05:14:48.089332+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.089332+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:26:11.376199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":106,"num_write":72,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:15.342788+0000","last_change":"2024-04-03T05:15:15.342845+0000","last_active":"2024-04-03T05:15:15.342788+0000","last_peered":"2024-04-03T05:15:15.342788+0000","last_clean":"2024-04-03T05:15:15.342788+0000","last_became_active":"2024-04-03T04:18:51.367290+0000","last_became_peered":"2024-04-03T04:18:51.367290+0000","last_unstale":"2024-04-03T05:15:15.342788+0000","last_undegraded":"2024-04-03T05:15:15.342788+0000","last_fullsized":"2024-04-03T05:15:15.342788+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:15.342586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:15.342586+0000","last_clean_scrub_stamp":"2024-04-03T05:15:15.342586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:13:07.663432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:03.318659+0000","last_change":"2024-04-03T05:15:03.318717+0000","last_active":"2024-04-03T05:15:03.318659+0000","last_peered":"2024-04-03T05:15:03.318659+0000","last_clean":"2024-04-03T05:15:03.318659+0000","last_became_active":"2024-04-03T03:55:53.247541+0000","last_became_peered":"2024-04-03T03:55:53.247541+0000","last_unstale":"2024-04-03T05:15:03.318659+0000","last_undegraded":"2024-04-03T05:15:03.318659+0000","last_fullsized":"2024-04-03T05:15:03.318659+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:03.318455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:03.318455+0000","last_clean_scrub_stamp":"2024-04-03T05:15:03.318455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:57.277795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"258'4","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.219803+0000","last_change":"2024-04-03T05:14:15.219826+0000","last_active":"2024-04-03T05:14:15.219803+0000","last_peered":"2024-04-03T05:14:15.219803+0000","last_clean":"2024-04-03T05:14:15.219803+0000","last_became_active":"2024-04-03T03:55:45.819664+0000","last_became_peered":"2024-04-03T03:55:45.819664+0000","last_unstale":"2024-04-03T05:14:15.219803+0000","last_undegraded":"2024-04-03T05:14:15.219803+0000","last_fullsized":"2024-04-03T05:14:15.219803+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'4","last_scrub_stamp":"2024-04-03T05:14:15.219711+0000","last_deep_scrub":"258'4","last_deep_scrub_stamp":"2024-04-03T05:14:15.219711+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.219711+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:39.431443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"263'13","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.596552+0000","last_change":"2024-04-03T05:14:21.596703+0000","last_active":"2024-04-03T05:14:21.596552+0000","last_peered":"2024-04-03T05:14:21.596552+0000","last_clean":"2024-04-03T05:14:21.596552+0000","last_became_active":"2024-04-03T03:49:00.961782+0000","last_became_peered":"2024-04-03T03:49:00.961782+0000","last_unstale":"2024-04-03T05:14:21.596552+0000","last_undegraded":"2024-04-03T05:14:21.596552+0000","last_fullsized":"2024-04-03T05:14:21.596552+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-04-03T05:14:21.596278+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-04-03T05:14:21.596278+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.596278+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:28:32.878479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:03.753920+0000","last_change":"2024-04-03T05:15:03.753979+0000","last_active":"2024-04-03T05:15:03.753920+0000","last_peered":"2024-04-03T05:15:03.753920+0000","last_clean":"2024-04-03T05:15:03.753920+0000","last_became_active":"2024-04-03T04:18:51.304323+0000","last_became_peered":"2024-04-03T04:18:51.304323+0000","last_unstale":"2024-04-03T05:15:03.753920+0000","last_undegraded":"2024-04-03T05:15:03.753920+0000","last_fullsized":"2024-04-03T05:15:03.753920+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:03.753727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:03.753727+0000","last_clean_scrub_stamp":"2024-04-03T05:15:03.753727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:00:18.612324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:08.181353+0000","last_change":"2024-04-03T05:15:08.181505+0000","last_active":"2024-04-03T05:15:08.181353+0000","last_peered":"2024-04-03T05:15:08.181353+0000","last_clean":"2024-04-03T05:15:08.181353+0000","last_became_active":"2024-04-03T03:55:53.255231+0000","last_became_peered":"2024-04-03T03:55:53.255231+0000","last_unstale":"2024-04-03T05:15:08.181353+0000","last_undegraded":"2024-04-03T05:15:08.181353+0000","last_fullsized":"2024-04-03T05:15:08.181353+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-04-03T05:15:08.181125+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-04-03T05:15:08.181125+0000","last_clean_scrub_stamp":"2024-04-03T05:15:08.181125+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:27:14.229940+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.797480+0000","last_change":"2024-04-03T05:14:19.797532+0000","last_active":"2024-04-03T05:14:19.797480+0000","last_peered":"2024-04-03T05:14:19.797480+0000","last_clean":"2024-04-03T05:14:19.797480+0000","last_became_active":"2024-04-03T03:55:45.829412+0000","last_became_peered":"2024-04-03T03:55:45.829412+0000","last_unstale":"2024-04-03T05:14:19.797480+0000","last_undegraded":"2024-04-03T05:14:19.797480+0000","last_fullsized":"2024-04-03T05:14:19.797480+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:19.797275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:19.797275+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.797275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:12:11.890163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"263'19","reported_seq":121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.576493+0000","last_change":"2024-04-03T05:14:17.576536+0000","last_active":"2024-04-03T05:14:17.576493+0000","last_peered":"2024-04-03T05:14:17.576493+0000","last_clean":"2024-04-03T05:14:17.576493+0000","last_became_active":"2024-04-03T03:49:00.981577+0000","last_became_peered":"2024-04-03T03:49:00.981577+0000","last_unstale":"2024-04-03T05:14:17.576493+0000","last_undegraded":"2024-04-03T05:14:17.576493+0000","last_fullsized":"2024-04-03T05:14:17.576493+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-04-03T05:14:17.576374+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-04-03T05:14:17.576374+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.576374+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:47.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:16.391060+0000","last_change":"2024-04-03T05:15:16.391187+0000","last_active":"2024-04-03T05:15:16.391060+0000","last_peered":"2024-04-03T05:15:16.391060+0000","last_clean":"2024-04-03T05:15:16.391060+0000","last_became_active":"2024-04-03T04:18:51.372963+0000","last_became_peered":"2024-04-03T04:18:51.372963+0000","last_unstale":"2024-04-03T05:15:16.391060+0000","last_undegraded":"2024-04-03T05:15:16.391060+0000","last_fullsized":"2024-04-03T05:15:16.391060+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:16.390809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:16.390809+0000","last_clean_scrub_stamp":"2024-04-03T05:15:16.390809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:16:15.448837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.391523+0000","last_change":"2024-04-03T05:14:48.391591+0000","last_active":"2024-04-03T05:14:48.391523+0000","last_peered":"2024-04-03T05:14:48.391523+0000","last_clean":"2024-04-03T05:14:48.391523+0000","last_became_active":"2024-04-03T03:55:53.268903+0000","last_became_peered":"2024-04-03T03:55:53.268903+0000","last_unstale":"2024-04-03T05:14:48.391523+0000","last_undegraded":"2024-04-03T05:14:48.391523+0000","last_fullsized":"2024-04-03T05:14:48.391523+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-04-03T05:14:48.391314+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-04-03T05:14:48.391314+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.391314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:08:41.058813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'2","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.468487+0000","last_change":"2024-04-03T05:14:45.468552+0000","last_active":"2024-04-03T05:14:45.468487+0000","last_peered":"2024-04-03T05:14:45.468487+0000","last_clean":"2024-04-03T05:14:45.468487+0000","last_became_active":"2024-04-03T03:55:45.834865+0000","last_became_peered":"2024-04-03T03:55:45.834865+0000","last_unstale":"2024-04-03T05:14:45.468487+0000","last_undegraded":"2024-04-03T05:14:45.468487+0000","last_fullsized":"2024-04-03T05:14:45.468487+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:45.468285+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:45.468285+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.468285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:25:09.871125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"263'64","reported_seq":239,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.590706+0000","last_change":"2024-04-03T05:14:20.590768+0000","last_active":"2024-04-03T05:14:20.590706+0000","last_peered":"2024-04-03T05:14:20.590706+0000","last_clean":"2024-04-03T05:14:20.590706+0000","last_became_active":"2024-04-03T03:49:00.971042+0000","last_became_peered":"2024-04-03T03:49:00.971042+0000","last_unstale":"2024-04-03T05:14:20.590706+0000","last_undegraded":"2024-04-03T05:14:20.590706+0000","last_fullsized":"2024-04-03T05:14:20.590706+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-04-03T05:14:20.590514+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-04-03T05:14:20.590514+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.590514+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:29:07.571711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":214,"num_write":97,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:56.493133+0000","last_change":"2024-04-03T05:14:56.493186+0000","last_active":"2024-04-03T05:14:56.493133+0000","last_peered":"2024-04-03T05:14:56.493133+0000","last_clean":"2024-04-03T05:14:56.493133+0000","last_became_active":"2024-04-03T04:18:51.307933+0000","last_became_peered":"2024-04-03T04:18:51.307933+0000","last_unstale":"2024-04-03T05:14:56.493133+0000","last_undegraded":"2024-04-03T05:14:56.493133+0000","last_fullsized":"2024-04-03T05:14:56.493133+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:56.492933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:56.492933+0000","last_clean_scrub_stamp":"2024-04-03T05:14:56.492933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:05:31.267557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.206018+0000","last_change":"2024-04-03T05:14:39.206018+0000","last_active":"2024-04-03T05:14:39.206018+0000","last_peered":"2024-04-03T05:14:39.206018+0000","last_clean":"2024-04-03T05:14:39.206018+0000","last_became_active":"2024-04-03T03:55:53.266957+0000","last_became_peered":"2024-04-03T03:55:53.266957+0000","last_unstale":"2024-04-03T05:14:39.206018+0000","last_undegraded":"2024-04-03T05:14:39.206018+0000","last_fullsized":"2024-04-03T05:14:39.206018+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:39.205624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:39.205624+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.205624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:09:20.764053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'2","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.252891+0000","last_change":"2024-04-03T05:14:23.252891+0000","last_active":"2024-04-03T05:14:23.252891+0000","last_peered":"2024-04-03T05:14:23.252891+0000","last_clean":"2024-04-03T05:14:23.252891+0000","last_became_active":"2024-04-03T03:55:45.829247+0000","last_became_peered":"2024-04-03T03:55:45.829247+0000","last_unstale":"2024-04-03T05:14:23.252891+0000","last_undegraded":"2024-04-03T05:14:23.252891+0000","last_fullsized":"2024-04-03T05:14:23.252891+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:23.252480+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:23.252480+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.252480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:59:45.549115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"263'66","reported_seq":236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.575622+0000","last_change":"2024-04-03T05:14:15.575655+0000","last_active":"2024-04-03T05:14:15.575622+0000","last_peered":"2024-04-03T05:14:15.575622+0000","last_clean":"2024-04-03T05:14:15.575622+0000","last_became_active":"2024-04-03T03:49:00.990969+0000","last_became_peered":"2024-04-03T03:49:00.990969+0000","last_unstale":"2024-04-03T05:14:15.575622+0000","last_undegraded":"2024-04-03T05:14:15.575622+0000","last_fullsized":"2024-04-03T05:14:15.575622+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-04-03T05:14:15.575468+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-04-03T05:14:15.575468+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.575468+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:10:53.811160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":193,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:58.564848+0000","last_change":"2024-04-03T05:14:58.564876+0000","last_active":"2024-04-03T05:14:58.564848+0000","last_peered":"2024-04-03T05:14:58.564848+0000","last_clean":"2024-04-03T05:14:58.564848+0000","last_became_active":"2024-04-03T04:18:51.310856+0000","last_became_peered":"2024-04-03T04:18:51.310856+0000","last_unstale":"2024-04-03T05:14:58.564848+0000","last_undegraded":"2024-04-03T05:14:58.564848+0000","last_fullsized":"2024-04-03T05:14:58.564848+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:58.564733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:58.564733+0000","last_clean_scrub_stamp":"2024-04-03T05:14:58.564733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:40:18.002422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'6","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.547531+0000","last_change":"2024-04-03T05:14:24.547531+0000","last_active":"2024-04-03T05:14:24.547531+0000","last_peered":"2024-04-03T05:14:24.547531+0000","last_clean":"2024-04-03T05:14:24.547531+0000","last_became_active":"2024-04-03T03:55:53.240485+0000","last_became_peered":"2024-04-03T03:55:53.240485+0000","last_unstale":"2024-04-03T05:14:24.547531+0000","last_undegraded":"2024-04-03T05:14:24.547531+0000","last_fullsized":"2024-04-03T05:14:24.547531+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:24.547121+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:24.547121+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.547121+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:34:01.732381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.818669+0000","last_change":"2024-04-03T05:14:23.818669+0000","last_active":"2024-04-03T05:14:23.818669+0000","last_peered":"2024-04-03T05:14:23.818669+0000","last_clean":"2024-04-03T05:14:23.818669+0000","last_became_active":"2024-04-03T03:55:45.833049+0000","last_became_peered":"2024-04-03T03:55:45.833049+0000","last_unstale":"2024-04-03T05:14:23.818669+0000","last_undegraded":"2024-04-03T05:14:23.818669+0000","last_fullsized":"2024-04-03T05:14:23.818669+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:23.818338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:23.818338+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.818338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:09:23.603846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"263'54","reported_seq":215,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.195113+0000","last_change":"2024-04-03T05:14:19.195179+0000","last_active":"2024-04-03T05:14:19.195113+0000","last_peered":"2024-04-03T05:14:19.195113+0000","last_clean":"2024-04-03T05:14:19.195113+0000","last_became_active":"2024-04-03T03:49:00.969239+0000","last_became_peered":"2024-04-03T03:49:00.969239+0000","last_unstale":"2024-04-03T05:14:19.195113+0000","last_undegraded":"2024-04-03T05:14:19.195113+0000","last_fullsized":"2024-04-03T05:14:19.195113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'54","last_scrub_stamp":"2024-04-03T05:14:19.194918+0000","last_deep_scrub":"263'54","last_deep_scrub_stamp":"2024-04-03T05:14:19.194918+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.194918+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:32:09.246304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":93,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.011006+0000","last_change":"2024-04-03T05:14:54.011006+0000","last_active":"2024-04-03T05:14:54.011006+0000","last_peered":"2024-04-03T05:14:54.011006+0000","last_clean":"2024-04-03T05:14:54.011006+0000","last_became_active":"2024-04-03T04:18:51.318231+0000","last_became_peered":"2024-04-03T04:18:51.318231+0000","last_unstale":"2024-04-03T05:14:54.011006+0000","last_undegraded":"2024-04-03T05:14:54.011006+0000","last_fullsized":"2024-04-03T05:14:54.011006+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:54.010659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:54.010659+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.010659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:32:00.903876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:05.318491+0000","last_change":"2024-04-03T05:15:05.318491+0000","last_active":"2024-04-03T05:15:05.318491+0000","last_peered":"2024-04-03T05:15:05.318491+0000","last_clean":"2024-04-03T05:15:05.318491+0000","last_became_active":"2024-04-03T03:55:53.278529+0000","last_became_peered":"2024-04-03T03:55:53.278529+0000","last_unstale":"2024-04-03T05:15:05.318491+0000","last_undegraded":"2024-04-03T05:15:05.318491+0000","last_fullsized":"2024-04-03T05:15:05.318491+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:15:05.318092+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:15:05.318092+0000","last_clean_scrub_stamp":"2024-04-03T05:15:05.318092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:06:27.250899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'2","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.911278+0000","last_change":"2024-04-03T05:14:15.911278+0000","last_active":"2024-04-03T05:14:15.911278+0000","last_peered":"2024-04-03T05:14:15.911278+0000","last_clean":"2024-04-03T05:14:15.911278+0000","last_became_active":"2024-04-03T03:55:45.820737+0000","last_became_peered":"2024-04-03T03:55:45.820737+0000","last_unstale":"2024-04-03T05:14:15.911278+0000","last_undegraded":"2024-04-03T05:14:15.911278+0000","last_fullsized":"2024-04-03T05:14:15.911278+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:15.911138+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:15.911138+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.911138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:35:35.324319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"263'71","reported_seq":258,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.486256+0000","last_change":"2024-04-03T05:14:18.486381+0000","last_active":"2024-04-03T05:14:18.486256+0000","last_peered":"2024-04-03T05:14:18.486256+0000","last_clean":"2024-04-03T05:14:18.486256+0000","last_became_active":"2024-04-03T03:49:00.987062+0000","last_became_peered":"2024-04-03T03:49:00.987062+0000","last_unstale":"2024-04-03T05:14:18.486256+0000","last_undegraded":"2024-04-03T05:14:18.486256+0000","last_fullsized":"2024-04-03T05:14:18.486256+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'71","last_scrub_stamp":"2024-04-03T05:14:18.485978+0000","last_deep_scrub":"263'71","last_deep_scrub_stamp":"2024-04-03T05:14:18.485978+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.485978+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:34:39.263878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":233,"num_write":115,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:12.424187+0000","last_change":"2024-04-03T05:15:12.424254+0000","last_active":"2024-04-03T05:15:12.424187+0000","last_peered":"2024-04-03T05:15:12.424187+0000","last_clean":"2024-04-03T05:15:12.424187+0000","last_became_active":"2024-04-03T04:18:51.319383+0000","last_became_peered":"2024-04-03T04:18:51.319383+0000","last_unstale":"2024-04-03T05:15:12.424187+0000","last_undegraded":"2024-04-03T05:15:12.424187+0000","last_fullsized":"2024-04-03T05:15:12.424187+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:15:12.423972+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:15:12.423972+0000","last_clean_scrub_stamp":"2024-04-03T05:15:12.423972+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:50:13.757991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'11","reported_seq":86,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.060301+0000","last_change":"2024-04-03T05:14:51.060301+0000","last_active":"2024-04-03T05:14:51.060301+0000","last_peered":"2024-04-03T05:14:51.060301+0000","last_clean":"2024-04-03T05:14:51.060301+0000","last_became_active":"2024-04-03T03:55:53.279910+0000","last_became_peered":"2024-04-03T03:55:53.279910+0000","last_unstale":"2024-04-03T05:14:51.060301+0000","last_undegraded":"2024-04-03T05:14:51.060301+0000","last_fullsized":"2024-04-03T05:14:51.060301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:51.060038+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:51.060038+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.060038+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:56:02.111472+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12290,"num_write":19,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'6","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.447085+0000","last_change":"2024-04-03T05:14:20.447085+0000","last_active":"2024-04-03T05:14:20.447085+0000","last_peered":"2024-04-03T05:14:20.447085+0000","last_clean":"2024-04-03T05:14:20.447085+0000","last_became_active":"2024-04-03T03:55:45.840884+0000","last_became_peered":"2024-04-03T03:55:45.840884+0000","last_unstale":"2024-04-03T05:14:20.447085+0000","last_undegraded":"2024-04-03T05:14:20.447085+0000","last_fullsized":"2024-04-03T05:14:20.447085+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:20.446700+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:20.446700+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.446700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:38:24.233173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13312,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"263'34","reported_seq":153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.003460+0000","last_change":"2024-04-03T05:14:21.003529+0000","last_active":"2024-04-03T05:14:21.003460+0000","last_peered":"2024-04-03T05:14:21.003460+0000","last_clean":"2024-04-03T05:14:21.003460+0000","last_became_active":"2024-04-03T03:49:00.966982+0000","last_became_peered":"2024-04-03T03:49:00.966982+0000","last_unstale":"2024-04-03T05:14:21.003460+0000","last_undegraded":"2024-04-03T05:14:21.003460+0000","last_fullsized":"2024-04-03T05:14:21.003460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-04-03T05:14:21.003253+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-04-03T05:14:21.003253+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.003253+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:55:19.768847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:10.393220+0000","last_change":"2024-04-03T05:15:10.393294+0000","last_active":"2024-04-03T05:15:10.393220+0000","last_peered":"2024-04-03T05:15:10.393220+0000","last_clean":"2024-04-03T05:15:10.393220+0000","last_became_active":"2024-04-03T04:18:51.314416+0000","last_became_peered":"2024-04-03T04:18:51.314416+0000","last_unstale":"2024-04-03T05:15:10.393220+0000","last_undegraded":"2024-04-03T05:15:10.393220+0000","last_fullsized":"2024-04-03T05:15:10.393220+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:15:10.393021+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:15:10.393021+0000","last_clean_scrub_stamp":"2024-04-03T05:15:10.393021+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:30:33.436579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"263'11","reported_seq":86,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.446764+0000","last_change":"2024-04-03T05:14:46.446828+0000","last_active":"2024-04-03T05:14:46.446764+0000","last_peered":"2024-04-03T05:14:46.446764+0000","last_clean":"2024-04-03T05:14:46.446764+0000","last_became_active":"2024-04-03T03:55:53.248092+0000","last_became_peered":"2024-04-03T03:55:53.248092+0000","last_unstale":"2024-04-03T05:14:46.446764+0000","last_undegraded":"2024-04-03T05:14:46.446764+0000","last_fullsized":"2024-04-03T05:14:46.446764+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:46.446558+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:46.446558+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.446558+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:25:20.293058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"258'2","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:02.319536+0000","last_change":"2024-04-03T05:15:02.319624+0000","last_active":"2024-04-03T05:15:02.319536+0000","last_peered":"2024-04-03T05:15:02.319536+0000","last_clean":"2024-04-03T05:15:02.319536+0000","last_became_active":"2024-04-03T03:55:45.829835+0000","last_became_peered":"2024-04-03T03:55:45.829835+0000","last_unstale":"2024-04-03T05:15:02.319536+0000","last_undegraded":"2024-04-03T05:15:02.319536+0000","last_fullsized":"2024-04-03T05:15:02.319536+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:15:02.319312+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:15:02.319312+0000","last_clean_scrub_stamp":"2024-04-03T05:15:02.319312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:13:17.695601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"263'30","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.254552+0000","last_change":"2024-04-03T05:14:27.254552+0000","last_active":"2024-04-03T05:14:27.254552+0000","last_peered":"2024-04-03T05:14:27.254552+0000","last_clean":"2024-04-03T05:14:27.254552+0000","last_became_active":"2024-04-03T03:49:00.983761+0000","last_became_peered":"2024-04-03T03:49:00.983761+0000","last_unstale":"2024-04-03T05:14:27.254552+0000","last_undegraded":"2024-04-03T05:14:27.254552+0000","last_fullsized":"2024-04-03T05:14:27.254552+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-04-03T05:14:27.254297+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-04-03T05:14:27.254297+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.254297+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:58:42.410817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":71,"num_write":59,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:11.440710+0000","last_change":"2024-04-03T05:15:11.440767+0000","last_active":"2024-04-03T05:15:11.440710+0000","last_peered":"2024-04-03T05:15:11.440710+0000","last_clean":"2024-04-03T05:15:11.440710+0000","last_became_active":"2024-04-03T04:18:51.319470+0000","last_became_peered":"2024-04-03T04:18:51.319470+0000","last_unstale":"2024-04-03T05:15:11.440710+0000","last_undegraded":"2024-04-03T05:15:11.440710+0000","last_fullsized":"2024-04-03T05:15:11.440710+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:11.440506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:11.440506+0000","last_clean_scrub_stamp":"2024-04-03T05:15:11.440506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:41:10.619478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'8","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:04.925782+0000","last_change":"2024-04-03T05:15:04.925861+0000","last_active":"2024-04-03T05:15:04.925782+0000","last_peered":"2024-04-03T05:15:04.925782+0000","last_clean":"2024-04-03T05:15:04.925782+0000","last_became_active":"2024-04-03T03:55:53.257856+0000","last_became_peered":"2024-04-03T03:55:53.257856+0000","last_unstale":"2024-04-03T05:15:04.925782+0000","last_undegraded":"2024-04-03T05:15:04.925782+0000","last_fullsized":"2024-04-03T05:15:04.925782+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:15:04.925593+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:15:04.925593+0000","last_clean_scrub_stamp":"2024-04-03T05:15:04.925593+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:19:53.418052+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":16434,"num_write":11,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'14","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.113680+0000","last_change":"2024-04-03T05:14:27.113680+0000","last_active":"2024-04-03T05:14:27.113680+0000","last_peered":"2024-04-03T05:14:27.113680+0000","last_clean":"2024-04-03T05:14:27.113680+0000","last_became_active":"2024-04-03T03:55:45.829711+0000","last_became_peered":"2024-04-03T03:55:45.829711+0000","last_unstale":"2024-04-03T05:14:27.113680+0000","last_undegraded":"2024-04-03T05:14:27.113680+0000","last_fullsized":"2024-04-03T05:14:27.113680+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-04-03T05:14:27.113418+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-04-03T05:14:27.113418+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.113418+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:00:20.265172+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":20484,"num_write":20,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"263'38","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.342198+0000","last_change":"2024-04-03T05:14:20.342198+0000","last_active":"2024-04-03T05:14:20.342198+0000","last_peered":"2024-04-03T05:14:20.342198+0000","last_clean":"2024-04-03T05:14:20.342198+0000","last_became_active":"2024-04-03T03:49:00.987174+0000","last_became_peered":"2024-04-03T03:49:00.987174+0000","last_unstale":"2024-04-03T05:14:20.342198+0000","last_undegraded":"2024-04-03T05:14:20.342198+0000","last_fullsized":"2024-04-03T05:14:20.342198+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-04-03T05:14:20.341945+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-04-03T05:14:20.341945+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.341945+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:38.153173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:13.413262+0000","last_change":"2024-04-03T05:15:13.413360+0000","last_active":"2024-04-03T05:15:13.413262+0000","last_peered":"2024-04-03T05:15:13.413262+0000","last_clean":"2024-04-03T05:15:13.413262+0000","last_became_active":"2024-04-03T04:18:51.320359+0000","last_became_peered":"2024-04-03T04:18:51.320359+0000","last_unstale":"2024-04-03T05:15:13.413262+0000","last_undegraded":"2024-04-03T05:15:13.413262+0000","last_fullsized":"2024-04-03T05:15:13.413262+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:13.412986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:13.412986+0000","last_clean_scrub_stamp":"2024-04-03T05:15:13.412986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:02:32.289090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"258'2","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.502674+0000","last_change":"2024-04-03T05:14:54.502674+0000","last_active":"2024-04-03T05:14:54.502674+0000","last_peered":"2024-04-03T05:14:54.502674+0000","last_clean":"2024-04-03T05:14:54.502674+0000","last_became_active":"2024-04-03T03:55:53.274653+0000","last_became_peered":"2024-04-03T03:55:53.274653+0000","last_unstale":"2024-04-03T05:14:54.502674+0000","last_undegraded":"2024-04-03T05:14:54.502674+0000","last_fullsized":"2024-04-03T05:14:54.502674+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:54.502395+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:54.502395+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.502395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:00:26.169798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.428145+0000","last_change":"2024-04-03T05:14:44.428201+0000","last_active":"2024-04-03T05:14:44.428145+0000","last_peered":"2024-04-03T05:14:44.428145+0000","last_clean":"2024-04-03T05:14:44.428145+0000","last_became_active":"2024-04-03T03:55:45.832127+0000","last_became_peered":"2024-04-03T03:55:45.832127+0000","last_unstale":"2024-04-03T05:14:44.428145+0000","last_undegraded":"2024-04-03T05:14:44.428145+0000","last_fullsized":"2024-04-03T05:14:44.428145+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:44.427934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:44.427934+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.427934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:59:22.452340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"263'16","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.516914+0000","last_change":"2024-04-03T05:14:17.516914+0000","last_active":"2024-04-03T05:14:17.516914+0000","last_peered":"2024-04-03T05:14:17.516914+0000","last_clean":"2024-04-03T05:14:17.516914+0000","last_became_active":"2024-04-03T03:49:00.987993+0000","last_became_peered":"2024-04-03T03:49:00.987993+0000","last_unstale":"2024-04-03T05:14:17.516914+0000","last_undegraded":"2024-04-03T05:14:17.516914+0000","last_fullsized":"2024-04-03T05:14:17.516914+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-04-03T05:14:17.516663+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-04-03T05:14:17.516663+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.516663+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:02:59.257046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:00.584825+0000","last_change":"2024-04-03T05:15:00.584882+0000","last_active":"2024-04-03T05:15:00.584825+0000","last_peered":"2024-04-03T05:15:00.584825+0000","last_clean":"2024-04-03T05:15:00.584825+0000","last_became_active":"2024-04-03T04:18:51.373189+0000","last_became_peered":"2024-04-03T04:18:51.373189+0000","last_unstale":"2024-04-03T05:15:00.584825+0000","last_undegraded":"2024-04-03T05:15:00.584825+0000","last_fullsized":"2024-04-03T05:15:00.584825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:00.584640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:00.584640+0000","last_clean_scrub_stamp":"2024-04-03T05:15:00.584640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:12:46.439562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'4","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.262833+0000","last_change":"2024-04-03T05:14:39.262897+0000","last_active":"2024-04-03T05:14:39.262833+0000","last_peered":"2024-04-03T05:14:39.262833+0000","last_clean":"2024-04-03T05:14:39.262833+0000","last_became_active":"2024-04-03T03:55:53.243858+0000","last_became_peered":"2024-04-03T03:55:53.243858+0000","last_unstale":"2024-04-03T05:14:39.262833+0000","last_undegraded":"2024-04-03T05:14:39.262833+0000","last_fullsized":"2024-04-03T05:14:39.262833+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:39.262646+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:39.262646+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.262646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:26:13.319997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'8","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.301561+0000","last_change":"2024-04-03T05:14:22.301561+0000","last_active":"2024-04-03T05:14:22.301561+0000","last_peered":"2024-04-03T05:14:22.301561+0000","last_clean":"2024-04-03T05:14:22.301561+0000","last_became_active":"2024-04-03T03:55:45.815910+0000","last_became_peered":"2024-04-03T03:55:45.815910+0000","last_unstale":"2024-04-03T05:14:22.301561+0000","last_undegraded":"2024-04-03T05:14:22.301561+0000","last_fullsized":"2024-04-03T05:14:22.301561+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:22.301288+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:22.301288+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.301288+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:28.061626+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"263'51","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.161207+0000","last_change":"2024-04-03T05:14:17.161207+0000","last_active":"2024-04-03T05:14:17.161207+0000","last_peered":"2024-04-03T05:14:17.161207+0000","last_clean":"2024-04-03T05:14:17.161207+0000","last_became_active":"2024-04-03T03:49:00.965454+0000","last_became_peered":"2024-04-03T03:49:00.965454+0000","last_unstale":"2024-04-03T05:14:17.161207+0000","last_undegraded":"2024-04-03T05:14:17.161207+0000","last_fullsized":"2024-04-03T05:14:17.161207+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-04-03T05:14:17.160932+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-04-03T05:14:17.160932+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.160932+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:02:36.721077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":162,"num_write":91,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:08.838340+0000","last_change":"2024-04-03T05:15:08.838340+0000","last_active":"2024-04-03T05:15:08.838340+0000","last_peered":"2024-04-03T05:15:08.838340+0000","last_clean":"2024-04-03T05:15:08.838340+0000","last_became_active":"2024-04-03T04:18:51.367071+0000","last_became_peered":"2024-04-03T04:18:51.367071+0000","last_unstale":"2024-04-03T05:15:08.838340+0000","last_undegraded":"2024-04-03T05:15:08.838340+0000","last_fullsized":"2024-04-03T05:15:08.838340+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:08.838015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:08.838015+0000","last_clean_scrub_stamp":"2024-04-03T05:15:08.838015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:22:26.729317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"258'2","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.596827+0000","last_change":"2024-04-03T05:14:23.596893+0000","last_active":"2024-04-03T05:14:23.596827+0000","last_peered":"2024-04-03T05:14:23.596827+0000","last_clean":"2024-04-03T05:14:23.596827+0000","last_became_active":"2024-04-03T03:55:53.265100+0000","last_became_peered":"2024-04-03T03:55:53.265100+0000","last_unstale":"2024-04-03T05:14:23.596827+0000","last_undegraded":"2024-04-03T05:14:23.596827+0000","last_fullsized":"2024-04-03T05:14:23.596827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:23.596633+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:23.596633+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.596633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:33:10.162116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'8","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.790209+0000","last_change":"2024-04-03T05:14:17.790327+0000","last_active":"2024-04-03T05:14:17.790209+0000","last_peered":"2024-04-03T05:14:17.790209+0000","last_clean":"2024-04-03T05:14:17.790209+0000","last_became_active":"2024-04-03T03:55:45.822292+0000","last_became_peered":"2024-04-03T03:55:45.822292+0000","last_unstale":"2024-04-03T05:14:17.790209+0000","last_undegraded":"2024-04-03T05:14:17.790209+0000","last_fullsized":"2024-04-03T05:14:17.790209+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:17.789970+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:17.789970+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.789970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:00:22.608204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"263'28","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.615807+0000","last_change":"2024-04-03T05:14:18.615807+0000","last_active":"2024-04-03T05:14:18.615807+0000","last_peered":"2024-04-03T05:14:18.615807+0000","last_clean":"2024-04-03T05:14:18.615807+0000","last_became_active":"2024-04-03T03:49:00.981338+0000","last_became_peered":"2024-04-03T03:49:00.981338+0000","last_unstale":"2024-04-03T05:14:18.615807+0000","last_undegraded":"2024-04-03T05:14:18.615807+0000","last_fullsized":"2024-04-03T05:14:18.615807+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-04-03T05:14:18.615526+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-04-03T05:14:18.615526+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.615526+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:26:42.378669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:04.758227+0000","last_change":"2024-04-03T05:15:04.758227+0000","last_active":"2024-04-03T05:15:04.758227+0000","last_peered":"2024-04-03T05:15:04.758227+0000","last_clean":"2024-04-03T05:15:04.758227+0000","last_became_active":"2024-04-03T04:18:51.308461+0000","last_became_peered":"2024-04-03T04:18:51.308461+0000","last_unstale":"2024-04-03T05:15:04.758227+0000","last_undegraded":"2024-04-03T05:15:04.758227+0000","last_fullsized":"2024-04-03T05:15:04.758227+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:04.757964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:04.757964+0000","last_clean_scrub_stamp":"2024-04-03T05:15:04.757964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:10:14.752759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.206357+0000","last_change":"2024-04-03T05:14:35.206443+0000","last_active":"2024-04-03T05:14:35.206357+0000","last_peered":"2024-04-03T05:14:35.206357+0000","last_clean":"2024-04-03T05:14:35.206357+0000","last_became_active":"2024-04-03T03:55:53.243822+0000","last_became_peered":"2024-04-03T03:55:53.243822+0000","last_unstale":"2024-04-03T05:14:35.206357+0000","last_undegraded":"2024-04-03T05:14:35.206357+0000","last_fullsized":"2024-04-03T05:14:35.206357+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:35.206168+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:35.206168+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.206168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:13:22.172343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'4","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.270479+0000","last_change":"2024-04-03T05:14:17.270479+0000","last_active":"2024-04-03T05:14:17.270479+0000","last_peered":"2024-04-03T05:14:17.270479+0000","last_clean":"2024-04-03T05:14:17.270479+0000","last_became_active":"2024-04-03T03:55:45.819117+0000","last_became_peered":"2024-04-03T03:55:45.819117+0000","last_unstale":"2024-04-03T05:14:17.270479+0000","last_undegraded":"2024-04-03T05:14:17.270479+0000","last_fullsized":"2024-04-03T05:14:17.270479+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:17.270342+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:17.270342+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.270342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:39:43.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"263'9","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.532743+0000","last_change":"2024-04-03T05:14:16.532814+0000","last_active":"2024-04-03T05:14:16.532743+0000","last_peered":"2024-04-03T05:14:16.532743+0000","last_clean":"2024-04-03T05:14:16.532743+0000","last_became_active":"2024-04-03T03:49:00.991393+0000","last_became_peered":"2024-04-03T03:49:00.991393+0000","last_unstale":"2024-04-03T05:14:16.532743+0000","last_undegraded":"2024-04-03T05:14:16.532743+0000","last_fullsized":"2024-04-03T05:14:16.532743+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-04-03T05:14:16.532534+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-04-03T05:14:16.532534+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.532534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:38:21.117233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":23,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:06.887264+0000","last_change":"2024-04-03T05:15:06.887319+0000","last_active":"2024-04-03T05:15:06.887264+0000","last_peered":"2024-04-03T05:15:06.887264+0000","last_clean":"2024-04-03T05:15:06.887264+0000","last_became_active":"2024-04-03T04:18:51.315679+0000","last_became_peered":"2024-04-03T04:18:51.315679+0000","last_unstale":"2024-04-03T05:15:06.887264+0000","last_undegraded":"2024-04-03T05:15:06.887264+0000","last_fullsized":"2024-04-03T05:15:06.887264+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:06.887060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:06.887060+0000","last_clean_scrub_stamp":"2024-04-03T05:15:06.887060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:43:29.084369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'5","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:59.757684+0000","last_change":"2024-04-03T05:14:59.757865+0000","last_active":"2024-04-03T05:14:59.757684+0000","last_peered":"2024-04-03T05:14:59.757684+0000","last_clean":"2024-04-03T05:14:59.757684+0000","last_became_active":"2024-04-03T03:55:53.277402+0000","last_became_peered":"2024-04-03T03:55:53.277402+0000","last_unstale":"2024-04-03T05:14:59.757684+0000","last_undegraded":"2024-04-03T05:14:59.757684+0000","last_fullsized":"2024-04-03T05:14:59.757684+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-04-03T05:14:59.757458+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-04-03T05:14:59.757458+0000","last_clean_scrub_stamp":"2024-04-03T05:14:59.757458+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:09:02.483703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":3,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'8","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.423054+0000","last_change":"2024-04-03T05:14:18.423124+0000","last_active":"2024-04-03T05:14:18.423054+0000","last_peered":"2024-04-03T05:14:18.423054+0000","last_clean":"2024-04-03T05:14:18.423054+0000","last_became_active":"2024-04-03T03:55:45.814319+0000","last_became_peered":"2024-04-03T03:55:45.814319+0000","last_unstale":"2024-04-03T05:14:18.423054+0000","last_undegraded":"2024-04-03T05:14:18.423054+0000","last_fullsized":"2024-04-03T05:14:18.423054+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:18.422837+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:18.422837+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.422837+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:11:35.323066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"263'34","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.501763+0000","last_change":"2024-04-03T05:14:30.501826+0000","last_active":"2024-04-03T05:14:30.501763+0000","last_peered":"2024-04-03T05:14:30.501763+0000","last_clean":"2024-04-03T05:14:30.501763+0000","last_became_active":"2024-04-03T03:49:00.979122+0000","last_became_peered":"2024-04-03T03:49:00.979122+0000","last_unstale":"2024-04-03T05:14:30.501763+0000","last_undegraded":"2024-04-03T05:14:30.501763+0000","last_fullsized":"2024-04-03T05:14:30.501763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-04-03T05:14:30.501563+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-04-03T05:14:30.501563+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.501563+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:08:28.157076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":103,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:59.605698+0000","last_change":"2024-04-03T05:14:59.605698+0000","last_active":"2024-04-03T05:14:59.605698+0000","last_peered":"2024-04-03T05:14:59.605698+0000","last_clean":"2024-04-03T05:14:59.605698+0000","last_became_active":"2024-04-03T04:18:51.318018+0000","last_became_peered":"2024-04-03T04:18:51.318018+0000","last_unstale":"2024-04-03T05:14:59.605698+0000","last_undegraded":"2024-04-03T05:14:59.605698+0000","last_fullsized":"2024-04-03T05:14:59.605698+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:59.605369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:59.605369+0000","last_clean_scrub_stamp":"2024-04-03T05:14:59.605369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:10:06.385459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'7","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:07.183855+0000","last_change":"2024-04-03T05:15:07.183942+0000","last_active":"2024-04-03T05:15:07.183855+0000","last_peered":"2024-04-03T05:15:07.183855+0000","last_clean":"2024-04-03T05:15:07.183855+0000","last_became_active":"2024-04-03T03:55:53.254546+0000","last_became_peered":"2024-04-03T03:55:53.254546+0000","last_unstale":"2024-04-03T05:15:07.183855+0000","last_undegraded":"2024-04-03T05:15:07.183855+0000","last_fullsized":"2024-04-03T05:15:07.183855+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-04-03T05:15:07.183660+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-04-03T05:15:07.183660+0000","last_clean_scrub_stamp":"2024-04-03T05:15:07.183660+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:14:30.311086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.967998+0000","last_change":"2024-04-03T05:14:16.968043+0000","last_active":"2024-04-03T05:14:16.967998+0000","last_peered":"2024-04-03T05:14:16.967998+0000","last_clean":"2024-04-03T05:14:16.967998+0000","last_became_active":"2024-04-03T03:55:45.820294+0000","last_became_peered":"2024-04-03T03:55:45.820294+0000","last_unstale":"2024-04-03T05:14:16.967998+0000","last_undegraded":"2024-04-03T05:14:16.967998+0000","last_fullsized":"2024-04-03T05:14:16.967998+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-04-03T05:14:16.967919+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-04-03T05:14:16.967919+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.967919+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:45:58.471685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18434,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"263'22","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.255113+0000","last_change":"2024-04-03T05:14:23.255191+0000","last_active":"2024-04-03T05:14:23.255113+0000","last_peered":"2024-04-03T05:14:23.255113+0000","last_clean":"2024-04-03T05:14:23.255113+0000","last_became_active":"2024-04-03T03:49:00.979598+0000","last_became_peered":"2024-04-03T03:49:00.979598+0000","last_unstale":"2024-04-03T05:14:23.255113+0000","last_undegraded":"2024-04-03T05:14:23.255113+0000","last_fullsized":"2024-04-03T05:14:23.255113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'22","last_scrub_stamp":"2024-04-03T05:14:23.254887+0000","last_deep_scrub":"263'22","last_deep_scrub_stamp":"2024-04-03T05:14:23.254887+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.254887+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:57:20.929131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":52,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:10.078971+0000","last_change":"2024-04-03T05:15:10.079027+0000","last_active":"2024-04-03T05:15:10.078971+0000","last_peered":"2024-04-03T05:15:10.078971+0000","last_clean":"2024-04-03T05:15:10.078971+0000","last_became_active":"2024-04-03T04:18:51.366501+0000","last_became_peered":"2024-04-03T04:18:51.366501+0000","last_unstale":"2024-04-03T05:15:10.078971+0000","last_undegraded":"2024-04-03T05:15:10.078971+0000","last_fullsized":"2024-04-03T05:15:10.078971+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:10.078769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:10.078769+0000","last_clean_scrub_stamp":"2024-04-03T05:15:10.078769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:19:05.878585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'11","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.423373+0000","last_change":"2024-04-03T05:14:47.423453+0000","last_active":"2024-04-03T05:14:47.423373+0000","last_peered":"2024-04-03T05:14:47.423373+0000","last_clean":"2024-04-03T05:14:47.423373+0000","last_became_active":"2024-04-03T03:55:53.266771+0000","last_became_peered":"2024-04-03T03:55:53.266771+0000","last_unstale":"2024-04-03T05:14:47.423373+0000","last_undegraded":"2024-04-03T05:14:47.423373+0000","last_fullsized":"2024-04-03T05:14:47.423373+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:47.423149+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:47.423149+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.423149+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:53:32.932026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":19,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'3","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.065902+0000","last_change":"2024-04-03T05:14:49.065970+0000","last_active":"2024-04-03T05:14:49.065902+0000","last_peered":"2024-04-03T05:14:49.065902+0000","last_clean":"2024-04-03T05:14:49.065902+0000","last_became_active":"2024-04-03T03:55:45.836623+0000","last_became_peered":"2024-04-03T03:55:45.836623+0000","last_unstale":"2024-04-03T05:14:49.065902+0000","last_undegraded":"2024-04-03T05:14:49.065902+0000","last_fullsized":"2024-04-03T05:14:49.065902+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-04-03T05:14:49.065663+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-04-03T05:14:49.065663+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.065663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:25:53.324907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"263'70","reported_seq":243,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.399386+0000","last_change":"2024-04-03T05:14:42.399446+0000","last_active":"2024-04-03T05:14:42.399386+0000","last_peered":"2024-04-03T05:14:42.399386+0000","last_clean":"2024-04-03T05:14:42.399386+0000","last_became_active":"2024-04-03T03:49:00.978563+0000","last_became_peered":"2024-04-03T03:49:00.978563+0000","last_unstale":"2024-04-03T05:14:42.399386+0000","last_undegraded":"2024-04-03T05:14:42.399386+0000","last_fullsized":"2024-04-03T05:14:42.399386+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'70","last_scrub_stamp":"2024-04-03T05:14:42.399194+0000","last_deep_scrub":"263'70","last_deep_scrub_stamp":"2024-04-03T05:14:42.399194+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.399194+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:04:14.620157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":197,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:09.125881+0000","last_change":"2024-04-03T05:15:09.125941+0000","last_active":"2024-04-03T05:15:09.125881+0000","last_peered":"2024-04-03T05:15:09.125881+0000","last_clean":"2024-04-03T05:15:09.125881+0000","last_became_active":"2024-04-03T04:18:51.311005+0000","last_became_peered":"2024-04-03T04:18:51.311005+0000","last_unstale":"2024-04-03T05:15:09.125881+0000","last_undegraded":"2024-04-03T05:15:09.125881+0000","last_fullsized":"2024-04-03T05:15:09.125881+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:09.125640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:09.125640+0000","last_clean_scrub_stamp":"2024-04-03T05:15:09.125640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:40:27.684801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"258'3","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.815260+0000","last_change":"2024-04-03T05:14:35.815260+0000","last_active":"2024-04-03T05:14:35.815260+0000","last_peered":"2024-04-03T05:14:35.815260+0000","last_clean":"2024-04-03T05:14:35.815260+0000","last_became_active":"2024-04-03T03:55:53.251863+0000","last_became_peered":"2024-04-03T03:55:53.251863+0000","last_unstale":"2024-04-03T05:14:35.815260+0000","last_undegraded":"2024-04-03T05:14:35.815260+0000","last_fullsized":"2024-04-03T05:14:35.815260+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-04-03T05:14:35.814988+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-04-03T05:14:35.814988+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.814988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:02:35.981117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"0'0","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.207038+0000","last_change":"2024-04-03T05:14:19.207099+0000","last_active":"2024-04-03T05:14:19.207038+0000","last_peered":"2024-04-03T05:14:19.207038+0000","last_clean":"2024-04-03T05:14:19.207038+0000","last_became_active":"2024-04-03T03:55:45.823003+0000","last_became_peered":"2024-04-03T03:55:45.823003+0000","last_unstale":"2024-04-03T05:14:19.207038+0000","last_undegraded":"2024-04-03T05:14:19.207038+0000","last_fullsized":"2024-04-03T05:14:19.207038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:19.206826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:19.206826+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.206826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:47:42.400975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"263'42","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.827228+0000","last_change":"2024-04-03T05:14:22.827287+0000","last_active":"2024-04-03T05:14:22.827228+0000","last_peered":"2024-04-03T05:14:22.827228+0000","last_clean":"2024-04-03T05:14:22.827228+0000","last_became_active":"2024-04-03T03:49:00.981940+0000","last_became_peered":"2024-04-03T03:49:00.981940+0000","last_unstale":"2024-04-03T05:14:22.827228+0000","last_undegraded":"2024-04-03T05:14:22.827228+0000","last_fullsized":"2024-04-03T05:14:22.827228+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-04-03T05:14:22.827034+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-04-03T05:14:22.827034+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.827034+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:48:11.329544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":74,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:02.742263+0000","last_change":"2024-04-03T05:15:02.742263+0000","last_active":"2024-04-03T05:15:02.742263+0000","last_peered":"2024-04-03T05:15:02.742263+0000","last_clean":"2024-04-03T05:15:02.742263+0000","last_became_active":"2024-04-03T04:18:51.301260+0000","last_became_peered":"2024-04-03T04:18:51.301260+0000","last_unstale":"2024-04-03T05:15:02.742263+0000","last_undegraded":"2024-04-03T05:15:02.742263+0000","last_fullsized":"2024-04-03T05:15:02.742263+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:15:02.742006+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:15:02.742006+0000","last_clean_scrub_stamp":"2024-04-03T05:15:02.742006+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:24.092649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:03.888068+0000","last_change":"2024-04-03T05:15:03.888129+0000","last_active":"2024-04-03T05:15:03.888068+0000","last_peered":"2024-04-03T05:15:03.888068+0000","last_clean":"2024-04-03T05:15:03.888068+0000","last_became_active":"2024-04-03T03:55:53.257421+0000","last_became_peered":"2024-04-03T03:55:53.257421+0000","last_unstale":"2024-04-03T05:15:03.888068+0000","last_undegraded":"2024-04-03T05:15:03.888068+0000","last_fullsized":"2024-04-03T05:15:03.888068+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:15:03.887886+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:15:03.887886+0000","last_clean_scrub_stamp":"2024-04-03T05:15:03.887886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:52:31.791000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:15.581955+0000","last_change":"2024-04-03T05:14:15.581955+0000","last_active":"2024-04-03T05:14:15.581955+0000","last_peered":"2024-04-03T05:14:15.581955+0000","last_clean":"2024-04-03T05:14:15.581955+0000","last_became_active":"2024-04-03T03:55:45.822134+0000","last_became_peered":"2024-04-03T03:55:45.822134+0000","last_unstale":"2024-04-03T05:14:15.581955+0000","last_undegraded":"2024-04-03T05:14:15.581955+0000","last_fullsized":"2024-04-03T05:14:15.581955+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-04-03T05:14:15.581753+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-04-03T05:14:15.581753+0000","last_clean_scrub_stamp":"2024-04-03T05:14:15.581753+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:13:39.514734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"263'37","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.295589+0000","last_change":"2024-04-03T05:14:31.295589+0000","last_active":"2024-04-03T05:14:31.295589+0000","last_peered":"2024-04-03T05:14:31.295589+0000","last_clean":"2024-04-03T05:14:31.295589+0000","last_became_active":"2024-04-03T03:49:00.989509+0000","last_became_peered":"2024-04-03T03:49:00.989509+0000","last_unstale":"2024-04-03T05:14:31.295589+0000","last_undegraded":"2024-04-03T05:14:31.295589+0000","last_fullsized":"2024-04-03T05:14:31.295589+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-04-03T05:14:31.295305+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-04-03T05:14:31.295305+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.295305+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:06:48.153827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":115,"num_write":60,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:07.863677+0000","last_change":"2024-04-03T05:15:07.863677+0000","last_active":"2024-04-03T05:15:07.863677+0000","last_peered":"2024-04-03T05:15:07.863677+0000","last_clean":"2024-04-03T05:15:07.863677+0000","last_became_active":"2024-04-03T04:18:51.366898+0000","last_became_peered":"2024-04-03T04:18:51.366898+0000","last_unstale":"2024-04-03T05:15:07.863677+0000","last_undegraded":"2024-04-03T05:15:07.863677+0000","last_fullsized":"2024-04-03T05:15:07.863677+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:07.863329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:07.863329+0000","last_clean_scrub_stamp":"2024-04-03T05:15:07.863329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:00:49.654740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:04.334474+0000","last_change":"2024-04-03T05:15:04.334530+0000","last_active":"2024-04-03T05:15:04.334474+0000","last_peered":"2024-04-03T05:15:04.334474+0000","last_clean":"2024-04-03T05:15:04.334474+0000","last_became_active":"2024-04-03T03:55:53.272757+0000","last_became_peered":"2024-04-03T03:55:53.272757+0000","last_unstale":"2024-04-03T05:15:04.334474+0000","last_undegraded":"2024-04-03T05:15:04.334474+0000","last_fullsized":"2024-04-03T05:15:04.334474+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:04.334249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:04.334249+0000","last_clean_scrub_stamp":"2024-04-03T05:15:04.334249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:40.790139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.778706+0000","last_change":"2024-04-03T05:14:27.778761+0000","last_active":"2024-04-03T05:14:27.778706+0000","last_peered":"2024-04-03T05:14:27.778706+0000","last_clean":"2024-04-03T05:14:27.778706+0000","last_became_active":"2024-04-03T03:55:45.834364+0000","last_became_peered":"2024-04-03T03:55:45.834364+0000","last_unstale":"2024-04-03T05:14:27.778706+0000","last_undegraded":"2024-04-03T05:14:27.778706+0000","last_fullsized":"2024-04-03T05:14:27.778706+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.778514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.778514+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.778514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:44:07.258462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"263'29","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.843494+0000","last_change":"2024-04-03T05:14:24.843494+0000","last_active":"2024-04-03T05:14:24.843494+0000","last_peered":"2024-04-03T05:14:24.843494+0000","last_clean":"2024-04-03T05:14:24.843494+0000","last_became_active":"2024-04-03T03:49:00.974654+0000","last_became_peered":"2024-04-03T03:49:00.974654+0000","last_unstale":"2024-04-03T05:14:24.843494+0000","last_undegraded":"2024-04-03T05:14:24.843494+0000","last_fullsized":"2024-04-03T05:14:24.843494+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-04-03T05:14:24.843104+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-04-03T05:14:24.843104+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.843104+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:36:52.914225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:08.345058+0000","last_change":"2024-04-03T05:15:08.345058+0000","last_active":"2024-04-03T05:15:08.345058+0000","last_peered":"2024-04-03T05:15:08.345058+0000","last_clean":"2024-04-03T05:15:08.345058+0000","last_became_active":"2024-04-03T04:18:51.322311+0000","last_became_peered":"2024-04-03T04:18:51.322311+0000","last_unstale":"2024-04-03T05:15:08.345058+0000","last_undegraded":"2024-04-03T05:15:08.345058+0000","last_fullsized":"2024-04-03T05:15:08.345058+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:08.344791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:08.344791+0000","last_clean_scrub_stamp":"2024-04-03T05:15:08.344791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:59:18.089145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'5","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:02.868288+0000","last_change":"2024-04-03T05:15:02.868288+0000","last_active":"2024-04-03T05:15:02.868288+0000","last_peered":"2024-04-03T05:15:02.868288+0000","last_clean":"2024-04-03T05:15:02.868288+0000","last_became_active":"2024-04-03T03:55:53.255322+0000","last_became_peered":"2024-04-03T03:55:53.255322+0000","last_unstale":"2024-04-03T05:15:02.868288+0000","last_undegraded":"2024-04-03T05:15:02.868288+0000","last_fullsized":"2024-04-03T05:15:02.868288+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-04-03T05:15:02.867898+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-04-03T05:15:02.867898+0000","last_clean_scrub_stamp":"2024-04-03T05:15:02.867898+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:33:55.976878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":90,"num_write":10,"num_write_kb":4141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'2","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:16.524760+0000","last_change":"2024-04-03T05:14:16.524760+0000","last_active":"2024-04-03T05:14:16.524760+0000","last_peered":"2024-04-03T05:14:16.524760+0000","last_clean":"2024-04-03T05:14:16.524760+0000","last_became_active":"2024-04-03T03:55:45.825324+0000","last_became_peered":"2024-04-03T03:55:45.825324+0000","last_unstale":"2024-04-03T05:14:16.524760+0000","last_undegraded":"2024-04-03T05:14:16.524760+0000","last_fullsized":"2024-04-03T05:14:16.524760+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:16.524499+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:16.524499+0000","last_clean_scrub_stamp":"2024-04-03T05:14:16.524499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:06:55.683539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"263'10","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:17.922456+0000","last_change":"2024-04-03T05:14:17.922456+0000","last_active":"2024-04-03T05:14:17.922456+0000","last_peered":"2024-04-03T05:14:17.922456+0000","last_clean":"2024-04-03T05:14:17.922456+0000","last_became_active":"2024-04-03T03:49:00.988511+0000","last_became_peered":"2024-04-03T03:49:00.988511+0000","last_unstale":"2024-04-03T05:14:17.922456+0000","last_undegraded":"2024-04-03T05:14:17.922456+0000","last_fullsized":"2024-04-03T05:14:17.922456+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-04-03T05:14:17.922164+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-04-03T05:14:17.922164+0000","last_clean_scrub_stamp":"2024-04-03T05:14:17.922164+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:09:03.267120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:57.533128+0000","last_change":"2024-04-03T05:14:57.533128+0000","last_active":"2024-04-03T05:14:57.533128+0000","last_peered":"2024-04-03T05:14:57.533128+0000","last_clean":"2024-04-03T05:14:57.533128+0000","last_became_active":"2024-04-03T04:18:51.310903+0000","last_became_peered":"2024-04-03T04:18:51.310903+0000","last_unstale":"2024-04-03T05:14:57.533128+0000","last_undegraded":"2024-04-03T05:14:57.533128+0000","last_fullsized":"2024-04-03T05:14:57.533128+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:57.532876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:57.532876+0000","last_clean_scrub_stamp":"2024-04-03T05:14:57.532876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:41:43.066957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'4","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.816391+0000","last_change":"2024-04-03T05:14:31.816522+0000","last_active":"2024-04-03T05:14:31.816391+0000","last_peered":"2024-04-03T05:14:31.816391+0000","last_clean":"2024-04-03T05:14:31.816391+0000","last_became_active":"2024-04-03T03:55:53.248897+0000","last_became_peered":"2024-04-03T03:55:53.248897+0000","last_unstale":"2024-04-03T05:14:31.816391+0000","last_undegraded":"2024-04-03T05:14:31.816391+0000","last_fullsized":"2024-04-03T05:14:31.816391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:31.816146+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:31.816146+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.816146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:02:36.972838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.378955+0000","last_change":"2024-04-03T05:14:35.378955+0000","last_active":"2024-04-03T05:14:35.378955+0000","last_peered":"2024-04-03T05:14:35.378955+0000","last_clean":"2024-04-03T05:14:35.378955+0000","last_became_active":"2024-04-03T03:55:45.822406+0000","last_became_peered":"2024-04-03T03:55:45.822406+0000","last_unstale":"2024-04-03T05:14:35.378955+0000","last_undegraded":"2024-04-03T05:14:35.378955+0000","last_fullsized":"2024-04-03T05:14:35.378955+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:35.378674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:35.378674+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.378674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:50.015655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"263'32","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.310176+0000","last_change":"2024-04-03T05:14:21.310176+0000","last_active":"2024-04-03T05:14:21.310176+0000","last_peered":"2024-04-03T05:14:21.310176+0000","last_clean":"2024-04-03T05:14:21.310176+0000","last_became_active":"2024-04-03T03:49:00.983502+0000","last_became_peered":"2024-04-03T03:49:00.983502+0000","last_unstale":"2024-04-03T05:14:21.310176+0000","last_undegraded":"2024-04-03T05:14:21.310176+0000","last_fullsized":"2024-04-03T05:14:21.310176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-04-03T05:14:21.309909+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-04-03T05:14:21.309909+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.309909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:33:21.060923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":91,"num_write":66,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:05.792831+0000","last_change":"2024-04-03T05:15:05.792831+0000","last_active":"2024-04-03T05:15:05.792831+0000","last_peered":"2024-04-03T05:15:05.792831+0000","last_clean":"2024-04-03T05:15:05.792831+0000","last_became_active":"2024-04-03T04:18:51.319585+0000","last_became_peered":"2024-04-03T04:18:51.319585+0000","last_unstale":"2024-04-03T05:15:05.792831+0000","last_undegraded":"2024-04-03T05:15:05.792831+0000","last_fullsized":"2024-04-03T05:15:05.792831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:05.792578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:05.792578+0000","last_clean_scrub_stamp":"2024-04-03T05:15:05.792578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:34:53.538607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.079000+0000","last_change":"2024-04-03T05:14:50.079000+0000","last_active":"2024-04-03T05:14:50.079000+0000","last_peered":"2024-04-03T05:14:50.079000+0000","last_clean":"2024-04-03T05:14:50.079000+0000","last_became_active":"2024-04-03T03:55:53.253313+0000","last_became_peered":"2024-04-03T03:55:53.253313+0000","last_unstale":"2024-04-03T05:14:50.079000+0000","last_undegraded":"2024-04-03T05:14:50.079000+0000","last_fullsized":"2024-04-03T05:14:50.079000+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:50.078639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:50.078639+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.078639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:45:20.489308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.795872+0000","last_change":"2024-04-03T05:14:18.795955+0000","last_active":"2024-04-03T05:14:18.795872+0000","last_peered":"2024-04-03T05:14:18.795872+0000","last_clean":"2024-04-03T05:14:18.795872+0000","last_became_active":"2024-04-03T03:55:45.820786+0000","last_became_peered":"2024-04-03T03:55:45.820786+0000","last_unstale":"2024-04-03T05:14:18.795872+0000","last_undegraded":"2024-04-03T05:14:18.795872+0000","last_fullsized":"2024-04-03T05:14:18.795872+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-04-03T05:14:18.795665+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-04-03T05:14:18.795665+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.795665+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:35:11.045049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"263'69","reported_seq":252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.176593+0000","last_change":"2024-04-03T05:14:18.176593+0000","last_active":"2024-04-03T05:14:18.176593+0000","last_peered":"2024-04-03T05:14:18.176593+0000","last_clean":"2024-04-03T05:14:18.176593+0000","last_became_active":"2024-04-03T03:49:00.961318+0000","last_became_peered":"2024-04-03T03:49:00.961318+0000","last_unstale":"2024-04-03T05:14:18.176593+0000","last_undegraded":"2024-04-03T05:14:18.176593+0000","last_fullsized":"2024-04-03T05:14:18.176593+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'69","last_scrub_stamp":"2024-04-03T05:14:18.176318+0000","last_deep_scrub":"263'69","last_deep_scrub_stamp":"2024-04-03T05:14:18.176318+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.176318+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:57:25.774114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":306,"num_read_kb":217,"num_write":109,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.969655+0000","last_change":"2024-04-03T05:14:54.969655+0000","last_active":"2024-04-03T05:14:54.969655+0000","last_peered":"2024-04-03T05:14:54.969655+0000","last_clean":"2024-04-03T05:14:54.969655+0000","last_became_active":"2024-04-03T04:18:51.318123+0000","last_became_peered":"2024-04-03T04:18:51.318123+0000","last_unstale":"2024-04-03T05:14:54.969655+0000","last_undegraded":"2024-04-03T05:14:54.969655+0000","last_fullsized":"2024-04-03T05:14:54.969655+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:54.969402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:54.969402+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.969402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:23:40.535237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.572960+0000","last_change":"2024-04-03T05:14:27.572960+0000","last_active":"2024-04-03T05:14:27.572960+0000","last_peered":"2024-04-03T05:14:27.572960+0000","last_clean":"2024-04-03T05:14:27.572960+0000","last_became_active":"2024-04-03T03:55:53.272979+0000","last_became_peered":"2024-04-03T03:55:53.272979+0000","last_unstale":"2024-04-03T05:14:27.572960+0000","last_undegraded":"2024-04-03T05:14:27.572960+0000","last_fullsized":"2024-04-03T05:14:27.572960+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.572704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.572704+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.572704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:13:55.190017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"258'2","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.383521+0000","last_change":"2024-04-03T05:14:19.383521+0000","last_active":"2024-04-03T05:14:19.383521+0000","last_peered":"2024-04-03T05:14:19.383521+0000","last_clean":"2024-04-03T05:14:19.383521+0000","last_became_active":"2024-04-03T03:55:45.807410+0000","last_became_peered":"2024-04-03T03:55:45.807410+0000","last_unstale":"2024-04-03T05:14:19.383521+0000","last_undegraded":"2024-04-03T05:14:19.383521+0000","last_fullsized":"2024-04-03T05:14:19.383521+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-04-03T05:14:19.383065+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-04-03T05:14:19.383065+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.383065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:48:31.309704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"263'45","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.487332+0000","last_change":"2024-04-03T05:14:32.487398+0000","last_active":"2024-04-03T05:14:32.487332+0000","last_peered":"2024-04-03T05:14:32.487332+0000","last_clean":"2024-04-03T05:14:32.487332+0000","last_became_active":"2024-04-03T03:49:00.978547+0000","last_became_peered":"2024-04-03T03:49:00.978547+0000","last_unstale":"2024-04-03T05:14:32.487332+0000","last_undegraded":"2024-04-03T05:14:32.487332+0000","last_fullsized":"2024-04-03T05:14:32.487332+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'45","last_scrub_stamp":"2024-04-03T05:14:32.487125+0000","last_deep_scrub":"263'45","last_deep_scrub_stamp":"2024-04-03T05:14:32.487125+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.487125+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:30:00.068417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":127,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'414","reported_seq":1115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.866159+0000","last_change":"2024-04-03T05:14:50.866285+0000","last_active":"2024-04-03T05:14:50.866159+0000","last_peered":"2024-04-03T05:14:50.866159+0000","last_clean":"2024-04-03T05:14:50.866159+0000","last_became_active":"2024-04-03T03:38:24.753446+0000","last_became_peered":"2024-04-03T03:38:24.753446+0000","last_unstale":"2024-04-03T05:14:50.866159+0000","last_undegraded":"2024-04-03T05:14:50.866159+0000","last_fullsized":"2024-04-03T05:14:50.866159+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'414","last_scrub_stamp":"2024-04-03T05:14:50.865940+0000","last_deep_scrub":"263'414","last_deep_scrub_stamp":"2024-04-03T05:14:50.865940+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.865940+0000","objects_scrubbed":11,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:53:54.550715+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8977164,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":672,"num_read_kb":35431,"num_write":1374,"num_write_kb":27233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'365","reported_seq":1900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.445171+0000","last_change":"2024-04-03T05:14:43.445267+0000","last_active":"2024-04-03T05:14:43.445171+0000","last_peered":"2024-04-03T05:14:43.445171+0000","last_clean":"2024-04-03T05:14:43.445171+0000","last_became_active":"2024-04-03T03:38:26.750879+0000","last_became_peered":"2024-04-03T03:38:26.750879+0000","last_unstale":"2024-04-03T05:14:43.445171+0000","last_undegraded":"2024-04-03T05:14:43.445171+0000","last_fullsized":"2024-04-03T05:14:43.445171+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-04-03T05:14:43.444983+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-04-03T05:14:43.444983+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.444983+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:10:56.419620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2014,"num_read_kb":1942,"num_write":406,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'333","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.572680+0000","last_change":"2024-04-03T05:14:50.572839+0000","last_active":"2024-04-03T05:14:50.572680+0000","last_peered":"2024-04-03T05:14:50.572680+0000","last_clean":"2024-04-03T05:14:50.572680+0000","last_became_active":"2024-04-03T03:38:24.722769+0000","last_became_peered":"2024-04-03T03:38:24.722769+0000","last_unstale":"2024-04-03T05:14:50.572680+0000","last_undegraded":"2024-04-03T05:14:50.572680+0000","last_fullsized":"2024-04-03T05:14:50.572680+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-04-03T05:14:50.572466+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-04-03T05:14:50.572466+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.572466+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:53:24.797108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586810,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":606,"num_read_kb":76325,"num_write":1300,"num_write_kb":34753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'863","reported_seq":2525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.885194+0000","last_change":"2024-04-03T05:14:38.885260+0000","last_active":"2024-04-03T05:14:38.885194+0000","last_peered":"2024-04-03T05:14:38.885194+0000","last_clean":"2024-04-03T05:14:38.885194+0000","last_became_active":"2024-04-03T03:38:26.724640+0000","last_became_peered":"2024-04-03T03:38:26.724640+0000","last_unstale":"2024-04-03T05:14:38.885194+0000","last_undegraded":"2024-04-03T05:14:38.885194+0000","last_fullsized":"2024-04-03T05:14:38.885194+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'863","last_scrub_stamp":"2024-04-03T05:14:38.885007+0000","last_deep_scrub":"263'863","last_deep_scrub_stamp":"2024-04-03T05:14:38.885007+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.885007+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":800,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:35:32.648007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3968,"num_read_kb":3559,"num_write":1184,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'315","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:57.202707+0000","last_change":"2024-04-03T05:14:57.202795+0000","last_active":"2024-04-03T05:14:57.202707+0000","last_peered":"2024-04-03T05:14:57.202707+0000","last_clean":"2024-04-03T05:14:57.202707+0000","last_became_active":"2024-04-03T03:38:24.711028+0000","last_became_peered":"2024-04-03T03:38:24.711028+0000","last_unstale":"2024-04-03T05:14:57.202707+0000","last_undegraded":"2024-04-03T05:14:57.202707+0000","last_fullsized":"2024-04-03T05:14:57.202707+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-04-03T05:14:57.202507+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-04-03T05:14:57.202507+0000","last_clean_scrub_stamp":"2024-04-03T05:14:57.202507+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:33:13.005410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174583,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":16599,"num_write":1026,"num_write_kb":26343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'713","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.751614+0000","last_change":"2024-04-03T05:14:34.751690+0000","last_active":"2024-04-03T05:14:34.751614+0000","last_peered":"2024-04-03T05:14:34.751614+0000","last_clean":"2024-04-03T05:14:34.751614+0000","last_became_active":"2024-04-03T03:38:26.745277+0000","last_became_peered":"2024-04-03T03:38:26.745277+0000","last_unstale":"2024-04-03T05:14:34.751614+0000","last_undegraded":"2024-04-03T05:14:34.751614+0000","last_fullsized":"2024-04-03T05:14:34.751614+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'713","last_scrub_stamp":"2024-04-03T05:14:34.751404+0000","last_deep_scrub":"263'713","last_deep_scrub_stamp":"2024-04-03T05:14:34.751404+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.751404+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:57:11.797760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3170,"num_read_kb":2825,"num_write":964,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1651,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'389","reported_seq":1110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.412882+0000","last_change":"2024-04-03T05:14:44.412882+0000","last_active":"2024-04-03T05:14:44.412882+0000","last_peered":"2024-04-03T05:14:44.412882+0000","last_clean":"2024-04-03T05:14:44.412882+0000","last_became_active":"2024-04-03T03:38:24.756927+0000","last_became_peered":"2024-04-03T03:38:24.756927+0000","last_unstale":"2024-04-03T05:14:44.412882+0000","last_undegraded":"2024-04-03T05:14:44.412882+0000","last_fullsized":"2024-04-03T05:14:44.412882+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-04-03T05:14:44.412430+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-04-03T05:14:44.412430+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.412430+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:51:44.234807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":48559,"num_write":1381,"num_write_kb":35333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'579","reported_seq":2227,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.208870+0000","last_change":"2024-04-03T05:14:44.208941+0000","last_active":"2024-04-03T05:14:44.208870+0000","last_peered":"2024-04-03T05:14:44.208870+0000","last_clean":"2024-04-03T05:14:44.208870+0000","last_became_active":"2024-04-03T03:38:26.729866+0000","last_became_peered":"2024-04-03T03:38:26.729866+0000","last_unstale":"2024-04-03T05:14:44.208870+0000","last_undegraded":"2024-04-03T05:14:44.208870+0000","last_fullsized":"2024-04-03T05:14:44.208870+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'579","last_scrub_stamp":"2024-04-03T05:14:44.208660+0000","last_deep_scrub":"263'579","last_deep_scrub_stamp":"2024-04-03T05:14:44.208660+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.208660+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:06:03.005150+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3072,"num_read_kb":2799,"num_write":801,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2635,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'407","reported_seq":1322,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:59.879629+0000","last_change":"2024-04-03T05:14:59.879735+0000","last_active":"2024-04-03T05:14:59.879629+0000","last_peered":"2024-04-03T05:14:59.879629+0000","last_clean":"2024-04-03T05:14:59.879629+0000","last_became_active":"2024-04-03T03:38:24.748338+0000","last_became_peered":"2024-04-03T03:38:24.748338+0000","last_unstale":"2024-04-03T05:14:59.879629+0000","last_undegraded":"2024-04-03T05:14:59.879629+0000","last_fullsized":"2024-04-03T05:14:59.879629+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-04-03T05:14:59.879390+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-04-03T05:14:59.879390+0000","last_clean_scrub_stamp":"2024-04-03T05:14:59.879390+0000","objects_scrubbed":10,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:06:49.070745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1354628,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1249,"num_read_kb":39095,"num_write":1674,"num_write_kb":52242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'479","reported_seq":1936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.207315+0000","last_change":"2024-04-03T05:14:39.207315+0000","last_active":"2024-04-03T05:14:39.207315+0000","last_peered":"2024-04-03T05:14:39.207315+0000","last_clean":"2024-04-03T05:14:39.207315+0000","last_became_active":"2024-04-03T03:38:26.719805+0000","last_became_peered":"2024-04-03T03:38:26.719805+0000","last_unstale":"2024-04-03T05:14:39.207315+0000","last_undegraded":"2024-04-03T05:14:39.207315+0000","last_fullsized":"2024-04-03T05:14:39.207315+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-04-03T05:14:39.207044+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-04-03T05:14:39.207044+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.207044+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:17:57.511774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2340,"num_read_kb":2138,"num_write":626,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'359","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.314921+0000","last_change":"2024-04-03T05:14:48.315028+0000","last_active":"2024-04-03T05:14:48.314921+0000","last_peered":"2024-04-03T05:14:48.314921+0000","last_clean":"2024-04-03T05:14:48.314921+0000","last_became_active":"2024-04-03T03:38:24.749192+0000","last_became_peered":"2024-04-03T03:38:24.749192+0000","last_unstale":"2024-04-03T05:14:48.314921+0000","last_undegraded":"2024-04-03T05:14:48.314921+0000","last_fullsized":"2024-04-03T05:14:48.314921+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-04-03T05:14:48.314718+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-04-03T05:14:48.314718+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.314718+0000","objects_scrubbed":11,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:09:20.121325+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4003555,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":459,"num_read_kb":24946,"num_write":1297,"num_write_kb":50928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'295","reported_seq":1660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.722488+0000","last_change":"2024-04-03T05:14:36.722555+0000","last_active":"2024-04-03T05:14:36.722488+0000","last_peered":"2024-04-03T05:14:36.722488+0000","last_clean":"2024-04-03T05:14:36.722488+0000","last_became_active":"2024-04-03T03:38:26.744762+0000","last_became_peered":"2024-04-03T03:38:26.744762+0000","last_unstale":"2024-04-03T05:14:36.722488+0000","last_undegraded":"2024-04-03T05:14:36.722488+0000","last_fullsized":"2024-04-03T05:14:36.722488+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'295","last_scrub_stamp":"2024-04-03T05:14:36.722295+0000","last_deep_scrub":"263'295","last_deep_scrub_stamp":"2024-04-03T05:14:36.722295+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.722295+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:55:03.237199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1674,"num_read_kb":1613,"num_write":327,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'333","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:56.879876+0000","last_change":"2024-04-03T05:14:56.880107+0000","last_active":"2024-04-03T05:14:56.879876+0000","last_peered":"2024-04-03T05:14:56.879876+0000","last_clean":"2024-04-03T05:14:56.879876+0000","last_became_active":"2024-04-03T03:38:24.728188+0000","last_became_peered":"2024-04-03T03:38:24.728188+0000","last_unstale":"2024-04-03T05:14:56.879876+0000","last_undegraded":"2024-04-03T05:14:56.879876+0000","last_fullsized":"2024-04-03T05:14:56.879876+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-04-03T05:14:56.879681+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-04-03T05:14:56.879681+0000","last_clean_scrub_stamp":"2024-04-03T05:14:56.879681+0000","objects_scrubbed":11,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:29:53.558309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149405,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":546,"num_read_kb":30992,"num_write":1174,"num_write_kb":37947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'736","reported_seq":2245,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.434540+0000","last_change":"2024-04-03T05:14:38.434701+0000","last_active":"2024-04-03T05:14:38.434540+0000","last_peered":"2024-04-03T05:14:38.434540+0000","last_clean":"2024-04-03T05:14:38.434540+0000","last_became_active":"2024-04-03T03:38:26.722053+0000","last_became_peered":"2024-04-03T03:38:26.722053+0000","last_unstale":"2024-04-03T05:14:38.434540+0000","last_undegraded":"2024-04-03T05:14:38.434540+0000","last_fullsized":"2024-04-03T05:14:38.434540+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'736","last_scrub_stamp":"2024-04-03T05:14:38.434324+0000","last_deep_scrub":"263'736","last_deep_scrub_stamp":"2024-04-03T05:14:38.434324+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.434324+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:11:18.939280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3332,"num_read_kb":2987,"num_write":969,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'347","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:08.316240+0000","last_change":"2024-04-03T05:15:08.316358+0000","last_active":"2024-04-03T05:15:08.316240+0000","last_peered":"2024-04-03T05:15:08.316240+0000","last_clean":"2024-04-03T05:15:08.316240+0000","last_became_active":"2024-04-03T03:38:24.748669+0000","last_became_peered":"2024-04-03T03:38:24.748669+0000","last_unstale":"2024-04-03T05:15:08.316240+0000","last_undegraded":"2024-04-03T05:15:08.316240+0000","last_fullsized":"2024-04-03T05:15:08.316240+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-04-03T05:15:08.316029+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-04-03T05:15:08.316029+0000","last_clean_scrub_stamp":"2024-04-03T05:15:08.316029+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:18:18.776302+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1960097,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":30925,"num_write":1242,"num_write_kb":34378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'467","reported_seq":1995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.475999+0000","last_change":"2024-04-03T05:14:37.476076+0000","last_active":"2024-04-03T05:14:37.475999+0000","last_peered":"2024-04-03T05:14:37.475999+0000","last_clean":"2024-04-03T05:14:37.475999+0000","last_became_active":"2024-04-03T03:38:26.711993+0000","last_became_peered":"2024-04-03T03:38:26.711993+0000","last_unstale":"2024-04-03T05:14:37.475999+0000","last_undegraded":"2024-04-03T05:14:37.475999+0000","last_fullsized":"2024-04-03T05:14:37.475999+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'467","last_scrub_stamp":"2024-04-03T05:14:37.475790+0000","last_deep_scrub":"263'467","last_deep_scrub_stamp":"2024-04-03T05:14:37.475790+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.475790+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:29:23.922936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2333,"num_write":597,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'428","reported_seq":1891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.674369+0000","last_change":"2024-04-03T05:14:54.674438+0000","last_active":"2024-04-03T05:14:54.674369+0000","last_peered":"2024-04-03T05:14:54.674369+0000","last_clean":"2024-04-03T05:14:54.674369+0000","last_became_active":"2024-04-03T03:38:26.740542+0000","last_became_peered":"2024-04-03T03:38:26.740542+0000","last_unstale":"2024-04-03T05:14:54.674369+0000","last_undegraded":"2024-04-03T05:14:54.674369+0000","last_fullsized":"2024-04-03T05:14:54.674369+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-04-03T05:14:54.674174+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-04-03T05:14:54.674174+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.674174+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:13:57.373011+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2192,"num_read_kb":2031,"num_write":524,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'347","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.859682+0000","last_change":"2024-04-03T05:14:46.859799+0000","last_active":"2024-04-03T05:14:46.859682+0000","last_peered":"2024-04-03T05:14:46.859682+0000","last_clean":"2024-04-03T05:14:46.859682+0000","last_became_active":"2024-04-03T03:38:24.761424+0000","last_became_peered":"2024-04-03T03:38:24.761424+0000","last_unstale":"2024-04-03T05:14:46.859682+0000","last_undegraded":"2024-04-03T05:14:46.859682+0000","last_fullsized":"2024-04-03T05:14:46.859682+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-04-03T05:14:46.859475+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-04-03T05:14:46.859475+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.859475+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:30:55.297131+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342126,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":4079,"num_write":1247,"num_write_kb":13920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'365","reported_seq":1762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.860694+0000","last_change":"2024-04-03T05:14:40.860794+0000","last_active":"2024-04-03T05:14:40.860694+0000","last_peered":"2024-04-03T05:14:40.860694+0000","last_clean":"2024-04-03T05:14:40.860694+0000","last_became_active":"2024-04-03T03:38:26.723638+0000","last_became_peered":"2024-04-03T03:38:26.723638+0000","last_unstale":"2024-04-03T05:14:40.860694+0000","last_undegraded":"2024-04-03T05:14:40.860694+0000","last_fullsized":"2024-04-03T05:14:40.860694+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-04-03T05:14:40.860502+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-04-03T05:14:40.860502+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.860502+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:32:09.070447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1899,"num_read_kb":1790,"num_write":424,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'351","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.231008+0000","last_change":"2024-04-03T05:14:38.231008+0000","last_active":"2024-04-03T05:14:38.231008+0000","last_peered":"2024-04-03T05:14:38.231008+0000","last_clean":"2024-04-03T05:14:38.231008+0000","last_became_active":"2024-04-03T03:38:58.349885+0000","last_became_peered":"2024-04-03T03:38:58.349885+0000","last_unstale":"2024-04-03T05:14:38.231008+0000","last_undegraded":"2024-04-03T05:14:38.231008+0000","last_fullsized":"2024-04-03T05:14:38.231008+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-04-03T05:14:38.230676+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-04-03T05:14:38.230676+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.230676+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:06:03.387049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502701,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":66677,"num_write":1253,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'453","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.433075+0000","last_change":"2024-04-03T05:14:42.433138+0000","last_active":"2024-04-03T05:14:42.433075+0000","last_peered":"2024-04-03T05:14:42.433075+0000","last_clean":"2024-04-03T05:14:42.433075+0000","last_became_active":"2024-04-03T03:38:26.709613+0000","last_became_peered":"2024-04-03T03:38:26.709613+0000","last_unstale":"2024-04-03T05:14:42.433075+0000","last_undegraded":"2024-04-03T05:14:42.433075+0000","last_fullsized":"2024-04-03T05:14:42.433075+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-04-03T05:14:42.432892+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-04-03T05:14:42.432892+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.432892+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:02:32.705873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2380,"num_write":570,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'353","reported_seq":1066,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.195637+0000","last_change":"2024-04-03T05:14:44.195637+0000","last_active":"2024-04-03T05:14:44.195637+0000","last_peered":"2024-04-03T05:14:44.195637+0000","last_clean":"2024-04-03T05:14:44.195637+0000","last_became_active":"2024-04-03T03:38:24.761284+0000","last_became_peered":"2024-04-03T03:38:24.761284+0000","last_unstale":"2024-04-03T05:14:44.195637+0000","last_undegraded":"2024-04-03T05:14:44.195637+0000","last_fullsized":"2024-04-03T05:14:44.195637+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-04-03T05:14:44.195321+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-04-03T05:14:44.195321+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.195321+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:02:22.125464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":65082,"num_write":1201,"num_write_kb":43379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'451","reported_seq":2423,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.454618+0000","last_change":"2024-04-03T05:14:38.454618+0000","last_active":"2024-04-03T05:14:38.454618+0000","last_peered":"2024-04-03T05:14:38.454618+0000","last_clean":"2024-04-03T05:14:38.454618+0000","last_became_active":"2024-04-03T03:38:26.711748+0000","last_became_peered":"2024-04-03T03:38:26.711748+0000","last_unstale":"2024-04-03T05:14:38.454618+0000","last_undegraded":"2024-04-03T05:14:38.454618+0000","last_fullsized":"2024-04-03T05:14:38.454618+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-04-03T05:14:38.454435+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-04-03T05:14:38.454435+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.454435+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:08:51.014215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2976,"num_read_kb":2877,"num_write":500,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6701,"num_omap_keys":28,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'299","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.641216+0000","last_change":"2024-04-03T05:14:52.641216+0000","last_active":"2024-04-03T05:14:52.641216+0000","last_peered":"2024-04-03T05:14:52.641216+0000","last_clean":"2024-04-03T05:14:52.641216+0000","last_became_active":"2024-04-03T03:38:24.742574+0000","last_became_peered":"2024-04-03T03:38:24.742574+0000","last_unstale":"2024-04-03T05:14:52.641216+0000","last_undegraded":"2024-04-03T05:14:52.641216+0000","last_fullsized":"2024-04-03T05:14:52.641216+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-04-03T05:14:52.640905+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-04-03T05:14:52.640905+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.640905+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:32:12.639513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399089,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":46919,"num_write":1114,"num_write_kb":37595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'342","reported_seq":1764,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.397502+0000","last_change":"2024-04-03T05:14:41.397502+0000","last_active":"2024-04-03T05:14:41.397502+0000","last_peered":"2024-04-03T05:14:41.397502+0000","last_clean":"2024-04-03T05:14:41.397502+0000","last_became_active":"2024-04-03T03:38:26.743735+0000","last_became_peered":"2024-04-03T03:38:26.743735+0000","last_unstale":"2024-04-03T05:14:41.397502+0000","last_undegraded":"2024-04-03T05:14:41.397502+0000","last_fullsized":"2024-04-03T05:14:41.397502+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-04-03T05:14:41.397242+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-04-03T05:14:41.397242+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.397242+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:40:08.131190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1802,"num_read_kb":1729,"num_write":383,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'346","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:05.295915+0000","last_change":"2024-04-03T05:15:05.295915+0000","last_active":"2024-04-03T05:15:05.295915+0000","last_peered":"2024-04-03T05:15:05.295915+0000","last_clean":"2024-04-03T05:15:05.295915+0000","last_became_active":"2024-04-03T03:38:24.725557+0000","last_became_peered":"2024-04-03T03:38:24.725557+0000","last_unstale":"2024-04-03T05:15:05.295915+0000","last_undegraded":"2024-04-03T05:15:05.295915+0000","last_fullsized":"2024-04-03T05:15:05.295915+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-04-03T05:15:05.295558+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-04-03T05:15:05.295558+0000","last_clean_scrub_stamp":"2024-04-03T05:15:05.295558+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:36:20.920206+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456508,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":495,"num_read_kb":4167,"num_write":1155,"num_write_kb":37047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'335","reported_seq":1773,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.581251+0000","last_change":"2024-04-03T05:14:45.581251+0000","last_active":"2024-04-03T05:14:45.581251+0000","last_peered":"2024-04-03T05:14:45.581251+0000","last_clean":"2024-04-03T05:14:45.581251+0000","last_became_active":"2024-04-03T03:38:26.744977+0000","last_became_peered":"2024-04-03T03:38:26.744977+0000","last_unstale":"2024-04-03T05:14:45.581251+0000","last_undegraded":"2024-04-03T05:14:45.581251+0000","last_fullsized":"2024-04-03T05:14:45.581251+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-04-03T05:14:45.581007+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-04-03T05:14:45.581007+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.581007+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:51:18.049040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1755,"num_write":385,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'292","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:58.161299+0000","last_change":"2024-04-03T05:14:58.161406+0000","last_active":"2024-04-03T05:14:58.161299+0000","last_peered":"2024-04-03T05:14:58.161299+0000","last_clean":"2024-04-03T05:14:58.161299+0000","last_became_active":"2024-04-03T03:38:24.725410+0000","last_became_peered":"2024-04-03T03:38:24.725410+0000","last_unstale":"2024-04-03T05:14:58.161299+0000","last_undegraded":"2024-04-03T05:14:58.161299+0000","last_fullsized":"2024-04-03T05:14:58.161299+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'292","last_scrub_stamp":"2024-04-03T05:14:58.161095+0000","last_deep_scrub":"263'292","last_deep_scrub_stamp":"2024-04-03T05:14:58.161095+0000","last_clean_scrub_stamp":"2024-04-03T05:14:58.161095+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:53:57.340781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":543,"num_read_kb":79698,"num_write":993,"num_write_kb":41581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'140","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.593760+0000","last_change":"2024-04-03T05:14:25.593823+0000","last_active":"2024-04-03T05:14:25.593760+0000","last_peered":"2024-04-03T05:14:25.593760+0000","last_clean":"2024-04-03T05:14:25.593760+0000","last_became_active":"2024-04-03T03:38:34.738565+0000","last_became_peered":"2024-04-03T03:38:34.738565+0000","last_unstale":"2024-04-03T05:14:25.593760+0000","last_undegraded":"2024-04-03T05:14:25.593760+0000","last_fullsized":"2024-04-03T05:14:25.593760+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-04-03T05:14:25.593574+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-04-03T05:14:25.593574+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.593574+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:12:17.516873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":372,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":162,"num_write":345,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'373","reported_seq":1834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.038166+0000","last_change":"2024-04-03T05:14:22.038166+0000","last_active":"2024-04-03T05:14:22.038166+0000","last_peered":"2024-04-03T05:14:22.038166+0000","last_clean":"2024-04-03T05:14:22.038166+0000","last_became_active":"2024-04-03T03:39:58.989982+0000","last_became_peered":"2024-04-03T03:39:58.989982+0000","last_unstale":"2024-04-03T05:14:22.038166+0000","last_undegraded":"2024-04-03T05:14:22.038166+0000","last_fullsized":"2024-04-03T05:14:22.038166+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'373","last_scrub_stamp":"2024-04-03T05:14:22.037900+0000","last_deep_scrub":"263'373","last_deep_scrub_stamp":"2024-04-03T05:14:22.037900+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.037900+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:40:14.362011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2119,"num_read_kb":1999,"num_write":436,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'348","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:00.896152+0000","last_change":"2024-04-03T05:15:00.896258+0000","last_active":"2024-04-03T05:15:00.896152+0000","last_peered":"2024-04-03T05:15:00.896152+0000","last_clean":"2024-04-03T05:15:00.896152+0000","last_became_active":"2024-04-03T03:38:24.750235+0000","last_became_peered":"2024-04-03T03:38:24.750235+0000","last_unstale":"2024-04-03T05:15:00.896152+0000","last_undegraded":"2024-04-03T05:15:00.896152+0000","last_fullsized":"2024-04-03T05:15:00.896152+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-04-03T05:15:00.895948+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-04-03T05:15:00.895948+0000","last_clean_scrub_stamp":"2024-04-03T05:15:00.895948+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:33:02.974425+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":98321,"num_write":1208,"num_write_kb":49383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.406622+0000","last_change":"2024-04-03T05:14:45.406622+0000","last_active":"2024-04-03T05:14:45.406622+0000","last_peered":"2024-04-03T05:14:45.406622+0000","last_clean":"2024-04-03T05:14:45.406622+0000","last_became_active":"2024-04-03T03:38:28.725801+0000","last_became_peered":"2024-04-03T03:38:28.725801+0000","last_unstale":"2024-04-03T05:14:45.406622+0000","last_undegraded":"2024-04-03T05:14:45.406622+0000","last_fullsized":"2024-04-03T05:14:45.406622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:45.406366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:45.406366+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.406366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:50:06.900565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'354","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.232786+0000","last_change":"2024-04-03T05:14:49.232786+0000","last_active":"2024-04-03T05:14:49.232786+0000","last_peered":"2024-04-03T05:14:49.232786+0000","last_clean":"2024-04-03T05:14:49.232786+0000","last_became_active":"2024-04-03T03:38:30.726684+0000","last_became_peered":"2024-04-03T03:38:30.726684+0000","last_unstale":"2024-04-03T05:14:49.232786+0000","last_undegraded":"2024-04-03T05:14:49.232786+0000","last_fullsized":"2024-04-03T05:14:49.232786+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-04-03T05:14:49.232517+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-04-03T05:14:49.232517+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.232517+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:22:38.826152+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46296,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":564,"num_read_kb":1147,"num_write":428,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.862524+0000","last_change":"2024-04-03T05:14:34.862524+0000","last_active":"2024-04-03T05:14:34.862524+0000","last_peered":"2024-04-03T05:14:34.862524+0000","last_clean":"2024-04-03T05:14:34.862524+0000","last_became_active":"2024-04-03T03:38:32.745434+0000","last_became_peered":"2024-04-03T03:38:32.745434+0000","last_unstale":"2024-04-03T05:14:34.862524+0000","last_undegraded":"2024-04-03T05:14:34.862524+0000","last_fullsized":"2024-04-03T05:14:34.862524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:34.862224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:34.862224+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.862224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:19:24.722534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2400","reported_seq":4234,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.260141+0000","last_change":"2024-04-03T05:14:21.260225+0000","last_active":"2024-04-03T05:14:21.260141+0000","last_peered":"2024-04-03T05:14:21.260141+0000","last_clean":"2024-04-03T05:14:21.260141+0000","last_became_active":"2024-04-03T03:38:34.757256+0000","last_became_peered":"2024-04-03T03:38:34.757256+0000","last_unstale":"2024-04-03T05:14:21.260141+0000","last_undegraded":"2024-04-03T05:14:21.260141+0000","last_fullsized":"2024-04-03T05:14:21.260141+0000","mapping_epoch":33,"log_start":"263'2300","ondisk_log_start":"263'2300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2400","last_scrub_stamp":"2024-04-03T05:14:21.259923+0000","last_deep_scrub":"263'2400","last_deep_scrub_stamp":"2024-04-03T05:14:21.259923+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.259923+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":2300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:05:50.752828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5948,"num_read_kb":5953,"num_write":4769,"num_write_kb":1764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'433","reported_seq":1951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.392592+0000","last_change":"2024-04-03T05:14:37.392592+0000","last_active":"2024-04-03T05:14:37.392592+0000","last_peered":"2024-04-03T05:14:37.392592+0000","last_clean":"2024-04-03T05:14:37.392592+0000","last_became_active":"2024-04-03T03:38:26.724537+0000","last_became_peered":"2024-04-03T03:38:26.724537+0000","last_unstale":"2024-04-03T05:14:37.392592+0000","last_undegraded":"2024-04-03T05:14:37.392592+0000","last_fullsized":"2024-04-03T05:14:37.392592+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-04-03T05:14:37.392344+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-04-03T05:14:37.392344+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.392344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:19:58.926821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2269,"num_read_kb":2119,"num_write":527,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'354","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.525722+0000","last_change":"2024-04-03T05:14:20.525722+0000","last_active":"2024-04-03T05:14:20.525722+0000","last_peered":"2024-04-03T05:14:20.525722+0000","last_clean":"2024-04-03T05:14:20.525722+0000","last_became_active":"2024-04-03T03:38:57.870251+0000","last_became_peered":"2024-04-03T03:38:57.870251+0000","last_unstale":"2024-04-03T05:14:20.525722+0000","last_undegraded":"2024-04-03T05:14:20.525722+0000","last_fullsized":"2024-04-03T05:14:20.525722+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-04-03T05:14:20.525419+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-04-03T05:14:20.525419+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.525419+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:42:39.785681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":658,"num_read_kb":14924,"num_write":1423,"num_write_kb":20295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3],"acting":[2,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.230698+0000","last_change":"2024-04-03T05:14:51.230791+0000","last_active":"2024-04-03T05:14:51.230698+0000","last_peered":"2024-04-03T05:14:51.230698+0000","last_clean":"2024-04-03T05:14:51.230698+0000","last_became_active":"2024-04-03T03:38:28.728632+0000","last_became_peered":"2024-04-03T03:38:28.728632+0000","last_unstale":"2024-04-03T05:14:51.230698+0000","last_undegraded":"2024-04-03T05:14:51.230698+0000","last_fullsized":"2024-04-03T05:14:51.230698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:51.230369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:51.230369+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.230369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:19:39.166883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'124","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.715959+0000","last_change":"2024-04-03T05:14:31.715959+0000","last_active":"2024-04-03T05:14:31.715959+0000","last_peered":"2024-04-03T05:14:31.715959+0000","last_clean":"2024-04-03T05:14:31.715959+0000","last_became_active":"2024-04-03T03:38:30.730797+0000","last_became_peered":"2024-04-03T03:38:30.730797+0000","last_unstale":"2024-04-03T05:14:31.715959+0000","last_undegraded":"2024-04-03T05:14:31.715959+0000","last_fullsized":"2024-04-03T05:14:31.715959+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-04-03T05:14:31.715693+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-04-03T05:14:31.715693+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.715693+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:55:48.930887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":143,"num_read_kb":139,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.582301+0000","last_change":"2024-04-03T05:14:26.582301+0000","last_active":"2024-04-03T05:14:26.582301+0000","last_peered":"2024-04-03T05:14:26.582301+0000","last_clean":"2024-04-03T05:14:26.582301+0000","last_became_active":"2024-04-03T03:38:32.732994+0000","last_became_peered":"2024-04-03T03:38:32.732994+0000","last_unstale":"2024-04-03T05:14:26.582301+0000","last_undegraded":"2024-04-03T05:14:26.582301+0000","last_fullsized":"2024-04-03T05:14:26.582301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:26.581951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:26.581951+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.581951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:09:39.194706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'109","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.293430+0000","last_change":"2024-04-03T05:14:28.293503+0000","last_active":"2024-04-03T05:14:28.293430+0000","last_peered":"2024-04-03T05:14:28.293430+0000","last_clean":"2024-04-03T05:14:28.293430+0000","last_became_active":"2024-04-03T03:38:34.746126+0000","last_became_peered":"2024-04-03T03:38:34.746126+0000","last_unstale":"2024-04-03T05:14:28.293430+0000","last_undegraded":"2024-04-03T05:14:28.293430+0000","last_fullsized":"2024-04-03T05:14:28.293430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'109","last_scrub_stamp":"2024-04-03T05:14:28.293256+0000","last_deep_scrub":"263'109","last_deep_scrub_stamp":"2024-04-03T05:14:28.293256+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.293256+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:21:21.785941+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":113,"num_write":252,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'391","reported_seq":1883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.270130+0000","last_change":"2024-04-03T05:14:50.270130+0000","last_active":"2024-04-03T05:14:50.270130+0000","last_peered":"2024-04-03T05:14:50.270130+0000","last_clean":"2024-04-03T05:14:50.270130+0000","last_became_active":"2024-04-03T03:38:26.724468+0000","last_became_peered":"2024-04-03T03:38:26.724468+0000","last_unstale":"2024-04-03T05:14:50.270130+0000","last_undegraded":"2024-04-03T05:14:50.270130+0000","last_fullsized":"2024-04-03T05:14:50.270130+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'391","last_scrub_stamp":"2024-04-03T05:14:50.269781+0000","last_deep_scrub":"263'391","last_deep_scrub_stamp":"2024-04-03T05:14:50.269781+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.269781+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:54:02.827869+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1964,"num_write":459,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'331","reported_seq":1168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:58.917805+0000","last_change":"2024-04-03T05:14:58.917992+0000","last_active":"2024-04-03T05:14:58.917805+0000","last_peered":"2024-04-03T05:14:58.917805+0000","last_clean":"2024-04-03T05:14:58.917805+0000","last_became_active":"2024-04-03T03:38:24.732182+0000","last_became_peered":"2024-04-03T03:38:24.732182+0000","last_unstale":"2024-04-03T05:14:58.917805+0000","last_undegraded":"2024-04-03T05:14:58.917805+0000","last_fullsized":"2024-04-03T05:14:58.917805+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-04-03T05:14:58.917545+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-04-03T05:14:58.917545+0000","last_clean_scrub_stamp":"2024-04-03T05:14:58.917545+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:50.919116+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5549602,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":861,"num_read_kb":9858,"num_write":1206,"num_write_kb":55489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.209934+0000","last_change":"2024-04-03T05:14:53.209934+0000","last_active":"2024-04-03T05:14:53.209934+0000","last_peered":"2024-04-03T05:14:53.209934+0000","last_clean":"2024-04-03T05:14:53.209934+0000","last_became_active":"2024-04-03T03:38:28.733142+0000","last_became_peered":"2024-04-03T03:38:28.733142+0000","last_unstale":"2024-04-03T05:14:53.209934+0000","last_undegraded":"2024-04-03T05:14:53.209934+0000","last_fullsized":"2024-04-03T05:14:53.209934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:53.209652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:53.209652+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.209652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:38:46.766205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'177","reported_seq":775,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.513155+0000","last_change":"2024-04-03T05:14:21.513155+0000","last_active":"2024-04-03T05:14:21.513155+0000","last_peered":"2024-04-03T05:14:21.513155+0000","last_clean":"2024-04-03T05:14:21.513155+0000","last_became_active":"2024-04-03T03:38:30.734934+0000","last_became_peered":"2024-04-03T03:38:30.734934+0000","last_unstale":"2024-04-03T05:14:21.513155+0000","last_undegraded":"2024-04-03T05:14:21.513155+0000","last_fullsized":"2024-04-03T05:14:21.513155+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-04-03T05:14:21.512906+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-04-03T05:14:21.512906+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.512906+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:17:22.689201+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":209,"num_write":146,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'516","reported_seq":2447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.845096+0000","last_change":"2024-04-03T05:14:30.845096+0000","last_active":"2024-04-03T05:14:30.845096+0000","last_peered":"2024-04-03T05:14:30.845096+0000","last_clean":"2024-04-03T05:14:30.845096+0000","last_became_active":"2024-04-03T03:38:32.748836+0000","last_became_peered":"2024-04-03T03:38:32.748836+0000","last_unstale":"2024-04-03T05:14:30.845096+0000","last_undegraded":"2024-04-03T05:14:30.845096+0000","last_fullsized":"2024-04-03T05:14:30.845096+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'516","last_scrub_stamp":"2024-04-03T05:14:30.844834+0000","last_deep_scrub":"263'516","last_deep_scrub_stamp":"2024-04-03T05:14:30.844834+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.844834+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:48.358869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'105","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:21.496669+0000","last_change":"2024-04-03T05:14:21.496732+0000","last_active":"2024-04-03T05:14:21.496669+0000","last_peered":"2024-04-03T05:14:21.496669+0000","last_clean":"2024-04-03T05:14:21.496669+0000","last_became_active":"2024-04-03T03:38:34.940390+0000","last_became_peered":"2024-04-03T03:38:34.940390+0000","last_unstale":"2024-04-03T05:14:21.496669+0000","last_undegraded":"2024-04-03T05:14:21.496669+0000","last_fullsized":"2024-04-03T05:14:21.496669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-04-03T05:14:21.496472+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-04-03T05:14:21.496472+0000","last_clean_scrub_stamp":"2024-04-03T05:14:21.496472+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:47.773784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'571","reported_seq":2258,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.272724+0000","last_change":"2024-04-03T05:14:50.272724+0000","last_active":"2024-04-03T05:14:50.272724+0000","last_peered":"2024-04-03T05:14:50.272724+0000","last_clean":"2024-04-03T05:14:50.272724+0000","last_became_active":"2024-04-03T03:38:26.717394+0000","last_became_peered":"2024-04-03T03:38:26.717394+0000","last_unstale":"2024-04-03T05:14:50.272724+0000","last_undegraded":"2024-04-03T05:14:50.272724+0000","last_fullsized":"2024-04-03T05:14:50.272724+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'571","last_scrub_stamp":"2024-04-03T05:14:50.272451+0000","last_deep_scrub":"263'571","last_deep_scrub_stamp":"2024-04-03T05:14:50.272451+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.272451+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:44:31.806317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2983,"num_read_kb":2733,"num_write":743,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1913,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'339","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.146618+0000","last_change":"2024-04-03T05:14:45.146719+0000","last_active":"2024-04-03T05:14:45.146618+0000","last_peered":"2024-04-03T05:14:45.146618+0000","last_clean":"2024-04-03T05:14:45.146618+0000","last_became_active":"2024-04-03T03:38:24.761913+0000","last_became_peered":"2024-04-03T03:38:24.761913+0000","last_unstale":"2024-04-03T05:14:45.146618+0000","last_undegraded":"2024-04-03T05:14:45.146618+0000","last_fullsized":"2024-04-03T05:14:45.146618+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-04-03T05:14:45.146412+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-04-03T05:14:45.146412+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.146412+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:10:44.076698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":83387,"num_write":1167,"num_write_kb":33117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.343152+0000","last_change":"2024-04-03T05:14:47.343152+0000","last_active":"2024-04-03T05:14:47.343152+0000","last_peered":"2024-04-03T05:14:47.343152+0000","last_clean":"2024-04-03T05:14:47.343152+0000","last_became_active":"2024-04-03T03:38:28.730711+0000","last_became_peered":"2024-04-03T03:38:28.730711+0000","last_unstale":"2024-04-03T05:14:47.343152+0000","last_undegraded":"2024-04-03T05:14:47.343152+0000","last_fullsized":"2024-04-03T05:14:47.343152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:47.342904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:47.342904+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.342904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:15:43.463095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'306","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.853257+0000","last_change":"2024-04-03T05:14:36.853257+0000","last_active":"2024-04-03T05:14:36.853257+0000","last_peered":"2024-04-03T05:14:36.853257+0000","last_clean":"2024-04-03T05:14:36.853257+0000","last_became_active":"2024-04-03T03:38:30.824397+0000","last_became_peered":"2024-04-03T03:38:30.824397+0000","last_unstale":"2024-04-03T05:14:36.853257+0000","last_undegraded":"2024-04-03T05:14:36.853257+0000","last_fullsized":"2024-04-03T05:14:36.853257+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-04-03T05:14:36.852984+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-04-03T05:14:36.852984+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.852984+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:41:01.357277+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45592,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":493,"num_read_kb":1098,"num_write":394,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'553","reported_seq":4250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.189324+0000","last_change":"2024-04-03T05:14:36.189387+0000","last_active":"2024-04-03T05:14:36.189324+0000","last_peered":"2024-04-03T05:14:36.189324+0000","last_clean":"2024-04-03T05:14:36.189324+0000","last_became_active":"2024-04-03T03:38:32.743645+0000","last_became_peered":"2024-04-03T03:38:32.743645+0000","last_unstale":"2024-04-03T05:14:36.189324+0000","last_undegraded":"2024-04-03T05:14:36.189324+0000","last_fullsized":"2024-04-03T05:14:36.189324+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'553","last_scrub_stamp":"2024-04-03T05:14:36.189129+0000","last_deep_scrub":"263'553","last_deep_scrub_stamp":"2024-04-03T05:14:36.189129+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.189129+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:07:23.200679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1050","reported_seq":2437,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.456675+0000","last_change":"2024-04-03T05:14:39.456794+0000","last_active":"2024-04-03T05:14:39.456675+0000","last_peered":"2024-04-03T05:14:39.456675+0000","last_clean":"2024-04-03T05:14:39.456675+0000","last_became_active":"2024-04-03T03:38:26.726039+0000","last_became_peered":"2024-04-03T03:38:26.726039+0000","last_unstale":"2024-04-03T05:14:39.456675+0000","last_undegraded":"2024-04-03T05:14:39.456675+0000","last_fullsized":"2024-04-03T05:14:39.456675+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1050","last_scrub_stamp":"2024-04-03T05:14:39.456345+0000","last_deep_scrub":"263'1050","last_deep_scrub_stamp":"2024-04-03T05:14:39.456345+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.456345+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1000,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:03:32.110634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4374,"num_read_kb":3788,"num_write":1482,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'382","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.829428+0000","last_change":"2024-04-03T05:14:52.829537+0000","last_active":"2024-04-03T05:14:52.829428+0000","last_peered":"2024-04-03T05:14:52.829428+0000","last_clean":"2024-04-03T05:14:52.829428+0000","last_became_active":"2024-04-03T03:38:24.752543+0000","last_became_peered":"2024-04-03T03:38:24.752543+0000","last_unstale":"2024-04-03T05:14:52.829428+0000","last_undegraded":"2024-04-03T05:14:52.829428+0000","last_fullsized":"2024-04-03T05:14:52.829428+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-04-03T05:14:52.829207+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-04-03T05:14:52.829207+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.829207+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:37:57.191995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":24937,"num_write":1159,"num_write_kb":21782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.893372+0000","last_change":"2024-04-03T05:14:43.893423+0000","last_active":"2024-04-03T05:14:43.893372+0000","last_peered":"2024-04-03T05:14:43.893372+0000","last_clean":"2024-04-03T05:14:43.893372+0000","last_became_active":"2024-04-03T03:38:28.737738+0000","last_became_peered":"2024-04-03T03:38:28.737738+0000","last_unstale":"2024-04-03T05:14:43.893372+0000","last_undegraded":"2024-04-03T05:14:43.893372+0000","last_fullsized":"2024-04-03T05:14:43.893372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:43.893182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:43.893182+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.893182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:21:52.083340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'430","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.347824+0000","last_change":"2024-04-03T05:14:32.347919+0000","last_active":"2024-04-03T05:14:32.347824+0000","last_peered":"2024-04-03T05:14:32.347824+0000","last_clean":"2024-04-03T05:14:32.347824+0000","last_became_active":"2024-04-03T03:38:30.822389+0000","last_became_peered":"2024-04-03T03:38:30.822389+0000","last_unstale":"2024-04-03T05:14:32.347824+0000","last_undegraded":"2024-04-03T05:14:32.347824+0000","last_fullsized":"2024-04-03T05:14:32.347824+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'430","last_scrub_stamp":"2024-04-03T05:14:32.347631+0000","last_deep_scrub":"263'430","last_deep_scrub_stamp":"2024-04-03T05:14:32.347631+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.347631+0000","objects_scrubbed":10,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:40:47.707333+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42966,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":673,"num_read_kb":1254,"num_write":506,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.536385+0000","last_change":"2024-04-03T05:14:43.536385+0000","last_active":"2024-04-03T05:14:43.536385+0000","last_peered":"2024-04-03T05:14:43.536385+0000","last_clean":"2024-04-03T05:14:43.536385+0000","last_became_active":"2024-04-03T03:38:32.730901+0000","last_became_peered":"2024-04-03T03:38:32.730901+0000","last_unstale":"2024-04-03T05:14:43.536385+0000","last_undegraded":"2024-04-03T05:14:43.536385+0000","last_fullsized":"2024-04-03T05:14:43.536385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:43.536127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:43.536127+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.536127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:06:34.309013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'542","reported_seq":1381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.293225+0000","last_change":"2024-04-03T05:14:25.293225+0000","last_active":"2024-04-03T05:14:25.293225+0000","last_peered":"2024-04-03T05:14:25.293225+0000","last_clean":"2024-04-03T05:14:25.293225+0000","last_became_active":"2024-04-03T03:38:34.754300+0000","last_became_peered":"2024-04-03T03:38:34.754300+0000","last_unstale":"2024-04-03T05:14:25.293225+0000","last_undegraded":"2024-04-03T05:14:25.293225+0000","last_fullsized":"2024-04-03T05:14:25.293225+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'542","last_scrub_stamp":"2024-04-03T05:14:25.292797+0000","last_deep_scrub":"263'542","last_deep_scrub_stamp":"2024-04-03T05:14:25.292797+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.292797+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:23:55.184793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1265,"num_read_kb":1263,"num_write":1135,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'845","reported_seq":2451,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.664803+0000","last_change":"2024-04-03T05:14:41.664891+0000","last_active":"2024-04-03T05:14:41.664803+0000","last_peered":"2024-04-03T05:14:41.664803+0000","last_clean":"2024-04-03T05:14:41.664803+0000","last_became_active":"2024-04-03T03:38:26.742328+0000","last_became_peered":"2024-04-03T03:38:26.742328+0000","last_unstale":"2024-04-03T05:14:41.664803+0000","last_undegraded":"2024-04-03T05:14:41.664803+0000","last_fullsized":"2024-04-03T05:14:41.664803+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'845","last_scrub_stamp":"2024-04-03T05:14:41.664599+0000","last_deep_scrub":"263'845","last_deep_scrub_stamp":"2024-04-03T05:14:41.664599+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.664599+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:14:36.522629+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3790,"num_read_kb":3360,"num_write":1145,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1196,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'387","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.579950+0000","last_change":"2024-04-03T05:14:26.580048+0000","last_active":"2024-04-03T05:14:26.579950+0000","last_peered":"2024-04-03T05:14:26.579950+0000","last_clean":"2024-04-03T05:14:26.579950+0000","last_became_active":"2024-04-03T03:38:58.348120+0000","last_became_peered":"2024-04-03T03:38:58.348120+0000","last_unstale":"2024-04-03T05:14:26.579950+0000","last_undegraded":"2024-04-03T05:14:26.579950+0000","last_fullsized":"2024-04-03T05:14:26.579950+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'387","last_scrub_stamp":"2024-04-03T05:14:26.579740+0000","last_deep_scrub":"263'387","last_deep_scrub_stamp":"2024-04-03T05:14:26.579740+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.579740+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:30:30.667472+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1491014,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":692,"num_read_kb":8001,"num_write":1323,"num_write_kb":23217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.472962+0000","last_change":"2024-04-03T05:14:33.473025+0000","last_active":"2024-04-03T05:14:33.472962+0000","last_peered":"2024-04-03T05:14:33.472962+0000","last_clean":"2024-04-03T05:14:33.472962+0000","last_became_active":"2024-04-03T03:38:28.729832+0000","last_became_peered":"2024-04-03T03:38:28.729832+0000","last_unstale":"2024-04-03T05:14:33.472962+0000","last_undegraded":"2024-04-03T05:14:33.472962+0000","last_fullsized":"2024-04-03T05:14:33.472962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.472762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.472762+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.472762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:14:38.186211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'317","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:09.354879+0000","last_change":"2024-04-03T05:15:09.354879+0000","last_active":"2024-04-03T05:15:09.354879+0000","last_peered":"2024-04-03T05:15:09.354879+0000","last_clean":"2024-04-03T05:15:09.354879+0000","last_became_active":"2024-04-03T03:38:30.720884+0000","last_became_peered":"2024-04-03T03:38:30.720884+0000","last_unstale":"2024-04-03T05:15:09.354879+0000","last_undegraded":"2024-04-03T05:15:09.354879+0000","last_fullsized":"2024-04-03T05:15:09.354879+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-04-03T05:15:09.354627+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-04-03T05:15:09.354627+0000","last_clean_scrub_stamp":"2024-04-03T05:15:09.354627+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:53:28.080644+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1184,"num_write":408,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.139944+0000","last_change":"2024-04-03T05:14:37.139999+0000","last_active":"2024-04-03T05:14:37.139944+0000","last_peered":"2024-04-03T05:14:37.139944+0000","last_clean":"2024-04-03T05:14:37.139944+0000","last_became_active":"2024-04-03T03:38:32.741770+0000","last_became_peered":"2024-04-03T03:38:32.741770+0000","last_unstale":"2024-04-03T05:14:37.139944+0000","last_undegraded":"2024-04-03T05:14:37.139944+0000","last_fullsized":"2024-04-03T05:14:37.139944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:37.139752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:37.139752+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.139752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:00:02.448643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'86","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.314643+0000","last_change":"2024-04-03T05:14:32.314643+0000","last_active":"2024-04-03T05:14:32.314643+0000","last_peered":"2024-04-03T05:14:32.314643+0000","last_clean":"2024-04-03T05:14:32.314643+0000","last_became_active":"2024-04-03T03:38:34.733896+0000","last_became_peered":"2024-04-03T03:38:34.733896+0000","last_unstale":"2024-04-03T05:14:32.314643+0000","last_undegraded":"2024-04-03T05:14:32.314643+0000","last_fullsized":"2024-04-03T05:14:32.314643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-04-03T05:14:32.314378+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-04-03T05:14:32.314378+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.314378+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:45.957383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'718","reported_seq":2139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.222593+0000","last_change":"2024-04-03T05:14:37.222723+0000","last_active":"2024-04-03T05:14:37.222593+0000","last_peered":"2024-04-03T05:14:37.222593+0000","last_clean":"2024-04-03T05:14:37.222593+0000","last_became_active":"2024-04-03T03:38:26.734518+0000","last_became_peered":"2024-04-03T03:38:26.734518+0000","last_unstale":"2024-04-03T05:14:37.222593+0000","last_undegraded":"2024-04-03T05:14:37.222593+0000","last_fullsized":"2024-04-03T05:14:37.222593+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'718","last_scrub_stamp":"2024-04-03T05:14:37.222276+0000","last_deep_scrub":"263'718","last_deep_scrub_stamp":"2024-04-03T05:14:37.222276+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.222276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:10:21.823195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3204,"num_read_kb":2862,"num_write":964,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'359","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.812191+0000","last_change":"2024-04-03T05:14:48.812191+0000","last_active":"2024-04-03T05:14:48.812191+0000","last_peered":"2024-04-03T05:14:48.812191+0000","last_clean":"2024-04-03T05:14:48.812191+0000","last_became_active":"2024-04-03T03:38:24.758401+0000","last_became_peered":"2024-04-03T03:38:24.758401+0000","last_unstale":"2024-04-03T05:14:48.812191+0000","last_undegraded":"2024-04-03T05:14:48.812191+0000","last_fullsized":"2024-04-03T05:14:48.812191+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-04-03T05:14:48.811767+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-04-03T05:14:48.811767+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.811767+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:12:42.853492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":692,"num_read_kb":12991,"num_write":1287,"num_write_kb":25567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.469228+0000","last_change":"2024-04-03T05:14:31.469228+0000","last_active":"2024-04-03T05:14:31.469228+0000","last_peered":"2024-04-03T05:14:31.469228+0000","last_clean":"2024-04-03T05:14:31.469228+0000","last_became_active":"2024-04-03T03:38:28.731257+0000","last_became_peered":"2024-04-03T03:38:28.731257+0000","last_unstale":"2024-04-03T05:14:31.469228+0000","last_undegraded":"2024-04-03T05:14:31.469228+0000","last_fullsized":"2024-04-03T05:14:31.469228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.468968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.468968+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.468968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:53:21.461796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'348","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.820289+0000","last_change":"2024-04-03T05:14:49.820410+0000","last_active":"2024-04-03T05:14:49.820289+0000","last_peered":"2024-04-03T05:14:49.820289+0000","last_clean":"2024-04-03T05:14:49.820289+0000","last_became_active":"2024-04-03T03:38:30.732417+0000","last_became_peered":"2024-04-03T03:38:30.732417+0000","last_unstale":"2024-04-03T05:14:49.820289+0000","last_undegraded":"2024-04-03T05:14:49.820289+0000","last_fullsized":"2024-04-03T05:14:49.820289+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-04-03T05:14:49.820104+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-04-03T05:14:49.820104+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.820104+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:54:13.985852+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50822,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":1115,"num_write":422,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'545","reported_seq":3047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.179716+0000","last_change":"2024-04-03T05:14:34.179780+0000","last_active":"2024-04-03T05:14:34.179716+0000","last_peered":"2024-04-03T05:14:34.179716+0000","last_clean":"2024-04-03T05:14:34.179716+0000","last_became_active":"2024-04-03T03:38:32.746029+0000","last_became_peered":"2024-04-03T03:38:32.746029+0000","last_unstale":"2024-04-03T05:14:34.179716+0000","last_undegraded":"2024-04-03T05:14:34.179716+0000","last_fullsized":"2024-04-03T05:14:34.179716+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'545","last_scrub_stamp":"2024-04-03T05:14:34.179529+0000","last_deep_scrub":"263'545","last_deep_scrub_stamp":"2024-04-03T05:14:34.179529+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.179529+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:50:40.090221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'95","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.300483+0000","last_change":"2024-04-03T05:14:29.300618+0000","last_active":"2024-04-03T05:14:29.300483+0000","last_peered":"2024-04-03T05:14:29.300483+0000","last_clean":"2024-04-03T05:14:29.300483+0000","last_became_active":"2024-04-03T03:38:34.741505+0000","last_became_peered":"2024-04-03T03:38:34.741505+0000","last_unstale":"2024-04-03T05:14:29.300483+0000","last_undegraded":"2024-04-03T05:14:29.300483+0000","last_fullsized":"2024-04-03T05:14:29.300483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-04-03T05:14:29.300259+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-04-03T05:14:29.300259+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.300259+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:41:52.092733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'446","reported_seq":2136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.245529+0000","last_change":"2024-04-03T05:14:42.245529+0000","last_active":"2024-04-03T05:14:42.245529+0000","last_peered":"2024-04-03T05:14:42.245529+0000","last_clean":"2024-04-03T05:14:42.245529+0000","last_became_active":"2024-04-03T03:38:26.731734+0000","last_became_peered":"2024-04-03T03:38:26.731734+0000","last_unstale":"2024-04-03T05:14:42.245529+0000","last_undegraded":"2024-04-03T05:14:42.245529+0000","last_fullsized":"2024-04-03T05:14:42.245529+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-04-03T05:14:42.245239+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-04-03T05:14:42.245239+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.245239+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:20:17.315413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2572,"num_read_kb":2428,"num_write":531,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2066,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'311","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.352771+0000","last_change":"2024-04-03T05:14:52.352771+0000","last_active":"2024-04-03T05:14:52.352771+0000","last_peered":"2024-04-03T05:14:52.352771+0000","last_clean":"2024-04-03T05:14:52.352771+0000","last_became_active":"2024-04-03T03:38:24.748646+0000","last_became_peered":"2024-04-03T03:38:24.748646+0000","last_unstale":"2024-04-03T05:14:52.352771+0000","last_undegraded":"2024-04-03T05:14:52.352771+0000","last_fullsized":"2024-04-03T05:14:52.352771+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-04-03T05:14:52.352465+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-04-03T05:14:52.352465+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.352465+0000","objects_scrubbed":8,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:43:28.678637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262207,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":9924,"num_write":1193,"num_write_kb":21025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"263'6","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.500813+0000","last_change":"2024-04-03T05:14:29.500877+0000","last_active":"2024-04-03T05:14:29.500813+0000","last_peered":"2024-04-03T05:14:29.500813+0000","last_clean":"2024-04-03T05:14:29.500813+0000","last_became_active":"2024-04-03T03:38:28.733096+0000","last_became_peered":"2024-04-03T03:38:28.733096+0000","last_unstale":"2024-04-03T05:14:29.500813+0000","last_undegraded":"2024-04-03T05:14:29.500813+0000","last_fullsized":"2024-04-03T05:14:29.500813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-04-03T05:14:29.500623+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-04-03T05:14:29.500623+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.500623+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:45:34.140345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":788,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'509","reported_seq":1200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.207079+0000","last_change":"2024-04-03T05:14:53.207220+0000","last_active":"2024-04-03T05:14:53.207079+0000","last_peered":"2024-04-03T05:14:53.207079+0000","last_clean":"2024-04-03T05:14:53.207079+0000","last_became_active":"2024-04-03T03:38:30.729624+0000","last_became_peered":"2024-04-03T03:38:30.729624+0000","last_unstale":"2024-04-03T05:14:53.207079+0000","last_undegraded":"2024-04-03T05:14:53.207079+0000","last_fullsized":"2024-04-03T05:14:53.207079+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-04-03T05:14:53.206869+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-04-03T05:14:53.206869+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.206869+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:36:09.340149+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99740,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":863,"num_read_kb":2054,"num_write":690,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:18.563232+0000","last_change":"2024-04-03T05:14:18.563335+0000","last_active":"2024-04-03T05:14:18.563232+0000","last_peered":"2024-04-03T05:14:18.563232+0000","last_clean":"2024-04-03T05:14:18.563232+0000","last_became_active":"2024-04-03T03:38:32.746634+0000","last_became_peered":"2024-04-03T03:38:32.746634+0000","last_unstale":"2024-04-03T05:14:18.563232+0000","last_undegraded":"2024-04-03T05:14:18.563232+0000","last_fullsized":"2024-04-03T05:14:18.563232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:18.563005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:18.563005+0000","last_clean_scrub_stamp":"2024-04-03T05:14:18.563005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:17.147799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'92","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.597309+0000","last_change":"2024-04-03T05:14:26.597470+0000","last_active":"2024-04-03T05:14:26.597309+0000","last_peered":"2024-04-03T05:14:26.597309+0000","last_clean":"2024-04-03T05:14:26.597309+0000","last_became_active":"2024-04-03T03:38:34.730714+0000","last_became_peered":"2024-04-03T03:38:34.730714+0000","last_unstale":"2024-04-03T05:14:26.597309+0000","last_undegraded":"2024-04-03T05:14:26.597309+0000","last_fullsized":"2024-04-03T05:14:26.597309+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-04-03T05:14:26.597062+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-04-03T05:14:26.597062+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.597062+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:11:36.950593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":839,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":214,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'708","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.445558+0000","last_change":"2024-04-03T05:14:19.445558+0000","last_active":"2024-04-03T05:14:19.445558+0000","last_peered":"2024-04-03T05:14:19.445558+0000","last_clean":"2024-04-03T05:14:19.445558+0000","last_became_active":"2024-04-03T03:39:58.684099+0000","last_became_peered":"2024-04-03T03:39:58.684099+0000","last_unstale":"2024-04-03T05:14:19.445558+0000","last_undegraded":"2024-04-03T05:14:19.445558+0000","last_fullsized":"2024-04-03T05:14:19.445558+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'708","last_scrub_stamp":"2024-04-03T05:14:19.445286+0000","last_deep_scrub":"263'708","last_deep_scrub_stamp":"2024-04-03T05:14:19.445286+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.445286+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:37:12.157533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3233,"num_read_kb":2920,"num_write":926,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'339","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.492469+0000","last_change":"2024-04-03T05:14:22.492712+0000","last_active":"2024-04-03T05:14:22.492469+0000","last_peered":"2024-04-03T05:14:22.492469+0000","last_clean":"2024-04-03T05:14:22.492469+0000","last_became_active":"2024-04-03T03:38:57.880334+0000","last_became_peered":"2024-04-03T03:38:57.880334+0000","last_unstale":"2024-04-03T05:14:22.492469+0000","last_undegraded":"2024-04-03T05:14:22.492469+0000","last_fullsized":"2024-04-03T05:14:22.492469+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-04-03T05:14:22.492212+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-04-03T05:14:22.492212+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.492212+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:58:23.552426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263916,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":538,"num_read_kb":83385,"num_write":1176,"num_write_kb":48172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.536556+0000","last_change":"2024-04-03T05:14:25.536556+0000","last_active":"2024-04-03T05:14:25.536556+0000","last_peered":"2024-04-03T05:14:25.536556+0000","last_clean":"2024-04-03T05:14:25.536556+0000","last_became_active":"2024-04-03T03:38:28.735217+0000","last_became_peered":"2024-04-03T03:38:28.735217+0000","last_unstale":"2024-04-03T05:14:25.536556+0000","last_undegraded":"2024-04-03T05:14:25.536556+0000","last_fullsized":"2024-04-03T05:14:25.536556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:25.536310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:25.536310+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.536310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:06:47.226136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'354","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.596048+0000","last_change":"2024-04-03T05:14:48.596129+0000","last_active":"2024-04-03T05:14:48.596048+0000","last_peered":"2024-04-03T05:14:48.596048+0000","last_clean":"2024-04-03T05:14:48.596048+0000","last_became_active":"2024-04-03T03:38:30.716983+0000","last_became_peered":"2024-04-03T03:38:30.716983+0000","last_unstale":"2024-04-03T05:14:48.596048+0000","last_undegraded":"2024-04-03T05:14:48.596048+0000","last_fullsized":"2024-04-03T05:14:48.596048+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-04-03T05:14:48.595852+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-04-03T05:14:48.595852+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.595852+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:18:19.906164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56711,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":610,"num_read_kb":1386,"num_write":534,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.281384+0000","last_change":"2024-04-03T05:14:38.281435+0000","last_active":"2024-04-03T05:14:38.281384+0000","last_peered":"2024-04-03T05:14:38.281384+0000","last_clean":"2024-04-03T05:14:38.281384+0000","last_became_active":"2024-04-03T03:38:32.737619+0000","last_became_peered":"2024-04-03T03:38:32.737619+0000","last_unstale":"2024-04-03T05:14:38.281384+0000","last_undegraded":"2024-04-03T05:14:38.281384+0000","last_fullsized":"2024-04-03T05:14:38.281384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:38.281203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:38.281203+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.281203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:28:38.298700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'105","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.123126+0000","last_change":"2024-04-03T05:14:29.123126+0000","last_active":"2024-04-03T05:14:29.123126+0000","last_peered":"2024-04-03T05:14:29.123126+0000","last_clean":"2024-04-03T05:14:29.123126+0000","last_became_active":"2024-04-03T03:38:34.754907+0000","last_became_peered":"2024-04-03T03:38:34.754907+0000","last_unstale":"2024-04-03T05:14:29.123126+0000","last_undegraded":"2024-04-03T05:14:29.123126+0000","last_fullsized":"2024-04-03T05:14:29.123126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-04-03T05:14:29.122845+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-04-03T05:14:29.122845+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.122845+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:41:57.447948+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":237,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'877","reported_seq":2641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:55.707509+0000","last_change":"2024-04-03T05:14:55.707509+0000","last_active":"2024-04-03T05:14:55.707509+0000","last_peered":"2024-04-03T05:14:55.707509+0000","last_clean":"2024-04-03T05:14:55.707509+0000","last_became_active":"2024-04-03T03:38:26.740674+0000","last_became_peered":"2024-04-03T03:38:26.740674+0000","last_unstale":"2024-04-03T05:14:55.707509+0000","last_undegraded":"2024-04-03T05:14:55.707509+0000","last_fullsized":"2024-04-03T05:14:55.707509+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'877","last_scrub_stamp":"2024-04-03T05:14:55.707223+0000","last_deep_scrub":"263'877","last_deep_scrub_stamp":"2024-04-03T05:14:55.707223+0000","last_clean_scrub_stamp":"2024-04-03T05:14:55.707223+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:19.415893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4230,"num_read_kb":3805,"num_write":1201,"num_write_kb":481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1185,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'306","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.527258+0000","last_change":"2024-04-03T05:14:24.527258+0000","last_active":"2024-04-03T05:14:24.527258+0000","last_peered":"2024-04-03T05:14:24.527258+0000","last_clean":"2024-04-03T05:14:24.527258+0000","last_became_active":"2024-04-03T03:38:58.344044+0000","last_became_peered":"2024-04-03T03:38:58.344044+0000","last_unstale":"2024-04-03T05:14:24.527258+0000","last_undegraded":"2024-04-03T05:14:24.527258+0000","last_fullsized":"2024-04-03T05:14:24.527258+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-04-03T05:14:24.526901+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-04-03T05:14:24.526901+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.526901+0000","objects_scrubbed":14,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:03.910729+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6735876,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":460,"num_read_kb":45119,"num_write":1136,"num_write_kb":60620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.619805+0000","last_change":"2024-04-03T05:14:31.619805+0000","last_active":"2024-04-03T05:14:31.619805+0000","last_peered":"2024-04-03T05:14:31.619805+0000","last_clean":"2024-04-03T05:14:31.619805+0000","last_became_active":"2024-04-03T03:38:28.715394+0000","last_became_peered":"2024-04-03T03:38:28.715394+0000","last_unstale":"2024-04-03T05:14:31.619805+0000","last_undegraded":"2024-04-03T05:14:31.619805+0000","last_fullsized":"2024-04-03T05:14:31.619805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.619467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.619467+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.619467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:50:24.136880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'342","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.542366+0000","last_change":"2024-04-03T05:14:23.542474+0000","last_active":"2024-04-03T05:14:23.542366+0000","last_peered":"2024-04-03T05:14:23.542366+0000","last_clean":"2024-04-03T05:14:23.542366+0000","last_became_active":"2024-04-03T03:38:30.733001+0000","last_became_peered":"2024-04-03T03:38:30.733001+0000","last_unstale":"2024-04-03T05:14:23.542366+0000","last_undegraded":"2024-04-03T05:14:23.542366+0000","last_fullsized":"2024-04-03T05:14:23.542366+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-04-03T05:14:23.542156+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-04-03T05:14:23.542156+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.542156+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:43:59.797131+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50205,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1151,"num_write":432,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'500","reported_seq":2378,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:19.539513+0000","last_change":"2024-04-03T05:14:19.539513+0000","last_active":"2024-04-03T05:14:19.539513+0000","last_peered":"2024-04-03T05:14:19.539513+0000","last_clean":"2024-04-03T05:14:19.539513+0000","last_became_active":"2024-04-03T03:38:32.740883+0000","last_became_peered":"2024-04-03T03:38:32.740883+0000","last_unstale":"2024-04-03T05:14:19.539513+0000","last_undegraded":"2024-04-03T05:14:19.539513+0000","last_fullsized":"2024-04-03T05:14:19.539513+0000","mapping_epoch":31,"log_start":"258'400","ondisk_log_start":"258'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'500","last_scrub_stamp":"2024-04-03T05:14:19.539252+0000","last_deep_scrub":"263'500","last_deep_scrub_stamp":"2024-04-03T05:14:19.539252+0000","last_clean_scrub_stamp":"2024-04-03T05:14:19.539252+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:02:16.078882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'93","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.635841+0000","last_change":"2024-04-03T05:14:25.635841+0000","last_active":"2024-04-03T05:14:25.635841+0000","last_peered":"2024-04-03T05:14:25.635841+0000","last_clean":"2024-04-03T05:14:25.635841+0000","last_became_active":"2024-04-03T03:38:34.748128+0000","last_became_peered":"2024-04-03T03:38:34.748128+0000","last_unstale":"2024-04-03T05:14:25.635841+0000","last_undegraded":"2024-04-03T05:14:25.635841+0000","last_fullsized":"2024-04-03T05:14:25.635841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'93","last_scrub_stamp":"2024-04-03T05:14:25.635545+0000","last_deep_scrub":"263'93","last_deep_scrub_stamp":"2024-04-03T05:14:25.635545+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.635545+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:51:27.121684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":229,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'413","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.580112+0000","last_change":"2024-04-03T05:14:47.580112+0000","last_active":"2024-04-03T05:14:47.580112+0000","last_peered":"2024-04-03T05:14:47.580112+0000","last_clean":"2024-04-03T05:14:47.580112+0000","last_became_active":"2024-04-03T03:38:26.742254+0000","last_became_peered":"2024-04-03T03:38:26.742254+0000","last_unstale":"2024-04-03T05:14:47.580112+0000","last_undegraded":"2024-04-03T05:14:47.580112+0000","last_fullsized":"2024-04-03T05:14:47.580112+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-04-03T05:14:47.579767+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-04-03T05:14:47.579767+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.579767+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:49:16.724164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2115,"num_read_kb":2003,"num_write":485,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'358","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.639750+0000","last_change":"2024-04-03T05:14:50.639850+0000","last_active":"2024-04-03T05:14:50.639750+0000","last_peered":"2024-04-03T05:14:50.639750+0000","last_clean":"2024-04-03T05:14:50.639750+0000","last_became_active":"2024-04-03T03:38:24.710396+0000","last_became_peered":"2024-04-03T03:38:24.710396+0000","last_unstale":"2024-04-03T05:14:50.639750+0000","last_undegraded":"2024-04-03T05:14:50.639750+0000","last_fullsized":"2024-04-03T05:14:50.639750+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-04-03T05:14:50.639528+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-04-03T05:14:50.639528+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.639528+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:02:38.795244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288129,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":39636,"num_write":1279,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.348269+0000","last_change":"2024-04-03T05:14:51.348358+0000","last_active":"2024-04-03T05:14:51.348269+0000","last_peered":"2024-04-03T05:14:51.348269+0000","last_clean":"2024-04-03T05:14:51.348269+0000","last_became_active":"2024-04-03T03:38:28.734894+0000","last_became_peered":"2024-04-03T03:38:28.734894+0000","last_unstale":"2024-04-03T05:14:51.348269+0000","last_undegraded":"2024-04-03T05:14:51.348269+0000","last_fullsized":"2024-04-03T05:14:51.348269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:51.348059+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:51.348059+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.348059+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:54:56.812110+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":632,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'131","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.261912+0000","last_change":"2024-04-03T05:14:40.261912+0000","last_active":"2024-04-03T05:14:40.261912+0000","last_peered":"2024-04-03T05:14:40.261912+0000","last_clean":"2024-04-03T05:14:40.261912+0000","last_became_active":"2024-04-03T03:38:30.821224+0000","last_became_peered":"2024-04-03T03:38:30.821224+0000","last_unstale":"2024-04-03T05:14:40.261912+0000","last_undegraded":"2024-04-03T05:14:40.261912+0000","last_fullsized":"2024-04-03T05:14:40.261912+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-04-03T05:14:40.261652+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-04-03T05:14:40.261652+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.261652+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:52:43.682995+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'526","reported_seq":2482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.280786+0000","last_change":"2024-04-03T05:14:30.280848+0000","last_active":"2024-04-03T05:14:30.280786+0000","last_peered":"2024-04-03T05:14:30.280786+0000","last_clean":"2024-04-03T05:14:30.280786+0000","last_became_active":"2024-04-03T03:38:32.747078+0000","last_became_peered":"2024-04-03T03:38:32.747078+0000","last_unstale":"2024-04-03T05:14:30.280786+0000","last_undegraded":"2024-04-03T05:14:30.280786+0000","last_fullsized":"2024-04-03T05:14:30.280786+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'526","last_scrub_stamp":"2024-04-03T05:14:30.280590+0000","last_deep_scrub":"263'526","last_deep_scrub_stamp":"2024-04-03T05:14:30.280590+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.280590+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:33:41.204577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'100","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:23.533167+0000","last_change":"2024-04-03T05:14:23.533167+0000","last_active":"2024-04-03T05:14:23.533167+0000","last_peered":"2024-04-03T05:14:23.533167+0000","last_clean":"2024-04-03T05:14:23.533167+0000","last_became_active":"2024-04-03T03:38:34.739554+0000","last_became_peered":"2024-04-03T03:38:34.739554+0000","last_unstale":"2024-04-03T05:14:23.533167+0000","last_undegraded":"2024-04-03T05:14:23.533167+0000","last_fullsized":"2024-04-03T05:14:23.533167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'100","last_scrub_stamp":"2024-04-03T05:14:23.532876+0000","last_deep_scrub":"263'100","last_deep_scrub_stamp":"2024-04-03T05:14:23.532876+0000","last_clean_scrub_stamp":"2024-04-03T05:14:23.532876+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:47.184410+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'348","reported_seq":1762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.611008+0000","last_change":"2024-04-03T05:14:30.611179+0000","last_active":"2024-04-03T05:14:30.611008+0000","last_peered":"2024-04-03T05:14:30.611008+0000","last_clean":"2024-04-03T05:14:30.611008+0000","last_became_active":"2024-04-03T03:38:26.729241+0000","last_became_peered":"2024-04-03T03:38:26.729241+0000","last_unstale":"2024-04-03T05:14:30.611008+0000","last_undegraded":"2024-04-03T05:14:30.611008+0000","last_fullsized":"2024-04-03T05:14:30.611008+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-04-03T05:14:30.610796+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-04-03T05:14:30.610796+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.610796+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:09:37.419874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1840,"num_read_kb":1751,"num_write":396,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'307","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:01.229230+0000","last_change":"2024-04-03T05:15:01.229457+0000","last_active":"2024-04-03T05:15:01.229230+0000","last_peered":"2024-04-03T05:15:01.229230+0000","last_clean":"2024-04-03T05:15:01.229230+0000","last_became_active":"2024-04-03T03:38:24.709105+0000","last_became_peered":"2024-04-03T03:38:24.709105+0000","last_unstale":"2024-04-03T05:15:01.229230+0000","last_undegraded":"2024-04-03T05:15:01.229230+0000","last_fullsized":"2024-04-03T05:15:01.229230+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-04-03T05:15:01.228957+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-04-03T05:15:01.228957+0000","last_clean_scrub_stamp":"2024-04-03T05:15:01.228957+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:30:29.889086+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2161470,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":67615,"num_write":1075,"num_write_kb":19160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.615729+0000","last_change":"2024-04-03T05:14:46.615729+0000","last_active":"2024-04-03T05:14:46.615729+0000","last_peered":"2024-04-03T05:14:46.615729+0000","last_clean":"2024-04-03T05:14:46.615729+0000","last_became_active":"2024-04-03T03:38:28.729835+0000","last_became_peered":"2024-04-03T03:38:28.729835+0000","last_unstale":"2024-04-03T05:14:46.615729+0000","last_undegraded":"2024-04-03T05:14:46.615729+0000","last_fullsized":"2024-04-03T05:14:46.615729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:46.615351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:46.615351+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.615351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:23:42.065678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'519","reported_seq":1189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.380435+0000","last_change":"2024-04-03T05:14:33.380521+0000","last_active":"2024-04-03T05:14:33.380435+0000","last_peered":"2024-04-03T05:14:33.380435+0000","last_clean":"2024-04-03T05:14:33.380435+0000","last_became_active":"2024-04-03T03:38:30.729797+0000","last_became_peered":"2024-04-03T03:38:30.729797+0000","last_unstale":"2024-04-03T05:14:33.380435+0000","last_undegraded":"2024-04-03T05:14:33.380435+0000","last_fullsized":"2024-04-03T05:14:33.380435+0000","mapping_epoch":29,"log_start":"263'500","ondisk_log_start":"263'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'519","last_scrub_stamp":"2024-04-03T05:14:33.380246+0000","last_deep_scrub":"263'519","last_deep_scrub_stamp":"2024-04-03T05:14:33.380246+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.380246+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:28:22.253810+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1388,"num_read_kb":1975,"num_write":1982,"num_write_kb":1776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":480474,"num_omap_keys":1112,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.264992+0000","last_change":"2024-04-03T05:14:24.265046+0000","last_active":"2024-04-03T05:14:24.264992+0000","last_peered":"2024-04-03T05:14:24.264992+0000","last_clean":"2024-04-03T05:14:24.264992+0000","last_became_active":"2024-04-03T03:38:32.738974+0000","last_became_peered":"2024-04-03T03:38:32.738974+0000","last_unstale":"2024-04-03T05:14:24.264992+0000","last_undegraded":"2024-04-03T05:14:24.264992+0000","last_fullsized":"2024-04-03T05:14:24.264992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:24.264793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:24.264793+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.264793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:39:12.004063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'127","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.621498+0000","last_change":"2024-04-03T05:14:24.621498+0000","last_active":"2024-04-03T05:14:24.621498+0000","last_peered":"2024-04-03T05:14:24.621498+0000","last_clean":"2024-04-03T05:14:24.621498+0000","last_became_active":"2024-04-03T03:38:34.755358+0000","last_became_peered":"2024-04-03T03:38:34.755358+0000","last_unstale":"2024-04-03T05:14:24.621498+0000","last_undegraded":"2024-04-03T05:14:24.621498+0000","last_fullsized":"2024-04-03T05:14:24.621498+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-04-03T05:14:24.621251+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-04-03T05:14:24.621251+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.621251+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:00:25.765195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":113,"num_write":275,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'757","reported_seq":2273,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.277004+0000","last_change":"2024-04-03T05:14:35.277004+0000","last_active":"2024-04-03T05:14:35.277004+0000","last_peered":"2024-04-03T05:14:35.277004+0000","last_clean":"2024-04-03T05:14:35.277004+0000","last_became_active":"2024-04-03T03:38:26.747883+0000","last_became_peered":"2024-04-03T03:38:26.747883+0000","last_unstale":"2024-04-03T05:14:35.277004+0000","last_undegraded":"2024-04-03T05:14:35.277004+0000","last_fullsized":"2024-04-03T05:14:35.277004+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'757","last_scrub_stamp":"2024-04-03T05:14:35.276741+0000","last_deep_scrub":"263'757","last_deep_scrub_stamp":"2024-04-03T05:14:35.276741+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.276741+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:09:05.702739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3405,"num_read_kb":3046,"num_write":999,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'119","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.861605+0000","last_change":"2024-04-03T05:14:53.861676+0000","last_active":"2024-04-03T05:14:53.861605+0000","last_peered":"2024-04-03T05:14:53.861605+0000","last_clean":"2024-04-03T05:14:53.861605+0000","last_became_active":"2024-04-03T03:38:04.255147+0000","last_became_peered":"2024-04-03T03:38:04.255147+0000","last_unstale":"2024-04-03T05:14:53.861605+0000","last_undegraded":"2024-04-03T05:14:53.861605+0000","last_fullsized":"2024-04-03T05:14:53.861605+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-04-03T05:14:53.861415+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-04-03T05:14:53.861415+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.861415+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:57:50.031534+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":547,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.325299+0000","last_change":"2024-04-03T05:14:54.325350+0000","last_active":"2024-04-03T05:14:54.325299+0000","last_peered":"2024-04-03T05:14:54.325299+0000","last_clean":"2024-04-03T05:14:54.325299+0000","last_became_active":"2024-04-03T03:38:11.615990+0000","last_became_peered":"2024-04-03T03:38:11.615990+0000","last_unstale":"2024-04-03T05:14:54.325299+0000","last_undegraded":"2024-04-03T05:14:54.325299+0000","last_fullsized":"2024-04-03T05:14:54.325299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:54.325094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:54.325094+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.325094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:26:10.488903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'273","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:00.228170+0000","last_change":"2024-04-03T05:15:00.228302+0000","last_active":"2024-04-03T05:15:00.228170+0000","last_peered":"2024-04-03T05:15:00.228170+0000","last_clean":"2024-04-03T05:15:00.228170+0000","last_became_active":"2024-04-03T03:38:24.759653+0000","last_became_peered":"2024-04-03T03:38:24.759653+0000","last_unstale":"2024-04-03T05:15:00.228170+0000","last_undegraded":"2024-04-03T05:15:00.228170+0000","last_fullsized":"2024-04-03T05:15:00.228170+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'273","last_scrub_stamp":"2024-04-03T05:15:00.227965+0000","last_deep_scrub":"263'273","last_deep_scrub_stamp":"2024-04-03T05:15:00.227965+0000","last_clean_scrub_stamp":"2024-04-03T05:15:00.227965+0000","objects_scrubbed":11,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:57:01.005216+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5305714,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":451,"num_read_kb":37025,"num_write":1084,"num_write_kb":41578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.899034+0000","last_change":"2024-04-03T05:14:41.899090+0000","last_active":"2024-04-03T05:14:41.899034+0000","last_peered":"2024-04-03T05:14:41.899034+0000","last_clean":"2024-04-03T05:14:41.899034+0000","last_became_active":"2024-04-03T03:38:28.735507+0000","last_became_peered":"2024-04-03T03:38:28.735507+0000","last_unstale":"2024-04-03T05:14:41.899034+0000","last_undegraded":"2024-04-03T05:14:41.899034+0000","last_fullsized":"2024-04-03T05:14:41.899034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:41.898834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:41.898834+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.898834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:50:34.267851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'743","reported_seq":1495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.337866+0000","last_change":"2024-04-03T05:14:34.337951+0000","last_active":"2024-04-03T05:14:34.337866+0000","last_peered":"2024-04-03T05:14:34.337866+0000","last_clean":"2024-04-03T05:14:34.337866+0000","last_became_active":"2024-04-03T03:38:30.722613+0000","last_became_peered":"2024-04-03T03:38:30.722613+0000","last_unstale":"2024-04-03T05:14:34.337866+0000","last_undegraded":"2024-04-03T05:14:34.337866+0000","last_fullsized":"2024-04-03T05:14:34.337866+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'743","last_scrub_stamp":"2024-04-03T05:14:34.337675+0000","last_deep_scrub":"263'743","last_deep_scrub_stamp":"2024-04-03T05:14:34.337675+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.337675+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:51:22.454088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1443,"num_read_kb":3262,"num_write":1372,"num_write_kb":1187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89356,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.221693+0000","last_change":"2024-04-03T05:14:33.221748+0000","last_active":"2024-04-03T05:14:33.221693+0000","last_peered":"2024-04-03T05:14:33.221693+0000","last_clean":"2024-04-03T05:14:33.221693+0000","last_became_active":"2024-04-03T03:38:32.746148+0000","last_became_peered":"2024-04-03T03:38:32.746148+0000","last_unstale":"2024-04-03T05:14:33.221693+0000","last_undegraded":"2024-04-03T05:14:33.221693+0000","last_fullsized":"2024-04-03T05:14:33.221693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.221493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.221493+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.221493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:11:50.545960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'116","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.237415+0000","last_change":"2024-04-03T05:14:36.237555+0000","last_active":"2024-04-03T05:14:36.237415+0000","last_peered":"2024-04-03T05:14:36.237415+0000","last_clean":"2024-04-03T05:14:36.237415+0000","last_became_active":"2024-04-03T03:38:34.760522+0000","last_became_peered":"2024-04-03T03:38:34.760522+0000","last_unstale":"2024-04-03T05:14:36.237415+0000","last_undegraded":"2024-04-03T05:14:36.237415+0000","last_fullsized":"2024-04-03T05:14:36.237415+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-04-03T05:14:36.237184+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-04-03T05:14:36.237184+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.237184+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:14:12.077097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":148,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'707","reported_seq":2098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.201518+0000","last_change":"2024-04-03T05:14:48.201600+0000","last_active":"2024-04-03T05:14:48.201518+0000","last_peered":"2024-04-03T05:14:48.201518+0000","last_clean":"2024-04-03T05:14:48.201518+0000","last_became_active":"2024-04-03T03:38:26.725330+0000","last_became_peered":"2024-04-03T03:38:26.725330+0000","last_unstale":"2024-04-03T05:14:48.201518+0000","last_undegraded":"2024-04-03T05:14:48.201518+0000","last_fullsized":"2024-04-03T05:14:48.201518+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'707","last_scrub_stamp":"2024-04-03T05:14:48.201318+0000","last_deep_scrub":"263'707","last_deep_scrub_stamp":"2024-04-03T05:14:48.201318+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.201318+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:41:25.098807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3168,"num_read_kb":2822,"num_write":954,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":546,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:55.876143+0000","last_change":"2024-04-03T05:14:55.876198+0000","last_active":"2024-04-03T05:14:55.876143+0000","last_peered":"2024-04-03T05:14:55.876143+0000","last_clean":"2024-04-03T05:14:55.876143+0000","last_became_active":"2024-04-03T03:38:11.619474+0000","last_became_peered":"2024-04-03T03:38:11.619474+0000","last_unstale":"2024-04-03T05:14:55.876143+0000","last_undegraded":"2024-04-03T05:14:55.876143+0000","last_fullsized":"2024-04-03T05:14:55.876143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:55.875951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:55.875951+0000","last_clean_scrub_stamp":"2024-04-03T05:14:55.875951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:26:33.611820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'329","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:03.162474+0000","last_change":"2024-04-03T05:15:03.162620+0000","last_active":"2024-04-03T05:15:03.162474+0000","last_peered":"2024-04-03T05:15:03.162474+0000","last_clean":"2024-04-03T05:15:03.162474+0000","last_became_active":"2024-04-03T03:38:24.745231+0000","last_became_peered":"2024-04-03T03:38:24.745231+0000","last_unstale":"2024-04-03T05:15:03.162474+0000","last_undegraded":"2024-04-03T05:15:03.162474+0000","last_fullsized":"2024-04-03T05:15:03.162474+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-04-03T05:15:03.162222+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-04-03T05:15:03.162222+0000","last_clean_scrub_stamp":"2024-04-03T05:15:03.162222+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:23:27.930213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":22150,"num_write":1160,"num_write_kb":21627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:01.326555+0000","last_change":"2024-04-03T05:15:01.326616+0000","last_active":"2024-04-03T05:15:01.326555+0000","last_peered":"2024-04-03T05:15:01.326555+0000","last_clean":"2024-04-03T05:15:01.326555+0000","last_became_active":"2024-04-03T03:38:28.740595+0000","last_became_peered":"2024-04-03T03:38:28.740595+0000","last_unstale":"2024-04-03T05:15:01.326555+0000","last_undegraded":"2024-04-03T05:15:01.326555+0000","last_fullsized":"2024-04-03T05:15:01.326555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:15:01.326254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:15:01.326254+0000","last_clean_scrub_stamp":"2024-04-03T05:15:01.326254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:43:19.584959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1199","reported_seq":3263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.599336+0000","last_change":"2024-04-03T05:14:37.599428+0000","last_active":"2024-04-03T05:14:37.599336+0000","last_peered":"2024-04-03T05:14:37.599336+0000","last_clean":"2024-04-03T05:14:37.599336+0000","last_became_active":"2024-04-03T03:38:30.719511+0000","last_became_peered":"2024-04-03T03:38:30.719511+0000","last_unstale":"2024-04-03T05:14:37.599336+0000","last_undegraded":"2024-04-03T05:14:37.599336+0000","last_fullsized":"2024-04-03T05:14:37.599336+0000","mapping_epoch":29,"log_start":"263'1100","ondisk_log_start":"263'1100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1199","last_scrub_stamp":"2024-04-03T05:14:37.599136+0000","last_deep_scrub":"263'1199","last_deep_scrub_stamp":"2024-04-03T05:14:37.599136+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.599136+0000","objects_scrubbed":12,"log_size":99,"log_dups_size":1100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:39:34.119832+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152942,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1863,"num_read_kb":3633,"num_write":1216,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.774498+0000","last_change":"2024-04-03T05:14:32.774498+0000","last_active":"2024-04-03T05:14:32.774498+0000","last_peered":"2024-04-03T05:14:32.774498+0000","last_clean":"2024-04-03T05:14:32.774498+0000","last_became_active":"2024-04-03T03:38:32.748061+0000","last_became_peered":"2024-04-03T03:38:32.748061+0000","last_unstale":"2024-04-03T05:14:32.774498+0000","last_undegraded":"2024-04-03T05:14:32.774498+0000","last_fullsized":"2024-04-03T05:14:32.774498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:32.774243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:32.774243+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.774243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:29:08.272229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'165","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.594652+0000","last_change":"2024-04-03T05:14:22.594652+0000","last_active":"2024-04-03T05:14:22.594652+0000","last_peered":"2024-04-03T05:14:22.594652+0000","last_clean":"2024-04-03T05:14:22.594652+0000","last_became_active":"2024-04-03T03:38:34.936635+0000","last_became_peered":"2024-04-03T03:38:34.936635+0000","last_unstale":"2024-04-03T05:14:22.594652+0000","last_undegraded":"2024-04-03T05:14:22.594652+0000","last_fullsized":"2024-04-03T05:14:22.594652+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'165","last_scrub_stamp":"2024-04-03T05:14:22.594244+0000","last_deep_scrub":"263'165","last_deep_scrub_stamp":"2024-04-03T05:14:22.594244+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.594244+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:31:56.893087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":220,"num_read_kb":219,"num_write":382,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'396","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.629074+0000","last_change":"2024-04-03T05:14:36.629142+0000","last_active":"2024-04-03T05:14:36.629074+0000","last_peered":"2024-04-03T05:14:36.629074+0000","last_clean":"2024-04-03T05:14:36.629074+0000","last_became_active":"2024-04-03T03:38:26.721536+0000","last_became_peered":"2024-04-03T03:38:26.721536+0000","last_unstale":"2024-04-03T05:14:36.629074+0000","last_undegraded":"2024-04-03T05:14:36.629074+0000","last_fullsized":"2024-04-03T05:14:36.629074+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-04-03T05:14:36.628883+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-04-03T05:14:36.628883+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.628883+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:53:04.082202+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2077,"num_read_kb":1939,"num_write":478,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":546,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.465874+0000","last_change":"2024-04-03T05:14:34.465974+0000","last_active":"2024-04-03T05:14:34.465874+0000","last_peered":"2024-04-03T05:14:34.465874+0000","last_clean":"2024-04-03T05:14:34.465874+0000","last_became_active":"2024-04-03T03:38:11.755301+0000","last_became_peered":"2024-04-03T03:38:11.755301+0000","last_unstale":"2024-04-03T05:14:34.465874+0000","last_undegraded":"2024-04-03T05:14:34.465874+0000","last_fullsized":"2024-04-03T05:14:34.465874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:34.465584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:34.465584+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.465584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:46:25.305170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'314","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.524635+0000","last_change":"2024-04-03T05:14:48.524635+0000","last_active":"2024-04-03T05:14:48.524635+0000","last_peered":"2024-04-03T05:14:48.524635+0000","last_clean":"2024-04-03T05:14:48.524635+0000","last_became_active":"2024-04-03T03:38:24.720445+0000","last_became_peered":"2024-04-03T03:38:24.720445+0000","last_unstale":"2024-04-03T05:14:48.524635+0000","last_undegraded":"2024-04-03T05:14:48.524635+0000","last_fullsized":"2024-04-03T05:14:48.524635+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-04-03T05:14:48.524349+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-04-03T05:14:48.524349+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.524349+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:40:11.390177+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194358,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":20915,"num_write":1082,"num_write_kb":36230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.527332+0000","last_change":"2024-04-03T05:14:27.527393+0000","last_active":"2024-04-03T05:14:27.527332+0000","last_peered":"2024-04-03T05:14:27.527332+0000","last_clean":"2024-04-03T05:14:27.527332+0000","last_became_active":"2024-04-03T03:38:28.733750+0000","last_became_peered":"2024-04-03T03:38:28.733750+0000","last_unstale":"2024-04-03T05:14:27.527332+0000","last_undegraded":"2024-04-03T05:14:27.527332+0000","last_fullsized":"2024-04-03T05:14:27.527332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:27.527140+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:27.527140+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.527140+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:50:25.076608+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'340","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:01.861324+0000","last_change":"2024-04-03T05:15:01.861407+0000","last_active":"2024-04-03T05:15:01.861324+0000","last_peered":"2024-04-03T05:15:01.861324+0000","last_clean":"2024-04-03T05:15:01.861324+0000","last_became_active":"2024-04-03T03:38:30.824061+0000","last_became_peered":"2024-04-03T03:38:30.824061+0000","last_unstale":"2024-04-03T05:15:01.861324+0000","last_undegraded":"2024-04-03T05:15:01.861324+0000","last_fullsized":"2024-04-03T05:15:01.861324+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-04-03T05:15:01.861132+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-04-03T05:15:01.861132+0000","last_clean_scrub_stamp":"2024-04-03T05:15:01.861132+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:02:44.796086+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":319,"num_read_kb":311,"num_write":309,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.274808+0000","last_change":"2024-04-03T05:14:40.274859+0000","last_active":"2024-04-03T05:14:40.274808+0000","last_peered":"2024-04-03T05:14:40.274808+0000","last_clean":"2024-04-03T05:14:40.274808+0000","last_became_active":"2024-04-03T03:38:32.735151+0000","last_became_peered":"2024-04-03T03:38:32.735151+0000","last_unstale":"2024-04-03T05:14:40.274808+0000","last_undegraded":"2024-04-03T05:14:40.274808+0000","last_fullsized":"2024-04-03T05:14:40.274808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:40.274606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:40.274606+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.274606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:10:22.499028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'196","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.153641+0000","last_change":"2024-04-03T05:14:32.153712+0000","last_active":"2024-04-03T05:14:32.153641+0000","last_peered":"2024-04-03T05:14:32.153641+0000","last_clean":"2024-04-03T05:14:32.153641+0000","last_became_active":"2024-04-03T03:38:34.731776+0000","last_became_peered":"2024-04-03T03:38:34.731776+0000","last_unstale":"2024-04-03T05:14:32.153641+0000","last_undegraded":"2024-04-03T05:14:32.153641+0000","last_fullsized":"2024-04-03T05:14:32.153641+0000","mapping_epoch":33,"log_start":"252'100","ondisk_log_start":"252'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-04-03T05:14:32.153424+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-04-03T05:14:32.153424+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.153424+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:04:00.407236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":349,"num_read_kb":358,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'385","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.627383+0000","last_change":"2024-04-03T05:14:32.627453+0000","last_active":"2024-04-03T05:14:32.627383+0000","last_peered":"2024-04-03T05:14:32.627383+0000","last_clean":"2024-04-03T05:14:32.627383+0000","last_became_active":"2024-04-03T03:38:26.727581+0000","last_became_peered":"2024-04-03T03:38:26.727581+0000","last_unstale":"2024-04-03T05:14:32.627383+0000","last_undegraded":"2024-04-03T05:14:32.627383+0000","last_fullsized":"2024-04-03T05:14:32.627383+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-04-03T05:14:32.627188+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-04-03T05:14:32.627188+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.627188+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:06:17.186544+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2147,"num_read_kb":2031,"num_write":458,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":635,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":547,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.332314+0000","last_change":"2024-04-03T05:14:53.332431+0000","last_active":"2024-04-03T05:14:53.332314+0000","last_peered":"2024-04-03T05:14:53.332314+0000","last_clean":"2024-04-03T05:14:53.332314+0000","last_became_active":"2024-04-03T03:38:11.613973+0000","last_became_peered":"2024-04-03T03:38:11.613973+0000","last_unstale":"2024-04-03T05:14:53.332314+0000","last_undegraded":"2024-04-03T05:14:53.332314+0000","last_fullsized":"2024-04-03T05:14:53.332314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:53.332067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:53.332067+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.332067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:16:12.388040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'335","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.514369+0000","last_change":"2024-04-03T05:14:28.514369+0000","last_active":"2024-04-03T05:14:28.514369+0000","last_peered":"2024-04-03T05:14:28.514369+0000","last_clean":"2024-04-03T05:14:28.514369+0000","last_became_active":"2024-04-03T03:38:58.349561+0000","last_became_peered":"2024-04-03T03:38:58.349561+0000","last_unstale":"2024-04-03T05:14:28.514369+0000","last_undegraded":"2024-04-03T05:14:28.514369+0000","last_fullsized":"2024-04-03T05:14:28.514369+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-04-03T05:14:28.514073+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-04-03T05:14:28.514073+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.514073+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:56:01.820268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":496,"num_read_kb":36392,"num_write":1067,"num_write_kb":30181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.195446+0000","last_change":"2024-04-03T05:14:43.195446+0000","last_active":"2024-04-03T05:14:43.195446+0000","last_peered":"2024-04-03T05:14:43.195446+0000","last_clean":"2024-04-03T05:14:43.195446+0000","last_became_active":"2024-04-03T03:38:28.711551+0000","last_became_peered":"2024-04-03T03:38:28.711551+0000","last_unstale":"2024-04-03T05:14:43.195446+0000","last_undegraded":"2024-04-03T05:14:43.195446+0000","last_fullsized":"2024-04-03T05:14:43.195446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:43.195182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:43.195182+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.195182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:23:25.576316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'189","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:57.196487+0000","last_change":"2024-04-03T05:14:57.196594+0000","last_active":"2024-04-03T05:14:57.196487+0000","last_peered":"2024-04-03T05:14:57.196487+0000","last_clean":"2024-04-03T05:14:57.196487+0000","last_became_active":"2024-04-03T03:38:30.717437+0000","last_became_peered":"2024-04-03T03:38:30.717437+0000","last_unstale":"2024-04-03T05:14:57.196487+0000","last_undegraded":"2024-04-03T05:14:57.196487+0000","last_fullsized":"2024-04-03T05:14:57.196487+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-04-03T05:14:57.196273+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-04-03T05:14:57.196273+0000","last_clean_scrub_stamp":"2024-04-03T05:14:57.196273+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:12:02.436051+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":238,"num_read_kb":232,"num_write":176,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.289928+0000","last_change":"2024-04-03T05:14:26.289985+0000","last_active":"2024-04-03T05:14:26.289928+0000","last_peered":"2024-04-03T05:14:26.289928+0000","last_clean":"2024-04-03T05:14:26.289928+0000","last_became_active":"2024-04-03T03:38:32.739201+0000","last_became_peered":"2024-04-03T03:38:32.739201+0000","last_unstale":"2024-04-03T05:14:26.289928+0000","last_undegraded":"2024-04-03T05:14:26.289928+0000","last_fullsized":"2024-04-03T05:14:26.289928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:26.289723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:26.289723+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.289723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:39:59.552127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'111","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.265127+0000","last_change":"2024-04-03T05:14:26.265199+0000","last_active":"2024-04-03T05:14:26.265127+0000","last_peered":"2024-04-03T05:14:26.265127+0000","last_clean":"2024-04-03T05:14:26.265127+0000","last_became_active":"2024-04-03T03:38:34.749642+0000","last_became_peered":"2024-04-03T03:38:34.749642+0000","last_unstale":"2024-04-03T05:14:26.265127+0000","last_undegraded":"2024-04-03T05:14:26.265127+0000","last_fullsized":"2024-04-03T05:14:26.265127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-04-03T05:14:26.264937+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-04-03T05:14:26.264937+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.264937+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:55:51.281140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":197,"num_write":285,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'483","reported_seq":2140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.543646+0000","last_change":"2024-04-03T05:14:38.543709+0000","last_active":"2024-04-03T05:14:38.543646+0000","last_peered":"2024-04-03T05:14:38.543646+0000","last_clean":"2024-04-03T05:14:38.543646+0000","last_became_active":"2024-04-03T03:38:26.720476+0000","last_became_peered":"2024-04-03T03:38:26.720476+0000","last_unstale":"2024-04-03T05:14:38.543646+0000","last_undegraded":"2024-04-03T05:14:38.543646+0000","last_fullsized":"2024-04-03T05:14:38.543646+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'483","last_scrub_stamp":"2024-04-03T05:14:38.543456+0000","last_deep_scrub":"263'483","last_deep_scrub_stamp":"2024-04-03T05:14:38.543456+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.543456+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:23:12.739628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2351,"num_write":586,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'318","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:50.327400+0000","last_change":"2024-04-03T05:14:50.327487+0000","last_active":"2024-04-03T05:14:50.327400+0000","last_peered":"2024-04-03T05:14:50.327400+0000","last_clean":"2024-04-03T05:14:50.327400+0000","last_became_active":"2024-04-03T03:38:24.748412+0000","last_became_peered":"2024-04-03T03:38:24.748412+0000","last_unstale":"2024-04-03T05:14:50.327400+0000","last_undegraded":"2024-04-03T05:14:50.327400+0000","last_fullsized":"2024-04-03T05:14:50.327400+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-04-03T05:14:50.327210+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-04-03T05:14:50.327210+0000","last_clean_scrub_stamp":"2024-04-03T05:14:50.327210+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:01:59.641695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400935,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":679,"num_read_kb":11584,"num_write":1159,"num_write_kb":16660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":549,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.501996+0000","last_change":"2024-04-03T05:14:45.502051+0000","last_active":"2024-04-03T05:14:45.501996+0000","last_peered":"2024-04-03T05:14:45.501996+0000","last_clean":"2024-04-03T05:14:45.501996+0000","last_became_active":"2024-04-03T03:38:11.609995+0000","last_became_peered":"2024-04-03T03:38:11.609995+0000","last_unstale":"2024-04-03T05:14:45.501996+0000","last_undegraded":"2024-04-03T05:14:45.501996+0000","last_fullsized":"2024-04-03T05:14:45.501996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:45.501801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:45.501801+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.501801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:54:46.328534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"263'4","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.240975+0000","last_change":"2024-04-03T05:14:47.241169+0000","last_active":"2024-04-03T05:14:47.240975+0000","last_peered":"2024-04-03T05:14:47.240975+0000","last_clean":"2024-04-03T05:14:47.240975+0000","last_became_active":"2024-04-03T03:38:28.716761+0000","last_became_peered":"2024-04-03T03:38:28.716761+0000","last_unstale":"2024-04-03T05:14:47.240975+0000","last_undegraded":"2024-04-03T05:14:47.240975+0000","last_fullsized":"2024-04-03T05:14:47.240975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-04-03T05:14:47.240751+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-04-03T05:14:47.240751+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.240751+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:20:21.061216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":484,"num_read_kb":482,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'628","reported_seq":1369,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:55.252046+0000","last_change":"2024-04-03T05:14:55.252046+0000","last_active":"2024-04-03T05:14:55.252046+0000","last_peered":"2024-04-03T05:14:55.252046+0000","last_clean":"2024-04-03T05:14:55.252046+0000","last_became_active":"2024-04-03T03:38:30.731186+0000","last_became_peered":"2024-04-03T03:38:30.731186+0000","last_unstale":"2024-04-03T05:14:55.252046+0000","last_undegraded":"2024-04-03T05:14:55.252046+0000","last_fullsized":"2024-04-03T05:14:55.252046+0000","mapping_epoch":29,"log_start":"263'600","ondisk_log_start":"263'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'628","last_scrub_stamp":"2024-04-03T05:14:55.251734+0000","last_deep_scrub":"263'628","last_deep_scrub_stamp":"2024-04-03T05:14:55.251734+0000","last_clean_scrub_stamp":"2024-04-03T05:14:55.251734+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:02:44.397018+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105089,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1067,"num_read_kb":2412,"num_write":850,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.705076+0000","last_change":"2024-04-03T05:14:29.705128+0000","last_active":"2024-04-03T05:14:29.705076+0000","last_peered":"2024-04-03T05:14:29.705076+0000","last_clean":"2024-04-03T05:14:29.705076+0000","last_became_active":"2024-04-03T03:38:32.725549+0000","last_became_peered":"2024-04-03T03:38:32.725549+0000","last_unstale":"2024-04-03T05:14:29.705076+0000","last_undegraded":"2024-04-03T05:14:29.705076+0000","last_fullsized":"2024-04-03T05:14:29.705076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:29.704889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:29.704889+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.704889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:18:48.023074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'104","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.211493+0000","last_change":"2024-04-03T05:14:24.211555+0000","last_active":"2024-04-03T05:14:24.211493+0000","last_peered":"2024-04-03T05:14:24.211493+0000","last_clean":"2024-04-03T05:14:24.211493+0000","last_became_active":"2024-04-03T03:38:34.939419+0000","last_became_peered":"2024-04-03T03:38:34.939419+0000","last_unstale":"2024-04-03T05:14:24.211493+0000","last_undegraded":"2024-04-03T05:14:24.211493+0000","last_fullsized":"2024-04-03T05:14:24.211493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-04-03T05:14:24.211297+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-04-03T05:14:24.211297+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.211297+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:21:35.674236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":118,"num_write":243,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'845","reported_seq":2359,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.280826+0000","last_change":"2024-04-03T05:14:41.280894+0000","last_active":"2024-04-03T05:14:41.280826+0000","last_peered":"2024-04-03T05:14:41.280826+0000","last_clean":"2024-04-03T05:14:41.280826+0000","last_became_active":"2024-04-03T03:38:26.731406+0000","last_became_peered":"2024-04-03T03:38:26.731406+0000","last_unstale":"2024-04-03T05:14:41.280826+0000","last_undegraded":"2024-04-03T05:14:41.280826+0000","last_fullsized":"2024-04-03T05:14:41.280826+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'845","last_scrub_stamp":"2024-04-03T05:14:41.280656+0000","last_deep_scrub":"263'845","last_deep_scrub_stamp":"2024-04-03T05:14:41.280656+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.280656+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:26:59.185989+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3757,"num_read_kb":3345,"num_write":1171,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":623,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'312","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.562642+0000","last_change":"2024-04-03T05:14:49.562853+0000","last_active":"2024-04-03T05:14:49.562642+0000","last_peered":"2024-04-03T05:14:49.562642+0000","last_clean":"2024-04-03T05:14:49.562642+0000","last_became_active":"2024-04-03T03:38:24.721685+0000","last_became_peered":"2024-04-03T03:38:24.721685+0000","last_unstale":"2024-04-03T05:14:49.562642+0000","last_undegraded":"2024-04-03T05:14:49.562642+0000","last_fullsized":"2024-04-03T05:14:49.562642+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-04-03T05:14:49.562415+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-04-03T05:14:49.562415+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.562415+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:42:30.758765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266323,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":425,"num_read_kb":12382,"num_write":1218,"num_write_kb":30338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.858183+0000","last_change":"2024-04-03T05:14:54.858238+0000","last_active":"2024-04-03T05:14:54.858183+0000","last_peered":"2024-04-03T05:14:54.858183+0000","last_clean":"2024-04-03T05:14:54.858183+0000","last_became_active":"2024-04-03T03:38:11.617057+0000","last_became_peered":"2024-04-03T03:38:11.617057+0000","last_unstale":"2024-04-03T05:14:54.858183+0000","last_undegraded":"2024-04-03T05:14:54.858183+0000","last_fullsized":"2024-04-03T05:14:54.858183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:54.857974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:54.857974+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.857974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:54:06.899675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.323855+0000","last_change":"2024-04-03T05:14:33.323915+0000","last_active":"2024-04-03T05:14:33.323855+0000","last_peered":"2024-04-03T05:14:33.323855+0000","last_clean":"2024-04-03T05:14:33.323855+0000","last_became_active":"2024-04-03T03:38:28.719394+0000","last_became_peered":"2024-04-03T03:38:28.719394+0000","last_unstale":"2024-04-03T05:14:33.323855+0000","last_undegraded":"2024-04-03T05:14:33.323855+0000","last_fullsized":"2024-04-03T05:14:33.323855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.323658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.323658+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.323658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:48:26.127102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'316","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.600163+0000","last_change":"2024-04-03T05:14:41.600245+0000","last_active":"2024-04-03T05:14:41.600163+0000","last_peered":"2024-04-03T05:14:41.600163+0000","last_clean":"2024-04-03T05:14:41.600163+0000","last_became_active":"2024-04-03T03:38:30.821297+0000","last_became_peered":"2024-04-03T03:38:30.821297+0000","last_unstale":"2024-04-03T05:14:41.600163+0000","last_undegraded":"2024-04-03T05:14:41.600163+0000","last_fullsized":"2024-04-03T05:14:41.600163+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-04-03T05:14:41.599966+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-04-03T05:14:41.599966+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.599966+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:20:40.235969+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":386,"num_write":374,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5650,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'555","reported_seq":2694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.254021+0000","last_change":"2024-04-03T05:14:29.254021+0000","last_active":"2024-04-03T05:14:29.254021+0000","last_peered":"2024-04-03T05:14:29.254021+0000","last_clean":"2024-04-03T05:14:29.254021+0000","last_became_active":"2024-04-03T03:38:32.747292+0000","last_became_peered":"2024-04-03T03:38:32.747292+0000","last_unstale":"2024-04-03T05:14:29.254021+0000","last_undegraded":"2024-04-03T05:14:29.254021+0000","last_fullsized":"2024-04-03T05:14:29.254021+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'555","last_scrub_stamp":"2024-04-03T05:14:29.253768+0000","last_deep_scrub":"263'555","last_deep_scrub_stamp":"2024-04-03T05:14:29.253768+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.253768+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:40:53.784055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'92","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.151466+0000","last_change":"2024-04-03T05:14:28.151634+0000","last_active":"2024-04-03T05:14:28.151466+0000","last_peered":"2024-04-03T05:14:28.151466+0000","last_clean":"2024-04-03T05:14:28.151466+0000","last_became_active":"2024-04-03T03:38:34.935593+0000","last_became_peered":"2024-04-03T03:38:34.935593+0000","last_unstale":"2024-04-03T05:14:28.151466+0000","last_undegraded":"2024-04-03T05:14:28.151466+0000","last_fullsized":"2024-04-03T05:14:28.151466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'92","last_scrub_stamp":"2024-04-03T05:14:28.151248+0000","last_deep_scrub":"263'92","last_deep_scrub_stamp":"2024-04-03T05:14:28.151248+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.151248+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:44.377270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":828,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":224,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'421","reported_seq":1899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.233120+0000","last_change":"2024-04-03T05:14:52.233247+0000","last_active":"2024-04-03T05:14:52.233120+0000","last_peered":"2024-04-03T05:14:52.233120+0000","last_clean":"2024-04-03T05:14:52.233120+0000","last_became_active":"2024-04-03T03:38:26.716004+0000","last_became_peered":"2024-04-03T03:38:26.716004+0000","last_unstale":"2024-04-03T05:14:52.233120+0000","last_undegraded":"2024-04-03T05:14:52.233120+0000","last_fullsized":"2024-04-03T05:14:52.233120+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'421","last_scrub_stamp":"2024-04-03T05:14:52.232895+0000","last_deep_scrub":"263'421","last_deep_scrub_stamp":"2024-04-03T05:14:52.232895+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.232895+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:11:29.994818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2330,"num_read_kb":2164,"num_write":539,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'334","reported_seq":1015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:07.285239+0000","last_change":"2024-04-03T05:15:07.285326+0000","last_active":"2024-04-03T05:15:07.285239+0000","last_peered":"2024-04-03T05:15:07.285239+0000","last_clean":"2024-04-03T05:15:07.285239+0000","last_became_active":"2024-04-03T03:38:24.727736+0000","last_became_peered":"2024-04-03T03:38:24.727736+0000","last_unstale":"2024-04-03T05:15:07.285239+0000","last_undegraded":"2024-04-03T05:15:07.285239+0000","last_fullsized":"2024-04-03T05:15:07.285239+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-04-03T05:15:07.285047+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-04-03T05:15:07.285047+0000","last_clean_scrub_stamp":"2024-04-03T05:15:07.285047+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:17:59.029284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262228,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":37309,"num_write":1217,"num_write_kb":23236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":547,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.539124+0000","last_change":"2024-04-03T05:14:46.539176+0000","last_active":"2024-04-03T05:14:46.539124+0000","last_peered":"2024-04-03T05:14:46.539124+0000","last_clean":"2024-04-03T05:14:46.539124+0000","last_became_active":"2024-04-03T03:38:11.613252+0000","last_became_peered":"2024-04-03T03:38:11.613252+0000","last_unstale":"2024-04-03T05:14:46.539124+0000","last_undegraded":"2024-04-03T05:14:46.539124+0000","last_fullsized":"2024-04-03T05:14:46.539124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:46.538925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:46.538925+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.538925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:12:57.842788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.694419+0000","last_change":"2024-04-03T05:14:40.694477+0000","last_active":"2024-04-03T05:14:40.694419+0000","last_peered":"2024-04-03T05:14:40.694419+0000","last_clean":"2024-04-03T05:14:40.694419+0000","last_became_active":"2024-04-03T03:38:28.721796+0000","last_became_peered":"2024-04-03T03:38:28.721796+0000","last_unstale":"2024-04-03T05:14:40.694419+0000","last_undegraded":"2024-04-03T05:14:40.694419+0000","last_fullsized":"2024-04-03T05:14:40.694419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:40.694210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:40.694210+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.694210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:55:14.210078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'172","reported_seq":771,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.783442+0000","last_change":"2024-04-03T05:14:33.783527+0000","last_active":"2024-04-03T05:14:33.783442+0000","last_peered":"2024-04-03T05:14:33.783442+0000","last_clean":"2024-04-03T05:14:33.783442+0000","last_became_active":"2024-04-03T03:38:30.718913+0000","last_became_peered":"2024-04-03T03:38:30.718913+0000","last_unstale":"2024-04-03T05:14:33.783442+0000","last_undegraded":"2024-04-03T05:14:33.783442+0000","last_fullsized":"2024-04-03T05:14:33.783442+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-04-03T05:14:33.783242+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-04-03T05:14:33.783242+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.783242+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:27:44.505546+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":144,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'554","reported_seq":2680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.169371+0000","last_change":"2024-04-03T05:14:34.169432+0000","last_active":"2024-04-03T05:14:34.169371+0000","last_peered":"2024-04-03T05:14:34.169371+0000","last_clean":"2024-04-03T05:14:34.169371+0000","last_became_active":"2024-04-03T03:38:32.743829+0000","last_became_peered":"2024-04-03T03:38:32.743829+0000","last_unstale":"2024-04-03T05:14:34.169371+0000","last_undegraded":"2024-04-03T05:14:34.169371+0000","last_fullsized":"2024-04-03T05:14:34.169371+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'554","last_scrub_stamp":"2024-04-03T05:14:34.169176+0000","last_deep_scrub":"263'554","last_deep_scrub_stamp":"2024-04-03T05:14:34.169176+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.169176+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:03:02.748798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'94","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.265589+0000","last_change":"2024-04-03T05:14:26.265677+0000","last_active":"2024-04-03T05:14:26.265589+0000","last_peered":"2024-04-03T05:14:26.265589+0000","last_clean":"2024-04-03T05:14:26.265589+0000","last_became_active":"2024-04-03T03:38:34.746249+0000","last_became_peered":"2024-04-03T03:38:34.746249+0000","last_unstale":"2024-04-03T05:14:26.265589+0000","last_undegraded":"2024-04-03T05:14:26.265589+0000","last_fullsized":"2024-04-03T05:14:26.265589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'94","last_scrub_stamp":"2024-04-03T05:14:26.265394+0000","last_deep_scrub":"263'94","last_deep_scrub_stamp":"2024-04-03T05:14:26.265394+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.265394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:25:51.955446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":217,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1106","reported_seq":2698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:57.688241+0000","last_change":"2024-04-03T05:14:57.688307+0000","last_active":"2024-04-03T05:14:57.688241+0000","last_peered":"2024-04-03T05:14:57.688241+0000","last_clean":"2024-04-03T05:14:57.688241+0000","last_became_active":"2024-04-03T03:38:26.741272+0000","last_became_peered":"2024-04-03T03:38:26.741272+0000","last_unstale":"2024-04-03T05:14:57.688241+0000","last_undegraded":"2024-04-03T05:14:57.688241+0000","last_fullsized":"2024-04-03T05:14:57.688241+0000","mapping_epoch":25,"log_start":"263'1000","ondisk_log_start":"263'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1106","last_scrub_stamp":"2024-04-03T05:14:57.688048+0000","last_deep_scrub":"263'1106","last_deep_scrub_stamp":"2024-04-03T05:14:57.688048+0000","last_clean_scrub_stamp":"2024-04-03T05:14:57.688048+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":1000,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:16:15.828277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4771,"num_read_kb":4189,"num_write":1521,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'320","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:04.208750+0000","last_change":"2024-04-03T05:15:04.208945+0000","last_active":"2024-04-03T05:15:04.208750+0000","last_peered":"2024-04-03T05:15:04.208750+0000","last_clean":"2024-04-03T05:15:04.208750+0000","last_became_active":"2024-04-03T03:38:24.747145+0000","last_became_peered":"2024-04-03T03:38:24.747145+0000","last_unstale":"2024-04-03T05:15:04.208750+0000","last_undegraded":"2024-04-03T05:15:04.208750+0000","last_fullsized":"2024-04-03T05:15:04.208750+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-04-03T05:15:04.208487+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-04-03T05:15:04.208487+0000","last_clean_scrub_stamp":"2024-04-03T05:15:04.208487+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:18:32.440744+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3601918,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":38174,"num_write":1065,"num_write_kb":41152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.154809+0000","last_change":"2024-04-03T05:14:40.154865+0000","last_active":"2024-04-03T05:14:40.154809+0000","last_peered":"2024-04-03T05:14:40.154809+0000","last_clean":"2024-04-03T05:14:40.154809+0000","last_became_active":"2024-04-03T03:38:11.617573+0000","last_became_peered":"2024-04-03T03:38:11.617573+0000","last_unstale":"2024-04-03T05:14:40.154809+0000","last_undegraded":"2024-04-03T05:14:40.154809+0000","last_fullsized":"2024-04-03T05:14:40.154809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:40.154593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:40.154593+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.154593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T17:14:09.469907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:55.212176+0000","last_change":"2024-04-03T05:14:55.212232+0000","last_active":"2024-04-03T05:14:55.212176+0000","last_peered":"2024-04-03T05:14:55.212176+0000","last_clean":"2024-04-03T05:14:55.212176+0000","last_became_active":"2024-04-03T03:38:28.733237+0000","last_became_peered":"2024-04-03T03:38:28.733237+0000","last_unstale":"2024-04-03T05:14:55.212176+0000","last_undegraded":"2024-04-03T05:14:55.212176+0000","last_fullsized":"2024-04-03T05:14:55.212176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:55.211965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:55.211965+0000","last_clean_scrub_stamp":"2024-04-03T05:14:55.211965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:50:19.677511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'805","reported_seq":1587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.872778+0000","last_change":"2024-04-03T05:14:51.872871+0000","last_active":"2024-04-03T05:14:51.872778+0000","last_peered":"2024-04-03T05:14:51.872778+0000","last_clean":"2024-04-03T05:14:51.872778+0000","last_became_active":"2024-04-03T03:38:30.822610+0000","last_became_peered":"2024-04-03T03:38:30.822610+0000","last_unstale":"2024-04-03T05:14:51.872778+0000","last_undegraded":"2024-04-03T05:14:51.872778+0000","last_fullsized":"2024-04-03T05:14:51.872778+0000","mapping_epoch":29,"log_start":"263'700","ondisk_log_start":"263'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-04-03T05:14:51.872585+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-04-03T05:14:51.872585+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.872585+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:42:57.316323+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1404,"num_read_kb":3337,"num_write":1132,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.180217+0000","last_change":"2024-04-03T05:14:38.180253+0000","last_active":"2024-04-03T05:14:38.180217+0000","last_peered":"2024-04-03T05:14:38.180217+0000","last_clean":"2024-04-03T05:14:38.180217+0000","last_became_active":"2024-04-03T03:38:32.728874+0000","last_became_peered":"2024-04-03T03:38:32.728874+0000","last_unstale":"2024-04-03T05:14:38.180217+0000","last_undegraded":"2024-04-03T05:14:38.180217+0000","last_fullsized":"2024-04-03T05:14:38.180217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:38.180096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:38.180096+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.180096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:47:46.583547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'106","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.338215+0000","last_change":"2024-04-03T05:14:24.338375+0000","last_active":"2024-04-03T05:14:24.338215+0000","last_peered":"2024-04-03T05:14:24.338215+0000","last_clean":"2024-04-03T05:14:24.338215+0000","last_became_active":"2024-04-03T03:38:34.756936+0000","last_became_peered":"2024-04-03T03:38:34.756936+0000","last_unstale":"2024-04-03T05:14:24.338215+0000","last_undegraded":"2024-04-03T05:14:24.338215+0000","last_fullsized":"2024-04-03T05:14:24.338215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-04-03T05:14:24.338001+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-04-03T05:14:24.338001+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.338001+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:46:06.133728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":248,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'144","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.233348+0000","last_change":"2024-04-03T05:14:25.233348+0000","last_active":"2024-04-03T05:14:25.233348+0000","last_peered":"2024-04-03T05:14:25.233348+0000","last_clean":"2024-04-03T05:14:25.233348+0000","last_became_active":"2024-04-03T03:38:34.759767+0000","last_became_peered":"2024-04-03T03:38:34.759767+0000","last_unstale":"2024-04-03T05:14:25.233348+0000","last_undegraded":"2024-04-03T05:14:25.233348+0000","last_fullsized":"2024-04-03T05:14:25.233348+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-04-03T05:14:25.233092+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-04-03T05:14:25.233092+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.233092+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:33:41.732896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":108,"num_write":250,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'829","reported_seq":2414,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:56.707410+0000","last_change":"2024-04-03T05:14:56.707481+0000","last_active":"2024-04-03T05:14:56.707410+0000","last_peered":"2024-04-03T05:14:56.707410+0000","last_clean":"2024-04-03T05:14:56.707410+0000","last_became_active":"2024-04-03T03:38:26.740732+0000","last_became_peered":"2024-04-03T03:38:26.740732+0000","last_unstale":"2024-04-03T05:14:56.707410+0000","last_undegraded":"2024-04-03T05:14:56.707410+0000","last_fullsized":"2024-04-03T05:14:56.707410+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'829","last_scrub_stamp":"2024-04-03T05:14:56.707220+0000","last_deep_scrub":"263'829","last_deep_scrub_stamp":"2024-04-03T05:14:56.707220+0000","last_clean_scrub_stamp":"2024-04-03T05:14:56.707220+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:57:23.806852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3680,"num_read_kb":3271,"num_write":1116,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'362","reported_seq":1139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.620319+0000","last_change":"2024-04-03T05:14:51.620422+0000","last_active":"2024-04-03T05:14:51.620319+0000","last_peered":"2024-04-03T05:14:51.620319+0000","last_clean":"2024-04-03T05:14:51.620319+0000","last_became_active":"2024-04-03T03:38:24.740900+0000","last_became_peered":"2024-04-03T03:38:24.740900+0000","last_unstale":"2024-04-03T05:14:51.620319+0000","last_undegraded":"2024-04-03T05:14:51.620319+0000","last_fullsized":"2024-04-03T05:14:51.620319+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-04-03T05:14:51.620123+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-04-03T05:14:51.620123+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.620123+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:01:58.064198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100573,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":621,"num_read_kb":65764,"num_write":1260,"num_write_kb":26843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.609710+0000","last_change":"2024-04-03T05:14:33.609771+0000","last_active":"2024-04-03T05:14:33.609710+0000","last_peered":"2024-04-03T05:14:33.609710+0000","last_clean":"2024-04-03T05:14:33.609710+0000","last_became_active":"2024-04-03T03:38:28.725020+0000","last_became_peered":"2024-04-03T03:38:28.725020+0000","last_unstale":"2024-04-03T05:14:33.609710+0000","last_undegraded":"2024-04-03T05:14:33.609710+0000","last_fullsized":"2024-04-03T05:14:33.609710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.609472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.609472+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.609472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:45:03.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'315","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.226128+0000","last_change":"2024-04-03T05:14:44.226324+0000","last_active":"2024-04-03T05:14:44.226128+0000","last_peered":"2024-04-03T05:14:44.226128+0000","last_clean":"2024-04-03T05:14:44.226128+0000","last_became_active":"2024-04-03T03:38:30.729608+0000","last_became_peered":"2024-04-03T03:38:30.729608+0000","last_unstale":"2024-04-03T05:14:44.226128+0000","last_undegraded":"2024-04-03T05:14:44.226128+0000","last_fullsized":"2024-04-03T05:14:44.226128+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-04-03T05:14:44.225905+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-04-03T05:14:44.225905+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.225905+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:41:42.032295+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":1071,"num_write":390,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.147656+0000","last_change":"2024-04-03T05:14:33.147720+0000","last_active":"2024-04-03T05:14:33.147656+0000","last_peered":"2024-04-03T05:14:33.147656+0000","last_clean":"2024-04-03T05:14:33.147656+0000","last_became_active":"2024-04-03T03:38:32.744256+0000","last_became_peered":"2024-04-03T03:38:32.744256+0000","last_unstale":"2024-04-03T05:14:33.147656+0000","last_undegraded":"2024-04-03T05:14:33.147656+0000","last_fullsized":"2024-04-03T05:14:33.147656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.147448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.147448+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.147448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:25:04.586669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'108","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.156559+0000","last_change":"2024-04-03T05:14:30.156559+0000","last_active":"2024-04-03T05:14:30.156559+0000","last_peered":"2024-04-03T05:14:30.156559+0000","last_clean":"2024-04-03T05:14:30.156559+0000","last_became_active":"2024-04-03T03:38:34.736176+0000","last_became_peered":"2024-04-03T03:38:34.736176+0000","last_unstale":"2024-04-03T05:14:30.156559+0000","last_undegraded":"2024-04-03T05:14:30.156559+0000","last_fullsized":"2024-04-03T05:14:30.156559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-04-03T05:14:30.156298+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-04-03T05:14:30.156298+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.156298+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:22:54.335172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":259,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'761","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.547731+0000","last_change":"2024-04-03T05:14:40.547802+0000","last_active":"2024-04-03T05:14:40.547731+0000","last_peered":"2024-04-03T05:14:40.547731+0000","last_clean":"2024-04-03T05:14:40.547731+0000","last_became_active":"2024-04-03T03:38:26.720106+0000","last_became_peered":"2024-04-03T03:38:26.720106+0000","last_unstale":"2024-04-03T05:14:40.547731+0000","last_undegraded":"2024-04-03T05:14:40.547731+0000","last_fullsized":"2024-04-03T05:14:40.547731+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-04-03T05:14:40.547541+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-04-03T05:14:40.547541+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.547541+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:15:41.406155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3508,"num_write":1155,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2379,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'344","reported_seq":1066,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.838372+0000","last_change":"2024-04-03T05:14:25.838372+0000","last_active":"2024-04-03T05:14:25.838372+0000","last_peered":"2024-04-03T05:14:25.838372+0000","last_clean":"2024-04-03T05:14:25.838372+0000","last_became_active":"2024-04-03T03:38:57.882607+0000","last_became_peered":"2024-04-03T03:38:57.882607+0000","last_unstale":"2024-04-03T05:14:25.838372+0000","last_undegraded":"2024-04-03T05:14:25.838372+0000","last_fullsized":"2024-04-03T05:14:25.838372+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-04-03T05:14:25.838028+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-04-03T05:14:25.838028+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.838028+0000","objects_scrubbed":9,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:57:21.795448+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5935608,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":618,"num_read_kb":85965,"num_write":1280,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.245501+0000","last_change":"2024-04-03T05:14:49.245554+0000","last_active":"2024-04-03T05:14:49.245501+0000","last_peered":"2024-04-03T05:14:49.245501+0000","last_clean":"2024-04-03T05:14:49.245501+0000","last_became_active":"2024-04-03T03:38:28.723082+0000","last_became_peered":"2024-04-03T03:38:28.723082+0000","last_unstale":"2024-04-03T05:14:49.245501+0000","last_undegraded":"2024-04-03T05:14:49.245501+0000","last_fullsized":"2024-04-03T05:14:49.245501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:49.245312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:49.245312+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.245312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:02:58.629798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'64","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.232164+0000","last_change":"2024-04-03T05:14:51.232243+0000","last_active":"2024-04-03T05:14:51.232164+0000","last_peered":"2024-04-03T05:14:51.232164+0000","last_clean":"2024-04-03T05:14:51.232164+0000","last_became_active":"2024-04-03T03:38:30.729412+0000","last_became_peered":"2024-04-03T03:38:30.729412+0000","last_unstale":"2024-04-03T05:14:51.232164+0000","last_undegraded":"2024-04-03T05:14:51.232164+0000","last_fullsized":"2024-04-03T05:14:51.232164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-04-03T05:14:51.231966+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-04-03T05:14:51.231966+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.231966+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:26:41.484570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":62,"num_read_kb":60,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:33.816863+0000","last_change":"2024-04-03T05:14:33.816917+0000","last_active":"2024-04-03T05:14:33.816863+0000","last_peered":"2024-04-03T05:14:33.816863+0000","last_clean":"2024-04-03T05:14:33.816863+0000","last_became_active":"2024-04-03T03:38:32.747294+0000","last_became_peered":"2024-04-03T03:38:32.747294+0000","last_unstale":"2024-04-03T05:14:33.816863+0000","last_undegraded":"2024-04-03T05:14:33.816863+0000","last_fullsized":"2024-04-03T05:14:33.816863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:33.816656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:33.816656+0000","last_clean_scrub_stamp":"2024-04-03T05:14:33.816656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:32:17.430996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'98","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.270883+0000","last_change":"2024-04-03T05:14:30.270951+0000","last_active":"2024-04-03T05:14:30.270883+0000","last_peered":"2024-04-03T05:14:30.270883+0000","last_clean":"2024-04-03T05:14:30.270883+0000","last_became_active":"2024-04-03T03:38:34.737841+0000","last_became_peered":"2024-04-03T03:38:34.737841+0000","last_unstale":"2024-04-03T05:14:30.270883+0000","last_undegraded":"2024-04-03T05:14:30.270883+0000","last_fullsized":"2024-04-03T05:14:30.270883+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'98","last_scrub_stamp":"2024-04-03T05:14:30.270694+0000","last_deep_scrub":"263'98","last_deep_scrub_stamp":"2024-04-03T05:14:30.270694+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.270694+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:32:59.118448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":225,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'411","reported_seq":1874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:48.295304+0000","last_change":"2024-04-03T05:14:48.295437+0000","last_active":"2024-04-03T05:14:48.295304+0000","last_peered":"2024-04-03T05:14:48.295304+0000","last_clean":"2024-04-03T05:14:48.295304+0000","last_became_active":"2024-04-03T03:38:26.715716+0000","last_became_peered":"2024-04-03T03:38:26.715716+0000","last_unstale":"2024-04-03T05:14:48.295304+0000","last_undegraded":"2024-04-03T05:14:48.295304+0000","last_fullsized":"2024-04-03T05:14:48.295304+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-04-03T05:14:48.295075+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-04-03T05:14:48.295075+0000","last_clean_scrub_stamp":"2024-04-03T05:14:48.295075+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":300,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:06:08.835194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2104,"num_read_kb":1969,"num_write":502,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":556,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'456","reported_seq":1151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:58.304886+0000","last_change":"2024-04-03T05:14:58.304886+0000","last_active":"2024-04-03T05:14:58.304886+0000","last_peered":"2024-04-03T05:14:58.304886+0000","last_clean":"2024-04-03T05:14:58.304886+0000","last_became_active":"2024-04-03T03:38:24.737281+0000","last_became_peered":"2024-04-03T03:38:24.737281+0000","last_unstale":"2024-04-03T05:14:58.304886+0000","last_undegraded":"2024-04-03T05:14:58.304886+0000","last_fullsized":"2024-04-03T05:14:58.304886+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'456","last_scrub_stamp":"2024-04-03T05:14:58.304374+0000","last_deep_scrub":"263'456","last_deep_scrub_stamp":"2024-04-03T05:14:58.304374+0000","last_clean_scrub_stamp":"2024-04-03T05:14:58.304374+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:18:43.625289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448109,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":780,"num_read_kb":29467,"num_write":1404,"num_write_kb":33665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.862657+0000","last_change":"2024-04-03T05:14:39.862722+0000","last_active":"2024-04-03T05:14:39.862657+0000","last_peered":"2024-04-03T05:14:39.862657+0000","last_clean":"2024-04-03T05:14:39.862657+0000","last_became_active":"2024-04-03T03:38:28.735156+0000","last_became_peered":"2024-04-03T03:38:28.735156+0000","last_unstale":"2024-04-03T05:14:39.862657+0000","last_undegraded":"2024-04-03T05:14:39.862657+0000","last_fullsized":"2024-04-03T05:14:39.862657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:39.862425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:39.862425+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.862425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:50:40.422410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'329","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.219704+0000","last_change":"2024-04-03T05:14:42.219797+0000","last_active":"2024-04-03T05:14:42.219704+0000","last_peered":"2024-04-03T05:14:42.219704+0000","last_clean":"2024-04-03T05:14:42.219704+0000","last_became_active":"2024-04-03T03:38:30.733682+0000","last_became_peered":"2024-04-03T03:38:30.733682+0000","last_unstale":"2024-04-03T05:14:42.219704+0000","last_undegraded":"2024-04-03T05:14:42.219704+0000","last_fullsized":"2024-04-03T05:14:42.219704+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-04-03T05:14:42.219507+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-04-03T05:14:42.219507+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.219507+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:46:12.542793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42201,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1138,"num_write":422,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.242447+0000","last_change":"2024-04-03T05:14:27.242501+0000","last_active":"2024-04-03T05:14:27.242447+0000","last_peered":"2024-04-03T05:14:27.242447+0000","last_clean":"2024-04-03T05:14:27.242447+0000","last_became_active":"2024-04-03T03:38:32.733728+0000","last_became_peered":"2024-04-03T03:38:32.733728+0000","last_unstale":"2024-04-03T05:14:27.242447+0000","last_undegraded":"2024-04-03T05:14:27.242447+0000","last_fullsized":"2024-04-03T05:14:27.242447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.242249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.242249+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.242249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:00:08.047349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'154","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.251598+0000","last_change":"2024-04-03T05:14:22.251667+0000","last_active":"2024-04-03T05:14:22.251598+0000","last_peered":"2024-04-03T05:14:22.251598+0000","last_clean":"2024-04-03T05:14:22.251598+0000","last_became_active":"2024-04-03T03:38:34.755929+0000","last_became_peered":"2024-04-03T03:38:34.755929+0000","last_unstale":"2024-04-03T05:14:22.251598+0000","last_undegraded":"2024-04-03T05:14:22.251598+0000","last_fullsized":"2024-04-03T05:14:22.251598+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-04-03T05:14:22.251370+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-04-03T05:14:22.251370+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.251370+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:21:59.675735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":91,"num_write":329,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'736","reported_seq":2119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.257055+0000","last_change":"2024-04-03T05:14:46.257183+0000","last_active":"2024-04-03T05:14:46.257055+0000","last_peered":"2024-04-03T05:14:46.257055+0000","last_clean":"2024-04-03T05:14:46.257055+0000","last_became_active":"2024-04-03T03:38:26.723758+0000","last_became_peered":"2024-04-03T03:38:26.723758+0000","last_unstale":"2024-04-03T05:14:46.257055+0000","last_undegraded":"2024-04-03T05:14:46.257055+0000","last_fullsized":"2024-04-03T05:14:46.257055+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'736","last_scrub_stamp":"2024-04-03T05:14:46.256842+0000","last_deep_scrub":"263'736","last_deep_scrub_stamp":"2024-04-03T05:14:46.256842+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.256842+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:27:36.984427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3210,"num_read_kb":2838,"num_write":998,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'347","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:00.167785+0000","last_change":"2024-04-03T05:15:00.167785+0000","last_active":"2024-04-03T05:15:00.167785+0000","last_peered":"2024-04-03T05:15:00.167785+0000","last_clean":"2024-04-03T05:15:00.167785+0000","last_became_active":"2024-04-03T03:38:24.739968+0000","last_became_peered":"2024-04-03T03:38:24.739968+0000","last_unstale":"2024-04-03T05:15:00.167785+0000","last_undegraded":"2024-04-03T05:15:00.167785+0000","last_fullsized":"2024-04-03T05:15:00.167785+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-04-03T05:15:00.167467+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-04-03T05:15:00.167467+0000","last_clean_scrub_stamp":"2024-04-03T05:15:00.167467+0000","objects_scrubbed":11,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:24:49.491203+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303204,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":602,"num_read_kb":31745,"num_write":1185,"num_write_kb":30139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.274370+0000","last_change":"2024-04-03T05:14:29.274427+0000","last_active":"2024-04-03T05:14:29.274370+0000","last_peered":"2024-04-03T05:14:29.274370+0000","last_clean":"2024-04-03T05:14:29.274370+0000","last_became_active":"2024-04-03T03:38:28.723907+0000","last_became_peered":"2024-04-03T03:38:28.723907+0000","last_unstale":"2024-04-03T05:14:29.274370+0000","last_undegraded":"2024-04-03T05:14:29.274370+0000","last_fullsized":"2024-04-03T05:14:29.274370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:29.274155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:29.274155+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.274155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:58:51.335375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'317","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.823849+0000","last_change":"2024-04-03T05:14:47.823922+0000","last_active":"2024-04-03T05:14:47.823849+0000","last_peered":"2024-04-03T05:14:47.823849+0000","last_clean":"2024-04-03T05:14:47.823849+0000","last_became_active":"2024-04-03T03:38:30.732520+0000","last_became_peered":"2024-04-03T03:38:30.732520+0000","last_unstale":"2024-04-03T05:14:47.823849+0000","last_undegraded":"2024-04-03T05:14:47.823849+0000","last_fullsized":"2024-04-03T05:14:47.823849+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-04-03T05:14:47.823673+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-04-03T05:14:47.823673+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.823673+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:49:58.358283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49780,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":1180,"num_write":410,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:32.189242+0000","last_change":"2024-04-03T05:14:32.189296+0000","last_active":"2024-04-03T05:14:32.189242+0000","last_peered":"2024-04-03T05:14:32.189242+0000","last_clean":"2024-04-03T05:14:32.189242+0000","last_became_active":"2024-04-03T03:38:32.748621+0000","last_became_peered":"2024-04-03T03:38:32.748621+0000","last_unstale":"2024-04-03T05:14:32.189242+0000","last_undegraded":"2024-04-03T05:14:32.189242+0000","last_fullsized":"2024-04-03T05:14:32.189242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:32.189053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:32.189053+0000","last_clean_scrub_stamp":"2024-04-03T05:14:32.189053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:20:39.713325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'377","reported_seq":2051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.136705+0000","last_change":"2024-04-03T05:14:46.136771+0000","last_active":"2024-04-03T05:14:46.136705+0000","last_peered":"2024-04-03T05:14:46.136705+0000","last_clean":"2024-04-03T05:14:46.136705+0000","last_became_active":"2024-04-03T03:38:26.711974+0000","last_became_peered":"2024-04-03T03:38:26.711974+0000","last_unstale":"2024-04-03T05:14:46.136705+0000","last_undegraded":"2024-04-03T05:14:46.136705+0000","last_fullsized":"2024-04-03T05:14:46.136705+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-04-03T05:14:46.136508+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-04-03T05:14:46.136508+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.136508+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:29:26.657175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2308,"num_read_kb":2240,"num_write":411,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'349","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:02.222632+0000","last_change":"2024-04-03T05:15:02.222632+0000","last_active":"2024-04-03T05:15:02.222632+0000","last_peered":"2024-04-03T05:15:02.222632+0000","last_clean":"2024-04-03T05:15:02.222632+0000","last_became_active":"2024-04-03T03:38:24.715050+0000","last_became_peered":"2024-04-03T03:38:24.715050+0000","last_unstale":"2024-04-03T05:15:02.222632+0000","last_undegraded":"2024-04-03T05:15:02.222632+0000","last_fullsized":"2024-04-03T05:15:02.222632+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-04-03T05:15:02.222266+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-04-03T05:15:02.222266+0000","last_clean_scrub_stamp":"2024-04-03T05:15:02.222266+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:52:17.161536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6617705,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":464,"num_read_kb":21769,"num_write":1174,"num_write_kb":53575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.212568+0000","last_change":"2024-04-03T05:14:45.212568+0000","last_active":"2024-04-03T05:14:45.212568+0000","last_peered":"2024-04-03T05:14:45.212568+0000","last_clean":"2024-04-03T05:14:45.212568+0000","last_became_active":"2024-04-03T03:38:28.716638+0000","last_became_peered":"2024-04-03T03:38:28.716638+0000","last_unstale":"2024-04-03T05:14:45.212568+0000","last_undegraded":"2024-04-03T05:14:45.212568+0000","last_fullsized":"2024-04-03T05:14:45.212568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:45.212324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:45.212324+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.212324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:22:12.859807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'514","reported_seq":1193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.511174+0000","last_change":"2024-04-03T05:14:39.511246+0000","last_active":"2024-04-03T05:14:39.511174+0000","last_peered":"2024-04-03T05:14:39.511174+0000","last_clean":"2024-04-03T05:14:39.511174+0000","last_became_active":"2024-04-03T03:38:30.725324+0000","last_became_peered":"2024-04-03T03:38:30.725324+0000","last_unstale":"2024-04-03T05:14:39.511174+0000","last_undegraded":"2024-04-03T05:14:39.511174+0000","last_fullsized":"2024-04-03T05:14:39.511174+0000","mapping_epoch":29,"log_start":"263'500","ondisk_log_start":"263'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'514","last_scrub_stamp":"2024-04-03T05:14:39.511001+0000","last_deep_scrub":"263'514","last_deep_scrub_stamp":"2024-04-03T05:14:39.511001+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.511001+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:27:25.632511+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":885,"num_read_kb":2163,"num_write":714,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.270791+0000","last_change":"2024-04-03T05:14:30.270846+0000","last_active":"2024-04-03T05:14:30.270791+0000","last_peered":"2024-04-03T05:14:30.270791+0000","last_clean":"2024-04-03T05:14:30.270791+0000","last_became_active":"2024-04-03T03:38:32.730456+0000","last_became_peered":"2024-04-03T03:38:32.730456+0000","last_unstale":"2024-04-03T05:14:30.270791+0000","last_undegraded":"2024-04-03T05:14:30.270791+0000","last_fullsized":"2024-04-03T05:14:30.270791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:30.270588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:30.270588+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.270588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:28:22.839549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'161","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.147352+0000","last_change":"2024-04-03T05:14:26.147513+0000","last_active":"2024-04-03T05:14:26.147352+0000","last_peered":"2024-04-03T05:14:26.147352+0000","last_clean":"2024-04-03T05:14:26.147352+0000","last_became_active":"2024-04-03T03:38:34.939244+0000","last_became_peered":"2024-04-03T03:38:34.939244+0000","last_unstale":"2024-04-03T05:14:26.147352+0000","last_undegraded":"2024-04-03T05:14:26.147352+0000","last_fullsized":"2024-04-03T05:14:26.147352+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-04-03T05:14:26.147094+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-04-03T05:14:26.147094+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.147094+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:10:50.462110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":235,"num_read_kb":238,"num_write":361,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'566","reported_seq":2136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.229963+0000","last_change":"2024-04-03T05:14:52.229963+0000","last_active":"2024-04-03T05:14:52.229963+0000","last_peered":"2024-04-03T05:14:52.229963+0000","last_clean":"2024-04-03T05:14:52.229963+0000","last_became_active":"2024-04-03T03:38:26.718375+0000","last_became_peered":"2024-04-03T03:38:26.718375+0000","last_unstale":"2024-04-03T05:14:52.229963+0000","last_undegraded":"2024-04-03T05:14:52.229963+0000","last_fullsized":"2024-04-03T05:14:52.229963+0000","mapping_epoch":25,"log_start":"263'500","ondisk_log_start":"263'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'566","last_scrub_stamp":"2024-04-03T05:14:52.229713+0000","last_deep_scrub":"263'566","last_deep_scrub_stamp":"2024-04-03T05:14:52.229713+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.229713+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:16:00.784742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2911,"num_read_kb":2669,"num_write":774,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2394,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'320","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:51.572722+0000","last_change":"2024-04-03T05:14:51.572830+0000","last_active":"2024-04-03T05:14:51.572722+0000","last_peered":"2024-04-03T05:14:51.572722+0000","last_clean":"2024-04-03T05:14:51.572722+0000","last_became_active":"2024-04-03T03:38:24.730294+0000","last_became_peered":"2024-04-03T03:38:24.730294+0000","last_unstale":"2024-04-03T05:14:51.572722+0000","last_undegraded":"2024-04-03T05:14:51.572722+0000","last_fullsized":"2024-04-03T05:14:51.572722+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-04-03T05:14:51.572520+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-04-03T05:14:51.572520+0000","last_clean_scrub_stamp":"2024-04-03T05:14:51.572520+0000","objects_scrubbed":10,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:05:41.968418+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274297,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":474,"num_read_kb":62893,"num_write":1320,"num_write_kb":30207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:31.301408+0000","last_change":"2024-04-03T05:14:31.301463+0000","last_active":"2024-04-03T05:14:31.301408+0000","last_peered":"2024-04-03T05:14:31.301408+0000","last_clean":"2024-04-03T05:14:31.301408+0000","last_became_active":"2024-04-03T03:38:28.719692+0000","last_became_peered":"2024-04-03T03:38:28.719692+0000","last_unstale":"2024-04-03T05:14:31.301408+0000","last_undegraded":"2024-04-03T05:14:31.301408+0000","last_fullsized":"2024-04-03T05:14:31.301408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:31.301203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:31.301203+0000","last_clean_scrub_stamp":"2024-04-03T05:14:31.301203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:39:51.285253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'345","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.879929+0000","last_change":"2024-04-03T05:14:45.880117+0000","last_active":"2024-04-03T05:14:45.879929+0000","last_peered":"2024-04-03T05:14:45.879929+0000","last_clean":"2024-04-03T05:14:45.879929+0000","last_became_active":"2024-04-03T03:38:30.732529+0000","last_became_peered":"2024-04-03T03:38:30.732529+0000","last_unstale":"2024-04-03T05:14:45.879929+0000","last_undegraded":"2024-04-03T05:14:45.879929+0000","last_fullsized":"2024-04-03T05:14:45.879929+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-04-03T05:14:45.879706+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-04-03T05:14:45.879706+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.879706+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:44:36.980268+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":563,"num_read_kb":1112,"num_write":458,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.566913+0000","last_change":"2024-04-03T05:14:28.566972+0000","last_active":"2024-04-03T05:14:28.566913+0000","last_peered":"2024-04-03T05:14:28.566913+0000","last_clean":"2024-04-03T05:14:28.566913+0000","last_became_active":"2024-04-03T03:38:32.731752+0000","last_became_peered":"2024-04-03T03:38:32.731752+0000","last_unstale":"2024-04-03T05:14:28.566913+0000","last_undegraded":"2024-04-03T05:14:28.566913+0000","last_fullsized":"2024-04-03T05:14:28.566913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:28.566730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:28.566730+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.566730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:51.820450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'190","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.287079+0000","last_change":"2024-04-03T05:14:34.287156+0000","last_active":"2024-04-03T05:14:34.287079+0000","last_peered":"2024-04-03T05:14:34.287079+0000","last_clean":"2024-04-03T05:14:34.287079+0000","last_became_active":"2024-04-03T03:38:34.736663+0000","last_became_peered":"2024-04-03T03:38:34.736663+0000","last_unstale":"2024-04-03T05:14:34.287079+0000","last_undegraded":"2024-04-03T05:14:34.287079+0000","last_fullsized":"2024-04-03T05:14:34.287079+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-04-03T05:14:34.286879+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-04-03T05:14:34.286879+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.286879+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:04:47.107632+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":719,"num_read_kb":691,"num_write":524,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'753","reported_seq":2350,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:58.201399+0000","last_change":"2024-04-03T05:14:58.201535+0000","last_active":"2024-04-03T05:14:58.201399+0000","last_peered":"2024-04-03T05:14:58.201399+0000","last_clean":"2024-04-03T05:14:58.201399+0000","last_became_active":"2024-04-03T03:38:26.711214+0000","last_became_peered":"2024-04-03T03:38:26.711214+0000","last_unstale":"2024-04-03T05:14:58.201399+0000","last_undegraded":"2024-04-03T05:14:58.201399+0000","last_fullsized":"2024-04-03T05:14:58.201399+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'753","last_scrub_stamp":"2024-04-03T05:14:58.201149+0000","last_deep_scrub":"263'753","last_deep_scrub_stamp":"2024-04-03T05:14:58.201149+0000","last_clean_scrub_stamp":"2024-04-03T05:14:58.201149+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:52:49.092410+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3543,"num_read_kb":3207,"num_write":983,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'300","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.646361+0000","last_change":"2024-04-03T05:14:53.646449+0000","last_active":"2024-04-03T05:14:53.646361+0000","last_peered":"2024-04-03T05:14:53.646361+0000","last_clean":"2024-04-03T05:14:53.646361+0000","last_became_active":"2024-04-03T03:38:24.761330+0000","last_became_peered":"2024-04-03T03:38:24.761330+0000","last_unstale":"2024-04-03T05:14:53.646361+0000","last_undegraded":"2024-04-03T05:14:53.646361+0000","last_fullsized":"2024-04-03T05:14:53.646361+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-04-03T05:14:53.646133+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-04-03T05:14:53.646133+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.646133+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:48:55.991241+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4626676,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":410,"num_read_kb":53466,"num_write":1122,"num_write_kb":35897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.641798+0000","last_change":"2024-04-03T05:14:42.641854+0000","last_active":"2024-04-03T05:14:42.641798+0000","last_peered":"2024-04-03T05:14:42.641798+0000","last_clean":"2024-04-03T05:14:42.641798+0000","last_became_active":"2024-04-03T03:38:28.724296+0000","last_became_peered":"2024-04-03T03:38:28.724296+0000","last_unstale":"2024-04-03T05:14:42.641798+0000","last_undegraded":"2024-04-03T05:14:42.641798+0000","last_fullsized":"2024-04-03T05:14:42.641798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:42.641604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:42.641604+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.641604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:30:36.878798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'314","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.257381+0000","last_change":"2024-04-03T05:14:41.257456+0000","last_active":"2024-04-03T05:14:41.257381+0000","last_peered":"2024-04-03T05:14:41.257381+0000","last_clean":"2024-04-03T05:14:41.257381+0000","last_became_active":"2024-04-03T03:38:30.821335+0000","last_became_peered":"2024-04-03T03:38:30.821335+0000","last_unstale":"2024-04-03T05:14:41.257381+0000","last_undegraded":"2024-04-03T05:14:41.257381+0000","last_fullsized":"2024-04-03T05:14:41.257381+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-04-03T05:14:41.257199+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-04-03T05:14:41.257199+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.257199+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:26:24.431127+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45080,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":1115,"num_write":402,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:53.504584+0000","last_change":"2024-04-03T05:14:53.504584+0000","last_active":"2024-04-03T05:14:53.504584+0000","last_peered":"2024-04-03T05:14:53.504584+0000","last_clean":"2024-04-03T05:14:53.504584+0000","last_became_active":"2024-04-03T03:38:32.730954+0000","last_became_peered":"2024-04-03T03:38:32.730954+0000","last_unstale":"2024-04-03T05:14:53.504584+0000","last_undegraded":"2024-04-03T05:14:53.504584+0000","last_fullsized":"2024-04-03T05:14:53.504584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:53.504332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:53.504332+0000","last_clean_scrub_stamp":"2024-04-03T05:14:53.504332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:03:47.090395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'106","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.229393+0000","last_change":"2024-04-03T05:14:28.229531+0000","last_active":"2024-04-03T05:14:28.229393+0000","last_peered":"2024-04-03T05:14:28.229393+0000","last_clean":"2024-04-03T05:14:28.229393+0000","last_became_active":"2024-04-03T03:38:34.754544+0000","last_became_peered":"2024-04-03T03:38:34.754544+0000","last_unstale":"2024-04-03T05:14:28.229393+0000","last_undegraded":"2024-04-03T05:14:28.229393+0000","last_fullsized":"2024-04-03T05:14:28.229393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-04-03T05:14:28.229167+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-04-03T05:14:28.229167+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.229167+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:31:37.294628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":262,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'319","reported_seq":1744,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.386471+0000","last_change":"2024-04-03T05:14:40.386554+0000","last_active":"2024-04-03T05:14:40.386471+0000","last_peered":"2024-04-03T05:14:40.386471+0000","last_clean":"2024-04-03T05:14:40.386471+0000","last_became_active":"2024-04-03T03:38:26.720984+0000","last_became_peered":"2024-04-03T03:38:26.720984+0000","last_unstale":"2024-04-03T05:14:40.386471+0000","last_undegraded":"2024-04-03T05:14:40.386471+0000","last_fullsized":"2024-04-03T05:14:40.386471+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-04-03T05:14:40.386242+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-04-03T05:14:40.386242+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.386242+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:21:35.765971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1783,"num_read_kb":1722,"num_write":353,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'374","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:02.207032+0000","last_change":"2024-04-03T05:15:02.207218+0000","last_active":"2024-04-03T05:15:02.207032+0000","last_peered":"2024-04-03T05:15:02.207032+0000","last_clean":"2024-04-03T05:15:02.207032+0000","last_became_active":"2024-04-03T03:38:24.745183+0000","last_became_peered":"2024-04-03T03:38:24.745183+0000","last_unstale":"2024-04-03T05:15:02.207032+0000","last_undegraded":"2024-04-03T05:15:02.207032+0000","last_fullsized":"2024-04-03T05:15:02.207032+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'374","last_scrub_stamp":"2024-04-03T05:15:02.206599+0000","last_deep_scrub":"263'374","last_deep_scrub_stamp":"2024-04-03T05:15:02.206599+0000","last_clean_scrub_stamp":"2024-04-03T05:15:02.206599+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:05:18.017132+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5733043,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":528,"num_read_kb":13372,"num_write":1290,"num_write_kb":33178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.581746+0000","last_change":"2024-04-03T05:14:29.581798+0000","last_active":"2024-04-03T05:14:29.581746+0000","last_peered":"2024-04-03T05:14:29.581746+0000","last_clean":"2024-04-03T05:14:29.581746+0000","last_became_active":"2024-04-03T03:38:28.710708+0000","last_became_peered":"2024-04-03T03:38:28.710708+0000","last_unstale":"2024-04-03T05:14:29.581746+0000","last_undegraded":"2024-04-03T05:14:29.581746+0000","last_fullsized":"2024-04-03T05:14:29.581746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:29.581560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:29.581560+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.581560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:56:14.340545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'158","reported_seq":743,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:30.701450+0000","last_change":"2024-04-03T05:14:30.701450+0000","last_active":"2024-04-03T05:14:30.701450+0000","last_peered":"2024-04-03T05:14:30.701450+0000","last_clean":"2024-04-03T05:14:30.701450+0000","last_became_active":"2024-04-03T03:38:30.822452+0000","last_became_peered":"2024-04-03T03:38:30.822452+0000","last_unstale":"2024-04-03T05:14:30.701450+0000","last_undegraded":"2024-04-03T05:14:30.701450+0000","last_fullsized":"2024-04-03T05:14:30.701450+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-04-03T05:14:30.701180+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-04-03T05:14:30.701180+0000","last_clean_scrub_stamp":"2024-04-03T05:14:30.701180+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:17:50.340919+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":185,"num_write":168,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12140,"num_omap_keys":36,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'526","reported_seq":4615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.267613+0000","last_change":"2024-04-03T05:14:25.267733+0000","last_active":"2024-04-03T05:14:25.267613+0000","last_peered":"2024-04-03T05:14:25.267613+0000","last_clean":"2024-04-03T05:14:25.267613+0000","last_became_active":"2024-04-03T03:38:32.734617+0000","last_became_peered":"2024-04-03T03:38:32.734617+0000","last_unstale":"2024-04-03T05:14:25.267613+0000","last_undegraded":"2024-04-03T05:14:25.267613+0000","last_fullsized":"2024-04-03T05:14:25.267613+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'526","last_scrub_stamp":"2024-04-03T05:14:25.267298+0000","last_deep_scrub":"263'526","last_deep_scrub_stamp":"2024-04-03T05:14:25.267298+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.267298+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:15:44.044015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'183","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:26.817411+0000","last_change":"2024-04-03T05:14:26.817474+0000","last_active":"2024-04-03T05:14:26.817411+0000","last_peered":"2024-04-03T05:14:26.817411+0000","last_clean":"2024-04-03T05:14:26.817411+0000","last_became_active":"2024-04-03T03:38:34.756694+0000","last_became_peered":"2024-04-03T03:38:34.756694+0000","last_unstale":"2024-04-03T05:14:26.817411+0000","last_undegraded":"2024-04-03T05:14:26.817411+0000","last_fullsized":"2024-04-03T05:14:26.817411+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-04-03T05:14:26.817208+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-04-03T05:14:26.817208+0000","last_clean_scrub_stamp":"2024-04-03T05:14:26.817208+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:13:30.094225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":410,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'392","reported_seq":2038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.730297+0000","last_change":"2024-04-03T05:14:37.730367+0000","last_active":"2024-04-03T05:14:37.730297+0000","last_peered":"2024-04-03T05:14:37.730297+0000","last_clean":"2024-04-03T05:14:37.730297+0000","last_became_active":"2024-04-03T03:38:26.744905+0000","last_became_peered":"2024-04-03T03:38:26.744905+0000","last_unstale":"2024-04-03T05:14:37.730297+0000","last_undegraded":"2024-04-03T05:14:37.730297+0000","last_fullsized":"2024-04-03T05:14:37.730297+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-04-03T05:14:37.730111+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-04-03T05:14:37.730111+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.730111+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:43:07.781322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2315,"num_read_kb":2222,"num_write":443,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1435,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'372","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:20.252631+0000","last_change":"2024-04-03T05:14:20.252870+0000","last_active":"2024-04-03T05:14:20.252631+0000","last_peered":"2024-04-03T05:14:20.252631+0000","last_clean":"2024-04-03T05:14:20.252631+0000","last_became_active":"2024-04-03T03:38:58.350828+0000","last_became_peered":"2024-04-03T03:38:58.350828+0000","last_unstale":"2024-04-03T05:14:20.252631+0000","last_undegraded":"2024-04-03T05:14:20.252631+0000","last_fullsized":"2024-04-03T05:14:20.252631+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-04-03T05:14:20.252422+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-04-03T05:14:20.252422+0000","last_clean_scrub_stamp":"2024-04-03T05:14:20.252422+0000","objects_scrubbed":9,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:50:54.930268+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9469383,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":544,"num_read_kb":21295,"num_write":1304,"num_write_kb":30213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.879862+0000","last_change":"2024-04-03T05:14:37.879919+0000","last_active":"2024-04-03T05:14:37.879862+0000","last_peered":"2024-04-03T05:14:37.879862+0000","last_clean":"2024-04-03T05:14:37.879862+0000","last_became_active":"2024-04-03T03:38:28.726412+0000","last_became_peered":"2024-04-03T03:38:28.726412+0000","last_unstale":"2024-04-03T05:14:37.879862+0000","last_undegraded":"2024-04-03T05:14:37.879862+0000","last_fullsized":"2024-04-03T05:14:37.879862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:37.879666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:37.879666+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.879666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:14:28.818586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'387","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.398393+0000","last_change":"2024-04-03T05:14:36.398516+0000","last_active":"2024-04-03T05:14:36.398393+0000","last_peered":"2024-04-03T05:14:36.398393+0000","last_clean":"2024-04-03T05:14:36.398393+0000","last_became_active":"2024-04-03T03:38:30.721642+0000","last_became_peered":"2024-04-03T03:38:30.721642+0000","last_unstale":"2024-04-03T05:14:36.398393+0000","last_undegraded":"2024-04-03T05:14:36.398393+0000","last_fullsized":"2024-04-03T05:14:36.398393+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'387","last_scrub_stamp":"2024-04-03T05:14:36.398185+0000","last_deep_scrub":"263'387","last_deep_scrub_stamp":"2024-04-03T05:14:36.398185+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.398185+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:02:47.544229+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44870,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":590,"num_read_kb":1131,"num_write":454,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:37.262459+0000","last_change":"2024-04-03T05:14:37.262459+0000","last_active":"2024-04-03T05:14:37.262459+0000","last_peered":"2024-04-03T05:14:37.262459+0000","last_clean":"2024-04-03T05:14:37.262459+0000","last_became_active":"2024-04-03T03:38:32.739496+0000","last_became_peered":"2024-04-03T03:38:32.739496+0000","last_unstale":"2024-04-03T05:14:37.262459+0000","last_undegraded":"2024-04-03T05:14:37.262459+0000","last_fullsized":"2024-04-03T05:14:37.262459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:37.262108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:37.262108+0000","last_clean_scrub_stamp":"2024-04-03T05:14:37.262108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:24:14.833620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'93","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.772895+0000","last_change":"2024-04-03T05:14:28.773057+0000","last_active":"2024-04-03T05:14:28.772895+0000","last_peered":"2024-04-03T05:14:28.772895+0000","last_clean":"2024-04-03T05:14:28.772895+0000","last_became_active":"2024-04-03T03:38:34.751005+0000","last_became_peered":"2024-04-03T03:38:34.751005+0000","last_unstale":"2024-04-03T05:14:28.772895+0000","last_undegraded":"2024-04-03T05:14:28.772895+0000","last_fullsized":"2024-04-03T05:14:28.772895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'93","last_scrub_stamp":"2024-04-03T05:14:28.772679+0000","last_deep_scrub":"263'93","last_deep_scrub_stamp":"2024-04-03T05:14:28.772679+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.772679+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:51:16.361362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":380,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":214,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'781","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.668498+0000","last_change":"2024-04-03T05:14:39.668563+0000","last_active":"2024-04-03T05:14:39.668498+0000","last_peered":"2024-04-03T05:14:39.668498+0000","last_clean":"2024-04-03T05:14:39.668498+0000","last_became_active":"2024-04-03T03:38:26.745135+0000","last_became_peered":"2024-04-03T03:38:26.745135+0000","last_unstale":"2024-04-03T05:14:39.668498+0000","last_undegraded":"2024-04-03T05:14:39.668498+0000","last_fullsized":"2024-04-03T05:14:39.668498+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'781","last_scrub_stamp":"2024-04-03T05:14:39.668301+0000","last_deep_scrub":"263'781","last_deep_scrub_stamp":"2024-04-03T05:14:39.668301+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.668301+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:08:38.214904+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3471,"num_read_kb":3079,"num_write":1070,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'292","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:59.311615+0000","last_change":"2024-04-03T05:14:59.311732+0000","last_active":"2024-04-03T05:14:59.311615+0000","last_peered":"2024-04-03T05:14:59.311615+0000","last_clean":"2024-04-03T05:14:59.311615+0000","last_became_active":"2024-04-03T03:38:24.743710+0000","last_became_peered":"2024-04-03T03:38:24.743710+0000","last_unstale":"2024-04-03T05:14:59.311615+0000","last_undegraded":"2024-04-03T05:14:59.311615+0000","last_fullsized":"2024-04-03T05:14:59.311615+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'292","last_scrub_stamp":"2024-04-03T05:14:59.311392+0000","last_deep_scrub":"263'292","last_deep_scrub_stamp":"2024-04-03T05:14:59.311392+0000","last_clean_scrub_stamp":"2024-04-03T05:14:59.311392+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:39:20.920053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":414,"num_read_kb":32346,"num_write":1024,"num_write_kb":33286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.295519+0000","last_change":"2024-04-03T05:14:49.295591+0000","last_active":"2024-04-03T05:14:49.295519+0000","last_peered":"2024-04-03T05:14:49.295519+0000","last_clean":"2024-04-03T05:14:49.295519+0000","last_became_active":"2024-04-03T03:38:28.731547+0000","last_became_peered":"2024-04-03T03:38:28.731547+0000","last_unstale":"2024-04-03T05:14:49.295519+0000","last_undegraded":"2024-04-03T05:14:49.295519+0000","last_fullsized":"2024-04-03T05:14:49.295519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:49.295315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:49.295315+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.295315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:59:58.830081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'319","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:05.213966+0000","last_change":"2024-04-03T05:15:05.213966+0000","last_active":"2024-04-03T05:15:05.213966+0000","last_peered":"2024-04-03T05:15:05.213966+0000","last_clean":"2024-04-03T05:15:05.213966+0000","last_became_active":"2024-04-03T03:38:30.732095+0000","last_became_peered":"2024-04-03T03:38:30.732095+0000","last_unstale":"2024-04-03T05:15:05.213966+0000","last_undegraded":"2024-04-03T05:15:05.213966+0000","last_fullsized":"2024-04-03T05:15:05.213966+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-04-03T05:15:05.213708+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-04-03T05:15:05.213708+0000","last_clean_scrub_stamp":"2024-04-03T05:15:05.213708+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:53:21.058014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1184,"num_write":416,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:28.285076+0000","last_change":"2024-04-03T05:14:28.285133+0000","last_active":"2024-04-03T05:14:28.285076+0000","last_peered":"2024-04-03T05:14:28.285076+0000","last_clean":"2024-04-03T05:14:28.285076+0000","last_became_active":"2024-04-03T03:38:32.743994+0000","last_became_peered":"2024-04-03T03:38:32.743994+0000","last_unstale":"2024-04-03T05:14:28.285076+0000","last_undegraded":"2024-04-03T05:14:28.285076+0000","last_fullsized":"2024-04-03T05:14:28.285076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:28.284861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:28.284861+0000","last_clean_scrub_stamp":"2024-04-03T05:14:28.284861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:02:36.856459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'90","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:25.095237+0000","last_change":"2024-04-03T05:14:25.095237+0000","last_active":"2024-04-03T05:14:25.095237+0000","last_peered":"2024-04-03T05:14:25.095237+0000","last_clean":"2024-04-03T05:14:25.095237+0000","last_became_active":"2024-04-03T03:38:34.941122+0000","last_became_peered":"2024-04-03T03:38:34.941122+0000","last_unstale":"2024-04-03T05:14:25.095237+0000","last_undegraded":"2024-04-03T05:14:25.095237+0000","last_fullsized":"2024-04-03T05:14:25.095237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'90","last_scrub_stamp":"2024-04-03T05:14:25.094941+0000","last_deep_scrub":"263'90","last_deep_scrub_stamp":"2024-04-03T05:14:25.094941+0000","last_clean_scrub_stamp":"2024-04-03T05:14:25.094941+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:14:54.760676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'828","reported_seq":2469,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:56.239900+0000","last_change":"2024-04-03T05:14:56.240071+0000","last_active":"2024-04-03T05:14:56.239900+0000","last_peered":"2024-04-03T05:14:56.239900+0000","last_clean":"2024-04-03T05:14:56.239900+0000","last_became_active":"2024-04-03T03:38:26.710804+0000","last_became_peered":"2024-04-03T03:38:26.710804+0000","last_unstale":"2024-04-03T05:14:56.239900+0000","last_undegraded":"2024-04-03T05:14:56.239900+0000","last_fullsized":"2024-04-03T05:14:56.239900+0000","mapping_epoch":25,"log_start":"263'800","ondisk_log_start":"263'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'828","last_scrub_stamp":"2024-04-03T05:14:56.239684+0000","last_deep_scrub":"263'828","last_deep_scrub_stamp":"2024-04-03T05:14:56.239684+0000","last_clean_scrub_stamp":"2024-04-03T05:14:56.239684+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:20:11.483374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3882,"num_read_kb":3472,"num_write":1106,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":949,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'370","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:06.270261+0000","last_change":"2024-04-03T05:15:06.270429+0000","last_active":"2024-04-03T05:15:06.270261+0000","last_peered":"2024-04-03T05:15:06.270261+0000","last_clean":"2024-04-03T05:15:06.270261+0000","last_became_active":"2024-04-03T03:38:24.726765+0000","last_became_peered":"2024-04-03T03:38:24.726765+0000","last_unstale":"2024-04-03T05:15:06.270261+0000","last_undegraded":"2024-04-03T05:15:06.270261+0000","last_fullsized":"2024-04-03T05:15:06.270261+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-04-03T05:15:06.270024+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-04-03T05:15:06.270024+0000","last_clean_scrub_stamp":"2024-04-03T05:15:06.270024+0000","objects_scrubbed":10,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:07:14.854031+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975468,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":544,"num_read_kb":31092,"num_write":1278,"num_write_kb":58109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.607643+0000","last_change":"2024-04-03T05:14:44.607643+0000","last_active":"2024-04-03T05:14:44.607643+0000","last_peered":"2024-04-03T05:14:44.607643+0000","last_clean":"2024-04-03T05:14:44.607643+0000","last_became_active":"2024-04-03T03:38:28.725139+0000","last_became_peered":"2024-04-03T03:38:28.725139+0000","last_unstale":"2024-04-03T05:14:44.607643+0000","last_undegraded":"2024-04-03T05:14:44.607643+0000","last_fullsized":"2024-04-03T05:14:44.607643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:44.607355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:44.607355+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.607355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:50:46.231711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'262","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:59.184676+0000","last_change":"2024-04-03T05:14:59.184821+0000","last_active":"2024-04-03T05:14:59.184676+0000","last_peered":"2024-04-03T05:14:59.184676+0000","last_clean":"2024-04-03T05:14:59.184676+0000","last_became_active":"2024-04-03T03:38:30.719983+0000","last_became_peered":"2024-04-03T03:38:30.719983+0000","last_unstale":"2024-04-03T05:14:59.184676+0000","last_undegraded":"2024-04-03T05:14:59.184676+0000","last_fullsized":"2024-04-03T05:14:59.184676+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-04-03T05:14:59.184471+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-04-03T05:14:59.184471+0000","last_clean_scrub_stamp":"2024-04-03T05:14:59.184471+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:04:05.193830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46477,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":1098,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:27.615281+0000","last_change":"2024-04-03T05:14:27.615333+0000","last_active":"2024-04-03T05:14:27.615281+0000","last_peered":"2024-04-03T05:14:27.615281+0000","last_clean":"2024-04-03T05:14:27.615281+0000","last_became_active":"2024-04-03T03:38:32.728438+0000","last_became_peered":"2024-04-03T03:38:32.728438+0000","last_unstale":"2024-04-03T05:14:27.615281+0000","last_undegraded":"2024-04-03T05:14:27.615281+0000","last_fullsized":"2024-04-03T05:14:27.615281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:27.615083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:27.615083+0000","last_clean_scrub_stamp":"2024-04-03T05:14:27.615083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:46:21.652566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'139","reported_seq":1191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:29.821692+0000","last_change":"2024-04-03T05:14:29.821852+0000","last_active":"2024-04-03T05:14:29.821692+0000","last_peered":"2024-04-03T05:14:29.821692+0000","last_clean":"2024-04-03T05:14:29.821692+0000","last_became_active":"2024-04-03T03:38:34.748329+0000","last_became_peered":"2024-04-03T03:38:34.748329+0000","last_unstale":"2024-04-03T05:14:29.821692+0000","last_undegraded":"2024-04-03T05:14:29.821692+0000","last_fullsized":"2024-04-03T05:14:29.821692+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-04-03T05:14:29.821474+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-04-03T05:14:29.821474+0000","last_clean_scrub_stamp":"2024-04-03T05:14:29.821474+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:19:03.047582+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":680,"num_read_kb":679,"num_write":303,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'715","reported_seq":2153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:49.602450+0000","last_change":"2024-04-03T05:14:49.602450+0000","last_active":"2024-04-03T05:14:49.602450+0000","last_peered":"2024-04-03T05:14:49.602450+0000","last_clean":"2024-04-03T05:14:49.602450+0000","last_became_active":"2024-04-03T03:38:26.742044+0000","last_became_peered":"2024-04-03T03:38:26.742044+0000","last_unstale":"2024-04-03T05:14:49.602450+0000","last_undegraded":"2024-04-03T05:14:49.602450+0000","last_fullsized":"2024-04-03T05:14:49.602450+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'715","last_scrub_stamp":"2024-04-03T05:14:49.602155+0000","last_deep_scrub":"263'715","last_deep_scrub_stamp":"2024-04-03T05:14:49.602155+0000","last_clean_scrub_stamp":"2024-04-03T05:14:49.602155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:14:03.008984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3199,"num_read_kb":2853,"num_write":956,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'338","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:01.186520+0000","last_change":"2024-04-03T05:15:01.186750+0000","last_active":"2024-04-03T05:15:01.186520+0000","last_peered":"2024-04-03T05:15:01.186520+0000","last_clean":"2024-04-03T05:15:01.186520+0000","last_became_active":"2024-04-03T03:38:24.740329+0000","last_became_peered":"2024-04-03T03:38:24.740329+0000","last_unstale":"2024-04-03T05:15:01.186520+0000","last_undegraded":"2024-04-03T05:15:01.186520+0000","last_fullsized":"2024-04-03T05:15:01.186520+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-04-03T05:15:01.186135+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-04-03T05:15:01.186135+0000","last_clean_scrub_stamp":"2024-04-03T05:15:01.186135+0000","objects_scrubbed":8,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:42:04.737302+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050233,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":56728,"num_write":1264,"num_write_kb":35698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.621352+0000","last_change":"2024-04-03T05:14:35.621415+0000","last_active":"2024-04-03T05:14:35.621352+0000","last_peered":"2024-04-03T05:14:35.621352+0000","last_clean":"2024-04-03T05:14:35.621352+0000","last_became_active":"2024-04-03T03:38:28.725225+0000","last_became_peered":"2024-04-03T03:38:28.725225+0000","last_unstale":"2024-04-03T05:14:35.621352+0000","last_undegraded":"2024-04-03T05:14:35.621352+0000","last_fullsized":"2024-04-03T05:14:35.621352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-04-03T05:14:35.621162+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-04-03T05:14:35.621162+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.621162+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:33:10.739210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'339","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:58.719989+0000","last_change":"2024-04-03T05:14:58.720165+0000","last_active":"2024-04-03T05:14:58.719989+0000","last_peered":"2024-04-03T05:14:58.719989+0000","last_clean":"2024-04-03T05:14:58.719989+0000","last_became_active":"2024-04-03T03:38:30.717323+0000","last_became_peered":"2024-04-03T03:38:30.717323+0000","last_unstale":"2024-04-03T05:14:58.719989+0000","last_undegraded":"2024-04-03T05:14:58.719989+0000","last_fullsized":"2024-04-03T05:14:58.719989+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-04-03T05:14:58.719760+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-04-03T05:14:58.719760+0000","last_clean_scrub_stamp":"2024-04-03T05:14:58.719760+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:28:57.128092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41938,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1119,"num_write":416,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.222763+0000","last_change":"2024-04-03T05:14:36.222883+0000","last_active":"2024-04-03T05:14:36.222763+0000","last_peered":"2024-04-03T05:14:36.222763+0000","last_clean":"2024-04-03T05:14:36.222763+0000","last_became_active":"2024-04-03T03:38:32.743076+0000","last_became_peered":"2024-04-03T03:38:32.743076+0000","last_unstale":"2024-04-03T05:14:36.222763+0000","last_undegraded":"2024-04-03T05:14:36.222763+0000","last_fullsized":"2024-04-03T05:14:36.222763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-03T05:14:36.222537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-03T05:14:36.222537+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.222537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:14:35.938418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'78","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.535115+0000","last_change":"2024-04-03T05:14:22.535115+0000","last_active":"2024-04-03T05:14:22.535115+0000","last_peered":"2024-04-03T05:14:22.535115+0000","last_clean":"2024-04-03T05:14:22.535115+0000","last_became_active":"2024-04-03T03:38:34.749644+0000","last_became_peered":"2024-04-03T03:38:34.749644+0000","last_unstale":"2024-04-03T05:14:22.535115+0000","last_undegraded":"2024-04-03T05:14:22.535115+0000","last_fullsized":"2024-04-03T05:14:22.535115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-04-03T05:14:22.534825+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-04-03T05:14:22.534825+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.534825+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T07:40:34.618691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":90,"num_write":191,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'756","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:34.575369+0000","last_change":"2024-04-03T05:14:34.575435+0000","last_active":"2024-04-03T05:14:34.575369+0000","last_peered":"2024-04-03T05:14:34.575369+0000","last_clean":"2024-04-03T05:14:34.575369+0000","last_became_active":"2024-04-03T03:38:26.721951+0000","last_became_peered":"2024-04-03T03:38:26.721951+0000","last_unstale":"2024-04-03T05:14:34.575369+0000","last_undegraded":"2024-04-03T05:14:34.575369+0000","last_fullsized":"2024-04-03T05:14:34.575369+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'756","last_scrub_stamp":"2024-04-03T05:14:34.575178+0000","last_deep_scrub":"263'756","last_deep_scrub_stamp":"2024-04-03T05:14:34.575178+0000","last_clean_scrub_stamp":"2024-04-03T05:14:34.575178+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:28:43.629233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3698,"num_read_kb":3347,"num_write":1000,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2630,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'304","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.183387+0000","last_change":"2024-04-03T05:14:41.183595+0000","last_active":"2024-04-03T05:14:41.183387+0000","last_peered":"2024-04-03T05:14:41.183387+0000","last_clean":"2024-04-03T05:14:41.183387+0000","last_became_active":"2024-04-03T03:38:24.741407+0000","last_became_peered":"2024-04-03T03:38:24.741407+0000","last_unstale":"2024-04-03T05:14:41.183387+0000","last_undegraded":"2024-04-03T05:14:41.183387+0000","last_fullsized":"2024-04-03T05:14:41.183387+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-04-03T05:14:41.183060+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-04-03T05:14:41.183060+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.183060+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:08:50.383669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":24965,"num_write":1150,"num_write_kb":36078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1408","reported_seq":2758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.571664+0000","last_change":"2024-04-03T05:14:42.571727+0000","last_active":"2024-04-03T05:14:42.571664+0000","last_peered":"2024-04-03T05:14:42.571664+0000","last_clean":"2024-04-03T05:14:42.571664+0000","last_became_active":"2024-04-03T03:38:26.719386+0000","last_became_peered":"2024-04-03T03:38:26.719386+0000","last_unstale":"2024-04-03T05:14:42.571664+0000","last_undegraded":"2024-04-03T05:14:42.571664+0000","last_fullsized":"2024-04-03T05:14:42.571664+0000","mapping_epoch":25,"log_start":"263'1300","ondisk_log_start":"263'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1408","last_scrub_stamp":"2024-04-03T05:14:42.571459+0000","last_deep_scrub":"263'1408","last_deep_scrub_stamp":"2024-04-03T05:14:42.571459+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.571459+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":1300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:57:22.982576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5587,"num_read_kb":4776,"num_write":2003,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'265","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:36.494584+0000","last_change":"2024-04-03T05:14:36.494678+0000","last_active":"2024-04-03T05:14:36.494584+0000","last_peered":"2024-04-03T05:14:36.494584+0000","last_clean":"2024-04-03T05:14:36.494584+0000","last_became_active":"2024-04-03T03:38:24.748369+0000","last_became_peered":"2024-04-03T03:38:24.748369+0000","last_unstale":"2024-04-03T05:14:36.494584+0000","last_undegraded":"2024-04-03T05:14:36.494584+0000","last_fullsized":"2024-04-03T05:14:36.494584+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'265","last_scrub_stamp":"2024-04-03T05:14:36.494353+0000","last_deep_scrub":"263'265","last_deep_scrub_stamp":"2024-04-03T05:14:36.494353+0000","last_clean_scrub_stamp":"2024-04-03T05:14:36.494353+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:28:34.312534+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050494,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":45141,"num_write":1016,"num_write_kb":24649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'763","reported_seq":2395,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:40.493269+0000","last_change":"2024-04-03T05:14:40.493335+0000","last_active":"2024-04-03T05:14:40.493269+0000","last_peered":"2024-04-03T05:14:40.493269+0000","last_clean":"2024-04-03T05:14:40.493269+0000","last_became_active":"2024-04-03T03:38:26.713821+0000","last_became_peered":"2024-04-03T03:38:26.713821+0000","last_unstale":"2024-04-03T05:14:40.493269+0000","last_undegraded":"2024-04-03T05:14:40.493269+0000","last_fullsized":"2024-04-03T05:14:40.493269+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-04-03T05:14:40.493077+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-04-03T05:14:40.493077+0000","last_clean_scrub_stamp":"2024-04-03T05:14:40.493077+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:32:57.230029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3127,"num_write":983,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'367","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:57.284949+0000","last_change":"2024-04-03T05:14:57.285041+0000","last_active":"2024-04-03T05:14:57.284949+0000","last_peered":"2024-04-03T05:14:57.284949+0000","last_clean":"2024-04-03T05:14:57.284949+0000","last_became_active":"2024-04-03T03:38:24.741322+0000","last_became_peered":"2024-04-03T03:38:24.741322+0000","last_unstale":"2024-04-03T05:14:57.284949+0000","last_undegraded":"2024-04-03T05:14:57.284949+0000","last_fullsized":"2024-04-03T05:14:57.284949+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-04-03T05:14:57.284743+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-04-03T05:14:57.284743+0000","last_clean_scrub_stamp":"2024-04-03T05:14:57.284743+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:45:44.265291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262179,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":554,"num_read_kb":110805,"num_write":1222,"num_write_kb":46785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'796","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.540276+0000","last_change":"2024-04-03T05:14:44.540357+0000","last_active":"2024-04-03T05:14:44.540276+0000","last_peered":"2024-04-03T05:14:44.540276+0000","last_clean":"2024-04-03T05:14:44.540276+0000","last_became_active":"2024-04-03T03:38:26.718895+0000","last_became_peered":"2024-04-03T03:38:26.718895+0000","last_unstale":"2024-04-03T05:14:44.540276+0000","last_undegraded":"2024-04-03T05:14:44.540276+0000","last_fullsized":"2024-04-03T05:14:44.540276+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-04-03T05:14:44.540078+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-04-03T05:14:44.540078+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.540078+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:11:23.316758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3511,"num_read_kb":3115,"num_write":1065,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'355","reported_seq":1147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:22.281665+0000","last_change":"2024-04-03T05:14:22.281665+0000","last_active":"2024-04-03T05:14:22.281665+0000","last_peered":"2024-04-03T05:14:22.281665+0000","last_clean":"2024-04-03T05:14:22.281665+0000","last_became_active":"2024-04-03T03:38:58.349944+0000","last_became_peered":"2024-04-03T03:38:58.349944+0000","last_unstale":"2024-04-03T05:14:22.281665+0000","last_undegraded":"2024-04-03T05:14:22.281665+0000","last_fullsized":"2024-04-03T05:14:22.281665+0000","mapping_epoch":36,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-04-03T05:14:22.281372+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-04-03T05:14:22.281372+0000","last_clean_scrub_stamp":"2024-04-03T05:14:22.281372+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:28:11.179395+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274194,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":861,"num_read_kb":89019,"num_write":1362,"num_write_kb":26145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1191","reported_seq":2766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.254135+0000","last_change":"2024-04-03T05:14:54.254307+0000","last_active":"2024-04-03T05:14:54.254135+0000","last_peered":"2024-04-03T05:14:54.254135+0000","last_clean":"2024-04-03T05:14:54.254135+0000","last_became_active":"2024-04-03T03:38:26.715042+0000","last_became_peered":"2024-04-03T03:38:26.715042+0000","last_unstale":"2024-04-03T05:14:54.254135+0000","last_undegraded":"2024-04-03T05:14:54.254135+0000","last_fullsized":"2024-04-03T05:14:54.254135+0000","mapping_epoch":25,"log_start":"263'1100","ondisk_log_start":"263'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1191","last_scrub_stamp":"2024-04-03T05:14:54.253919+0000","last_deep_scrub":"263'1191","last_deep_scrub_stamp":"2024-04-03T05:14:54.253919+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.253919+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":1100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:26:25.573770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5057,"num_read_kb":4409,"num_write":1655,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1663,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'301","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:24.069802+0000","last_change":"2024-04-03T05:14:24.070042+0000","last_active":"2024-04-03T05:14:24.069802+0000","last_peered":"2024-04-03T05:14:24.069802+0000","last_clean":"2024-04-03T05:14:24.069802+0000","last_became_active":"2024-04-03T03:38:58.350321+0000","last_became_peered":"2024-04-03T03:38:58.350321+0000","last_unstale":"2024-04-03T05:14:24.069802+0000","last_undegraded":"2024-04-03T05:14:24.069802+0000","last_fullsized":"2024-04-03T05:14:24.069802+0000","mapping_epoch":36,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-04-03T05:14:24.069542+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-04-03T05:14:24.069542+0000","last_clean_scrub_stamp":"2024-04-03T05:14:24.069542+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T13:05:52.218774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550052,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":66631,"num_write":1085,"num_write_kb":28536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'744","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.638883+0000","last_change":"2024-04-03T05:14:43.638950+0000","last_active":"2024-04-03T05:14:43.638883+0000","last_peered":"2024-04-03T05:14:43.638883+0000","last_clean":"2024-04-03T05:14:43.638883+0000","last_became_active":"2024-04-03T03:38:26.744330+0000","last_became_peered":"2024-04-03T03:38:26.744330+0000","last_unstale":"2024-04-03T05:14:43.638883+0000","last_undegraded":"2024-04-03T05:14:43.638883+0000","last_fullsized":"2024-04-03T05:14:43.638883+0000","mapping_epoch":25,"log_start":"263'700","ondisk_log_start":"263'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'744","last_scrub_stamp":"2024-04-03T05:14:43.638672+0000","last_deep_scrub":"263'744","last_deep_scrub_stamp":"2024-04-03T05:14:43.638672+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.638672+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:45:53.347894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3386,"num_read_kb":3032,"num_write":1008,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":401,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'326","reported_seq":1015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.520251+0000","last_change":"2024-04-03T05:14:47.520364+0000","last_active":"2024-04-03T05:14:47.520251+0000","last_peered":"2024-04-03T05:14:47.520251+0000","last_clean":"2024-04-03T05:14:47.520251+0000","last_became_active":"2024-04-03T03:38:24.707626+0000","last_became_peered":"2024-04-03T03:38:24.707626+0000","last_unstale":"2024-04-03T05:14:47.520251+0000","last_undegraded":"2024-04-03T05:14:47.520251+0000","last_fullsized":"2024-04-03T05:14:47.520251+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-04-03T05:14:47.520049+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-04-03T05:14:47.520049+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.520049+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:17:14.577095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":9991,"num_write":1303,"num_write_kb":25388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'428","reported_seq":1826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:45.229856+0000","last_change":"2024-04-03T05:14:45.229936+0000","last_active":"2024-04-03T05:14:45.229856+0000","last_peered":"2024-04-03T05:14:45.229856+0000","last_clean":"2024-04-03T05:14:45.229856+0000","last_became_active":"2024-04-03T03:38:26.725513+0000","last_became_peered":"2024-04-03T03:38:26.725513+0000","last_unstale":"2024-04-03T05:14:45.229856+0000","last_undegraded":"2024-04-03T05:14:45.229856+0000","last_fullsized":"2024-04-03T05:14:45.229856+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-04-03T05:14:45.229671+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-04-03T05:14:45.229671+0000","last_clean_scrub_stamp":"2024-04-03T05:14:45.229671+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:19:06.343396+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2235,"num_read_kb":2034,"num_write":556,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":637,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'284","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.181156+0000","last_change":"2024-04-03T05:14:42.181259+0000","last_active":"2024-04-03T05:14:42.181156+0000","last_peered":"2024-04-03T05:14:42.181156+0000","last_clean":"2024-04-03T05:14:42.181156+0000","last_became_active":"2024-04-03T03:38:24.748923+0000","last_became_peered":"2024-04-03T03:38:24.748923+0000","last_unstale":"2024-04-03T05:14:42.181156+0000","last_undegraded":"2024-04-03T05:14:42.181156+0000","last_fullsized":"2024-04-03T05:14:42.181156+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-04-03T05:14:42.180927+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-04-03T05:14:42.180927+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.180927+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:59:06.333314+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306678,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":42672,"num_write":1032,"num_write_kb":23960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'707","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.139677+0000","last_change":"2024-04-03T05:14:47.139769+0000","last_active":"2024-04-03T05:14:47.139677+0000","last_peered":"2024-04-03T05:14:47.139677+0000","last_clean":"2024-04-03T05:14:47.139677+0000","last_became_active":"2024-04-03T03:38:26.716359+0000","last_became_peered":"2024-04-03T03:38:26.716359+0000","last_unstale":"2024-04-03T05:14:47.139677+0000","last_undegraded":"2024-04-03T05:14:47.139677+0000","last_fullsized":"2024-04-03T05:14:47.139677+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'707","last_scrub_stamp":"2024-04-03T05:14:47.139444+0000","last_deep_scrub":"263'707","last_deep_scrub_stamp":"2024-04-03T05:14:47.139444+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.139444+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:41:32.088135+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3142,"num_read_kb":2808,"num_write":934,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":794,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'337","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:04.260554+0000","last_change":"2024-04-03T05:15:04.260672+0000","last_active":"2024-04-03T05:15:04.260554+0000","last_peered":"2024-04-03T05:15:04.260554+0000","last_clean":"2024-04-03T05:15:04.260554+0000","last_became_active":"2024-04-03T03:38:24.716473+0000","last_became_peered":"2024-04-03T03:38:24.716473+0000","last_unstale":"2024-04-03T05:15:04.260554+0000","last_undegraded":"2024-04-03T05:15:04.260554+0000","last_fullsized":"2024-04-03T05:15:04.260554+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-04-03T05:15:04.260318+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-04-03T05:15:04.260318+0000","last_clean_scrub_stamp":"2024-04-03T05:15:04.260318+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:03:36.007476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3764519,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":31436,"num_write":1237,"num_write_kb":38562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'398","reported_seq":1856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:56.233092+0000","last_change":"2024-04-03T05:14:56.233250+0000","last_active":"2024-04-03T05:14:56.233092+0000","last_peered":"2024-04-03T05:14:56.233092+0000","last_clean":"2024-04-03T05:14:56.233092+0000","last_became_active":"2024-04-03T03:38:26.716435+0000","last_became_peered":"2024-04-03T03:38:26.716435+0000","last_unstale":"2024-04-03T05:14:56.233092+0000","last_undegraded":"2024-04-03T05:14:56.233092+0000","last_fullsized":"2024-04-03T05:14:56.233092+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-04-03T05:14:56.232775+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-04-03T05:14:56.232775+0000","last_clean_scrub_stamp":"2024-04-03T05:14:56.232775+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:10:52.625793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2146,"num_read_kb":2018,"num_write":509,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'422","reported_seq":1228,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:56.331612+0000","last_change":"2024-04-03T05:14:56.331832+0000","last_active":"2024-04-03T05:14:56.331612+0000","last_peered":"2024-04-03T05:14:56.331612+0000","last_clean":"2024-04-03T05:14:56.331612+0000","last_became_active":"2024-04-03T03:38:24.740664+0000","last_became_peered":"2024-04-03T03:38:24.740664+0000","last_unstale":"2024-04-03T05:14:56.331612+0000","last_undegraded":"2024-04-03T05:14:56.331612+0000","last_fullsized":"2024-04-03T05:14:56.331612+0000","mapping_epoch":23,"log_start":"263'400","ondisk_log_start":"263'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'422","last_scrub_stamp":"2024-04-03T05:14:56.331329+0000","last_deep_scrub":"263'422","last_deep_scrub_stamp":"2024-04-03T05:14:56.331329+0000","last_clean_scrub_stamp":"2024-04-03T05:14:56.331329+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:28:50.376442+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10717012,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":923,"num_read_kb":68467,"num_write":1504,"num_write_kb":54703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'408","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:38.704092+0000","last_change":"2024-04-03T05:14:38.704159+0000","last_active":"2024-04-03T05:14:38.704092+0000","last_peered":"2024-04-03T05:14:38.704092+0000","last_clean":"2024-04-03T05:14:38.704092+0000","last_became_active":"2024-04-03T03:38:26.751399+0000","last_became_peered":"2024-04-03T03:38:26.751399+0000","last_unstale":"2024-04-03T05:14:38.704092+0000","last_undegraded":"2024-04-03T05:14:38.704092+0000","last_fullsized":"2024-04-03T05:14:38.704092+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-04-03T05:14:38.703897+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-04-03T05:14:38.703897+0000","last_clean_scrub_stamp":"2024-04-03T05:14:38.703897+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:30:31.421072+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2226,"num_read_kb":2116,"num_write":486,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'294","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:03.229968+0000","last_change":"2024-04-03T05:15:03.229968+0000","last_active":"2024-04-03T05:15:03.229968+0000","last_peered":"2024-04-03T05:15:03.229968+0000","last_clean":"2024-04-03T05:15:03.229968+0000","last_became_active":"2024-04-03T03:38:24.715106+0000","last_became_peered":"2024-04-03T03:38:24.715106+0000","last_unstale":"2024-04-03T05:15:03.229968+0000","last_undegraded":"2024-04-03T05:15:03.229968+0000","last_fullsized":"2024-04-03T05:15:03.229968+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-04-03T05:15:03.229667+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-04-03T05:15:03.229667+0000","last_clean_scrub_stamp":"2024-04-03T05:15:03.229667+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T05:48:08.152738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642458,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":15103,"num_write":965,"num_write_kb":22507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'630","reported_seq":2288,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:39.417899+0000","last_change":"2024-04-03T05:14:39.417964+0000","last_active":"2024-04-03T05:14:39.417899+0000","last_peered":"2024-04-03T05:14:39.417899+0000","last_clean":"2024-04-03T05:14:39.417899+0000","last_became_active":"2024-04-03T03:38:26.717085+0000","last_became_peered":"2024-04-03T03:38:26.717085+0000","last_unstale":"2024-04-03T05:14:39.417899+0000","last_undegraded":"2024-04-03T05:14:39.417899+0000","last_fullsized":"2024-04-03T05:14:39.417899+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'630","last_scrub_stamp":"2024-04-03T05:14:39.417694+0000","last_deep_scrub":"263'630","last_deep_scrub_stamp":"2024-04-03T05:14:39.417694+0000","last_clean_scrub_stamp":"2024-04-03T05:14:39.417694+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T14:13:02.978944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3119,"num_read_kb":2815,"num_write":838,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'344","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.369715+0000","last_change":"2024-04-03T05:14:46.369715+0000","last_active":"2024-04-03T05:14:46.369715+0000","last_peered":"2024-04-03T05:14:46.369715+0000","last_clean":"2024-04-03T05:14:46.369715+0000","last_became_active":"2024-04-03T03:38:24.755345+0000","last_became_peered":"2024-04-03T03:38:24.755345+0000","last_unstale":"2024-04-03T05:14:46.369715+0000","last_undegraded":"2024-04-03T05:14:46.369715+0000","last_fullsized":"2024-04-03T05:14:46.369715+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-04-03T05:14:46.369226+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-04-03T05:14:46.369226+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.369226+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:50:14.322251+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194329,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":14159,"num_write":1284,"num_write_kb":40251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'703","reported_seq":2151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.715213+0000","last_change":"2024-04-03T05:14:35.715213+0000","last_active":"2024-04-03T05:14:35.715213+0000","last_peered":"2024-04-03T05:14:35.715213+0000","last_clean":"2024-04-03T05:14:35.715213+0000","last_became_active":"2024-04-03T03:38:26.745102+0000","last_became_peered":"2024-04-03T03:38:26.745102+0000","last_unstale":"2024-04-03T05:14:35.715213+0000","last_undegraded":"2024-04-03T05:14:35.715213+0000","last_fullsized":"2024-04-03T05:14:35.715213+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'703","last_scrub_stamp":"2024-04-03T05:14:35.714946+0000","last_deep_scrub":"263'703","last_deep_scrub_stamp":"2024-04-03T05:14:35.714946+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.714946+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T11:24:00.065707+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3146,"num_read_kb":2819,"num_write":922,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":951,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'360","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:59.205560+0000","last_change":"2024-04-03T05:14:59.205560+0000","last_active":"2024-04-03T05:14:59.205560+0000","last_peered":"2024-04-03T05:14:59.205560+0000","last_clean":"2024-04-03T05:14:59.205560+0000","last_became_active":"2024-04-03T03:38:24.729149+0000","last_became_peered":"2024-04-03T03:38:24.729149+0000","last_unstale":"2024-04-03T05:14:59.205560+0000","last_undegraded":"2024-04-03T05:14:59.205560+0000","last_fullsized":"2024-04-03T05:14:59.205560+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-04-03T05:14:59.205212+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-04-03T05:14:59.205212+0000","last_clean_scrub_stamp":"2024-04-03T05:14:59.205212+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:40:05.455836+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3498280,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":538,"num_read_kb":15990,"num_write":1205,"num_write_kb":30672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'377","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:42.889640+0000","last_change":"2024-04-03T05:14:42.889640+0000","last_active":"2024-04-03T05:14:42.889640+0000","last_peered":"2024-04-03T05:14:42.889640+0000","last_clean":"2024-04-03T05:14:42.889640+0000","last_became_active":"2024-04-03T03:38:26.713796+0000","last_became_peered":"2024-04-03T03:38:26.713796+0000","last_unstale":"2024-04-03T05:14:42.889640+0000","last_undegraded":"2024-04-03T05:14:42.889640+0000","last_fullsized":"2024-04-03T05:14:42.889640+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-04-03T05:14:42.889374+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-04-03T05:14:42.889374+0000","last_clean_scrub_stamp":"2024-04-03T05:14:42.889374+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T06:08:07.315889+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2155,"num_read_kb":2080,"num_write":414,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'297","reported_seq":939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:43.173645+0000","last_change":"2024-04-03T05:14:43.173645+0000","last_active":"2024-04-03T05:14:43.173645+0000","last_peered":"2024-04-03T05:14:43.173645+0000","last_clean":"2024-04-03T05:14:43.173645+0000","last_became_active":"2024-04-03T03:38:24.749152+0000","last_became_peered":"2024-04-03T03:38:24.749152+0000","last_unstale":"2024-04-03T05:14:43.173645+0000","last_undegraded":"2024-04-03T05:14:43.173645+0000","last_fullsized":"2024-04-03T05:14:43.173645+0000","mapping_epoch":23,"log_start":"263'200","ondisk_log_start":"263'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-04-03T05:14:43.173314+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-04-03T05:14:43.173314+0000","last_clean_scrub_stamp":"2024-04-03T05:14:43.173314+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T08:25:55.157887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":381,"num_read_kb":32536,"num_write":1044,"num_write_kb":42333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1010","reported_seq":2666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:46.256798+0000","last_change":"2024-04-03T05:14:46.256798+0000","last_active":"2024-04-03T05:14:46.256798+0000","last_peered":"2024-04-03T05:14:46.256798+0000","last_clean":"2024-04-03T05:14:46.256798+0000","last_became_active":"2024-04-03T03:38:26.729124+0000","last_became_peered":"2024-04-03T03:38:26.729124+0000","last_unstale":"2024-04-03T05:14:46.256798+0000","last_undegraded":"2024-04-03T05:14:46.256798+0000","last_fullsized":"2024-04-03T05:14:46.256798+0000","mapping_epoch":25,"log_start":"263'900","ondisk_log_start":"263'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1010","last_scrub_stamp":"2024-04-03T05:14:46.256335+0000","last_deep_scrub":"263'1010","last_deep_scrub_stamp":"2024-04-03T05:14:46.256335+0000","last_clean_scrub_stamp":"2024-04-03T05:14:46.256335+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":900,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:57:56.531035+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4687,"num_read_kb":4082,"num_write":1459,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'345","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:57.884652+0000","last_change":"2024-04-03T05:14:57.884776+0000","last_active":"2024-04-03T05:14:57.884652+0000","last_peered":"2024-04-03T05:14:57.884652+0000","last_clean":"2024-04-03T05:14:57.884652+0000","last_became_active":"2024-04-03T03:38:24.731586+0000","last_became_peered":"2024-04-03T03:38:24.731586+0000","last_unstale":"2024-04-03T05:14:57.884652+0000","last_undegraded":"2024-04-03T05:14:57.884652+0000","last_fullsized":"2024-04-03T05:14:57.884652+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-04-03T05:14:57.884425+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-04-03T05:14:57.884425+0000","last_clean_scrub_stamp":"2024-04-03T05:14:57.884425+0000","objects_scrubbed":13,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:50:01.162108+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282846,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":553,"num_read_kb":86610,"num_write":1391,"num_write_kb":58692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'367","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:47.265816+0000","last_change":"2024-04-03T05:14:47.265816+0000","last_active":"2024-04-03T05:14:47.265816+0000","last_peered":"2024-04-03T05:14:47.265816+0000","last_clean":"2024-04-03T05:14:47.265816+0000","last_became_active":"2024-04-03T03:38:26.728070+0000","last_became_peered":"2024-04-03T03:38:26.728070+0000","last_unstale":"2024-04-03T05:14:47.265816+0000","last_undegraded":"2024-04-03T05:14:47.265816+0000","last_fullsized":"2024-04-03T05:14:47.265816+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-04-03T05:14:47.265527+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-04-03T05:14:47.265527+0000","last_clean_scrub_stamp":"2024-04-03T05:14:47.265527+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T15:33:55.186925+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2004,"num_read_kb":1922,"num_write":414,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":964,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'366","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:35.476360+0000","last_change":"2024-04-03T05:14:35.476477+0000","last_active":"2024-04-03T05:14:35.476360+0000","last_peered":"2024-04-03T05:14:35.476360+0000","last_clean":"2024-04-03T05:14:35.476360+0000","last_became_active":"2024-04-03T03:38:24.725969+0000","last_became_peered":"2024-04-03T03:38:24.725969+0000","last_unstale":"2024-04-03T05:14:35.476360+0000","last_undegraded":"2024-04-03T05:14:35.476360+0000","last_fullsized":"2024-04-03T05:14:35.476360+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-04-03T05:14:35.476124+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-04-03T05:14:35.476124+0000","last_clean_scrub_stamp":"2024-04-03T05:14:35.476124+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T09:50:57.988501+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2360956,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":552,"num_read_kb":62664,"num_write":1296,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'467","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:44.889009+0000","last_change":"2024-04-03T05:14:44.889075+0000","last_active":"2024-04-03T05:14:44.889009+0000","last_peered":"2024-04-03T05:14:44.889009+0000","last_clean":"2024-04-03T05:14:44.889009+0000","last_became_active":"2024-04-03T03:38:26.705142+0000","last_became_peered":"2024-04-03T03:38:26.705142+0000","last_unstale":"2024-04-03T05:14:44.889009+0000","last_undegraded":"2024-04-03T05:14:44.889009+0000","last_fullsized":"2024-04-03T05:14:44.889009+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'467","last_scrub_stamp":"2024-04-03T05:14:44.888820+0000","last_deep_scrub":"263'467","last_deep_scrub_stamp":"2024-04-03T05:14:44.888820+0000","last_clean_scrub_stamp":"2024-04-03T05:14:44.888820+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:06:13.346374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2439,"num_read_kb":2283,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'321","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:15:00.329990+0000","last_change":"2024-04-03T05:15:00.330092+0000","last_active":"2024-04-03T05:15:00.329990+0000","last_peered":"2024-04-03T05:15:00.329990+0000","last_clean":"2024-04-03T05:15:00.329990+0000","last_became_active":"2024-04-03T03:38:24.748843+0000","last_became_peered":"2024-04-03T03:38:24.748843+0000","last_unstale":"2024-04-03T05:15:00.329990+0000","last_undegraded":"2024-04-03T05:15:00.329990+0000","last_fullsized":"2024-04-03T05:15:00.329990+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-04-03T05:15:00.329776+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-04-03T05:15:00.329776+0000","last_clean_scrub_stamp":"2024-04-03T05:15:00.329776+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:05:39.257695+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":1436,"num_write":1076,"num_write_kb":18869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'325","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:55.340284+0000","last_change":"2024-04-03T05:14:55.340509+0000","last_active":"2024-04-03T05:14:55.340284+0000","last_peered":"2024-04-03T05:14:55.340284+0000","last_clean":"2024-04-03T05:14:55.340284+0000","last_became_active":"2024-04-03T03:38:24.737358+0000","last_became_peered":"2024-04-03T03:38:24.737358+0000","last_unstale":"2024-04-03T05:14:55.340284+0000","last_undegraded":"2024-04-03T05:14:55.340284+0000","last_fullsized":"2024-04-03T05:14:55.340284+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-04-03T05:14:55.340012+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-04-03T05:14:55.340012+0000","last_clean_scrub_stamp":"2024-04-03T05:14:55.340012+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T10:15:38.660539+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5528791,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":543,"num_read_kb":13846,"num_write":1342,"num_write_kb":46293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'653","reported_seq":2349,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:54.210045+0000","last_change":"2024-04-03T05:14:54.210110+0000","last_active":"2024-04-03T05:14:54.210045+0000","last_peered":"2024-04-03T05:14:54.210045+0000","last_clean":"2024-04-03T05:14:54.210045+0000","last_became_active":"2024-04-03T03:38:26.717854+0000","last_became_peered":"2024-04-03T03:38:26.717854+0000","last_unstale":"2024-04-03T05:14:54.210045+0000","last_undegraded":"2024-04-03T05:14:54.210045+0000","last_fullsized":"2024-04-03T05:14:54.210045+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'653","last_scrub_stamp":"2024-04-03T05:14:54.209856+0000","last_deep_scrub":"263'653","last_deep_scrub_stamp":"2024-04-03T05:14:54.209856+0000","last_clean_scrub_stamp":"2024-04-03T05:14:54.209856+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T16:30:34.144339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3358,"num_read_kb":3036,"num_write":900,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'386","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:52.538889+0000","last_change":"2024-04-03T05:14:52.539008+0000","last_active":"2024-04-03T05:14:52.538889+0000","last_peered":"2024-04-03T05:14:52.538889+0000","last_clean":"2024-04-03T05:14:52.538889+0000","last_became_active":"2024-04-03T03:38:24.730312+0000","last_became_peered":"2024-04-03T03:38:24.730312+0000","last_unstale":"2024-04-03T05:14:52.538889+0000","last_undegraded":"2024-04-03T05:14:52.538889+0000","last_fullsized":"2024-04-03T05:14:52.538889+0000","mapping_epoch":23,"log_start":"263'300","ondisk_log_start":"263'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-04-03T05:14:52.538689+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-04-03T05:14:52.538689+0000","last_clean_scrub_stamp":"2024-04-03T05:14:52.538689+0000","objects_scrubbed":11,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:31:29.371664+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342930,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":661,"num_read_kb":19035,"num_write":1410,"num_write_kb":53256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'684","reported_seq":2073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-04-03T05:14:41.474091+0000","last_change":"2024-04-03T05:14:41.474091+0000","last_active":"2024-04-03T05:14:41.474091+0000","last_peered":"2024-04-03T05:14:41.474091+0000","last_clean":"2024-04-03T05:14:41.474091+0000","last_became_active":"2024-04-03T03:38:26.728038+0000","last_became_peered":"2024-04-03T03:38:26.728038+0000","last_unstale":"2024-04-03T05:14:41.474091+0000","last_undegraded":"2024-04-03T05:14:41.474091+0000","last_fullsized":"2024-04-03T05:14:41.474091+0000","mapping_epoch":25,"log_start":"263'600","ondisk_log_start":"263'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'684","last_scrub_stamp":"2024-04-03T05:14:41.473712+0000","last_deep_scrub":"263'684","last_deep_scrub_stamp":"2024-04-03T05:14:41.473712+0000","last_clean_scrub_stamp":"2024-04-03T05:14:41.473712+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-04T12:42:30.144906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3172,"num_read_kb":2837,"num_write":928,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2155,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":195556,"num_write":183,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5643,"num_read_kb":4008,"num_write":2168,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3956,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1288,"ondisk_log_size":1288,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":11006,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":12265,"num_read_kb":12111,"num_write":14239,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1890,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":22012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2622,"ondisk_log_size":2622,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":375,"ondisk_log_size":375,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1532186,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":19519,"num_read_kb":39189,"num_write":16363,"num_write_kb":11731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":630684,"num_omap_keys":1484,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1566,"ondisk_log_size":1566,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1711,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1602,"num_read_kb":1902,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":189133,"num_read_kb":172083,"num_write":51171,"num_write_kb":17715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":121,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40470,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4102,"ondisk_log_size":4102,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":162411735,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":0,"num_read":35354,"num_read_kb":2539931,"num_write":77944,"num_write_kb":2266597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":246079488,"data_stored":246079488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3564,"ondisk_log_size":3564,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":216081,"num_write":183,"num_write_kb":137174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510612,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":352532,"kb_used_data":46476,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94019308,"statfs":{"total":96636764160,"available":96275771392,"internally_reserved":0,"allocated":47591424,"data_stored":45521294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":313391562},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510614,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305720,"kb_used_data":44080,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94066120,"statfs":{"total":96636764160,"available":96323706880,"internally_reserved":0,"allocated":45137920,"data_stored":43104262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510611,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183136,"kb_used_data":35416,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94188704,"statfs":{"total":96636764160,"available":96449232896,"internally_reserved":0,"allocated":36265984,"data_stored":34171288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510610,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141844,"kb_used_data":38476,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94229996,"statfs":{"total":96636764160,"available":96491515904,"internally_reserved":0,"allocated":39399424,"data_stored":37369253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":105839047},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543318,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305028,"kb_used_data":48956,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94066812,"statfs":{"total":96636764160,"available":96324415488,"internally_reserved":0,"allocated":50130944,"data_stored":48057944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543318,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132128,"kb_used_data":38488,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94239712,"statfs":{"total":96636764160,"available":96501465088,"internally_reserved":0,"allocated":39411712,"data_stored":37394593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95877574},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543315,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":203096,"kb_used_data":41488,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94168744,"statfs":{"total":96636764160,"available":96428793856,"internally_reserved":0,"allocated":42483712,"data_stored":40444668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543316,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303500,"kb_used_data":47428,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94068340,"statfs":{"total":96636764160,"available":96325980160,"internally_reserved":0,"allocated":48566272,"data_stored":46507952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262207941},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28962816,"data_stored":28962816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32927744,"data_stored":32927744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24633344,"data_stored":24633344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32149504,"data_stored":32149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32997376,"data_stored":32997376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":31895552,"data_stored":31895552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29294592,"data_stored":29294592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":33218560,"data_stored":33218560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-03T05:15:19.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-03T05:15:19.705 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-03T05:15:19.705 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-03T05:15:19.705 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-03T05:15:19.705 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:25.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-03T05:15:25.808 INFO:tasks.ceph.osd.0:Stopped 2024-04-03T05:15:25.808 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-03T05:15:25.808 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:31.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-03T05:15:31.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-03T05:15:31.910 INFO:tasks.ceph.osd.1:Stopped 2024-04-03T05:15:31.911 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-03T05:15:31.911 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:32.005 INFO:tasks.ceph.osd.2:Stopped 2024-04-03T05:15:32.005 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-03T05:15:32.005 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:37.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-03T05:15:37.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-03T05:15:38.107 INFO:tasks.ceph.osd.3:Stopped 2024-04-03T05:15:38.107 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-03T05:15:38.107 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:38.198 INFO:tasks.ceph.osd.4:Stopped 2024-04-03T05:15:38.198 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-03T05:15:38.199 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:38.298 INFO:tasks.ceph.osd.5:Stopped 2024-04-03T05:15:38.298 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-03T05:15:38.298 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:43.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-03T05:15:43.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-03T05:15:44.400 INFO:tasks.ceph.osd.6:Stopped 2024-04-03T05:15:44.400 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-03T05:15:44.400 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:48.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-03T05:15:48.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-03T05:15:50.502 INFO:tasks.ceph.osd.7:Stopped 2024-04-03T05:15:50.503 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-03T05:15:50.503 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-03T05:15:50.503 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:50.533 INFO:tasks.ceph.mgr.y:Stopped 2024-04-03T05:15:50.534 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-03T05:15:50.534 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:50.562 INFO:tasks.ceph.mgr.x:Stopped 2024-04-03T05:15:50.562 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-03T05:15:50.562 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-03T05:15:50.563 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:50.601 INFO:tasks.ceph.mon.a:Stopped 2024-04-03T05:15:50.601 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-03T05:15:50.601 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:50.661 INFO:tasks.ceph.mon.c:Stopped 2024-04-03T05:15:50.662 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-03T05:15:50.662 INFO:teuthology.orchestra.run:waiting for 300 2024-04-03T05:15:50.692 INFO:tasks.ceph.mon.b:Stopped 2024-04-03T05:15:50.692 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-03T05:15:50.692 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-04-03T05:15:50.721 INFO:teuthology.orchestra.run.smithi104.stdout:2024-04-03T03:40:00.000124+0000 mon.a (mon.0) 296 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg peering 2024-04-03T05:15:50.721 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-04-03T05:15:50.721 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-04-03T05:15:50.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-04-03T05:15:50.831 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-04-03T05:15:50.886 INFO:teuthology.orchestra.run.smithi104.stdout:2024-04-03T03:40:00.000124+0000 mon.a (mon.0) 296 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg peering 2024-04-03T05:15:50.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T05:15:50.886 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-03T05:15:51.252 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T05:15:51.252 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-03T05:15:51.484 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T05:15:51.484 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-03T05:15:51.657 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T05:15:51.657 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-03T05:15:51.855 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T05:15:51.857 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-03T05:15:52.057 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T05:15:52.057 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-03T05:15:52.276 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T05:15:52.276 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-03T05:15:52.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T05:15:52.477 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-03T05:15:52.662 INFO:tasks.ceph:Archiving mon data... 2024-04-03T05:15:52.663 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/data/mon.a.tgz 2024-04-03T05:15:52.663 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-04-03T05:15:52.670 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.OBJfnJSQ7C 2024-04-03T05:15:52.670 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OBJfnJSQ7C 2024-04-03T05:15:52.848 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.OBJfnJSQ7C 2024-04-03T05:15:52.910 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.OBJfnJSQ7C is 547KB 2024-04-03T05:15:52.971 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.OBJfnJSQ7C 2024-04-03T05:15:52.976 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/data/mon.c.tgz 2024-04-03T05:15:52.976 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-04-03T05:15:53.022 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.CV7Fyv8g1W 2024-04-03T05:15:53.022 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.CV7Fyv8g1W 2024-04-03T05:15:53.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.CV7Fyv8g1W 2024-04-03T05:15:53.270 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.CV7Fyv8g1W is 561KB 2024-04-03T05:15:53.336 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.CV7Fyv8g1W 2024-04-03T05:15:53.342 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/data/mon.b.tgz 2024-04-03T05:15:53.342 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-04-03T05:15:53.348 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.tU6UX9tQSS 2024-04-03T05:15:53.348 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.tU6UX9tQSS 2024-04-03T05:15:53.532 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.tU6UX9tQSS 2024-04-03T05:15:53.595 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.tU6UX9tQSS is 562KB 2024-04-03T05:15:53.658 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.tU6UX9tQSS 2024-04-03T05:15:53.663 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-03T05:15:53.663 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-03T05:15:53.666 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-03T05:15:53.781 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-03T05:15:53.787 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-03T05:15:53.787 INFO:tasks.ceph:Archiving crash dumps... 2024-04-03T05:15:53.789 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/remote/smithi104/crash 2024-04-03T05:15:53.790 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-03T05:15:53.804 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/remote/smithi130/crash 2024-04-03T05:15:53.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-03T05:15:53.844 INFO:tasks.ceph:Compressing logs... 2024-04-03T05:15:53.844 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-03T05:15:53.855 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-03T05:15:53.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-03T05:15:53.877 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50962.log 2024-04-03T05:15:53.877 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2024-04-03T05:15:53.878 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102940.log 2024-04-03T05:15:53.878 INFO:teuthology.orchestra.run.smithi104.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.50962.log.gz 2024-04-03T05:15:53.880 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.127234.log 2024-04-03T05:15:53.880 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2024-04-03T05:15:53.880 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.102940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100580.log 2024-04-03T05:15:53.880 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.127234.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102940.log.gz 2024-04-03T05:15:53.880 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-03T05:15:53.880 INFO:teuthology.orchestra.run.smithi104.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.127234.log.gz 2024-04-03T05:15:53.880 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.100580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57721.log 2024-04-03T05:15:53.880 INFO:teuthology.orchestra.run.smithi104.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.100580.log.gz 2024-04-03T05:15:53.880 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30567.log 2024-04-03T05:15:53.882 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107093.log 2024-04-03T05:15:53.882 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130553.log 2024-04-03T05:15:53.882 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30567.log.gz 2024-04-03T05:15:53.882 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.107093.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-03T05:15:53.882 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107093.log.gz 2024-04-03T05:15:53.883 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.130553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130553.log.gz 2024-04-03T05:15:53.883 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125464.log 2024-04-03T05:15:53.883 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58364.log 2024-04-03T05:15:53.883 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.0.125464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83470.log 2024-04-03T05:15:53.886 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58364.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.125464.log.gz 2024-04-03T05:15:53.886 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46192.log 2024-04-03T05:15:53.886 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.83470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76980.log 2024-04-03T05:15:53.886 INFO:teuthology.orchestra.run.smithi104.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.83470.log.gz 2024-04-03T05:15:53.886 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111273.log 2024-04-03T05:15:53.886 INFO:teuthology.orchestra.run.smithi104.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.46192.log.gz 2024-04-03T05:15:53.886 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.76980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111913.log 2024-04-03T05:15:53.886 INFO:teuthology.orchestra.run.smithi104.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.76980.log.gz 2024-04-03T05:15:53.886 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58364.log.gz 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.111273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131266.log 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111273.log.gz 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.57721.log.gz 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.111913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131241.log 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.131266.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111913.log.gz 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.126054.log 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131266.log.gz 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.131241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90550.log 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131241.log.gz 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.126054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134237.log 2024-04-03T05:15:53.887 INFO:teuthology.orchestra.run.smithi104.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.126054.log.gz 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.90550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85240.log 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90550.log.gz 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74620.log 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134237.log.gz 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.85240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30983.log 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.85240.log.gz 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.74620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.123104.log 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30983.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74620.log.gz 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30983.log.gz 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.123104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59007.log 2024-04-03T05:15:53.892 INFO:teuthology.orchestra.run.smithi104.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.123104.log.gz 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116428.log 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60936.log 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.116428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105301.log 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134133.log 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.105301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54011.log 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr: 82.0% 93.3% -- replaced with /var/log/ceph/ceph-client.admin.116428.log.gz 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105301.log.gz 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59007.log.gz 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134133.log.gz 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.60936.log.gz 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54560.log 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71670.log 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr: 56.0% -- replaced with /var/log/ceph/ceph-client.admin.54011.log.gz 2024-04-03T05:15:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96450.log 2024-04-03T05:15:53.900 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.71670.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.54560.log.gz 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106481.log 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71670.log.gz 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.96450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86420.log 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.96450.log.gz 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.106481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133925.log 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.106481.log.gz 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40192.log 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.86420.log: /var/log/ceph/ceph-client.admin.133925.log: gzip -5 82.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.86420.log.gz 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-client.admin.129940.log 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133925.log.gz 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134263.log 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.129940.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.40192.log.gz 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108273.log 2024-04-03T05:15:53.901 INFO:teuthology.orchestra.run.smithi104.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.129940.log.gz 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134263.log.gz 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97630.log 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.108273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40832.log 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.108273.log.gz 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31225.log 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.97630.log.gz 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134055.log 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40832.log: /var/log/ceph/ceph-client.admin.31225.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.40832.log.gz 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75800.log 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31225.log.gz 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134055.log.gzgzip 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.134315.log 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.75800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30982.log 2024-04-03T05:15:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134315.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.75800.log.gz 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134315.log.gz 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38422.log 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30445.log 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30982.log.gz 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38422.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.38422.log.gz 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30445.log.gz 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31173.log 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89960.log 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.31173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32278.log 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31173.log.gz 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.89960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134003.log 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.89960.log.gz 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30764.log 2024-04-03T05:15:53.903 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32278.log.gz 2024-04-03T05:15:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134003.log.gzgzip 2024-04-03T05:15:53.904 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.131914.log 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.126644.log 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30764.log.gz 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.131914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107683.log 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.131914.log.gz 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132510.log 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.126644.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.126644.log.gz 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.107683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110068.log 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46782.log 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.107683.log.gz 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.132510.log: /var/log/ceph/ceph-client.admin.110068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115171.log 2024-04-03T05:15:53.907 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110068.log.gz 2024-04-03T05:15:53.908 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80520.log 2024-04-03T05:15:53.908 INFO:teuthology.orchestra.run.smithi104.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.46782.log.gz/var/log/ceph/ceph-client.admin.115171.log: 2024-04-03T05:15:53.908 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-03T05:15:53.908 INFO:teuthology.orchestra.run.smithi104.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.115171.log.gz 2024-04-03T05:15:53.908 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.80520.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.80520.log.gz 2024-04-03T05:15:53.908 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48552.log 2024-04-03T05:15:53.908 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95860.log 2024-04-03T05:15:53.908 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69308.log 2024-04-03T05:15:53.908 INFO:teuthology.orchestra.run.smithi104.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.48552.log.gz 2024-04-03T05:15:53.909 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95860.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.95860.log.gz 2024-04-03T05:15:53.910 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43832.log 2024-04-03T05:15:53.910 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.69308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30569.log 2024-04-03T05:15:53.910 INFO:teuthology.orchestra.run.smithi104.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.69308.log.gz 2024-04-03T05:15:53.910 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43832.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.43832.log.gz 2024-04-03T05:15:53.910 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61579.log 2024-04-03T05:15:53.911 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103530.log 2024-04-03T05:15:53.913 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30569.log.gz 2024-04-03T05:15:53.915 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61579.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61579.log.gz 2024-04-03T05:15:53.915 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79930.log 2024-04-03T05:15:53.915 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39012.log 2024-04-03T05:15:53.915 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.103530.log: /var/log/ceph/ceph-client.admin.79930.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103530.log.gz 2024-04-03T05:15:53.916 INFO:teuthology.orchestra.run.smithi104.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.79930.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104120.log 2024-04-03T05:15:53.916 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-03T05:15:53.916 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39012.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.39012.log.gz 2024-04-03T05:15:53.916 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69900.log 2024-04-03T05:15:53.916 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36455.log 2024-04-03T05:15:53.916 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.104120.log: /var/log/ceph/ceph-client.admin.69900.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104120.log.gz 2024-04-03T05:15:53.919 INFO:teuthology.orchestra.run.smithi104.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.69900.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56435.log 2024-04-03T05:15:53.919 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-03T05:15:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.36455.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36455.log.gz 2024-04-03T05:15:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75210.log 2024-04-03T05:15:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44422.log 2024-04-03T05:15:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56435.log: /var/log/ceph/ceph-client.admin.75210.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.75210.log.gz 2024-04-03T05:15:53.921 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-03T05:15:53.921 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-03T05:15:53.921 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25418.log 2024-04-03T05:15:53.921 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25394.log 2024-04-03T05:15:53.921 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25418.log.gz 2024-04-03T05:15:53.921 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25442.log 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25370.log 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25394.log.gz 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25442.log.gz 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25370.log.gz 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25466.log 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25490.log 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.25466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25466.log.gz 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25490.log.gz 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-03T05:15:53.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-03T05:15:53.925 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25514.log 2024-04-03T05:15:53.926 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.4.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-03T05:15:53.926 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25538.log 2024-04-03T05:15:53.926 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25514.log.gz 2024-04-03T05:15:53.926 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.25538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25538.log.gz 2024-04-03T05:15:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113990.log 2024-04-03T05:15:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44422.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.44422.log.gz 2024-04-03T05:15:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94680.log 2024-04-03T05:15:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.113990.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.56435.log.gz 2024-04-03T05:15:53.927 INFO:teuthology.orchestra.run.smithi104.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.113990.log.gz 2024-04-03T05:15:53.928 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59650.log 2024-04-03T05:15:53.928 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134107.log 2024-04-03T05:15:53.928 INFO:teuthology.orchestra.run.smithi104.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94680.log.gz 2024-04-03T05:15:53.928 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30565.log 2024-04-03T05:15:53.928 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134107.log.gz 2024-04-03T05:15:53.928 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51602.log 2024-04-03T05:15:53.928 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30565.log.gz 2024-04-03T05:15:53.929 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67342.log 2024-04-03T05:15:53.929 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51602.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.51602.log.gz 2024-04-03T05:15:53.929 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102350.log 2024-04-03T05:15:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.67342.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.67342.log.gz 2024-04-03T05:15:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49167.log 2024-04-03T05:15:53.931 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.102350.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.102350.log.gz 2024-04-03T05:15:53.931 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101760.log 2024-04-03T05:15:53.932 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49167.log.gz 2024-04-03T05:15:53.932 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.0.132510.log.gz 2024-04-03T05:15:53.933 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134367.log 2024-04-03T05:15:53.933 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.101760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91730.log 2024-04-03T05:15:53.934 INFO:teuthology.orchestra.run.smithi104.stderr: 86.3%/var/log/ceph/ceph-client.admin.134367.log: -- replaced with /var/log/ceph/ceph-client.admin.101760.log.gz 2024-04-03T05:15:53.934 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134367.log.gz 2024-04-03T05:15:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82880.log 2024-04-03T05:15:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.91730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52192.log 2024-04-03T05:15:53.935 INFO:teuthology.orchestra.run.smithi104.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.91730.log.gz 2024-04-03T05:15:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.82880.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.82880.log.gz 2024-04-03T05:15:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30523.log 2024-04-03T05:15:53.937 INFO:teuthology.orchestra.run.smithi130.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-03T05:15:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131193.log 2024-04-03T05:15:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52192.log: /var/log/ceph/ceph-client.admin.30523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30523.log.gz 86.3% -- replaced with /var/log/ceph/ceph-client.admin.52192.log.gz 2024-04-03T05:15:53.938 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-03T05:15:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-03T05:15:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51552.log 2024-04-03T05:15:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.131193.log: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.131193.log.gz 2024-04-03T05:15:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111888.log 2024-04-03T05:15:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51552.log: 28.3% -- replaced with /var/log/ceph/ceph-client.admin.51552.log.gz 2024-04-03T05:15:53.940 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82290.log 2024-04-03T05:15:53.940 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.111888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111888.log.gz 2024-04-03T05:15:53.940 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110093.log 2024-04-03T05:15:53.941 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.82290.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.82290.log.gz 2024-04-03T05:15:53.941 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49142.log 2024-04-03T05:15:53.942 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.110093.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110093.log.gz 2024-04-03T05:15:53.943 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62222.log 2024-04-03T05:15:53.943 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49142.log.gz 2024-04-03T05:15:53.944 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31011.log 2024-04-03T05:15:53.949 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62222.log: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.59650.log.gz 2024-04-03T05:15:53.949 INFO:teuthology.orchestra.run.smithi104.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.62222.log.gz 2024-04-03T05:15:53.950 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30773.log 2024-04-03T05:15:53.950 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73440.log 2024-04-03T05:15:53.950 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31011.log.gz 2024-04-03T05:15:53.950 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30773.log.gz 2024-04-03T05:15:53.951 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47372.log 2024-04-03T05:15:53.951 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64336.log 2024-04-03T05:15:53.951 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.73440.log: /var/log/ceph/ceph-client.admin.47372.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.73440.log.gz 2024-04-03T05:15:53.951 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.47372.log.gz 2024-04-03T05:15:53.951 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112503.log 2024-04-03T05:15:53.952 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117017.log 2024-04-03T05:15:53.953 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64336.log: /var/log/ceph/ceph-client.admin.112503.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.64336.log.gz 2024-04-03T05:15:53.953 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105891.log 2024-04-03T05:15:53.953 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112503.log.gz 2024-04-03T05:15:53.953 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.117017.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.117017.log.gz 2024-04-03T05:15:53.954 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60293.log 2024-04-03T05:15:53.954 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89370.log 2024-04-03T05:15:53.955 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.105891.log: /var/log/ceph/ceph-client.admin.60293.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105891.log.gz 2024-04-03T05:15:53.956 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77570.log 2024-04-03T05:15:53.957 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.89370.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89370.log.gz 2024-04-03T05:15:53.957 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43192.log 2024-04-03T05:15:53.957 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.77570.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.60293.log.gz 2024-04-03T05:15:53.957 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77570.log.gz 2024-04-03T05:15:53.957 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-04-03T05:15:53.957 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78160.log 2024-04-03T05:15:53.958 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43192.log.gz 2024-04-03T05:15:53.958 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40782.log 2024-04-03T05:15:53.959 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.78160.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.78160.log.gz 2024-04-03T05:15:53.959 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30774.log 2024-04-03T05:15:53.959 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40782.log.gz 2024-04-03T05:15:53.960 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134185.log 2024-04-03T05:15:53.960 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30774.log.gz 2024-04-03T05:15:53.961 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-03T05:15:53.961 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134185.log.gz 2024-04-03T05:15:53.962 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95270.log 2024-04-03T05:15:53.963 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.1.log: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-04-03T05:15:53.964 INFO:teuthology.orchestra.run.smithi130.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-03T05:15:53.978 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30771.log 2024-04-03T05:15:53.979 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.95270.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95270.log.gz 2024-04-03T05:15:53.979 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108863.log 2024-04-03T05:15:53.980 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30771.log.gz 2024-04-03T05:15:53.980 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53753.log 2024-04-03T05:15:53.981 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.108863.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.108863.log.gz 2024-04-03T05:15:53.981 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31010.log 2024-04-03T05:15:53.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53753.log: 49.4% -- replaced with /var/log/ceph/ceph-client.admin.53753.log.gz 2024-04-03T05:15:53.982 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93500.log 2024-04-03T05:15:53.983 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31010.log.gz 2024-04-03T05:15:53.983 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68612.log 2024-04-03T05:15:53.984 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.93500.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.93500.log.gz 2024-04-03T05:15:53.985 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124874.log 2024-04-03T05:15:53.986 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.68612.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.68612.log.gz 2024-04-03T05:15:53.986 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54526.log 2024-04-03T05:15:53.987 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.124874.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.124874.log.gz 2024-04-03T05:15:53.987 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30777.log 2024-04-03T05:15:53.988 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54526.log: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.54526.log.gz 2024-04-03T05:15:53.988 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124284.log 2024-04-03T05:15:53.989 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30777.log.gz 2024-04-03T05:15:53.989 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133847.log 2024-04-03T05:15:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.124284.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.124284.log.gz 2024-04-03T05:15:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130603.log 2024-04-03T05:15:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.133847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133847.log.gz 2024-04-03T05:15:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121914.log 2024-04-03T05:15:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.130603.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.130603.log.gz 2024-04-03T05:15:53.993 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120691.log 2024-04-03T05:15:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.121914.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.121914.log.gz 2024-04-03T05:15:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43217.log 2024-04-03T05:15:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.120691.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.120691.log.gz 2024-04-03T05:15:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33523.log 2024-04-03T05:15:53.998 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43217.log.gz 2024-04-03T05:15:53.998 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74030.log 2024-04-03T05:15:53.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.33523.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.33523.log.gz 2024-04-03T05:15:53.999 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30757.log 2024-04-03T05:15:54.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.74030.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.74030.log.gz 2024-04-03T05:15:54.000 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118924.log 2024-04-03T05:15:54.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30757.log.gz 2024-04-03T05:15:54.001 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67983.log 2024-04-03T05:15:54.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.118924.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.118924.log.gz 2024-04-03T05:15:54.003 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30784.log 2024-04-03T05:15:54.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.67983.log: 47.0% -- replaced with /var/log/ceph/ceph-client.admin.67983.log.gz 2024-04-03T05:15:54.004 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113093.log 2024-04-03T05:15:54.005 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30784.log.gz 2024-04-03T05:15:54.005 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34697.log 2024-04-03T05:15:54.006 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.113093.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.113093.log.gz 2024-04-03T05:15:54.006 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30396.log 2024-04-03T05:15:54.007 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.34697.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.34697.log.gz 2024-04-03T05:15:54.007 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.123694.log 2024-04-03T05:15:54.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30396.log.gz 2024-04-03T05:15:54.008 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133977.log 2024-04-03T05:15:54.009 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.123694.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.123694.log.gz 2024-04-03T05:15:54.010 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50372.log 2024-04-03T05:15:54.010 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.133977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133977.log.gz 2024-04-03T05:15:54.011 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84060.log 2024-04-03T05:15:54.012 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50372.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50372.log.gz 2024-04-03T05:15:54.012 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52782.log 2024-04-03T05:15:54.013 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.84060.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.84060.log.gz 2024-04-03T05:15:54.013 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72260.log 2024-04-03T05:15:54.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52782.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.52782.log.gz 2024-04-03T05:15:54.014 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32230.log 2024-04-03T05:15:54.015 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.72260.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.72260.log.gz 2024-04-03T05:15:54.016 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-03T05:15:54.016 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32230.log.gz 2024-04-03T05:15:54.017 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118195.log 2024-04-03T05:15:54.030 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99990.log 2024-04-03T05:15:54.031 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.118195.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.118195.log.gz 2024-04-03T05:15:54.038 INFO:teuthology.orchestra.run.smithi104.stderr: 93.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25521.log 2024-04-03T05:15:54.038 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.99990.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-03T05:15:54.039 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99990.log.gz 2024-04-03T05:15:54.039 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63747.log 2024-04-03T05:15:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.25521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25521.log.gz 2024-04-03T05:15:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114582.log 2024-04-03T05:15:54.041 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63747.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.63747.log.gz 2024-04-03T05:15:54.041 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47962.log 2024-04-03T05:15:54.045 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.114582.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114582.log.gz 2024-04-03T05:15:54.045 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53961.log 2024-04-03T05:15:54.046 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47962.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.47962.log.gz 2024-04-03T05:15:54.046 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79340.log 2024-04-03T05:15:54.047 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53961.log.gz 2024-04-03T05:15:54.047 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41422.log 2024-04-03T05:15:54.048 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.79340.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79340.log.gz 2024-04-03T05:15:54.048 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134211.log 2024-04-03T05:15:54.049 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41422.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.41422.log.gz 2024-04-03T05:15:54.050 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110043.log 2024-04-03T05:15:54.051 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134211.log.gz 2024-04-03T05:15:54.051 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25637.log 2024-04-03T05:15:54.052 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.110043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110043.log.gz 2024-04-03T05:15:54.052 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133899.log 2024-04-03T05:15:54.053 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.25637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25637.log.gz 2024-04-03T05:15:54.053 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30785.log 2024-04-03T05:15:54.054 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.133899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133899.log.gz 2024-04-03T05:15:54.054 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30325.log 2024-04-03T05:15:54.055 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30785.log.gz 2024-04-03T05:15:54.055 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30984.log 2024-04-03T05:15:54.056 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30325.log.gz 2024-04-03T05:15:54.056 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97040.log 2024-04-03T05:15:54.057 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30984.log.gz 2024-04-03T05:15:54.057 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30471.log 2024-04-03T05:15:54.058 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.97040.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97040.log.gz 2024-04-03T05:15:54.058 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134159.log 2024-04-03T05:15:54.059 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30471.log.gz 2024-04-03T05:15:54.059 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85830.log 2024-04-03T05:15:54.060 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134159.log.gz 2024-04-03T05:15:54.060 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25374.log 2024-04-03T05:15:54.061 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.85830.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85830.log.gz 2024-04-03T05:15:54.062 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87010.log 2024-04-03T05:15:54.062 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.25374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25374.log.gz 2024-04-03T05:15:54.063 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32254.log 2024-04-03T05:15:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87010.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.87010.log.gz 2024-04-03T05:15:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87600.log 2024-04-03T05:15:54.065 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32254.log.gz 2024-04-03T05:15:54.065 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30969.log 2024-04-03T05:15:54.067 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.87600.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.87600.log.gz 2024-04-03T05:15:54.067 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-03T05:15:54.068 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30969.log.gz 2024-04-03T05:15:54.068 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78750.log 2024-04-03T05:15:54.082 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131292.log 2024-04-03T05:15:54.083 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.78750.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.78750.log.gz 2024-04-03T05:15:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133951.log 2024-04-03T05:15:54.107 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.131292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131292.log.gz 2024-04-03T05:15:54.114 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101170.log 2024-04-03T05:15:54.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.133951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133951.log.gz 2024-04-03T05:15:54.122 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109453.log 2024-04-03T05:15:54.122 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.101170.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.101170.log.gz 2024-04-03T05:15:54.130 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88190.log 2024-04-03T05:15:54.130 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.109453.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109453.log.gz 2024-04-03T05:15:54.142 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55792.log 2024-04-03T05:15:54.142 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.88190.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.88190.log.gz 2024-04-03T05:15:54.162 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71080.log 2024-04-03T05:15:54.162 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55792.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.55792.log.gz 2024-04-03T05:15:54.170 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65518.log 2024-04-03T05:15:54.170 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.71080.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.71080.log.gz 2024-04-03T05:15:54.178 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30576.log 2024-04-03T05:15:54.178 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65518.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.65518.log.gz 2024-04-03T05:15:54.198 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129350.log 2024-04-03T05:15:54.198 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30576.log.gz 2024-04-03T05:15:54.214 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104711.log 2024-04-03T05:15:54.214 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.129350.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.129350.log.gz 2024-04-03T05:15:54.230 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31199.log 2024-04-03T05:15:54.231 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.104711.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104711.log.gz 2024-04-03T05:15:54.238 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30985.log 2024-04-03T05:15:54.238 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31199.log.gz 2024-04-03T05:15:54.258 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30570.log 2024-04-03T05:15:54.258 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30985.log.gz 2024-04-03T05:15:54.270 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42012.log 2024-04-03T05:15:54.270 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30570.log.gz 2024-04-03T05:15:54.286 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134422.log 2024-04-03T05:15:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42012.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.42012.log.gz 2024-04-03T05:15:54.298 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-03T05:15:54.298 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134422.log.gz 2024-04-03T05:15:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32326.log 2024-04-03T05:15:54.330 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53682.log 2024-04-03T05:15:54.330 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32326.log.gz 2024-04-03T05:15:54.337 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70490.log 2024-04-03T05:15:54.338 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53682.log: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.53682.log.gz 2024-04-03T05:15:54.354 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92320.log 2024-04-03T05:15:54.354 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.70490.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.70490.log.gz 2024-04-03T05:15:54.371 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107071.log 2024-04-03T05:15:54.371 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.92320.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92320.log.gz 2024-04-03T05:15:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134446.log 2024-04-03T05:15:54.372 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.107071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107071.log.gz 2024-04-03T05:15:54.373 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-03T05:15:54.373 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134446.log.gz 2024-04-03T05:15:54.373 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91140.log 2024-04-03T05:15:54.377 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.audit.log: 94.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-03T05:15:54.377 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53466.log 2024-04-03T05:15:54.378 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.91140.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.91140.log.gz 2024-04-03T05:15:54.379 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30577.log 2024-04-03T05:15:54.379 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53466.log: 60.4% -- replaced with /var/log/ceph/ceph-client.admin.53466.log.gz 2024-04-03T05:15:54.379 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76390.log 2024-04-03T05:15:54.380 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30577.log.gz 2024-04-03T05:15:54.380 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20598.log 2024-04-03T05:15:54.381 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.76390.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.76390.log.gz 2024-04-03T05:15:54.381 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110683.log 2024-04-03T05:15:54.382 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.tmp-client.admin.20598.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20598.log.gz 2024-04-03T05:15:54.382 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39602.log 2024-04-03T05:15:54.383 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.110683.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110683.log.gz 2024-04-03T05:15:54.383 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30497.log 2024-04-03T05:15:54.384 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39602.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.39602.log.gz 2024-04-03T05:15:54.384 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128414.log 2024-04-03T05:15:54.385 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30497.log.gz 2024-04-03T05:15:54.385 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57078.log 2024-04-03T05:15:54.386 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.128414.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.128414.log.gz 2024-04-03T05:15:54.386 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53984.log 2024-04-03T05:15:54.391 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57078.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.57078.log.gz 2024-04-03T05:15:54.392 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30965.log 2024-04-03T05:15:54.406 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32939.log 2024-04-03T05:15:54.406 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30965.log.gz 2024-04-03T05:15:54.407 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64928.log 2024-04-03T05:15:54.407 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.32939.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.32939.log.gz 2024-04-03T05:15:54.410 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53984.log.gz 2024-04-03T05:15:54.410 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84650.log 2024-04-03T05:15:54.412 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64928.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.64928.log.gz 2024-04-03T05:15:54.412 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92910.log 2024-04-03T05:15:54.413 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.84650.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.84650.log.gz 2024-04-03T05:15:54.413 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-04-03T05:15:54.414 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.92910.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.92910.log.gz 2024-04-03T05:15:54.414 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134029.log 2024-04-03T05:15:54.415 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 62.8% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-04-03T05:15:54.415 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54034.log 2024-04-03T05:15:54.416 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134029.log.gz 2024-04-03T05:15:54.416 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117606.log 2024-04-03T05:15:54.418 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54034.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.54034.log.gz 2024-04-03T05:15:54.418 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98220.log 2024-04-03T05:15:54.418 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.117606.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.117606.log.gz 2024-04-03T05:15:54.419 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32349.log 2024-04-03T05:15:54.420 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.98220.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.98220.log.gz 2024-04-03T05:15:54.420 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32302.log 2024-04-03T05:15:54.423 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.32349.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.32349.log.gz 2024-04-03T05:15:54.423 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.127824.log 2024-04-03T05:15:54.423 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32302.log.gz 2024-04-03T05:15:54.423 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42602.log 2024-04-03T05:15:54.424 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.127824.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.127824.log.gz 2024-04-03T05:15:54.424 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34113.log 2024-04-03T05:15:54.425 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42602.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.42602.log.gz 2024-04-03T05:15:54.425 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88780.log 2024-04-03T05:15:54.426 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.34113.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.34113.log.gz 2024-04-03T05:15:54.426 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94090.log 2024-04-03T05:15:54.427 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.88780.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.88780.log.gz 2024-04-03T05:15:54.427 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30571.log 2024-04-03T05:15:54.428 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.94090.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94090.log.gz 2024-04-03T05:15:54.429 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30421.log 2024-04-03T05:15:54.429 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30571.log.gz 2024-04-03T05:15:54.430 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134081.log 2024-04-03T05:15:54.430 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30421.log.gz 2024-04-03T05:15:54.431 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81110.log 2024-04-03T05:15:54.431 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134081.log.gz 2024-04-03T05:15:54.432 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72850.log 2024-04-03T05:15:54.434 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.81110.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.81110.log.gz 2024-04-03T05:15:54.434 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111863.log 2024-04-03T05:15:54.435 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.72850.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.72850.log.gz 2024-04-03T05:15:54.435 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35871.log 2024-04-03T05:15:54.436 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.111863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111863.log.gz 2024-04-03T05:15:54.436 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66752.log 2024-04-03T05:15:54.437 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.35871.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.35871.log.gz 2024-04-03T05:15:54.437 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119513.log 2024-04-03T05:15:54.438 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.66752.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.66752.log.gz 2024-04-03T05:15:54.439 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99400.log 2024-04-03T05:15:54.439 INFO:teuthology.orchestra.run.smithi104.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-03T05:15:54.439 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.119513.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.119513.log.gz 2024-04-03T05:15:54.440 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35287.log 2024-04-03T05:15:54.440 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.99400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134393.log 2024-04-03T05:15:54.441 INFO:teuthology.orchestra.run.smithi104.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.99400.log.gz 2024-04-03T05:15:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.35287.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35287.log.gz 2024-04-03T05:15:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49782.log 2024-04-03T05:15:54.443 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133821.log 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134393.log.gz 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66700.log 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.49782.log.gz 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.133821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133821.log.gz 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51577.log 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133873.log 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.66700.log.gz 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51577.log.gz 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66109.log 2024-04-03T05:15:54.444 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.133873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133873.log.gz 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30563.log 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr: 82.8%/var/log/ceph/ceph-client.admin.43242.log: -- replaced with /var/log/ceph/ceph-client.admin.66109.log.gz 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gz 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40807.log 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37039.log 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30563.log.gz 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131216.log 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40807.log.gz 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.37039.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37039.log.gz 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68022.log 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.131216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62871.log 2024-04-03T05:15:54.448 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131216.log.gz 2024-04-03T05:15:54.449 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.68022.log: gzip -5 --verbose 92.0% -- /var/log/ceph/ceph-client.admin.49192.log -- replaced with /var/log/ceph/ceph-client.0.68022.log.gz 2024-04-03T05:15:54.450 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-03T05:15:54.450 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131317.log 2024-04-03T05:15:54.451 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62871.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.62871.log.gz/var/log/ceph/ceph-client.admin.49192.log: 2024-04-03T05:15:54.451 INFO:teuthology.orchestra.run.smithi104.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.49192.log.gz 2024-04-03T05:15:54.451 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134341.log 2024-04-03T05:15:54.452 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.131317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130530.log 2024-04-03T05:15:54.452 INFO:teuthology.orchestra.run.smithi104.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.131317.log.gz/var/log/ceph/ceph-client.admin.134341.log: 2024-04-03T05:15:54.452 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134341.log.gz 2024-04-03T05:15:54.452 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122503.log 2024-04-03T05:15:54.453 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.130530.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.130530.log.gz 2024-04-03T05:15:54.453 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55149.log 2024-04-03T05:15:54.454 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.122503.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.122503.log.gz 2024-04-03T05:15:54.454 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120102.log 2024-04-03T05:15:54.467 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55149.log: 94.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130578.log 2024-04-03T05:15:54.468 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.120102.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.120102.log.gz 2024-04-03T05:15:54.468 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134289.log 2024-04-03T05:15:54.469 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.130578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130578.log.gz 2024-04-03T05:15:54.469 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55149.log.gz 2024-04-03T05:15:54.470 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45012.log 2024-04-03T05:15:54.470 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.134289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134289.log.gz 2024-04-03T05:15:54.471 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98810.log 2024-04-03T05:15:54.471 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45012.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.45012.log.gz 2024-04-03T05:15:54.472 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81700.log 2024-04-03T05:15:54.472 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.98810.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.98810.log.gz 2024-04-03T05:15:54.473 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53920.log 2024-04-03T05:15:54.474 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.81700.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.81700.log.gz 2024-04-03T05:15:54.474 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53920.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53920.log.gz 2024-04-03T05:15:54.812 INFO:teuthology.orchestra.run.smithi104.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-03T05:15:55.011 INFO:teuthology.orchestra.run.smithi130.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-03T05:15:55.696 INFO:teuthology.orchestra.run.smithi104.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-03T05:15:57.237 INFO:teuthology.orchestra.run.smithi104.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-03T05:15:57.415 INFO:teuthology.orchestra.run.smithi104.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-03T05:16:03.093 INFO:teuthology.orchestra.run.smithi104.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-03T05:16:05.469 INFO:teuthology.orchestra.run.smithi130.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-03T05:16:05.637 INFO:teuthology.orchestra.run.smithi130.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-03T05:16:05.913 INFO:teuthology.orchestra.run.smithi104.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-03T05:16:06.136 INFO:teuthology.orchestra.run.smithi130.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-03T05:16:07.662 INFO:teuthology.orchestra.run.smithi130.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-03T05:16:07.664 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-04-03T05:16:07.664 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m13.773s 2024-04-03T05:16:07.664 INFO:teuthology.orchestra.run.smithi130.stderr:user 0m48.576s 2024-04-03T05:16:07.664 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m1.840s 2024-04-03T05:16:08.144 INFO:teuthology.orchestra.run.smithi104.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-03T05:16:14.845 INFO:teuthology.orchestra.run.smithi104.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-03T05:16:14.846 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-04-03T05:16:14.846 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m20.989s 2024-04-03T05:16:14.846 INFO:teuthology.orchestra.run.smithi104.stderr:user 1m3.664s 2024-04-03T05:16:14.846 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m2.346s 2024-04-03T05:16:14.847 INFO:tasks.ceph:Archiving logs... 2024-04-03T05:16:14.847 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/remote/smithi104/log 2024-04-03T05:16:14.849 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-03T05:16:22.710 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/remote/smithi130/log 2024-04-03T05:16:22.711 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-03T05:16:28.634 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-03T05:16:28.646 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-03T05:16:28.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-03T05:16:28.649 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-03T05:16:28.727 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-03T05:16:28.737 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-03T05:16:28.738 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-03T05:16:28.741 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-03T05:16:28.754 INFO:teuthology.orchestra.run.smithi104.stdout: remote refid st t when poll reach delay offset jitter 2024-04-03T05:16:28.754 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================== 2024-04-03T05:16:28.755 INFO:teuthology.orchestra.run.smithi104.stdout:*hv01.front.sepi 44.4.53.2 2 u 122 256 377 0.196 -0.742 0.189 2024-04-03T05:16:28.755 INFO:teuthology.orchestra.run.smithi104.stdout:+hv02.front.sepi 63.231.80.2 3 u 224 256 377 0.127 +0.130 0.156 2024-04-03T05:16:28.755 INFO:teuthology.orchestra.run.smithi104.stdout:+hv03.front.sepi 74.6.168.72 3 u 234 256 377 0.159 -1.412 0.221 2024-04-03T05:16:28.755 INFO:teuthology.orchestra.run.smithi104.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-03T05:16:28.758 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2024-04-03T05:16:28.758 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2024-04-03T05:16:28.758 INFO:teuthology.orchestra.run.smithi130.stdout:*hv01.front.sepi 44.4.53.2 2 u 41 128 377 0.089 -0.337 0.052 2024-04-03T05:16:28.758 INFO:teuthology.orchestra.run.smithi130.stdout:+hv02.front.sepi 63.231.80.2 3 u 71 128 377 0.104 +0.448 0.168 2024-04-03T05:16:28.759 INFO:teuthology.orchestra.run.smithi130.stdout:+hv03.front.sepi 74.6.168.72 3 u 81 128 377 0.118 -1.120 0.049 2024-04-03T05:16:28.759 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-03T05:16:28.759 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-03T05:16:28.770 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-03T05:16:28.771 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-03T05:16:28.782 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-03T05:16:28.792 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-03T05:16:28.803 INFO:teuthology.task.internal:Duration was 6515.493162 seconds 2024-04-03T05:16:28.803 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-03T05:16:28.815 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-03T05:16:28.815 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-03T05:16:28.817 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-03T05:16:28.853 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-03T05:16:28.854 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-04-03T05:16:28.854 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-03T05:16:28.907 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-04-03T05:16:28.907 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-03T05:16:28.917 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-03T05:16:28.917 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-03T05:16:28.951 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-03T05:16:28.984 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-03T05:16:28.985 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-03T05:16:29.019 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-03T05:16:29.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-03T05:16:29.095 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-03T05:16:29.095 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-03T05:16:29.107 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-03T05:16:29.120 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-03T05:16:29.131 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-03T05:16:29.150 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-03T05:16:29.159 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-04-03T05:16:29.173 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-04-03T05:16:29.207 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-03T05:16:29.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T05:16:29.217 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-03T05:16:29.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-03T05:16:29.255 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-03T05:16:29.266 INFO:teuthology.task.internal:Transferring archived files... 2024-04-03T05:16:29.267 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/remote/smithi104 2024-04-03T05:16:29.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-03T05:16:29.289 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874/remote/smithi130 2024-04-03T05:16:29.290 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-03T05:16:29.318 INFO:teuthology.task.internal:Removing archive directory... 2024-04-03T05:16:29.318 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-03T05:16:29.327 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-03T05:16:29.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-03T05:16:29.372 INFO:teuthology.task.internal:Not uploading archives. 2024-04-03T05:16:29.372 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-03T05:16:29.383 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-03T05:16:29.383 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-03T05:16:29.386 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-03T05:16:29.389 INFO:teuthology.orchestra.run.smithi104.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 3 05:16 /home/ubuntu/cephtest 2024-04-03T05:16:29.407 INFO:teuthology.orchestra.run.smithi130.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 3 05:16 /home/ubuntu/cephtest 2024-04-03T05:16:29.409 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-03T05:16:29.421 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-03T05:16:29.444 INFO:teuthology.nuke:Checking targets against current locks 2024-04-03T05:16:29.470 DEBUG:teuthology.nuke:shortname: smithi104 2024-04-03T05:16:29.470 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-03T05:16:29.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-03 03:19:22.102134', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFLgZ6zNouvHIjgv2P77XxyefnUSV3rLK0sfVfL+8JEn65Gu0Y7QNLktBsCBHDPibdl+QzzrV7J/PAImqYFj4aA='} 2024-04-03T05:16:29.496 DEBUG:teuthology.nuke:shortname: smithi130 2024-04-03T05:16:29.497 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-03T05:16:29.519 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-03_02:50:19-rgw-wip-cbodley-testing-distro-default-smithi/7637874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-03 03:19:22.103603', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDe9QW5qhbgo38kVyahGLMl0uKnW4+nvI8vXE9zS2067sunmND40vD69pCYCHUDkdh1cmlt+SE0nSU7gK3qg6D4='} 2024-04-03T05:16:29.549 INFO:teuthology.orchestra.console.smithi104:Power off 2024-04-03T05:16:29.550 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-03T05:16:29.588 INFO:teuthology.orchestra.console.smithi130:Power off 2024-04-03T05:16:29.588 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-03T05:16:29.598 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2024-04-03T05:16:29.598 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T05:16:29.611 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2024-04-03T05:16:29.612 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T05:16:29.622 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-03T05:16:29.636 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-03T05:16:33.624 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T05:16:33.637 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T05:16:33.733 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-03T05:16:33.745 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-03T05:16:37.734 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T05:16:37.745 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T05:16:37.845 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-03T05:16:37.855 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2024-04-03T05:16:37.958 INFO:teuthology.orchestra.console.smithi130:Power off completed 2024-04-03T05:16:41.849 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-03T05:16:41.958 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-03T05:16:42.059 INFO:teuthology.orchestra.console.smithi104:Power off completed 2024-04-03T05:16:42.163 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 6515.493161916733 failure_reason: '"2024-04-03T03:40:00.000124+0000 mon.a (mon.0) 296 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg peering" in cluster log' flavor: default owner: scheduled_cbodley@teuthology success: false 2024-04-03T05:16:42.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-03T05:16:42.249 INFO:teuthology.run:FAIL